πŸš€
muse-data-engineer
  • muse-data-engineer
  • Data Ingestion
    • Kafka
      • binlog
      • cdc
    • Embulk
      • embulk
      • embulk_code
  • Batch Processing
    • Hadoop
      • hadoop_hdfs
      • hadoop_map_yarn
      • hadoop eco system
    • Spark
      • spark_base
      • Spark νŠœλ‹
      • spark_optimization
      • spark_yarn
      • spark_cluster_manager
      • 쑰인과 μ…”ν”Œ
    • Batch SQL
      • Hive
        • hive_base
        • Hive Architecture
        • hive_format
        • hive_hiveql
      • Presto
        • presto_base
        • presto_query_processing
        • presto_tuning
        • trino_base
  • workflow
    • Airflow
      • κ°œμš”
      • μ•„ν‚€ν…μ²˜
    • dbt_base
    • prefect_base
  • Back-End Development
    • infra_based
    • onpremises_cloud
    • msa
    • Kubernetes
      • kubernetes_base
      • kubernetes_object
      • kubernetes_pod
      • kubernetes_replica
      • kubernetes_service
      • kubernetes_volume
      • kubernetes_config_secret
      • kubernetes_deployment
  • BI
    • olap
    • data_modeling_dw_dm
    • data_lake
  • Programming Language
    • Python
      • python_profiling
      • python_comfile
      • python_Async
      • python_multiprocessing
Powered by GitBook
On this page
  1. Batch Processing

Spark

Previoushadoop eco systemNextspark_base

Last updated 1 year ago

spark_base
Spark νŠœλ‹
spark_optimization
spark_yarn
spark_cluster_manager
쑰인과 μ…”ν”Œ