Data Engineer

We are looking for a Cloud Data Engineer to build and automate robust data pipelines on cloud platforms. You will transform raw data into usable formats for data scientists and analysts.

Job Description:

Key Responsibilities:

• :Design and deploy automated ETL/ELT pipelines to ingest data from various sources (APIs, databases, logs) into cloud data warehouses
• .Maintain cloud storage solutions (Data Lakes and Data Warehouses)
• .Monitor and tune query performance and cloud resource consumption to manage costs

Technical Requirements:

1. Cloud Platforms: AWS (Redshift, S3, Glue), Azure (Data Factory, Synapse), or GCP (BigQuery, Dataflow)
2. Languages: Advanced SQL (essential) and Python
3. Data Processing: Apache Spark, Flink, or Kafka for real-time streaming
4. Orchestration: Apache Airflow, dbt, or Prefect