Data Engineer

Job Overview

Design, build, and maintain robust, scalable, and high-performance data pipelines (batch and streaming).

Develop and optimize ETL/ELT workflows using modern orchestration tools (e.g., Airflow, dbt, ADF, Databricks, Prefect).

Collaborate with Data Scientists, Analysts, and Business stakeholders to ensure data models support analytical and AI/ML needs.

Integrate data from multiple sources (SQL/NoSQL databases, APIs, flat files, etc.) into centralized warehouses or lakehouses.

Implement and enforce data quality, integrity, and governance standards across the pipeline.

Work with cloud platforms (Azure, AWS, or GCP) for data storage, compute, and orchestration.

Contribute to data schema design, query optimization, and performance tuning.

Maintain detailed technical documentation for pipelines, jobs, and data models.

Actively participate in code reviews, design discussions, and production support.

Job Qualification

• 1-3 years of experience

Programming: Python (Pandas, PySpark, SQLAlchemy), SQL (advanced query writing

and optimization)

ETL / Orchestration Tools: Apache Airflow, Azure Data Factory, or Prefect

Data Processing Frameworks: PySpark / Spark