Data Engineer
Job Description
We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders.
Key Responsibilities
Key Responsibilities
- Design and develop scalable data pipelines using AWS services.
- Implement ETL processes with AWS Glue, Lambda, and DBT.
- Work with PySpark and SQL to transform and cleanse data.
- Configure and manage Airflow workflows and Amazon EMR clusters.
- Integrate data services with API Gateway and REST/Soap APIs.
- 3 to 5 years of experience in data engineering.
- Proficient in AWS S3, Glue, Lambda, DBT, PySpark, SQL, API Gateway, EMR, Airflow.
- Hands‑on experience with REST and SOAP APIs.
- Strong client communication and basic project lifecycle management.
- Data modelling experience.
More Info
About Company
Skills:
Sql, Google Cloud, ELT, Apache Airflow, Nosql, Jenkins, Git, Docker, Azure, Python, AWS, Etl
Skills:
Apache Airflow, Pyspark, Spark, Databricks, Azure, Python, Sql, Fabric, ETL pipelines
Skills:
Sql Performance Tuning, Azure Data Factory, Power Bi, Pyspark, Apache Spark, Azure Databricks, Data Governance Unity Catalog, Microsoft DP-203 certification, CI CD for ADF Databricks, Azure Data Lake Gen2
Skills:
Apache Airflow, Github, Pyspark, Spark, Azure Databricks, Azure Storage, Python, CodeQL, Cycode
Skills:
data engineering , snowflake , Apis, Power Bi, Json, Sql, Apache Airflow, Git, Azure Data Factory, Xml, Python, AWS, ELT, Etl, Matillion, dbt, Fivetran