Senior Data Engineer - Remote

Job Summary

We are looking for a Senior Data Engineer with strong Python and data engineering experience to build scalable data platforms and pipelines using Azure, Databricks, and Snowflake.

Key Responsibilities

• Design and develop scalable ETL/ELT data pipelines.
• Build data ingestion frameworks using Python, APIs, and distributed processing.
• Develop Databricks pipelines using PySpark and Delta Lake.
• Work with Snowflake, Azure Data Factory, ADLS Gen2, and Azure Synapse.
• Design Medallion Architecture, CDC, data models, and data quality frameworks.
• Develop REST/GraphQL API integrations with authentication, retry, and error handling.
• Optimize pipeline performance, reliability, and cloud costs.
• Support batch, real-time, and event-driven data processing.
• Collaborate with AI engineers, architects, product teams, and business stakeholders.
  
  

Required Skills

• 5+ years of Data Engineering experience.
• Strong Python and Advanced SQL skills.
• Hands-on experience with Databricks, PySpark, Delta Lake, and Snowflake.
• Strong knowledge of Azure Data Factory, ADLS Gen2, and Azure Synapse.
• Experience with REST/GraphQL APIs, OAuth2/JWT, and API integrations.
• Knowledge of data architecture, CDC, Medallion Architecture, and dimensional modeling.
• Experience with Git and CI/CD.
  
  

Good To Have

Airflow, dbt, Kafka, Terraform, Azure OpenAI, and AI/ML data pipelines.

Skills: git,azure,architecture,python,api,rest,data architecture,two-factor authentication,snowflake,oauth,databricks