Senior Data Engineer
Job Description
Job Summary
We are looking for a Senior Data Engineer to design, develop, and maintain scalable data pipelines and modern data solutions. The ideal candidate should have strong experience with Databricks, Snowflake, SQL, Python, ETL, and cloud platforms.
Key Responsibilities
- Design and develop scalable ETL/ELT data pipelines.
- Build and optimize data processing solutions using Databricks and PySpark.
- Develop and manage data solutions using Snowflake.
- Develop complex data transformations using Python and SQL.
- Build and maintain data warehouses, data lakes, and lakehouse solutions.
- Perform data integration, transformation, cleansing, and validation.
- Optimize queries, pipelines, and data processing performance.
- Work with cloud platforms such as AWS, Azure, or GCP.
- Ensure data quality, security, reliability, and governance.
- Collaborate with Data Architects, Analysts, Developers, and business teams.
- Troubleshoot data pipeline and production issues.
- Mentor junior engineers and contribute to technical design decisions.
Required Skills
- 7+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Strong experience with Snowflake.
- Advanced SQL and Python skills.
- Experience with PySpark / Apache Spark.
- Strong experience with ETL/ELT and data pipeline development.
- Strong understanding of Data Warehousing and Data Modeling.
- Experience with AWS, Azure, or GCP.
- Experience with Git and CI/CD.
- Good understanding of data integration, data quality, and performance optimization.
Preferred Skills
- Apache Kafka / Streaming
- Apache Airflow
- Terraform
- AWS Glue / Azure Data Factory
- Delta Lake
- Cloud-native data engineering
- Data governance and security
More Info
Key Skills
Cloud-native data engineering
Delta Lake
CI/CD
About Company
Skills:
snowflake , Data Management, Hadoop, Performance Tuning, Data Modeling, Dimensional Modeling, Redshift, Sql, Data Quality, Hive, Spark, Data Integration, Python, Airflow, big data systems, data warehouse scaling, ETL pipelines
Skills:
monte carlo , snowflake , Azure, Python, Sql, Azure DevOps, GitHub Actions, dbt, Fivetran, Atlan, Immuta
Skills:
Pyspark, Azure Databricks, Sql, Git, Data Quality Governance, ADLS Gen2, Medallion Architecture, DLT, Auto Loader, Unity Catalog, Delta Lake, Structured Streaming, CI-CD, Databricks Workflows
Skills:
Apache Airflow, Pyspark, Spark, Databricks, Azure, Python, Sql, Fabric, ETL pipelines
Skills:
Apis, Dashboards, Data Modeling, Sql, ELT, Data Integration, Data Transformation, Etl, Operational documentation, Root Cause Analysis, Cloud data platforms, Data Analysis, Enterprise data warehouses, Support handoff, Production Support, Data quality checks, Ticket governance, Incident resolution, Analytics environments, Data pipelines, Manufacturing data