Senior Data Engineer

Required:

Technical Skills:

• 10+ years of experience in data engineering or backend data systems
• Strong proficiency in Python (production-grade code, testing, packaging)
• Advanced SQL skills (complex joins, window functions, performance tuning)
• Hands-on experience with Databricks and Apache Spark
• Strong experience with Snowflake (data modeling, performance optimization)
• Experience working with AWS S3 or equivalent cloud object storage
• Hands-on experience with job schedulers/orchestrators (Airflow, Databricks Jobs, Prefect, etc.)

Data Engineering Best Practices

• Experience designing ETL / ELT pipelines
• Knowledge of data warehousing concepts (star/snowflake schemas)
• Experience implementing incremental loads, CDC, and backfills
• Understanding of data security, access control, and governance

Good to have:

• Experience with CI/CD for data pipelines
• Familiarity with Terraform or infrastructure-as-code
• Experience with streaming technologies (Kafka, Kinesis)
• Knowledge of data quality frameworks (Great Expectations, dbt tests)
• Experience in high-volume, high-availability data environments
• Experience in multi-cloud or hybrid environments
• Exposure to ML feature pipelines
• Familiarity with data cataloging and lineage tools