We are seeking an experienced Senior Data Engineer with strong expertise in Databricks, Python, and cloud-based data platforms. The role involves designing, developing, and optimizing scalable data pipelines, enabling advanced analytics, and collaborating with crossfunctional teams to deliver highquality data solutions.
Key Responsibilities
- Design, build, and maintain robust data pipelines using Databricks, Spark, and Delta Lake
- Develop and optimize data processing workflows using Python and SQL
- Work with large, complex datasets to derive actionable business insights
- Implement and manage data solutions on cloud platforms (AWS, Azure, or GCP)
- Collaborate with data scientists, analysts, and stakeholders to support analytics and ML use cases
- Ensure data quality, reliability, and performance across platforms
- Participate in Agile development processes including sprint planning and reviews
- Provide technical guidance and support to junior team members
- Communicate insights and technical concepts clearly to both technical and nontechnical audiences
Mandatory Skills & Experience
- 8+ years of handson experience in Data Engineering / Data Streams
- Strong handson experience with:
- Databricks
- Apache Spark
- Delta Lake
- MLflow
- Advanced proficiency in Python for data analysis and engineering
- Strong SQL skills for querying and optimizing large datasets
- Experience with cloud data services on AWS, Azure, or GCP
- Excellent problemsolving and analytical skills
- Ability to work independently as well as in a teamoriented environment
- Strong written and spoken English communication skills
