Title: Sr Data Engineer
Years of experience: 10+years
Location: Bengaluru
QUALIFICATIONS:
- Bachelor's or Master's in Computer Science, Information Systems, Statistics, or related field.
- 10+ years of experience in data engineering with strong software development foundations.
- 5+ years of hands-on experience with Azure Data Factory, ADLS Gen 2, Databricks (database/warehouse design), and SQL Server.
- Proficiency in Python, SQL, Spark
- Experience with ETL orchestration tools (Databricks Workflows, Airflow, Dagster, Prefect, etc.).
- Expertise in REST APIs, web services, and data quality validation.
- Strong analytical skills with a meticulous approach to data accuracy.
TECHNICAL ENVIRONMENT:
- Azure Data Stack (Databricks, SQL Server, Data Factory, ADLS Gen 2)
- Python programming
- Version Control (Git, Azure DevOps)
- Infrastructure as Code
- Power BI and PowerApps
- REST APIs and Web services
RESPONSIBILITIES:
- Manage Azure Databricks, Azure SQL Server, Azure Data Factory, Power BI, and PowerApps environments, ensuring scalability and reliability.
- Develop and optimize data pipelines, implementing robust and fault-tolerant systems for data ingestion and processing.
- Establish and enforce data quality standards, leveraging validation checks and automated testing frameworks.
- Analyze data patterns, rigorously evaluating data assets to detect logical inconsistencies and anomalies.
- Document data models, pipelines, and dictionaries for both technical and non-technical stakeholders.
- Collaborate with stakeholders to understand analytical needs and design scalable, well-structured data solutions.
WHY YOU WOULD THRIVE IN THIS ROLE:
- You love working with data and enjoy building high-impact solutions.
- You have a meticulous eye for detail and proactively address data quality issues.
- You translate complex business needs into structured, scalable data models.
- You take pride in creating reliable, trustworthy data assets that drive decision-making
