Senior Data Engineer - Azure

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Role : Senior Data Engineer - Azure

Experience : 4 - 7 Years

Location : Mumbai/Bangalore

Role & Responsibilities:

• Developing the data integration solutions to bring data from various sources into Azure, ensuring data quality and consistency.

• Choosing and implementing appropriate Azure data storage solutions for different data types and optimizing for performance and cost.

• Implementing data processing solutions using Azure services, optimizing for performance and scalability.

• Executing data migration projects, including migrations from on-premises environments to Azure and between different cloud platforms.

• Establishment and enforcement of data governance policies, ensuring data is compliant with regulations and industry standards.

• Monitoring data solutions for performance and cost, making necessary adjustments for optimization.

• Create data models as per client solution needs

• Documentation for data architecture and solutions

• Collaboration with cross-functional teams, including data engineers, data scientists, and business stakeholders, to ensure data solutions meet business needs.

• Adhering to project timelines

• Communicate with non-technical stakeholders to understand their data requirements and convey the benefits of data solutions, including migration strategies

Must have skills:

• Profound knowledge and expertise in Microsoft Azure, including Azure Data services like Azure SQL Database (MS SQL), Azure Data Lake Storage, Azure Synapse, Azure Databricks, Azure Data Factory etc.

• Strong skills in data modeling to design efficient and scalable data solutions.

• Proficiency in data integration techniques, ETL processes, and data pipeline development using Azure services.

• In-depth understanding of data governance principles, data security, and compliance requirements (e.g., GDPR, HIPAA), and the ability to implement these in Azure environments.

• Experience with database management systems, both relational and NoSQL, and the ability to choose the right storage solutions for different data types.

• Proficiency in SQL for querying and working with relational databases, as well as knowledge of NoSQL databases

• Familiarity with data analysis tools and reporting platforms such as Power BI, Tableau, or similar.

• Strong programming skills in languages like Python, Java, or C# for scripting, automation, and data manipulation.

• The ability to manage data-related projects, work collaboratively with cross-functional teams, and meet project deadlines

• Strong documentation skills and excellent communication skills for conveying complex technical concepts to non-technical stakeholders

Good to have skills:

• Relevant Microsoft Azure certifications, such as Azure Data Engineer or Azure Solutions Architect, can enhance your credibility.

• Knowledge of big data technologies like Hadoop and Spark for handling large datasets.

• Familiarity with machine learning concepts and Azure Machine Learning for implementing data-driven models.

• Experience with DevOps practices and continuous integration/continuous deployment (CI/CD) pipelines for data solutions.

• Understanding of real-time data processing and streaming technologies, such as Azure Stream Analytics.

• Skills in advanced analytics, data mining, and statistical analysis are good to have.