Data Engineer

About Position:

As a Data Engineer, you will design and manage robust data pipelines using Azure Databricks, Spark, and Kafka. You'll process large-scale datasets and implement CDC pipelines to power analytics platforms. Your role includes modeling data using the Medallion Architecture and ensuring data quality and governance. Collaboration with analytics teams for visualization and insights is key to success.

• Role: Data Engineer
• Location: Mumbai
• Experience: 5 to 11 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory and Azure Databricks.
• Implement Change Data Capture (CDC) pipelines to ingest data from origination and servicing platforms into the analytics ecosystem.
• Process and transform large-scale datasets using PySpark, Spark SQL, and Kafka for real-time and batch data processing.
• Model data using the Medallion Architecture (Bronze, Silver, Gold layers) to support structured and governed data flows.
• Ensure data quality, lineage, and compliance with governance standards across all stages of the data lifecycle.
• Collaborate with analytics teams and support data visualization using Power BI for business insights.

Expertise You'll Bring:

• Strong hands-on experience with Azure Databricks, Spark, Kafka, PySpark, and Power BI.
• Proficiency in building data pipelines and implementing CDC mechanisms.
• Solid understanding of data modeling principles and data governance best practices.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.