About Position:
As a Senior Data Engineer, you will play a key role in designing, building, and maintaining the data pipelines, models, and reporting structures that underpin risk-management platform. You will develop cloud-native data solutions that transform operational data into clean, scalable, and analytics-ready datasets that support reporting, dashboards, and cross-team consumption. You bring strong expertise in Python-based data engineering, ELT design, data modeling, and building robust data flows in AWS.
- Role: Senior Data Engineer
- Location: Pune
- Experience: 5 to 10 Years
- Job Type: Full-Time Employment
What You'll Do:
- Design, build, and maintain Python-based data pipelines to process, transform, and enrich operational and analytical data.
- Implement ELT workflows, including ingestion, cleaning, transformation, aggregation, and historical modeling.
- Develop and maintain AWS-native data environments using S3, Redshift Spectrum, and related AWS services.
- Build Amazon Quick Sight dashboards and reports, delivering actionable insights to customers and internal users.
- Integrate data from multiple, heterogeneous sources into unified, well-structured datasets.
- Implement and optimize schema designs, partitioning strategies, file formats, and metadata practices (including Apache Avro and Parquet).
- Develop or support the development of .NET (C#) microservices that expose curated data via RESTful APIs.
- Work with product managers, analysts, and engineers to understand data requirements, ensuring solutions meet performance and reliability needs.
- Enhance data quality, governance, and observability through validation, error handling, and lineage best practices.
- Troubleshoot and resolve data issues, improving performance and reliability across data pipelines and storage layers.
- Participate in code reviews, design discussions, and planning sessions to ensure engineering excellence.
- Contribute to continuous improvement of data processes, tooling, and development patterns.
Expertise You'll Bring:
- Bachelor's degree in computer science, Engineering, Data Science, or equivalent experience.
- 5+ years of experience in data engineering or software engineering with strong exposure to cloud-native data pipelines.
- Strong experience building Python-based data workflows and ETL/ELT pipelines.
- Hands-on experience with AWS data services, especially:
- S3 data lakes/marts
- Redshift / Redshift Spectrum
- Solid understanding of Apache Avro, Parquet, ORC, or other structured/columnar formats.
- Strong proficiency in SQL, analytical query design, and performance tuning.
- Experience developing Quick Sight dashboards or similar BI reporting solutions.
- Experience integrating multiple data sources into unified, query-efficient structures.
- Ability to work with .NET/C# for light API or microservice development.
- Strong understanding of data quality, pipeline reliability, and monitoring practices.
- Excellent problem-solving, debugging, and communication skills.
- Ability to work independently while collaborating effectively within a cross-functional engineering team.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent - persistent.com/careers
Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.
