About Position:
As a Senior Associate L2 / Manager in Data Engineering, you will be responsible for translating client business requirements into robust technical designs and delivering scalable data engineering solutions across cloud and onprem environments. This role combines handson technical leadership with architecture ownership, ensuring highquality delivery of big data platforms and analytics pipelines. You will independently drive design discussions, guide teams through complex implementations, and ensure solution health across performance, security, governance, and scalability, while working closely with client stakeholders in an Agile delivery model.
- Role: Dev Lead
- Location: Bengaluru, Mumbai, hyderabad
- Experience: 3 to 5 years
- Job Type: Full Time Employment
What You'll Do:
- Translate client requirements into technical designs and endtoend data engineering solutions
- Architect and implement cloud and noncloud big data platforms
- Lead design discussions across data ingestion, transformation, storage, computation, and consumption
- Build and maintain batch and streaming data pipelines
- Implement ETL/ELT pipelines using distributed processing frameworks
- Drive performance optimization, scalability, and reliability of data solutions
- Design and implement solutions using Hadoop ecosystem components
- Ensure data governance, security, privacy, and quality standards are met
- Set up and manage secure big data platforms, including authentication and authorization
- Orchestrate workflows using enterprise pipeline orchestration tools
- Provide technical leadership and handson guidance to delivery teams
- Lead teams delivering solutions on cloud (AWS/GCP/Azure) and onprem platforms
- Participate in client workshops and help align stakeholders to optimal architecture choices
- Manage functional and nonfunctional scope, SLAs, and delivery quality
- Mentor team members and contribute to thought leadership and best practices
- Support hiring, people management, and capability building initiatives
- Act as a trusted technical advisor to clients across programs
Expertise You'll Bring:
- 3+ years of overall IT experience
- 3+ years of handson experience with Big Data technologies
- 1+ year experience delivering data solutions on AWS, Azure, or GCP
- Experience delivering at least one endtoend Big Data architecture as a technical lead or architect
- Strong understanding of Big Data architecture patterns
- Expert-level knowledge of Hadoop ecosystem (Cloudera or cloud distributions)
- Strong programming skills in Java or Scala (Python good to have)
- Expertise in data ingestion tools such as Sqoop, Flume, NiFi
- Experience with distributed messaging systems like Kafka, Pulsar, Pub/Sub
- Strong experience with Spark (Core, Streaming, SQL) and/or Storm, Flink
- Experience with MPP query engines such as Impala, Presto, Athena
- Handson experience with NoSQL databases (MongoDB, Cassandra, HBase) or cloud NoSQL (DynamoDB, BigTable)
- Knowledge of cluster security, including dataatrest and dataintransit protection
- Experience implementing monitoring and alerting for big data platforms
- Handson experience with orchestration tools such as Oozie, Airflow, ControlM
- Proven experience with performance tuning, optimization, and data security
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent - persistent.com/careers
Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.
