Data Engineer

Data Engineer

Location: Pune

Experience: 5–9 Years

Employment Type: Full-Time

Job Summary

We are looking for an experienced Data Engineer to join our team in Pune. The ideal candidate will have strong hands-on experience in building, deploying, and automating scalable data pipelines and data solutions. You will work on end-to-end data ingestion, processing, data modeling, visualization, and dashboarding solutions while collaborating with global customers and cross-functional teams.

The role requires strong expertise in Databricks, Java, SQL, Spark/PySpark, data modeling, and cloud technologies, preferably Azure.

Key Responsibilities

• Design, develop, and implement scalable data pipelines and data solutions.
• Build end-to-end data ingestion, transformation, and processing pipelines.
• Deploy and automate data pipelines and dashboards for customer implementations.
• Develop and maintain data models, schemas, and data processing workflows.
• Work with distributed data processing technologies such as Apache Spark/PySpark.
• Develop solutions using Databricks for large-scale data processing.
• Build and optimize dashboards and data visualizations using Splunk, Grafana, Power BI, Tableau, or similar tools.
• Develop and maintain data-driven services using Java and SQL.
• Work with structured and semi-structured data formats including JSON, XML, and Avro.
• Deploy applications and data services using Docker and Kubernetes.
• Work with cloud platforms, preferably Microsoft Azure.
• Design and implement batch and streaming data solutions using technologies such as Kafka.
• Ensure data quality, monitoring, reliability, and performance of data pipelines.
• Collaborate with international, cross-functional teams to understand requirements and deliver customer-focused solutions.
• Take ownership of projects from solution design and development through deployment and client handover.
• Participate in Agile/Scrum activities including story creation, refinement, planning, and continuous improvement.
• Communicate effectively with customers, stakeholders, and internal technical teams.

Required Skills & Experience

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 5–9 years of experience in Data Engineering, data pipelines, or data solutions.
• Strong hands-on experience with Databricks.
• Strong programming experience in Java.
• Strong proficiency in SQL and data modeling.
• Hands-on experience with Apache Spark / PySpark.
• Experience with data visualization tools such as Splunk, Grafana, Prometheus, Power BI, or Tableau.
• Good knowledge of Splunk SPL is an advantage.
• Experience working with JSON, XML, Avro, or similar data schemas.
• Experience with Docker and Kubernetes.
• Experience with cloud services, preferably Microsoft Azure.
• Knowledge of Kafka or other streaming platforms is a plus.
• Understanding of data quality, monitoring, and validation.
• Strong analytical, problem-solving, and troubleshooting skills.
• Excellent communication skills in English.

Good to Have

• Experience working with real-time/streaming data pipelines.
• Knowledge of Kafka and event-driven architectures.
• Experience with data quality frameworks and monitoring solutions.
• Experience working in Agile/Scrum environments.
• Experience working with international customers or distributed teams.

Why Join Us

• Work on innovative data intelligence and analytics solutions.
• Opportunity to work with global customers and multidisciplinary teams.
• Exposure to modern technologies including Databricks, Spark, Azure, Kafka, Docker, Kubernetes, and Splunk.
• Be part of an Agile environment focused on innovation, ownership, and continuous improvement.

Thanks,

Renuka