Data Engineer

Job Title: Data Engineer

Location: Pune

Experience: 4–8 Years

Employment Type: Full-Time

About the Role

We are looking for a skilled Data Engineer to join our growing team in Pune. In this role, you will design, build, and deploy scalable data engineering solutions that enable customers to gain actionable insights from their material handling systems. You will work on modern data platforms, develop end-to-end data pipelines, and implement dashboards while collaborating with global cross-functional teams in an Agile environment.

Key Responsibilities

• Design, develop, and implement scalable data pipelines and data engineering solutions.
• Build, deploy, and automate ETL/ELT pipelines using Databricks and PySpark/Spark.
• Develop robust data models and optimize SQL queries for high-performance analytics.
• Create and deploy dashboards using Splunk, Grafana, Power BI, Tableau, or similar visualization tools.
• Work with structured and semi-structured data formats such as JSON, XML, and Avro.
• Deploy and manage containerized applications using Docker and Kubernetes.
• Collaborate with global stakeholders to understand business requirements and deliver high-quality data solutions.
• Participate in Agile/Scrum ceremonies, including sprint planning, story creation, refinement, and retrospectives.
• Monitor, troubleshoot, and improve data quality, pipeline reliability, and overall platform performance.
• Continuously identify opportunities to enhance existing products, processes, and customer solutions.

Required Skills & Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 4–8 years of experience in Data Engineering, Data Pipeline Development, or Big Data technologies.
• Strong hands-on experience with Databricks.
• Proficiency in Java and SQL.
• Strong experience in PySpark/Spark for distributed data processing.
• Hands-on experience with Data Modeling.
• Experience with data formats such as JSON, XML, and Avro.
• Experience with data visualization tools such as Splunk, Grafana, Power BI, or Tableau.
• Experience with Docker and Kubernetes.
• Hands-on experience with cloud platforms, preferably Microsoft Azure.
• Strong communication and stakeholder management skills.

Good to Have

• Knowledge of Splunk SPL.
• Experience with Kafka or other streaming platforms.
• Experience with batch and streaming data architectures.
• Knowledge of data quality, monitoring, and observability frameworks.
• Experience working in Agile/Scrum environments.

Primary Skills

• Databricks
• Java
• SQL
• PySpark / Apache Spark
• Data Engineering
• Data Modeling
• Azure

Secondary Skills

• Splunk (SPL)
• Grafana / Power BI / Tableau
• Docker
• Kubernetes
• Kafka
• JSON / XML / Avro
• Data Quality & Monitoring
• Agile / Scrum

What We Offer

• Opportunity to work on large-scale, cloud-based data platforms.
• Exposure to global customers and enterprise data solutions.
• Collaborative, diverse, and innovation-driven work environment.
• Career growth with modern Data Engineering and Cloud technologies.
• Flexible and Agile working culture.