Required Skills
- 4+ years of experience in Data Engineering, Analytics, or Software Engineering.
- Strong SQL skills for data analysis and pipeline development.
- Proficiency in Python (PySpark) for data pipeline creation and troubleshooting.
- Experience with Databricks and Azure Data Factory.
- Experience structuring data for analytics and machine learning.
Overview
The Data & Insights organization at Insight Global is responsible for delivering Trusted Data & Verified Insights to drive business decisions across the company. As a Data Engineer based in Hyderabad, India, you will be part of a newly established offshore team focused on building and maintaining scalable data pipelines, supporting platform operations, and enabling analytics, data science, and machine learning use cases.
This is a hands-on role reporting to the Data Engineering Manager with direct impact on Insight Global's ability to deliver high-quality, actionable data to the business.
Primary Responsibilities
- Design and build scalable, reliable data pipelines for analytics and data science.
- Monitor and maintain data pipelines, automate operational tasks, and ensure SLA adherence.
- Troubleshoot and fix bugs across the data platform, contributing to platform stability and performance.
- Improve data quality, performance, and process efficiency.
- Develop and maintain metadata catalogs and optimize resource usage.
- Apply CI/CD and automated testing to ensure code quality and deployment reliability.
- Collaborate across business, analytics, and IT teams to deliver data solutions.
- Work with structured and unstructured data in both batch and streaming environments.
- Participate in on-call rotations and support deployment activities.
