Overview
The Data & Insights organization at Insight Global is responsible for delivering Trusted Data & Verified Insights to drive business decisions across the company. As a Data Engineer based in Hyderabad, India, you will be part of a newly established offshore team focused on building and maintaining scalable data pipelines, supporting platform operations, and enabling analytics, data science, and machine learning use cases.
This is a hands-on role reporting to the Data Engineering Manager with direct impact on Insight Global's ability to deliver high-quality, actionable data to the business.
Primary Responsibilities
- Design and build scalable, reliable data pipelines for analytics and data science.
- Monitor and maintain data pipelines, automate operational tasks, and ensure SLA adherence.
- Troubleshoot and fix bugs across the data platform, contributing to platform stability and performance.
- Improve data quality, performance, and process efficiency.
- Develop and maintain metadata catalogs and optimize resource usage.
- Apply CI/CD and automated testing to ensure code quality and deployment reliability.
- Collaborate across business, analytics, and IT teams to deliver data solutions.
- Work with structured and unstructured data in both batch and streaming environments.
- Participate in on-call rotations and support deployment activities.
Required Skills
- 5+ years of experience in Data Engineering, Analytics, or Software Engineering.
- Strong SQL skills for data analysis and pipeline development.
- Proficiency in Python (PySpark) for data pipeline creation and troubleshooting.
- Experience with Databricks and Azure Data Factory.
- Effective communication and collaboration across technical and business teams.
- Experience structuring data for analytics and machine learning.
Preferred Skills
- Experience with Databricks Unity Catalog.
- Familiarity with data modeling and diagramming tools.
- Focus on continuous improvement and data quality.
- Exposure to operational monitoring and incident response practices.
This Role Is Ideal If You:
- Are excited to be part of a growing offshore team and help shape its success.
- Thrive in Agile environments and enjoy working across disciplines.
- Take ownership of both development and operational responsibilities.
- Are passionate about delivering reliable, high-quality data solutions.
- Embody Insight Global's shared values and contribute to a collaborative, high-performance culture.
