Now Hiring: Senior Data Engineer
Locations: Hyderabad | Pune | Bangalore | Chennai
Job Type: Full-Time
Experience: 610 Years
We are looking for an experienced Senior Data Engineer to join our growing data organization. In this role, you will design, build, and optimize scalable data pipelines and infrastructure that power our analytics, AI initiatives, and business decision-making. If you are passionate about cloud-native engineering, AI workflows, and high-impact data systems, we want to hear from you.
What You'll Do
- AI Integration: Build and deploy LLM-powered workflows including RAG pipelines, agent frameworks, and AI-driven data processes (LangChain, LangGraph, CrewAI, etc.).
- Data Pipeline Engineering: Design, develop, and maintain reliable, scalable ETL/ELT pipelines using Python and Azure.
- Collaboration: Work closely with data scientists, analysts, and engineering teams to deliver high-quality, data-driven solutions.
- Automation & Deployment: Containerize and deploy data services using Docker, Kubernetes, and CI/CD pipelines across Azure/AWS/GCP.
- Data Governance & Observability: Ensure data quality, compliance, monitoring, and security best practices.
- Documentation: Maintain clear, high-quality technical documentation.
- Troubleshooting: Identify and resolve performance bottlenecks and data issues.
What We're Looking For
- Bachelor's/Master's in Computer Science, IT, or related field.
- 68+ years of experience in data engineering with strong expertise in Python, Azure, CI/CD, and deployment.
- Strong knowledge of:
- LLMs & Generative AI (fine-tuning, prompt engineering, RAG).
- ETL/ELT pipelines (structured & unstructured data).
- Azure services (ADF, Databricks, Azure SQL, etc.).
- Big data & cloud tools (Spark, Hadoop, Kafka).
- SQL & NoSQL databases.
- Docker, Kubernetes, cloud-native deployment.
- Understanding of ML fundamentals (model training, feature engineering).
- Strong collaboration, communication, and problem-solving skills.
Preferred Qualifications
- Azure or other cloud certifications
- Experience with large-scale big data platforms
- Familiarity with MLOps and GenAI deployment
