Job Title: Data Engineer
Experience: 7+ Years
Location: Pune
Employment Type: Full-Time
About the Role
We are looking for a highly skilled Data Engineer with strong experience in building scalable data pipelines, cloud-based data solutions, and end-to-end application delivery. The ideal candidate will be a hands-on technologist with expertise in data engineering, cloud platforms (GCP preferred), CI/CD pipelines, and observability practices.
You will work closely with engineering teams, product stakeholders, and business partners to design, build, and optimize data systems that support critical business operations and analytics.
Key Responsibilities
Data Engineering & Pipeline Development
- Design, develop, and maintain scalable data pipelines to ingest, process, and distribute data across heterogeneous systems.
- Implement ETL/ELT processes, ensuring data quality, consistency, and reliability.
- Work with structured and unstructured data across multiple database systems.
Cloud & Platform Engineering (GCP Preferred)
- Build and manage data solutions using GCP services such as:
- Cloud Storage (Buckets)
- Dataflow
- Cloud Composer (Airflow)
- Cloud Scheduler
- IAM (Service Accounts & Roles)
- Deploy and manage applications in cloud environments (GCP/AWS/Azure).
CI/CD & DevOps
- Build and deploy applications using GitHub, CircleCI, Harness, and similar CI/CD tools.
- Automate build, test, and deployment pipelines.
- Follow DevOps best practices for continuous delivery and infrastructure management.
Application Development & Delivery
- Own end-to-end application lifecycle including design, development, deployment, and operationalization.
- Ensure application scalability, reliability, and maintainability.
- Write clean, efficient, and testable code following best practices.
Monitoring, Observability & Support
- Monitor application health, KPIs, and performance metrics.
- Build dashboards using tools like Prometheus and Grafana.
- Analyze logs and trace application issues across different tiers.
- Provide production support and triage issues as needed.
Security & Best Practices
- Implement and advocate for security best practices including IAM roles, access control, and data protection.
- Ensure compliance with organizational and industry standards.
- Adopt modern engineering practices and continuous improvement initiatives.
Collaboration & Agile Delivery
- Work closely with product owners, business stakeholders, and engineering teams.
- Participate in Agile Scrum ceremonies (Sprint Planning, Grooming, Daily Standups, Reviews, Retrospectives).
- Analyze requirements and contribute to solution design aligned with business goals.
Required Qualifications
Experience
- 7+ years of experience in software engineering and data engineering.
- Strong experience across the full software development lifecycle (SDLC) from ideation to production deployment.
Technical Skills
- Hands-on experience with GCP services (Cloud Storage, Dataflow, Composer, Scheduler, IAM).
- Strong experience in ETL/ELT processes, data pipelines, and data quality frameworks.
- Proficiency in SQL and NoSQL databases.
- Experience with CI/CD tools like GitHub, CircleCI, Harness.
- Strong understanding of cloud environments (GCP preferred).
Preferred Qualifications
- Experience with:
- Kubernetes (GKE)
- Airflow / Cloud Composer
- Google Spanner, MongoDB, Oracle, PostgreSQL
- Experience with SOAP services, Postman, SOAP UI for API testing.
- Hands-on experience with GitHub Actions and DevOps practices.
- Experience building unit tests and mock test cases for code coverage.
- Knowledge of log ingestion, monitoring, and observability tools.
- Experience troubleshooting applications in cloud environments.
- Healthcare domain experience is a strong plus.
Soft Skills
- Strong analytical and problem-solving skills.
- Ability to work independently and as part of a team.
- Excellent communication and collaboration abilities.
- Strong attention to detail and commitment to quality.
