Hiresquad Resources is looking for talented Data Engineers to join our client's team. If you have solid experience with Python, Kafka Stream, PySpark, and Azure Databricks, and are ready to design and implement real-time data pipelines, we encourage you to apply for an immediate start in Hyderabad, Bengaluru, or Noida.
Roles and Responsibilities
- Lead the design, development, and implementation of real-time data pipelines using Kafka, Python, and Azure Databricks.
- Architect scalable data streaming and processing solutions to support complex healthcare data workflows.
- Develop, optimize, and maintain ETL/ELT pipelines for both structured and unstructured healthcare data.
- Ensure data integrity, security, and compliance with critical healthcare regulations (such as HIPAA, HITRUST, etc.).
- Collaborate effectively with fellow data engineers, analysts, and business stakeholders to understand requirements and translate them into robust technical solutions.
- Troubleshoot and optimize Kafka streaming applications, Python scripts, and Databricks workflows.
- Mentor junior engineers, conduct thorough code reviews, and ensure adherence to best practices in data engineering.
- Stay updated with the latest cloud technologies, big data frameworks, and industry trends.
Qualifications
- Experience: 5+ years of experience in data engineering.
- Mandatory Tools: Must have experience in Python, Kafka Stream, PySpark, and Azure Databricks.
Skills
- Core Proficiency: Strong proficiency in Kafka and Python.
- Real-time Data Processing: Expertise in Kafka Streams, Kafka Connect, and Schema Registry for real-time data processing.
- Cloud Platforms: Experience with Azure Databricks (or willingness to learn and adopt it quickly).
- Hands-on experience with other cloud platforms (Azure preferred, AWS or GCP is a plus).
- Database & Modeling: Proficiency in SQL, NoSQL databases, and data modeling for big data processing.
- DevOps Practices: Knowledge of containerization (Docker, Kubernetes) and CI/CD pipelines for data applications.
- Domain Knowledge (Plus): Experience working with healthcare data (EHR, claims, HL7, FHIR, etc.) is a significant plus.
- Problem Solving: Strong analytical skills, a problem-solving mindset, and the ability to lead complex data projects.
- Communication: Excellent communication and stakeholder management skills.
Interested Call Rose at 9873538143 (or WhatsApp at 8595800635) or email your resume to [Confidential Information].
