Basic Qualifications:
- Bachelordegree in Computer Science, Engineering, Math, or a related field, or equivalent experience
- 7+ years of experience with Hadoop tech stack (Spark, Kafka)
- Should have experience with batch processing on large scale data with Spark and real-time without Spark
- Proficiency in programming languages such as Scala or Python
- Extensive experience with Kafka and data streaming platforms
- Advanced knowledge of Data Bricks on AWS or similar cloud platforms
- Proven experience building and maintaining microservices
- Deep understanding of data architecture principles
- Experience leading design and development of large systems
- Proficiency with CI/CD tools like Jenkins
- Experience with Unix/Linux operating systems
- Familiarity with Agile processes and tools like Jira and Confluence
- Strong drive to learn and advocate for development best practices
- Strong knowledge on troubleshooting and optimizing Spark applications
Preferred Qualifications:
- Experience with Data Bricks on Azure/AWS
- Experience with Kafka, DataStream/DataFrame/DataSet
- Advanced proficiency with containerization tools like Docker, Kubernetes
- Knowledge of machine learning frameworks and tools such as DataRobot, H2O, ML Flow
- Experience with big data tools like Spark, Scala, Oozie, Hive or similar Streaming technologies Kafka, SparkStreams, RabbitMQ
- Experience with Continuous Integration and Delivery, unit testing, and functional automation testing
- Having API development experience will be a good addition.
- Healthcare domain experience will be a plus.
Responsibilities:
- Lead the development and implementation of machine learning solutions for healthcare applications
- Guide and mentor a team of developers and testers
- Collaborate with data scientists and other engineers to design and build scalable solutions
- Write, test, and maintain high-quality code along with Code coverage
- Lead design and code review sessions
- Troubleshoot and resolve complex technical issues
- Document your work and share knowledge with the team
- Advocate for and implement development best practices
- Train and mentor junior engineers and software engineers
Who You Are:
- Curious: You are always looking to deepen your understanding of complex problems.
- Creative: You enjoy coming up with innovative solutions to difficult challenges.
- Practical: You focus on delivering solutions that have real-world applications and value.
- Focused: You maintain a clear vision of your goals and work diligently to achieve them.
- Determined: You are committed to contributing to the development of advanced machine learning capabilities.
