Lead Engineer

Computomic was founded in 2019 with a vision to design and deploy mission critical and highly differentiated Data & AI solutions for companies looking to migrate their data stack from legacy data platforms such as Teradata, Cloudera, DataStage and Informatica to modern data platforms like Databricks. Over the last few years, we have become a leading Databricks partner, building a strong and mature Databricks practice and delivering Databricks migration projects for some of the world's leading companies.

We are a nimble and rapidly growing company with a global footprint, and a focus on Data & AI, and Financial Crime Prevention solutions. We have built an impressive depth of Data & AI experts with over 40 trained and certified Databricks professionals; experts in BI/ Dashboarding tools such as PowerBI and Tableau; and experts in financial crime and fraud prevention.

The Role

We are one of the fastest growing delivery partners for Databricks and are looking to hire committed, passionate and hard-working Lead Engineers. This position requires well-rounded individuals who focus on details, thrive in a fast-paced environment, know how to cultivate collaborative working relationships, can communicate effectively with executives and drive projects to completion. You will have the opportunity to shape the future of the big data landscape at leading Fortune 500 companies and cutting-edge startups. You will work on the industry's most challenging customer engagements to solve big data problems using leading cloud platforms such as AWS/Azure/GCP, Apache Spark and Databricks.

You will have the opportunity to work with some of the leading experts in the data and AI industry, manage complex data migration projects and help develop data and AI best practices and thought leadership. You will join a team of experts with the autonomy and flexibility to make quick decisions, forge your own paths and adapt to the changing market and customers needs.

What you will be doing

1. Work directly with end customers on enterprise scale Data & AI projects

2. Mentor our growing team of junior Consultants

3. Provide input into thought leadership in the areas of master data management, data modeling, data governance, data transformations, curation and data integration

4. Help develop data architecture blueprints, patterns and frameworks that will enable reuse and standardization

5. Building scalable streaming and batch solutions using cloud-native components. Help develop reusable frameworks, accelerators and internal product development

Technology and skills

1. Certified and have deep knowledge of one or more popular cloud platforms (AWS, Azure, GCP). Strong abilities to provide a firm point of view on core cloud platform capabilities, security, and best practices

2. Hands-on technical experience, building production grade data pipelines with Apache Spark and/or Databricks

3. Proficient in Python, PySpark, SQL

4. Experience building pipelines with CICD capabilities and strong knowledge of Apache Spark and/or Databricks Internals

5. Databricks technical certifications, knowledge of the lake house architecture, highly desirable