Job Summary
This role should be able to design and implement scalable data warehouse solutions by integrating client data with the Ignite platform, aligning to Health Catalyst architecture and standards. Lead SQL Server to Databricks migrations, including schema mapping, query optimization, and data validation. Develop and maintain data products using dbt, ensuring high data quality, documentation, and alignment with client analytics needs. Communicate project status and risks effectively to stakeholders and leadership, ensuring successful implementation outcomes. Drive knowledge transfer and training for client teams while supporting internal tooling improvements and onboarding data engineers.
Duties & Responsibilities
Required Skills
- Must possess deep technical experience with several technical competencies; data query (SQL), data movement (ETL), data modeling, and working within cloud environments.
- Ability to profile large datasets and interpret and analyze multiple data models quickly.
- Strong communication, collaboration, and negotiation skills; ability to anticipate, diffuse and/or manage conflict resolution. Ability to guide and support other resources through tenuous situations.
- Strong experience as a Data Engineer, Analytics Director, Technical Director, or similar role.
- Advanced data modeling skills. Working knowledge of dimensional, 3rd Normal, and other data modeling standards and possess the ability to explain these concepts to technical and non-technical audiences.
- Ability to interpret complex customer requests and implement them using Health Catalyst tools including DOS Marts, SAMs, SAM Designer, Source Mart Designer, Databricks, Visual Studio Code, etc.
- Exceptional interpersonal, problem solving and time management skills.
- Ability to learn new software tools/technologies quickly and ask for help or training when necessary.
- Ability to make sound decisions on behalf of clients or peer groups aligned with the organization's current goals, mission, and strategic priorities.
- Experience migrating workloads from SQL Server to Databricks, including Spark SQL query translation, performance tuning, and data validation practices.
- Hands-on experience with dbt for building, testing, and documenting data models; familiarity with dbt on Databricks preferred.
Desired Skills
- DBA-experience optimizing Execution Plans.
- Query profiling and optimization.
- PowerShell scripting experience.
- TSQL and/or procedure/function scripting experience.
- Experience with Snowflake. (Note: Databricks experience is now a Required Skill.)
- Python/Pyspark knowledge and experience
Education & Relevant Experience
- Any Bachelors/master's degree
- Minimum 1+ years relevant or equivalent experience
