Job Description Senior Data Engineer (DBT + Databricks)
Experience: 5+ Years
Employment Type: Contract
Location: Remote
Key Responsibilities
- Design, develop, test, and deploy scalable, secure, and production-grade dbt models using Jinja and SQL in a modular, incremental approach.
- Build and optimize data transformations in Databricks Unity Catalog and Delta Lake, ensuring smooth downstream consumption in Snowflake and other systems.
- Optimize Databricks SQL/Spark workloads using techniques like partitioning, clustering, caching, and Z-Ordering.
- Maintain code quality through best practices in documentation, Git/GitLab version control, code reviews, and robust data tests.
- Integrate dbt workflows into GitLab CI/CD pipelines for automated testing and multi-environment deployments.
- Collaborate with Data Governance teams to ensure correct handling of sensitive data (e.g., OneTrust consent data).
Required Qualifications
- 5+ years of experience in Data Engineering / BI / Analytics Engineering.
- 2+ years of production experience with dbt.
- Expert-level SQL skills and strong understanding of dimensional modeling.
- Hands-on experience with Databricks/Spark, Delta Lake, and Databricks SQL or Spark SQL.
- Experience working with Pharma/Life Sciences datasets (e.g., Veeva CRM, HCP/HCO data, Sales & Interaction data).
- Experience integrating CI/CD pipelines using GitLab or similar tools.
- Familiarity with modern Cloud Data Warehouses, preferably Snowflake.
Skills: lake,code,ci,cd,pipelines,sql,spark,data,dbt,gitlab
