AWS Data Engineer (Data Build Tool)

Job Title : DBT Developer

Experience- 5 + Years

Location: Remote

Key Responsibilities

DBT Development & Modeling: Design, develop, test, and deploy production-grade, secure, and performant data models using dbt (Jinja and SQL) in a modular and incremental fashion.

Databricks Integration: Utilize dbt to transform data residing in Databricks Unity Catalog and Delta Lake tables, ensuring models are optimized for consumption by Snowflake and other downstream systems.

Performance Optimization: Optimize dbt models and associated Databricks queries (SQL/Spark) for scale, efficiency, and cost, leveraging partitioning, clustering, and table optimization techniques (e.g., Z-Ordering).

Code Quality & Governance: Establish and enforce best practices for dbt development, including documentation, version control (GitLab/Git), code reviews, and comprehensive testing (data quality, uniqueness, referential integrity).

CI/CD Integration: Integrate dbt projects into the CI/CD pipeline (managed via GitLab) for automated testing and deployment across development, staging, and production environments.

Data Governance: Work closely with Data Governance and Compliance teams to ensure models handle sensitive data (e.g., OneTrust consent data)

Required Qualifications

Minimum 5+ years of professional experience in Data Engineering, Business Intelligence, or Analytics Engineering.

2+ years of hands-on, production experience with dbt (data build tool).

Expert proficiency in SQL and experience with complex data modeling techniques (e.g., dimensional modeling).

Proven experience with Databricks/Spark environment, specifically reading from Delta Lake tables and utilizing Databricks SQL or standard Spark SQL for transformations.

Demonstrable experience working with data specific to the Pharmaceutical or Life Sciences industry, including understanding of systems like Veeva CRM, HCP/HCO, Address & Affiliation data, Sales & Interactions data.

Experience with CI/CD practices and tooling (e.g., GitLab, GitHub Actions) for automated code deployment.

Familiarity with Cloud Data Warehouses, preferably Snowflake or similar platforms.