As a Data Engineer specializing in DBT, you'll be joining one of IBM Consulting's Client Innovation Centers here in Hyderabad. In this role, you'll contribute your deep technical and industry expertise to a variety of public and private sector clients, driving innovation and adopting new technologies.
Your Responsibilities
- Establish and implement best practices for DBT workflows, ensuring efficiency, reliability, and maintainability.
- Collaborate with data analysts, engineers, and business teams to align data transformations with business needs.
- Monitor and troubleshoot data pipelines to ensure accuracy and performance.
- Work with Azure-based cloud technologies to support data storage, transformation, and processing.
Required Qualifications
- Education: Bachelor's Degree
- Technical & Professional Expertise:
- Strong MS SQL and Azure Databricks experience.
- Ability to implement and manage data models in DBT, focusing on data transformation and alignment with business requirements.
- Experience ingesting raw, unstructured data into structured datasets within a cloud object store.
- Proficiency in utilizing DBT to convert raw, unstructured data into structured datasets, enabling efficient analysis and reporting.
- Skilled in writing and optimizing SQL queries within DBT to enhance data transformation processes and improve overall performance.
Preferred Qualifications
Education: Master's Degree
Technical & Professional Expertise:
- Ability to establish best DBT processes to improve performance, scalability, and reliability.
- Experience in designing, developing, and maintaining scalable data models and transformations using DBT in conjunction with Databricks.
- Proven interpersonal skills, contributing to team efforts and achieving results as required.
