Senior Data Engineer
Job Description
Required Qualifications:
- Bachelor's or Master's (preferred) degree in a quantitative or technical field such as Statistics, Mathematics, Computer Science, Information Technology, Computer Engineering or equivalent
- 4+ years of experience in data engineering and analytics on modern data platforms
- 3+ years extensive experience with DBT or similar data transformation tools, including building complex & maintainable DBT models and developing DBT packages/macros
- Deep familiarity with dimensional modeling/data warehousing concepts and expertise in designing, implementing, operating, and extending enterprise dimensional models
- Understand change data capture concepts
- Experience working with AWS Services (Lambda, Step Functions, MWAA, Glue, Redshift)
- Hands-on experience with AWS CDK, CodeCommit, and CodePipeline for infrastructure automation and CI/CD
- Python proficiency or general knowledge of Jinja templating in Python and/or PySpark
- Agile experience and willingness to work with extended offshore teams and assist with design and code reviews with customer
- A great teammate and self-starter, strong detail orientation is critical in this role.
More Info
Key Skills
AWS CDK
Jinja templating
MWAA
CodePipeline
CodeCommit
About Company
Skills:
snowflake , T-sql, Snowpipe, Plsql, Data Warehousing, Advanced Sql, Python, DataStream ETL Fundamentals, SnowSQL, Snowflake Cortex AI Functions, Stored Procedures, Time Travel and Fail Safe
Skills:
Apache Airflow, Aws Redshift, Amazon S3, AWS Glue, Sql
Skills:
snowflake , Java, Data Factory, Performance Tuning, Scala, Data Governance, Sql, Metadata Management, Spark, Python, OneLake, Access Control, Snowflake Snowpipe Streaming, Fabric Warehouse, Fabric Lakehouse, Microsoft Purview, Snowpark, Snowflake Tasks, Azure Event Hubs, Lakehouse architecture, Data quality frameworks, Microsoft Fabric, CI/CD practices for data pipelines
Skills:
snowflake , Hadoop, Kafka, Data Warehousing Concepts, Sql, Git, Azure Data Factory, Spark, Microsoft Azure, Python, Big Data tools, NoSQL databases
Skills:
snowflake , Pyspark, Kafka, Spring Boot, CDK, Apache Airflow, React, Typescript, Javascript, Core Java, Terraform, Python, AWS, Java, Cloudformation, Emr, Spark, Databricks, Rest Apis, Azure, Kubernetes, Apache Iceberg, Flink, Trino, Unity Catalog, Delta Lake