
Search by job, company or skills
Job Overview:
We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience working with modern data tools and cloud platforms, ensuring data integrity, efficiency, and security.
Key Responsibilities:
Design, develop, and maintain data pipelines using DBT, Snowflake, and AWS Glue.
Build and optimize ETL/ELT workflows for efficient data processing.
Develop and maintain real-time data streaming solutions using Kafka.
Work with AWS services such as Lambda, S3, Glue, and Redshift for cloud-based data integration.
Implement data governance, security, and best practices to ensure compliance and efficiency.
Write efficient, scalable, and maintainable Python code for data transformations and automation.
Optimize Snowflake performance, including warehouse sizing, query tuning, and cost management.
Collaborate with data analysts, scientists, and stakeholders to ensure data accessibility and usability.
Required Qualifications:
Bachelor's/Master's degree in Computer Science, Data Engineering, or a related field.
Strong expertise in Snowflake, DBT, and Kafka for data processing and analytics.
Experience with AWS services including Glue, Lambda, S3, and IAM.
Proficiency in Python for data manipulation, automation, and pipeline development.
Experience with SQL and performance optimization techniques.
Familiarity with CI/CD pipelines and version control (Git).
Strong understanding of data warehousing, modeling, and governance best practices.
Preferred Qualifications:
AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect/ SnowPro Certification
Experience with orchestration tools like Apache Airflow.
Exposure to Terraform or CloudFormation for infrastructure automation.
Skills
Python Snowflake, DBT, Kafka, SQL, AWS
Job ID: 148675973
Skills:
data sharing , snowflake , Github, Data Pipeline, Tables, Python, Azure DevOps, Views, Visual Studio, Functions, Azure Data Factory, Databricks, Time Travel and Fail-safe Features, Tasks in Snowflake, Query Optimization Techniques, Snowflake costing model, External Hybrid tables, Warehouse Optimization, ABAC, cost tracking, Pyscript, Tags policies, Clustering and Partitioning, rbac, Collaboration, Stored Procedures, Snowpipe integrations, Snowflake Architecture, DR replication in Snowflake
Skills:
data warehouses , Database Concepts, Azure Databricks, Sql Queries, Azure Sql, Azure Synapse, Devops, Azure Data Factory, Unix Scripting, Linux, Agile Process, Python, Adf, Control M, Azure Data technologies, Datalake, ADLSGen2, Snowflake Cloud data Platform, modeling transactional databases, T-SQL query analysis
We don’t charge any money for job offers