Data Engineer - Snowflake

Data Engineer - L2

Experience: 3-6 years of relevant experience in data engineering. | Location: Bangalore, Hyderabad, Gurugram. | Work Mode: Hybrid work environment, promoting flexibility and collaboration.

About Us

CoffeeBeans Consulting is a premier tech consulting firm dedicated to empowering organizations to become AI-ready by optimizing their data across diverse sources. Our expertise spans data architecture, pipelines, governance, MLOps, and cutting-edge Generative AI solutions.

Role Overview

Join CoffeeBeans Consulting as a Data Engineer - L2 and transform the future of data engineering in the Generative AI landscape. In this pivotal role, you will design, develop, and maintain robust data pipelines using Python, SQL, Snowflake, and AWS, enabling our clients to harness the power of AI-driven insights. Collaborate with cross-functional teams to deliver high-quality data solutions that support healthcare data ingestion and analytical needs. Leverage AI-native development practices to enhance productivity and optimize data processing performance, making a significant impact in a rapidly evolving industry.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python, SQL, Snowflake, and AWS.
• Build and support healthcare data ingestion, transformation, and analytical solutions.
• Collaborate with product, business, and QA teams to deliver high-quality data solutions.
• Optimize data processing performance, reliability, and data quality across production environments.
• Leverage AI-native development practices, including AI agents/tools for code generation, code reviews, and test case creation.

Required Qualifications

• Experience building and maintaining scalable data pipelines and data integration frameworks.

Required Skills

• Strong Python development skills with experience in ETL, data processing, and automation.
• Advanced SQL and Snowflake expertise, including data modeling and performance optimization.
• Experience with PySpark and Big Data technologies for processing large-scale datasets.
• Proficiency in AWS services such as S3, SNS, Glue, and cloud-based data engineering solutions.
• Familiarity with AI-native SDLC practices, including the use of AI tools for development and testing.

Preferred Skills

• Experience with Snowpark for data processing.
• Knowledge of Shell/Unix scripting and workflow orchestration tools like Airflow.
• Familiarity with REST APIs for data integration.
• Experience with CI/CD tools such as GitHub Actions and Jenkins.
• Understanding of monitoring tools such as Splunk.