Search by job, company or skills

Coffeebeans Consulting

Senior Data Engineer

Save
  • Posted 8 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Location: Bangalore (with short/medium-term travel opportunities within India & foreign location)

Experience: 7–10 years

Job Type: Full-time

About the Role

We're looking for seasoned data engineers who can take end-to-end ownership of complex data engineering engagements—right from architecture and design to development and delivery. You'll work with client stakeholders, lead data initiatives, and guide teams in building modern, scalable data platforms that support business intelligence, advanced analytics, and AI/ML applications.

Key Responsibilities

  • Lead the design and implementation of scalable, secure, and high-performance data architectures.

  • Architect and optimize data pipelines for batch and real-time processing across varied source systems.

  • Model and implement enterprise-grade data lakes, lakehouses, and warehouses to support analytical workloads.

  • Collaborate with client teams and internal stakeholders to define data strategies, tooling, and standards.

  • Set up and enforce best practices around code quality, pipeline observability, testing, and CI/CD.

  • Guide technical decision-making and mentor junior/mid-level engineers.

  • Troubleshoot complex data issues and provide architectural solutions across heterogeneous systems.

Must-Have Skills

  • Strong expertise in Python and advanced proficiency in SQL.

  • Hands-on experience with snowflake

  • Deep understanding of data engineering architecture: ETL/ELT pipelines, data modeling (dimensional and normalized), warehousing, streaming systems, and data integration patterns.

  • Proven experience with distributed data processing frameworks (e.g., Apache Spark, Flink).

  • Proficient with orchestration tools like Airflow or similar, and production-grade data workflows.

  • Solid grounding in cloud-native data services (compute, storage, IAM, monitoring).

  • Experience leading technical implementations and collaborating with business stakeholders.

Good to Have

  • Multi-cloud experience (AWS preferred; GCP or Azure familiarity is valued).

  • Hands-on experience with Databricks, dbt, and collaborative data development environments.

  • Awareness of data governance, security, lineage, and quality frameworks.

  • Certifications such as AWS Certified Data Analytics, Databricks Certified Data Engineer Professional, or equivalent.

Other Expectations

  • Strong leadership, ownership, and client communication skills.

  • Ability to balance hands-on contributions with technical guidance.

  • Adaptability to new tools, tech stacks, and problem domains.

  • Willingness to travel within India for short/medium-term client assignments.

More Info

Job Type:
Industry:
Employment Type:

Job ID: 149369161

Similar Jobs

Bengaluru, India

Skills:

snowflake PysparkPostgreSQLData ModelingSqlApache AirflowRDBMSTerraformMySQLSparkPythonEtldbt

Bengaluru, India

Skills:

snowflake BigQueryPysparkKafkaRedshiftSqlKinesisGcpAzurePythonAWSIncortaIcebergdbtDelta Lake

Bengaluru, India

Skills:

snowflake ApisApache SparkSqlDevopsDatabricksAzurePythonAWSdata modeling principlesSageMakerdata integration toolsmessage streaming platformsAmazon Bedrock

Bengaluru, India

Skills:

snowflake AdfSqlAzure Data FactoryShellAzure Data LakeEtl ToolsData Warehousing ConceptsPythonAzure BlobAzure Storage ExplorerSynapseSnowpark

Bengaluru, India

Skills:

Data ModelingApache SparkData ArchitectureDatabricksSqlPythonEtlAirflowData Optimization