Search by job, company or skills

Coffeebeans Consulting

Senior Data Engineer

Save
  • Posted 8 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Location: Bangalore

WorkMode: Hybrid

Experience: 6–9 years

Job Type: Full-time

About the Role

We're looking for seasoned data engineers who can take end-to-end ownership of complex data engineering engagements—right from architecture and design to development and delivery. You'll work with client stakeholders, lead data initiatives, and guide teams in building modern, scalable data platforms that support business intelligence, advanced analytics, and AI/ML applications.

Key Responsibilities

  • Lead the design and implementation of scalable, secure, and high-performance data architectures.
  • Architect and optimise data pipelines for batch and real-time processing across varied source systems.
  • Model and implement enterprise-grade data lakes, lakehouses, and warehouses to support analytical workloads.
  • Collaborate with client teams and internal stakeholders to define data strategies, tooling, and standards.
  • Set up and enforce best practices around code quality, pipeline observability, testing, and CI/CD.
  • Guide technical decision-making and mentor junior/mid-level engineers.
  • Troubleshoot complex data issues and provide architectural solutions across heterogeneous systems.

Must-Have Skills

  • Strong expertise in Python and advanced proficiency in SQL.
  • Hands-on experience with Databricks.
  • Deep understanding of data engineering architecture: ETL/ELT pipelines, data modeling (dimensional and normalised), warehousing, streaming systems, and data integration patterns.
  • Proven experience with distributed data processing frameworks (e.g., Apache Spark, Flink).
  • Proficient with orchestration tools like Airflow or similar, and production-grade data workflows.
  • Solid grounding in cloud-native data services (compute, storage, IAM, monitoring).
  • Experience leading technical implementations and collaborating with business stakeholders.

Good to Have

  • Multi-cloud experience (AWS preferred; GCP or Azure familiarity is valued).
  • Hands-on experience with Databricks, dbt, and collaborative data development environments.
  • Awareness of data governance, security, lineage, and quality frameworks.
  • Certifications such as AWS Certified Data Analytics, Databricks Certified Data Engineer Professional, or equivalent.

Other Expectations

  • Strong leadership, ownership, and client communication skills.
  • Ability to balance hands-on contributions with technical guidance.
  • Adaptability to new tools, tech stacks, and problem domains.
  • Willingness to travel within India for short/medium-term client assignments.

Kindly drop your resume ([Confidential Information] OR [HIDDEN TEXT])

More Info

Job Type:
Industry:
Employment Type:

Job ID: 149765741

Similar Jobs

Bengaluru, India

Skills:

PysparkSap EccELTAWSMlOdataSAP BTPSqlDevopsGitAzure Data FactoryGcpDatabricksAzureEtlAirflowCI CDDB ConnectorsDatabricks ReposCDC toolsSAP DatasphereSAP BDCLLMsSAP S 4HANAAiDelta LakeDatabricks Genie

Bengaluru, India

Skills:

Power BiPower AutomateData GovernanceData Warehousing ConceptsPower QuerySqlAzure SqlData VisualisationAzure Data FactoryData ModellingDaxIntegration with APIsSecurity ImplementationPower AppsDataverseAzure Synapse FabricPerformance tuning of reports and datasetsRelational DatabasesEnterprise analytics architecture designAzure data services

Bengaluru, India

Skills:

WorkflowsApisCloudformationPysparkSqlDevopsMLopsTerraformSparkDatabricksAzurePythonAWSDatabricks Lakehousedbt

Bengaluru

Skills:

snowflake SqlApache SparkPythonAirflowdbt

Bengaluru, India

Skills:

data engineering snowflake BigQueryData ModellingKafkaRedshiftSqlELTHiveKinesisPrestoDockerTerraformSparkPythonEtlAWSAirflowPubsubTrinoDelta Lake