Search by job, company or skills

V

Senior Data Engineer

Fresher
Save
new job description bg glownew job description bg glow
  • Posted 23 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Data Sr. Developer

  • Role Overview Lead the engineering efforts to build pipelines, CDC connections, and lakehouse foundations bridging the legacy estate to the cloud.
  • Key Responsibilities
  • Develop data pipelines using Databricks Live Tables, PySpark, and AWS Lambda/Kinesis for all data types.
  • Implement CDC using AWS DMS to apply daily delta extracts from Oracle/DB2 to AWS Aurora/PostgreSQL.
  • Build transformation frameworks for data validation, cleansing, and business logic within the Curated and Foundation layers.
  • Expose data products through APIs and Event-driven streams for downstream microservices.
  • Required Skills
  • Advanced programming skills in Python/Scala (PySpark) and SQL.
  • Hands-on experience with Databricks Workflows and Delta Lake architecture.
  • Experience managing AWS DMS, Kafka, or similar event-driven/CDC streaming technologies.
  • AI Augmentation/Vibe Coding knowledge required

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 148675131

Similar Jobs

Pune, India

Skills:

PysparkAzurePythonSqlAzure Fabric

Delhi, India

Skills:

snowflake Metadata ManagementData ArchitectureKafkaSchema DesignBig Data TechnologiesDockerPythonAWSJavaHadoopData ModellingScalaSqlSparkData GovernanceData Warehousing ConceptsDatabricksKubernetesAirflowfeature engineering workflowsdata optimizationETL processesAI ML data pipelinesdistributed data processing systemsDevOps practicesNoSQL databasesMonitoringdata ingestion frameworksinfrastructure-as-codeTroubleshooting

Pune, India

Skills:

.NETsnowflake JavaPysparkApigeeSqlSap BwJenkinsAzure Data FactoryMulesoftDatabricksPythonAzure DevOpsAzure Data Platform

Noida, India

Skills:

snowflake PysparkAdvanced SqlPythonBig Data ArchitectureETL Pipeline Development

Bengaluru, India

Skills:

PysparkApache SparkDatabricksSqlPythonAWS EMR