Search by job, company or skills

Sr. Data Engineer

Early Applicant
  • Posted 15 days ago
  • Be among the first 10 applicants

Job Description

Key Responsibilities

  • Design and develop real-time data pipelines using Kafka, Spark, AWS Kinesis, and related technologies.
  • Build and support scalable data processing solutions on AWS.
  • Modernize legacy ingestion frameworks using cloud-native services.
  • Develop and optimize large-scale distributed data processing systems.
  • Troubleshoot and support production data platforms and streaming applications.
  • Collaborate with cross-functional teams on enterprise data integration initiatives.

Required Skills & Experience

  • 10+ years of experience in Data Engineering, Software Engineering, or related fields.
  • Strong expertise in AWS Cloud Services and cloud-native architectures.
  • Hands-on experience with Apache Spark (Scala & PySpark).
  • Strong knowledge of the Hadoop Ecosystem and distributed computing.
  • Experience with Kafka, streaming technologies, and real-time data pipelines.
  • Experience with AWS Kinesis, Kinesis Firehose, Flume, or similar ingestion platforms.
  • Strong programming skills in Python, Scala, and Java.
  • Experience with Big Data, Enterprise Data Warehousing, and Distributed Systems.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151078795

Similar Jobs

Hyderabad, India

Skills:

Data ModelingPysparkApache SparkSparksqlData IntegrationSqlApache AirflowData WarehousingDatabricksData GovernancePythonEtlR

Hyderabad

Skills:

Data EngineerSsisSsrsAzurePyspark

Hyderabad, India

Skills:

snowflake PysparkApache SparkSqldbt

Hyderabad, India

Skills:

Spark SQLUnix Shell ScriptingGcpLinux CommandsSqlBig Data TechnologiesAWSEtlAi

Hyderabad, India

Skills:

SqlELTSpring BootUnix Shell ScriptingMavenGradlePysparkAWSEtlPythonDockerJenkinsJava 8-17