Search by job, company or skills

5-7 Years

This job is no longer accepting applications

Job Description

Summary:

We are seeking a Senior Software Engineer with a focus on Data Engineering to join our. The role involves developing and maintaining data products in a cloud environment, particularly in building dashboards for customers to provide effective summarized views of data. You will work with high-volume datasets, transforming raw data into meaningful insights.

Responsibilities:

  • Develop and maintain data products in a cloud environment.
  • Work with raw data stored in S3.
  • Build and optimize Spark-based data pipelines.
  • Perform data processing, transformation, and optimization.
  • Support dashboard creation and data visualization needs.
  • Collaborate with cross-functional teams.
  • Contribute to the development and maintenance of high-quality, scalable software solutions.
  • Participate in code reviews, providing feedback to help uphold quality standards and best practices.
  • Assist in designing, developing, and delivering software solutions that align with business needs and organizational standards.
  • Create and maintain technical artifacts, such as requirements documents, design specifications, and test plans.
  • Support system maintenance activities, including incident management, root cause analysis, and problem resolution in production environments.
  • Assist in evaluating emerging technologies and frameworks, supporting Proof of Concept (PoC) efforts and solution assessments.
  • Contribute to solution and technology roadmaps, supporting strategic planning and innovation initiatives.

Requirements:

  • 5&ndash7 years of experience in data engineering with strong expertise in large-scale data processing.
  • At least 3&ndash4 years of hands-on experience building data products.
  • Experience working with distributed data systems.
  • Background from product or consulting companies is preferred.

Required Skills:

  • Strong experience in Databricks, Apache Spark (PySpark & Spark SQL), and Python.
  • Knowledge of Data Warehousing concepts.
  • Familiarity with Medallion Architecture (Bronze, Silver, Gold layers).
  • Experience handling and processing high-volume data.
  • Experience with any cloud platform (AWS preferred).

Preferred Skills:

  • Exposure to card/payment domain data is a plus.
  • Strong communication skills.
  • Ability to work in cross-functional teams.
  • Problem-solving and analytical thinking.


#AditiConsulting
# 26-04046

More Info

Job ID: 150545885

Similar Jobs

Pune, India

Skills:

KafkaSpring BootMicroservicesDockerCore JavaOpenshiftGitlabAgileScrumAWSHibernateIbm MqJiraSpring DataJenkinsGitAppdynamicsLiquibaseBitbucketDynatraceSplunkRestful ApisJpaAzureKubernetesSpring FrameworkWeb Servicesevent-driven applicationsJava 17

Pune, India

Skills:

snowflake DynamodbData ModelingPythonSqlETL frameworksAirflowAI-assisted development

Pune, India

Skills:

JavaS3DynamodbKafkaSpring BootSpring MVCSpring DataRabbitmqLambdaReactjsElasticsearchMongoDBSpring FrameworkAWS

Pune, India

Skills:

TerraformAmazon CloudWatchRestful ApisPythonMicroservicesGolangAngularAWS QuickSightPlaywrightAWS cloud services

Pune, India

Skills:

GitAgileDatabricksFastAPIRest ApisPythonMicroservicesDatabricks AppsStreamlit

Beware of Scammers

We don’t charge money for job offers