Search by job, company or skills

Persistent

Sr Data Engineer

Persistent
Ahmedabad, Bengaluru, Pune
10-15 Years
Save
new job description bg glownew job description bg glow
  • Posted 3 days ago
  • Over 50 applicants
Quick Apply

Job Description

What You'll Do:

  • Design and Develop: Analytics workloads using Apache Spark and Scala for big data processing.
  • Create and Optimize: Data transformation pipelines using Spark or Apache Flink.
  • Migrate Workloads: From cloud platforms to open-source Apache Spark infrastructure on Kubernetes.
  • Implement Optimization: Performance techniques for large-scale data processing

Expertise You'll Bring:

  • Scala Programming: Focus on functional programming paradigm.
  • Apache Spark: Extensive experience with core concepts and APIs, including:
  • Spark SQL and DataFrame APIs
  • Spark Structured Streaming
  • Spark MLlib for analytics
  • Distributed Computing: Strong understanding of big data processing frameworks.
  • Data Modeling: Expertise in optimization techniques for large-scale datasets.
  • Performance Tuning: Proficiency in optimizing Spark jobs.
  • Lakehouse Storage: Good understanding of technologies like Delta Lake and Apache Iceberg

More Info

Job Type:
Permanent Job
Industry:
Information Technology
Role:
Software Engineer/Programmer
Function:
IT
Employment Type:
Full time

About Company

Persistent

We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 12 of the 30 most innovative global companies, 60% of the largest banks in the US and India, and numerous innovators across the healthcare ecosystem.

Job ID: 107757673

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Last Updated: 27-05-2026 09:32:01 AM
Homejobs in AhmedabadSr Data Engineer

Similar Jobs

Sr. Data Engineer - AI ML

Assent
Pune, India

Skills:

Sql, Neo4j, Python, Airflow, Step Functions, Pinecone, LangChain Agents, Prefect, Semantic Kernel, ArangoDB, AWS Neptune, LlamaIndex Agents, FAISS, semantic indexing, Elastic Vector Search, DSPy, Milvus, Weaviate, context chunking, embedding generation

Sr Data Engineer

standard chartered india
Bengaluru, India

Skills:

Apis, Pyspark, Microservices, Sql, Devops, Hive, Terraform, Docker, Spark, Shell scripting, Kubernetes, Python, Etl, Airflow, HDFS, Big Data Ecosystem, CI CD, Iceberg

Sr. Data engineer (Azure Databricks/PowerBI/SQL) : Bangalore ITPL : Remote

gyansys inc.
Bengaluru, India

Skills:

snowflake , Power Bi, Azure Databricks, Sql, Microsoft Fabric

Sr. Data Engineer

Happiest Minds Technologies
Pune, India

Skills:

Pyspark, RDS, Apache Spark, Redshift, Sql, ELT, Apache Airflow, Tdd, Python, Etl, AWS EMR, Unity Catalog, Delta Sharing, Redshift Spectrum, Athena, Databricks Delta tables, Data modeling techniques

Sr. Data Engineer

Eaton
Pune, India

Skills:

snowflake , Github, Data Quality, Data Governance, Sql, Python, GenAI, Data Observability, DataOps