Search by job, company or skills

A

Big Data developer (with Pyspark)

Alike Thoughts
Hyderabad, Pune
5-8 Years
new job description bg glownew job description bg glownew job description bg svg
  • Posted a day ago
  • Be among the first 30 applicants
Early Applicant
Quick Apply

Job Description

Key Responsibilities:

  • Design, develop, and optimize batch and streaming data pipelines primarily using PySpark (Python with Apache Spark).
  • Write efficient, reusable, and testable code for large-scale data processing.
  • Work with diverse and large-scale datasets from various sources, including but not limited to Kafka, Hive, S3, and Parquet files.
  • Collaborate closely with data scientists, data analysts, and DevOps teams to build robust and scalable data pipelines.
  • Tune Spark jobs for optimal performance and resource efficiency.
  • Implement comprehensive data quality checks, logging, and error-handling mechanisms within data pipelines.
  • Contribute to the overall architecture and strategy for big data solutions

More Info

Job Type:
Permanent Job
Industry:
Information Technology
Role:
Software Developer
Function:
IT/Software Development - DBA/Datawarehousing
Employment Type:
Full time
Open to candidates from:
Indian

About Company

Alike Thoughts

Founded in 2010, Alike Thoughts is a leading provider of Technology Solutions, Talent Acquisition, and Corporate Training. We help businesses stay ahead by offering custom software development, cutting-edge technology solutions, and workforce transformation strategies that drive efficiency and growth.
With a deep understanding of emerging technologies, software engineering, and digital transformation, we empower organizations to build scalable, future-ready solutions. Our expertise spans custom software development, cloud solutions, AI-powered automation, cybersecurity, and enterprise applications, ensuring businesses operate with agility and innovation.
In addition to technology solutions, we specialize in talent acquisition and workforce development—helping businesses attract, hire, and retain top-tier talent while equipping their teams with the skills and leadership capabilities needed for success.
At Alike Thoughts, we are more than a service provider—we are a strategic partner, committed to enabling business transformation through innovation, technology, and people.

Job ID: 120339727

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Last Updated: 05-03-2026 00:58:22 PM
Homejobs in Hyderabad / Secunderabad, TelanganaBig Data developer (with Pyspark)