Search by job, company or skills

Python, Pyspark Developer

Infosys
5-9 Years
Hyderabad, India
Early Applicant
  • Posted 2 days ago
  • Be among the first 10 applicants

Job Description

Technology->Analytics - Packages->Python - Big Data,Technology->Big Data - Data Processing->PySpark

  • Design, develop, and maintain scalable batch/stream data pipelines using Python and PySpark in distributed environments.
  • Implement efficient transformations, aggregations, and joins on large datasets while ensuring performance and cost optimization.
  • Write optimized SQL for data extraction, validation, and reconciliation across multiple sources.
  • Build reusable, testable modules and follow engineering best practices (code reviews, unit testing, documentation).
  • Troubleshoot production issues, perform root-cause analysis, and implement long-term fixes and monitoring improvements.
  • Collaborate with stakeholders to translate requirements into technical designs, delivery plans, and measurable outcomes.
  • Ensure data quality through validation checks, anomaly detection patterns, and consistent schema management.
  • Contribute to continuous improvement of development standards, performance benchmarks, and pipeline reliability.
  • Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience).
  • 5–9 years of hands-on experience in software development and/or data engineering roles.
  • Strong proficiency in Python with experience building production-grade applications or data workflows.
  • Strong proficiency in PySpark, including DataFrame APIs, optimization techniques, and distributed processing concepts.
  • Working knowledge of SQL for complex queries, data analysis, and validation.
  • Experience delivering reliable solutions with attention to performance, scalability, and maintainability.

More Info

Job Type:
Permanent Job
Industry:
Other
Function:
Technology
Employment Type:
Full time

About Company

Job ID: 151655415

Last Updated: 28-07-2026 10:09:26 AM
Homejobs in Hyderabad / Secunderabad, TelanganaPython, Pyspark Developer

Similar Jobs

Pyspark Developer

Innova solutinos
Hyderabad, Chennai, Pune

Skills:

Pyspark, Databricks, Python, AWS

AWS+Python Platform Engineer

Sonata Software
Hyderabad, Bengaluru, Chennai

Skills:

PostgreSQL, Python, AWS, Design Thinking, platform engineerig

Senior Python Full Stack Developer

Dun & Bradstreet
Hyderabad, India

Skills:

composer , BigQuery, Google Cloud Platform, PostgreSQL, Dataproc, Npm, Sql, Microservices, Cloud Storage, React, Git, Typescript, Docker, Terraform, MySQL, FastAPI, MongoDB, Rest Apis, DataFlow, Yarn, Python, Airflow, GKE

Factspan - Python Full Stack Developer

Factspan
Hyderabad, India

Skills:

react.js , Github, PostgreSQL, Angular, Javascript, Celery, Docker, MySQL, Gitlab, Flask, Python, AWS, Css3, Redis, Django, Vue.JS, Git, Gcp, Html5, MongoDB, FastAPI, Restful Apis, Azure, Kubernetes, Linux environments, Microservices Architecture, API integrations, Authentication Authorization Development, CI CD pipelines

Infrastructure Engineer III-AWS, Terraform, Python-ML Ops

JP Morgan Chase & Co.
Hyderabad

Skills:

Databricks, UNIX, Emr, Java, CloudFront, Grafana, Cassandra, Helm, Terraform, Scala, Dynatrace, Datadog, AWS, Prometheus, Kubernetes, Python, Argo, Ec2, Docker, Jenkins, Kubeflow, EKS, Spinnaker, OpenSearch, Gremlin, Google VertexAI, KServe, MLflow, GitOps, Amazon SageMaker, BentoML