Search by job, company or skills

This job is no longer accepting applications

Job Description

Role Summary

We are looking for a skilled Python / PySpark Developer to design, develop, test, and maintain scalable data processing systems and high‑quality software solutions. The ideal candidate should be strong in Python, PySpark, and capable of building large-scale data pipelines that support machine learning and analytics use cases.

Must‑Have Skills

  • Strong hands-on programming experience in Python
  • Solid experience in PySpark for large-scale data processing
  • Experience building, debugging, and optimizing ETL pipelines

Good-to-Have Skills

  • Experience with Azure Data Factory (ADF)
  • Working knowledge of Power BI
  • Experience with Spark / Databricks
  • Understanding of data engineering and ML workflows

Key Responsibilities

Software Development & Coding

  • Develop, test, and maintain high-quality software using Python.
  • Write clean, efficient, reusable, and scalable code following best practices.
  • Implement, debug, and optimize large‑scale data processing workloads using PySpark.

Data Pipelines & Machine Learning Support

  • Build and maintain large-scale data processing pipelines to support ML model training and analytics.
  • Collaborate with Data Scientists and ML Engineers to integrate data workflows.
  • Handle data ingestion, transformation, processing, and quality validations.

Collaboration & Problem Solving

  • Work closely with cross‑functional teams including Data Engineering, ML, Product, and DevOps.
  • Participate in requirement analysis, solutioning, and architectural discussions.
  • Identify, troubleshoot, and resolve complex technical issues.

Quality & Best Practices

  • Participate in code reviews to ensure code quality and adherence to standards.
  • Identify areas for improvement and recommend practical solutions.
  • Ensure robust testing, performance optimization, and documentation.

Continuous Learning

  • Stay up to date with the latest trends in Python, PySpark, and data engineering.
  • Explore emerging tools and technologies to improve efficiency and performance.

Behavioral Competencies

  • Strong analytical and problem‑solving skills
  • Ability to collaborate in cross‑functional teams
  • Good communication and documentation skills
  • Attention to detail with a proactive approach

More Info

Job Type:
Industry:
Employment Type:

Job ID: 149014231

Similar Jobs

Hyderabad, India

Skills:

Release planningCoding StandardsApplication ArchitecturePython

Hyderabad, India

Skills:

ScriptingApache AirflowAzure Data FactoryData TransformationAzure StoragePythonAzure DevOpsApi DevelopmentProcess AutomationAzure cloud technologiesDatabase interactions

Delhi, Hyderabad, Mumbai

Skills:

GitJavascriptData StructuresPythonSqlHTML/CSS

Hyderabad, India

Skills:

snowflake SqlalchemySqlSQL ServerApache SparkPandasBigQueryOraclePythonMongoDBRedshiftOpenAILuigiLangraphLangchain

Hyderabad, India

Skills:

cherrypy AWSFastAPIPythonDjangoDockerApisFlask