Search by job, company or skills

Senior Pyspark Developer

  • Posted 18 days ago
  • Be among the first 10 applicants

Job Description


About the Company: We need a Senior Pyspark Developer to work for a leading investment bank client in Trade Surveillance Team.

Responsibilities:

  • Develop software applications based on business requirements
  • Maintain software applications and make enhancements according to project specifications
  • Participate in requirement analysis, design, development, testing, and implementation activities
  • Propose new techniques and technologies for software development
  • Perform unit testing and user acceptance testing to evaluate application functionality
  • Ensure to complete the assigned development tasks within the deadlines
  • Work in compliance with coding standards and best practices
  • Provide assistance to Junior Developers when needed
  • Perform code reviews and recommend improvements
  • Review business requirements and recommend changes to develop reliable applications
  • Develop coding documentation and other technical specifications for assigned projects
  • Act as primary contact for development queries and concerns
  • Analyze and resolve development issues accurately

Qualifications:

  • 8+ years of experience in data intensive Pyspark development
  • Experience as a core Python developer
  • Basic experience in Gen/Agentic AI
  • Experience developing Classes, OOPS, exception handling, parallel processing
  • Strong knowledge of DB connectivity, data loading, transformation, calculation
  • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations
  • Lambda Functions, Decorators
  • Vector operations on Pandas dataframes/series
  • Application of applymap, apply, map functions
  • Concurrency and error handling data pipeline batch of size [1-10 gb]
  • Ability to understand business requirements and translate them into technical requirements
  • Ability to design architecture of data pipeline for concurrent data processing
  • Familiar with creating/designing RESTful services and APIs
  • Familiar with application unit tests
  • Working with Git source control Service-oriented architecture, including the ability to consider integrations with other applications and services
  • Debugging application

Required Skills:

  • Agentic AI
  • Python
  • PySpark

Preferred Skills:

  • Knowledge of web backend technology - Django, Python, PostgreSQL
  • Apache Airflow
  • Atlassian Jira
  • Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus
  • Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus

Locations: Bengaluru, Chennai

Notice Period: Immediate-30Days

More Info

Job Type:
Industry:
Function:
Employment Type:

About Company

Job ID: 151055441

Similar Jobs

Bengaluru, India

Skills:

data wrangling PysparkUnit TestingApisDebuggingOopConcurrencyGitNumpyPandasData PipelineException HandlingData LoadingPythonRestful ServicesVector OperationsGen Agentic AIDecoratorsDataframesParallel ProcessingLambda FunctionsDB ConnectivityError Handling

Bengaluru, India

Skills:

PysparkSpark SQLSpark StreamingHadoopPysparkScalaPythonPython 3.x