python,pyspark

Fusion Plus Solutions

Hyderabad

5-8 Years

Save

Posted a day ago
Be among the first 20 applicants

Early Applicant

Quick Apply

Job Description

Develop and optimize data processing jobs using PySpark for complex transformations and aggregations
Design and implement robust data pipelines on AWS, ensuring scalability and performance
Utilize AWS services like EC2 and S3 for data processing and storage solutions
Manage SQL database schema design, query optimization, and performance tuning
Design and maintain scalable data warehouses using best practices in data modeling and ETL
Leverage modern data platforms for collaborative data science across varied sources
Maintain Databricks clusters and Spark jobs for optimal performance and data quality
Implement security, backup procedures, and disaster recovery plans using AWS best practices
Manage source code and automate deployment via GitHub with CI/CD pipelines
Troubleshoot and optimize PySpark scripts, Databricks notebooks, SQL queries, and Airflow DAGs
Stay current with advancements in cloud data technologies and recommend useful tools
Use Apache Airflow for orchestrating and automating data workflows reliably
Collaborate with data scientists and analysts to build models and pipelines for analytics and ML projects

More Info

Job Type:

Permanent Job

Industry:

Information Technology

Role:

Other Roles

Function:

Others

Employment Type:

Full time

Open to candidates from:

Indian

About Company

Fusion Plus Solutions

At Fusion Plus Solutions Inc, we believe that it’s an exceptional company - a company of people proud of the work they do and the solutions they provide. By understanding what drives our specialty industries, becoming involved in our communities on a professional and personal basis, following a disciplined process of identifying quality candidates, partnering with employers to understand their core business and their employment requirements, and delivering exceptional service, we achieve great results for all concerned.

Job ID: 121913263

Jobs by Skill - IT