Databricks Pyspark

Fusion Plus Solutions

Hyderabad

5-8 Years

Save

Posted a month ago
Be among the first 10 applicants

Early Applicant

Quick Apply

Job Description

Develop and optimize data processing jobs using PySpark to handle complex transformations and aggregations efficiently
Design and implement robust data pipelines on the AWS platform (Databricks exposure is a plus)
Utilize AWS services like EC2, S3 for scalable data processing and storage
Manage SQL database schema design, query optimization, and performance tuning
Design and maintain data warehouses following best practices in data modeling and ETL
Use Databricks clusters and Spark jobs to ensure data quality and performance
Implement security measures, backup, and disaster recovery using AWS best practices
Use GitHub and CI/CD for source code management and deployment
Orchestrate data workflows using Apache Airflow
Collaborate with data scientists and business analysts for advanced analytics projects

Mandatory Skills

Databricks
PySpark

More Info

Job Type:

Permanent Job

Industry:

Information Technology

Role:

Other Roles

Function:

Others

Employment Type:

Full time

Open to candidates from:

Indian

About Company

Fusion Plus Solutions

At Fusion Plus Solutions Inc, we believe that it’s an exceptional company - a company of people proud of the work they do and the solutions they provide. By understanding what drives our specialty industries, becoming involved in our communities on a professional and personal basis, following a disciplined process of identifying quality candidates, partnering with employers to understand their core business and their employment requirements, and delivering exceptional service, we achieve great results for all concerned.

Job ID: 121916471

Jobs by Skill - IT