Azure Databricks + Pyspark

Role: Azure Databricks + PySpark

Exp: 6 Yr to 9 Yr

Location: PAN India

Full Time

Job description

**Skill Requirements**: - Strong development skills in PySpark and Azure Databricks are a must

- Must have hands-on experience on PySpark Dataframes, RDD, DAG Partitioning, SparkSQL Optimization, and Clustering

- Experience in working on ongoing operations involving Azure Databricks

- Power BI tech stack is good to have

- Knowledge of Azure DevOps, Azure SQL DW, and ADF is required, and the candidate should be able to explain solutions using the same

- Experience in working in Azure medallion architecture is preferable

- Should be capable of doing detailed RCA on incidents and generating preventive actions

- Should have experience in both development and operations data projects

- Ability to create processes to manage code quality, CI/CD testing, and manage execution within the team

- Excellent written and oral communication in English

- Should have strong skills in the Japanese language, both written and oral