Azure Data Engineer (Pyspark)

Role - Azure Data Engineer

Location - Bangalore /Hyderabad

Experience - 6 to 10 Yrs

Required Technical Skill Set

• Minimum 5 years of PySpark Development experience, especially in Spark SQL and Complex Transformations
• Minimum 3 years of Python development experience
• Minimum 2 years of experience in ADF

1) Strong design and data solutioning skills

2) PySpark hands-on experience with complex transformations and large dataset handling experience

3) Good command and hands-on experience in Python. Experience working with following concepts, packages, and tools, a. Object oriented and functional programming b. NumPy, Pandas, Matplotlib, requests, pytest c. Jupyter, PyCharm and IDLE d. Conda and Virtual Environment

4) Working experience must with Hive, HBase or similar

5) Azure Skills a. Must have working experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Databases b. Azure DevOps c. Azure AD Integration, Service Principal, Pass-thru login etc. d. Networking vnet, private links, service connections, etc. e. Integrations Event grid, Service Bus etc.