- Databricks Lead
- Key skills Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL)
- Must-have skills
- 6+ years of experience required for this role
- Cloud certified in one of these categories
- Azure Data Engineer
- Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation
- Semantic Modelling/ Optimization of data model to work within Rahona
- Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.
- Experience in Sqoop / Hadoop
- Microsoft Excel (for metadata files with requirements for ingestion)
- Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud
- Strong Programming skills with at least one of Python, Scala or Java
- Strong SQL skills ( T-SQL or PL-SQL)
- Data files movement via mailbox
- Source-code versioning/promotion tools, e.g. Git/Jenkins
- Orchestration tools, e.g. Autosys, Oozie
- Source-code versioning with Git.
- Nice-to-have skills
- Experience working with mainframe files
- Experience in Agile environment, JIRA/Confluence tools
This job is provided by Shine.com
