Data Engineer

Migration of Oracle Database to Databricks

We are part way through migrating two Oracle Databases to Databricks. This is a lift and shift activity, converting the oracle SQL into Databricks SQL. We will need engineers to help with:

• Data Ingestion into Databricks
• Conversion of Oracle SQL into Databricks SQL
• Writing Python based testing frameworks for data reconciliation

Migration of SAP HANA to Databricks

We are migrating SAP HANA to Databricks, using another 3 rd party for the code conversion. We will need to engineers to help with:

• Data Ingestion into databricks
• Data Reconciliation between databricks and SAP HANA
• Writing Python based testing frameworks for data reconciliation

Network Data Model

We are building a new dataset in databricks that will help us better understand our delviery network. We will need engineers to help with:

• Data Ingestion (Streaming, Batch)
• Data ETL (Streaming, Batch)
• Data Modelling in Databricks (Medallion Architecture)