Data Engineer
Job Description
Migration of Oracle Database to Databricks
We are part way through migrating two Oracle Databases to Databricks. This is a lift and shift activity, converting the oracle SQL into Databricks SQL. We will need engineers to help with:
- Data Ingestion into Databricks
- Conversion of Oracle SQL into Databricks SQL
- Writing Python based testing frameworks for data reconciliation
Migration of SAP HANA to Databricks
We are migrating SAP HANA to Databricks, using another 3 rd party for the code conversion. We will need to engineers to help with:
- Data Ingestion into databricks
- Data Reconciliation between databricks and SAP HANA
- Writing Python based testing frameworks for data reconciliation
Network Data Model
We are building a new dataset in databricks that will help us better understand our delviery network. We will need engineers to help with:
- Data Ingestion (Streaming, Batch)
- Data ETL (Streaming, Batch)
- Data Modelling in Databricks (Medallion Architecture)
More Info
Job Type:
Industry:
Function:
Employment Type:
Key Skills
About Company
Skills:
Python, Sql, Hadoop, Spark, Data Warehousing, Etl, Machine Learning, Data Modeling, Cloud Computing, Api Development
SENIOR DATA ENGINEER
**********Company Name Confidential
Skills:
Security amp; Reliability, Snowflake Openflow ? Apache NiFi ? ETL/ELT Pipeline Development ? Data Ingestion, Transformation amp; Integration ? Snowflake Data Warehousing ? Data Flow Optimization amp; Performance Tuning ? Data Quality
Skills:
Gcp, Ml, Power Bi, Dynamodb, Tableau, Sql, Tensorflow, Pytorch, Docker, Data Governance, Etl Tools, MongoDB, Azure, Kubernetes, Python, AWS, Generative AI, NoSQL databases, Ai, data warehousing solutions, Looker, CI CD
Skills:
snowflake , Data Modeling, Powerbi, Data Warehousing, Sql, Python, Etl, Azure Data Fabric
Skills:
Data Engineer, Sql Development, Data Modeling, Data Cleansing, Python, ELT/ETL