Data Engineer OCI Data Lakehouse (DLH) Projects - Datamatics Technologies - Career Page

Datamatics Global Service

Data Engineer OCI Data Lakehouse (DLH) Projects - Datamatics Technologies - Career Page

Datamatics Global Service

7-12 Years

India

Early Applicant

Posted 17 hours ago

Be among the first 10 applicants

Job Description

Data Engineer – OCI Data Lakehouse (DLH) Projects

Sharjah, UAE, United Arab Emirates

Full Time

Experienced

Data Engineer – OCI Data Lakehouse (DLH) Projects

Location: UAE
Employment Type: Full-Time
Department: Data Management Office
Experience: 7+ Years

Role Overview

Highly skilled Data Engineer for a Data Management Office and to play a key role in advancing enterprise OCI Data Lakehouse (DLH) initiatives. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, ingestion frameworks, and data products that support business analytics, regulatory reporting, and AI/ML-driven innovation.

Working closely with cross-functional stakeholders across Actuarial, Underwriting, Claims, Finance, and Business teams, the Data Engineer will help transform raw data into trusted, high-value data assets that drive strategic decision-making.

Key Responsibilities

Data Engineering & Pipeline Development Design, build, and maintain scalable data ingestion, transformation, and orchestration pipelines using OCI Data Flow, Oracle Data Integrator (ODI), and AIDP.

Develop robust ETL/ELT processes to support enterprise data integration and analytics requirements. Implement and manage Delta Lakehouse architectures, including ingestion, curation, and consumption layers. Data Modeling & Analytics Enablement Design and optimize analytical data models, data marts, and datasets on Oracle Autonomous Data Warehouse (ADW).

Ensure data structures are aligned with business reporting, operational analytics, and advanced AI/ML use cases. Collaborate with business stakeholders to translate requirements into scalable technical solutions and reusable data products. Data Lakehouse & Storage Management Manage both structured and unstructured datasets within OCI Object Storage. Implement storage lifecycle strategies, governance policies, and cost optimization measures.

Ensure efficient organization and accessibility of enterprise data assets across the Data Lakehouse ecosystem. Architecture, Quality & Governance Partner with data architects to create reusable and high-performance ingestion frameworks for new initiatives. Embed data quality, lineage, metadata management, and governance controls into all data pipelines. Drive continuous improvements in platform performance, scalability, and reliability. Performance Optimization Tune and optimize SQL workloads, Spark jobs, ETL processes, and ADW performance. Monitor data processing efficiency and proactively resolve bottlenecks to ensure optimal platform utilization.

Required Skills & Experience

OCI Data Platform Expertise Strong hands-on experience with the following Oracle Cloud Infrastructure services: Oracle Autonomous Data Warehouse (ADW) OCI Object Storage OCI Data Flow (Apache Spark) Oracle Data Integrator (ODI) Oracle AI Data Platform (AIDP)

Technical Competencies

Advanced proficiency in SQL and Python development. Strong experience in performance tuning, optimization, and troubleshooting of large-scale data workloads. Hands-on experience building modern data pipelines and cloud-native data platforms, preferably on Oracle Cloud Infrastructure (OCI). Solid understanding of Delta Lakehouse architecture, Medallion Architecture, data versioning, and modern data engineering best practices.

Domain Knowledge

Exposure to Insurance data domains such as:

Policy Administration

Claims Management

Underwriting

Finance & Regulatory Reporting (Preferred but not mandatory.)

Soft Skills

Strong analytical and problem-solving capabilities. Effective communication and stakeholder management skills. Ability to work collaboratively across business and technology teams in a fast-paced environment.

Preferred Qualifications

Experience with Oracle GoldenGate for real-time data replication and Change Data Capture (CDC) pipelines. Familiarity with modern data governance, metadata management, and data observability frameworks. Exposure to AI/ML data preparation and feature engineering workflows within enterprise Data Lakehouse environments.

Must Have

OCI Data Platform Expertise - Strong hands-on experience with the following Oracle Cloud Infrastructure services: Oracle Autonomous Data Warehouse (ADW), OCI Object Storage, OCI Data Flow (Apache Spark), Oracle Data Integrator (ODI), Oracle AI Data Platform (AIDP)
Advanced proficiency in SQL and Python development.
Strong experience in performance tuning, optimization, and troubleshooting of large-scale data workloads.
Hands-on experience building modern data pipelines and cloud-native data platforms, preferably on Oracle Cloud Infrastructure (OCI).
Solid understanding of Delta Lakehouse architecture, Medallion Architecture, data versioning, and modern data engineering best practices.

Good to Have

Experience with Oracle GoldenGate for real-time data replication and Change Data Capture (CDC) pipelines.
Familiarity with modern data governance, metadata management, and data observability frameworks.
Exposure to AI/ML data preparation and feature engineering workflows within enterprise Data Lakehouse environments.

Apply for this position

Required*

// GTM Values For A/B Testing var EXP1_TWO_STAGE_APPLY_ENABLED = false; var EXP1_TWO_STAGE_APPLY_CHOSEN = false; window.resumeRequired = true;

First Name*

Last Name*

Email Address*

Phone*

Address

Resume*

We've received your resume. Click here to update it.

Attach resume or Paste resume

Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

Are you willing to relocate*

What languages do you speak fluently*

Desired salary*

Earliest start date*

What is your total professional experience*

How many years of relevant experience do you have for this position*

What is your current location (City and Country)*

What is your nationality*

What is your current employment status*

What is your current designation and company name*

What are your key technical skills and areas of expertise*

What is your current monthly salary
Please mention the amount and currency.*

What is your expected monthly salary
Please mention the amount and currency.*

What is your current notice period or earliest availability to join*

Do you have a valid work visa or work permit for the project country*

Are you willing to relocate if required*

What is your proficiency level in English*

Please provide your contact number, including the country code.*

Human Check*

Submit Application

// Define Google Tag Manager script function runGoogleTagManagerScript() const gtmScript = document.createElement(script); gtmScript.async = true; gtmScript.src = https://www.googletagmanager.com/gtm.jsid=GTM-H9NR; const firstScript = document.getElementsByTagName(script)[0]; firstScript.parentNode.insertBefore(gtmScript,firstScript); // Set tracking consent to denied by default window.dataLayer = window.dataLayer || []; function gtag() dataLayer.push(arguments); gtag(consent, default, ad_user_data: denied, ad_personalization: denied, ad_storage: denied, analytics_storage: denied, wait_for_update: 500, ); dataLayer.push(gtm.start: new Date().getTime(), event: gtm.js); window.googleTagManager = window.dataLayer; // If consent has already been granted, load Google Tag Manager if (localStorage.getItem(trackingConsentGranted) === true) runGoogleTagManagerScript(); function grantConsent() // Store tracking consent preference and push update to Google Tag Manager localStorage.setItem(trackingConsentGranted, true); function gtag() googleTagManager.push(arguments); gtag(consent, update, ad_user_data: granted, ad_personalization: granted, ad_storage: granted, analytics_storage: granted ); // Load Google Tag Manager runGoogleTagManagerScript(); function denyConsent() // Store tracking consent preference and do not load Google Tag Manager localStorage.setItem(trackingConsentGranted, false); $([data-track-share-click]).click(function () googleTagManager.push( event: gaEvent, eventCategory: Share Job, eventAction: Click, eventLabel: $(this).data(track-share-click) + Share ); ); function initializeGainsightPX() // Get current page URL var currentURL = window.location.href; // Check if URL contains /apply/confirm/ if (currentURL.includes(/apply/confirm/)) return; // Exit function, do not proceed with initialization // Check to see if user id exists in sample population loading Gainsight PX var sessionID = 2356017adea335d5edd20e428c51f4fa; var visitorType = guest; var samplePercentage = 1; var accountId = customer_20251001122918_1W8DYZ8Z8LE8DASA; var accountName = datamaticstechnologies; // Format signUpDate as YYYY/MM/DD const today = new Date(); const signUpDate = today.getFullYear() + / + String(today.getMonth() + 1).padStart(2, 0) + / + String(today.getDate()).padStart(2, 0); if (visitorType !== guest || __IdSampler.isIdInSamplePopulation(sessionID, samplePercentage)) // Load Gainsight Script (function (n, t, a, e) let i = aptrinsic; n[i] = n[i] || function () (n[i].q = n[i].q || []).push(arguments); ; n[i].p = e; let r = t.createElement(script); r.async = true; r.src = a + a= + e; let c = t.getElementsByTagName(script)[0]; c.parentNode.insertBefore(r, c); )(window, document, https://web-sdk.aptrinsic.com/api/aptrinsic.js, AP-D0FHNVQROUMO-2); // Send custom attributes including Account ID and Account Name aptrinsic(identify, id: sessionID, role: Visitor, signUpDate: signUpDate , id: accountId, name: accountName ); // Initialize Gainsight PX if the URL condition is met initializeGainsightPX(); window.NREUM||(NREUM=);NREUM.info=beacon:bam.nr-data.net,licenseKey:7232591015,applicationID:29127175,transactionName:ZAcBYxEEXxICBkVRDV1NIEIQEV4MTARBSA5KTRNYEAxFCAwL,queueTime:0,applicationTime:57,atts:SEAWFVkeTE1BBBMCGU4f,errorBeacon:bam.nr-data.net,agent:'