Search by job, company or skills

Lead Data Engineer

Lead Data Engineer

vericence
8-10 Years
Not Disclosed

This job is no longer accepting applications

Job Description

About Vericence

Vericence is a digital engineering and technology consulting firm helping enterprises build AI-driven platforms, modernize legacy systems, and scale innovation through cloud, data, and intelligent engineering. We partner with global organizations to deliver high-impact technology solutions and build world-class engineering teams.

Job Summary

We are looking for a skilled Lead Data Engineer with 8-10 years of experience in designing, developing, and maintaining scalable data pipelines and data integration solutions. The ideal candidate should have strong expertise in Python, Oracle Cloud Infrastructure (OCI), and PL/SQL, along with hands-on experience in ETL development, data modeling, and database performance optimization. Experience working with cloud-native data services and large-scale enterprise data platforms is highly preferred.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Python and PL/SQL.
  • Develop data integration solutions on Oracle Cloud Infrastructure (OCI).
  • Build and optimize data ingestion, transformation, and validation processes.
  • Write complex SQL and PL/SQL packages, procedures, functions, and triggers for enterprise applications.
  • Design and maintain data models to support analytics and operational reporting.
  • Optimize SQL queries and database objects for high performance and scalability.
  • Work with Oracle Autonomous Database, Oracle Database, and OCI Object Storage.
  • Develop data workflows using OCI Data Integration and related cloud services.
  • Ensure data quality, integrity, governance, and security across the data platform.
  • Troubleshoot production issues, perform root cause analysis, and implement permanent fixes.
  • Collaborate with business analysts, application developers, and data architects to gather and implement data requirements.
  • Automate operational tasks using Python scripts and cloud-native services.
  • Participate in code reviews, documentation, and deployment activities.

Required Skills

  • 8-10 years of experience in Data Engineering or ETL development.
  • Strong programming experience in Python.
  • Advanced SQL and PL/SQL development skills.
  • Hands-on experience with Oracle Cloud Infrastructure (OCI).
  • Experience with Oracle Database (12c/19c), Autonomous Database, and Oracle SQL Developer.
  • Strong understanding of ETL/ELT concepts, data warehousing, and dimensional modeling.
  • Experience with OCI Data Integration, Object Storage, Data Flow, or related OCI services.
  • Knowledge of REST APIs, JSON, XML, and file-based integrations.
  • Experience with Git and CI/CD pipelines.
  • Strong debugging, analytical, and performance tuning skills.

Preferred Skills

  • Experience with Apache Airflow or other workflow orchestration tools.
  • Familiarity with Spark or distributed data processing frameworks.
  • Experience with Docker and Kubernetes.
  • Knowledge of Linux shell scripting.
  • Exposure to Oracle Analytics Cloud (OAC), Oracle Integration Cloud (OIC), or Oracle GoldenGate.
  • Understanding of data governance and security best practices.

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Oracle Cloud certifications (OCI Foundations, OCI Data Management, or Oracle Database certifications) are a plus.

Preferred Technologies

  • Programming: Python, PL/SQL, SQL
  • Cloud: Oracle Cloud Infrastructure (OCI)
  • Database: Oracle Database, Autonomous Database
  • Data Services: OCI Data Integration, Object Storage, Data Flow
  • Version Control: Git
  • Operating System: Linux

Tools: Oracle SQL Developer, VS Code, Postman

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Autonomous Database

OCI Data Integration

About Company

Similar Jobs

9-11 yrs
Bengaluru, India
Skills:
Pyspark, Scala, Apache Spark, Kafka, Oracle Goldengate, Jenkins, Terraform, Python, Airflow, Google BigQuery, Cloud Composer, GitHub Actions
7-9 yrs
Hyderabad, India
Skills:
snowflake , Adf, Agile Methodologies, Informatica, Sql Development, Git, Gcp, Azure, AWS, Airflow, dbt Core, Kimball Dimensional Modeling, Matillion, dbt Cloud, CI CD pipelines, Fivetran, Snowflake Certification SnowPro Core Advanced
10-12 yrs
Bengaluru, India
Skills:
snowflake , Data Lineage, Pyspark, Apache Spark, Sql, ELT, Data Quality, Goldengate, Data Lake, Databricks, Data Governance, Python, AWS, Etl, AWS DMS, Data Pipelines, Lakehouse, Observability
8-10 yrs
Pune, India
Skills:
snowflake , Pyspark, Scala, Redshift, Sql, Gcp, Spark, Databricks, Azure, Python, AWS, Etl
7-9 yrs
Bengaluru, India
Skills:
Orchestration, S3, Metadata Management, Pyspark, PostgreSQL, Automated Testing, Data Modeling, Lambda, Advanced Sql, Python, RDS, release management, Dynamodb, SQL Server, Redshift, Data Quality, ECS, transformation standards, CI CD, AWS data services, ETL best practices, data cataloging, Step Functions, Monitoring, large-scale data processing, Glue