Search Jobs

Search by job, company or skills

Lead Data Engineer

Lead Data Engineer

visionet systems inc.
Early Applicant
  • Posted 11 hours ago
  • Be among the first 10 applicants

Job Description

About the Role

  • We are hiring for a Principal Engineer for Data and Platform Architecture to guide the evolution from a single shared SQL Server database toward domain-owned data and service boundaries. This role is central to the microservices modernization program because unsafe data separation can create more risk than the service decomposition removes.
  • You will define data ownership, migration sequencing, compatibility patterns, distributed processing, and reporting continuity across the platform. You will work as a peer to the Principal Architect and will not replace database administration, DevOps, analytics, or pod-level engineering ownership.

What You Will Own

  • Define the target data architecture, domain ownership model, and transition away from unrestricted shared-database access.
  • Create migration patterns for schema separation, data replication, synchronization, reconciliation, and cutover.
  • Guide transaction-boundary decisions, consistency models, event flows, and failure recovery across services.
  • Protect reporting, auditability, historical access, and client integrations during data migration.
  • Establish standards for data contracts, lineage, retention, privacy, quality, and controlled access.
  • Review high-risk data changes and lead proofs of concept for difficult migration or scale concerns.
  • Mentor Engineering Leads and senior engineers in data architecture and distributed data trade-offs.

What You Bring

  • 12+ years in platform, backend, or data-intensive engineering with senior technical leadership experience.
  • Deep relational database architecture and SQL performance expertise; SQL Server experience is strongly preferred.
  • Experience decomposing a shared database or monolithic data model into owned domains incrementally.
  • Strong knowledge of transactions, consistency, messaging, change data capture, reconciliation, and data migration.
  • Experience with high-volume processing, operational reporting, audit controls, and production data safety.
  • Working knowledge of Java and Spring Boot systems and the operational needs of distributed services.
  • Ability to lead through design, code, prototypes, reviews, and written technical decisions.

What Sets You Apart

  • You have led a data or platform center of excellence and converted research into production standards.
  • You have modernized data architecture while preserving live reporting and client operations.
  • You know when a dedicated data pipeline, specialist engineer, or platform investment is justified by sustained demand.

Success in This Role

  • Each modernized domain has explicit data ownership and controlled access boundaries.
  • Migrations include reconciliation, rollback, observability, and reporting continuity from the start.
  • The platform reduces shared-database coupling without creating inconsistent or duplicated sources

More Info

Job Type:
Industry:
Employment Type:

Key Skills

production data safety

SQL performance expertise

operational reporting

high-volume processing

transactions consistency

relational database architecture

audit controls

Similar Jobs

10-12 yrs
Bengaluru, India
Skills:
Spark, Java, Hadoop, Pyspark, Etl Development, Scala, Data Warehousing, Data Modeling, Sql, Google Cloud, Big Data Technologies, Hive, Docker, Azure, Kubernetes, Python, AWS, Airflow, Prefect
10-12 yrs
Bengaluru, India
Skills:
Spark, Sql, Etl Development, Big Data Technologies, Data Modeling, Java, Hadoop, Pyspark, Google Cloud, AWS, Hive, Data Warehousing, Kubernetes, Python, Azure, Docker, Scala, Airflow, Prefect
7-15 yrs
Coimbatore, Chennai, Bengaluru
Skills:
Gcp, Apache Beam, Java, BigQuery, Sql, Data Modeling, Cloud Storage, Dataproc, Kafka, Git, Agile, Python, Spark, Data Quality, Data Governance, Cloud Security, Google Dataflow, ETL/ELT, Batch Processing, Streaming Data Pipelines, Pub/Sub, Cloud Composer, CI/CD, Performance Optimization
10-20 yrs
Bengaluru
Skills:
data engineering , Oracle), SQL & Python, Data Warehousing (Redshift, SQL Server, Aws Cloud, Data Pipeline Architecture
15-18 yrs
Bengaluru, India
Skills:
S3, Pyspark, AWS Glue, Tableau, Apache Airflow, Lambda, Python, Java, Scoop, BigQuery, Hadoop, Power Bi, Scala, Redshift, Sql, Hive, Azure Data Factory, Linux, Spark, Etl, GCP Dataflow, Control-M, SOAP APIs, HDFS, Synapse, Microstrategy