Search by job, company or skills

Data Engineer

Data Engineer

Giggso
3-5 Years
Not Disclosed
Early Applicant
  • Posted 12 hours ago
  • Be among the first 10 applicants

Job Description

Role Overview:

We are seeking a versatile Data Engineer with a hybrid background in traditional data engineering (SQL), semantic modeling (Ontologies), Graph Databases, and Machine Learning systems. In this role, you will design, build, and optimize the connected data architecture that powers our Enterprise Knowledge Graph (EKG), feature stores, and advanced ML pipelines.

You will bridge relational systems, graph databases, and ML models—building scalable data pipelines (ETL/ELT), transforming raw data into structured ontologies, and preparing graph-native features for downstream AI/ML applications like GraphRAG, link prediction, and recommendation systems.

WeAreDevelopers

Key Responsibilities

Data Engineering & Pipeline Architecture
  • Scalable Data Pipelines: Design, implement, and maintain high-throughput batch and streaming ETL/ELT data pipelines using SQL, Python, and modern data orchestration frameworks (e.g., Airflow, Prefect, dbt).
  • WeAreDevelopers
  • Relational & Analytical Data Stores: Write complex SQL queries, procedures, and transformations across data warehouses (e.g., Snowflake, BigQuery, PostgreSQL) to clean, aggregate, and stage raw business data.
  • Data Integration: Extract structured, semi-structured, and unstructured data from transactional databases, APIs, and file systems to map into graph-ready schemas.
  • WeAreDevelopers
Knowledge Graph & Ontology Engineering
  • Graph Modeling: Build and optimize graph data schemas and property graph models (nodes, edges, labels) aligned with business domain ontologies.
  • WeAreDevelopers
  • Semantic Mapping & Ingestion: Translate semantic concepts (OWL, RDF, SKOS, SHACL) and relational SQL schemas into Graph Database models (Property Graphs or Triple Stores).
  • Siemens Jobs
  • Graph Database Management: Administer, query, and tune performance on graph databases (e.g., Neo4j, AWS Neptune, Stardog, GraphDB) using languages like Cypher, Gremlin, or SPARQL.
  • Myworkdayjobs.com
Machine Learning & AI Integration
  • Graph ML & Feature Engineering: Generate node/edge embeddings (e.g., Node2Vec, PyTorch Geometric) and engineer graph-based features for ML pipelines.
  • ML Pipeline Support: Partner with Data Scientists and Machine Learning Engineers to operationalize ML models, enabling GraphRAG (Retrieval-Augmented Generation), entity resolution, link prediction, and vector/graph hybrid search.
  • WeAreDevelopers
  • Feature Store Integration: Maintain dataset versioning, lineage, and metadata catalogs for both ML training data and graph nodes/relationships.
Required Qualifications & Skills
  • Core Data Engineering: 3+ years of data engineering experience with expert proficiency in Python and advanced SQL (window functions, query tuning, complex JOINs).
  • Myworkdayjobs.com
  • Graph Databases: 2+ years of hands-on experience building, querying, and managing graph databases (e.g., Neo4j, AWS Neptune, TigerGraph, Stardog) using query languages like Cypher, Gremlin, or SPARQL.
  • Ontology & Semantic Web: Familiarity with data ontologies, taxonomies, and W3C standards (RDF, RDFS, OWL, SKOS, SHACL).
  • Machine Learning Fundamentals: Practical experience deploying or supporting ML models, feature stores, and working with libraries such as PyTorch/TensorFlow, Scikit-learn, spaCy, or Hugging Face.
  • Cloud & Orchestration: Proven experience with cloud platforms (AWS, GCP, or Azure) and pipeline orchestration tools (Apache Airflow, Prefect, or dbt).

Preferred / Good-to-Have Skills
  • Experience building GraphRAG solutions combining Knowledge Graphs with Vector Databases (e.g., Pinecone, Weaviate, Qdrant) and LLMs.
  • WeAreDevelopers
  • Experience with Graph Neural Networks (GNNs) or graph embedding algorithms (e.g., PyG, DeepWALK).
  • WeAreDevelopers
  • Exposure to streaming architectures (Apache Kafka, Spark Streaming) for real-time graph updates.
  • Knowledge of SHACL/ShEx for data quality validation in graph environments.
Education & Experience
  • Bachelor's or Master's degree in Computer Science, Data Engineering, Software Engineering, or a related quantitative field.
  • 3+ years of experience in software or data engineering, with at least 2 years actively working with semantic graphs or graph databases.
  • Professional certifications from Google/Oracle/AWS are an added advantage for this role.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

6-8 yrs
Chennai, India
Skills:
S3, Github, Performance Tuning, Agile Development Methodologies, Pyspark, Emr, Redshift, Sql, ELT, Lambda, Git, Iam, Data Warehousing, Python, Etl, AWS Data Services, Glue, Optimization of Spark applications, Athena
5-7 yrs
Chennai, India
Skills:
Kafka, API design, Data Modeling, Microservices, ELT, Distributed Systems, Python, Java, BigQuery, Hadoop, Data Quality, Hive, MLops, Spark, Data Governance, Databricks, Fault Tolerance, Kubernetes, Etl, Airflow, GenAI, LLM tooling, event-driven patterns, asynchronous processing, cloud-native practices, observability, Big Data ecosystem, HDFS, Delta Lake, CI/CD
6-10 yrs
Chennai, India
Skills:
ELT, Cloud Storage, Python, Ml, Google Cloud Platform, Sql, Devops, Git, Data Governance, Etl, Data Streams, Airflow, GenAI, Data engineering services, Google BigQuery, Data Flow, Cloud Composer, API integrations, Informatica CDC, data observability, Ai, data fusion, dbt, CI/CD
4-6 yrs
Chennai, India
Skills:
Git, Pyspark, Databricks, Azure, Sql, Python, AWS
5-7 yrs
Chennai, India
Skills:
Gcp, Pyspark, Azure, Python, Sql, AWS