Data Engineer

About Cybage

Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the worlds largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are enabled by a scientific, data-driven system called Decision Mines for Digital Excellence

Key Aspects of the Role:

• Design and implement the Audience Database architecture, integrating multiple data sources including CRMs, APIs, and web tracking.
• Build and manage ETL/ELT pipelines using Airbyte to ingest and normalize data into storage layers such as PostgreSQL, S3, and ClickHouse.
• Develop backend components and RESTful APIs using FastAPI to serve audience data for dashboards and campaign systems.
• Integrate and optimize Elasticsearch for indexing, search, and personalized audience filtering.
• Apply data transformations, deduplication, and schema management using Python and SQL.
• Ensure high availability, performance, and reliability of the data infrastructure.
• Work closely with product and analytics teams to define data requirements and delivery mechanisms.
• Lead and mentor a team of data engineers and ensure project milestones are met.

Required skillset:

• Experience in Data Engineering, with strong Python programming skills.
• Proven experience with Airbyte (Cloud or OSS) for connector-based data ingestion.
• Hands-on experience building APIs using FastAPI or similar Python frameworks (Flask, Django REST).
• Strong experience with Elasticsearch, including index design, query optimization, and integration.
• Solid command of SQL and data modeling in PostgreSQL or other relational databases.
• Familiarity with cloud storage and processing (e.g., AWS S3).
• Experience with OAuth2, webhooks, and API-based integrations.
• Ability to lead small technical teams and coordinate with stakeholders across functions.