About Cybage
Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the worlds largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are enabled by a scientific, data-driven system called Decision Mines for Digital Excellence
Key Aspects of the Role:
- Design and implement the Audience Database architecture, integrating multiple data sources including CRMs, APIs, and web tracking.
- Build and manage ETL/ELT pipelines using Airbyte to ingest and normalize data into storage layers such as PostgreSQL, S3, and ClickHouse.
- Develop backend components and RESTful APIs using FastAPI to serve audience data for dashboards and campaign systems.
- Integrate and optimize Elasticsearch for indexing, search, and personalized audience filtering.
- Apply data transformations, deduplication, and schema management using Python and SQL.
- Ensure high availability, performance, and reliability of the data infrastructure.
- Work closely with product and analytics teams to define data requirements and delivery mechanisms.
- Lead and mentor a team of data engineers and ensure project milestones are met.
Required skillset:
- Experience in Data Engineering, with strong Python programming skills.
- Proven experience with Airbyte (Cloud or OSS) for connector-based data ingestion.
- Hands-on experience building APIs using FastAPI or similar Python frameworks (Flask, Django REST).
- Strong experience with Elasticsearch, including index design, query optimization, and integration.
- Solid command of SQL and data modeling in PostgreSQL or other relational databases.
- Familiarity with cloud storage and processing (e.g., AWS S3).
- Experience with OAuth2, webhooks, and API-based integrations.
- Ability to lead small technical teams and coordinate with stakeholders across functions.
