Data Engineer

About The Role

We are seeking an experienced Senior Software Engineer with deep Python expertise to design, develop, and maintain backend services and data platform components for an AI-driven data intelligence platform. This is an individual contributor role with significant technical influence, requiring architectural leadership, mentorship, and the delivery of scalable, production-grade backend solutions.

Key Responsibilities

Backend Development and Architecture

Design and develop high-performance backend services and RESTful APIs using Python frameworks such as FastAPI, Django, or Flask following clean architecture and domain-driven design principles.

Build and maintain asynchronous processing pipelines using Celery, Redis, and event-driven microservices.

Architect scalable microservices for high-throughput data ingestion, transformation, and analytics.

Own end-to-end backend feature delivery from design through deployment, performance optimization, and production support.

Data Platform and Integration

Develop and optimize data pipelines integrating Databricks, SQL databases, and cloud-native storage services.

Design caching strategies, data access layers, and API contracts for internal and external consumers.

Collaborate with Data Engineering and Data Science teams to operationalize machine learning models and analytics workflows.

Integrate third-party APIs and enterprise systems with a focus on reliability, fault tolerance, and scalability.

Quality and Engineering Excellence

Lead code reviews and establish coding standards and engineering best practices.

Develop comprehensive unit, integration, and contract testing strategies.