Data Engineer

About Soul AI Pods

Deccan AI is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from top tier institutes like IITs, NITs, and BITS.

We're hiring for our client servicing arm Soul AI. Soul AI has a talent network, known as Soul AI Pods, under which highly skilled & vetted tech talent gets the opportunity to work with top-tier global tech companies. Our client list includes tech giants like Google & Snowflake.

Read more about here

Responsibilities

• Design, build, and maintain ETL/ELT pipelines using tools like Airflow, DBT, or Spark
• Develop and optimize data lakes, data warehouses, and streaming pipelines
• Ensure data quality, reliability, and lineage across sources and pipelines
• Integrate structured and unstructured data from internal and third-party APIs
• Collaborate with ML teams to deliver production-ready feature pipelines, labeling data, and dataset versioning
• Implement data governance, security, and access control policies

Required Skills

• Strong SQL skills including analytical queries, CTEs, window functions, and query optimization
• Proficient in Python for data manipulation and scripting using libraries like Pandas and NumPy
• Experience with ETL orchestration tools such as Airflow, Prefect, or Luigi
• Hands-on with batch and streaming data processing using Spark, Kafka, or Flink
• Familiarity with data lakes and warehouses (S3, BigQuery, Redshift, Snowflake) and schema design
• Bonus: experience with DBT, data validation, MLOps integration, or compliance-aware data workflows

Application & Other Details

1. To apply, fill the Soul AI Pods Interest Form
2. You will be invited for selection process R1: Test, R2: AI Interview, R3: 1:1 Interview
3. We are hiring for full-time or long Contract (40 hrs/week) hybrid roles
4. We are hiring across different seniority levels

You will work on a key client project (Top-tier tech consulting firm)