About Us
Deccan AI Experts is a pioneering AI company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high-quality human-curated data, AI-first operations, advanced AI evaluation systems, and scalable data solutions that power next-generation artificial intelligence.
About the Role
We are seeking a skilled Data Engineer (Freelancer) to support advanced AI evaluation and data infrastructure initiatives. In this role, you will work on designing, building, optimizing, and evaluating data pipelines, data models, and data workflows that enable high-quality AI training, evaluation, and deployment.
You will contribute to projects involving large-scale datasets, data transformation, ETL processes, data quality assessment, analytics workflows, and AI-driven data systems. Your expertise will help improve the efficiency, reliability, and scalability of data platforms used in cutting-edge AI research and development.
Responsibilities
- Design and develop scalable data pipelines for data ingestion, transformation, validation, and processing.
- Create deliverables addressing real-world data engineering challenges and workflows.
- Evaluate and review data-related outputs, datasets, schemas, and pipeline implementations.
- Assess data quality, consistency, completeness, integrity, and usability across various data sources.
- Identify data issues, pipeline bottlenecks, performance gaps, and architecture inefficiencies, providing structured recommendations for improvement.
- Work with structured, semi-structured, and unstructured datasets across multiple domains.
- Develop and optimize ETL/ELT workflows for large-scale data processing.
- Collaborate on projects involving data warehousing, cloud-based data infrastructure, and analytics platforms.
- Review peer-developed deliverables to improve project quality, consistency, and evaluation standards.
- Contribute domain expertise to improve AI systems focused on data understanding, processing, and evaluation.
Requirements
- Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.
- Strong experience with SQL and relational databases.
- Proficiency in Python and data processing libraries.
- Experience building and maintaining ETL/ELT pipelines.
- Familiarity with data warehousing concepts and modern data architectures.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Knowledge of big data technologies such as Spark, Hadoop, Databricks, or similar frameworks is a plus.
- Strong understanding of data modeling, data governance, and data quality best practices.
- Excellent analytical, problem-solving, and debugging skills.
- Ability to work independently in a remote, fast-paced environment.
- Strong written and verbal communication skills in English.
Why Join Us
- Competitive hourly pay: ₹1200/hour
- Fully remote with flexible working hours
- Opportunity to contribute to cutting-edge AI and data engineering research
- Exposure to advanced AI evaluation systems and large-scale data infrastructure projects
- Flexible project-based opportunities with global teams
- Work alongside experts from IITs, IIMs, NITs, and leading technology organizations
