Big Data Engineer – Contractor

Job Type: Contract

Work Mode: Remote(US Shift Timings)

Experience: 3-6 years

Industry: Technology / AI / Data Engineering

Job Summary

We are looking for an experienced Big Data Engineer to join our team on a contract basis and contribute to building scalable, reliable, and high-performance data solutions.

In this role, you will work on large-scale data pipelines and distributed data systems that support next-generation AI and data-driven applications. You will collaborate with technical and cross-functional teams to design, develop, optimize, and maintain robust data infrastructure and processing workflows.

The ideal candidate has strong hands-on experience with Python, SQL, data pipelines, ETL, distributed data processing frameworks, and relational/NoSQL databases, along with a strong understanding of data engineering best practices.

Key Responsibilities

Design, develop, and maintain scalable big data pipelines and data architectures.
Build efficient data ingestion, integration, transformation, and processing workflows using Python and modern data engineering technologies.
Develop and optimize distributed data processing solutions using technologies such as Apache Spark, PySpark, Hadoop, or Apache Flink.
Design, manage, and optimize relational and NoSQL databases for scalability, reliability, and performance.
Develop and maintain ETL/ELT pipelines, data models, and data warehousing solutions.
Work with cross-functional teams to understand data requirements and translate business needs into scalable technical solutions.
Monitor, troubleshoot, and optimize data pipelines and distributed systems to ensure high availability and performance.
Implement data quality, security, governance, validation, and monitoring practices.
Identify performance bottlenecks and continuously improve data processing efficiency.
Develop technical documentation and communicate complex technical concepts clearly to technical and non-technical stakeholders.
Work independently in a remote and collaborative environment, taking ownership of assigned projects and deliverables.

Required Skills & Qualifications

4+ years of hands-on experience in Big Data Engineering / Data Engineering.
Strong proficiency in Python for data processing, automation, and integration.
Strong knowledge of SQL and relational databases.
Hands-on experience with NoSQL databases such as MongoDB, Cassandra, DynamoDB, or similar technologies.
Experience with distributed data processing frameworks such as Apache Spark/PySpark, Hadoop, or Flink.
Strong understanding of ETL/ELT, data pipelines, data modeling, and data warehousing concepts.
Experience designing and maintaining large-scale data processing pipelines.
Understanding of data quality, security, governance, and system monitoring.
Strong analytical and troubleshooting skills.
Excellent written and verbal communication skills.
Ability to work independently, proactively, and effectively in a remote environment.

Preferred Qualifications

Experience with cloud-based data platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP).
Experience working with fast-paced, startup, or globally distributed teams.
Familiarity with MLOps, machine learning pipelines, or data science workflows.
Experience working with cloud-based big data technologies and distributed storage systems.
Exposure to AI/ML data pipelines or large-scale datasets is a plus.

Key Skills

What You'll Work On

You will have the opportunity to work on challenging large-scale data engineering problems and contribute to data infrastructure supporting next-generation AI systems. The role offers an opportunity to work with modern data technologies while collaborating with distributed teams in a remote environment.