

Search by job, company or skills

This job is no longer accepting applications
Job Category: Data Engineer Hadoop python Spark
Job Type: Full Time
Job Location: Pune
We are seeking a highly skilled and motivated Data Engineer with over 5 years of experience in big data technologies, specializing in Spark, Python, and Hadoop. The ideal candidate will have a strong track record of designing, building, and maintaining scalable data pipelines and solutions. In this role, you will develop and optimize robust data workflows using Apache Spark and Python, ensuring data transformation, cleaning, and enrichment processes meet the needs of analytics and machine learning initiatives. You will also design and implement scalable solutions leveraging the Hadoop ecosystem while collaborating with cross-functional teams to gather requirements and ensure seamless data integration.
Key responsibilities include monitoring and troubleshooting production pipelines to ensure reliability and performance, implementing best practices for data governance, security, and compliance, and optimizing workflows for maximum efficiency. Candidates should have a bachelor s degree in Computer Science, Engineering, or a related field, with strong expertise in distributed computing principles and big data architecture. Experience with ETL processes, data warehousing, and cloud platforms (AWS, Azure, or GCP) is a plus. If you are passionate about big data technologies and enjoy problem-solving in a collaborative environment, we invite you to apply and contribute to our dynamic and innovative team.
Role: Data Engineer
Industry Type: IT Services & Consulting
Department: Engineering - Software & QA
Employment Type: Full Time, Permanent
Role Category: Software Development
Education
UG: Any Graduate
PG: Any Postgraduate
iKrux is a young Technology Engineering Talent Enablement Squad serving the Global IT landscape. iKrux has been incalculably successful in creating global impact with a highly adept intelligent workforce that helps organizations to achieve mission-critical, technology-aligned projects. Keeping pace with projects and being on the lookout for extremely high competent technology individuals has become ever more challenging. iKrux play a key role to bring the best suited technology engineering brains for organisation.
Job ID: 103734953
Skills:
snowflake , Hadoop, Sql, Apache Spark, Azure Machine Learning, Kafka, AWS, Plsql, Python, Redshift, LlamaIndex, DataStax AstraDB, LangChain
Skills:
Automated Testing, BigQuery, Kubernetes, Python, Api Development, machine learning frameworks, Cloud Run, data transformation tools, MLOps tools, dbt, Go, VertexAI, Monitoring, CI CD pipelines, GCP services, model versioning
Skills:
Sql, Data Warehousing, Pyspark, Machine Learning, Generative AI, Microsoft Fabric
Skills:
Python, Machine Learning, R Programming, Predictive Modeling, Data Science, Text processing, IFRS9
Skills:
Python, Machine Learning, Sql, Automation Testing, Data Analysis