Search by job, company or skills

Data Engineer

Data Engineer

Concentrix
Fresher
Not Disclosed
Early Applicant
  • Posted 20 hours ago
  • Be among the first 50 applicants

Job Description

Job Title:

Data Engineer

Job Description

We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled.

The global technology and services leader that powers the world's best brands, today and into the future. We're solution-focused, tech-powered, intelligence-fueled. With unique data and insights, deep industry expertise, and advanced technology solutions, we're the intelligent transformation partner that powers a world that works, helping companies become refreshingly simple to work, interact, and transact with. We shape new game-changing careers in over 70 countries, attracting the best talent.

In our Information Technology and Global Security team, you will deliver the latest technology infrastructure, transformative software solutions and industry-leading global security for our staff and clients. You will work with the best in the world to design, implement and strategize IT, security, application development, innovation, and solutions in today's hyperconnected world. You will be part of the technology team that is core to our vision of develop, build and run the future of Integrated Services.

Our game-changers around the world have devoted their careers to ensuring every relationship is exceptional. And we're proud to be recognized with awards such as World's Best Workplaces, Best Companies for Career Growth, and Best Company Culture, year after year.

We embrace our game-changers with open arms, people from diverse backgrounds, who are curious and willing to learn. Your natural talent to help others and go beyond WOW for our customers will fit right in with what we do and who we are.

Join us and be part of this journey towards greater opportunities and brighter futures.

Job Overview

We are seeking an experienced and results-driven Data Engineer with 4-6 years of relevant experience in designing, developing, and optimizing scalable data solutions using Azure Databricks and related technologies.

The ideal candidate should have strong hands-on expertise in Azure Databricks, PySpark, Apache Spark, SQL, Python, ETL/ELT development, Delta Lake, Azure cloud services, CI/CD, and performance optimization. The role requires practical experience in building reliable, secure, and production-grade data pipelines.


Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Databricks, PySpark, Python, and SQL.
  • Build and optimize batch and large-scale data-processing solutions using Apache Spark.
  • Develop data ingestion and transformation workflows for structured and semi-structured data.
  • Implement reliable data-processing frameworks using Delta Lake capabilities.
  • Perform data cleansing, validation, reconciliation, and quality checks to ensure accuracy and consistency.
  • Optimize Spark jobs, Databricks notebooks, SQL queries, clusters, and data pipelines for performance and cost efficiency.
  • Troubleshoot pipeline failures, data-quality issues, production incidents, and performance bottlenecks.
  • Implement incremental data processing, partitioning, caching, join optimization, and file-management techniques.
  • Develop reusable and configurable data-engineering components.
  • Implement version control and automated deployment processes using CI/CD and DevOps practices.
  • Collaborate with data architects, analysts, application teams, and business stakeholders to translate requirements into technical solutions.
  • Maintain technical documentation covering pipeline architecture, transformation logic, dependencies, and operational procedures.
  • Ensure solutions comply with organizational standards for security, governance, monitoring, and data protection.

Required Technical Skills

  • 4-6 years of relevant experience in data engineering and cloud-based data platforms.
  • Strong hands-on experience with Azure Databricks, PySpark, Apache Spark, Python, and advanced SQL.
  • Proven expertise in developing scalable ETL/ELT pipelines for batch and large-scale data processing.
  • Solid understanding of Delta Lake, including Delta tables, ACID transactions, schema evolution, merge/upsert operations, and table optimization.
  • Experience with Azure data services such as Azure Data Lake Storage and Azure Data Factory.
  • Strong knowledge of Spark and Databricks performance optimization, including partitioning, caching, join strategies, shuffle optimization, file sizing, and cluster configuration.
  • Experience with Git-based version control, CI/CD pipelines, and DevOps practices for automated deployment across environments.
  • Good understanding of data quality, security, monitoring, troubleshooting, and production support.

Location:

IND Bangalore - MTP C4, 3rd Flr

Language Requirements:

Time Type:

Full time

More Info

Key Skills

DevOps practices

Git-based version control

CI CD

Azure Data Lake Storage

Delta Lake

About Company

Mission: Hi, we're Concentrix. We're a global technology and services leader that powers the brands of the future. We help well-known brands - the ones you use every day - improve their businesses with technology and integrated solutions, in over 70 countries. Company Overview: We power the brands of the future. Some call us a global technology and services leader. But we're so much more. Human-centered, tech-powered, intelligence fuelled. Every day we're busy helping over 2000 of the world's best brands solve their toughest business challenges. Whether it's…… designing game-changing brand experiences, building and scaling secure AI technologies, or building loyalty to drive revenue. We've got them covered. But how We design, build, and run fully integrated, end-to-end solutions across the entire enterprise, at speed and scale. We're the strategic thinkers who designbrand-defining experiences. The technologists & engineers who buildsmarter solutions. And the operational experts who run it all and make it work seamlessly. By integrating strategy & design with data & analytics, enterprise technology, and digital operations. You could say, at the heart of everything we do lies a commitment to transform the way companies connect, interact, and grow across the world and into the future. Experience the power of Concentrix. Concentrix CVG Corporation is an EEO/AA/M/F/Vet/Disability Employer.

Similar Jobs

1-3 yrs
Bengaluru, India
Skills:
Data Analytics, Machine Learning, Data Warehousing, Sql, Tensorflow, Sklearn, Dashboards, Pytorch, Python, Etl, data pipelines, Gen AI agents, Geo-Spatial data, generative AI models, dimensional data modeling, Gemini, Retrieval Augmented Generation
0-2 yrs
Bengaluru, India
Skills:
data engineering , Apache Hadoop, Amazon Web Services, Machine Learning, Java Programming Language, Data Modeling, Apache Spark, Big Data, Apache Kafka, Microsoft Azure, Data Warehousing, Data Pipelines, Extract Transform Load ETL, Python Programming Language, Scala Programming Language, SQL Programming Language, Data Analysis
Bengaluru, India
Skills:
Pytest, Pyspark, Azure Databricks, Sql, ELT, Rest Api, Git, Databricks, FastAPI, Python, Etl, Medallion Architecture, CI CD, Delta Lake, Data Lake Storage
Bengaluru, India
Skills:
Apache Airflow, Hadoop, Spark, Apache Beam, Python, Google DataProc, dbt, Google DataFlow, Google Cloud Ecosystem, Google Cloud Storage
Bengaluru, India
Skills:
Celonis Execution Management Systems (EMS), Object-Centric Data Model (OCDM), Database Management, Sql, Python, Celonis data integration frameworks, enterprise data architecture, ETL processes, Celonis Process Mining, PQL