Company Profile:
We're Hiring at CGI for our GCC - Right Here in Hyderabad!
Join us at the intersection of technology, finance, and innovation. You will be working to support one of the top-tier financial institutions in the U.S. You'll help shape digital solutions for a global enterprise—from the ground up.
This is more than a job. It's your opportunity to:
- Work on cutting-edge technologies
- Collaborate with global teams
- Build a career with purpose and impact
Ready to build the future of banking Let's talk.
Position Description:
Job Title: Senior Software Engineer – Data Engineer
Position: Data Engineer
Experience: 6-8 years
Category: Software Development/ Engineering
Shift: General
Main location: India, Telangana, Hyderabad
Position ID: J0426-0102
Employment Type: Full Time
Job Overview:
We are seeking a highly skilled Data Engineer with strong expertise in Core Hadoop technologies and Python-based data processing frameworks. The ideal candidate should have hands-on experience working with HDFS, Hive, Impala, YARN, and Spark (PySpark) to build scalable data pipelines and support large-scale data processing and analytics platforms.
Key Responsibilities:
- Design, develop, and maintain scalable big data solutions using the Hadoop ecosystem.
- Develop and optimize data processing pipelines using PySpark and Spark frameworks.
- Work extensively with HDFS for distributed data storage and management.
- Develop complex queries and data transformations using Hive and Impala.
- Monitor and manage workloads on YARN resource manager.
- Build and maintain ETL pipelines to ingest, process, and transform large volumes of structured and unstructured data.
- Optimize Spark jobs and Hive queries for performance and scalability.
- Collaborate with data scientists, analysts, and engineering teams to deliver data-driven solutions.
- Ensure data quality, reliability, and performance across data platforms.
- Troubleshoot and resolve issues related to cluster performance and data processing workflows.
Required Skills:
- Strong experience with Core Hadoop ecosystem:
- Proficiency in Python programming.
- Hands-on experience with Apache Spark and PySpark for large-scale data processing.
- Experience in writing optimized Hive queries and data transformations.
- Understanding of distributed computing and big data architecture.
- Experience working with Linux/Unix environments.
- Knowledge of data ingestion frameworks and ETL pipelines.
- Familiarity with performance tuning and troubleshooting Spark/Hadoop jobs.
Good to Have:
- Experience with Kafka, Sqoop, or Flume.
- Exposure to cloud platforms (AWS, Azure, GCP).
- Knowledge of Airflow or other workflow orchestration tools.
- Experience with data warehousing concepts and data lakes.
About CGI:
CGI is an equal opportunity employer. In addition, CGI is committed to providing accommodation for people with disabilities in accordance with provincial legislation. Please let us know if you require reasonable accommodation due to a disability during any aspect of the recruitment process and we will work with you to address your needs.
Your future duties and responsibilities
Required Qualifications To Be Successful In This Role
Together, as owners, let's turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction.
Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our team—one of the largest IT and business consulting services firms in the world.
