Big Data Engineer

Cognine Technologies

Hyderabad, India

5-10 Years

Save

Posted 8 days ago
Be among the first 10 applicants

Early Applicant

Job Description

5 - 10

Hyderabad

Full-Time

Job Summary

We are looking for a skilled Big Data Engineer with strong experience in PySpark and data engineering. The ideal candidate will have hands-on experience in building scalable data pipelines, working with streaming data, and cloud platforms. Experience with Palantir Foundry is highly preferred

Experience Required: 5 – 10 years

Key Responsibilities

Design, develop, and maintain ETL/data pipelines using Python and PySpark
Work with real-time/streaming data systems
Build and optimize data processing solutions on cloud platforms
Collaborate with cross-functional teams to understand business requirements
Develop and maintain CI/CD pipelines
Ensure data quality, performance, and scalability

Required Skills

5–10+ years of experience in Data Engineering
Strong expertise in Python and PySpark
Experience with Kafka, Flink, and Kubernetes
Hands-on with Big Data technologies (Hadoop, Spark, MongoDB)
Experience with cloud platforms (Azure, AWS, or GCP)
Good understanding of data architecture and pipeline design

Preferred Skills

Experience with Palantir Foundry
Knowledge of Java
Experience in consulting or Utilities domain

Share with someone awesome

View all job openings

More Info

Job Type:

Industry:

Function:

Employment Type:

About Company

Cognine TechnologiesJob Source: www.linkedin.com

Job ID: 147507631

Jobs by Skill - IT

Jobs by Skill - Non IT

International Jobs

Last Updated: 18-05-2026 08:16:33 PM

Homejobs in Hyderabad / Secunderabad, TelanganaBig Data Engineer

Similar Jobs

Big Data Engineer with AWS

Nisum

9-11 yrs

Hyderabad, India

Skills:

Machine Learning, Hadoop Ecosystem, Pyspark, Kafka, Mapreduce, Tensorflow, Python, Scala, Bash, HBase, Big Data Technologies, Hive, Linux, Spark, Dynatrace, Keras, MongoDB, Splunk, Airflow, Delta Tables, AWS EMR, Ai, HDFS, Iceberg

Senior Big Data Engineer I

MetLife

8-11 yrs

Hyderabad, India

Skills:

Performance Tuning, Azure Functions, Data Factory, Nosql, Cosmos DB, Python, Hadoop, Scala, Apache Spark, Sql, Hive, Databricks, Azure, Hbase, data marts, Big Data Frameworks, batch data processing, data quality validation, distributed databases, Eventhub, data lakes, Optimization, ETL pipeline development, Medallion architecture, Cloud platforms, Synapse, Datawarehouses, streaming pipelines