Data Engineer

netlink computer inc

5-7 Years

Pune, India

Early Applicant

Posted 4 hours ago
Be among the first 10 applicants

Job Description

Design, develop, and maintain efficient and scalable data pipelines using Python, PySpark, and Databricks on AWS.
Work closely with data scientists, analysts, and other engineers to ensure smooth data integration and high-quality data processing.
Build and optimize complex ETL (Extract, Transform, Load) workflows to handle large datasets.
Implement data ingestion and transformation logic using PySpark on Databricks to improve data processing performance.
Ensure data quality, accuracy, and consistency across all data pipelines.
Collaborate with cross-functional teams to identify and resolve bottlenecks in data systems.
Utilize AWS cloud services (e.g., S3, Redshift, RDS, EMR) for data storage and management.
Write SQL queries to extract, manipulate, and transform data stored in relational databases.
Develop, deploy, and maintain APIs for integrating data systems and enabling data access.
Monitor and troubleshoot data pipelines, ensuring they operate smoothly with minimal downtime.
Stay up to date with the latest industry tools, technologies, and best practices in cloud data engineering and big data processing.

Job Category: Data Services

Job Type: Full Time

Job Location: Pune Gurgaon noida

Experience: 5+ Years

Design, develop, and maintain efficient and scalable data pipelines using Python, PySpark, and Databricks on AWS.
Work closely with data scientists, analysts, and other engineers to ensure smooth data integration and high-quality data processing.
Build and optimize complex ETL (Extract, Transform, Load) workflows to handle large datasets.
Implement data ingestion and transformation logic using PySpark on Databricks to improve data processing performance.
Ensure data quality, accuracy, and consistency across all data pipelines.
Collaborate with cross-functional teams to identify and resolve bottlenecks in data systems.
Utilize AWS cloud services (e.g., S3, Redshift, RDS, EMR) for data storage and management.
Write SQL queries to extract, manipulate, and transform data stored in relational databases.
Develop, deploy, and maintain APIs for integrating data systems and enabling data access.
Monitor and troubleshoot data pipelines, ensuring they operate smoothly with minimal downtime.
Stay up to date with the latest industry tools, technologies, and best practices in cloud data engineering and big data processing.

More Info

Job Type:

Industry:

Function:

Employment Type:

About Company

netlink computer inc

Job ID: 153566829

Jobs by Skill - IT

Jobs by Skill - Non IT

International Jobs

Last Updated: 01-09-2026 04:23:12 AM

Homejobs in PuneData Engineer

Similar Jobs

Senior Data Engineer

Barclays

5-7 yrs

Pune, India

Skills:

snowflake , S3, Redshift, Jenkins, Lambda, Spark Streaming, Apache Kafka, Gitlab, Data Governance, Python, AWS, Alation, Glue, Data Quality Mesh

Azure Data Engineering-Data Engineer III

Deloitte

6-10 yrs

Pune, India

Skills:

.NET, data warehouses , Spark SQL, Power Bi, Azure Log Analytics, Powershell Scripting, Hive, Azure Data Factory, Data lakes, Microsoft Azure Data platform, Azure SQL Data Warehouse, Azure Storage Services, Azure Application Insights, Data Bricks, Stream Analytics, data marts, Event Hubs, Azure SQL DB, Azure Analysis Services

Data Engineer

unfilterstory

4-8 yrs

Pune, India

Skills:

Java, Unix, Apache Flink, Data Modeling, Schema Design, Pyspark, Data Cleansing, Apache Spark, Data Warehouse Concepts, Shell Scripting, Sql, ELT, Apache Airflow, Linux, Apache Kafka, Restful Apis, Python, Etl, Data Transformation, Data Quality Validation

Azure Data Engineer

Persistent Systems

6-10 yrs

Pune, India

Skills:

snowflake , Kafka, ELT, Devops, Spark, Incident Management, Databricks, Restful Apis, Azure, Etl, AWS, Airflow, Monitoring

Lab and Center Data Engineer (AWS+ On Prem)

sonicwall sled

4-6 yrs

Pune, India

Skills:

proxmox , Servicenow, Kvm, Windows Server, Prometheus, Grafana, Datadog, Terraform, Vcenter, Python, AWS, Esxi, Vmware Vsphere, PowerShell, Bash, Jira, Ubuntu, Git, Nsx, Ansible, Rhel, Powercli, Vsan, networking fundamentals