Search by job, company or skills

Data Engineer

4-8 Years
  • Posted 9 hours ago
  • Be among the first 10 applicants

Job Description

Job Title: Data Engineer

Job Type: Full Time

Location: Pune, India

Experience: 4–8 Years

Job Summary

We are looking for an experienced Data Engineer with strong expertise in big data technologies, data pipelines, distributed processing, and data modeling.

The ideal candidate should have a minimum of 4 years of hands-on experience with core technologies and possess excellent communication skills.

Must-Have Skills

Category Skills / Experience Programming Languages Python (PySpark), SQL, Java Big Data Frameworks Apache Spark Workflow Orchestration Apache Airflow Streaming & Messaging Apache Kafka Operating System Strong familiarity with Linux/Unix environments and shell scripting Data Engineering Experience in data ingestion, ETL/ELT pipeline development, data transformation, data cleansing, and data quality validation Data Modelling Experience in logical and physical data modeling, schema design, and data warehouse concepts

Good-to-Have Skills

Category Skills / Experience API Integration Experience developing or consuming RESTful APIs Stream Processing Experience with Apache Flink or other real-time stream processing frameworks

Key Requirements

  • Minimum 4 years of relevant experience in Data Engineering.
  • Strong hands-on experience with Python (PySpark), SQL, and Java.
  • Strong knowledge of Apache Spark, Apache Airflow, and Apache Kafka.
  • Good understanding of Linux/Unix environments and shell scripting.
  • Experience building and managing data ingestion and ETL/ELT pipelines.
  • Strong understanding of data transformation, cleansing, and data quality validation.
  • Experience with logical and physical data modeling.
  • Understanding of schema design and data warehouse concepts.
  • Excellent communication and stakeholder-management skills.
  • Experience with REST APIs and Apache Flink/real-time stream processing will be an advantage.

Benefits & Perks

[Add information regarding benefits and perks here]

Skills: apache spark,apache,pyspark,java,apache kafka,sql,airflow

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 153518719

Similar Jobs

Pune, India

Skills:

Document Databases Working knowledge of MongoDBETL Tools Proficiency in Ab Initio GDE EME Co Operating SystemUnix Linux ScriptingSQL PL SQL QueryingTesting QA Exposure to SIT E2E and OAT testing cyclesMessaging Systems Experience with IBM MQ Apache KafkaAgile Delivery Experience with JIRAScheduling Tools Familiarity with Tivoli Workload Scheduler TWSSecurity Compliance Awareness of access control vulnerability assessments

Pune, India

Skills:

GitPower BiSQL ServerDaxDashboard creationMicrosoft Azure Data Factory

Pune, India

Skills:

.NETdata warehouses Spark SQLPower BiAzure Log AnalyticsPowershell ScriptingHiveAzure Data FactoryData lakesMicrosoft Azure Data platformAzure SQL Data WarehouseAzure Storage ServicesAzure Application InsightsData BricksStream Analyticsdata martsEvent HubsAzure SQL DBAzure Analysis Services

Pune, India

Skills:

GitPower BiSQL ServerDaxDashboard creationMicrosoft Azure Data Factory

Pune, India

Skills:

proxmox ServicenowKvmWindows ServerPrometheusGrafanaDatadogTerraformVcenterPythonAWSEsxiVmware VspherePowerShellBashJiraUbuntuGitNsxAnsibleRhelPowercliVsannetworking fundamentals

Beware of Scammers

We don’t charge money for job offers