I
Data Engineer
I
- Posted 6 hours ago
- Be among the first 10 applicants
Job Description
Job Title: Data Engineer
Location: Hyderabad
Experience Required: 5+ Years (Minimum 3+ Years Relevant in PySpark, Azure Data Factory, and Python)
Company:- WalikingTree Technologies
Interview Rounds
1⃣ Assessment Test – 1 hour 30 minutes
2⃣ Technical Panel Interview (Face-to-Face – Hyderabad)
About The Role
We are looking for an experienced and passionate Data Engineer to join our growing analytics and data team. The ideal candidate will have hands-on experience in PySpark, Azure Data Factory (ADF), and Python, with a strong background in designing and maintaining scalable data solutions on Azure.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory.
Collaborate with business stakeholders, data analysts, and data scientists to understand requirements and deliver reliable solutions.
Optimize ETL workflows for performance, scalability, and reliability.
Implement best practices for data ingestion, transformation, and integration across multiple sources.
Ensure data quality, governance, and security across all stages of the data lifecycle.
Troubleshoot and resolve data pipeline, storage, and performance issues.
Required Skills & Qualifications
5+ years of total experience with 3+ years of relevant experience in PySpark, Azure Data Factory, and Python.
Proven experience in building large-scale data pipelines and ETL workflows.
Strong expertise in PySpark for data processing and transformation.
Proficiency in Azure Data Factory (ADF) for orchestrating workflows.
Advanced Python programming skills for data handling and automation.
Strong command over SQL and experience with both relational and non-relational databases.
Good understanding of data warehousing concepts and performance optimization techniques.
Exposure to Azure ecosystem (Data Lake, Databricks, Synapse Analytics, etc.) is a plus.
Excellent problem-solving, analytical, and communication skills.
Nice to Have
Experience with CI/CD pipelines for data solutions.
Knowledge of data governance, security, and compliance frameworks.
Familiarity with real-time data streaming tools (Kafka, Event Hubs, etc.).
Location: Hyderabad
Experience Required: 5+ Years (Minimum 3+ Years Relevant in PySpark, Azure Data Factory, and Python)
Company:- WalikingTree Technologies
Interview Rounds
1⃣ Assessment Test – 1 hour 30 minutes
2⃣ Technical Panel Interview (Face-to-Face – Hyderabad)
About The Role
We are looking for an experienced and passionate Data Engineer to join our growing analytics and data team. The ideal candidate will have hands-on experience in PySpark, Azure Data Factory (ADF), and Python, with a strong background in designing and maintaining scalable data solutions on Azure.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory.
Collaborate with business stakeholders, data analysts, and data scientists to understand requirements and deliver reliable solutions.
Optimize ETL workflows for performance, scalability, and reliability.
Implement best practices for data ingestion, transformation, and integration across multiple sources.
Ensure data quality, governance, and security across all stages of the data lifecycle.
Troubleshoot and resolve data pipeline, storage, and performance issues.
Required Skills & Qualifications
5+ years of total experience with 3+ years of relevant experience in PySpark, Azure Data Factory, and Python.
Proven experience in building large-scale data pipelines and ETL workflows.
Strong expertise in PySpark for data processing and transformation.
Proficiency in Azure Data Factory (ADF) for orchestrating workflows.
Advanced Python programming skills for data handling and automation.
Strong command over SQL and experience with both relational and non-relational databases.
Good understanding of data warehousing concepts and performance optimization techniques.
Exposure to Azure ecosystem (Data Lake, Databricks, Synapse Analytics, etc.) is a plus.
Excellent problem-solving, analytical, and communication skills.
Nice to Have
Experience with CI/CD pipelines for data solutions.
Knowledge of data governance, security, and compliance frameworks.
Familiarity with real-time data streaming tools (Kafka, Event Hubs, etc.).
More Info
Key Skills
CI CD pipelines
Real-time data streaming tools
ETL workflows
About Company
Skills:
data masking , Dimensional Modeling, Database Design, ELT, Nosql, Workflow, Pl-sql, Python, Java, Apis, Sql, Jenkins, Gcp, DataFlow, Etl, Big Data Streaming, Cloud Build, Denormalization, Pub Sub, Cloud Run, GitHub Actions, Data Integration Flows, Normalization, Data Warehousing Modelling, Key-Value Databases, Cloud Scheduler, GCS
Skills:
Scala, Database Design, Data Warehousing, Data Modeling, Azure, Python, AWS, Databricks Unified Data Analytics Platform
Skills:
Kinesis, Spark, AWS Glue, Data Modeling, Python, Sql, IAM roles and permissions, FireHose, ETL pipelines, Event-driven architectures
Skills:
Java, Scala, Restful Apis, Kubernetes, Python, Sql, OLAP and OLTP systems, big data engineering
Skills:
Java, BigQuery, Hadoop, Data Modeling, Kafka, ELT, Microservices, Data Quality, Hive, MLops, Spark, Databricks, Data Governance, Python, Kubernetes, Etl, Airflow, HDFS, Delta Lake, CI/CD