Job Description
Job Title: Data Engineer
Location: Hyderabad
Experience Required: 5+ Years (Minimum 3+ Years Relevant in PySpark, Azure Data Factory, and Python)
Company:- WalikingTree Technologies
Interview Rounds
1 Assessment Test 1 hour 30 minutes
2 Technical Panel Interview (Face-to-Face Hyderabad)
About The Role
We are looking for an experienced and passionate Data Engineer to join our growing analytics and data team. The ideal candidate will have hands-on experience in PySpark, Azure Data Factory (ADF), and Python, with a strong background in designing and maintaining scalable data solutions on Azure.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory.
Collaborate with business stakeholders, data analysts, and data scientists to understand requirements and deliver reliable solutions.
Optimize ETL workflows for performance, scalability, and reliability.
Implement best practices for data ingestion, transformation, and integration across multiple sources.
Ensure data quality, governance, and security across all stages of the data lifecycle.
Troubleshoot and resolve data pipeline, storage, and performance issues.
Required Skills & Qualifications
5+ years of total experience with 3+ years of relevant experience in PySpark, Azure Data Factory, and Python.
Proven experience in building large-scale data pipelines and ETL workflows.
Strong expertise in PySpark for data processing and transformation.
Proficiency in Azure Data Factory (ADF) for orchestrating workflows.
Advanced Python programming skills for data handling and automation.
Strong command over SQL and experience with both relational and non-relational databases.
Good understanding of data warehousing concepts and performance optimization techniques.
Exposure to Azure ecosystem (Data Lake, Databricks, Synapse Analytics, etc.) is a plus.
Excellent problem-solving, analytical, and communication skills.
Nice to Have
Experience with CI/CD pipelines for data solutions.
Knowledge of data governance, security, and compliance frameworks.
Familiarity with real-time data streaming tools (Kafka, Event Hubs, etc.).
