Data Engineer
Search Jobs
Search by job, company or skills
Search by job, company or skills
Senior Python Data Engineer (6-10 Yrs) | PySpark, Databricks, ADF | Hybrid Model
Note :- Below 5 Years of candidate should not apply for the same not even 4.5/4.11
About the Role :-
Join a fast-paced, innovation-driven IT solutions provider to design and build our next-generation, enterprise-level data systems. We are seeking an expert Senior Python Data Engineer to take ownership of end-to-end data solutions, utilizing the modern Azure Data Stack. You'll have the freedom to build from the ground up, influence architecture, and drive clean engineering principles.
Experience: 6 - 10 Years (Preferably 8+ years of hands-on experience)
Location:Indore / Pune
Work Mode: Onsite during initial training period, transitioning to Hybrid post-training.
What You Will Do:
Design, develop, and maintain highly scalable data pipelines and applications using Python and PySpark.
Build end-to-end data solutions from scratch, ensuring clean, modular, and reusable code.
Utilize Databricks and Azure Data Factory (ADF) for robust data workflow orchestration, automation, and monitoring.
Write and optimize complex SQL queries for processing, transformation, and validation of large-scale datasets.
Develop dynamic, reusable frameworks and implement design patterns for system scalability and performance.
Collaborate with cross-functional teams to translate complex business requirements into high-quality technical solutions.
Drive best practices in code reviews, performance tuning, and deployment automation.
What We're Looking For (Must-Have Skills):
Core Experience: 6-10+ years in software or data engineering, with a strong focus on building data platforms.
Programming: Advance level proficiency in Python coding and scripting, and expert-level hands-on experience with PySpark.
Data Stack:Mandatory expertise in Databricks and Azure Data Factory (ADF).
Database: Strong command over SQL for working with large, complex datasets.
Architecture: Solid understanding of data structures, design patterns, and scalable architectures.
Cloud: Exposure to cloud platforms such as Azure, AWS, or GCP.
A problem-solver mindset with the ability to think innovatively and deliver end-to-end solutions.
Apply Now!
Interested candidates, please share your resume directly to
Email: [Confidential Information]
Linkdin :- https://www.linkedin.com/in/aman-sariyam-a91b70222/
Job ID: 131858923
Skills:
Document Databases Working knowledge of MongoDB, ETL Tools Proficiency in Ab Initio GDE EME Co Operating System, Unix Linux Scripting, SQL PL SQL Querying, Testing QA Exposure to SIT E2E and OAT testing cycles, Messaging Systems Experience with IBM MQ Apache Kafka, Agile Delivery Experience with JIRA, Scheduling Tools Familiarity with Tivoli Workload Scheduler TWS, Security Compliance Awareness of access control vulnerability assessments
Skills:
.NET, data warehouses , Spark SQL, Power Bi, Azure Log Analytics, Powershell Scripting, Hive, Azure Data Factory, Data lakes, Microsoft Azure Data platform, Azure SQL Data Warehouse, Azure Storage Services, Azure Application Insights, Data Bricks, Stream Analytics, data marts, Event Hubs, Azure SQL DB, Azure Analysis Services
Skills:
S3, RDS, Pyspark, Databricks, Emr, Redshift, Python, Sql, AWS, Etl
Skills:
Java, Unix, Apache Flink, Data Modeling, Schema Design, Pyspark, Data Cleansing, Apache Spark, Data Warehouse Concepts, Shell Scripting, Sql, ELT, Apache Airflow, Linux, Apache Kafka, Restful Apis, Python, Etl, Data Transformation, Data Quality Validation
Skills:
snowflake , Kafka, ELT, Devops, Spark, Incident Management, Databricks, Restful Apis, Azure, Etl, AWS, Airflow, Monitoring
