Experience:
- 6+ years in Python data processing and migration
- 2–3+ years hands-on with Azure Synapse Analytics
Key Responsibilities & Skills
Strong hands-on experience in Python 3.x and PySpark for large-scale data processing.Proven experience working on Azure Synapse Spark Pools, notebooks, and pipelines.Ability to analyze and refactor legacy Python code for compatibility with Spark 3.x runtimes.Experience handling Python dependency issues, library upgrades, and runtime incompatibilities.Solid understanding of Spark 3.x behavior changes, performance tuning, and execution optimization.Experience supporting Spark Pool version upgrades (3.4 → 3.5) with minimal production impact.
