Job Summary
The Sr Product Specialist(ISG) will play a crucial role in driving product innovation and excellence within the organization. With a focus on leveraging technical expertise in PySpark Azure Data Lake and Study Data Tabulation Model the candidate will contribute to the development and enhancement of data-driven solutions. This hybrid role requires a proactive approach to problem-solving and collaboration with cross-functional teams to achieve strategic objectives.
Responsibilities
- Experienced in working with PySpark Data Frames Data Bricks and Azure Data Lake
- Experienced in creating reusable parameterized libraries resp. re-usable code in Python for repetitive data transformations
- Experience in writing and executing various types of DDL and DML SQL statements
- Good Analytical and troubleshooting skills to resolve issues
- Experienced in working with Git ADO and deployment pipelines
- Good experience in Azure Data Factory for data transformation building and executing pipelines
- Experienced in testing data transformations and pipelines
- Good understanding of ETL Source to Target Mappings and Data warehousing concepts
- Knowledgeable of data modeling principles and experience in designing efficient data models in Delta Lake including partitioning parallelization
- Optionally understanding of data collected during ongoing clinical studies in pharmaceutical industry
- Optionally understanding of SDTM as data model for clinical data
- Experience in the life sciences/ pharma industry will be an added advantage
- Good Communication skills
- Update work items promptly and accurately in Azure Dev Ops
- Attend scrum calls on time and provide proper updates on work items
- Ability to work independently with Project Managers and Data Scientists for assigned tasks
- Raise issues and showstoppers in team meetings and follow up/get it addressed
- Work closely with other Azure Data Engineers and other team members for resolution of common issues
- Provide regular status updates to leads and help in resolving issues
