Job Description
Job Description
Design, develop, and maintain scalable data pipelines and systems.
Work closely with data scientists and analysts to ensure data quality and availability
Implement data integration and transformation processes using PySpark and Python.
Optimize and maintain SQL databases and queries.
Collaborate with cross-functional teams to understand data requirements and deliver solutions.
Monitor and troubleshoot data pipeline issues to ensure data integrity and performance.