- Implementing ETL processes.
- Creating comprehensive test suites using Python.
- Validating data quality through advanced SQL queries.
- Collaborating with Data Scientists, Engineers, and Software teams.
- Developing and monitoring data tools, frameworks, and infrastructure changes.
- Focusing on continuous automation and integration of data from multiple sources.
Required Technical Skills
- Proficiency in Hive QL, Spark QL, and Big Data concepts.
- Experience in data testing tools like DBT, iCEDQ, and QuerySurge.
- Expertise in Linux/Unix.
- Familiarity with messaging systems such as Kafka or RabbitMQ.
- Strong analytical and debugging skills.
