Work closely with Data Analyst, Architects to achieve DQ objectives
Validating data pipelines and ensuring the quality of datasets
Collaborate with the Data Delivery technology teams and architects to define and develop solutions
Gather business requirements for the building of the Data Quality Dashboard that will include the full set of functionalities from exception identification to remediation
Formulate and actively develop test cases, test scripts, and output report specifications for data remediation projects
Maintain up-to-date documentation for the Data quality audits and processes
Manage and provide data quality control and perform deep-dive analysis of data, identifies problems, root cause, and solution
Able to integrate data QA automation using DQ tools
Should be able to research new tools and technologies for project.
Come up with innovations which team can get benefit from
Mentor QA team and Provide solutions to team issues
Troubleshooting skills to optimize performance.
Leads a team of 8 data QA and own and prioritizes work allocation based on business need
Provides regular coaching and feedback to direct reports
Responsibilities
7+ Years of Experience in Data Test Automation, Data Comparison and Validation.
Must have experience in ETL/ELT tools and pipeline
Working experience with Python libraries such as Pandas, NumPy, and SQL Alchemy for ETL
Strong understanding of Data Warehouse/Data Lake Architecture and Development
Experience with relational SQL and NoSQL databases
Good knowledge of SQL, DB Procedures, Packages, and Functions.
Experience with data pipeline and workflow management tools
Experience working with relational databases
Experience with AWS cloud services: EC2, EMR, RDS, Redshift
Experience in SQL injection, and query performance (Athena).
Must have CI/Cd knowledge
Knowledge of bit bucket/git
Excellent interpersonal and communication skills
Qualifications
Additional Skills
Be tool agnostic and recommend new processes and techniques to improve the capability of testing for our clients.
Good analytical, Problem-solving skills and communication skills.
Leadership/mentorship experience
Demonstrate motivation, ownership, compassion, and leadership capabilities within the Team
Able to communicate feedback articulately
Has analytical way of thinking
NICE TO HAVE
Understanding of data observability tools like Great expectation, Light Up etc.
Understanding of Cloud Technologies in AWS or Azure
Experience in advanced Excel
Experience in data integration tools like Power BI, Datadog, Altan etc.
Have team management experience
Knowledge of Atlassian products like Jira & Confluence
