SDET Engineer

Key Responsibilities:

• Complex SQL Queries:
• Write and optimize complex SQL queries to validate data pipelines, transformations, and reporting accuracy.
• Perform root cause analysis of data discrepancies and provide insights into data quality issues.
• Develop automated SQL scripts to streamline data validation and reconciliation processes.
• ETL Testing:
• Validate ETL processes by designing comprehensive test strategies to ensure data accuracy and completeness.
• Test and verify ETL pipelines from various data sources (structured and unstructured) into data warehouses, ensuring data conforms to business rules and logic.
• Implement automated ETL testing frameworks and continuously improve them to optimize the data validation process.
• Data Reconciliation:
• Develop, implement, and automate test scripts to validate data integrity between source and target systems.
• Identify and resolve data inconsistencies, mismatches, and errors in large datasets.
• Design and execute reconciliation processes to ensure accurate data migration and transformation.

Nice to have:

• Experience with HiveQL for Hive Database
• Experience with Python as a scripting language