Big Data Tester(SJ-IQ)

3-5 Years

Save

Early Applicant

Job Description

Key Responsibilities

Design and execute test cases and test scenarios for data pipelines, ETL workflows, and database systems
Perform end-to-end data validation between source, staging, and target systems
Test and validate big data platforms such as Hadoop, Spark, Hive
Write complex SQL queries to validate data accuracy, completeness, and consistency
Validate ETL transformations, data ingestion, and business rules implementation
Conduct database testing including stored procedures, triggers, functions, and views
Perform data reconciliation and root cause analysis for discrepancies
Develop and maintain automation scripts for data validation and regression testing
Participate in test planning, defect tracking, and reporting
Ensure adherence to data quality, governance, and security standards

Required Skills

3-5 years of experience in data testing, ETL testing, or database testing
Strong hands-on expertise in SQL (joins, subqueries, window functions, query optimization)
Experience with big data technologies: Hadoop, Spark, Hive (working knowledge expected)
Solid understanding of ETL processes, data warehousing, and data validation techniques
Experience with RDBMS such as Oracle
Proficiency in at least one programming/scripting language (Python preferred)
Familiarity with test automation frameworks/tools for data validation
Experience working in Agile/Scrum environments and defect management tools (e.g., JIRA)