About LetitbexAI
LetitbexAI is a fast-growing AI-driven technology company focused on building intelligent, scalable, and enterprise-grade solutions. We work at the intersection of AI, data engineering, cloud, and business transformation, helping organizations unlock real value from artificial intelligence.
Position: ETL Developer
Experience: 7+ Years
Notice Period: Can be considered up to 15-30 Days
Job Description: Looking for an ETL Developer with expertise in DataStage, Azure Data Factory (ADF), and Microsoft SQL Server for managing and integrating data within an organization. These roles involve designing, developing, and maintaining data pipelines to extract, transform, and load data from various sources into target systems for analysis and reporting.
Key Responsibilities
- Data Extraction: Extracting data from various sources and ensuring consistency and completeness.
- Data Transformation: Cleaning, validating, and applying business rules to transform data into a usable format.
- Data Loading: Loading transformed data into target systems and designing data models and workflows.
- ETL Process Management: Designing, developing, implementing, and maintaining ETL processes and infrastructure.
- Performance Optimization: Tuning ETL processes, monitoring jobs, and troubleshooting issues.
- Data Quality and Governance: Ensuring data quality, integrity, and compliance with regulations.
- Collaboration and Documentation: Working with stakeholders and documenting ETL workflows.
- Tool-Specific Responsibilities: Utilizing DataStage for complex ETL processes, using ADF for scalable cloud-based integration, and developing data warehouse solutions with SQL Server.
- Develop DataStage Sequencers and Parallel jobs using different stages like Aggregator, Join, Merge, Lookup, Source dataset, External Filter, Row generator, Column Generator, Change Capture, Copy, Funnel, Short, Peek stages
- Work with the end user to get data requirements, performing complex data mapping and developing/maintaining ETL programs to support FCB's enterprise data warehouse
- Provide timely resolution for integration-related production issues, including root cause analysis and follow the Change management procedures and policies.
- Resource needs to be a data pipeline expert, ensuring that data is extracted, transformed, and loaded efficiently and accurately into the appropriate systems to support business intelligence and analytics efforts.
- The role is vital for enabling data-driven decision-making by ensuring efficient data flow and availability.
Required Skills
- Minimum 7 years of development experience in Datastage (Version V8.5 or higher) with experience in processing high volume jobs
- 7+ years experience in Advanced Infosphere DataStage Design and ADF Development.
- 3+ years in DB2 UDB Administration and Support
- 2+ years Report Solution/Design experiences.
- Experience DataStage 11.3 and 8.7 is a must
- Strong experience with UNIX and shell scripting
- Mastery level on Datastage 8.7 server and parallel versions
- Write ETL Technical Specifications
- 3+yrsAzure Data Factory (ADF)/ Microsoft SQL Server Jobs:
- Using ADF connectors to connect to various data sources and destinations.
- Implementing data flows within ADF for complex transformations.
- Scheduling and monitoring ADF pipelines.
- Creating and managing pipelines in ADF to orchestrate data movement and transformation
- Creating and managing SQL Server Agent jobs for automated tasks, including ETL processes.
- Writing and optimizing SQL queries for data extraction and transformation.
- Using SSIS packages for complex ETL operations within SQL Server.
- Troubleshooting and resolving issues related to SQL Server jobs and SSIS packages.
Education
Education: Bachelor's degree in computer and information technology or a related field, such as engineering.
