Job Description
- Design develop and optimize largescale data processing pipelines using Apache Spark
- Build and maintain ETLELT workflows using AWS Glue Amazon S3 and Amazon Athena
- Orchestrate endtoend data pipelines and processing workflows using AWS Step Functions
- Develop ingestion frameworks to handle multivendor data schemas including Ericsson and Oracle datasets
- Standardize transform map and integrate heterogeneous vendor data into common data models
- Implement data validation reconciliation error handling and dataquality controls across ingestion pipelines
- Optimize Spark jobs Glue workloads storage structures queries and underlying datastore performance
- Monitor pipeline execution troubleshoot failures perform rootcause analysis RCA and improve processing reliability
- Support schema evolution metadata management partitioning and performance optimization for large datasets
- Collaborate with architecture platform analytics and downstream application teams to ensure scalable and reliable data delivery
Mandatory Skills : AWS Glue
More Info
About Company
LTM is a global technology consulting and digital solutions LTM company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTM brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by more than 90,000 talented and entrepreneurial professionals across 30 countries, LTM — a Larsen & Toubro Group company — combines the industry-acclaimed strengths of erstwhile L&T Infotech and Mindtree in solving the most complex business challenges and delivering transformation at scale. For more, please visit https://ltm.com.