Senior Talend Developer / Lead Data Engineer

Job Description

Role Overview

We are seeking a highly skilledSenior Talend Developer / Lead Data Engineerto drive complex data integration initiatives acrossSAP ERP, Talend, Kinaxis RapidResponse, and modern cloud data platforms. The ideal candidate will combine deep handson technical expertise with solution architecture capabilities and team leadership.

This role involves designing and optimizing endtoend data pipelines, modernizing legacy integrations, and enabling scalable, governed, and cloud-native data platforms leveragingAzure Data ServicesandDatabricks. The engineer will play a key role in supporting global supply chain planning systems and enterprise data initiatives.
Key Responsibilities

1. Data Integration & ETL Development (Talend)

• Design and implement robust ETL workflows usingTalend Data Integration (Open Studio).

• Hands-on expertise in designing and implementingtemplate-driven architecturefor reusable pipelines with minimal code changes.

• Integrate data from diverse sources including SAP, databases, APIs, flat files, cloud repositories, MQs, and XML-based systems.

• Apply best practices fordata profiling, cleansing, validation, transformation, mapping, and auditing.

• Build scalable batch and near-real-time data pipelines.

• Implement strongmonitoring, alerting, and loggingfor reliable production operations.

2. Integration Architecture & Delivery

• Architect and develop endtoend integration solutions acrossSAP ERP (S/4HANA and ECC), Talend, Kinaxis RapidResponse, MongoDB, Solace/RabbitMQ, and other enterprise systems.

• Lead migration of legacy file transfers and XML interfaces to modern automated frameworks.

• Define and enforce data mapping standards, enrichment logic, and transformation rules.

• Ensure alignment with business requirements and integration best practices.

• Strong understanding ofversion control and branching strategies using Talend Git.

3. Talend Administration Center (TAC) & Runtime Operations

• Manage deployments, job scheduling, execution logs, and monitoring viaTAC and TMC.

• Configure tasks, triggers, resource utilization, sequencing, and error-recovery workflows.

• Manage environment promotions, versioning, and dependency resolution.

• Deploy jobs onTalend JobServer and ESB Runtimeacross Dev, Test, UAT, and Production environments.

• Optimize memory, parallelism, and runtime configurations for performance.

4. SAP Data Integration

• Develop ETL workflows using SAP integration technologies:IDoc, BAPI, RFC, OData, and structured extract files.

• Understand SAP data models, business logic, and core master/transactional tables such asMARA, EKPO, BKPF, MSEG, etc.

• Work closely with SAP functional and BASIS teams to ensure reliable, validated, and secure data extraction.

5. Cloud Modernization (Azure & Databricks)

• Architect and implement solutions usingAzure Data Factory, Azure Synapse, Azure Data Lake Storage.

• UtilizeDatabricks (PySpark, Delta Lake)for advanced transformations, metadata-driven orchestration, and ML readiness.

• Integrate Talend with Azure CI/CD pipelines usingAzure DevOps or GitHub Actions.

• Promote cloud-native modernization and best practices.

6. Governance, Observability & Security

• ImplementData Quality frameworks, validation layers, and automated data health checks.

• Build endtoenddata lineage, metadata, and traceability frameworks.

• Develop enterprise observability dashboards usingGrafana, Azure Monitor, and related tools.

• Ensure compliance with RBAC, encryption, key vault usage, audit trails, and secure configuration standards.

7. Leadership & Cross-functional Collaboration

• Mentor and guide junior and mid-level data engineers.

• Perform code reviews, enforce development standards, and maintain technical excellence.

• Collaborate with SAP teams, Kinaxis consultants, global business stakeholders, and platform architects.

• Manage change requests, prioritization, issue resolution, and agile delivery workflows.

8. Future-Ready Initiatives

• Evaluate and implement streaming architectures usingKafkaorAzure Event Hub.

• Explore AI-driven data quality, anomaly detection, and pattern recognition usingDatabricks ML.

• Drive cost optimization, scalability improvements, and multi-region deployment strategies.

Qualifications

Educational qualification:

Bachelor's degree inComputer Science,Information Technology,Software Engineering, or a related field.

Core Technical Expertise (Mandatory)

• Advanced experience inTalend DI/ESBjob design, parameterization, error handling, and optimization.

• Minimum8 yearsin ETL and enterprise data integration.

• Minimum8 yearsworking withTalend TAC/TMCadministration.

• Minimum3 yearsintegrating SAP via IDoc, BAPI, RFC, OData.

• Minimum3 yearsdeploying and managing jobs on Talend Runtime.

• Minimum8 yearsstrong SQL experience (Oracle, MySQL, SQL Server, etc.).

Kinaxis & SAP Integration

• Strong expertise withKinaxis RapidResponsedata model and file-based integration.

• Deep experience in XML, XSD, schema evolution, and large-file processing.

Cloud & Big Data Technologies

• Hands-on experience withAzure Data Factory, Azure Synapse, Azure Data Lake Storage.

• Databricks experience usingPySpark, Delta Lake, optimization techniques.

Programming & Scripting

• Proficiency inPython, SQL, and Groovyfor automation and custom ETL logic.

Governance & Security

• Experience with DQ frameworks, metadata/lineage tools, and auditing.

• Strong grasp of secrets management, encryption, and compliance frameworks.

Preferred Skills

• Java development for custom Talend components (2+ years).

• Git experience (3+ years) with branching strategies, PR workflows, and code reviews.

Soft Skills

• Strong analytical and problem-solving abilities.

• Excellent communication and stakeholder engagement.

• Ability to lead teams, drive architecture decisions, and deliver large-scale programs.

• High attention to detail, documentation discipline, and a quality-first mindset.

Additional Information

Over all experience of 8-12 years