Technical Lead

Hiring Alert – Technical Lead (Big Data & Distributed Systems)

at Pinaca Technologies Private Limited

Location: Chennai

Experience: 6+ Years

Employment Type: Full-Time

Apply: [Confidential Information]

We are looking for a Technical Lead with strong expertise in Big Data systems, distributed computing, and on-premise deployments to lead the design and implementation of large-scale, data-intensive platforms.

The ideal candidate will have hands-on experience in data engineering, infrastructure optimization, system scalability, and enterprise-level deployment in on-prem environments. This role involves architecting end-to-end data pipelines, ensuring platform performance, optimizing compute and storage utilization, and leading a technical team that delivers reliable, secure, and high-performing systems.

Key Responsibilities:

• Architect, design, and lead the implementation of Big Data platforms capable of handling large-scale structured and unstructured data.

• Oversee on-prem deployment strategies, including compute resource management, load balancing, and storage optimization.

• Build and maintain data ingestion, transformation, and analytics pipelines using Apache Spark, Kafka, and Airflow.

• Ensure high availability, fault tolerance, and scalability across the data infrastructure.

• Lead system performance benchmarking, tuning, and capacity planning for on-prem clusters.

• Design data lake and data warehouse architectures for analytics and ML use cases.

• Collaborate with DevOps teams for CI/CD pipelines, monitoring, and automated deployment workflows.

• Ensure data security, compliance, and access control policies are enforced in on-prem environments.

• Work closely with Product, Data Science, and Infrastructure teams to align architecture with product goals.

• Lead and mentor a team of engineers to deliver high-quality, efficient, and maintainable codebases.

• Troubleshoot production issues, perform root cause analysis, and implement permanent fixes.

Requirements:

• 8+ years of experience in software or data engineering, with at least 2 years in a Technical Lead or Architect role.

• Bachelor's or Master's degree in Computer Science, Information Systems, or related field.

• Strong expertise in Big Data technologies including Apache Spark, Kafka, and Airflow.

• Proficiency in Python, Go, or Java.

• Hands-on experience with HDFS, PostgreSQL, MySQL, MongoDB, Elasticsearch, and Redis.

• Experience in on-prem cluster management, Kubernetes, Docker, and infrastructure automation tools.

• Strong understanding of ETL pipelines, data warehousing, schema design, and partitioning.

• Experience with monitoring and logging tools such as Prometheus, Grafana, and ELK Stack.

• Knowledge of MLOps, model deployment, and inference optimization is preferred.

• Experience in performance optimization, query tuning, caching, and distributed resource scheduling.

• Strong understanding of security practices including RBAC, encryption, and audit management.

• Proven experience in leading end-to-end product delivery or client project execution.

• Strong project management, stakeholder coordination, leadership, and communication skills.

Interested candidates can share their resumes to: [HIDDEN TEXT]

#Hiring #TechnicalLead #BigData #DataEngineering #ApacheSpark #Kafka #Airflow #DistributedSystems #OnPremise #DataPlatform #MLOps #Kubernetes #Docker #PythonJobs #TechHiring #ChennaiJobs #ITJobs #PinacaTechnologies