Search by job, company or skills

10-18 Years
Not Disclosed

This job is no longer accepting applications

Job Description

Job Description

Data Engineer Lead to design, build, and manage scalable data infrastructure and pipelines for enterprise-grade data platforms across cloud and big data ecosystems.

The Ideal Candidate Will Lead a Team Of Data Engineers And Drive End-to-end Data Architecture, Ensuring High-performance, Secure, And Reliable Data Solutions That Support Analytics, AI/ML, And Business Intelligence

  • Lead design and development of scalable data pipelines and data engineering solutions.
  • Architect and implement end-to-end data platforms (batch and real-time processing).
  • Build and optimize ETL/ELT workflows using modern data engineering tools.
  • Design cloud-native data solutions on AWS / Azure / GCP.
  • Implement data governance, data quality, and data security standards.
  • Collaborate with Data Scientists, Analysts, and Business stakeholders.
  • Manage streaming data pipelines using Kafka / real-time ingestion tools.
  • Monitor, troubleshoot, and optimize data systems for performance and scalability.
  • Lead and mentor a team of data engineers.

Exp (Years)

  • 10 to 18 Years

Required Skills

  • Strong experience in Python, SQL, and distributed data systems.
  • Expertise in Apache Spark, Hadoop, Kafka, Airflow, Databricks.
  • Knowledge of DevOps tools (Docker, Kubernetes, CI/CD).
  • Familiarity with BI tools (Power BI / Tableau).

Education

  • B.E / B.Tech / M.Tech / MCA / M.Sc (Computer Science / IT / Data Science / Statistics)

(ref:hirist.tech)

More Info

Job Type:
Industry:
Employment Type:

Similar Jobs

7-15 yrs
Chennai
Skills:
Cloud Computing, Data Modeling, Data Pipeline, Apache Spark, Big Data, Data Warehousing, Python Programming, ETL Processes, Kafka Streaming, SQL Databases
6-10 yrs
Chennai, India
Skills:
model development , Tensorflow, Pytorch, Sql, Python, Machine Learning Algorithms, Time Series, Clustering, Predictive Analytics, R, scikit-learn, Statistical analyses, Statistical methods, Regression, Model training, Classification, Ensemble learning, Optimizations
6-10 yrs
Chennai, India
Skills:
snowflake , Data Architecture, Data Modeling, Linux Scripting, Adobe Analytics, Sql, Devops, Data Quality, Powerbi, Azure Data Lake, Databricks, Python, DBT framework, Azure Data Engineering
6-12 yrs
Chennai, India
Skills:
PostgreSQL, Kafka, Tableau, Apache Airflow, Tensorflow, Pytorch, Docker, MySQL, Azure Data Lake, Cosmos DB, Python, Azure DevOps, Java, Power Bi, Scala, SQL Server, Sql, Azure Data Factory, Databricks, MongoDB, Azure, Kubernetes, GitHub Actions, Event Hubs, Service Bus, dbt, Apache Superset
10-15 yrs
Chennai, India
Skills:
snowflake , MongoDB, Elk, PostgreSQL, Prometheus, Dynamodb, Kafka, Grafana, Sql, Docker, MySQL, Oracle, Python, Kubernetes, Airflow, Infrastructure as Code, GitOps, Jaeger, Prefect, Dagster