Search by job, company or skills

Data Engineer(DevOps)

Data Engineer(DevOps)

Kezan Consulting
4-9 Years
Not Disclosed

This job is no longer accepting applications

Job Description

Key Responsibilities

• Ensure platform uptime and application health as per SLOs/KPIs

• Monitor infrastructure and applications using ELK, Prometheus, Zabbix, etc.

• Debug and resolve complex production issues, performing root cause analysis

• Automate routine tasks and implement self-healing systems

• Design and maintain dashboards, alerts, and operational playbooks

• Participate in incident management, problem resolution, and RCA documentation

• Own and update SOPs for repeatable processes

• Collaborate with L3 and Product teams for deeper issue resolution

• Support and guide L1 operations team

• Conduct periodic system maintenance and performance tuning

• Respond to user data requests and ensure timely resolution

• Address and mitigate security vulnerabilities and compliance issues Technical Skillset

• Hands-on with Spark, Hive, Cloudera Hadoop, Kafka, Ranger

• Strong Linux fundamentals and scripting (Python, Shell)

• Experience with Apache NiFi, Airflow, Yarn, and Zookeeper

• Proficient in monitoring and observability tools: ELK Stack, Prometheus, Loki

• Working knowledge of Kubernetes, Docker, Jenkins CI/CD pipelines

• Strong SQL skills (Oracle/Exadata preferred)

• Familiarity with DataHub, DataMesh, and security best practices is a plus

• Strong problem-solving and debugging mindset

• Ability to work under pressure in a fast-paced environment.

• Excellent communication and collaboration skills.

• Ownership, customer orientation, and a bias for actionKey Responsibilities

• Ensure platform uptime and application health as per SLOs/KPIs

• Monitor infrastructure and applications using ELK, Prometheus, Zabbix, etc.

• Debug and resolve complex production issues, performing root cause analysis

• Automate routine tasks and implement self-healing systems

• Design and maintain dashboards, alerts, and operational playbooks

• Participate in incident management, problem resolution, and RCA documentation

• Own and update SOPs for repeatable processes

• Collaborate with L3 and Product teams for deeper issue resolution

• Support and guide L1 operations team

• Conduct periodic system maintenance and performance tuning

• Respond to user data requests and ensure timely resolution

• Address and mitigate security vulnerabilities and compliance issues Technical Skillset

• Hands-on with Spark, Hive, Cloudera Hadoop, Kafka, Ranger

• Strong Linux fundamentals and scripting (Python, Shell)

• Experience with Apache NiFi, Airflow, Yarn, and Zookeeper

• Proficient in monitoring and observability tools: ELK Stack, Prometheus, Loki

• Working knowledge of Kubernetes, Docker, Jenkins CI/CD pipelines

• Strong SQL skills (Oracle/Exadata preferred)

Key Skills

About Company

Similar Jobs

8-10 yrs
Bengaluru, India
Skills:
MLops, Python, Data DevOps
7-9 yrs
Bengaluru, India
Skills:
bigtable , Solr, Cassandra, Prometheus, Bash, HBase, Cloud Infrastructure, Datadog, Redis, Devops, Gcp, Terraform, Elasticsearch, Kubernetes, Python, AWS, SRE, Go, AI LLM tools, OpenSearch, OpenTofu, Search Data Platforms
4-7 yrs
Bengaluru, India
Skills:
AWS Glue, Jfrog Artifactory, Bash, Sql, Apache Airflow, Jenkins, Lambda, Azure Data Factory, Gcp, Docker, Terraform, Databricks, Azure, Python, AWS, Step Functions, GitHub Actions