Search by job, company or skills

Cognizant Consulting

Kafka, Spark, Bigdata

Save
new job description bg glownew job description bg glownew job description bg svg
  • Posted a day ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Skill: Kafka, Spark, Bigdata

Experience: 7 to 13 years

Location: Bangalore

Job Description

  • Design and implement complex data solutions using Big Data, Spark, and Kafka Streaming technologies.
  • Lead and guide a team of data engineers in delivering high-quality and innovative solutions.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Develop and maintain data pipelines and workflows to ensure efficient and accurate data processing.
  • Identify and troubleshoot data quality and performance issues.
  • Stay up-to-date with industry trends and best practices in data engineering to drive innovation.
  • Manage and prioritize multiple projects and tasks to meet tight deadlines.
  • Communicate effectively with stakeholders at all levels to provide updates and recommendations.
  • Implement and maintain data security and governance measures to ensure compliance with regulations.
  • Mentor and train junior data engineers to enhance their skills and knowledge.
  • Continuously evaluate and improve existing data processes and systems to optimize efficiency.
  • Assist in the evaluation and implementation of new data technologies and tools.
  • Participate in regular team meetings and provide input in decision-making processes.
  • Take ownership of data engineering projects and drive them to successful completion.
  • Be a proactive problem-solver and provide innovative solutions to complex data challenges.

Job Qualifications

  • Extensive Knowledge Of Big Data Technologies: A Lead Data Engineer At Visa Should Have A Strong Understanding Of Big Data Technologies Such As Hadoop, Spark, And Kafka. They Should Be Proficient In Designing And Developing Data Pipelines And Data Warehousing Solutions Using These Technologies.
  • Experience With Real-Time Data Processing: As A Lead Data Engineer, The Candidate Should Have Experience With Real-Time Data Processing Using Technologies Like Kafka Streaming. They Should Be Able To Design And Implement Scalable And Fault-Tolerant Streaming Data Pipelines.
  • Expertise In Data Modeling And Database Design: A Strong Foundation In Data Modeling And Database Design Is Essential For A Lead Data Engineer At Visa. They Should Be Able To Design Efficient And Optimized Data Models For Large-Scale Data Processing And Analytics.
  • Team Management Skills: Being A Lead Data Engineer, The Candidate Should Have Excellent Team Management Skills. They Should Be Able To Lead And Mentor A Team Of Data Engineers, Providing Technical Guidance And Ensuring The Successful Delivery Of Projects.
  • Business Acumen: A Successful Lead Data Engineer At Visa Should Possess Strong Business Acumen And Be Able To Understand The Business Needs And Requirements. They Should Be Able To Translate Those Requirements Into Technical Solutions And Make Data-Driven Decisions.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 147253979

Similar Jobs

Hyderabad, India

Skills:

graph databases JavaApache SparkGitJUnitGcpDockerElasticsearchAgileRdbms ConceptsSeleniumAzureKubernetesPythonAWSDistributed storage systemsData LakehouseCI CD pipelines

Remote

Skills:

data engineering Apache SparkDistributed ComputingBig Data ProcessingCloud PlatformsScalable Code Development

Early Applicant
Hyderabad, India

Skills:

JavaSoftware Development Life CycleSpringbootContinuous DeliveryAgile MethodologiesKafkaAutomationAWSCloud NativeFlinkEKS

Hyderabad

Skills:

Software Development Life CycleAWSAutomationJavaContinuous DeliverySpringbootAgile MethodologiesKafkaEKSFlink

Hyderabad, India

Skills:

Confluent Kafkareal-time data pipelinesKafka ecosystemsevent streaming solutionsstreaming best practicesevent-driven architecturesKafka integration solutions