Search by job, company or skills

S

Data Engineer

4-9 Years
new job description bg glownew job description bg glownew job description bg svg
  • Posted 19 hours ago
  • Over 50 applicants
Quick Apply

Job Description

We are seeking a Data Engineer to design and implement scalable data pipelines for feature extraction, transformation, and loading (ETL). You will be responsible for governing and optimizing these pipelines to ensure high reliability and data quality across both on-premise and cloud environments. This role requires strong proficiency in Pyspark and Scala, experience with big data technologies, and proven leadership skills to guide a team of data engineers.

Roles & Responsibilities:

  • Data Pipeline Design & Implementation: Design and implement scalable data pipelines for feature extraction, transformation, and loading (ETL) using technologies such as Pyspark, Scala, and relevant big data frameworks.
  • Data Governance & Optimization: Govern and optimize data pipelines to ensure high reliability, efficiency, and data quality across on-premise and cloud environments.
  • Cross-functional Collaboration: Collaborate closely with data scientists, ML engineers, and business stakeholders to understand data requirements and translate them into robust technical solutions.
  • Best Practices & Compliance: Implement best practices for data governance, metadata management, and compliance with regulatory requirements.
  • Team Leadership: Lead a team of data engineers, providing technical guidance, mentorship, and fostering a culture of innovation and collaboration.
  • Continuous Improvement: Stay updated with industry trends and advancements in big data technologies, contributing to the continuous improvement of data engineering practices.

Skills Required:

  • Strong experience in data engineering with hands-on experience in designing and implementing data pipelines.
  • Strong proficiency in programming languages such as Pyspark and Scala, with experience in big data technologies (Cloudera, Hadoop ecosystem).
  • Proven leadership experience in managing and mentoring a team of data engineers.
  • Excellent communication skills with the ability to collaborate effectively across teams and stakeholders.
  • Experience working in a banking or financial services environment is a plus.

QUALIFICATION:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related technical field, or equivalent practical experience.

More Info

Job Type:
Function:
Employment Type:
Open to candidates from:
Indian

About Company

Skillventory is a leading name among top recruitment consultants having clients PAN India. Started in 2008, we feel delighted to state that we helped in shaping the careers of more than 20000 job seekers. We are a full spectrum Manpower Consultancy Firm, fulfilling manpower requirements of businesses by offering the wide range of services from Executive Search, Recruitment, Specialists-on-Contract, HR Automation, Consulting, Outsourcing, and Training. We are easily accessible, reachable and serving clients across India effectively and efficiently, as we are located in 6 major locations of the country, with Workstations in Indore , Mumbai , Ahmedabad ,Bangalore , New Delhi and Pune The other evidence of our best services is that we work as RPO (Recruitment Process Outsourcing) firm, where clients and companies transfer their recruitment worries on us. From beginning to end, i.e., right from sourcing the right candidate, interview, offer, acceptance, till his final joining, we handle recruitment process smoothly on behalf of the company. Skillventory is a preferred recruitment partner for multinational and pioneered Indian companies because of its trustworthiness, commitment, dedication, and capabilities. Our versatile, skilled and talented employees are generating best employment opportunities for professionals ranging from front line to senior positions. Our domain-specialist teams consist of 100+ expert consultants who are capable enough to provide customized and innovative HR consultancy services to more than 10+ industry practices namely Investment Banking & Firm, Consulting, Manufacturing, Banking & Financial Services, Insurance, Retail, Healthcare, Pharma, IT/ITES, E-Commerce and much more. Our strength lies in data analytics hiring, audit related recruitment, housing finance hiring, payment banking recruitment etc. Our work principles are based on the concept of placing Right Person at the Right Job on Time.

Job ID: 123424885

Similar Jobs