Search by job, company or skills

PySpark Senior Data Engineer

PySpark Senior Data Engineer

Valuelabs
7-12 Years
Not Disclosed
Early Applicant
Quick Apply
  • Posted a day ago
  • Be among the first 40 applicants

Job Description

Job description

Role & responsibilities :

  • Experience: More than 8+ years of experience in information technology, with 3+ years spent in data engineering, architecture and technology solutions definitions and implementations.
  • Extensive experience in banking services or related domain Knowledge & Skill: Expertise in Data Architecture, Data Strategy and Roadmap for large and complex organization and systems and implemented large scale end-to-end Data Management & Analytics solutions.
  • Experience in transforming traditional Data Warehousing approaches to Big Data based approaches and proven track record of managing risks and data security.
  • Expertise with DW Dimensional modeling techniques, Star & Snowflake schemas, modeling slowly changing dimensions and role playing dimensions, dimensional hierarchies, and data classification.
  • Experiences in cloud native principals, designs and deployments.
  • Extensive experience working with and enhancing Continuous Integration (CI) and Continuous Development (CD) environments.
  • Expertise in Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival Define workload migration strategies using appropriate tools.
  • Drive delivery in a matrixed environment working with various internal IT partners.
  • Demonstrated ability to work in a fast paced and changing environment with short deadlines, interruptions, and multiple tasks/projects occurring simultaneously.
  • Must be able to work independently and have skills in planning, strategy, estimation, scheduling. Strong problem solving, influencing, communication, and presentation skills, self-starter. Experience with data processing frameworks and platforms (Hadoop, Presto, Tez, Hive, Spark etc.).
  • Hands-on experience in work with bigdata platforms and related programming languages (e.g. Linux, Python, PySpark, GIT, Jenkins). Behavioral Competencies: Business Acumens Organization leadership skills Coaching and mentoring Excellent analytical skills
  • Demonstrate critical and systems of thinking ability.
  • Ability to negotiate and influence Disciplined, organized Flexibility / Adaptability Visionary Performance driven

More Info

Job Type:
Function:
Employment Type:

Key Skills

About Company

Similar Jobs

7-12 yrs
Chennai
Skills:
Pyspark, Data Engineer, Linux, Python, Jenkins