AWS data engineer with Databricks, Pyspark - Remote - 12+ exp required

Title: AWS Data Engineer

Location: India/ Remote

Shift Hrs: 7:30 pm to 3:30 am IST

Description:

We are searching for a Data Engineer who is a self-starter, fueled by collaboration, able to transform conceptual designs into reliable, scalable processes that meet or exceed customer needs. A person should be very good at analytical, problem solving and troubleshooting data pipelines root cause analysis and resolutions. Working with various Development team, Technology partners and business stakeholders to deliver unified and timely support, while upholding quality and resolution standards to fulfil the operational needs of our business stakeholders.

Person should have:

10+ Years of IT experience, with 7+ years of experience as an ETL/ELT developer/data engineer.

3+ years of Databricks data engineering experience (Databricks Data Engineer and/or Spark Developer certification preferred)

Working knowledge of the Finance or Insurance industry

Expert in AWS Databricks, Python, Spark, Hadoop EMR, Hive, Presto

Strong SQL, and UNIX Shell scripting experience

Performance tuning data pipelines, track record communicating issues & follow-up through issue resolution.

Production Support for applications, monitor production jobs, triage issues to appropriate team & resolve any issues in a timely manner