Senior Big Data Engineer

Job description

 About The Role : 

About The Role ::The Intel Foundry Manufacturing and Supply chain FMSC Automation team is looking for a highly motivated Big Data Engineer with strong data engineering skills for data integration of various manufacturing data. You will be responsible for engaging with customers and driving development from ideation to deployment and beyond. This position is a technical role that requires the direct design and development of robust, scalable, performant systems for world-class manufacturing data engineering.

Responsibilities include:Create and maintain optimal data architectureAssemble large, complex data sets that meet functional and non-functional business requirementsIdentify, design, and implement internal process improvements:automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sourcesWork with stakeholders including the users, cross functional teams to assist with data-related technical issues and support their data infrastructure needs.Standard process to keep data secure with right access and authorizationFocus on automated testing and robust monitoringThe ideal candidate must exhibit the following behavioral traits:Excellent problem solving and interpersonal communication skillsStrong desire to learn and share knowledge with others.Be inquisitive, innovative, and a team player with a strong focus on quality workmanship.Troubleshooting skills and root cause analysis for performance issuesAbility to lean, adopt and implement new skills to drive innovation and excellence.Ability to work with cross functional teams in dynamic environment

 Qualifications 

Minimum Qualifications:

A bachelor's with 4+ years of experience in related field

Experience building and optimizing big data pipelines

Experience with skills pf handling unstructured data

Experience with data transformations, structures, metadata, workload management

Experience with big data tools:Spark, Kafka, NIFI, etc.

Experience with at least programming languages:Python, C#, .NET

Experience with relational SQL and NOSQL DBs

Experience in leveraging open-source packages

Experience in cloud native skills such as Docker, Kubernetes, Rancher etc.