Job Description
The corporation is seeking talented and ambitious big data engineers to join the AI Center of Excellence team The team designs develops and deploys industry leading data science and big data engineering solutions using Artificial Intelligence Machine Learning and big data platforms and technologies to increase efficiency in complex work processes enable and empower data driven decision making planning and execution throughout the lifecycle of projects and improve outcomes to the organization and its customersJob Responsibilities
Big data design and analysis data modeling development deployment and CICD operations of big data pipelines
Collaborate with a team of data engineers data scientists and business subject matter experts to process data and prepare data sources
Mentor other data engineers to develop a world class data engineering team
Ingest process and model data from heterogeneous data sources to support data science projects
Basic Qualifications
Bachelors degree or higher in Computer Science or equivalent degree and 3 to 10 years related working experience
In depth experience with a big data cloud platform preferably Azure
Strong grasp of programming languages such as Python PySpark or equivalent and willingness to learn new ones
Experience writing database heavy services or APIs
Experience building and optimizing data pipelines architectures and data sets
Working knowledge of queueing stream processing and highly scalable data stores
Experience working with and supporting cross functional teams
Strong understanding of structuring code for testability
Preferred Qualifications
Professional experience implementing and maintaining MLOps pipelines in MLflow or AzureML
Professional experience implementing data ingestion pipelines using Data Factory
Professional experience with Databricks and coding with notebooks
Professional experience processing and manipulating data using SQL and Python
Professional experience with user training customer support and coordination with cross functional teams
