Senior Data Engineer

About Business Unit:

As part of the Digital Integration Services team, you'll be at the forefront of modernizing marketing and delivering ground-breaking solutions. From crafting data-driven, personalized experiences that customers truly value to turning marketing visions into reality - we empower brands to achieve their goals.

Our team of 1,200 experts in strategy, analytics, creative, and digital experience uses innovative technology and data-driven insights to craft relevant, customer-centric strategies for the world's leading brands.

This position is in the Engineering team under the Digital Experience organization. We drive the first mile of customer experience through personalization of offers and content. We are currently on the lookout for a smart, highly driven individual.

You will be part of a team that is focused on building solutions and pipelines using latest engineering (data & AI/ML) design principles and tech stacks. You will also be expected to Identify, design, and implement improvements including re-designing infrastructure for greater scalability, optimizing data delivery and automate continuous integration and deployment processes/pipelines.

The incumbent is also expected to partner with various stakeholders, bring scientific rigor to design and develop high quality software.

She / He also must have excellent verbal and written communication skills and be comfortable working in an entrepreneurial, start-up environment within a larger company.

Click here to view how Epsilon transforms marketing with 1 View, 1 Vision and 1 Voice.

Responsibilities

• Develop solutions for Epsilon that will deliver high quality personalized recommendations across different channels to our customers
• Working with Data science team to ensure seamless integration and support of machine learning models.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.
• Develop end-to-end (Data/Dev/MLOps) pipelines based on in-depth understanding of cloud platforms, AI/ML lifecycle, and business problems to ensure solutions are delivered efficiently and sustainably.
• Collaborate with other members of the team to ensure high quality deliverables
• Learning and implementing the latest design patterns in Data engineering

• Bachelor's degree in engineering and related field with 10+ years of similar experience
• Tech Stack: Python, PySpark, Micro services, Docker, Serverless Frameworks & Databricks.
• Experience working on Gen AI solutions
• Preferably to have certification in Databricks
• Hands on experience building ETL workflows/data pipelines

Data Management

• Good understanding of Data Modeling, Data Warehouse, Data Catalog concepts and tools
• Experience with Data Lake architecture, and with combining structured and unstructured data into unified representations
• Ability to reduce large quantities of unstructured or formless data and get it into a form in which it can be analyzed
• Ability to manipulate large datasets, (millions of rows, thousands of variables)

Software Development

• Ability to write code in programming languages such as Python, PySpark and shell script on Linux
• Familiarity with software development methodology such as Agile/Scrum
• Love to learn new technologies, keep abreast of the latest technologies within the cloud architecture, and drive your organization to adapt to emerging best practices

Architecture and Infrastructure

• Architectural design experience on AWS/Azure & Databricks.
• Architectural design for application with high transactional volume
• Experience in delivering software with AWS EC2, S3, EMR/Glue, Lambda, Data Pipeline, CloudFormation, Redshift/Snowflake etc.
• Good knowledge of working in UNIX/LINUX systems
• Experience designing and building large scale enterprise systems

Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we've provided marketers from the world's leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels.

Epsilon's comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world.

Our pillars aren't just words. They're how we show up every day.

• People centricity: We focus on employee well-being in an environment where colleagues truly care about each other.
• Collaboration: We work together, support one another, and collectively achieve goals.
• Growth: There are endless opportunities for growth through learning, development and career advancement.
• Innovation: We drive progress through cutting-edge solutions and forward-thinking approaches.
• Flexibility: We've created a balance between work and personal life, and we encourage adaptability to solve problems creatively.

Our values guide us to create value for our clients, our people and consumers.

• Act with integrity
• Work together to win together
• Innovate with purpose
• Respect all voices
• Empower with accountability

These pillars and values are our foundationshaping our culture, guiding our decisions, and uniting us in common purpose.

Epsilon is an Equal Opportunity Employer.

Epsilon is committed to promoting diversity, inclusion, and equal employment opportunities by using reasonable efforts to attract, recruit, engage and retain qualified individuals of all ethnicities and backgrounds, including, but not limited to, women, people of color, LGBTQ individuals, people with disabilities and any other underrepresented groups, traits or characteristics.