We are seeking a highly experienced Senior Data Engineer to support a Media ROI analytics project. This role requires a strong hands-on data engineering professional who can also function as an analytical partner, with a deep understanding of CPG (Consumer Packaged Goods) market data and media performance metrics. The ideal candidate will bring extensive experience designing and building cloud-based data platforms while collaborating closely with analytics and business stakeholders.
Key Responsibilities:
- Design, build, and maintain scalable, cloud-based enterprise data warehouses and data pipelines to support Media ROI and CPG analytics use cases.
- Partner with analytics and business stakeholders to understand media, marketing, and CPG business requirements and translate them into robust data solutions.
- Develop and optimize data pipelines using Snowflake, Databricks, Spark, and cloud-native services across AWS and Azure.
- Create and maintain complex SQL-based analytical models, business queries, and reporting datasets to enable deep insights into media performance and ROI.
- Integrate and process large-scale structured and semi-structured datasets using Big Data technologies.
- Ensure data quality, performance optimization, security, and governance across data platforms.
- Support downstream analytics, reporting, and advanced modeling teams by delivering well-structured, analytics-ready data.
- Provide technical leadership, best practices, and guidance on data engineering and cloud architecture.
Required Skills & Experience:
- 10+ years of overall experience in data engineering and analytics.
- Proven experience building cloud-based enterprise data warehouses and reporting platforms on AWS and Azure.
- Strong expertise in Snowflake, including data modeling, performance tuning, and optimization.
- Extensive experience with Big Data architectures and tools, including:
- Hadoop File System (HDFS)
- Spark (Spark SQL, PySpark)
- Hive
- Strong programming and query skills in SQL, Python, Postgres, and related technologies.
- Hands-on experience with Azure Databricks and the broader Azure data ecosystem.
- Deep experience working across both AWS and Azure stacks.
- Expertise in writing and optimizing complex business queries to support advanced analytical scenarios.
- Strong analytical mindset with the ability to understand and interpret CPG market data, media data, and performance metrics.
Preferred Qualifications:
- Experience supporting Media ROI, marketing analytics, or digital media measurement initiatives.
- Experience working in cross-functional or stakeholder-facing environments.
- Strong communication skills with the ability to explain complex technical concepts to non-technical audiences.