Data Engineer, MIDAS, Digital Acceleration
Search Jobs
Search by job, company or skills
Search by job, company or skills
Are you excited about the digital media revolution and passionate about designing and delivering advanced analytics that directly influence the product decisions of Amazon's digital businesses. Do you see yourself as a champion of innovating on behalf of the customer by turning data insights into action
The Amazon Digital Acceleration (DA) org is looking for an analytical and technically skilled data engineer to join our team. In this role, you will play a critical part in developing foundational analytical datasets spanning orders, subscriptions, discovery, promotions, pricing and royalties. Our mission is to enable digital clients to easily innovate with data on behalf of customers and make product and customer decisions faster.
An ideal individual is someone who has deep data engineering skills around ETL, data modeling, database architecture and big data solutions. This individual should have strong business judgement, excellent written and verbal communication skills.
Key job responsibilities
1. Develop data products, infrastructure and data pipelines leveraging AWS services (such as Redshift, Kinesis, EMR, Lambda etc.) and internal BDT tools (Datanet, Cradle, QuickSight etc.
2. Improve existing solutions/build solutions to improve scale, quality, IMR efficiency, data availability, consistency & compliance.
3. Partner with Software Developers, Business Intelligence Engineers, MLEs, Scientists, and Product Managers to develop scalable and maintainable data pipelines on both structured and unstructured (text based) data.
4. Drive operational excellence strongly within the team and build automation and mechanisms to reduce operations
About the team
The MIDAS team operates within Amazon's Digital Analytics (DA) engineering organization, building analytics and data engineering solutions that support cross-digital teams. Our platform delivers a wide range of capabilities, including metadata discovery, data lineage, customer segmentation, compliance automation, AI-driven data access through generative AI and LLMs, and advanced data quality monitoring. Today, more than 100 Amazon business and technology teams rely on MIDAS, with over 20,000 monthly active users leveraging our mission-critical tools to drive data-driven decisions at Amazon scale.
- 3+ years of data engineering experience
- 4+ years of SQL experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.
Job ID: 152166647
Skills:
Data Modeling, Pyspark, Apache Spark, AWS Glue, Git, Spark Streaming, Microsoft Azure, Databricks, MongoDB, Cosmos DB, Python, AWS, Etl, AWS EMR, Azure Search, ELT optimization, Azure HDInsight, Azure Event Hubs, Azure SQL Server
Skills:
data engineering , Kafka, Azure Databricks, Data Warehouse, Informatica, ELT, Tensorflow, Nosql, Pytorch, Azure Synapse Analytics, Talend, Python, Azure DevOps, Hadoop, SSIS, Sql, Deep Learning, Azure Data Factory, MLops, Spark, Etl, Computer Vision, Airflow, Azure OpenAI, DataOps, Azure Foundry, Big Data ecosystems, Azure Data Services
Skills:
Pyspark, Apis, SQL Server, Azure Databricks, Jira, Functions, Azure Data Factory, Confluence, MongoDB, Python, Informatica Data Catalog, KeyVault, Logic Apps, Git Repositories, Azure HDInsight, ADLS, Event Hubs, SQL DWH, Analytics Service
Skills:
Databricks Unified Data Analytics Platform, ETL processes, data integration techniques, data quality frameworks, data pipeline development and management, cloud-based data solutions
Skills:
bedrock , S3, Kafka, CDK, Emr, Redshift, Sql, Kinesis, Terraform, Python, AWS, Flink, SageMaker, Neptune, infrastructure-as-code, Glue
