
Search by job, company or skills
Avenue Code is the leading software consultancy focused on delivering end-to-end development solutions for digital transformation across every vertical. We're privately held, profitable, and have been on a solid growth trajectory since day one. We care deeply about our clients, our partners, and our people. We prefer the word partner over vendor, and our investment in professional relationships is a reflection of that philosophy. We pride ourselves on our technical acumen, our collaborative problem-solving ability, and the warm professionalism of our teams.
Avenue Code has been believing in and promoting plurality actions for over 10 years, understanding that recognizing differences and fostering a safe environment, employment opportunities, representation, and support are the best ways to promote an increasingly equitable culture.
About the opportunity:
Data Engineer– Data & AI, Supply Chain
Remote
About the Role
We are seeking a skilled Data Engineer to join the Supply Chain Data & AI Organization. This role will focus on developing and supporting scalable data products and data pipelines that enable analytics and AI initiatives across the Sourcing, Transportation, and Warehouse Management (WMS) domains.
As a Data Engineer, you will work closely with Product Managers, Data Architects, Solution Architects, Business Analysts, and fellow engineers to design, build, test, and maintain cloud-native data solutions on Google Cloud Platform (GCP). You will play a key role in transforming enterprise data into trusted, high-quality data assets that drive business insights and operational excellence.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT data pipelines on Google Cloud Platform (GCP).
Build and optimize data solutions using Dataproc, BigQuery, SQL, and dbt.
Develop and maintain high-quality data models that support reporting, analytics, and AI use cases.
Ingest, transform, validate, and publish data from multiple enterprise source systems.
Collaborate with Product Managers, Business Analysts, Data Architects, and engineering teams to understand business requirements and deliver scalable data solutions.
Develop reusable data transformation components and adhere to established engineering standards and best practices.
Optimize data processing performance, reliability, and cost efficiency.
Perform unit testing, data validation, and production support to ensure data quality and operational stability.
Participate in Agile ceremonies, including sprint planning, backlog refinement, and code reviews.
Document technical designs, data flows, and implementation details.
Required Qualifications
Strong experience with:
Preferred Qualifications
Avenue Code reinforces its commitment to privacy and to all the principles guaranteed by the most accurate global data protection laws, such as GDPR, LGPD, CCPA and CPRA. The Candidate data shared with Avenue Code will be kept confidential and will not be transmitted to disinterested third parties, nor will it be used for purposes other than the application for open positions. As a Consultancy company, Avenue Code may share your information with its clients and other Companies from the CompassUol Group to which Avenue Code's consultants are allocated to perform its services.
Job ID: 151783273
Skills:
virtual environment , T-sql, Pyspark, Azure Databricks, Tensorflow, Numpy, Nltk, Oracle Pl Sql, Azure Synapse Analytics, Postgres, Azure Data Lake, Data Modelling, Oracle, Python, Azure DevOps, Matplotlib, Pytest, Pycharm, Hadoop, SQL Server, HBase, Azure Data Factory, Hive, Pandas, Keras, Conda, requests, Azure SQL Databases, Scikit-learn, Azure AD Integration, IDLE, Jupyter
Skills:
snowflake , Azure, Sql, AWS, Python, Gcp, Data lake architectures, CI CD pipelines
Skills:
Github, Pyspark, Apache Spark, Sql, ELT, Devops, Jenkins, Terraform, Databricks, Azure, Kubernetes, Etl, infrastructure automation, Unity Catalog, DataOps, CI CD pipelines, Delta Lake, Databricks Workflows
Skills:
Neo4j, SQL and data transformation, Graph data modeling, Metadata and lineage concepts, Entity relationship modeling, Python data engineering, Cypher
Skills:
Hadoop, Data Modeling, Pyspark, Apache Spark, Kafka, Node.js, Numpy, Pandas, Docker, Flask, FastAPI, Azure, Kubernetes, AWS, LangChain, GenAI LLMs, Databricks Delta Lake, Python Ecosystem, Pinecone, Milvus, LlamaIndex