Search by job, company or skills

Data Engineer

4-6 Years
  • Posted 6 hours ago
  • Be among the first 10 applicants

Job Description

Avenue Code is the leading software consultancy focused on delivering end-to-end development solutions for digital transformation across every vertical. We're privately held, profitable, and have been on a solid growth trajectory since day one. We care deeply about our clients, our partners, and our people. We prefer the word partner over vendor, and our investment in professional relationships is a reflection of that philosophy. We pride ourselves on our technical acumen, our collaborative problem-solving ability, and the warm professionalism of our teams.

Avenue Code has been believing in and promoting plurality actions for over 10 years, understanding that recognizing differences and fostering a safe environment, employment opportunities, representation, and support are the best ways to promote an increasingly equitable culture.

About the opportunity:

Data Engineer– Data & AI, Supply Chain

Remote

About the Role

We are seeking a skilled Data Engineer to join the Supply Chain Data & AI Organization. This role will focus on developing and supporting scalable data products and data pipelines that enable analytics and AI initiatives across the Sourcing, Transportation, and Warehouse Management (WMS) domains.

As a Data Engineer, you will work closely with Product Managers, Data Architects, Solution Architects, Business Analysts, and fellow engineers to design, build, test, and maintain cloud-native data solutions on Google Cloud Platform (GCP). You will play a key role in transforming enterprise data into trusted, high-quality data assets that drive business insights and operational excellence.

Key Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines on Google Cloud Platform (GCP).

Build and optimize data solutions using Dataproc, BigQuery, SQL, and dbt.

Develop and maintain high-quality data models that support reporting, analytics, and AI use cases.

Ingest, transform, validate, and publish data from multiple enterprise source systems.

Collaborate with Product Managers, Business Analysts, Data Architects, and engineering teams to understand business requirements and deliver scalable data solutions.

Develop reusable data transformation components and adhere to established engineering standards and best practices.

Optimize data processing performance, reliability, and cost efficiency.

Perform unit testing, data validation, and production support to ensure data quality and operational stability.

Participate in Agile ceremonies, including sprint planning, backlog refinement, and code reviews.

Document technical designs, data flows, and implementation details.

Required Qualifications

  1. Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field, or equivalent practical experience.
  2. 4+ years of experience in Data Engineering.
  3. Hands-on experience developing data solutions on Google Cloud Platform (GCP).

Strong experience with:

  • Dataproc
  • BigQuery
  • SQL
  • dbt (Data Build Tool)
  • Strong knowledge of data modeling techniques, including dimensional modeling and analytical data warehouse concepts.
  • Experience building scalable ETL/ELT pipelines and processing large datasets.
  • Familiarity with software development best practices, including Git-based version control and CI/CD.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent communication and collaboration skills.

Preferred Qualifications

  • Experience with Apache Airflow for workflow orchestration.
  • Experience integrating with Apache Kafka or other event streaming platforms.
  • Working knowledge of PySpark for distributed data processing.
  • Experience using Python for data engineering, scripting, and automation.
  • Knowledge of data quality, metadata management, and data governance principles.
  • Domain Experience (Highly Desirable)
  • Experience in one or more of the following domains is highly desirable:
  • Retail industry (Apparel)
  • Supply Chain data platforms
  • Transportation and Logistics
  • Warehouse Management Systems (WMS)
  • Distribution Center operations
  • Desired Attributes
  • Strong problem-solving and analytical skills.
  • Ability to work independently while collaborating effectively within cross-functional Agile teams.
  • Commitment to delivering high-quality, reliable, and scalable data solutions.
  • Eagerness to learn new technologies and continuously improve engineering practices.
  • Customer-focused mindset with the ability to translate business requirements into effective technical solutions.

Avenue Code reinforces its commitment to privacy and to all the principles guaranteed by the most accurate global data protection laws, such as GDPR, LGPD, CCPA and CPRA. The Candidate data shared with Avenue Code will be kept confidential and will not be transmitted to disinterested third parties, nor will it be used for purposes other than the application for open positions. As a Consultancy company, Avenue Code may share your information with its clients and other Companies from the CompassUol Group to which Avenue Code's consultants are allocated to perform its services.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151783273

Similar Jobs

Pune, India

Skills:

virtual environment T-sqlPysparkAzure DatabricksTensorflowNumpyNltkOracle Pl SqlAzure Synapse AnalyticsPostgresAzure Data LakeData ModellingOraclePythonAzure DevOpsMatplotlibPytestPycharmHadoopSQL ServerHBaseAzure Data FactoryHivePandasKerasCondarequestsAzure SQL DatabasesScikit-learnAzure AD IntegrationIDLEJupyter

Hyderabad, India

Skills:

snowflake AzureSqlAWSPythonGcpData lake architecturesCI CD pipelines

Bengaluru, India

Skills:

GithubPysparkApache SparkSqlELTDevopsJenkinsTerraformDatabricksAzureKubernetesEtlinfrastructure automationUnity CatalogDataOpsCI CD pipelinesDelta LakeDatabricks Workflows

Pune, India

Skills:

Neo4jSQL and data transformationGraph data modelingMetadata and lineage conceptsEntity relationship modelingPython data engineeringCypher

Bengaluru, India

Skills:

HadoopData ModelingPysparkApache SparkKafkaNode.jsNumpyPandasDockerFlaskFastAPIAzureKubernetesAWSLangChainGenAI LLMsDatabricks Delta LakePython EcosystemPineconeMilvusLlamaIndex

Beware of Scammers

We don’t charge money for job offers