Search by job, company or skills

Data Engineer

5-7 Years
Early Applicant
  • Posted 20 hours ago
  • Be among the first 10 applicants

Job Description

Aviato Consulting is looking for a highly skilled and motivated Data Engineer to join our expanding team. This role is ideal for someone with a deep understanding of Google Cloud data solutions. GCP certification is mandatory for this position.

You will work directly with clients, translating their business requirements into scalable data solutions, while providing technical expertise and guidance.

Key Responsibilities:

  • Client Engagement: Work closely with clients to understand business needs, gather technical requirements, and design solutions leveraging GCP services.
  • Data Pipeline Design & Development: Build and manage scalable data pipelines using tools such as Apache Beam, Cloud Dataflow, and Cloud Composer.
  • Data Warehousing & Lake Solutions: Architect, implement, and optimize BigQuery based data lakes and warehouses.
  • Real Time Data Processing: Implement and manage streaming data pipelines using Kafka, Pub/Sub, and similar technologies.
  • Data Analysis & Visualization: Create insightful data dashboards and visualizations using tools like Looker, Data Studio, PowerBI, or Tableau.Build conversational interfaces, RAG pipelines, and intelligent search experiences for enterprise data.
  • AI & Machine Learning Solutions :Design, deploy, and operationalize ML models and Generative AI applications using Vertex AI (including Gemini, AutoML, and custom models). Implement MLOps pipelines to handle model training, evaluation, deployment, and monitoring.
  • Technical Leadership & Mentorship: Provide guidance and mentorship to team members and clients, helping them leverage the full potential of Google Cloud.

Required Qualifications:

  • Experience:
  • 5+ years as a Data Engineer working with Google Cloud
  • Proven experience in Python with libraries like Pandas and NumPy.
  • Expertise in building data pipelines using Apache Beam, Cloud Dataflow, or similar tools.
  • Solid knowledge of Kafka for real-time data streaming.
  • Proficiency with BigQuery, Google Pub/Sub, and other Google Cloud services.
  • Familiarity with Apache Hadoop for distributed data processing.
  • Technical Skills:
  • Strong understanding of data architecture and processing techniques.
  • Solid understanding of ETL pipelines, data ingestion, transformation, and storage.
  • Knowledge of data modeling, data warehousing, and big data management principles.
  • Certifications:
  • Google Cloud certification (Professional Data Engineer, Cloud Architect, or similar Pro level) is mandatory for this role.

Soft Skills:

  • Excellent English communication skills.
  • Client facing experience and the ability to manage client relationships effectively.
  • Strong problem solving skills with a results-oriented approach.

Preferred Qualifications:

  • Visualization Tools: Experience with tools like Looker, Power BI, or Tableau.

Benefits:

  • Competitive salary and benefits package.
  • Opportunities to work with cutting-edge cloud technologies with large customers.
  • Collaborative work environment that encourages learning and professional growth.
  • A chance to work on high-impact projects for leading clients in diverse industries.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 152528001

Similar Jobs

Bengaluru, India

Skills:

PysparkPower BiDatabricksDaxPower QueryPythonAzure Cloud Data Engineering Tools

Hyderabad, India

Skills:

Big Data TechnologiesData WarehousingDataprocPython ProgrammingGoogle Cloud Platform GCPCloud ComposerSQL PostgreSQLCloud Pub SubETL Development Data PipelinesLarge Dataset Processing

India

Skills:

data streaming snowflake JavaMachine LearningApi DevelopmentEtl DevelopmentNode.jsData ModelingSqlAngularDevopsReactVue.JSTypescriptJavascriptSparkDatabricksPythonAWSAimicroservices architectureGraphQL APIs

Hyderabad, India

Skills:

PysparkAzure Data FactoryApache KafkaPythonSqlAzure DevOpsAzure Databricks Unity Catalog Delta live tablesData Modelling ArchitectureETL pipeline designAzure cloud data services technologiesLogging and Monitoring using Azure Databricks services

Bengaluru, India

Skills:

data warehouses SAPAPI securityPysparkMicrosoft Power BiKafkaTerraformDockerOraclePythonSoqlApi GatewayAws LambdaOauth2Node.jsSoapSqlGitRESTSparkDatabricksKubernetesdata pipelinesSalesforce APIsAPI integrationsdelta lakesmicroservices architecturewebhooks

Beware of Scammers

We don’t charge money for job offers