Search by job, company or skills

ZETA

Data Engineer II

3-5 Years
Save
  • Posted 13 hours ago
  • Over 50 applicants
Quick Apply

Job Description

  • Design, develop & maintain data platform services for varied use cases such as Data Extraction, Data Processing, Data Ingestion, Data Observability and Data Discovery.
  • Own and operate the analytical data warehouse / data lake.
  • Manage the deployment of services onto multiple data centres across the globe.
  • Enable performance monitoring and auto-scaling of the platform services.
  • Contribute to establishing and enforcing coding & operational best practices for the team.

Who should apply

  • 3-5 years of experience in data engineering, BI engineering, and data warehouse development.
  • Excellent command of one or more programming languages, preferably Python or Java.
  • Excellent SQL skills.
  • Knowledge of Flink, Airflow.
  • Knowledge of DBT.
  • Experience working with Kubernetes.
  • Strong knowledge of architecture & internals of Apache Spark with multiple years of hand-on experience.
  • Experience working with distributed SQL engines like Athena / Presto.
  • Experience in building ETL Data Pipelines.
  • Ability to cut through the buzzwords and pick the right tools for building systems centred on core principles of reliability, scalability and maintainability.

Role: Data Engineer

Industry Type: IT Services & Consulting

Department: Data Science & Analytics

Employment Type: Full Time, Permanent

Role Category: Data Science & Machine Learning

Education

UG: Any Graduate

PG: Any Postgraduate

More Info

About Company

Job ID: 107522529

Similar Jobs

Hyderabad, India

Skills:

JavaCloud ComputingHadoopScalaData GovernanceApache AirflowNosqlData ManagementSparkPythonLuigiData warehousing principlesData quality functions

Hyderabad, India

Skills:

GitPower BiData WarehousingApache SparkDatabricksData ModelingApi IntegrationSqlPythonETL processesMedallion Architecture

Hyderabad, India

Skills:

YarnSqlPowerappsSQL AzureJavaAzure Data FactoryApache SparkHadoopPower BiPythonAzure SynapseScopeScalaData ExplorerBig Data ETLMap-Reduce

Hyderabad, India

Skills:

NosqlDatabricksSqlCosmos DBHbaseHadoopUnix Shell ScriptingHiveScalaGitAzure Data FactoryApache SparkAzure FunctionsPerformance TuningPythonMongoDBGen AI technology and toolsOptimizationData lakesSynapseData quality validationNifiEventhubBatch data processingMedallion architecturedata marts

Hyderabad, India

Skills:

StormHadoopData ModelingDynamodbKafkaEmrRedshiftSqlLambdaHiveKinesisPerlSqsSparkSnsStreamsPythonAWSEtlBatch and Streaming Data ArchitecturesFlinkBeamFirehose