Search Jobs

Search by job, company or skills

Data Engineer II

Data Engineer II

ZETA
3-5 Years

This job is no longer accepting applications

Job Description

  • Design, develop & maintain data platform services for varied use cases such as Data Extraction, Data Processing, Data Ingestion, Data Observability and Data Discovery.
  • Own and operate the analytical data warehouse / data lake.
  • Manage the deployment of services onto multiple data centres across the globe.
  • Enable performance monitoring and auto-scaling of the platform services.
  • Contribute to establishing and enforcing coding & operational best practices for the team.

Who should apply

  • 3-5 years of experience in data engineering, BI engineering, and data warehouse development.
  • Excellent command of one or more programming languages, preferably Python or Java.
  • Excellent SQL skills.
  • Knowledge of Flink, Airflow.
  • Knowledge of DBT.
  • Experience working with Kubernetes.
  • Strong knowledge of architecture & internals of Apache Spark with multiple years of hand-on experience.
  • Experience working with distributed SQL engines like Athena / Presto.
  • Experience in building ETL Data Pipelines.
  • Ability to cut through the buzzwords and pick the right tools for building systems centred on core principles of reliability, scalability and maintainability.

Role: Data Engineer

Industry Type: IT Services & Consulting

Department: Data Science & Analytics

Employment Type: Full Time, Permanent

Role Category: Data Science & Machine Learning

Education

UG: Any Graduate

PG: Any Postgraduate

More Info

Key Skills

About Company

Similar Jobs

3-5 yrs
Hyderabad, India
Skills:
Spark SQLHiveScalaAWS GluePythonAws S3CraddleDatanet
2-4 yrs
Hyderabad
Skills:
statistical data analysis DatabricksSpring BootEmrJavaAWS GlueData WarehousingHadoopPysparkKafkaPythonKubernetesAWS EKSFlaskSparkETL data pipelinesFlinkData lakesData frameworksData engineering conceptsReal-time data processingNoSQL databases
4-6 yrs
Hyderabad, India
Skills:
YarnSqlPowerappsSQL AzureJavaAzure Data FactoryApache SparkHadoopPower BiPythonAzure SynapseScopeScalaData ExplorerBig Data ETLMap-Reduce
3-5 yrs
Hyderabad, India
Skills:
Apache AirflowJavaHadoopCloud ComputingData ManagementData GovernanceNosqlPythonScalaSparkLuigiData warehousing principlesData quality functions
3-5 yrs
Hyderabad, India
Skills:
JavaCloud ComputingHadoopScalaData GovernanceNosqlApache AirflowData ManagementSparkPythonLuigiData warehousing principlesData quality functions