Search by job, company or skills

Data Engineer

Early Applicant
  • Posted 3 months ago
  • Be among the first 30 applicants

Job Description

Role: Data Engineer

Experience: 4+ years

Work Location: Chennai

Notice Period: 0-15 days

Job Description:

  • PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.
  • Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase.
  • Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala).
  • Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools.
  • Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks.
  • Scripting and Automation: Strong scripting skills in Linux.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 128396489

Similar Jobs

Chennai, India

Skills:

PysparkGcpScalaKafkaDataprocBQAirflow

Chennai, India

Skills:

PysparkAzure DatabricksSqlEncryptionAzure Data FactoryTerraformAzure Synapse AnalyticsData GovernanceArmPythonAzure DevOpsAzure PurviewADLS Gen2ComplianceSecurityrbacCI CD pipelinesDelta LakeBicepInfrastructure-as-Code

Chennai, India

Skills:

BigQueryDataFlowAdvanced SqlPythonLoggingDataformBatch and streaming data processingData CatalogCloud MonitoringData lakehouse architecture conceptsPub SubDataplexIAM Security controlsJava or ScalaData ingestion frameworksAnalytics HubData modeling and warehousing principlesCDC and incremental processing

Chennai, India

Skills:

Data FactoryContinuous DeliveryPysparkKafkaSqlAzure SqlContinuous IntegrationPandasDatabricksPythonAzure DevOpsADLS gen2Azure Key VaultMicrosoft Azure data servicesAgile practicesEvent HubsDelta Lake

Chennai, India

Skills:

GcpData WarehousingAzureEtlGenerative AIdata pipelinesAidata automation

Beware of Scammers

We don’t charge money for job offers