Search by job, company or skills

C

Data Engineer Lead

9-13 Years
22 - 27 LPA
Save
new job description bg glownew job description bg glow
  • Posted 10 hours ago
  • Be among the first 10 applicants
Early Applicant
Quick Apply

Job Description

Key Skills: Data Engineer, Apache, Cloud (AWS / Azure / GCP), ETL, CICD, Pyspark, Apache Spark, Kafka

Roles and Responsibilities:

  • Data pipeline development and ETL/ELT using tools like Apache Airflow, Talend, or Informatica
  • Cloud platform and big data technologies using AWS, Azure, or GCP and frameworks such as Spark, Hadoop, and Hive
  • Healthcare data standards and compliance including HIPAA, HL7, and FHIR
  • AI & machine learning integration including data preparation and real-time data streaming
  • Technical leadership to deliver planned commitments on time
  • Database management and optimization with SQL and relational/noSQL databases

Skills Required:

  • Strong experience in data engineering with hands-on expertise in building ETL/ELT pipelines.
  • Proficiency in cloud platforms such as AWS, Azure, or GCP.
  • Experience with big data technologies including Apache Spark, Hadoop, and Kafka.
  • Hands-on experience with PySpark for large-scale data processing.
  • Strong knowledge of SQL and database design for both relational and NoSQL systems.
  • Understanding of healthcare data standards and compliance requirements (HIPAA, HL7, FHIR) is preferred.
  • Experience in implementing CI/CD pipelines for data workflows.
  • Strong analytical, problem-solving, and debugging skills.
  • Excellent communication and leadership skills.

Education: Any Graduation, Any Post Graduation

Any Graduate

More Info

Job Type:
Function:
Employment Type:

Job ID: 148290831

Similar Jobs

Bengaluru, India

Skills:

PysparkKafkaAzure DatabricksData IntegrationELTNosqlAzure Synapse AnalyticsAzure Data LakeMicrosoft AzureData GovernanceData TransformationHadoopWorkflowsSqlAzure Data FactorySparkData WarehousingData SecurityEtlData Quality FrameworksAzure SQL DatabaseDelta Live TablesSQL WarehouseStructured StreamingAzure Blob StorageCompliance StandardsUnity CatalogData Pipeline Architecture

Bengaluru, India

Skills:

JavaBigQueryData ModelingData WarehousingSqlCloud StorageEtl ToolsDataFlowPythonPub SubCloud ComposerBig data processing frameworks

Bengaluru, India

Skills:

snowflake DatabricksSqlJavaAutomated TestingAWSCloudformationPythonAzureGcpTerraformScalaSparkApache Icebergobservability

Bengaluru, India

Skills:

Apache AirflowEmrJavaLambdaGrafanaMavenPysparkMySQLCloudformationCassandraJUnitTerraformGitPostgreSQLS3Spring BootApache FlinkGithubApache SparkKinesisGradleAWSGitlabRedisPrometheusSpark SQLPythonKubernetesDockerApache KafkaMongoDBRedshiftPulsarGlue

Bengaluru, India

Skills:

Unit TestingKafkaSpring BootAPI designJava 8Memory ManagementNosqlOops Design PatternsCore JavaAWSHadoopmultithreadingPerformance TuningSqlBig Data TechnologiesGcpSystem DesignSparkRest ApisAzureJVM optimizationclean code practicescloud platformscode reviewsmicroservices architecturescalable architectures