Search by job, company or skills

Azure Data Engineer

Early Applicant
  • Posted 10 hours ago
  • Be among the first 10 applicants

Job Description

Role Summary

Responsible for building and managing scalable cloud-based ETL/ELT data pipelines, supporting data ingestion, storage, and analytics. The role involves working with cloud data platforms, optimizing performance and costs, and leveraging SQL, cloud services, and modern data orchestration tools to deliver reliable data solutions.

Key Responsibilities

  • Design and deploy automated ETL/ELT pipelines to ingest data from various sources (APIs, databases, logs) into cloud data warehouses.
  • Maintain cloud storage solutions (Data Lakes and Data Warehouses).
  • Monitor and tune query performance and cloud resource consumption to manage costs

Required Skills And Qualifications

  • Educational Background: Bachelor's degree in computer science, Information Technology, or a related field.
  • Technical Skills:
    • Cloud Platforms: AWS (Redshift, S3, Glue) / Azure (Data Factory, Synapse) / GCP (BigQuery, Dataflow).
    • Languages: Advanced SQL (essential) and Python or Scala.
    • Data Processing: Apache Spark, Flink, or Kafka for real-time streaming.
    • Orchestration: Apache Airflow, dbt, or Prefect
    • Soft Skills: Excellent communication, teamwork abilities, and strong analytical and problem-solving skills.

    More Info

    Job Type:
    Industry:
    Employment Type:

    About Company

    Job ID: 152714685

    Similar Jobs

    Hyderabad, India

    Skills:

    cloud platform Azure Data Factory (ADF)Cloud IntegrationTechnologyAzure CDNAzure Networking Services

    Hyderabad, India

    Skills:

    PysparkPower BiInformaticaSqlAzure SynapseAzure Data LakeDatabricksELT architectureBig Data programmingAzure Blob StorageSpark HDInsightsEventHubAzure Analysis ServicesIOTHubAzure SQL DWHCosmosDBStream setsAttunityWindows Azure ADF

    Hyderabad, India

    Skills:

    MS-SQLPythondata engineering best practicesdata modelslogical and physical data warehouse design

    Hyderabad, India

    Skills:

    Azure Logic AppsSQL ServerAzure SQL Database

    Hyderabad, India

    Skills:

    snowflake PysparkAzure DatabricksELTData WarehousingData ModellingAdvanced SqlPythonEtlAzure DevOpsAzure Data Lake Storage ADLS Gen2Snowflake Streams TasksGit CI-CDData Pipeline DevelopmentAzure Data Factory ADFSnowflake SnowpipeDelta Lake

    Beware of Scammers

    We don’t charge money for job offers