Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

highbrow technology inc
6-8 Years
Not Disclosed
Early Applicant
  • Posted 13 hours ago
  • Be among the first 10 applicants

Job Description

Role : Azure AI - Data Engineer

Experience: 6-8 years

Location: Bangalore(Hybrid)

Mandatory skills - ADF, Synapse, Microsoft Fabric

JD :

Day to Day Job Duties:

  • Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, and Microsoft Fabric.
  • Build and optimize enterprise data solutions leveraging Azure Data Lake, Cosmos DB, Azure SQL, and Synapse.
  • Implement data ingestion, transformation, and integration processes for structured and unstructured data.
  • Develop and support modern data platforms, data warehousing, and analytics solutions.
  • Enable AI and GenAI use cases by supporting RAG (Retrieval-Augmented Generation), vector search, and Azure AI Search integrations.
  • Collaborate with business, consulting, and engineering teams to deliver data-driven solutions and ensure data quality, security, and governance.

Basic Qualifications:

  • Bachelor's degree in computer science, Information Technology, Engineering, or related field.
  • Hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, Microsoft Fabric, Azure Data Lake, Cosmos DB, and Azure SQL/Synapse.
  • Strong proficiency in SQL, Python, and data engineering concepts.
  • Experience building ETL/ELT pipelines, data models, and enterprise-scale data solutions.
  • Understanding of cloud-based data architectures, data governance, and performance optimization.
  • Strong analytical, problem-solving, and communication skills.

Preferred Qualifications:

  • Experience with Azure AI Search, vector databases, embeddings, and RAG-based AI solutions.
  • Knowledge of Spark, PySpark, and Fabric Lakehouse architectures.
  • Experience with DevOps, CI/CD pipelines, and Infrastructure as Code.
  • Microsoft Azure or Fabric certifications preferred.
  • Experience working within Agile delivery and consulting environments

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Fabric Lakehouse architectures

Infrastructure as Code

vector databases

RAG (Retrieval-Augmented Generation)

CI/CD pipelines

Microsoft Fabric

Azure AI Search

Azure Data Factory (ADF)

Similar Jobs

6-8 yrs
Bengaluru, India
Skills:
Aws Redshift, Data Modeling, Automated Testing, Scala, Apache Spark, ELT, Azure Synapse, Gcp, Databricks, Data Warehousing, Azure, Python, AWS, Etl, Lakehouse Architecture, Google BigQuery, Unity Catalog, Delta Lake, CI/CD, Infrastructure-as-Code, Observability, Databricks Workflows
8-12 yrs
Bengaluru, India
Skills:
Pyspark, Azure Databricks, Data Modeling, Sql, ELT, Databricks, Etl, GenAI frameworks and platforms, Databricks Mosaic AI, Lakehouse Architecture, Medallion Architecture, Transformation Notebooks, Batch and real-time streaming data processing frameworks, Cloud-based data storage solutions
8-12 yrs
Bengaluru, India
Skills:
Pyspark, Sql, Jenkins, Terraform, Docker, Spark, Data Modelling, Python, Kubernetes, Streaming data processing, Data pipeline development, Event-driven architectures
5-10 yrs
Bengaluru, India
Skills:
Power Bi, Pyspark, Agile Scrum, Tableau, Databases, Git, Data Warehousing, Informatica Powercenter, Python, Airflow, Data Lake concepts, Advanced SQL and performance tuning, IICS, dbt, CI/CD
6-10 yrs
Bengaluru, India
Skills:
BigQuery, Sql, Apache Flink, Hive, Python, Pyspark, Kafka, Spark, dbt, Apache Iceberg, Apache Hudi, Delta Lake