Search by job, company or skills

Fresher
Not Disclosed
  • Posted 4 hours ago
  • Be among the first 10 applicants

Job Description

Job Description

  1. Should have good understanding and real time experience on Hadoop ecosystem (HDFS, Map Reduce, YARN, Hive, Sqoop, Spark) and Azure cloud (ADLS, ADFS, ADF)
  2. Should have real time experience by using various file formats (csv, parquet, text file, avro, sequential file)
  3. Should have Hands-on experience with hive internal, external tables, hive join techniques, partitions, bucketing and hive optimization techniques
  4. Should have hands-on experience in developing Spark applications using Data frame API, Spark-SQL in Data bricks for data extraction, transformation, and aggregation from multiple file formats for Analyzing & transforming the data using Scala and Python to uncover insights into the customer usage patterns.
  5. Should have hands-on experience Extract Transform and Load data from sources Systems (On-prem) to Azure Data Storage services using a combination of Azure Data factory, T-SQL, Spark SQL.
  6. Should have hands-on Experience metadata driven ingestion pipeline framework by using Azure Data Factory
Should have good analytics and writing SQL queries to consume data and generate reports using Power BI

More Info

Job Type:
Employment Type:

Similar Jobs

Bengaluru, India
Skills:
Github, Design Patterns, Microservices, Typescript, Javascript, Python, AWS, Java, Git, Containers, Rest Apis, Azure, Kubernetes, Go, Claude, CI CD, Azure OpenAI, Agentic Workflows, LangGraph, Vector Databases, LangChain, CrewAI, Agentic AI frameworks, LLMs, Semantic Kernel, RAG Knowledge Graphs, AutoGen, Llama, OpenAI, Gemini, LlamaIndex
Noida, India
Skills:
Selenium, Kotlin, Swift, Angular, WebAuthn, Playwright, applied cryptography, FIDO2, AI tooling
Bengaluru, India
Skills:
react.js , Typescript, Webrtc, Next.js
Chennai, India
Skills:
Azure Data Factory (ADF), Git, Apis, Pyspark, Azure Databricks, Data Governance, Python, Sql