Data Engineer
Data Engineer
infojini inc6-10 Years
- Posted 3 hours ago
- Be among the first 10 applicants
Job Description
Data Engineer with AI
- Experience: 6 -10 years
- Job Location: Bangalore, Chennai, Hyderabad, Noida, Gurgaon, Kochi, Trivandrum, Pune
- Notice period – Immediate – 15days (Not more than that)
- Mandate skills: 70% Data Engineering and 30% AI with Telecom domain experience.
Detailed Mandatory Skills:
- Databricks (PySpark, Spark SQL, Structured Streaming)
- Python
- Snowflake (SQL, Snowpark, Snowpipe Streaming, Data Aggregations, ELT)
- Kafka & Real-time Streaming Pipelines
- Agentic AI Frameworks (Semantic Kernel / LangChain / AutoGen / CrewAI)
- Azure Functions / Serverless Deployments
- KPI Dashboard Automation (Cortex Analyst/Cortex Agents preferred)
- ADF / Airflow / dbt
- DevOps (Git, CI/CD, Azure DevOps/GitHub Actions)
- Telecom Domain experience with Network KPI/Telemetry data preferred
More Info
Key Skills
CI CD
GitHub Actions
Snowpark
Structured Streaming
CrewAI
LangChain
Cortex Agents
Real-time Streaming Pipelines
Semantic Kernel
AutoGen
Streaming Data Aggregations
KPI Dashboard Automation
Cortex Analyst
Serverless Deployments
About Company
Skills:
Spark SQL, Java, Pyspark, Scala, Apache Spark, Multithreading, Google Cloud, Spark Streaming, Distributed Computing, Apache Kafka, Azure, Python, AWS, DataFrames
Skills:
Docker, Pyspark, SQL Server, Databricks, Restful Apis, Kubernetes, Azure DevOps, Azure Container Registry, Azure Key Vault, Azure Blob Storage, Azure Kubernetes Service
Skills:
agent development , Agentic Design, ETL processes, Data pipeline architecture, Python Programming Language, Data storage solutions
Skills:
snowflake , Performance Tuning, Sql, Data Modelling, Python, Etl, dbt Data Build Tool, auditing, Monitoring, CI CD environments, Big Data frameworks, Security, Azure cloud infrastructure, automated deployments