Search by job, company or skills

Data Engineer

Data Engineer

infovision inc.
Fresher
Not Disclosed
  • Posted 2 hours ago
  • Be among the first 10 applicants

Job Description

Knowledge and experience with relational and non-relational databases.

Strong hands-on experience with MongoDB, including schema design, aggregation pipelines, indexing strategies, sharding, replica sets, and performance optimization.

Proficiency in Azure Cosmos DB, including multi-model data access (Cosmos DB API for MongoDB, SQL API), partitioning strategies, consistency levels, throughput management (RU/s), and global distribution.

Strong experience in graph data modeling and querying using Azure Cosmos DB Gremlin API, including graph traversals, vertex/edge design, and relationship-driven analytics.

Strong hands-on experience in building RESTful APIs using FastAPI, including async endpoint design, Pydantic models, middleware, dependency injection, background tasks, and auto-generated OpenAPI/Swagger documentation.

Experience with Azure API Management (APIM) for API gateway configuratio



Roles & Responsibilities

Responsibilities:

Collect progress updates from Squad on a regular basis.

Consolidate updates into weekly project status reports and share with the Squad Leads for their review.

You participate in early state design and feature definition activities.

Responsible for implementing robust data pipeline using Microsoft, Databricks Stack

Responsible for creating reusable and scalable data pipelines.

You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.

You have strong communication skills to effectively convey complex data insights to non-technical stakeholders.

Develop and manage L3-level project plans with sufficient details for tasks, milestones, and dependencies

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Microsoft Databricks

Azure API Management

About Company

Similar Jobs

Pune, India
Skills:
Apache Spark, Apache Airflow, Azure Synapse, Databricks, Kubernetes, Unix Shell Scripting, Couchbase NoSQL databases, ETL development and orchestration, Advanced SQL development and performance tuning, Apache Druid, Data migration to cloud platforms, Stambia, Python for ETL orchestration and automation, Data Platform Management, Agile delivery methodologies, Big Data Engineering, JSON API-based integrations
Pune, India
Skills:
Pyspark, Azure Databricks, Git, Automation Tools, Docker, Linux, Load Balancers, FastAPI, Kubernetes, Python, Kusto Query Language, traffic routing, AKS, cloud networking concepts, Azure Data Explorer, EKS, microservices architecture, PySpark SQL
Pune, India
Skills:
Apache Spark, Apache Airflow, Azure Synapse, Kubernetes, Unix Shell Scripting, Databricks, Couchbase NoSQL databases, Advanced SQL development and performance tuning, ETL development and orchestration, Apache Druid, Data migration to cloud platforms, Stambia, Python for ETL orchestration and automation, Agile delivery methodologies, JSON API-based integrations, Data Platform Management, Big Data Engineering
Pune, India
Skills:
Csv, Pyspark, Scala, Apache Spark, Avro, Pandas, Json, Apache Kafka, Xml, MongoDB, Python, S3, Aws Services, Dynamodb, Json, Lambda, Sqs, Sns, Etl, Apache Iceberg, Parquet, NoSQL databases, requests, Confluent Kafka, awswrangler, Starburst Trino, data formats, Step Functions, AWS architecture, EventBridge, Glue, Athena
2-4 yrs
Pune, India
Skills:
Hadoop, Scala, Kafka, Pl Sql, Sql, ELT, Spark, Data Warehousing, MongoDB, Azure, Python, Etl, AWS, Data Pipelines