Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

Vantageiq Technologies Opc
5-9 Years
Not Disclosed
Quick Apply
  • Posted a month ago
  • Over 100 applicants have applied

Job Description

Key Responsibilities

  • Design, develop, and optimize data pipelines and ETL processes using modern data engineering tools and technologies
  • Apply domain expertise in operations, supply chain, and manufacturing to deliver tailored data solutions
  • Process and analyze large-scale operational datasets using frameworks like Apache Spark
  • Implement data transformations and business logic to support analytics and decision-making
  • Manage structured and semi-structured data on cloud platforms such as Snowflake
  • Use dbt for data modeling, transformation, and documentation to ensure consistency and quality
  • Monitor, troubleshoot, and enhance the performance and scalability of data pipelines
  • Conduct data profiling, cleansing, and validation to ensure high data integrity
  • Collaborate with cross-functional teams including operations, data science, and business analysts to deliver impactful solutions
  • Stay updated with the latest trends and emerging tools in the data engineering ecosystem

Preferred Qualifications

  • Bachelor's degree in Computer Science, Engineering, Operations Management, or a related field
  • Minimum of 5 years of experience in data engineering or related roles
  • Proficiency in Python, Spark, SQL, Snowflake, dbt, and associated tools
  • Strong understanding of data within operations, supply chain, or manufacturing domains
  • Experience with big data frameworks and working on cloud platforms (e.g., AWS, Azure, GCP)
  • Solid knowledge of data modeling, ETL development, and data integration best practices
  • Familiarity with visualization tools like Tableau or Power BI is a plus
  • Strong analytical, problem-solving, and communication skills

More Info

Key Skills

About Company

Our Pune-based technology services company specializes in accelerating product development for tech-driven businesses in emerging markets. We offer expertise in niche and advanced technologies such as BI, Analytics, Data Engineering, Data Science, AI, ML, and Cloud solutions. Our team of seasoned experts collaborates with clients to build innovative products, leveraging our strong frontend capabilities and deep understanding of various technology stacks. We cater to IT, ITES, Fintech, Insurance, Banking, and Financial Services sectors, with a focus on delivering efficient, cost-effective solutions.

Similar Jobs

7-9 yrs
Bengaluru, India
Skills:
Hadoop, Etl Development, Scala, Data Modeling, Dataproc, Hive, Presto, Spark, Big Data Technologies, DataFlow, Azure, Python, AWS, Big Query, Airflow, Data lake architecture, Cloud Composer, GCS, GCP technologies
7-9 yrs
Bengaluru, India
Skills:
PostgreSQL, Apache Spark, Kafka, Apache Airflow, Pandas, MySQL, Elasticsearch, MongoDB, Python, data pipelines, pgvector, Polars, distributed data systems, Qdrant, NoSQL databases, vector databases, OpenSearch, Relational Databases, Milvus
5-8 yrs
Bengaluru, India
Skills:
Pyspark, Azure Databricks, Sql, Git, Data Quality Governance, ADLS Gen2, Medallion Architecture, DLT, Auto Loader, Unity Catalog, Delta Lake, Structured Streaming, CI-CD, Databricks Workflows
10-12 yrs
Bengaluru, India
Skills:
Pyspark, Snaplogic, PostgreSQL, SQL Server, Workato, SSIS, Sql, Data Cleansing, Oracle, Python, Etl, StreamSets, data storage and retrieval, Master Data Management
5-8 yrs
Bengaluru, India
Skills:
snowflake , Apache Airflow, Data Modelling, Python, Sql, AWS – Glue, dbt, CI CD