Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

LatentView Analytics
5-8 Years
Not Disclosed
Early Applicant
  • Posted 17 hours ago
  • Be among the first 10 applicants

Job Description


About the Company

Job SummaryWe are looking for an experienced Data Engineer with strong expertise in Snowflake and Microsoft Azure to design, build, and optimize scalable data solutions. The ideal candidate will have hands-on experience working with large datasets, modern cloud data platforms, and big data tools, enabling analytics and business intelligence at scale.

About the Role

We are looking for an experienced Data Engineer with strong expertise in Snowflake and Microsoft Azure to design, build, and optimize scalable data solutions. The ideal candidate will have hands-on experience working with large datasets, modern cloud data platforms, and big data tools, enabling analytics and business intelligence at scale.

Responsibilities

  • Snowflake Data Lake Management
  • Maintain and optimize existing Snowflake data lake architecture.
  • Implement data governance, security, and access control policies.
  • Ensure scalable storage and compute performance.
  • Monitor and manage data ingestion pipelines.
  • Azure Data Factory ETL Development
  • Design and develop robust ETL pipelines using Azure Data Factory.
  • Integrate data from multiple sources (on-prem, cloud, third-party).
  • Implement data transformation logic and error handling.
  • Schedule and orchestrate data workflows for timely delivery.
  • Data Quality & Validation
  • Define and implement data validation rules.
  • Monitor data accuracy, completeness, and consistency.
  • Provide automated alerts for data anomalies.
  • Develop and maintain data models to support analytics, reporting, and downstream applications
  • Write complex and high-performance queries using SQL
  • Work with NoSQL databases and integrate data from multiple sources
  • Use Python for data transformation, automation, and orchestration
  • Implement data quality checks, monitoring, and performance tuning
  • Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
  • Ensure best practices for data security, governance, and compliance in cloud environments
  • Troubleshoot and resolve data-related issues across the data platform

Qualifications

  • 5–8 years of experience as a Data Engineer

Required Skills

  • Strong hands-on experience with Snowflake (data modeling, performance tuning, SnowSQL)
  • Experience working with Microsoft Azure (e.g., Azure Data Factory, Azure Synapse, ADLS, Databricks)
  • Advanced proficiency in SQL
  • Experience with NoSQL databases (e.g., MongoDB, Cassandra, Cosmos DB)
  • Strong programming skills in Python
  • Experience with Big Data tools and frameworks (e.g., Spark, Hadoop, Kafka)
  • Solid understanding of data warehousing concepts and cloud-native architectures
  • Familiarity with CI/CD pipelines and version control tools (e.g., Git)

Preferred Skills- 3 - 5 years experience in Azure - Snowflake to design, build, and optimize scalable data solutions

Equal Opportunity Statement- We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Similar Jobs

6-8 yrs
Pune, India
Skills:
snowflake , Java, Data Factory, Performance Tuning, Scala, Data Governance, Sql, Metadata Management, Spark, Python, OneLake, Access Control, Snowflake Snowpipe Streaming, Fabric Warehouse, Fabric Lakehouse, Microsoft Purview, Snowpark, Snowflake Tasks, Azure Event Hubs, Lakehouse architecture, Data quality frameworks, Microsoft Fabric, CI/CD practices for data pipelines
8-13 yrs
Pune, India
Skills:
Apache Airflow, Aws Redshift, Amazon S3, AWS Glue, Sql
4-6 yrs
Pune, India
Skills:
snowflake , BigQuery, Redshift, Python, Sql, AWS, Airflow, SageMaker, Machine Learning Fundamentals, Data Quality Testing
6-8 yrs
Pune, India
Skills:
snowflake , Pyspark, Kafka, Spring Boot, CDK, Apache Airflow, React, Typescript, Javascript, Core Java, Terraform, Python, AWS, Java, Cloudformation, Emr, Spark, Databricks, Rest Apis, Azure, Kubernetes, Apache Iceberg, Flink, Trino, Unity Catalog, Delta Lake
5-7 yrs
Pune, India
Skills:
Apache Airflow, Pyspark, Spark, Databricks, Azure, Python, Sql, Fabric, ETL pipelines