Sr. Data Engineer & Data Analyst

Job Title: Data Engineer

Role Level: Senior Software Engineer

Employment Type: Full-Time

Experience Required: 6-12 years

Role Overview

We are seeking a highly experienced and skilled Senior/Staff Data Engineer to join a growing data engineering team. In this role, you will be responsible for designing, building, and maintaining scalable and reliable data infrastructure and pipelines. You will collaborate closely with data scientists, analysts, and product teams to transform raw data into actionable business insights.

This role is ideal for candidates who are passionate about data engineering, enjoy solving complex technical challenges, and thrive in a fast-paced environment.

Key Responsibilities

Design, develop, and implement scalable, high-performance data pipelines using ETL/ELT frameworks

Build and optimize data models (dimensional, relational, columnar)

Develop, maintain, and optimize data warehouses and data lakes

Technologies may include Snowflake, Redshift, BigQuery, Databricks

Storage platforms such as S3 or ADLS

Ensure data availability, reliability, scalability, and performance

Identify and resolve performance bottlenecks in data pipelines and SQL queries

Implement data governance, quality checks, security, and compliance standards

Automate data ingestion, transformation, monitoring, and alerting processes

Collaborate with cross-functional teams to gather requirements and deliver data solutions

Mentor junior data engineers and contribute to team best practices

Stay updated with emerging data technologies and recommend improvements

Create and maintain technical documentation for pipelines, models, and processes

Required Skills & Qualifications

7+ years of hands-on experience as a Data Engineer

Strong expertise in Databricks

Excellent proficiency in Python and SQL

Experience with ETL/ELT processes and tools

Hands-on experience with cloud platforms:

• AWS (S3, Glue, Lambda, Redshift, EMR)
• OR Azure (Data Lake, Data Factory, Synapse)
• OR GCP (BigQuery, Dataflow, Cloud Storage)

Strong understanding of data warehousing concepts

Experience with big data technologies such as Spark, Hadoop, or Kafka

Knowledge of data modeling techniques (Star Schema, Snowflake Schema, 3NF)

Experience using version control systems (Git)

Strong analytical, problem-solving, and communication skills

Mandatory Skills

Databricks, Python, SQL , AWS or any cloud, SQLite, Teradata

Position 2 : Sr. Data Analyst

Good to Have (Preferred)

Exposure to Databricks, Spark, or PySpark for large-scale data analysis.

Experience with ETL/ELT tools such as ADF, Airflow, dbt, Informatica, etc.

Mandatory Skills

Data Analysis, Data Quality Management, Data Warehousing, SQL, Snowflake, Data Modelling

Note:

1. Applications will only be accepted through the ATS link provided above. Profiles shared through other means will not be considered.

2. Prolegion does not charge any fee from candidates at any stage. If anyone approaches you for money in exchange for this opportunity, treat it as fraud and report it to us immediately.