Search by job, company or skills

Data Engineer

5-8 Years
Early Applicant
  • Posted 16 days ago
  • Be among the first 10 applicants

Job Description

DATA ANALYTICS ENGINEER

Fintech / Financial Services / Full-Time / 5+ Years Experience

Experience- 5 to 8 Years

Notice Period- Immediate to 15 Days.

Work mode- Hybrid

Location- Pune/ Bangalore/Hyderabad/ Noida/ Gururgram

Role Summary

We are seeking an experienced Data Analytics Engineer to design, build, and optimize scalable data pipelines and analytics infrastructure that power critical financial products and decisions. You will work at the intersection of software engineering and data analytics — building reliable ETL/ELT pipelines, orchestrating cloud-native workflows, and enabling trusted, high-quality data for reporting, risk, and product teams. This role requires strong engineering discipline (version control, CI/CD, infrastructure-as-code) combined with deep SQL and PySpark expertise, ideally within a regulated banking or financial services environment.

Key Responsibilities

  • Design, build, and maintain scalable, reliable ETL/ELT data pipelines across cloud and on-prem sources, ensuring data quality, lineage, and auditability.
  • Develop and optimize Python/ PySpark and SQL-based data transformations for large-scale, high-volume financial datasets.
  • Architect and manage data pipeline orchestration (e.g., Airflow, Databricks Workflows, Step Functions) to automate ingestion, transformation, and delivery.
  • Build and maintain CI/CD pipelines using GitHub/GitHub Actions to support automated testing, deployment, and version-controlled infrastructure changes.
  • Develop cloud-based solutions on AWS (S3, Glue, EMR, Redshift, Lambda, IAM) supporting analytics, reporting, and downstream ML use cases.
  • Deploy and manage infrastructure and pipelines as code, following best practices for environment promotion, rollback, and monitoring.
  • Monitor, troubleshoot, and optimize pipeline performance, query efficiency, and cost across the data stack.
  • Partner with data scientists, analysts, product, and risk/compliance teams to translate business requirements into robust data solutions.
  • Enforce data governance, security, and regulatory compliance standards appropriate for financial data (PII, SOX, PCI, etc.).
  • Document pipeline architecture, data models, and processes; contribute to engineering standards and code review practices.

Required Technical Skills

  • Advanced proficiency in Python for scripting, automation, and data engineering workflows.
  • Strong hands-on experience with PySpark for distributed data processing at scale.
  • Expert-level SQL and Advanced SQL (window functions, query optimization, complex joins, performance tuning).
  • Solid experience with AWS cloud services and cloud-based application/data development (S3, Glue, EMR, Redshift, Lambda, IAM, CloudWatch).
  • Proven expertise building and orchestrating data pipelines (Airflow, Databricks Workflows, Step Functions, or equivalent).
  • Hands-on CI/CD experience using GitHub / GitHub Actions for automated build, test, and deployment.
  • Deep understanding of ETL/ELT design patterns, data modeling, and data warehousing concepts.
  • Experience deploying infrastructure and pipelines via code (e.g. version-controlled deployments).
  • Demonstrated ability to optimize pipeline performance, query execution, and cloud resource/cost efficiency.

Preferred / Desired Skills (Nice to Have)

  • Hands-on experience with Databricks (Delta Lake, Unity Catalog, notebooks, cluster optimization).
  • Familiarity with Terraform or CloudFormation for infrastructure as code.
  • Experience with streaming data technologies (Kafka, Kinesis, Spark Structured Streaming).
  • Exposure to data quality/testing frameworks (Great Expectations, Dbt tests).
  • Knowledge of Dbt for transformation and analytics engineering workflows.
  • Understanding of financial data domains — payments, lending, risk, fraud, or accounting data.
  • Relevant certifications (AWS Certified Data Analytics/Solutions Architect, Databricks Certified Data Engineer).

Qualifications

  • Bachelor's degree in computer science, Engineering, Data Science, or a related field (or equivalent practical experience).
  • 5+ years of experience in data engineering, analytics engineering, or a related technical role.
  • Prior experience working within banking, fintech, or financial services, with awareness of regulatory and data-security requirements.
  • Demonstrated track record delivering production-grade data pipelines in a cloud environment.

Soft Skills

  • Strong analytical and problem-solving skills with attention to detail and data accuracy.
  • Excellent communication skills; able to translate technical concepts for non-technical stakeholders.
  • Collaborative mindset with experience working cross-functionally with analysts, engineers, and business teams.
  • Self-directed and comfortable owning projects end-to-end in a fast-paced, regulated environment.
  • Strong ownership mentality around data quality, reliability, and documentation.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 152362489

Similar Jobs

Pune, India

Skills:

Document Databases Working knowledge of MongoDBETL Tools Proficiency in Ab Initio GDE EME Co Operating SystemUnix Linux ScriptingSQL PL SQL QueryingTesting QA Exposure to SIT E2E and OAT testing cyclesMessaging Systems Experience with IBM MQ Apache KafkaAgile Delivery Experience with JIRAScheduling Tools Familiarity with Tivoli Workload Scheduler TWSSecurity Compliance Awareness of access control vulnerability assessments

Pune, India

Skills:

.NETdata warehouses Spark SQLPower BiAzure Log AnalyticsPowershell ScriptingHiveAzure Data FactoryData lakesMicrosoft Azure Data platformAzure SQL Data WarehouseAzure Storage ServicesAzure Application InsightsData BricksStream Analyticsdata martsEvent HubsAzure SQL DBAzure Analysis Services

Pune, India

Skills:

S3RDSPysparkDatabricksEmrRedshiftPythonSqlAWSEtl

Pune, India

Skills:

JavaUnixApache FlinkData ModelingSchema DesignPysparkData CleansingApache SparkData Warehouse ConceptsShell ScriptingSqlELTApache AirflowLinuxApache KafkaRestful ApisPythonEtlData TransformationData Quality Validation

Pune, India

Skills:

snowflake KafkaELTDevopsSparkIncident ManagementDatabricksRestful ApisAzureEtlAWSAirflowMonitoring

Beware of Scammers

We don’t charge money for job offers