Search by job, company or skills

Data engineer

Data engineer

Virtusa
5-7 Years
Not Disclosed
Early Applicant
  • Posted 3 hours ago
  • Be among the first 10 applicants

Job Description

Job Requirements

JP - UHGJP00126453

Role - Data Engineer

Number of RRIDs required - 5

JD - Description

Please list the required skills and attributes for this role, including expected years of experience where applicable.

Core Data Engineering: 5+ years of experience designing, building, and optimizing robust, scalable data pipelines

Programming Languages: 4+ years of strong production-grade coding experience in Python and advanced proficiency writing complex, optimized SQL queries

Big Data Technologies: 3+ years of experience working with distributed computing frameworks such as Apache Spark (or PySpark).

Data Warehousing Architecture: Advanced proficiency in cloud data platforms (such as Snowflake, Google BigQuery, or AWS Redshift) and building optimized dimensional models

Problem-Solving Data Quality: Proven track record of implementing rigorous data validation data cleansing, and error-handling frameworks

Please list the preferred skills and attributes for this role, including expected years of experience where applicable.

Cloud Infrastructure: 2+ years of hands-on experience with cloud platforms particularly with managed data services and serverless computing

Orchestration Tools: Experience managing and monitoring complex workflows using tools like Apache Airflow, Prefect, or dbt.

CI/CD & DevOps: Experience deploying pipelines via CI/CD frameworks and infrastructure-as-code

Streaming Architecture: Familiarity with real-time data streaming technologies such as Apache Kafka or AWS Kinesis is a strong plus.

Primary Responsibilities

Pipeline Development Design build and maintain automated scalable ETL/ELT pipelines ingesting high-volume data from disparate sources.

Data Modeling Optimization: Build clean relational and dimensional data models supporting self-service analytics and BI workloads.

Performance Tuning: Monitor troubleshoot and optimize data workflows and queries for speed, cost-efficiency, and reliability.

Collaboration Integration: Partner with analysts data scientists and business teams to translate requirements into structured datasets.

Preferred Experience Domain

Prior experience in enterprise software or high-growth technology environments

Strong grasp of data value chain models, cross-functional mapping, and Agile delivery

Required AI Skills Maintain 90%+ weekly usage of approved GenAI tools to boost coding documentation, and analysis workflows

Work Experience

5-7Years

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

5-7 yrs
Hyderabad, India
Skills:
Orchestration, Java, Power Bi, Performance Tuning, Scala, Kafka, Dimensional Modeling, Sql, Spark, Python, Flink, CI CD, Beam, incremental processing, access controls, Cube.dev, data-quality testing, data partitioning, Production Monitoring
3-5 yrs
Hyderabad, India
Skills:
graph databases , object storage , Data Modeling, Emr, Data Warehousing, Sql, Lambda, Kinesis, Spark, Python, Cradle, Non-relational databases, DataCraft, FireHose, R, Redshift Spectrum, Glue, Key-value stores, Column-family databases, IAM roles and permissions, ETL pipelines
7-9 yrs
Hyderabad, India
Skills:
snowflake , CSS, Pyspark, PostgreSQL, Microsoft Office, HTML, React Js, MySQL, Databricks, Excel, Oracle, Python, Fast API
8-10 yrs
Hyderabad, India
Skills:
BigQuery, Pyspark, Dataproc, Sql, Cloud Storage, Git, Terraform, DataFlow, Solution Architecture, Python, Airflow, Cloud Composer, CI/CD, Pub/Sub
3-5 yrs
Hyderabad, India
Skills:
Ab initio, Sql