V
Data Engineer
V
Data Engineer
Virtusa- Posted an hour ago
- Be among the first 10 applicants
Job Description
Job Requirements
Experience with cloud data platforms (Azure, AWS, GCP); Exposure to real-time data streaming and
event-driven architectures; Experience supporting AI/ML pipelines and analytics workloads is highly
preferred; Experience in regulated industries such as banking or financial services is an advantage.
Required Skills
Data Engineering, ETL/ELT, Data Modeling, SQL, Python/Scala, Big Data Processing
(Spark/Hadoop), Data Warehousing, Data Lakes, Streaming (Kafka/Event Hubs), Cloud Data
Platforms, Data Governance, Data Quality, Performance Optimization, Problem Solving,
Debugging, Integration Design, Collaboration
Preferred Tools And Certifications
Data Platforms: Azure Data Factory, AWS Glue, Google Dataflow, Databricks
Processing: Apache Spark, Hadoop
Databases: SQL Server, PostgreSQL, MySQL, Snowflake, BigQuery
Streaming: Kafka, Azure Event Hubs; Programming: Python, Scala
Orchestration: Airflow; Version Control: Git; DevOps: CI/CD tools (Azure DevOps, Jenkins)
Monitoring: Azure Monitor, Prometheus, Grafana
Certifications: Azure Data Engineer Associate, AWS Data Analytics, Google Professional Data
Engineer, Databricks certification (preferred)
Work Experience
7-10Years
Experience with cloud data platforms (Azure, AWS, GCP); Exposure to real-time data streaming and
event-driven architectures; Experience supporting AI/ML pipelines and analytics workloads is highly
preferred; Experience in regulated industries such as banking or financial services is an advantage.
Required Skills
Data Engineering, ETL/ELT, Data Modeling, SQL, Python/Scala, Big Data Processing
(Spark/Hadoop), Data Warehousing, Data Lakes, Streaming (Kafka/Event Hubs), Cloud Data
Platforms, Data Governance, Data Quality, Performance Optimization, Problem Solving,
Debugging, Integration Design, Collaboration
Preferred Tools And Certifications
Data Platforms: Azure Data Factory, AWS Glue, Google Dataflow, Databricks
Processing: Apache Spark, Hadoop
Databases: SQL Server, PostgreSQL, MySQL, Snowflake, BigQuery
Streaming: Kafka, Azure Event Hubs; Programming: Python, Scala
Orchestration: Airflow; Version Control: Git; DevOps: CI/CD tools (Azure DevOps, Jenkins)
Monitoring: Azure Monitor, Prometheus, Grafana
Certifications: Azure Data Engineer Associate, AWS Data Analytics, Google Professional Data
Engineer, Databricks certification (preferred)
Work Experience
7-10Years
More Info
Key Skills
Data Lakes
Big Data Processing
Event Hubs
Cloud Data Platforms
About Company
Skills:
Orchestration, Java, Power Bi, Performance Tuning, Scala, Kafka, Dimensional Modeling, Sql, Spark, Python, Flink, CI CD, Beam, incremental processing, access controls, Cube.dev, data-quality testing, data partitioning, Production Monitoring
Skills:
snowflake , Adf, Agile Methodologies, Informatica, Sql Development, Git, Gcp, Azure, AWS, Airflow, dbt Core, Kimball Dimensional Modeling, Matillion, dbt Cloud, CI CD pipelines, Fivetran, Snowflake Certification SnowPro Core Advanced
Skills:
Pyspark, Databricks, FastAPI, Python, Sql, AWS, Rockset, Airflow, CrateDB, Clickhouse
Skills:
Performance Tuning, SQL Server, Ibm Datastage, Azure Databricks, Data Modeling, Sql Development, ELT, Devops, Jenkins, Git, Azure DevOps, Etl, Warehouse design, CI CD, GitHub Actions
Skills:
BigQuery, Pyspark, Dataproc, Sql, Cloud Storage, Git, Terraform, DataFlow, Solution Architecture, Python, Airflow, Cloud Composer, CI/CD, Pub/Sub