Search by job, company or skills

Fresher
Not Disclosed
Early Applicant
  • Posted 15 hours ago
  • Be among the first 10 applicants

Job Description

Job Description

Skillset: (Data Architect)

  • . Hands-on experience with GCP (BigQuery, Composer, Dataproc, Dataflow, Pub/Sub)
  • . Working knowledge for data processing and pipelines
  • . Strong programming skills in SQL and PySpark
  • . Experience with Oracle and SQL Server databases
  • . Understanding of data modelling (dimensional / medallion basics)
  • . Experience in batch pipelines and exposure to streaming
  • . Familiarity with data ingestion, ETL/ELT processes
  • . Basic understanding of data quality and validation
  • . Exposure to Airflow/Composer and scheduling
  • . Working knowledge of Git and CI/CD

Detailed Responsibilities:

  • . Develop and maintain batch and streaming data pipelines
  • . Build SQL and PySpark transformations for large datasets
  • . Ingest data from multiple sources into BigQuery/cloud platforms
  • . Implement data transformation logic as per requirements
  • . Work with teams to consume curated datasets
  • . Develop workflows using Cloud Composer (Airflow)
  • . Perform data validation and reconciliation
  • . Optimise queries and pipelines for performance
  • . Support migration of legacy ETL jobs to cloud
  • . Troubleshoot pipeline and performance issues
  • . Participate in testing, UAT, and deployment
  • . Document pipelines, transformations, and sources
  • . Collaborate with analytics and reporting teams

More Info

Job Type:
Employment Type:

Similar Jobs

Hyderabad, India
Skills:
enterprise data modeling , data vault , snowflake , Data Lineage, Metadata Management, AWS Glue, Dimensional Modeling, ELT, Data Architecture, Data Warehousing, Data Governance, Security Compliance, Star Schema, Etl, Data Quality Frameworks, Airflow, Risk Management, Architecture Standards, Integration Patterns, Control-M
Cochin / Kochi / Ernakulam, India
Skills:
Data Modeling, Data Architecture, Data Warehousing, Data Governance, Big Data Technologies, Cloud data platforms, ETL processes and tools
Bengaluru, India
Skills:
Data Quality, Data Modeling, Apis, Data Architecture, Data Governance, Integration Patterns, Analytics
2-4 yrs
Gurugram, India
Skills:
data engineering , AWS Glue, Kafka, AWS, Python, Azure, Graphql, Gcp, REST, LLMs, Event orchestration, AWS Eventbridge, Airflow, GenAI, Agent orchestration frameworks, Fivetran, Airbyte, Event-driven architecture, Vector graph databases, dbt, Cloud platforms, Event bus, Microservice design
Bengaluru, India
Skills:
data engineering , Data Analytics, Aws Services, Data Processing, Data quality assessments, Cloud data warehouses, data infrastructure, Data lakes, data models, Master data management