T
Data Engineer
T
- Posted 6 hours ago
- Be among the first 10 applicants
Job Description
Job Title- Pyspark (Data Engineer)
Location- Chennai / Kolkata / Hyderabad / Pune/Bangalore
Experience Required- 5-10 years.
Job Description:
We are looking for a skilled and experienced professional to join our team. The ideal candidate should have 5-10 year of relevant experience and to be comfortable working in dynamic, fast-paced environment.
Key Responsibilities:
- Lead the team from offshore by owning project deliverables & provide technical oversight (For Tech Lead)
- Experienced in architecting & Developing Big Data solutions (For Tech Lead)
- Strong understanding of Big Data tools and Apache projects (For Tech Lead, Sr. Developer)
- Good understanding on performance tuning on Big data technologies (For Tech Lead, Sr. Developer)
- Good to have Python and Java background (For Tech Lead, Sr. Developer)
- Experience in relational database and data warehousing concept
- Well versed in Hive QL, Spark QL
- Create ETL transformation using Hive, Spark
- Support development team and testing team in implementing and testing the ETL respectively
- Build data quality rule and orchestrate using in house framework
- Work with Cloudera/Big Data support for root cause analysis and resolutions
- Good team player and collaborate with other team
More Info
Key Skills
Apache projects
ETL transformation
Big Data tools
Hive QL
Spark QL
About Company
Skills:
Azure Data Factory (ADF), T-sql, Data Warehouse Concepts, Pyspark, SQL Server, Sql, Git, Python, Star Schema, Azure DevOps, Generative AI, AI-Assisted Development, Claude Claude Code, Fact Dimension modeling, Azure SQL Database, Stored Procedures, CI/CD, Microsoft Fabric
Skills:
Agile Methodologies, Pyspark, Sql, Big Data Technologies, Microservices, Git, Gcp, Apache Kafka, Spark, Rest Apis, Azure, Python, AWS, Kafka Connect, CI CD tools, ETL ELT pipelines, Kafka Streams
Skills:
BigQuery, Pyspark, Dataproc, Data Modeling, Sql, ELT, Git, Python, Etl, GCP data services, Cloud Dataflow, Pub Sub, Cloud Composer, CI CD tools, performance optimization, partitioning, GCS
Skills:
PostgreSQL, Sql, ELT, Python, Etl, canonical data modeling, orchestration tools, data contracts, AI coding assistants, lakehouse concepts, data-quality validation, cloud data platforms, config-driven architecture
Skills:
snowflake , Github, Data Modeling, Cloudformation, Sql, Apache Airflow, Git, Terraform, Data Warehousing, Python, CI CD Pipelines, AWS IAM Security, AWS Cloud Services, dbt, Monitoring