Search by job, company or skills

Data Engineer

Data Engineer

TechnoGen
5-8 Years
Not Disclosed
Quick Apply
  • Posted a month ago
  • Over 100 applicants have applied

Job Description

Data Engineer Advanced Hyderabad, India Objectives of the role • Design, build and maintain complex ELT jobs that deliver business value • Translate high-level business requirements into technical specs • Ingest data from disparate sources into the data lake and data warehouse • Cleanse and enrich data and apply adequate data quality controls • Provide insight and direction to guide the future development of data platform • Develop re-usable tools to help streamline the delivery of new projects • Collaborate closely with other developers and provide mentorship • Evaluate and recommend tools, technologies, processes and reference architectures • Work in an Agile development environment, attending daily stand-up meetings and delivering incremental improvements

Basic Qualifications • Bachelors degree in computer science, engineering or a related field • Data: 5+ years of experience with data analytics and warehousing • SQL: Deep knowledge of SQL and query optimization • ELT: Good understanding of ELT methodologies and tools • Troubleshooting: Experience with troubleshooting and root cause analysis to determine and remediate potential issues • Communication: Excellent communication, problem solving and organizational and analytical skills • Able to work independently and to provide leadership to small teams of developers

Preferred Qualifications • Masters degree in computer science or engineering or a related field • Cloud: Experience working in a cloud environment (e.g. AWS) • Python: Hands on experience developing with Python • Advanced Data Processing: Experience using data processing technologies such as Apache Spark or Kafka • Workflow: Good knowledge of orchestration and scheduling tools (e.g. Apache Airflow) • Reporting: Experience with data reporting (e.g. Microstrategy, Tableau, Looker) and data cataloging tools (e.g. Alation

About Company

Similar Jobs

8-10 yrs
Hyderabad, India
Skills:
Power Bi, Apache Spark, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Powershell Scripting, Python, Azure DevOps, Lakehouse Architecture, SQL Performance Optimization, Azure SQL Database, Azure Data Lake Storage, Delta Lake, Microsoft Entra ID Azure AD
3-5 yrs
Hyderabad, India
Skills:
graph databases , object storage , S3, Golang, C#, AWS Glue, Data Modeling, Nosql, Lambda, Kinesis, Ruby, Oracle, Python, Java, Rust, C++, Emr, Redshift, Non-relational databases, Data stores, IAM roles and permissions, ETL pipelines, FireHose, AWS technologies, Key-value stores, Column-family databases
5-7 yrs
Hyderabad, India
Skills:
Power Bi, PowerShell, Azure Data Factory, Azure Synapse Analytics, Dax, Python, Azure DevOps, Azure Blob Storage, CI CD processes, Azure Data Lake Storage, Azure Analysis Services, Azure Data Catalog, Azure Data Services
5-7 yrs
Hyderabad, India
Skills:
risk management framework , Data Modeling, Data Architecture, Python, Devops, Data Quality, Agile, Data Governance, Sql, Data pipeline design, Software configuration management tools, Data observability
5-7 yrs
Hyderabad, India
Skills:
Git, Pyspark, Spark, Databricks, Sql, Python, Azure DevOps, AWS, dbt