Search Jobs

Search by job, company or skills

Data Engineer

Data Engineer

kavi india

This job is no longer accepting applications

Job Description

We are seeking a detail-oriented and highly motivated Data Engineer to join our growing Data & Analytics team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure that power insights across the organization. You'll work closely with data scientists, analysts, and engineers to ensure the integrity, accessibility, and scalability of our data systems.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines and ETL processes.
  • Build and optimize data architecture to ensure data quality and consistency.
  • Integrate data from diverse internal and external sources.
  • Collaborate with cross-functional teams to define data requirements and deliver solutions.
  • Implement best practices for data governance, security, and compliance.
  • Monitor pipeline performance and perform real-time troubleshooting of data issues.
  • Participate in code reviews and contribute to documentation and standards.

Required Qualifications & Skills:

  • Bachelor's degree in computer science, Engineering, or a related field (or equivalent practical experience).
  • 5+ years of professional experience in data engineering.
  • Solid understanding of SQL and proficiency in at least one programming language, such as Python, Java, or Scala.
  • Practical experience building and maintaining data pipelines using tools like Apache Airflow or DBT.
  • Hands-on experience with cloud platforms (AWS, GCP, Azure) and data warehousing solutions (Redshift, BigQuery, Snowflake).
  • Familiarity with big data technologies and frameworks, including Spark, Kafka, and Hadoop.
  • Demonstrated ability to solve complex problems with a strong focus on detail.
  • Experience implementing CI/CD practices for data workflows.
  • Working knowledge of data modelling principles and schema design.
  • Exposure to machine learning pipelines or real-time analytics systems is a plus

More Info

Job Type:
Industry:
Employment Type:

About Company

Similar Jobs

5-7 yrs
Chennai, India
Skills:
distributed architecture , object storage , Ksh, LINUX, Sql, ELT, Python, Etl, Airflow, CFT, Starburst, Trino
5-7 yrs
Chennai, India
Skills:
Power Bi, Microsoft Sql Server, Azure Databricks, Data Modeling, Sql, Azure Data Factory, Azure Synapse Analytics, Spark, Reporting Tools, Python, Microsoft Azure data platform, data pipelines, ER modelling, Azure Analysis Services
5-7 yrs
Chennai, India
Skills:
BigQuery, Gcp, Spark, Apache Beam, Dataproc, DataFlow, Python, Sql, ELT, Etl, Cloud Data Engineering
4-6 yrs
Chennai, India
Skills:
Azure Data Lake Storage (ADLS), Pyspark, Apache Spark, Python, Sql, Git, Azure Data Factory, Power Bi, Azure Synapse Analytics, Databricks, Azure DevOps, Fabric Lakehouse, OneLake, Delta Lake, Fabric Data Factory Data Pipelines, Microsoft Fabric, Microsoft Purview, ETL ELT concepts, Real-time streaming data, CI CD
5-10 yrs
Chennai, India
Skills:
Power Bi, PowerShell, SSIS, Azure Synapse, Vbscript, Ssas, Vba, Azure Data Lake, DevOps practices, Windows Server 2019 2022, Azure Data Factory ADF, CI CD pipelines, ETL ELT development, SQL Server 2019 2022