Search Jobs

Search by job, company or skills

Data Engineer

Data Engineer

iConsultera
2-4 Years
Early Applicant
  • Posted 6 hours ago
  • Be among the first 10 applicants

Job Description

Job Summary

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure that support business intelligence, analytics, and machine learning initiatives. The ideal candidate will have experience with ETL processes, data warehousing, cloud platforms, and big data technologies. This remote role requires strong programming skills, expertise in SQL, and the ability to collaborate with data analysts, data scientists, and software engineering teams.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines.
  • Build and optimize data integration workflows from multiple data sources.
  • Develop and maintain data warehouses, data lakes, and data marts.
  • Write optimized SQL queries for data extraction, transformation, and loading.
  • Ensure data quality, integrity, security, and governance across data platforms.
  • Implement data validation, monitoring, and automated quality checks.
  • Optimize database performance and troubleshoot data-related issues.
  • Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements.
  • Deploy and manage cloud-based data solutions on AWS, Microsoft Azure, or Google Cloud Platform.
  • Automate data workflows using orchestration tools and scripting languages.
  • Create and maintain technical documentation for data pipelines and architecture.
  • Stay current with emerging data engineering technologies and best practices.

Required Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, Software Engineering, or a related field (or equivalent experience).
  • 2+ years of experience in Data Engineering or a related role.
  • Strong proficiency in SQL and Python.
  • Experience with ETL/ELT development and data integration.
  • Knowledge of relational and NoSQL databases.
  • Experience with data warehousing concepts and dimensional modeling.
  • Familiarity with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to work independently in a remote environment.

Preferred Qualifications

  • Experience with Apache Spark, Hadoop, Kafka, or similar big data technologies.
  • Knowledge of orchestration tools such as Apache Airflow, Prefect, or Azure Data Factory.
  • Experience with Snowflake, Databricks, BigQuery, or Amazon Redshift.
  • Familiarity with Docker, Kubernetes, and CI/CD pipelines.
  • Understanding of data governance, data security, and regulatory compliance.
  • Experience supporting machine learning data pipelines.
  • Cloud certifications (AWS, Azure, or Google Cloud) are a plus.

More Info

Job Type:
Industry:
Employment Type:

About Company

Similar Jobs

6-8 yrs
Bengaluru, India
Skills:
Pyspark, ELT, Azure Synapse, Azure Functions, Terraform, Python, Power Bi, Sql, Azure Data Factory, Databricks, Mosaic AI, Cost Optimization for Databricks, Performance Optimisation of DLT Pipelines, Medallion Architecture, Delta Live Tables, CI CD, Asset Bundle, LLMs, Logic Apps, AI GenAI-driven Innovation, Gen AI Genie, Agents, Structured Live Streaming, GitHub CoPilot, Unity Catalog, ADLS, Photon Serverless
6-8 yrs
Bengaluru, India
Skills:
Hive, Hadoop, Azure, Sql, Python, AWS, Airflow
6-12 yrs
Kolkata, India
Skills:
Aws Services, Postgresql, Pyspark, Databricks, MongoDB, Python, Step Functions, Lambda Functions
5-8 yrs
Bengaluru, India
Skills:
snowflake , Apache Airflow, Data Modelling, Python, Sql, AWS – Glue, dbt, CI CD