Search by job, company or skills

V

Data Engineer- Airflow

5-7 Years
Save
new job description bg glownew job description bg glow
  • Posted 21 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Data Engineer- Airflow

Location: HYD Campus, Hyderabad

Years of Experience: 5-7 Years

Job Summary: We are seeking a skilled Software Development Engineer with strong experience in Apache Airflow and proficiency in Python. The ideal candidate will have a solid understanding of ETL/ELT concepts and data pipeline architecture, along with experience in SQL and relational databases. Familiarity with cloud platforms, particularly Amazon Web Services, is essential. This role requires a detail-oriented individual who can design and implement robust data solutions.

Responsibilities

  • Design, develop, and maintain data pipelines using Apache Airflow.
  • Implement ETL/ELT processes to ensure efficient data flow and transformation.
  • Collaborate with data engineers and analysts to optimize data architecture.
  • Write and optimize SQL queries for data retrieval and manipulation.
  • Deploy and manage data solutions on cloud platforms, primarily AWS.
  • Ensure data quality and integrity throughout the data lifecycle.
  • Document processes and maintain technical specifications.

Mandatory Skills

  • Strong experience with Apache Airflow.
  • Proficiency in Python programming.
  • Solid understanding of ETL/ELT concepts and data pipeline architecture.
  • Experience with SQL and relational databases.
  • Familiarity with Amazon Web Services (AWS).
  • Experience with Snowflake is a deal breaker.

Preferred Skills

  • Knowledge of data warehousing concepts.
  • Experience with data visualization tools.
  • Familiarity with containerization technologies (e.g., Docker).

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 5-7 years of relevant experience in software development and data engineering.
  • Strong analytical and problem-solving skills.
  • Excellent communication and teamwork abilities.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 148315817

Similar Jobs

Hyderabad, India

Skills:

snowflake S3HadoopPower BiPysparkKafkaTableauRedshiftSqlLambdaDatabricksAWSEtlAirflowGlue

India

Skills:

data engineering Apache AirflowSSISSqlPythondbtGo

Bengaluru, India

Skills:

snowflake PostgreSQLPrometheusKafkaGrafanaApache AirflowTerraformMySQLShell scriptingPythonAzure DevOpsAWSJavaScalaSqlJenkinsGitCloudwatchPrestoSparkKubernetesGitHub ActionsdbtDataOps toolsGitLab CI

Hyderabad, India

Skills:

JavaElkHadoopCloudformationPostgreSQLPrometheusApache SparkGrafanaPulumiDatadogApache AirflowJenkinsRESTDockerTerraformMySQLKubernetesPythonAWS EMRGRPCGitLab CIGitHub Actions

Chennai, India

Skills:

distributed architecture object storage KshLINUXSqlELTPythonEtlAirflowCFTStarburstTrino