Search by job, company or skills

Data Engineer

Data Engineer

Qentelli
4-9 Years
Not Disclosed
Quick Apply
  • Posted a month ago
  • Over 200 applicants have applied

Job Description

We are looking for a skilled Data Engineer with strong experience in Python and AWS cloud technologies. The ideal candidate should have hands-on knowledge of building automation frameworks, managing test scripts, and working with various AWS services. This role requires good technical understanding, strong problem-solving skills, and the ability to work closely with cross-functional teams to ensure high-quality product delivery.

Roles and Responsibilities:

  • Work closely with business stakeholders, Business Systems Analysts, and Developers to support application delivery.
  • Build robust and scalable automation frameworks using Python.
  • Design and manage test scripts using Python during development and execute them post-deployment.
  • Develop automated test cases using tools like TestNG and Spring Boot Test.
  • Support and maintain GitLab pipelines for continuous integration and deployment.
  • Monitor and troubleshoot automation issues, guiding developers and teams when needed.
  • Actively participate in root cause analysis, code debugging, and issue resolution.

Required Skills and Qualifications:

  • Strong hands-on experience in Automation Engineering with Python.
  • Proficient in AWS cloud services such as S3, Lambda, DynamoDB, DocumentDB, CloudWatch, and Kafka.
  • Good working knowledge of Python libraries like pytest and boto3 client.
  • Experience in developing automated test cases using TestNG and Spring Boot Test.
  • Familiarity with GitLab CI/CD pipelines.
  • Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent practical experience)

Preferred Skills:

  • Excellent communication skills and the ability to work with cross-functional teams.
  • Self-driven and capable of taking ownership with minimal supervision.
  • Able to guide developers and team members in solving automation-related issues.
  • Strong analytical skills for problem-solving, troubleshooting, and debugging.

Key Skills

About Company

Similar Jobs

6-14 yrs
Hyderabad, India
Skills:
Data Factory, Pyspark, Sql, Azure Sql, Devops, Databricks, Azure, Python, Etl, Data Ingestion Processing, CI CD, Data Pipeline Development, ADLS
8-10 yrs
Hyderabad, India
Skills:
snowflake , Data Management, Hadoop, Performance Tuning, Data Modeling, Dimensional Modeling, Redshift, Sql, Data Quality, Hive, Spark, Data Integration, Python, Airflow, big data systems, data warehouse scaling, ETL pipelines
4-6 yrs
Hyderabad, India
Skills:
Shell scripting (Bash), SQL Server, Data Warehousing, Sql, Git, Terraform, Docker, Data Modelling, Python, Kubernetes, GNU Linux, ETL/ELT pipelines, Azure Platform, CI/CD
3-5 yrs
Hyderabad, India
Skills:
Pyspark, PostgreSQL, Tableau, ELT, Pytorch, MySQL, Python, AWS, Cloudformation, Scala, Redshift, Sql, Pandas, Presto, Databricks, Etl, AWS Data engineering ecosystem, R, AWS data services, lakeformation, GitHub Workflows, boto3, Cloudera Data Platform, Athena
5-10 yrs
Hyderabad, India
Skills:
monte carlo , snowflake , Azure, Python, Sql, Azure DevOps, GitHub Actions, dbt, Fivetran, Atlan, Immuta