Search by job, company or skills

Senior Data Engineer

Early Applicant
  • Posted 2 months ago
  • Be among the first 30 applicants

Job Description

We are looking for an experienced Data Engineer with strong expertise in designing, building, and maintaining scalable data platforms. The ideal candidate should have hands-on experience in data modeling and developing end-to-end ETL pipelines using AWS services. You will work extensively with AWS Glue and AWS DMS for data integration and migration, and manage data stored in Snowflake, Oracle, and AWS RDS.

The role requires strong programming skills in Python and PySpark to process large-scale datasets efficiently. Candidates should be proficient in SQL for data analysis, transformations, and performance tuning. Experience with DBT for data transformations and maintaining analytics-ready datasets is highly desirable.

You should have exposure to CI/CD pipelines, GitLab, and version control best practices to support automated deployments and collaborative development. The role involves working closely with cross-functional teams to ensure data quality, optimize performance, and deliver reliable data solutions aligned with business requirements. Strong problem-solving skills and experience in cloud-based data engineering environments are essential.

Requirements

Data Modelling, Glue, DMS, Snowflake, Oracle, Python, PySpark, CI/CD, DBT, Gitlab, AWS RDS, ETL Pipeline, SQL

More Info

Job Type:
Industry:
Employment Type:

Job ID: 145221181

Similar Jobs

Hyderabad, India

Skills:

Data ArchitectureData IntegrationSqlELTEtlData Warehousing ConceptsDatabase Management Systemslarge-scale data managementcloud-based data servicesdata quality managementvalidation frameworksmonitoring solutionsdistributed data processing environments

Hyderabad, India

Skills:

PysparkDatabricksPythonSqlData ModelingData WarehousingData lake architectures

Hyderabad, India

Skills:

Regression TestingApi TestingData TestingPython

Hyderabad, India

Skills:

PysparkAzure DatabricksSqlClustersKubernetesPythonRBAC configurationAbility to debug and optimize PySpark SQL codeProgramming Data Processing using ScalaDatabricks Platform ExpertiseUnity CatalogAzure ServicesExperience in AWS using DockerCI CD with Azure DevOpsJobsSecure Coding principles in DatabricksBlob StorageData Governance and Compliance standardsNotebooksDelta LakeApache Spark optimization techniquesHelm framework

Hyderabad, India

Skills:

snowflake DatabricksPythonPytorchAWSTensorflowRbioinformatics toolsETL processesdocument miningdata imputationdata management expertiseHPC cloud AWS workflowsCLI shell scriptingDevOps MLOps