Search by job, company or skills

Data Engineer

Data Engineer

Softility Inc.,
3-5 Years
Not Disclosed
Early Applicant
  • Posted a month ago
  • Be among the first 30 applicants

Job Description

Job Type: Full Time
Locations: Hyderabad - India

Employment Type :
Full-time

Experience :
4-7 Years

Overview:

Data Engineer with strong DevOps and analytical skills to design, build, and maintain scalable data pipelines for financial data. This role supports Engineering, Operations and analytics teams by delivering high-quality, reliable datasets and automated workflows.

Key Responsibilities:

  • Build and maintain ETL/ELT pipelines for financial datasets.
  • Develop data pipelines and optimized structures for analytics and reporting.
  • infrastructure-as-code, and pipeline monitoring (DevOps/DataOps).
  • Ensure data quality, lineage, and governance across platforms.
  • Collaborate with Engineering, Operations and Analytics teams to support reporting and insights.
  • Optimize pipeline performance, reliability, and cloud resource usage for cost optimization.

Required Qualifications:

  • Masters degree in computer science, Data Engineering, Information Systems, or related field.
  • 3-5 years of hands-on experience in data engineering.
  • Strong SQL and Python experience with Spark or equivalent.
  • Experience with cloud data platforms (Spanner, BigQuery, Redshift, or similar).
  • Proficiency with DevOps tools (Git, CI/CD pipelines, Terraform/IaC).
  • Experience with orchestration tools (Airflow, Pentaho).
  • Understanding of financial datasets and domain concepts.
  • Knowledge of data quality/observability tools.

More Info

Job Type:
Employment Type:

Key Skills

About Company

Similar Jobs

5-7 yrs
Hyderabad, India
Skills:
Power Bi, PowerShell, Azure Data Factory, Azure Synapse Analytics, Dax, Python, Azure DevOps, Azure Blob Storage, CI CD processes, Azure Data Lake Storage, Azure Analysis Services, Azure Data Catalog, Azure Data Services
3-5 yrs
Hyderabad, India
Skills:
graph databases , object storage , S3, Golang, C#, AWS Glue, Data Modeling, Nosql, Lambda, Kinesis, Ruby, Oracle, Python, Java, Rust, C++, Emr, Redshift, Non-relational databases, Data stores, IAM roles and permissions, ETL pipelines, FireHose, AWS technologies, Key-value stores, Column-family databases
5-7 yrs
Hyderabad, India
Skills:
Git, Pyspark, Spark, Databricks, Sql, Python, Azure DevOps, AWS, dbt
5-7 yrs
Hyderabad, India
Skills:
Pyspark, Azure Data Factory, Apache Kafka, Python, Sql, Azure DevOps, Azure Databricks Unity Catalog Delta live tables, Azure cloud data services technologies, Logging and Monitoring using Azure Databricks services
7-9 yrs
Hyderabad, India
Skills:
Apache Spark, Kafka, Apache Airflow, Pandas, Elasticsearch, MongoDB, pgvector, Polars, Qdrant, Vector databases, NoSQL databases, Data models and storage architectures, Distributed data systems, Data processing performance and optimisation, Data pipelines, Milvus