Software Engineer
Software Engineer
adaThis job is no longer accepting applications
Job Description
About The Role
We are looking for a Software Engineer – Data Engineering to design, build, and maintain robust, scalable, and high-performance data infrastructure. In this role, you will work on end-to-end data pipelines, ensuring reliable data availability for analytics, machine learning, and business applications.
Key Responsibilities
Data Pipeline Development:
Design, implement, and optimize ETL/ELT pipelines for structured and unstructured data.
Integrate data from multiple internal and external sources into centralized systems.
Build scalable batch and real-time data processing workflows.
Data Infrastructure & Architecture:
Develop and maintain data lake, data warehouse, or data mesh architectures.
Ensure high availability, performance, and scalability of data systems.
Implement data modeling best practices to support analytics and ML use cases.
Software Engineering:
Write clean, efficient, and maintainable code in Python, Java, or Scala.
Implement unit tests, integration tests, and CI/CD pipelines for data workflows.
Apply software engineering principles to build reusable data services and APIs.
Data Quality & Governance:
Implement validation, monitoring, and observability to ensure data accuracy and reliability.
Enforce data security, compliance, and privacy standards (e.g., GDPR).
Collaborate with stakeholders to establish data definitions, lineage, and documentation.
Requirements
Bachelor's or Master's degree in Computer Science, Engineering, or related field.
2–4 years of experience in data engineering, software engineering, or backend systems.
Strong programming skills in Python, Java, or Scala.
Experience with distributed data processing frameworks (Apache Spark, Flink, Beam, or similar).
Proficiency with SQL and relational databases; familiarity with NoSQL systems (Cassandra, MongoDB, DynamoDB).
Hands-on experience with cloud platforms (AWS, GCP, Azure) and data services (e.g., Redshift, BigQuery, Snowflake, Databricks).
Familiarity with workflow orchestration tools (Airflow, Luigi, Dagster) and CI/CD pipelines.
Solid understanding of software engineering best practices (version control, testing, code reviews).
We are looking for a Software Engineer – Data Engineering to design, build, and maintain robust, scalable, and high-performance data infrastructure. In this role, you will work on end-to-end data pipelines, ensuring reliable data availability for analytics, machine learning, and business applications.
Key Responsibilities
Data Pipeline Development:
Design, implement, and optimize ETL/ELT pipelines for structured and unstructured data.
Integrate data from multiple internal and external sources into centralized systems.
Build scalable batch and real-time data processing workflows.
Data Infrastructure & Architecture:
Develop and maintain data lake, data warehouse, or data mesh architectures.
Ensure high availability, performance, and scalability of data systems.
Implement data modeling best practices to support analytics and ML use cases.
Software Engineering:
Write clean, efficient, and maintainable code in Python, Java, or Scala.
Implement unit tests, integration tests, and CI/CD pipelines for data workflows.
Apply software engineering principles to build reusable data services and APIs.
Data Quality & Governance:
Implement validation, monitoring, and observability to ensure data accuracy and reliability.
Enforce data security, compliance, and privacy standards (e.g., GDPR).
Collaborate with stakeholders to establish data definitions, lineage, and documentation.
Requirements
Bachelor's or Master's degree in Computer Science, Engineering, or related field.
2–4 years of experience in data engineering, software engineering, or backend systems.
Strong programming skills in Python, Java, or Scala.
Experience with distributed data processing frameworks (Apache Spark, Flink, Beam, or similar).
Proficiency with SQL and relational databases; familiarity with NoSQL systems (Cassandra, MongoDB, DynamoDB).
Hands-on experience with cloud platforms (AWS, GCP, Azure) and data services (e.g., Redshift, BigQuery, Snowflake, Databricks).
Familiarity with workflow orchestration tools (Airflow, Luigi, Dagster) and CI/CD pipelines.
Solid understanding of software engineering best practices (version control, testing, code reviews).
More Info
Key Skills
About Company
Skills:
Github, PowerShell, Prometheus, Bash, Grafana, Devops, Terraform, Docker, Ansible, Splunk, Puppet, Kubernetes, Python, AWS, Chef, GitHub Actions, Atlassian Jira Cloud, Confluence Cloud
Skills:
Java, Hibernate, Performance Tuning, C++, Agile Methodology, Debugging, Spring Boot, Visual Studio, Jsp, Rest Api, JIRA, React Js, Jenkins, Devops, Git, Xsl, Node JS, Shell scripting, Azure, Python, AI/ML concepts, CLI development
Skills:
Java, Solr, Graphql, Maven, Kafka, Spring Boot, Sql, Redis, Spring, Memcached, Nosql, Jenkins, Git, Mockito, JUnit, Gradle, Docker, Elasticsearch, Kubernetes
Skills:
Docker, Python, Kubernetes, LangChain, Reusable workflow components, Go, Cloud AI services, Tracing evals and regression testing, Tool and API orchestration, Memory state management, MCP, RAG pipelines, Prompt templates
Skills:
PostgreSQL, Spring Boot, Kafka, Angular, Nosql, React, Docker, Terraform, MySQL, Openshift, AWS, Java, Hibernate, Sql, Rabbitmq, Git, Gcp, Ansible, MongoDB, Azure, Kubernetes, Infrastructure as Code, Microservices architectures, GraphQL APIs, CI/CD