

Search by job, company or skills

Operational skills relevant for this job:
Strong communication skills, both written and verbal to effectively engage with team and individuals involved in the project.
Strong analytical abilities and attention to detail.
Experience with collaborative development methods such as mob or ensemble programming.
Experience relevant for this job:
Proficiency in SQL and programming languages like Python, PySpark
Working knowledge of ETL and ELT frameworks and orchestration tools like Airflow and dbt
Experience working with cloud data platforms e.g. Azure Databricks, Snowflake or BigQuery
Knowledge of data lakes and data warehouses concepts and distributed systems like Kafka, Spark etc.,
Familiarity of Docker, Kubernetes, CI/CD, Terraform
Knowledge of cybersecurity principles and practices
Data Architecture: Support
the design, build and management of realtime, near
realtime and batch data architectures that support threat detection, incident
response and reporting through advanced analytics, machine learning and GenAI capabilities.
Data Integration and Transformation: Implement
and manage the automated frameworks for integrating the data from various security
sources into the security data lake. Also, the data transformation frameworks
to move data between the raw, trusted, and curated data layers.
Coding and Documentations: Contribute to raising the quality bar of
the team's codebase by producing high-quality code and documentation of data
platform architecture, process and best practices.
Automation and DevOps: Implement various automations
and DevOps practices to streamline the deployment, configuration, and
management of data platform components.
Collaboration
and Communication: Collaborate and
communicate effectively with members of the team and actively participate in
resolving issues related to data platform operations, providing support as
needed.
Proficiency in SQL and programming languages
like Python, PySpark
Working knowledge of ETL and ELT frameworks and
orchestration tools like Airflow and dbt
Experience working with cloud data platforms
e.g. Azure Databricks, Snowflake or BigQuery
Knowledge of data lakes and data warehouses
concepts and distributed systems like Kafka, Spark etc.,
Familiarity of Docker, Kubernetes, CI/CD, Terraform
Job ID: 152712355
Skills:
Scala, Apache Spark, Data Quality, Databricks, Data Governance, Azure DevOps, Logging, Alerting, Security, Cloud Platforms, GitHub Actions, Monitoring
Skills:
Java, Github, Kafka, Performance Testing, Jenkins, Git, Azure Cloud, Mockito, Docker, Sqlite, MySQL, Postgres, MongoDB, Couchbase, Kubernetes, Azure DevOps, JUnit5, Micronaut, Spring 5, Contract Testing
Skills:
Golang, PostgreSQL, Kafka, Spring Boot, Microservices, Software Architecture, RDBMS, Design Patterns, Aws Ec2, Python, Api Gateway, Java, Artificial Intelligence, Big Data, Hazelcast, Redis, Rabbitmq, Django, ECS, Sqs, Asynchronous programming, GenAI tools, Domain-Driven Design, pub-sub technologies, caching tools, Cognito, DevOps practices, NoSQL databases, CQRS, unit and integration test cases
Skills:
Java, Scala, Apache Spark, Kafka, Databricks, Python, AirFlow, Hive SQL, AWS EMR, Big Data ecosystems, GCP BigQuery
Skills:
Algorithms, Nodejs, Ml, Java, Agile Methodologies, AWS, MySQL, Python, Golang, Elasticsearch, Nlp, MongoDB, data structures, CI CD tools, Cloud Platform services