Data Engineer

Role: Data Engineer

Experience: 5+ years

Notice Period: Immediate to 30 days

Location: Bengaluru

Job Description:

Key responsibilities include:

Refactor and build reusable data pipelines in AWS and Databricks.

Collaborate with business analysts, data scientists, architects, developers, and business stakeholders to deliver fit-for-purpose solutions.

Develop cloud-based solutions for data lakes, data warehouses, ETL processes and backend services for structured, and unstructured data.

Participate in code reviews and documentation efforts.

Optimize pipelines for cost, scalability, reliability and security

Implement rigorous testing and monitoring protocols.

Resolve performance bottlenecks and optimize workloads.

Stay current with data engineering trends and apply them where relevant.

Education and experience:

Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.

5+ years of experience in data engineering, data analytics and backend services.

Hands-on experience with AWS Cloud and Databricks

Proficiency across multiple execution and query paradigms, including:

o Event-driven and orchestration workflows for serverless computing (AWS Lambda, Step Functions)

o General-purpose and scripting languages for automation and data processing (Python, Bash, Make)

o Query languages for structured and semantic data (SQL, SPARQL).

Solid understanding of multiple data paradigms, including

o Relational data for structured storage and analytics (AWS Redshift)

o Key-value and document-oriented models for high-performance transactional workloads (DynamoDB)

o Object storage for semi-structured data and large-scale lakes (AWS S/3)

o Graph-based data models for relationship-driven queries and semantic structures (AWS Neptune)

GIT and CI/CD experience required; GitLab preferred

Infrastructure as Code experience required; AWS CDK preferred

Experience with Gitlab for Version Management, CI/CD and CDK for Infra as Code.

Skills

Working at the cutting edge of tech, you'll always have new challenges and new problems to solve and working together is the only way to do that. You won't work in a silo. Instead, you'll be part of a creative, dynamic work environment where you'll collaborate with supportive colleagues. There is always space for creative and unique points of view. You'll have the flexibility and trust to choose how best to tackle tasks and solve problems.

To thrive in this job, you'll need the following skills:

Passion for data engineering and solving real-world problems.

Customer-centric mindset and value-driven approach.

Strong analytical and problem-solving capabilities.

Excellent collaboration and communication skills.

Familiarity with agile and scrum methodologies.

Proactive attitude toward continuous improvement.