As a valued member of Opera's Engineering Team, you will work alongside ambitious and driven engineers and team members across the globe who are committed to solving the hard challenges present today in the DevOps space and pioneering new concepts and capabilities around Artificial Intelligence in a field ripe with potential. You'll contribute to fast-paced cycles of innovation and develop new user experiences, industry-defining insights and analysis standards in the DevOps space.
As an Experienced Data Engineer, you will be at the forefront of our data engineering efforts, responsible for ensuring the performance, reliability, and efficiency of our data ecosystem. Your expertise will be crucial in optimising existing queries, designing and modeling data structures, and collaborating closely with cross-functional teams to drive data-related initiatives. Your proactive approach, problem-solving skills, and deep knowledge of Big Data, Spark, Python & SQL databases will directly contribute to our success.
Responsibilities
- Partner with product teams, data analysts and engineering teams to build foundational data sets that are trusted, well understood, and aligned with business strategy.
- Translate business requirements into data models that are easy to understand and used by different subject areas.
- Design, implement and build data models and pipelines that deliver data with measurable quality under the SLA.
- Identify, document and promote data engineering standard methodologies.
Requirements
- Minimum 5 years of experience working in data engineering, data analysis and data modelling.
- Must have experience in working on data engineering elements in Databricks.
- A consistent track record in scaling and optimising schemas, performance tuning SQL and ELT/ETL pipelines in OLAP and Data Warehouse environments.
- Deep understanding of Spark architecture and its components.
- Proficiency in coding through the use of SQL, Spark and Python.
- Troubleshooting Spark jobs & effectively handling issues on the same.
- Familiar with data governance frameworks, SDLC, and Agile methodology.
- Excellent written and verbal communication and interpersonal skills, and the ability to efficiently collaborate with technical and business partners.
- Bachelor's degree in computer science, Engineering or a related field, equivalent training, fellowship, or work experience.
- Understanding of ML, DL and Agentic AI would be preferred.
Bonus Points
- Familiarity with DevOps processes and practices.
- Experience working with cloud technologies such as AWS, GCP or Azure.
- Hands-on experience with NoSQL Data Stores (MongoDB).
- Hands-on experience with Spark SQL and Big Data.
- Experience around Batch and Real-time processing.
- AI technologies and understanding of ML and LLMs.
This job was posted by Kl Narasimhan from Opsera.
