Key Responsibilities:
As a Principal Engineer for the data engineering, you will:
- Influence and contribute to engineering initiatives and practices at the enterprise (Target Tech) level
- Optimize data platform performance, provide expertise on choosing right tools, technologies and lead architecture of automated, scalable, resilient and self-healing data platform.
- Explore ways to enhance quality, reliability and ensure excellence in the end-to-end delivery of complex engineering solutions
- Collaborate with other engineers across products and data scientists to continually improve the development standards and practices at data engineering and larger Target Tech
- Be a thought leader and mentor for internal and external technical talent and actively contribute to the external technical community
- Work with engineering leaders to build a high performing engineering team and provide technical leadership, coaching, motivation and participate in the selection of technical talent.
- Work closely with our product, UX, platform and data teams to implement an intuitive, coherent, and engaging user experience
- Manage complex cross-team coordination and dependencies
- Ensure high quality, stable, and performant code
- Perform code and design reviews that guarantee code quality
- Evaluate and communicate different engineering solutions and trade-offs
- Develop clean, well-tested code to deliver functionality that meets business objectives
- Identify long-term tech opportunities that bring value and develop a roadmapfor future work to ensure continued product health and innovation
- Identify opportunities to perform or lead POC/POT with our teams
About you:
- 4-year degree or equivalent.
- 15+ years of experience in technology development or services, including deep expertise in data modelling, pipeline development, with a focus on Spark, Scala, Python/Java and associated libraries and frameworks.
- 4+ years of experience in strategic planning and setting technical direction.
- Deep understanding of data architecture patterns, data governance, best practices, testing and performance optimization techniques.
- Expertise in open source technologies like Hadoop, public Cloud platforms, database fundamentals, dev ops practises and performance tuning
- Lead and mentor a team of data engineers, providing technical guidance and fostering a collaborative and innovative environment.
- Drive the technical roadmap for the data platform, making strategic decisions to enhance performance, maintainability, and scalability.
- Conduct code reviews and provide constructive feedback to ensure code quality, maintainability, and adherence to coding standards.
- Stay up-to-date with the latest data technologies, tools, and trends, and evaluate their potential application within the organization.
- Collaborate with cross-functional teams to identify and address technical challenges and optimize development processes.
- Actively participate in architectural discussions, providing valuable insights and advocating for best practices.
- Lead by example, demonstrating a strong work ethic, excellent problem-solving skills, and a commitment to continuous learning.
