Skill: Azure Architect, Kafka, Spark, Casandra, CICD, Dynatrace
Experience: 13 to 19 years
Location: Bangalore
Job Summary
We are seeking an experienced Architect with 13 to 19 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. This hybrid role offers the opportunity to work on cutting-edge projects during day shifts with no travel required. The Architect will play a crucial role in designing and implementing data solutions that drive our company's success.
Responsibilities
- Design and implement scalable data architectures using Databricks SQL and Databricks Workflows to meet business requirements.
- Collaborate with cross-functional teams to gather and analyze data requirements ensuring alignment with organizational goals.
- Develop and optimize PySpark scripts to process large datasets efficiently enhancing data processing capabilities.
- Ensure data quality and integrity by implementing robust data validation and cleansing processes.
- Provide technical guidance and support to team members fostering a collaborative and innovative work environment.
- Monitor and troubleshoot data workflows to ensure seamless operation and minimal downtime.
- Stay updated with the latest industry trends and technologies to continuously improve data architecture solutions.
- Contribute to the development of best practices and standards for data management and analytics.
- Work closely with stakeholders to understand their data needs and deliver actionable insights that drive decision-making.
- Implement security measures to protect sensitive data and ensure compliance with relevant regulations.
- Optimize data storage and retrieval processes to enhance system performance and efficiency.
- Document data architecture designs and processes for future reference and knowledge sharing.
- Participate in code reviews and provide constructive feedback to improve code quality and maintainability.
Qualifications
- Possess strong expertise in Databricks SQL and Databricks Workflows with a proven track record of successful implementations.
- Demonstrate proficiency in PySpark with the ability to write and optimize complex scripts.
- Exhibit excellent problem-solving skills and the ability to work independently and collaboratively.
- Have a solid understanding of data modeling ETL processes and data warehousing concepts.
- Show experience in working in a hybrid work model effectively managing time and priorities.
- Display strong communication skills with the ability to convey technical concepts to non-technical stakeholders.
- Hold a bachelors degree in computer science information technology or a related field.
