A
Data Platform Engineer
Job Description
Project Role : Data Platform Engineer
Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.
Must have skills : Databricks Unified Data Analytics Platform
Good to have skills : NA
Minimum 3 Year(s) Of Experience Is Required
Educational Qualification : 15 years full time education
Summary:
As a Data Platform Engineer, a typical day involves contributing to the development and refinement of the data platform blueprint and design, ensuring that all components align effectively. This role requires close collaboration with Integration Architects and Data Architects to maintain seamless integration across various systems and data models. The position demands a proactive approach to coordinating efforts that support the overall data infrastructure, fostering a cohesive environment where data flows efficiently and supports organizational needs.
Roles & Responsibilities:
Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.
Must have skills : Databricks Unified Data Analytics Platform
Good to have skills : NA
Minimum 3 Year(s) Of Experience Is Required
Educational Qualification : 15 years full time education
Summary:
As a Data Platform Engineer, a typical day involves contributing to the development and refinement of the data platform blueprint and design, ensuring that all components align effectively. This role requires close collaboration with Integration Architects and Data Architects to maintain seamless integration across various systems and data models. The position demands a proactive approach to coordinating efforts that support the overall data infrastructure, fostering a cohesive environment where data flows efficiently and supports organizational needs.
Roles & Responsibilities:
- Expected to perform independently and become an SME.
- Required active participation/contribution in team discussions.
- Contribute in providing solutions to work related problems.
- Collaborate with cross-functional teams to ensure alignment of data platform components with business requirements.
- Assist in troubleshooting and resolving issues related to data platform integration and performance.
- Support continuous improvement initiatives by identifying opportunities to optimize data workflows and platform capabilities.
- Document processes and best practices to facilitate knowledge sharing within the team.
- Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform.
- Experience with cloud-based data storage and processing solutions.
- Strong understanding of data integration techniques and data modeling concepts.
- Familiarity with scripting and automation to streamline data platform operations.
- Ability to analyze and optimize data pipelines for performance and scalability.
- The candidate should have minimum 3 years of experience in Databricks Unified Data Analytics Platform.
- This position is based at our Chennai office.
- A 15 years full time education is required.
More Info
Key Skills
data modeling concepts
Databricks Unified Data Analytics Platform
data integration techniques
scripting and automation
cloud-based data storage and processing solutions
About Company
Skills:
graph databases , Cloud-based data platforms and services, Data integration tools and methodologies, Data modeling techniques
Skills:
Python, Advanced Sql, CDC and incremental processing, Java or Scala preferred, Dataflow batch streaming pipelines, BigQuery advanced optimization and tuning, Scripting and automation, Batch and streaming data processing, IAM Security controls, Data modeling and warehousing principles, Data lakehouse architecture concepts, ETL ELT pipeline design and implementation, Google Cloud Platform GCP, Data ingestion frameworks config-driven approach preferred, Cloud Storage GCS, Dataform SQL-based transformations, Dataplex Data Catalog, Analytics Hub data sharing, Pub Sub event-driven architectures, Cloud Monitoring Logging