Data Platform Engineer

Role Purpose

A result-oriented Software Developer to develop solutions powered by Fujitsus new processor, which helps solve real-world challenges facing society and businesses across different industries. As a software developer, you are passionate about developing solutions and should be comfortable with back-end coding languages, technologies, frameworks and third-party/opensource libraries. You will play a role in developing innovative advanced solutions and services to support business outcomes.

Responsibilities

• Improve and analyze performance of software applications.
• Enable and optimize OSS/ISV applications for Fujitsus new processor, starting with AI and Big Data Analytics-related applications.
• Develop new algorithms for Big Data Analytics frameworks, tuning technologies and work on software based on the proposed approaches using Big Data engineering.
• Designing and developing data analysis workflows, applications, effective APIs and the system architectures
• Deploying and Testing applications to ensure functionality, performance, responsiveness, and efficiency.
• Creating test cases, test plans and automated test scripts for unit tests
• Troubleshooting, debugging, and fixing bugs and upgrading software/applications.
• Creating security and data protection settings and measures
• Writing technical documentation
• Working and communicating well with product managers, business analysts, and data scientists, and other software developers to collaborate, review and deliver high quality applications.
• Learning continually, sharing knowledge, and fostering exchange of skills
• Working using agile methods (planning meetings, review meetings, standup meetings, development, etc.)
• Working on multiple projects at once while keeping focused on project timeline

Experience

You will be able to demonstrate that you have:

• Degree in computer science or relevant field
• Proven experience as a software developer or similar role, and familiarity with common stacks for software applications using Data analytics technologies.
• Minimum 4 years experience in production application/solution development
• Experience in Big Data using Databricks, PySpark etc. and statistical analysis with Data Analytics tools and technologies.  
• Experience with Data Intelligence Platforms, Large Scale Distributed processing with Spark
• Understanding of Java, JVM, VectorAPI, HotSpot, JNI, Vectorization techniques & SIMD optimization
• Knowledge of Spark Accelerator frameworks like Comet, Velox, TrinoDB, ClickHouse etc.
• Knowledge of ETL (AWS Glue, etc.) & database (RDB, Vector DB, etc.)
• Knowledge related to DWH Ecosystem (Palantir, Snowflake, Databricks, BigQuery, Redshift, etc.)
• Experience with SQL/Postgres SQL/Python data processing with SW Development Skills in Java/C++/Scala (especially Java)
• Experience in data analysis using parallel processing. (Apache Spark, PySpark etc.)
• In depth understanding and knowledge of the specified data analytic tools and technologies with Framework engineering experience.
• Proficiency with fundamental back-end server-side languages such as Python, C/C++, etc.
• Knowledge of OSS as an alternative to cloud computing for each layer
• Excellent writing, verbal communication, and teamwork skills
• Experience in Big Data using Databricks, PySpark etc. and statistical analysis with Data Analytics tools and technologies.  
• Experience in software development in agile approach
• Excellent writing, verbal communication, and teamwork skills

Preferred Experience

You will be able to demonstrate that you have:

• Experience in developing and deploying APIs.
• Preferred experience in performance tuning & optimization techniques for Data Analytics tools, SQL, and NoSQL databases.
• Knowledge and experience in Cloud service (Azure/AWS) features such as Functions, VM, Container, DevOps (CI/CD)
• Great skills in evaluating performance and security of software applications and delivering solutions which are efficient and performant.
• HPC and computer architecture understanding.
• Skills in AI-related technology

Role: Data Platform Engineer

Industry Type: Analytics / KPO / Research

Department: Engineering - Software & QA

Employment Type: Full Time, Permanent

Role Category: Software Development

Education

UG: B.Tech/B.E. in Any Specialization