Data/ETL Engineer

Job Title: Data/ETL Engineer

Experience: 4 - 6 years

Mode of Interview: In-Person

Notice: Immediate

Mandatory Skills: Abinitio, Snowflake Cloud DB, Python, Spark, Scala, PySpark, AWS service

Job Description

Our Team delivers data that powers Analytics, Data sciences, Marketing, ML and multiple other teams across the companies and offices that make up the PlayStation business: high quality, valuable to the user, accessible, and continuously improving.

Description

We are looking for a Data engineer to join the Player DE team within the Sony PlayStation environment.

A Data engineer is required to work within the Data Management team with the successful applicant responsible for the design, development and maintenance of the data processing platform. They will be required to fit into a highly skilled team and work with limited supervision, under their own initiative.

Our team provides data services for various global business units associated with Sony PlayStation.

Responsibilities

• Engineer data pipelines and provide automated solutions for DE teams
• Work proactively to address project requirements, and articulate issues challenges with enough lead time to address project delivery risk
• System monitoring and alerting, dashboards, charts/reports and alerts delivery
• Ensure code is fully scalable, maintainable, and performant
• Verifies program logic by overseeing the preparation of test data, testing and debugging of programs
• Work with Project Managers and TPM to ensure the timely delivery of project deliverables that meet requirements
• Requires ability to work in a global and multi-cultural environment. Team members are in multiple geographies, resulting in time constraints due to time zones differences and a requirement for occasional travel
• Participate in the agile development process
• Develops new documentation, departmental technical procedures and user guides

Experience

• BS Degree in Engineering or Masters, Computer Science or equivalent experience
• 4-6 years of experience in database development, programming, design, and analysis
• 2+ years of experience in coding and scripting languages - Java, Python, JavaScript, bash, batch files, Korn.
• 1 years of experience with Spark, Scala, PySpark.
• 4-6 year of experience with data and ETL programming (Abinitio)
• 3-6 years of experience in SQL and a variety of database technologies – Snowflake, Teradata and Oracle.
• 1+ years of experience in No SQL DB (dynanmo DB, Cassandra)
• Good technical analysis & troubleshooting skills
• Experience in designing and architecting medium to complex systems, well versed with design standards & framework
• General knowledge in Linux, Unix Administration and Windows Administration
• Knowledge of Dimensional Modelling
• 1+ year of experience with streaming services – Flink, Kafka
• Experience with automation, configuration management, orchestration, enterprise schedulers
• 1+ years of experience with AWS services (EKS, S3, EC2, Kinesis, DynamoDB, Glue, Deequ, etc.,)

Skills Required (essential):

• Demonstrable experience in developing large-scale data processing platforms
• Extensive experience throughout the software development lifecycle
• Interpersonal skills including presentation, negotiating, conflict resolution, etc.
• Strong communication skillsets. It is vital that the successful candidate can explain complex technical issues in non-technical terms to business stakeholders
• Ability to multi-task and priorities within parallel development cycles and aggressive timelines
• Knowledge and experiences of SDLC methodologies e.g. Agile, Waterfall
• Strong troubleshooting and problem-solving ability
• Skilled in business requirements analysis with ability to translate business information into technical specifications
• Eager to learn

Skills Required (desirable):

Knowledge of data warehouse appliances, e.g. Snowflake, Abinitio, Python, Scala, AWS

Education Qualification

● B.S./B.A. in Computer Science, Information Systems, Electrical/Computer Engineering or equivalent experience preferred

● Technical certifications preferred (AWS, Linux, Windows, Atlassian, etc.,)