Data Technology Index Engineer

MSCI Services is looking for a Data Technology Index Engineer to join our Data Technology team in Hyderabad, Telangana, India. Our team is responsible for fulfilling the diverse data requirements across various business areas, including Index, Analytics, and Sustainability. We collate data from multiple sources such as vendors (e.g., Bloomberg, Reuters), website acquisitions, and web scraping (e.g., financial news sites, company websites, exchange websites, filings). This data can be in structured or semi-structured formats. We then normalize the data, perform quality checks, assign internal identifiers, and release it to downstream applications.

As data engineers, we build scalable systems to process data in various formats and volumes, ranging from megabytes to terabytes. Our systems perform quality checks, match data across various sources, and release it in multiple formats. We leverage the latest technologies, sources, and tools to process the data. Some of the exciting technologies we work with include Snowflake, Databricks, and Apache Spark.

Responsibilities:

• Build scalable systems to process data in various formats and volumes, from megabytes to terabytes.
• Implement and manage quality checks for incoming data.
• Develop and maintain processes to match data across various sources.
• Design and implement data release mechanisms in multiple formats for downstream applications.
• Continuously leverage and integrate the latest technologies, sources, and tools for data processing.

Qualifications:

• Proficiency in Core Java, Spring Boot, Apache Spark, Spring Batch, and Python.
• Must have exposure to SQL databases like Oracle, MySQL, and Microsoft SQL.
• Any experience, knowledge, or certification in Cloud technology, preferably Microsoft Azure or Google Cloud Platform, is good to have.
• Exposure to NoSQL databases like Neo4j or Document databases is also a good-to-have.