Search by job, company or skills

Millennium

Senior Data Engineer

Save
new job description bg glownew job description bg glow
  • Posted a month ago
  • Be among the first 10 applicants
Early Applicant

Job Description

The Fixed Income & Commodities Data team is looking for a Data Engineer (8+ years of experience) who will work on the acquisition, accessibility, normalizing, and cataloging of large sets of data.

Responsibilities

  • Create and maintain optimal data pipeline architecture.
  • Extract, transform, and load data from a wide variety of data sources using Python and SQL.
  • Provide users access to datasets using REST and Python APIs.
  • Categorize, catalog, cleanse, and normalize datasets.
  • Communicate effectively with business users and technology stakeholders.

Required Skills/experience

  • 8+ years of relevant experience in data engineering or a closely related field.
  • Strong Python skills and experience with data analysis libraries (Pandas, NumPy, SciPy).
  • Hands-on relational SQL database development experience.
  • Unix/Linux experience.
  • Bachelor's degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.

Desirable Skills/experience

  • Object-oriented languages: Java, C++, etc.
  • AWS cloud services: EC2, RDS, Athena, Lambda, etc.
  • RDBMS: SQL Server and PostgreSQL.
  • Identity and Access Management: Kerberos, OAuth 2.0, LDAP.
  • Other technologies: Apache HTTP Server, Kafka, Snowflake.
  • Broad understanding of credit, fixed income, derivatives, futures, FX, or other financial instruments.

Other Qualifications

  • Excellent listening and communication skills (both oral and written).
  • Self-starter and critical thinker; takes ownership of projects and suggests improvements to the broader infrastructure.
  • Proactive, assertive, and attentive to detail.
  • Able to work both independently and collaboratively.
  • Comfortable handling multiple projects with competing priorities in a fast-paced environment.
  • Strong self-management and problem-solving skills.
  • Quick learner.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 145594157

Similar Jobs

Bengaluru

Skills:

PythonSqlRest ApisPower BiGraphqlCI/CD

Bengaluru, India

Skills:

PysparkSqlRest ApiBitbucketData WarehousingData LakeHadoopKafkaEtlPythonDB2JenkinsGitSparkAirflowData MeshCICD toolsTeradata

Bengaluru, India

Skills:

snowflake Apache AirflowNumpyPandasUnix Shell ScriptingPythonSqlELTEtldbt

Bengaluru, India

Skills:

JavaBigQueryMySQLPostgreSQLScalaSparkKafkaRedshiftSqlPythonFlink

Bengaluru, India

Skills:

object storage UnixHadoopPysparkApache SparkKafkaSqlCloudDockerOozieDatabricksKubernetesPythonAirflowAuto LoaderUnity CatalogDagsterDelta LakeStructured Streaming