Search by job, company or skills

equifax india

Senior Manager - Data Engineering

Save
new job description bg glownew job description bg glow
  • Posted 6 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Synopsis of the role

Equifax is searching for a Senior Data Engineer to join our world-class Entity Resolution/Keying & Linking team within the India, Data & Analytics. The ideal candidate is a rare hybrid, an engineer with programming abilities to scrape, combine, and manage data from a variety of sources and a statistician who knows how to derive insights from the information within. He or she will combine the skills to create new prototypes with creativity and thoroughness to ask and answer the deepest questions about the data. Qualified candidates will have a strong academic background in mathematics or statistics, and a passion for data science, data mining and machine learning.

What You'll Do

  • Apply knowledge of data characteristics and data supply pattern, develop rules and tracking process to support data quality model.
  • Prepare data for analytical use by building data pipelines to gather data from multiple sources and systems.
  • Integrate, consolidate, cleanse and structure data for use by our clients in our solutions.
  • Perform design, creation, and interpretation of large and highly complex datasets.
  • Stay up to date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions.
  • Understand best practices for data management, maintenance, reporting and security and use that knowledge to implement improvements in our solutions.
  • Implement security best practices in pipelines and infrastructure.
  • Communicate with the global teams in regions with Equifax presence to share best practices and guide adoption strategies.
  • Develop and implement data quality checks and troubleshoot data anomalies.
  • Provide guidance and mentorship to junior data engineers.
  • Review dataset implementations performed by junior data engineers

What Experience You Need

  • BS degree in a STEM major or equivalent discipline; Master's Degree strongly preferred.
  • Nearly 10 years of experience as a data engineer or related role.
  • Experience using programming languages such as Python or SQL and intermediate level experience with scripting languages.
  • Intermediate level understanding and experience with Google Cloud Platforms and overall cloud computing concepts, as well as basic knowledge of other cloud environments.
  • Experience building and maintaining moderately-complex data pipelines, troubleshooting issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects.
  • Experience designing and implementing moderately complex data models and experience enabling optimization to improve performance.
  • Demonstrates advanced Git usage and CI/CD integration skills.

What Could Set You Apart

  • Experience with credit data products.
  • Cloud certification.
  • Experience in performing analysis using Google BigQuery, BigTable, and other Google Cloud Platform technologies, Google DataFlow, Scala+ Spark or PySpark.
  • Experience working with data schema / formats such as JSON, AVRO, PARQUET.
  • Experience or advanced degree with focus on Entity Resolution concepts, prototype or hand-on project.
  • Experience leading international engagements and collaborating with international teams.

#India

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 147475703

Similar Jobs

Bengaluru

Skills:

PythonSqlPysparkGoogle Cloud PlatformBigQueryDataFlowDataproc

Bengaluru, India

Skills:

BigQueryPower BiPysparkTableauDataprocDataFlowSqlPythonAirflow

Bengaluru, India

Skills:

snowflake AlgorithmsDatabricksMicroservicesAutomated TestingReactjsAgile MethodologiesCoding StandardsAzureGitOracle Pl Sqldata structuresCI CD integrationdistributed processing frameworksdata pipelinesfrontend architecture design patternsdata Lakehousemodern frontend technologiescontainerized applicationsAI tools

Bengaluru, India

Skills:

snowflake AlgorithmsDatabricksMicroservicesAutomated TestingReactjsAccessibilityAgile MethodologiesCoding StandardsAzureGitOracle Pl Sqldata structuresCI CD integrationdistributed processing frameworksdata pipelinesfrontend architecture design patternsdata Lakehousemodern frontend technologiescontainerized applicationsunit testing strategiesAI toolsUI performance optimization

Bengaluru, India

Skills:

snowflake Automated TestingMicroservicesGitOracle Pl SqlReactjsDatabricksAzureAI toolsdata pipelinesfrontend technologiesCI CD integrationdistributed processing frameworkscontainerized applicationsdata Lakehouse