Search by job, company or skills

Senior Data Engineer

5-8 Years

This job is no longer accepting applications

Job Description

Meet our team:

We are the Data Team within PayPal Credit and more specifically, the Credit Platform Team. Our team supports PayPal Credit products including BNPL loans, credit cards, and merchant loans.

Your way to impact:

• Handling high-performance data loads at large scale

• Using automation to improve the accuracy and correctness of our data loading processes. We need ways to easily create test data and then write tests to validate the accuracy of our data loads

Your day-to-day:

Design, build, and maintain robust data pipelines and ETL processes to ingest, transform, and load data from various sources into downstream systems, ensuring scalability and efficiency.

  • Implement automated data quality checks and validation processes to ensure data integrity and accuracy at scale.
  • Troubleshoot data-related issues, identify root causes, and implement solutions in a timely manner to minimize impact on data processing.
  • Stay current with emerging technologies and trends in data engineering, recommending and implementing improvements as necessary to support scalability and growth.

What you need to bring:

  • Bachelor's/Master's in Engineering, Computer Science, or equivalent experience.
  • 5-8 years of experience in the IT industry; experience in Data space is preferred.
  • Proven experience as a Data Engineer or similar role, with a strong background in database development, ETL processes, and software development.
  • Proficiency in SQL and Python scripting, with hands-on experience working on relational databases.
  • Proficiency in PySpark, Pandas, or other data processing libraries.
  • Experience in Cloud - GDP / AWS.
  • Familiarity with data warehousing concepts and tools, such as AWS Redshift, Google BigQuery, or Snowflake, and experience optimizing performance for large-scale data processing.
  • Experience with data modeling, schema design, and optimization techniques for scalability.
  • Experience with Unix/Linux operating systems and shell scripting.

More Info

Job Type:
Function:
Employment Type:

About Company

Job ID: 107748289

Similar Jobs

Chennai, India

Skills:

BigQueryDataFlowAdvanced SqlPythonLoggingDataformBatch and streaming data processingData CatalogCloud MonitoringData lakehouse architecture conceptsPub SubDataplexIAM Security controlsJava or ScalaData ingestion frameworksAnalytics HubData modeling and warehousing principlesCDC and incremental processing

Chennai, India

Skills:

BigQueryData ModelingCiKafkaSqlELTApache AirflowGitGcpDockerPythonKubernetesEtlcdGoogle Cloud Composer

Chennai, India

Skills:

Power BiApache SparkAWS GlueTableauSqlAzure Data FactoryDockerAzurePythonKubernetesDevOps methodologiesData governance frameworksMatillionLookerSynapsedbtData quality tools

Chennai, India

Skills:

snowflake PysparkData GovernanceELTStar SchemaPerformance MonitoringPythonAWSData ProfilingUnit TestingAutomationSqlMetadata ManagementGitSparkDatabricksEtlSnowflake schemaOptimizationDenormalizationContainerized workloadsHPC environmentsLineage monitoringNormalizationPalantir FoundryLarge Language ModelsAI-assisted data engineeringAutomated data quality assessments

Chennai

Skills:

Google Cloud PlatformData EngineerAzureAWSSQL and Pythoncloud platformsETL methodologies

Beware of Scammers

We don’t charge money for job offers