
Search by job, company or skills
Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and GCP databases on AWS Cloud Platform and REST API's
Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python for various use cases built on the platform
Experience in developing streaming pipelines and exposure to services like
* Glue
* Lambda
* S3
* SQL
* Redshift
* CloudWatch
* Secrets Manager
* Experience with distributed computing, data modeling, schema handling, and performance tuning.
* Strong debugging and problem-solving skills.
Job ID: 138806833