Search by job, company or skills

Quest Global

Sr. Data Engineer

Save
new job description bg glownew job description bg glownew job description bg svg
  • Posted 6 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Job Requirements

  • Strong experience in programming languages and latest technologies - Spark, Scala.
  • AWS cloud knowledge is must, candidate should have hands on experience on Kinesis, SQS, SNS, S3, Athena, EMR, Elastic Search, Quicksight, Redshift, Cloudwatch etc.
  • Using data engineering tools, languages, frameworks to mine, cleanse and explore data.
  • Fluent in NoSQL & relational based systems like MongoDB
  • Fluent in complex, distributed and massively parallel systems.
  • Strong analytical and problem-solving skills with ability to represent complex algorithms in software.
  • Proficient in deploying artifacts using CI/CD
  • Designing data systems/solutions to manage complex data.
  • Strong understanding of database technologies and management systems.
  • Strong understanding of cloud-based systems/services.
  • Database architecture testing methodology, including execution of test plans, debugging, and testing scripts and tools.
  • Excellent written and verbal communication skills; mastery in English and local language.

Ability to effectively communicate product architectures, design proposals and negotiate options at management levels.

Work Experience

  • Strong experience in programming languages and latest technologies - Spark, Scala.
  • AWS cloud knowledge is must, candidate should have hands on experience on Kinesis, SQS, SNS, S3, Athena, EMR, Elastic Search, Quicksight, Redshift, Cloudwatch etc.
  • Using data engineering tools, languages, frameworks to mine, cleanse and explore data.
  • Fluent in NoSQL & relational based systems like MongoDB
  • Fluent in complex, distributed and massively parallel systems.
  • Strong analytical and problem-solving skills with ability to represent complex algorithms in software.
  • Proficient in deploying artifacts using CI/CD
  • Designing data systems/solutions to manage complex data.
  • Strong understanding of database technologies and management systems.
  • Strong understanding of cloud-based systems/services.
  • Database architecture testing methodology, including execution of test plans, debugging, and testing scripts and tools.
  • Excellent written and verbal communication skills; mastery in English and local language.

Ability to effectively communicate product architectures, design proposals and negotiate options at management levels.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 147257909

Similar Jobs

Pune, India

Skills:

S3PysparkScalaApache SparkEmrJsonAvroSqlApache AirflowSpark StreamingHiveKinesisPythonAWSParquetGlueFirehose

Pune, India

Skills:

JavaScalaApache SparkBig Data TechnologiesKafkaGcpAbinitioAzurePythonAWSdata protection and privacy-preserving technologiesdata pipeline developmentcloud-native applicationsETL processescloud-based data solutions

Pune, India

Skills:

snowflake S3Data ModellingPower BiAWS GlueData WarehousingPython Programming

Hyderabad, Pune

Skills:

EtlData ArchitectureHadoopSparkKafkaData Modeling

Pune, India

Skills:

Rest ApiSqlApache SparkCloud StoragePythonSftpJDBCETL ProcessesDatabricks Lakehouse PlatformData Governance and SecurityDelta LakeData AnalysisData Quality and Unit TestingUNITY CatalogPerformance tuning and optimization in Spark