Search by job, company or skills

IDESLABS

Big Data Engineer

Save
new job description bg glownew job description bg glownew job description bg svg
  • Posted a month ago
  • Over 100 applicants
Quick Apply

Job Description

  • Expert level understanding of distributed computing principles
  • Expert level knowledge and experience in Apache Spark
  • Hands on programing with Python / Java
  • Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop
  • Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming
  • Experience with messaging systems, such as Kafka or RabbitMQ
  • Good understanding of Big Data querying tools, such as Hive, and Impala
  • Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files
  • Good understanding of SQL queries, joins, stored procedures, relational schemas
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
  • Knowledge of ETL techniques and frameworks
  • Performance tuning of Spark Jobs
  • Experience with native Cloud data services AWS
  • Ability to lead a team efficiently
  • Experience with designing and implementing Big data solutions
  • Practitioner of AGILE methodology

About Company

Since its established in August 10 2013 in Hyderabad , Telangana, India,
IDESLABS Pvt Ltd has committed to provide high quality of Consulting Services and Corporate Trainings to our customers in locally in India and across the globe.
With our TEAMs passion towards the organization development and commitment towards excellence service to our customers within a less span of time IDESLABS has become a leading supplier for Corporate Trainings and Consulting Services for small and large business organizations.

Job ID: 112840399

Similar Jobs

Gurugram, Gurugram, India

Skills:

snowflake JavaScalaApache SparkAPI designHBaseMapreduceApache AirflowGitHiveApache KafkaOozieDatabricksPythonProcess AutomationData governance frameworksData meshData security best practicesdbtData fabric

Bengaluru, India

Skills:

graph databases object storage EmrData ModelingRedshiftQuicksightLambdaKinesisSparkPythonAWSFireHoseWarehousingcolumn-family databaseskey-value storesLake FormationGlueIAM roles and permissionsnon-relational databasesAthenaETL pipelines

Chennai, India

Skills:

graph databases object storage EmrData ModelingRedshiftQuicksightSparkPythonAWScolumn-family databasesLake Formationkey-value storesGluenon-relational databasesAthenaETL pipelines

Chennai

Skills:

data engineering snowflake Data EngineerBig DataPysparkSpark

Early Applicant
Chennai, India

Skills:

SqlDatabricksShell scriptingData WarehousingYarnApache SparkApache HadoopHBasePrestoPysparkKafkaHivePythonJenkinsGitScalaETL methodologiesDistributed computing principlesFlinkHDFSAzure HDInsightAWS EMRNoSQL databasesGoogle Cloud Dataproc