Search by job, company or skills

K

Big Data Engineer

Save
  • Posted a month ago
  • Over 100 applicants
Quick Apply

Job Description

Key Responsibilities:

  • Data Architecture: Design and implement scalable storage solutions using Hadoop, NoSQL databases, HBase, and Cassandra.
  • Big Data Processing: Develop and maintain pipelines using Apache Spark, Apache Storm, Apache Pig, MapReduce, and Oozie.
  • Scripting & Development: Write and test data processing scripts using Python, Scala, and Java.
  • System Integration: Integrate big data solutions with existing IT systems and external data sources.
  • Performance Optimization: Monitor and optimize big data systems for performance, scalability, and availability.
  • Security & Compliance: Ensure security and privacy of sensitive data.
  • Collaboration & Mentoring: Work with data scientists and stakeholders; mentor junior engineers and provide technical guidance.
  • Documentation: Document and communicate technical designs, solutions, and best practices.
  • Innovation: Stay updated with emerging trends and technologies in big data and data engineering.

More Info

Job Type:
Industry:
Function:
Employment Type:

About Company

Krazy Mantra, based in Ahmedabad, Gujarat, is a leading conglomerate offering IT, Non-IT, Real Estate, and Infrastructure solutions. Leveraging expertise and technology, it helps businesses grow through innovation and strategic consulting. Key products include Make In India Awards for Excellence, Holaa™, Business Integration System (BIS), CRM, and Campus Management System.

Job ID: 131082987

Similar Jobs

Delhi, India

Skills:

JavaDistributed ComputingHadoopData WarehousingMultithreadingTensorflowHadoop EcosystemPytorchSparkPythonAWS EMRCloudera Certified ProfessionalNoSQL databasesAzure HDInsightHortonworks Certified Developer

Gurugram, Gurugram, India

Skills:

snowflake HiveKinesisScalaApache SparkKafkaPythonSqlAWSData Lakes

Hyderabad, India

Skills:

Machine LearningHadoop EcosystemPysparkKafkaMapreduceTensorflowPythonScalaBashHBaseBig Data TechnologiesHiveLinuxSparkDynatraceKerasMongoDBSplunkAirflowDelta TablesAWS EMRAiHDFSIceberg

Hyderabad, India

Skills:

Performance TuningAzure FunctionsData FactoryNosqlCosmos DBPythonHadoopScalaApache SparkSqlHiveDatabricksAzureHbasedata martsBig Data Frameworksbatch data processingdata quality validationdistributed databasesEventhubdata lakesOptimizationETL pipeline developmentMedallion architectureCloud platformsSynapseDatawarehousesstreaming pipelines

Hyderabad

Skills:

Apache SparkScalaJavaPythonSqlHive