I
Data Engineer
Search Jobs
Search by job, company or skills
Search by job, company or skills
IBM is hiring for Data Engineer-Data Platforms-AWS/Databricks at Pune and Chennai location.
Your Role and Responsibilities*
As a Data Engineer specializing in Data Platforms on AWS, you will advise on, develop, and maintain data engineering solutions on the AWS Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various AWS services. Your primary responsibilities will include:
• 5+ years experience in Design and Develop Data Pipelines: Design, build, and operate batch and real-time data pipelines using AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis, ensuring seamless integration and operation of data engineering solutions.
• Create Data Layers: Create data layers on AWS RedShift, Aurora, and DynamoDB, and migrate data using AWS DMS.
Reach out to me on [Confidential Information]
Job ID: 153341379
Skills:
Kinesis, AWS Glue, Aws Redshift, AWS, Glue Catalog, AWS EMR, AWS DMS
Skills:
snowflake , Kafka, Automated Testing, Data Modeling, ELT, Python, AWS, Apis, Sql, Google Cloud, Spark, Databricks, Azure, Etl, Airflow, Reconciliation, traceability controls, industrial historians, OPC-UA, IEC protocols, Modbus, data-quality validation, dbt, SCADA systems, lineage monitoring, error handling
Skills:
distributed file system , Debugging, OLAP, Tableau, Data Lake, Yarn, Sql Tools, Version Control, Gcp, Spark, Cloud Services, Vertica, AWS, Etl, Dremio, Data Analysis, Troubleshooting, Relational Databases, Apache Superset, Agile data structures, Monitoring
Skills:
Power Bi, Apache Spark, AWS Glue, Tableau, Sql, Azure Data Factory, Docker, Azure, Python, Kubernetes, DevOps methodologies, Data governance frameworks, Matillion, Looker, Synapse, dbt, Data quality tools
Skills:
Machine Learning, T-sql, Pyspark, Microsoft Sql Server, Sql, Git, Agile, Databricks, Python, Azure Document Intelligence, OCR data extraction, AI coding tools, AWS Textract
