Dremio

Dremio and Big Data Expert

Primary Skills:

• Dremio Expertise: 4+ years experience with Dremio platform (coordinator, executor, reflections, VDS/PDS, metadata management)
• Big Data Technologies: Deep expertise in HDFS, Hive, Spark, and data lakehouse architectures
• On-Premises Data Platforms: 4+ years experience with on-premises enterprise data infrastructure and migration projects
• SQL Query Optimization: Advanced SQL and query performance tuning for large-scale data processing

Secondary Skills:

• Solution architecture and design documentation
• BI tool integrations (Tableau, Power BI)
• Container technologies (Docker, Kubernetes, image building)
• Data virtualization and federation strategies

Technical Capabilities:

• Dremio administration, configuration, and performance tuning on on-premises infrastructure
• RocksDB metadata management and migration
• Data source connectors (Hive, HDFS, S3, JDBC, ODBC)
• Big Data ecosystem integration (Hive, Spark, Hadoop)
• Kubernetes and container platforms for on-premises deployment
• Storage architecture (HDFS, object storage, MINIO)
• Advanced SQL and query optimization for distributed systems
• Architecture diagram creation and SI/SIA documentation support

Primary Responsibilities:

• Lead Dremio architecture design and deployment strategy
• Inventory existing Dremio infrastructure and datasets
• Configure Dremio in GDP environment (staging and production)