Education and Scientific Research RDM Data Lake Solution

Challenges for RDM

• 

  Insufficient Storage

  • The data volume increases explosively from PBs to EBs.
  • Massive numbers of large files on open platforms must be retained securely for at least 10 years.
  • Multiple copies are used for disaster recovery, causing a space utilization of less than 30%.
• 

  Data Silos

  • Data sharing across universities and institutions remains difficult, hindering interdisciplinary, cross-institutional, and cross-border collaboration that is essential for advancing open science.
  • Various HPC scenarios and heterogeneous research workflows and data involve complex data processing and diverse protocols.
• 

  Complex Management

  • Diverse storage devices used across universities and institutes result in various access modes and increased management complexity.
  • The lack of unified metadata management hinders efficient data retrieval in subject research, interdisciplinary projects, data cleansing, and cooperative research.
  • The lack of secure data sharing mechanisms makes it difficult to ensure the privacy, security, and regulatory compliance of high-value data.