Add a filesystem-backed metadata key/value store
Add a filesystem-backed metadata key/value store: a task in MiMo-V2.6-RL-oss: Agentic RL Environments (MiMo RL release). Our data-join components persist their metadata through a small key/value interface (the existing etcd and MySQL clients in fedlearner.common are examples). We now need to be…
The task
Our data-join components persist their metadata through a small key/value interface (the existing etcd and MySQL clients in fedlearner.common are examples). We now need to be able to keep that metadata on a distributed filesystem (HDFS or an NFS mount) instead of a database, so…
Part of XiaomiMiMo/MiMo-V2.6-RL-oss.