HF RL Explorer

I'm building transformer-style models and keep having to copy a custom RMSNorm because Keras doesn't seem to…

I'm building transformer-style models and keep having to copy a custom RMSNorm because Keras doesn't seem to…: a task in MiMo-V2.6-RL-oss: Agentic RL Environments (MiMo RL release). LayerNormalization(rms scaling=True) also made me wonder if that's supposed to be the same thing, but it doesn't…

The task

LayerNormalization(rms_scaling=True) also made me wonder if that's supposed to be the same thing, but it doesn't look like standard RMSNorm. Could Keras add native RMS normalization directly, ideally usable both from keras.ops and as a keras.layers layer? Expected outcomes RMS…

Part of XiaomiMiMo/MiMo-V2.6-RL-oss.