I'm building transformer-style models and keep having to copy a custom RMSNorm because Keras doesn't seem to…
I'm building transformer-style models and keep having to copy a custom RMSNorm because Keras doesn't seem to…: a task in MiMo-V2.6-RL-harbor-code: MiMo-V2.6-RL Code (Harbor) (Harbor dataset). The exact internal organization, helper functions, backend dispatch path, validation location, and…
The task
The exact internal organization, helper functions, backend dispatch path, validation location, and generated export-file mechanics are left to the implementer. The public behavior should be observable through the Keras ops namespace, the Keras layers namespace, tensor outputs, layer weights, output shapes, exceptions…
Part of FineEnvs/MiMo-V2.6-RL-harbor-code.