Feature: Model Pinning to Exclude from Idle Unloading
Feature: Model Pinning to Exclude from Idle Unloading: a task in LegoFlow-SWE (Harbor dataset). Currently, LocalAI’s WatchDog can unload idle models after a timeout, but this applies to all models uniformly. There is no way to keep a specific model loaded permanently while others are still subject…
The task
Currently, LocalAI’s WatchDog can unload idle models after a timeout, but this applies to all models uniformly. There is no way to keep a specific model loaded permanently while others are still subject to automatic reaping. This prevents users from ensuring that frequently‑needed models remain immediately available…
Part of Lego-X/LegoFlow-SWE.