HF RL Explorer

Issue: Support for fetching and processing all referenced hyperlinks when loading a web page

Issue: Support for fetching and processing all referenced hyperlinks when loading a web page: a task in LegoFlow-SWE (Harbor dataset). When adding a web page, the current loader only retrieves and processes the content from the specific URL that is provided. Users require the ability to…

The task

When adding a web page, the current loader only retrieves and processes the content from the specific URL that is provided. Users require the ability to automatically discover, fetch, and include all hyperlinked references found on that page, without manually specifying each link.

Part of Lego-X/LegoFlow-SWE.