Task: Create a Content-Type Validator for Web Documents
Task: Create a Content-Type Validator for Web Documents: a task in Terminal-Lego-15k (Harbor dataset). You are building a web crawler that needs to identify and filter XML, HTML, and XHTML documents based on their HTTP Content-Type headers. Your task is to create a utility that can validate…
The task
You are building a web crawler that needs to identify and filter XML, HTML, and XHTML documents based on their HTTP Content-Type headers. Your task is to create a utility that can validate whether a given Content-Type header value represents a valid XML, HTML, or XHTML document.
Part of PrimeIntellect/Terminal-Lego-15k.