|
NAMEGungho::Component::RobotsMETA - Automatically Parse Robots META SYNOPSIS components:
- RobotsMETA
DESCRIPTIONThis module automatically parses any text/html document for robots exclusion directies embedded in the document. METHODSsetupInitializes the component. handle_responseOverrides Gungho::Component::Core::handle_response() SEE ALSOHTML::RobotsMETA
|