|
Unix VPS
Support
FAQ
Network
Miscellaneous
|
| Plucene::Analysis::Standard::StandardTokenizer(3) | User Contributed Perl Documentation | Plucene::Analysis::Standard::StandardTokenizer(3) |
NAME
Plucene::Analysis::Standard::StandardTokenizer - standard tokenizer
SYNOPSIS
# isa Plucene::Analysis::CharTokenizer
DESCRIPTION
This is the standard tokenizer.
This should be a good tokenizer for most European-language documents.
METHODS
token_re
The regular expression for tokenising.
normalize
Remove 's and .
| 2005-09-05 | perl v5.40.2 |
Visit the GSP FreeBSD Man Page Interface.
Output converted with ManDoc.