Plucene::Analysis::CharTokenizer(3pm) - phpMan

Plucene::Analysis::CharTokenizeUsermContributed Perl DocumenPlucene::Analysis::CharTokenizer(3pm)



NAME
       Plucene::Analysis::CharTokenizer - base class for character tokenisers

SYNOPSIS
               # isa Plucene::Analysis::Tokenizer

               my $next = $chartokenizer->next;

DESCRIPTION
       This is an abstract base class for simple, character-oriented tokenizers.

METHODS
       token_re

       This should be defined in subclasses.

       normalize

       This will normalise the character before it is added to the token.

       next

               my $next = $chartokenizer->next;

       This will return the next token in the string, or undef at the end of the string.



perl v5.8.8                                 2008-03-01      Plucene::Analysis::CharTokenizer(3pm)

Generated by $Id: phpMan.php,v 4.49 2006/02/26 13:18:18 chedong Exp $ Author: Che Dong
On Apache
Under GNU General Public License
2012-05-25 00:43 @38.107.179.239 Crawled by CCBot/1.0 (+http://www.commoncrawl.org/bot.html)