Plucene::Analysis::Tokenizer(3pUser Contributed Perl DocumentatiPlucene::Analysis::Tokenizer(3pm)
NAME
Plucene::Analysis::Tokenizer - base class for tokenizers
SYNOPSIS
my $tokenizer = Plucene::Analysis::Tokenizer::Subclass
->new({ reader => $reader });
DESCRIPTION
This is an abstract base class for tokenizers.
A Tokenizer is a TokenStream whose input is a Reader.
METHODS
new
my $tokenizer = Plucene::Analysis::Tokenizer::Subclass
->new({ reader => $reader });
This will create a new tokenizer.
next
This must be defined in a subclass
close
Close the input reader.
perl v5.8.8 2008-03-01 Plucene::Analysis::Tokenizer(3pm)
Generated by $Id: phpMan.php,v 4.49 2006/02/26 13:18:18 chedong Exp $ Author: Che Dong
On Apache
Under GNU General Public License
2012-05-25 00:45 @38.107.179.240 Crawled by CCBot/1.0 (+http://www.commoncrawl.org/bot.html)