Class PortugueseWordTokenizer

java.lang.Object

org.languagetool.tokenizers.WordTokenizer

org.languagetool.tokenizers.pt.PortugueseWordTokenizer

All Implemented Interfaces:

org.languagetool.tokenizers.Tokenizer

public class PortugueseWordTokenizer
extends org.languagetool.tokenizers.WordTokenizer

Tokenizes a sentence into words. Punctuation and whitespace gets its own token.

Since:

3.6

Author:

Tiago F. Santos

Constructor Summary

Constructors

Constructor	Description
PortugueseWordTokenizer()

Method Summary

Modifier and Type	Method	Description
List<String>	tokenize(String text)

Methods inherited from class org.languagetool.tokenizers.WordTokenizer

getProtocols, getTokenizingCharacters, isEMail, isUrl, joinEMails, joinEMailsAndUrls, joinUrls

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

PortugueseWordTokenizer

public PortugueseWordTokenizer()

Method Details

tokenize

public List<String> tokenize(String text)

Specified by:

tokenize in interface org.languagetool.tokenizers.Tokenizer

Overrides:

tokenize in class org.languagetool.tokenizers.WordTokenizer