Package org.basex.util

Class FTToken

java.lang.Object
org.basex.util.FTToken
public final class FTToken extends Object

This class provides mapping tables for converting full-text tokens.

Author:
BaseX Team 2005-21, BSD License, Christian Gruen

  • Method Summary

    Modifier and Type
    Method
    Description
    static boolean
    lod(int cp)
    Returns true if the specified codepoint is a valid letter, digit, or a combining mark.
    static byte[]
    noDiacritics(byte[] token)
    Returns a token without diacritics.
    static int
    noDiacritics(int cp)
    Returns a codepoint without diacritics.
    static boolean
    ws(int ch)
    Returns true if the specified codepoint is whitespace.

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Method Details

    • ws

      public static boolean ws(int ch)
      Returns true if the specified codepoint is whitespace.
      Parameters:
      ch - codepoint to be tested
      Returns:
      result of check

    • lod

      public static boolean lod(int cp)
      Returns true if the specified codepoint is a valid letter, digit, or a combining mark.
      Parameters:
      cp - codepoint to be tested
      Returns:
      result of check

    • noDiacritics

      public static byte[] noDiacritics(byte[] token)
      Returns a token without diacritics.
      Parameters:
      token - token to be normalized
      Returns:
      resulting token

    • noDiacritics

      public static int noDiacritics(int cp)
      Returns a codepoint without diacritics.
      Parameters:
      cp - codepoint to be normalized
      Returns:
      resulting character