Class Token
- java.lang.Object
-
- org.openoffice.da.comp.w2lcommon.tex.tokenizer.Token
-
- All Implemented Interfaces:
java.lang.Cloneable
public class Token extends java.lang.Object implements java.lang.Cloneable
This class represent a token in TeX
-
-
Constructor Summary
Constructors Constructor Description Token()
Construct a newToken
, initialized as aTokenTYPE.ENDINPUT
-token
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description protected void
addChar(char c)
Append a character to the character content of this tokenprotected void
clearChars()
Delete the character content of this tokenjava.lang.Object
clone()
char
getChar()
Get the first character in this tokenjava.lang.String
getString()
Get the character content of this token as a stringTokenType
getType()
Get theTokenType
of this tokenboolean
is(char c, TokenType type)
Test wether this token is a character token of the given type (that is, a single character with a token type that is neitherCOMMAND_SEQUENCE
norENDINPUT
)boolean
isCS(java.lang.String sName)
Test wether this token is aCOMMAND_SEQUENCE
token with a given nameprotected void
set(char c, TokenType type)
Set this token as a character token with a specificTokenType
protected void
setChar(char c)
Set the character content of this token to a single character (the type of the token is not changed)protected void
setType(TokenType type)
Set the type of this token to a specificTokenType
(the character content is not changed)java.lang.String
toString()
-
-
-
Method Detail
-
setType
protected void setType(TokenType type)
Set the type of this token to a specificTokenType
(the character content is not changed)- Parameters:
type
- the newTokenType
-
setChar
protected void setChar(char c)
Set the character content of this token to a single character (the type of the token is not changed)- Parameters:
c
- the character
-
set
protected void set(char c, TokenType type)
Set this token as a character token with a specificTokenType
- Parameters:
c
- the charactertype
- theTokenType
to use
-
clearChars
protected void clearChars()
Delete the character content of this token
-
addChar
protected void addChar(char c)
Append a character to the character content of this token- Parameters:
c
- the character to be appended
-
is
public boolean is(char c, TokenType type)
Test wether this token is a character token of the given type (that is, a single character with a token type that is neitherCOMMAND_SEQUENCE
norENDINPUT
)- Parameters:
c
- the character to testtype
- theTokenType
to test- Returns:
- true if the test was successful
-
isCS
public boolean isCS(java.lang.String sName)
Test wether this token is aCOMMAND_SEQUENCE
token with a given name- Parameters:
sName
- the name of the command sequence- Returns:
- true if the test was successful
-
getType
public TokenType getType()
Get theTokenType
of this token- Returns:
- the type
-
getChar
public char getChar()
Get the first character in this token- Returns:
- the character or U+FFFF is no characters exist
-
getString
public java.lang.String getString()
Get the character content of this token as a string- Returns:
- the character content
-
toString
public java.lang.String toString()
- Overrides:
toString
in classjava.lang.Object
-
clone
public java.lang.Object clone()
- Overrides:
clone
in classjava.lang.Object
-
-