Package com._1c.g5.v8.dt.bsl.gumtree.tokenizer

Class BslLineTokenizer

java.lang.Object

com._1c.g5.gumtree.core.tokenizer.AbsractLineTokenizer

com._1c.g5.v8.dt.bsl.gumtree.tokenizer.BslLineTokenizer

public class BslLineTokenizer
extends com._1c.g5.gumtree.core.tokenizer.AbsractLineTokenizer

A line tokenizer for bsl files.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	COMMENT_OPEN_SYMBOL	Constant indicating the open symbol of comment.

Fields inherited from class com._1c.g5.gumtree.core.tokenizer.AbsractLineTokenizer

EMPTY_STRING

Constructor Summary

Constructors

Constructor	Description
BslLineTokenizer()

Method Summary

Modifier and Type	Method	Description
boolean	isComment(String token)
List<String>	splitLineToTokens(String line)

Methods inherited from class com._1c.g5.gumtree.core.tokenizer.AbsractLineTokenizer

isCommentLine

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

COMMENT_OPEN_SYMBOL

public static final String COMMENT_OPEN_SYMBOL

Constant indicating the open symbol of comment.

See Also:

• Constant Field Values

Constructor Details

BslLineTokenizer

public BslLineTokenizer()

Method Details

splitLineToTokens

public List<String> splitLineToTokens(String line)

Specified by:

splitLineToTokens in class com._1c.g5.gumtree.core.tokenizer.AbsractLineTokenizer

isComment

public boolean isComment(String token)

Specified by:

isComment in class com._1c.g5.gumtree.core.tokenizer.AbsractLineTokenizer