eu.cqse.check.framework.util.tokens

Class TokenStreamSplitter

java.lang.Object

eu.cqse.check.framework.util.tokens.TokenStreamSplitter

public class TokenStreamSplitter
extends java.lang.Object

Splits a token stream into multiple parts.

Field Summary

Fields

Modifier and Type	Field and Description
static IToken	SENTINEL_TOKEN The sentinel token to use when splitting nested structures.

Constructor Summary

Constructors

Constructor and Description
TokenStreamSplitter(java.util.List<IToken> tokens) Constructor.

Method Summary

Modifier and Type	Method and Description
java.util.List<java.util.List<IToken>>	getTokenStreams() Returns the split streams.
void	splitNested(ETokenType openToken, ETokenType closeToken) Splits all streams at the given open and close tokens, e.g.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

SENTINEL_TOKEN

public static final IToken SENTINEL_TOKEN

The sentinel token to use when splitting nested structures.

Constructor Detail

TokenStreamSplitter

public TokenStreamSplitter(java.util.List<IToken> tokens)

Constructor.

Method Detail

getTokenStreams

public java.util.List<java.util.List<IToken>> getTokenStreams()

Returns the split streams.

splitNested

public void splitNested(ETokenType openToken,
                        ETokenType closeToken)

Splits all streams at the given open and close tokens, e.g. parentheses. The part inside the parentheses will become one new stream and the rest of the original stream as well. In the outside part, the inside part is replaced by the SENTINEL_TOKEN token. For example: a ( b ) c would be split into a ( sentinel ) c and b. Outer parts are guaranteed to be stored before inner parts in the tokenStreams list.