com.dkfqs.tools.text

Class UniquePatternDetector

java.lang.Object

com.dkfqs.tools.text.UniquePatternDetector

public class UniquePatternDetector
extends java.lang.Object

Calculate a list of unique text patterns from a content.
This algorithm works as follows:

1. Get all lines of the content.
2. For each line: Split the line into tokens by applying a set of delimiter chars. Put each token in a temporary map.
3. Compare each token in the temporary map to all other tokens and calculate a list of unique tokens = unique text patterns.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	DEFAULT_DELIMITER_CHARS The default delimiter chars.

Constructor Summary

Constructors

Constructor and Description
UniquePatternDetector(java.lang.String content) Create a new instance with default delimiter chars.

Method Summary

Modifier and Type	Method and Description
java.lang.String	getDelimiterChars() Get the delimiter chars.
java.util.ArrayList<UniquePatternDetectorElement>	getUniquePatterns(int minPatternLength) Get a list of unique text patterns.
void	setDelimiterChars(java.lang.String delimiterChars) Set the delimiter chars.
void	setExcludeTextFragments(java.util.ArrayList<java.lang.String> excludeTextFragmentsList) Set a list of text fragments which cannot be part of a unique text pattern.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_DELIMITER_CHARS

public static final java.lang.String DEFAULT_DELIMITER_CHARS

The default delimiter chars.

See Also:

Constant Field Values

Constructor Detail

UniquePatternDetector

public UniquePatternDetector(java.lang.String content)

Create a new instance with default delimiter chars.

Parameters:

content - the content from which the unique text patterns are detected.

See Also:

DEFAULT_DELIMITER_CHARS

Method Detail

getDelimiterChars

public java.lang.String getDelimiterChars()

Get the delimiter chars.

Returns:

the delimiter chars

setDelimiterChars

public void setDelimiterChars(java.lang.String delimiterChars)

Set the delimiter chars.

Parameters:

delimiterChars - the delimiter chars

Throws:

java.lang.RuntimeException - if the delimiter chars is an empty string

setExcludeTextFragments

public void setExcludeTextFragments(java.util.ArrayList<java.lang.String> excludeTextFragmentsList)

Set a list of text fragments which cannot be part of a unique text pattern.

Parameters:

excludeTextFragmentsList - the list of text fragments which cannot be part of a unique text pattern

getUniquePatterns

public java.util.ArrayList<UniquePatternDetectorElement> getUniquePatterns(int minPatternLength)

Get a list of unique text patterns.

Parameters:

minPatternLength - the minimum length of an unique text pattern

Returns:

the list of unique text patterns

Throws:

java.lang.RuntimeException - if somewhat fails