com.dkfqs.tools.text

Class UniquePatternDetector

java.lang.Object

com.dkfqs.tools.text.UniquePatternDetector

public class UniquePatternDetector
extends java.lang.Object

Calculate a list of unique text patterns from a content.
This algorithm works as follows:

1. Get all lines of the content.
2. For each line: Split the line into tokens by applying a set of delimiter chars. Put each token in a temporary map.
3. Compare each token in the temporary map to all other tokens and calculate a list of unique tokens = unique text patterns.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	DEFAULT_DELIMITER_CHARS The default delimiter chars.

Constructor Summary

Constructors

Constructor and Description
UniquePatternDetector(java.lang.String content) Create a new instance.

Method Summary

Modifier and Type	Method and Description
void	addDelimiterChar(char c) Add a char to the set of delimiter chars.
java.lang.String	getDelimiterChars() Get the delimiter chars.
java.util.ArrayList<UniquePatternDetectorElement>	getUniquePatterns(int minPatternLength) Get a list of unique text patterns.
void	removeDelimiterChar(char c) Remove a char from the set of delimiter chars.
void	setDelimiterChars(java.lang.String delimiterChars) Set the delimiter chars.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_DELIMITER_CHARS

public static final java.lang.String DEFAULT_DELIMITER_CHARS

The default delimiter chars.

See Also:

Constant Field Values

Constructor Detail

UniquePatternDetector

public UniquePatternDetector(java.lang.String content)

Create a new instance.

Parameters:

content - the content from which the unique text patterns are detected.

Method Detail

getDelimiterChars

public java.lang.String getDelimiterChars()

Get the delimiter chars.

Returns:

the delimiter chars

setDelimiterChars

public void setDelimiterChars(java.lang.String delimiterChars)

Set the delimiter chars.

Parameters:

delimiterChars - the delimiter chars

removeDelimiterChar

public void removeDelimiterChar(char c)

Remove a char from the set of delimiter chars.

Parameters:

c - the char to remove

addDelimiterChar

public void addDelimiterChar(char c)

Add a char to the set of delimiter chars.

Parameters:

c - the char to add

getUniquePatterns

public java.util.ArrayList<UniquePatternDetectorElement> getUniquePatterns(int minPatternLength)

Get a list of unique text patterns.

Parameters:

minPatternLength - the minimum length of an unique text pattern

Returns:

the list of unique text patterns