java112.analyzer

Class UniqueTokenAnalyzer

java.lang.Object

java112.analyzer.UniqueTokenAnalyzer

All Implemented Interfaces:

Analyzer

Direct Known Subclasses:

BigWordAnalyzer

public class UniqueTokenAnalyzer
extends java.lang.Object
implements Analyzer

Processes individual text tokens and stores a list of unique values. Writes a report listing one unique token per line.

Author:

Brian Manning

Constructor Summary

Constructors

Constructor and Description
UniqueTokenAnalyzer() Instantiates a TreeSet object as uniqueTokensList on creation.
UniqueTokenAnalyzer(java.util.Properties properties) Constructor for UniqueTokenAnalyzer analyzer.

Method Summary

Methods

Modifier and Type	Method and Description
java.lang.String	getOutputFilePath() Retrieves values from properties for path to output file.
java.util.Set	getUniqueTokensList() Accessor for the uniqueTokensList instance variable.
void	processToken(java.lang.String token) Processes a single token by adding the token to uniqueTokensList.
void	writeOutputFile(java.lang.String inputFilePath) Writes a text file listing each unique token on a new line.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UniqueTokenAnalyzer

public UniqueTokenAnalyzer()

Instantiates a TreeSet object as uniqueTokensList on creation.

UniqueTokenAnalyzer

public UniqueTokenAnalyzer(java.util.Properties properties)

Constructor for UniqueTokenAnalyzer analyzer. Instantiates the uniqueTokensList Set as TreeSet.

Parameters:

properties - Properties - Properties file values for this analyzer.

Method Detail

getUniqueTokensList

public java.util.Set getUniqueTokensList()

Accessor for the uniqueTokensList instance variable.

Returns:

uniqueTokenList Set. A list of all unique tokens.

processToken

public void processToken(java.lang.String token)

Processes a single token by adding the token to uniqueTokensList.

Specified by:

processToken in interface Analyzer

Parameters:

token - String - a single text token.

writeOutputFile

public void writeOutputFile(java.lang.String inputFilePath)

Writes a text file listing each unique token on a new line.

Specified by:

writeOutputFile in interface Analyzer

Parameters:

inputFilePath - String - Path of the file being analyzed.

getOutputFilePath

public java.lang.String getOutputFilePath()

Retrieves values from properties for path to output file.

Returns:

outputFilePath String - Path of the output file.