public class CCIndexingFilter extends Object implements IndexingFilter
| Modifier and Type | Field and Description |
|---|---|
static String |
FIELD
The name of the document field we use.
|
X_POINT_ID| Constructor and Description |
|---|
CCIndexingFilter() |
| Modifier and Type | Method and Description |
|---|---|
void |
addUrlFeatures(NutchDocument doc,
String urlString)
Add the features represented by a license URL.
|
NutchDocument |
filter(NutchDocument doc,
Parse parse,
Text url,
CrawlDatum datum,
Inlinks inlinks)
Adds fields or otherwise modifies the document that will be indexed for a
parse.
|
Configuration |
getConf() |
void |
setConf(Configuration conf) |
public static String FIELD
public NutchDocument filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks) throws IndexingException
IndexingFilterfilter in interface IndexingFilterdoc - document instance for collecting fieldsparse - parse data instanceurl - page urldatum - crawl datum for the page (fetch datum from segment containing
fetch status and fetch time)inlinks - page inlinksIndexingExceptionpublic void addUrlFeatures(NutchDocument doc, String urlString)
public void setConf(Configuration conf)
setConf in interface Configurablepublic Configuration getConf()
getConf in interface ConfigurableCopyright © 2021 The Apache Software Foundation