public class SubcollectionIndexingFilter extends Configured implements IndexingFilter
| Modifier and Type | Field and Description |
|---|---|
static String |
fieldName
Doc field name
|
static String |
metadataSource
Metadata source field name
|
X_POINT_ID| Constructor and Description |
|---|
SubcollectionIndexingFilter() |
SubcollectionIndexingFilter(Configuration conf) |
| Modifier and Type | Method and Description |
|---|---|
NutchDocument |
filter(NutchDocument doc,
Parse parse,
Text url,
CrawlDatum datum,
Inlinks inlinks)
Adds fields or otherwise modifies the document that will be indexed for a
parse.
|
Configuration |
getConf() |
void |
setConf(Configuration conf) |
public static String fieldName
public static String metadataSource
public SubcollectionIndexingFilter()
public SubcollectionIndexingFilter(Configuration conf)
public void setConf(Configuration conf)
setConf in interface ConfigurablesetConf in class Configuredconf - public Configuration getConf()
getConf in interface ConfigurablegetConf in class Configuredpublic NutchDocument filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks) throws IndexingException
IndexingFilterfilter in interface IndexingFilterdoc - document instance for collecting fieldsparse - parse data instanceurl - page urldatum - crawl datum for the page (fetch datum from segment containing
fetch status and fetch time)inlinks - page inlinksIndexingExceptionCopyright © 2021 The Apache Software Foundation