public class URLMetaIndexingFilter extends Object implements IndexingFilter
X_POINT_ID| Constructor and Description |
|---|
URLMetaIndexingFilter() |
| Modifier and Type | Method and Description |
|---|---|
NutchDocument |
filter(NutchDocument doc,
Parse parse,
Text url,
CrawlDatum datum,
Inlinks inlinks)
This will take the metatags that you have listed in your "urlmeta.tags"
property, and looks for them inside the CrawlDatum object.
|
Configuration |
getConf()
Boilerplate
|
void |
setConf(Configuration conf)
handles conf assignment and pulls the value assignment from the
"urlmeta.tags" property
|
public NutchDocument filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks) throws IndexingException
filter in interface IndexingFilterdoc - document instance for collecting fieldsparse - parse data instanceurl - page urldatum - crawl datum for the page (fetch datum from segment containing
fetch status and fetch time)inlinks - page inlinksIndexingExceptionIndexingFilter.filter(org.apache.nutch.indexer.NutchDocument, org.apache.nutch.parse.Parse, org.apache.hadoop.io.Text, org.apache.nutch.crawl.CrawlDatum, org.apache.nutch.crawl.Inlinks)public Configuration getConf()
getConf in interface Configurablepublic void setConf(Configuration conf)
setConf in interface ConfigurableCopyright © 2021 The Apache Software Foundation