public interface URLExemptionFilter extends Pluggable, Configurable
db.ignore.external.links.
This is useful when the crawl is focused to a domain but resources like images are hosted on CDN.| Modifier and Type | Field and Description |
|---|---|
static String |
X_POINT_ID
The name of the extension point.
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
filter(String fromUrl,
String toUrl)
Checks if toUrl is exempted when the ignore external is enabled
|
getConf, setConfstatic final String X_POINT_ID
boolean filter(String fromUrl, String toUrl)
fromUrl - : the source url which generated the outlinktoUrl - : the destination url which needs to be checked for exemptionCopyright © 2021 The Apache Software Foundation