public class CrawlDbFilter extends Mapper<Text,CrawlDatum,Text,CrawlDatum>
Mapper.Context| Modifier and Type | Field and Description |
|---|---|
static String |
URL_FILTERING |
static String |
URL_NORMALIZING |
static String |
URL_NORMALIZING_SCOPE |
| Constructor and Description |
|---|
CrawlDbFilter() |
| Modifier and Type | Method and Description |
|---|---|
void |
map(Text key,
CrawlDatum value,
Mapper.Context context) |
void |
setup(Mapper.Context context) |
public static final String URL_FILTERING
public static final String URL_NORMALIZING
public static final String URL_NORMALIZING_SCOPE
public void setup(Mapper.Context context)
setup in class Mapper<Text,CrawlDatum,Text,CrawlDatum>public void map(Text key, CrawlDatum value, Mapper.Context context) throws IOException, InterruptedException
map in class Mapper<Text,CrawlDatum,Text,CrawlDatum>IOExceptionInterruptedExceptionCopyright © 2021 The Apache Software Foundation