public class HashSetNextFilter extends HashSet<String> implements NextFilter
| 构造器和说明 |
|---|
HashSetNextFilter() |
| 限定符和类型 | 方法和说明 |
|---|---|
CrawlDatum |
filter(CrawlDatum nextItem,
CrawlDatum referer)
if the crawler visit http://a.com/ and detect http://a.com/b.html
then nextItem = http://a.com/b.html and referer = http://a.com/
if you want to filter nextItem, return null
else you should return nextItem
|
equals, hashCode, removeAlladdAll, containsAll, retainAll, toArray, toArray, toStringaddAll, containsAll, equals, hashCode, removeAll, retainAll, toArray, toArrayparallelStream, removeIf, streampublic CrawlDatum filter(CrawlDatum nextItem, CrawlDatum referer)
NextFilterfilter 在接口中 NextFilternextItem - one of the detected crawldatumsreferer - the crawldatum of the page where nextItem is detectedCopyright © 2017. All Rights Reserved.