cn.edu.hfut.dmic.webcollector.plugin.ram

类 RamCrawler

java.lang.Object

cn.edu.hfut.dmic.webcollector.crawler.Crawler

cn.edu.hfut.dmic.webcollector.crawler.AutoParseCrawler

cn.edu.hfut.dmic.webcollector.plugin.ram.RamCrawler

所有已实现的接口:

Executor, Visitor, Requester

直接已知子类:

DemoBingCrawler, DemoMetaCrawler, DemoTypeCrawler

public abstract class RamCrawler
extends AutoParseCrawler

基于内存的Crawler插件，适合一次性爬取，并不具有断点爬取功能 长期任务请使用BreadthCrawler

作者:

hu

字段概要

从类继承的字段 cn.edu.hfut.dmic.webcollector.crawler.AutoParseCrawler

autoParse, LOG, parseImg, regexRule, requester, visitor

从类继承的字段 cn.edu.hfut.dmic.webcollector.crawler.Crawler

dbManager, executeInterval, executor, fetcher, forcedSeeds, maxExecuteCount, nextFilter, resumable, RUNNING, seeds, status, STOPED, threads, topN

构造器概要

构造器

构造器和说明
RamCrawler()
RamCrawler(boolean autoParse)

方法概要

限定符和类型	方法和说明
void	start()

从类继承的方法 cn.edu.hfut.dmic.webcollector.crawler.AutoParseCrawler

addRegex, afterParse, execute, getRegexRule, getRequester, getResponse, getVisitor, isAutoParse, isParseImg, parseLink, setAutoParse, setParseImg, setRegexRule, setRequester, setVisitor

从类继承的方法 cn.edu.hfut.dmic.webcollector.crawler.Crawler

addSeed, addSeed, addSeed, addSeed, addSeed, addSeed, addSeed, addSeed, addSeed, addSeed, addSeed, addSeed, getDBManager, getExecuteInterval, getExecutor, getMaxExecuteCount, getNextFilter, getThreads, getTopN, inject, injectForcedSeeds, isResumable, setDBManager, setExecuteInterval, setExecutor, setMaxExecuteCount, setNextFilter, setResumable, setThreads, setTopN, start, stop, toString

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

从接口继承的方法 cn.edu.hfut.dmic.webcollector.fetcher.Visitor

visit

构造器详细资料

RamCrawler

public RamCrawler()

RamCrawler

public RamCrawler(boolean autoParse)

方法详细资料

start

public void start()
           throws Exception

抛出:

Exception