Nutch 分析1Nutch 简介................................................................................................................................21.1nutch 体系结构............................................................................................................22抓取部分..................................................................................................................................32.1爬虫的数据结构及含义...............................................................................................32.2抓取目录分析..............................................................................................................42.3抓取过程概述..............................................................................................................42.4抓取过程分析..............................................................................................................52.4.1inject 方法......................................................................................................62.4.2generate 方法................................................................................................122.4.3fetch 方法.....................................................................................................142.4.4parse 方法......................................................................................................162.4.5update 方法....................................................................................................162.4.6invert 方法....................................................................................................192.4.7index 方法......................................................................................................232.4.8dedup 方法......................................................................................................262.4.9merge 方法......................................................................................................303配置文...
