Multi-Agent theory which is used for communication and collaboration among focused crawlers has been proved that it can improve the precision of returned result significantly. In this paper, we proposed a new organizational structure of multi-agent for focused crawlers, in which the agents were divided into three categories, namely F-Agent (Facilitator-Agent), As-Agent (Assistance-Agent) and C-Agent (Crawler-Agent). They worked on their own responsibilities and cooperated mutually to complete a common task of web crawling. In our proposed architecture of focused crawlers based on multi-agent system, we emphasized discussing the collaborative process among multiple agents. To control the cooperation among agents, we proposed a negotiation protocol based on the contract net protocol and achieved the collaboration model of focused crawlers based on multi-agent by JADE. At last, the comparative experiment results showed that our focused crawlers had higher precision and efficiency than other crawlers using the algorithms with breadth-first, best-first, etc.
Publié le : 2017-02-07
Classification:  other areas of Computing and Informatics,  Multi-agent, focused crawler, collaboration, contract net protocol, JADE
@article{cai1590,
     author = {Yajun Du; School of Mathematic and Computer Science, Xihua University, Chengdu and Yong Xu; School of Mathematic and Computer Science, Xihua University, Chengdu and Min Wang; School of Mathematic and Computer Science, Xihua University, Chengdu},
     title = {A Novel Cooperation and Competition Strategy Among Multi-Agent Crawlers},
     journal = {Computing and Informatics},
     volume = {35},
     number = {4},
     year = {2017},
     language = {en},
     url = {http://dml.mathdoc.fr/item/cai1590}
}
Yajun Du; School of Mathematic and Computer Science, Xihua University, Chengdu; Yong Xu; School of Mathematic and Computer Science, Xihua University, Chengdu; Min Wang; School of Mathematic and Computer Science, Xihua University, Chengdu. A Novel Cooperation and Competition Strategy Among Multi-Agent Crawlers. Computing and Informatics, Tome 35 (2017) no. 4, . http://gdmltest.u-ga.fr/item/cai1590/