Implement Network Iterator and allow multiple queue_servers for same crawl
administrator2011-12-07 11:16
A network iterator would allow Yioop to take a query then query several yioop machines to get their top k results and then combine these into a list of top m results. The fetcher and queue_server's would also need to be modified to allow for crawls with multiple queue_servers.
administrator2012-01-31 00:36
Initial pass of implementation was done over several commits, the last of these is
9e4d51fe
A network iterator would allow Yioop to take a query then query several yioop machines to get their top k results and then combine these into a list of top m results. The fetcher and queue_server's would also need to be modified to allow for crawls with multiple queue_servers.
Initial pass of implementation was done over several commits, the last of these is 9e4d51fe