Implement log merge of indexshard's dictionaries to speed look up of larger crawls
administrator2010-11-16 20:46
Right now Yioop searches through IndexShard's in sequence for larger crawls. This is slow (effectively linear time). By doing a log merge of shard dictionaries as crawling proceeds, it should be possible to have log access times.
Right now Yioop searches through IndexShard's in sequence for larger crawls. This is slow (effectively linear time). By doing a log merge of shard dictionaries as crawling proceeds, it should be possible to have log access times.
Implemented with a0d33a9.