Yioop Repo - Seekquarry

« Back Issue #308

2011-01-06 16:43 Reported by administrator
2011-01-19 00:14 Marked fixed

Status: Marked fixed

Priority: Medium

Support creating indexes from various file formats

administrator 2011-01-06 16:43

This sorta continues an idea that didn't make it into version 0.6: give some way to migrate old crawls to newer versions of Yioop! The basic thing that hasn't changed much in Yioop! is the WebArchive format. So it would be cool if you couls set a crawl to be of an existing WebArchiveBundle. The results of this crawl would be an index in the format of the latest version of Yioop! It would be nice to make this extensible, so Heritrix or maybe Nutch files could be read as well.

administrator 2011-01-19 00:14

Fixed:ffe054a Added support for reading arc files. Can now re-crawl previous crawls (for instance adding meta-words).