Progress on archive crawling.

Author Shawn Tice <sctice@gmail.com>
Author date 2012-05-08 06:May:th
Author local date 2012-05-07 23:May:th -0700
Committer Shawn Tice <sctice@gmail.com>
Committer date 2012-05-08 06:May:th
Committer local date 2012-05-07 23:May:th -0700
Commit ec7015bd4b17280d22f561020790ff7cdbe1e396
Tree 5585b81687266993c691fe02b9efb9cea9f0221d
Parent 328ff534ae7f477a804375a52cc0a395f6de2b82
Progress on archive crawling.

Archive crawling now works for WikiMedia .bz2 files and multiple fetchers.
Affected files:
.gitignore
bin/fetcher.php
controllers/admin_controller.php
controllers/fetch_controller.php
lib/archive_bundle_iterators/archive_bundle_iterator.php
lib/archive_bundle_iterators/mediawiki_bundle_iterator.php
lib/archive_bundle_iterators/web_archive_bundle_iterator.php
lib/bzip2_block_iterator.php
lib/crawl_constants.php
lib/index_archive_bundle.php
models/crawl_model.php
ViewGit