Yioop Repo - Seekquarry

« Back Issue #402

2013-12-13 14:51 Reported by snigdha_parvatneni
2013-12-16 22:33 Marked fixed

Status: Marked fixed

Priority: Medium

Source code search feature

snigdha_parvatneni 2013-12-13 14:51

Source code search feature first patch

administrator 2013-12-13 20:29

Hey Snidgha,

Please put up a patch with the other changes you said you had made as soon as you can.

Best, Chris

snigdha_parvatneni 2013-12-15 05:14

Hello Professor,

There were some minor issues I have fixed them and uploading the new patch.

Thanks, Snigdha

administrator 2013-12-15 15:51

Hi Snidgha,

Please don't delete old patches. The point is to keep a history. I did a check on your last patch: git apply --stat CodeSearch.patch and it says only fetcher is changed even though it seems to have a few files edited can you please check this?

Best, Chris

snigdha_parvatneni 2013-12-15 17:13

Hello Professor,

I have generated a new patch and applied it in my local. It is working fine for http://pollett.org/git/cinequest.git I have also tested it with my local git repository. I is working fine. I am uploading the new patch and fetcher logs for http://pollett.org/git/cinequest.git

Thanks, Snigdha

administrator 2013-12-15 17:55

Files downloaded from the git repository should then be treated as their correct file type. I see things like:

0.119448 seconds. Showing 21 - 30 of 403

iphone_icon57_57.png [TXT]

pollett.org/git/cinequest.git/objects/e4/a281729256de3476cdbec805c4acc9a464dc20

?PNG IHDR99z?gAMA??OX2tEXtSoftwareAdobe ImageReadyq?e?????l?7f?r??????!?e/| |?????HKZ??s?%F??L+?TH?y?+??8hk?Uh? \?A~Vn?.???1??!o?A?P??tϴb?i?a`Z?0?O??hq r?$?"?

View as text. Similar. Inlinks. IP:173.13.143.73. Score:8.88

in the search results. A png file should be mapped to the PngProcessor not the text processor.

administrator 2013-12-15 17:59

The source code search seemed to work. However, when I view any cache of a page, there is a notice:

Notice: Undefined index: repository in /Applications/MAMP/htdocs/git/yioop/controllers/search_controller.php on line 136 This cached version of http://pollett.org/git/cinequest.git/objects/68/19c04dc84cc890f7da79dbb566faca6777ec28 was obtained by the Yioop crawler on December 15 2013 17:48:31. Toggle History Toggle Extracted Headers and Summaries

package edu.sjsu.cinequest;

import java.util.List;

import android.os.Bundle;

snigdha_parvatneni 2013-12-16 22:01

Hello Professor,

I have uploaded the updated patch. Hope this time it will work smoothly without any issues.

Thanks, Snigdha

administrator 2013-12-16 22:29

That patch looks good.

administrator 2013-12-16 22:29

Implemented with 8a5f362

snigdha_parvatneni 2013-12-16 22:33

Attachments:

CodeSearch.patch

SourceCode.patch

_binary Last login: Sun Dec 15 18:01:09 on ttys001
sridhar-chunduris-MacBook-Pro:~ sridharchunduri$ cd /Applications/XAMPP/xamppfiles/htdocs/yioop/bin 
sridhar-chunduris-MacBook-Pro:bin sridharchunduri$ php fetcher.php terminal[Sun, 15 Dec 2013 18:01:37 -0800] 

Initialize logger..
[Sun, 15 Dec 2013 18:01:37 -0800] In Fetch Loop
[Sun, 15 Dec 2013 18:01:37 -0800] Checking name server:
[Sun, 15 Dec 2013 18:01:37 -0800]   http://localhost/yioop/ to see if should start crawling
[Sun, 15 Dec 2013 18:01:37 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:01:37 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:01:37 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:01:37 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:01:37 -0800] MAIN LOOP CASE 1 -- SWITCH CRAWL OR NO CURRENT CRAWL
[Sun, 15 Dec 2013 18:01:37 -0800] No data. Sleeping...
[Sun, 15 Dec 2013 18:01:52 -0800] Checking name server:
[Sun, 15 Dec 2013 18:01:52 -0800]   http://localhost/yioop/ to see if should start crawling
[Sun, 15 Dec 2013 18:01:52 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:01:52 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:01:52 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:01:52 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:01:52 -0800] MAIN LOOP CASE 1 -- SWITCH CRAWL OR NO CURRENT CRAWL
[Sun, 15 Dec 2013 18:01:52 -0800] No data. Sleeping...
[Sun, 15 Dec 2013 18:02:07 -0800] Checking name server:
[Sun, 15 Dec 2013 18:02:07 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:02:07 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:02:07 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:02:07 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:02:07 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:02:07 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:02:07 -0800] Checking  http://localhost/yioop/ for a new schedule.
[Sun, 15 Dec 2013 18:02:07 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:02:07 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:02:07 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:02:07 -0800] Making request: 
[Sun, 15 Dec 2013 18:02:07 -0800] http://localhost/yioop/?c=fetch&a=schedule&time=1387159327&session=f359528dfea59cb2aa39c95090bb0f0f&robot_instance=0-localhost-1387159138&machine_uri=/yioop/&crawl_time=1387159304&check_crawl_time=1387159327
[Sun, 15 Dec 2013 18:02:07 -0800] Time to check Scheduler 0.108062
[Sun, 15 Dec 2013 18:02:07 -0800] New name: /Applications/XAMPP/xamppfiles/htdocs/ydata/cache/0-Archive1387159304
[Sun, 15 Dec 2013 18:02:07 -0800] Switching archive...
[Sun, 15 Dec 2013 18:02:07 -0800] Checking name server:
[Sun, 15 Dec 2013 18:02:07 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:02:07 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:02:07 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:02:07 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:02:07 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:02:07 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:02:07 -0800]   Current to crawl count:1
[Sun, 15 Dec 2013 18:02:07 -0800]   Current to crawl try again count:0
[Sun, 15 Dec 2013 18:02:07 -0800] So not checking scheduler.
[Sun, 15 Dec 2013 18:02:07 -0800] Fetch url list to download time 0.00014199999999998
[Sun, 15 Dec 2013 18:02:07 -0800] Downloading list of urls...
[Sun, 15 Dec 2013 18:02:07 -0800]   Init Get Pages 0.00026799999999993
[Sun, 15 Dec 2013 18:02:08 -0800]   Page Request time 0.107622
[Sun, 15 Dec 2013 18:02:08 -0800]   Get Page Content time 0.001646
[Sun, 15 Dec 2013 18:02:08 -0800]   Sort downloaded/not downloaded 1.3E-5
[Sun, 15 Dec 2013 18:02:08 -0800]   Scheduling again..
[Sun, 15 Dec 2013 18:02:08 -0800] ....done.
[Sun, 15 Dec 2013 18:02:08 -0800] Downloading complete
[Sun, 15 Dec 2013 18:02:08 -0800] Start process pages... Current Memory:9589440
[Sun, 15 Dec 2013 18:02:08 -0800]   Converting from encoding ASCII...
[Sun, 15 Dec 2013 18:02:08 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:08 -0800]   Process pages time: 0.002061 Current Memory: 9611384
[Sun, 15 Dec 2013 18:02:08 -0800] Number of summarized pages 1
[Sun, 15 Dec 2013 18:02:08 -0800]   Updating Found Sites Array...
[Sun, 15 Dec 2013 18:02:08 -0800] 0.  http://pollett.org/robots.txt
[Sun, 15 Dec 2013 18:02:08 -0800]   Done Update Found Sites Array Time 0.000123
[Sun, 15 Dec 2013 18:02:08 -0800]   Start Update Server 
[Sun, 15 Dec 2013 18:02:08 -0800] Updating machine: http://localhost/yioop/
[Sun, 15 Dec 2013 18:02:08 -0800] ...124 bytes of robot data
[Sun, 15 Dec 2013 18:02:08 -0800] ...144 bytes of cache page validation data
[Sun, 15 Dec 2013 18:02:08 -0800] ...88 bytes of schedule data
[Sun, 15 Dec 2013 18:02:08 -0800]   Start building mini inverted index ...  Current Memory:9600408
[Sun, 15 Dec 2013 18:02:08 -0800] ..Still building inverted index. Have processed 0 of 1 documents.
Last url processed was http://pollett.org/robots.txt. Current memory usage:9630064
[Sun, 15 Dec 2013 18:02:08 -0800]   Build mini inverted index time 0.001681
[Sun, 15 Dec 2013 18:02:08 -0800] Saving Mini Inverted Index...
[Sun, 15 Dec 2013 18:02:08 -0800] Merge index shard postings to string to save memory.
[Sun, 15 Dec 2013 18:02:08 -0800] ..Merge Index Posting Final Copy
[Sun, 15 Dec 2013 18:02:08 -0800] ..Done Merge Index Posting Final Copy
[Sun, 15 Dec 2013 18:02:08 -0800] Saving index shard .. done merge postings to string
[Sun, 15 Dec 2013 18:02:08 -0800] Saving index shard .. make prefixes
[Sun, 15 Dec 2013 18:02:08 -0800] Saving index shard .. packed header
[Sun, 15 Dec 2013 18:02:08 -0800] Saving index shard .. wrote doc map. Done save
[Sun, 15 Dec 2013 18:02:08 -0800] ...Finish Compressing seen URLs.
[Sun, 15 Dec 2013 18:02:08 -0800] ...3016 bytes of index data
[Sun, 15 Dec 2013 18:02:08 -0800] ...
[Sun, 15 Dec 2013 18:02:08 -0800] Sending Queue Server Part 1 of 1...
[Sun, 15 Dec 2013 18:02:08 -0800] ...sending about 3372 bytes.
[Sun, 15 Dec 2013 18:02:08 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:02:08 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:02:08 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:02:08 -0800] Messages from Fetch Controller:
[Sun, 15 Dec 2013 18:02:08 -0800] ... Data upload complete

[Sun, 15 Dec 2013 18:02:08 -0800] post_max_size has changed was 8000000. Now is 128000000.
[Sun, 15 Dec 2013 18:02:08 -0800] Queue Server info response code: 1
[Sun, 15 Dec 2013 18:02:08 -0800] Queue Server's crawl time is: 1387159304
[Sun, 15 Dec 2013 18:02:08 -0800] Web Server peak memory usage: 5540904
[Sun, 15 Dec 2013 18:02:08 -0800] This fetcher peak memory usage: 10728032
[Sun, 15 Dec 2013 18:02:08 -0800] Updated Queue Server, sent approximately 3372 bytes:
[Sun, 15 Dec 2013 18:02:08 -0800] ...  Current Memory:9602208
[Sun, 15 Dec 2013 18:02:08 -0800]   Update Server Time 0.169416
[Sun, 15 Dec 2013 18:02:08 -0800] Ensure minimum loop time by sleeping...5
[Sun, 15 Dec 2013 18:02:13 -0800] Checking name server:
[Sun, 15 Dec 2013 18:02:13 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:02:13 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:02:13 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:02:13 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:02:13 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:02:13 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:02:13 -0800] Checking  http://localhost/yioop/ for a new schedule.
[Sun, 15 Dec 2013 18:02:13 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:02:13 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:02:13 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:02:13 -0800] Making request: 
[Sun, 15 Dec 2013 18:02:13 -0800] http://localhost/yioop/?c=fetch&a=schedule&time=1387159333&session=8d8082c5e2f44a5a007bcbcdc41dd182&robot_instance=0-localhost-1387159138&machine_uri=/yioop/&crawl_time=1387159304&check_crawl_time=1387159333
[Sun, 15 Dec 2013 18:02:13 -0800] Time to check Scheduler 0.111211
[Sun, 15 Dec 2013 18:02:25 -0800] Fetch url list to download time 12.181395
[Sun, 15 Dec 2013 18:02:25 -0800] Downloading list of urls...
[Sun, 15 Dec 2013 18:02:25 -0800]   Init Get Pages 0.031995
[Sun, 15 Dec 2013 18:02:34 -0800]   Page Request time 8.895201
[Sun, 15 Dec 2013 18:02:34 -0800]   Get Page Content time 0.049856
[Sun, 15 Dec 2013 18:02:45 -0800]   Sort downloaded/not downloaded 0.00015699999999996
[Sun, 15 Dec 2013 18:02:45 -0800]   Scheduling again..
[Sun, 15 Dec 2013 18:02:45 -0800] ....done.
[Sun, 15 Dec 2013 18:02:45 -0800] Downloading complete
[Sun, 15 Dec 2013 18:02:45 -0800] Start process pages... Current Memory:12708392
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:45 -0800]   Process pages time: 0.182037 Current Memory: 13924160
[Sun, 15 Dec 2013 18:02:45 -0800] Number of summarized pages 100
[Sun, 15 Dec 2013 18:02:45 -0800]   Updating Found Sites Array...
[Sun, 15 Dec 2013 18:02:45 -0800] 1.  http://pollett.org/git/cinequest.git/objects/07/73811b6c1fc88bdcf51e2d0f48d2d9d68dc2f0
[Sun, 15 Dec 2013 18:02:45 -0800] 2.  http://pollett.org/git/cinequest.git/objects/83/09d39af0311919221d3514585ff6a61bfe2850
[Sun, 15 Dec 2013 18:02:45 -0800] 3.  http://pollett.org/git/cinequest.git/objects/09/160096b041e10c93ba44d1d9f4633ac7a9fb59
[Sun, 15 Dec 2013 18:02:45 -0800] 4.  http://pollett.org/git/cinequest.git/objects/b1/cdf17b5bb40b4839cfc80f7e91bbcf7b94f798
[Sun, 15 Dec 2013 18:02:45 -0800] 5.  http://pollett.org/git/cinequest.git/objects/1c/81565c9d9e34c814a36fc3796192c84562a3b2
[Sun, 15 Dec 2013 18:02:45 -0800] 6.  http://pollett.org/git/cinequest.git/objects/37/e307a9f4d3b97ac5b846aa2b6a61f696ad7ca8
[Sun, 15 Dec 2013 18:02:45 -0800] 7.  http://pollett.org/git/cinequest.git/objects/87/9200baea89f6e99e4f51866dcc92368be64695
[Sun, 15 Dec 2013 18:02:45 -0800] 8.  http://pollett.org/git/cinequest.git/objects/23/e7e1c0ea9e1256a512c995eb9983f060fbc736
[Sun, 15 Dec 2013 18:02:45 -0800] 9.  http://pollett.org/git/cinequest.git/objects/7b/0dfc5e163e8aea196acbf59c06521de57437bc
[Sun, 15 Dec 2013 18:02:45 -0800] 10.  http://pollett.org/git/cinequest.git/objects/71/6d993502a1285061fce30eb7ab0a8bcc477f68
[Sun, 15 Dec 2013 18:02:45 -0800] 11.  http://pollett.org/git/cinequest.git/objects/9d/90baed475a858b40add360ee2497fed2e15672
[Sun, 15 Dec 2013 18:02:45 -0800] 12.  http://pollett.org/git/cinequest.git/objects/a0/3004c44c335c091778c74692033f1e0b32fa0d
[Sun, 15 Dec 2013 18:02:45 -0800] 13.  http://pollett.org/git/cinequest.git/objects/8b/83cf6e887490acafba2bce7a418a1e516fc018
[Sun, 15 Dec 2013 18:02:45 -0800] 14.  http://pollett.org/git/cinequest.git/objects/be/b475e836d48faab62fae0cbb097b0d143d5754
[Sun, 15 Dec 2013 18:02:45 -0800] 15.  http://pollett.org/git/cinequest.git/objects/7e/36571a6674f44df415e54d26b67c5e2bee6b13
[Sun, 15 Dec 2013 18:02:45 -0800] 16.  http://pollett.org/git/cinequest.git/objects/73/1233666d329acf173ef2bd78422226f9f7c8c3
[Sun, 15 Dec 2013 18:02:45 -0800] 17.  http://pollett.org/git/cinequest.git/objects/10/f3f6747d273f444fb01b56d4b95b6ff352a7cd
[Sun, 15 Dec 2013 18:02:45 -0800] 18.  http://pollett.org/git/cinequest.git/objects/aa/5c1c673e940cf47e3c750b7c25d900379330bd
[Sun, 15 Dec 2013 18:02:45 -0800] 19.  http://pollett.org/git/cinequest.git/objects/f7/edf970aa5c7bf3b11b08fc9d1aa871e690e5db
[Sun, 15 Dec 2013 18:02:45 -0800] 20.  http://pollett.org/git/cinequest.git/objects/e4/a281729256de3476cdbec805c4acc9a464dc20
[Sun, 15 Dec 2013 18:02:45 -0800] 21.  http://pollett.org/git/cinequest.git/objects/1a/33963d02db2302e2d7e3c234014d3c68a695ab
[Sun, 15 Dec 2013 18:02:45 -0800] 22.  http://pollett.org/git/cinequest.git/objects/66/60d2c2e39500a5627773b9e7b0456174cc7070
[Sun, 15 Dec 2013 18:02:45 -0800] 23.  http://pollett.org/git/cinequest.git/objects/8d/6a63cc445d3f2e29e32c8208d517f138e06043
[Sun, 15 Dec 2013 18:02:45 -0800] 24.  http://pollett.org/git/cinequest.git/objects/29/47bafa930027c0adc40b836175ee5db7520291
[Sun, 15 Dec 2013 18:02:45 -0800] 25.  http://pollett.org/git/cinequest.git/objects/79/31b3e13d4eecf73db6bbbf8d8efe22ba23b7c5
[Sun, 15 Dec 2013 18:02:45 -0800] 26.  http://pollett.org/git/cinequest.git/objects/1c/64bbe9ea1f9d89449ad89342d5e0a49e0c11e2
[Sun, 15 Dec 2013 18:02:45 -0800] 27.  http://pollett.org/git/cinequest.git/objects/d5/8c77fc1b1858e8bf18b5c7640214d7d46e7474
[Sun, 15 Dec 2013 18:02:45 -0800] 28.  http://pollett.org/git/cinequest.git/objects/95/d9323fa3d875d7ac29e828f54c98ed17d6faeb
[Sun, 15 Dec 2013 18:02:45 -0800] 29.  http://pollett.org/git/cinequest.git/objects/ca/439d2612f97d5c76536145e75a1844fad02d15
[Sun, 15 Dec 2013 18:02:45 -0800] 30.  http://pollett.org/git/cinequest.git/objects/89/620af8c03d187d47c7630e9c2a257b88e9e176
[Sun, 15 Dec 2013 18:02:45 -0800] 31.  http://pollett.org/git/cinequest.git/objects/9d/90baed475a858b40add360ee2497fed2e15672
[Sun, 15 Dec 2013 18:02:45 -0800] 32.  http://pollett.org/git/cinequest.git/objects/a5/78f37fb0aa50bf02e3a98f8001da13750e6f38
[Sun, 15 Dec 2013 18:02:45 -0800] 33.  http://pollett.org/git/cinequest.git/objects/7e/36571a6674f44df415e54d26b67c5e2bee6b13
[Sun, 15 Dec 2013 18:02:45 -0800] 34.  http://pollett.org/git/cinequest.git/objects/7d/241fc7cbd6eeec80d5d134b75f3ce9dcdbc9be
[Sun, 15 Dec 2013 18:02:45 -0800] 35.  http://pollett.org/git/cinequest.git/objects/ad/ab6d653754dbb5c4eb4c7ce5a20cd06cf1e6da
[Sun, 15 Dec 2013 18:02:45 -0800] 36.  http://pollett.org/git/cinequest.git/objects/01/f7b829b6a0d6fc35b9f136f5e659cfd8f5a7ba
[Sun, 15 Dec 2013 18:02:45 -0800] 37.  http://pollett.org/git/cinequest.git/objects/87/8b2a195d187d97a8d6c877cdfcbf23963570c5
[Sun, 15 Dec 2013 18:02:45 -0800] 38.  http://pollett.org/git/cinequest.git/objects/29/47bafa930027c0adc40b836175ee5db7520291
[Sun, 15 Dec 2013 18:02:45 -0800] 39.  http://pollett.org/git/cinequest.git/objects/bb/95da701f4ff8d80d1215f7f7866ff72db8216b
[Sun, 15 Dec 2013 18:02:45 -0800] 40.  http://pollett.org/git/cinequest.git/objects/33/ca4c90bb111888cbcf7aa6a7458e543e5fd1cd
[Sun, 15 Dec 2013 18:02:45 -0800] 41.  http://pollett.org/git/cinequest.git/objects/c5/bae164118dd75bd397a02c242e74589a26de30
[Sun, 15 Dec 2013 18:02:45 -0800] 42.  http://pollett.org/git/cinequest.git/objects/00/618ff2d28d8a985133acebf8f749a372946ba3
[Sun, 15 Dec 2013 18:02:45 -0800] 43.  http://pollett.org/git/cinequest.git/objects/9d/90baed475a858b40add360ee2497fed2e15672
[Sun, 15 Dec 2013 18:02:45 -0800] 44.  http://pollett.org/git/cinequest.git/objects/19/7f7b0a774e08975efed385c4c4c61c46e8d74d
[Sun, 15 Dec 2013 18:02:45 -0800] 45.  http://pollett.org/git/cinequest.git/objects/8b/83cf6e887490acafba2bce7a418a1e516fc018
[Sun, 15 Dec 2013 18:02:45 -0800] 46.  http://pollett.org/git/cinequest.git/objects/be/b475e836d48faab62fae0cbb097b0d143d5754
[Sun, 15 Dec 2013 18:02:45 -0800] 47.  http://pollett.org/git/cinequest.git/objects/7e/36571a6674f44df415e54d26b67c5e2bee6b13
[Sun, 15 Dec 2013 18:02:45 -0800] 48.  http://pollett.org/git/cinequest.git/objects/73/1233666d329acf173ef2bd78422226f9f7c8c3
[Sun, 15 Dec 2013 18:02:45 -0800] 49.  http://pollett.org/git/cinequest.git/objects/d5/8c77fc1b1858e8bf18b5c7640214d7d46e7474
[Sun, 15 Dec 2013 18:02:45 -0800] 50.  http://pollett.org/git/cinequest.git/objects/f2/f394a81598b3deac484d37f83c71d1f5d58556
[Sun, 15 Dec 2013 18:02:45 -0800] 51.  http://pollett.org/git/cinequest.git/objects/16/f8ed73d1ba92c1c5d8ca7150c9524b94f353b8
[Sun, 15 Dec 2013 18:02:45 -0800] 52.  http://pollett.org/git/cinequest.git/objects/7d/5b5092674ad6ea268faa88e6edc0314ae08667
[Sun, 15 Dec 2013 18:02:45 -0800] 53.  http://pollett.org/git/cinequest.git/objects/af/fa4260ff51bd29f4a55156fbaf3ed5c28bb40b
[Sun, 15 Dec 2013 18:02:45 -0800] 54.  http://pollett.org/git/cinequest.git/objects/8d/6a63cc445d3f2e29e32c8208d517f138e06043
[Sun, 15 Dec 2013 18:02:45 -0800] 55.  http://pollett.org/git/cinequest.git/objects/29/47bafa930027c0adc40b836175ee5db7520291
[Sun, 15 Dec 2013 18:02:45 -0800] 56.  http://pollett.org/git/cinequest.git/objects/0a/9d77c8574d9c63e2e4ee8bbb28041e2bcdcf7d
[Sun, 15 Dec 2013 18:02:45 -0800] 57.  http://pollett.org/git/cinequest.git/objects/c0/d1e6463521062d2ee985e82440f6d90c1a8cad
[Sun, 15 Dec 2013 18:02:45 -0800] 58.  http://pollett.org/git/cinequest.git/objects/c9/5598e4b5ccd350c41c149d355371ed06be5f44
[Sun, 15 Dec 2013 18:02:45 -0800] 59.  http://pollett.org/git/cinequest.git/objects/60/aadd002199904f5d2d43ea36742d8e8832ce97
[Sun, 15 Dec 2013 18:02:45 -0800] 60.  http://pollett.org/git/cinequest.git/objects/cd/08b1194480f4fb098c21a0155de6e805f716e2
[Sun, 15 Dec 2013 18:02:45 -0800] 61.  http://pollett.org/git/cinequest.git/objects/33/7c2b02ba7fac1068a76a43f91cf9486820da13
[Sun, 15 Dec 2013 18:02:45 -0800] 62.  http://pollett.org/git/cinequest.git/objects/57/397ccec908079efe366e849ce75dbe4e266b4e
[Sun, 15 Dec 2013 18:02:45 -0800] 63.  http://pollett.org/git/cinequest.git/objects/71/b8d4ccbadd8854eb961ee73eedbadae147796e
[Sun, 15 Dec 2013 18:02:45 -0800] 64.  http://pollett.org/git/cinequest.git/objects/23/513e3e4626ed194ceeb0a25aa3d6fb8d690967
[Sun, 15 Dec 2013 18:02:45 -0800] 65.  http://pollett.org/git/cinequest.git/objects/85/7a3b92de74401cc9774dce6f7d9bf001951234
[Sun, 15 Dec 2013 18:02:45 -0800] 66.  http://pollett.org/git/cinequest.git/objects/ae/0bf5aa50ed87618a939881f8adf84d17a8e218
[Sun, 15 Dec 2013 18:02:45 -0800] 67.  http://pollett.org/git/cinequest.git/objects/bf/654440cb05b0fc1c292a732a5f7cce7afd405b
[Sun, 15 Dec 2013 18:02:45 -0800] 68.  http://pollett.org/git/cinequest.git/objects/91/236f703bc43667f667349e5f4650322c27e44d
[Sun, 15 Dec 2013 18:02:45 -0800] 69.  http://pollett.org/git/cinequest.git/objects/1d/0e21b7da96770f55b708cfc65279f1bcccd963
[Sun, 15 Dec 2013 18:02:45 -0800] 70.  http://pollett.org/git/cinequest.git/objects/2a/ffe4cada3927c8ca9cd6b945a4472f84d61d44
[Sun, 15 Dec 2013 18:02:45 -0800] 71.  http://pollett.org/git/cinequest.git/objects/b7/c58b0d7ee7ab761d7cf3e2440b7de8a662d3db
[Sun, 15 Dec 2013 18:02:45 -0800] 72.  http://pollett.org/git/cinequest.git/objects/3e/4766b5b7940f5ca87af4f77cf41e0e63787c0a
[Sun, 15 Dec 2013 18:02:45 -0800] 73.  http://pollett.org/git/cinequest.git/objects/67/002efaf76ecccc03169146fa0336cc0b1ee930
[Sun, 15 Dec 2013 18:02:45 -0800] 74.  http://pollett.org/git/cinequest.git/objects/ab/b2fa21eb3928bbe4d354be60d946a2ef103ace
[Sun, 15 Dec 2013 18:02:45 -0800] 75.  http://pollett.org/git/cinequest.git/objects/83/0600a45d63b4040716c8f379ce0bec28a2acc2
[Sun, 15 Dec 2013 18:02:45 -0800] 76.  http://pollett.org/git/cinequest.git/objects/50/8888b3588d1a5cd2f0f1f886411023fc8a1d18
[Sun, 15 Dec 2013 18:02:45 -0800] 77.  http://pollett.org/git/cinequest.git/objects/a2/763eb3371f4d70bb4660e233450b4dd3428287
[Sun, 15 Dec 2013 18:02:45 -0800] 78.  http://pollett.org/git/cinequest.git/objects/6c/1f9b388e20dc30d48300bf27a9c5c2c3f98108
[Sun, 15 Dec 2013 18:02:45 -0800] 79.  http://pollett.org/git/cinequest.git/objects/71/12f7110d17ebedb513d8be1acdbc406ab6ac9f
[Sun, 15 Dec 2013 18:02:45 -0800] 80.  http://pollett.org/git/cinequest.git/objects/aa/989d53c02f7facfa21d29ee75eb03e5fdbd827
[Sun, 15 Dec 2013 18:02:45 -0800] 81.  http://pollett.org/git/cinequest.git/objects/5c/6facb22488e8bd069e8224f2c658404f9419ba
[Sun, 15 Dec 2013 18:02:45 -0800] 82.  http://pollett.org/git/cinequest.git/objects/a6/e2fe829b3172bc69cc0c33b63700114edb8942
[Sun, 15 Dec 2013 18:02:45 -0800] 83.  http://pollett.org/git/cinequest.git/objects/09/6a339beefb929772b1a40714433cbb8e7a4a43
[Sun, 15 Dec 2013 18:02:45 -0800] 84.  http://pollett.org/git/cinequest.git/objects/0c/0f8a40a435fde2b6d1bd3fcdd38e05b0486f4b
[Sun, 15 Dec 2013 18:02:45 -0800] 85.  http://pollett.org/git/cinequest.git/objects/68/19c04dc84cc890f7da79dbb566faca6777ec28
[Sun, 15 Dec 2013 18:02:45 -0800] 86.  http://pollett.org/git/cinequest.git/objects/27/88e8e3365edaefeb503c545239abd7c7e9b5e1
[Sun, 15 Dec 2013 18:02:45 -0800] 87.  http://pollett.org/git/cinequest.git/objects/32/2d852bb246f5bbc9f2856a2acdb1f59c9a7da0
[Sun, 15 Dec 2013 18:02:45 -0800] 88.  http://pollett.org/git/cinequest.git/objects/23/fa10657e1d23800fed76a4077f4201715d2595
[Sun, 15 Dec 2013 18:02:45 -0800] 89.  http://pollett.org/git/cinequest.git/objects/c1/ae5e780ed83462d14b8a282d513de71833b968
[Sun, 15 Dec 2013 18:02:45 -0800] 90.  http://pollett.org/git/cinequest.git/objects/cd/e2d3935ed6b71ec1c12bd8fa1844c9668016f1
[Sun, 15 Dec 2013 18:02:45 -0800] 91.  http://pollett.org/git/cinequest.git/objects/4d/fe057da2e46a981d0f2f5a107f1c5f72f9d2c4
[Sun, 15 Dec 2013 18:02:45 -0800] 92.  http://pollett.org/git/cinequest.git/objects/5e/03c65a05379c43455c1123300b2307746fa549
[Sun, 15 Dec 2013 18:02:45 -0800] 93.  http://pollett.org/git/cinequest.git/objects/08/45514db267c197d669d492e5365f62d463ef8b
[Sun, 15 Dec 2013 18:02:45 -0800] 94.  http://pollett.org/git/cinequest.git/objects/f2/8ca584af3b3a01e688be4b36661cbe39503e87
[Sun, 15 Dec 2013 18:02:45 -0800] 95.  http://pollett.org/git/cinequest.git/objects/ac/0e710ff0d6cabcd8db1d05623beb426d891174
[Sun, 15 Dec 2013 18:02:45 -0800] 96.  http://pollett.org/git/cinequest.git/objects/a3/09178d0a17ba4c79af38440111de9447404915
[Sun, 15 Dec 2013 18:02:45 -0800] 97.  http://pollett.org/git/cinequest.git/objects/3c/96d992f62d46b17fb60aaa2898a1f598df2949
[Sun, 15 Dec 2013 18:02:45 -0800] 98.  http://pollett.org/git/cinequest.git/objects/8a/8a474af483da5ba243b1b31c8bd429458b43bf
[Sun, 15 Dec 2013 18:02:45 -0800] 99.  http://pollett.org/git/cinequest.git/objects/bf/cc9eed830fb0cc8b24add5d5013e0bdd8edaf9
[Sun, 15 Dec 2013 18:02:45 -0800] 100.  http://pollett.org/git/cinequest.git/objects/52/590af41903d95cba138aa812bb7af3742553fc
[Sun, 15 Dec 2013 18:02:45 -0800]   Done Update Found Sites Array Time 0.006885
[Sun, 15 Dec 2013 18:02:45 -0800] Checking name server:
[Sun, 15 Dec 2013 18:02:45 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:02:45 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:02:45 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:02:46 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:02:46 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:02:46 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:02:46 -0800]   Current to crawl count:1
[Sun, 15 Dec 2013 18:02:46 -0800]   Current to crawl try again count:0
[Sun, 15 Dec 2013 18:02:46 -0800] So not checking scheduler.
[Sun, 15 Dec 2013 18:02:46 -0800] Fetch url list to download time 0.000651
[Sun, 15 Dec 2013 18:02:46 -0800] Downloading list of urls...
[Sun, 15 Dec 2013 18:02:46 -0800]   Init Get Pages 0.01252
[Sun, 15 Dec 2013 18:02:49 -0800]   Page Request time 3.301297
[Sun, 15 Dec 2013 18:02:49 -0800]   Get Page Content time 0.065954
[Sun, 15 Dec 2013 18:02:59 -0800]   Sort downloaded/not downloaded 0.00017700000000004
[Sun, 15 Dec 2013 18:02:59 -0800]   Scheduling again..
[Sun, 15 Dec 2013 18:02:59 -0800] ....done.
[Sun, 15 Dec 2013 18:02:59 -0800] Downloading complete
[Sun, 15 Dec 2013 18:02:59 -0800] Start process pages... Current Memory:13202440
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:02:59 -0800]   Process pages time: 0.186641 Current Memory: 14579728
[Sun, 15 Dec 2013 18:02:59 -0800] Number of summarized pages 100
[Sun, 15 Dec 2013 18:02:59 -0800]   Updating Found Sites Array...
[Sun, 15 Dec 2013 18:02:59 -0800] 101.  http://pollett.org/git/cinequest.git/objects/1f/789ae6b1107152e956c98de17b61087c3e5678
[Sun, 15 Dec 2013 18:02:59 -0800] 102.  http://pollett.org/git/cinequest.git/objects/9f/70fd27ef6d95fd47b8a610c8c1d386aed4d809
[Sun, 15 Dec 2013 18:02:59 -0800] 103.  http://pollett.org/git/cinequest.git/objects/8f/ae7e6d3bbc86b9ffecd2c5864b59a0bf622e69
[Sun, 15 Dec 2013 18:02:59 -0800] 104.  http://pollett.org/git/cinequest.git/objects/3a/473e7c439bae249fe71dcac79f6f71f28c0852
[Sun, 15 Dec 2013 18:02:59 -0800] 105.  http://pollett.org/git/cinequest.git/objects/b5/24393105a32032b6209147cad29dd8526c3a01
[Sun, 15 Dec 2013 18:02:59 -0800] 106.  http://pollett.org/git/cinequest.git/objects/94/a9ed024d3859793618152ea559a168bbcbb5e2
[Sun, 15 Dec 2013 18:02:59 -0800] 107.  http://pollett.org/git/cinequest.git/objects/f9/910d7d400b183d57e5c0a298e9a85f8526cb0e
[Sun, 15 Dec 2013 18:02:59 -0800] 108.  http://pollett.org/git/cinequest.git/objects/cc/ee31062692d2474cc8d228a2fe1497ca91b29f
[Sun, 15 Dec 2013 18:02:59 -0800] 109.  http://pollett.org/git/cinequest.git/objects/28/b7e9abf3df3f533eac70c09c7ab92a7e585577
[Sun, 15 Dec 2013 18:02:59 -0800] 110.  http://pollett.org/git/cinequest.git/objects/41/053298c157168ce1e75908b6afddcdf19c235c
[Sun, 15 Dec 2013 18:02:59 -0800] 111.  http://pollett.org/git/cinequest.git/objects/82/5727aa556d19236ee2ba99c55f93dad7c01cc6
[Sun, 15 Dec 2013 18:02:59 -0800] 112.  http://pollett.org/git/cinequest.git/objects/7f/f8f232587cc5deb48b1701b27b0247bc18ca02
[Sun, 15 Dec 2013 18:02:59 -0800] 113.  http://pollett.org/git/cinequest.git/objects/18/5a2be2d4516c5bc0e0a0903eb156a5c32b5bf3
[Sun, 15 Dec 2013 18:02:59 -0800] 114.  http://pollett.org/git/cinequest.git/objects/13/40e485622fbc7d46964fc06678ad6c895db675
[Sun, 15 Dec 2013 18:02:59 -0800] 115.  http://pollett.org/git/cinequest.git/objects/e6/08a0c19c66c6785ec7938a851c72660b5d81c8
[Sun, 15 Dec 2013 18:02:59 -0800] 116.  http://pollett.org/git/cinequest.git/objects/0d/2bcb062a6fbe5ba5ac15edcbbfed358e796e78
[Sun, 15 Dec 2013 18:02:59 -0800] 117.  http://pollett.org/git/cinequest.git/objects/12/09185c8a0ca1bd3df28f1a0613345bd4aa0cf7
[Sun, 15 Dec 2013 18:02:59 -0800] 118.  http://pollett.org/git/cinequest.git/objects/7e/36571a6674f44df415e54d26b67c5e2bee6b13
[Sun, 15 Dec 2013 18:02:59 -0800] 119.  http://pollett.org/git/cinequest.git/objects/34/ff5602f1faa311993db737ecf20afefafeeb63
[Sun, 15 Dec 2013 18:02:59 -0800] 120.  http://pollett.org/git/cinequest.git/objects/19/d7aa60ab855597bdaa600db5f55bdabccafd2c
[Sun, 15 Dec 2013 18:02:59 -0800] 121.  http://pollett.org/git/cinequest.git/objects/bc/6d9a05294b9d9ea1b89e92d6dd043fc30f8a26
[Sun, 15 Dec 2013 18:02:59 -0800] 122.  http://pollett.org/git/cinequest.git/objects/e3/b998e603b793b3c77d2c195102d1b9e5258687
[Sun, 15 Dec 2013 18:02:59 -0800] 123.  http://pollett.org/git/cinequest.git/objects/27/b19adcf307f48e3ad84901080455d23a5de47f
[Sun, 15 Dec 2013 18:02:59 -0800] 124.  http://pollett.org/git/cinequest.git/objects/4c/da6c3671f19fe5e6829472171535aabd74e7ee
[Sun, 15 Dec 2013 18:02:59 -0800] 125.  http://pollett.org/git/cinequest.git/objects/15/a14b895be709c88c6af873cb30b51837013cbb
[Sun, 15 Dec 2013 18:02:59 -0800] 126.  http://pollett.org/git/cinequest.git/objects/ae/8758437e9f0bd03955e053450d2e648d0cd69d
[Sun, 15 Dec 2013 18:02:59 -0800] 127.  http://pollett.org/git/cinequest.git/objects/2c/3a9fd6afd231c349a2a6874201bd58e82bafcb
[Sun, 15 Dec 2013 18:02:59 -0800] 128.  http://pollett.org/git/cinequest.git/objects/65/d63fb52febb2ce48176624b25ff7e1e9f011d3
[Sun, 15 Dec 2013 18:02:59 -0800] 129.  http://pollett.org/git/cinequest.git/objects/0f/3bb81e0121071e6fc71005eedd260a9fcb1fd9
[Sun, 15 Dec 2013 18:02:59 -0800] 130.  http://pollett.org/git/cinequest.git/objects/09/06e7dd070ed2c48351d650d5a988a62983e484
[Sun, 15 Dec 2013 18:02:59 -0800] 131.  http://pollett.org/git/cinequest.git/objects/72/2c7e3e3e42e7d5c0ed6301a25641acbd7d4d20
[Sun, 15 Dec 2013 18:02:59 -0800] 132.  http://pollett.org/git/cinequest.git/objects/31/01825001b6052430c029544455e371c16d5f7c
[Sun, 15 Dec 2013 18:02:59 -0800] 133.  http://pollett.org/git/cinequest.git/objects/83/21532fdcb9a8fd27fd48e9e98b5234c65f507d
[Sun, 15 Dec 2013 18:02:59 -0800] 134.  http://pollett.org/git/cinequest.git/objects/6e/ff6e2e247632eb0904611593fbd4ce1ee9ec75
[Sun, 15 Dec 2013 18:02:59 -0800] 135.  http://pollett.org/git/cinequest.git/objects/e2/d89e5aa7bd1010f3af16d58f75375fae5a1b77
[Sun, 15 Dec 2013 18:02:59 -0800] 136.  http://pollett.org/git/cinequest.git/objects/7c/c4e1bd32f63516e8e69b358629bbd78cd6f648
[Sun, 15 Dec 2013 18:02:59 -0800] 137.  http://pollett.org/git/cinequest.git/objects/c1/749f40a4775cde925ac300e379946c8e07c5b8
[Sun, 15 Dec 2013 18:02:59 -0800] 138.  http://pollett.org/git/cinequest.git/objects/5d/285b9940ed1cff1244ec4fb89e686a887b04e8
[Sun, 15 Dec 2013 18:02:59 -0800] 139.  http://pollett.org/git/cinequest.git/objects/61/80d5f76fb4cf25a0cbbfb05b76bbb6e6abf9e2
[Sun, 15 Dec 2013 18:02:59 -0800] 140.  http://pollett.org/git/cinequest.git/objects/37/3d192348ee87b4184d32437ff95b136f05e9ed
[Sun, 15 Dec 2013 18:02:59 -0800] 141.  http://pollett.org/git/cinequest.git/objects/0f/67b34244d36ef9faa8fcb0973d9172c929dc22
[Sun, 15 Dec 2013 18:02:59 -0800] 142.  http://pollett.org/git/cinequest.git/objects/67/b29036a0786b0fd10768cb1ab5f0b228af8a26
[Sun, 15 Dec 2013 18:02:59 -0800] 143.  http://pollett.org/git/cinequest.git/objects/7b/997a0c3353761a4f95786a29fde297a8c04927
[Sun, 15 Dec 2013 18:02:59 -0800] 144.  http://pollett.org/git/cinequest.git/objects/8e/580e06712d9662839b7c46339dec25f8a8e0ef
[Sun, 15 Dec 2013 18:02:59 -0800] 145.  http://pollett.org/git/cinequest.git/objects/2c/d4315e8621b836384c90a403dc2f5fe139758d
[Sun, 15 Dec 2013 18:02:59 -0800] 146.  http://pollett.org/git/cinequest.git/objects/1a/f8c01f0e8967bbb66f65506c68c2adef33c03d
[Sun, 15 Dec 2013 18:02:59 -0800] 147.  http://pollett.org/git/cinequest.git/objects/99/34c7ec725521d849099ec53486839a4480a62d
[Sun, 15 Dec 2013 18:02:59 -0800] 148.  http://pollett.org/git/cinequest.git/objects/7a/8d976c65765b431c6b73e5e5d038ff37ff1130
[Sun, 15 Dec 2013 18:02:59 -0800] 149.  http://pollett.org/git/cinequest.git/objects/3d/16deac1afb1b717a7f015decb68c5fe38155c2
[Sun, 15 Dec 2013 18:02:59 -0800] 150.  http://pollett.org/git/cinequest.git/objects/33/2e08bfdb91aec9811ce0b2dfbd42abe1513028
[Sun, 15 Dec 2013 18:02:59 -0800] 151.  http://pollett.org/git/cinequest.git/objects/37/a878459a695f5c4ed16b92062729d5eae133fa
[Sun, 15 Dec 2013 18:02:59 -0800] 152.  http://pollett.org/git/cinequest.git/objects/aa/41c632ba3db526c09a4f49967530cd07e01b64
[Sun, 15 Dec 2013 18:02:59 -0800] 153.  http://pollett.org/git/cinequest.git/objects/90/09d179b31d98497312391692c91da37908412f
[Sun, 15 Dec 2013 18:02:59 -0800] 154.  http://pollett.org/git/cinequest.git/objects/65/417740367a49ffb6124ccf7b940b4c35791643
[Sun, 15 Dec 2013 18:02:59 -0800] 155.  http://pollett.org/git/cinequest.git/objects/b8/652ba7454d31a118d31b19fcdc2b8f2da55e22
[Sun, 15 Dec 2013 18:02:59 -0800] 156.  http://pollett.org/git/cinequest.git/objects/3d/bbb8c78fbd6b7884d2752b958d403386d3f1d6
[Sun, 15 Dec 2013 18:02:59 -0800] 157.  http://pollett.org/git/cinequest.git/objects/3c/58c756217a67a5b85d41ea6551b70d4012cc70
[Sun, 15 Dec 2013 18:02:59 -0800] 158.  http://pollett.org/git/cinequest.git/objects/bd/5de90c9e6388bfcf7cc721267b5edcabc83636
[Sun, 15 Dec 2013 18:02:59 -0800] 159.  http://pollett.org/git/cinequest.git/objects/a7/84ce70b19e84534219d5ea75e137f4d59a606d
[Sun, 15 Dec 2013 18:02:59 -0800] 160.  http://pollett.org/git/cinequest.git/objects/50/c27e7d42157bcfb77412dd29282b4ae01178b3
[Sun, 15 Dec 2013 18:02:59 -0800] 161.  http://pollett.org/git/cinequest.git/objects/5b/5dab2ab7b1c50dea9cfe73dc5a269a92d2d4b4
[Sun, 15 Dec 2013 18:02:59 -0800] 162.  http://pollett.org/git/cinequest.git/objects/ac/8b229af950c29356abf64a6c4aa894575445f0
[Sun, 15 Dec 2013 18:02:59 -0800] 163.  http://pollett.org/git/cinequest.git/objects/ad/3d6346e00f246102f72f2e026ed0491988b394
[Sun, 15 Dec 2013 18:02:59 -0800] 164.  http://pollett.org/git/cinequest.git/objects/42/ccba269b6e91bef12ad0fa18be651b5ef0ee68
[Sun, 15 Dec 2013 18:02:59 -0800] 165.  http://pollett.org/git/cinequest.git/objects/5a/46b47cb16631068aee9e0bd61269fc4e95e5cd
[Sun, 15 Dec 2013 18:02:59 -0800] 166.  http://pollett.org/git/cinequest.git/objects/86/c2baa655eac8539db34f8d9adb69ec1226201c
[Sun, 15 Dec 2013 18:02:59 -0800] 167.  http://pollett.org/git/cinequest.git/objects/44/43fdc1a156babad4336f004eaf5ca5dfa0f9ab
[Sun, 15 Dec 2013 18:02:59 -0800] 168.  http://pollett.org/git/cinequest.git/objects/7c/9fa6c6edcfcdd3e5b77e6f547b719e6fc66e30
[Sun, 15 Dec 2013 18:02:59 -0800] 169.  http://pollett.org/git/cinequest.git/objects/b2/73ff111d219c9b9a8b96d57683d0075fb7871a
[Sun, 15 Dec 2013 18:02:59 -0800] 170.  http://pollett.org/git/cinequest.git/objects/09/d1cdc856c292c4ab6dd818c7543ac0828bd616
[Sun, 15 Dec 2013 18:02:59 -0800] 171.  http://pollett.org/git/cinequest.git/objects/59/bd45b907c4fd965697774ce8c5fc6b2fd9c105
[Sun, 15 Dec 2013 18:02:59 -0800] 172.  http://pollett.org/git/cinequest.git/objects/6d/02426c114be4b57aabc0a80b8a63d9e56b9eb6
[Sun, 15 Dec 2013 18:02:59 -0800] 173.  http://pollett.org/git/cinequest.git/objects/2a/b019b73ec11a485fa09378f3a0e155194f6a5d
[Sun, 15 Dec 2013 18:02:59 -0800] 174.  http://pollett.org/git/cinequest.git/objects/0f/1a7e770e833e2598ea8cc420e5a7956e4b09e6
[Sun, 15 Dec 2013 18:02:59 -0800] 175.  http://pollett.org/git/cinequest.git/objects/b2/168655ee00713c18176319f13de9df528c245b
[Sun, 15 Dec 2013 18:02:59 -0800] 176.  http://pollett.org/git/cinequest.git/objects/11/dddd00ef0e91a0bce53b034d6b5b318a84e690
[Sun, 15 Dec 2013 18:02:59 -0800] 177.  http://pollett.org/git/cinequest.git/objects/be/226805d3674eb142eac08326f5311708ccb0df
[Sun, 15 Dec 2013 18:02:59 -0800] 178.  http://pollett.org/git/cinequest.git/objects/29/69904b4f62e841da49949f0eff25e84513c935
[Sun, 15 Dec 2013 18:02:59 -0800] 179.  http://pollett.org/git/cinequest.git/objects/9c/bb9bca9fac27cffe1c3d71ae156381e7d2e323
[Sun, 15 Dec 2013 18:02:59 -0800] 180.  http://pollett.org/git/cinequest.git/objects/24/1770bf36e026566d71f58aab66047144efc62b
[Sun, 15 Dec 2013 18:02:59 -0800] 181.  http://pollett.org/git/cinequest.git/objects/2a/d7db33ed9bf40f085fe387a5ba3384ae93ab03
[Sun, 15 Dec 2013 18:02:59 -0800] 182.  http://pollett.org/git/cinequest.git/objects/17/2e165255518e978caeee85f5dc563d36781436
[Sun, 15 Dec 2013 18:02:59 -0800] 183.  http://pollett.org/git/cinequest.git/objects/d1/07dd881d4295daeb756094a97edba26120166d
[Sun, 15 Dec 2013 18:02:59 -0800] 184.  http://pollett.org/git/cinequest.git/objects/22/8ce28cb83a6c9a6eaf418013bf19f3b125cd25
[Sun, 15 Dec 2013 18:02:59 -0800] 185.  http://pollett.org/git/cinequest.git/objects/8b/bed3fd9f6e1fc2f93d1268a23e5ef50ce3d7fb
[Sun, 15 Dec 2013 18:02:59 -0800] 186.  http://pollett.org/git/cinequest.git/objects/dd/c7123eb5de47feb5753d2a14bb2fe6d8ef2873
[Sun, 15 Dec 2013 18:02:59 -0800] 187.  http://pollett.org/git/cinequest.git/objects/af/117fb52c4f81caec8f45ae3920c94b7f805300
[Sun, 15 Dec 2013 18:02:59 -0800] 188.  http://pollett.org/git/cinequest.git/objects/f5/bd6a0e4246df0f2cc873b4bfb77db32a42fa41
[Sun, 15 Dec 2013 18:02:59 -0800] 189.  http://pollett.org/git/cinequest.git/objects/14/8c36e5ba2e9dc63d44c9a730fef554074f84e0
[Sun, 15 Dec 2013 18:02:59 -0800] 190.  http://pollett.org/git/cinequest.git/objects/f5/bd6a0e4246df0f2cc873b4bfb77db32a42fa41
[Sun, 15 Dec 2013 18:02:59 -0800] 191.  http://pollett.org/git/cinequest.git/objects/ec/3a46c47a77c4be74f96558170d739fbc9c49ea
[Sun, 15 Dec 2013 18:02:59 -0800] 192.  http://pollett.org/git/cinequest.git/objects/9d/45ceddec86a8b8491c878ceb5b1a618638f7da
[Sun, 15 Dec 2013 18:02:59 -0800] 193.  http://pollett.org/git/cinequest.git/objects/a9/7b715d0755b4445d123d81986210d0f28fcffa
[Sun, 15 Dec 2013 18:02:59 -0800] 194.  http://pollett.org/git/cinequest.git/objects/12/75a6bd4fcafa386c814f30f2fd6b844c9ecbf2
[Sun, 15 Dec 2013 18:02:59 -0800] 195.  http://pollett.org/git/cinequest.git/objects/60/5391993e32da4d6cc8384b69ba8053b221fd26
[Sun, 15 Dec 2013 18:02:59 -0800] 196.  http://pollett.org/git/cinequest.git/objects/93/12f02d5d396d168510e17e1faedf864f2859b0
[Sun, 15 Dec 2013 18:02:59 -0800] 197.  http://pollett.org/git/cinequest.git/objects/e0/03d16c140584603cfc97a1f151faa99a0d62f7
[Sun, 15 Dec 2013 18:02:59 -0800] 198.  http://pollett.org/git/cinequest.git/objects/4c/e0704d1858987f2801f9a302107be004c5eb15
[Sun, 15 Dec 2013 18:02:59 -0800] 199.  http://pollett.org/git/cinequest.git/objects/c2/da5b889d84409a7937b02debf9d2e9698b1363
[Sun, 15 Dec 2013 18:02:59 -0800] 200.  http://pollett.org/git/cinequest.git/objects/08/4ecb879b9900663322beff5d735b8d225022b4
[Sun, 15 Dec 2013 18:02:59 -0800]   Done Update Found Sites Array Time 0.006955
[Sun, 15 Dec 2013 18:02:59 -0800] Checking name server:
[Sun, 15 Dec 2013 18:02:59 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:02:59 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:02:59 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:02:59 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:02:59 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:02:59 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:02:59 -0800]   Current to crawl count:1
[Sun, 15 Dec 2013 18:02:59 -0800]   Current to crawl try again count:0
[Sun, 15 Dec 2013 18:02:59 -0800] So not checking scheduler.
[Sun, 15 Dec 2013 18:02:59 -0800] Fetch url list to download time 0.00068199999999996
[Sun, 15 Dec 2013 18:02:59 -0800] Downloading list of urls...
[Sun, 15 Dec 2013 18:02:59 -0800]   Init Get Pages 0.009717
[Sun, 15 Dec 2013 18:03:06 -0800]   Page Request time 7.273234
[Sun, 15 Dec 2013 18:03:06 -0800]   Get Page Content time 0.046416
[Sun, 15 Dec 2013 18:03:15 -0800]   Sort downloaded/not downloaded 0.000162
[Sun, 15 Dec 2013 18:03:15 -0800]   Scheduling again..
[Sun, 15 Dec 2013 18:03:15 -0800] ....done.
[Sun, 15 Dec 2013 18:03:15 -0800] Downloading complete
[Sun, 15 Dec 2013 18:03:15 -0800] Start process pages... Current Memory:13779880
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:15 -0800]   Process pages time: 0.2316 Current Memory: 15026944
[Sun, 15 Dec 2013 18:03:15 -0800] Number of summarized pages 100
[Sun, 15 Dec 2013 18:03:15 -0800]   Updating Found Sites Array...
[Sun, 15 Dec 2013 18:03:15 -0800] 201.  http://pollett.org/git/cinequest.git/objects/77/f801996d3014181c0ebab14458960cfe497edd
[Sun, 15 Dec 2013 18:03:15 -0800] 202.  http://pollett.org/git/cinequest.git/objects/26/285499816658c6ca4de0ecc23dff485c7737da
[Sun, 15 Dec 2013 18:03:15 -0800] 203.  http://pollett.org/git/cinequest.git/objects/ee/e33979d66a05993ece630167d51198b1718616
[Sun, 15 Dec 2013 18:03:15 -0800] 204.  http://pollett.org/git/cinequest.git/objects/8e/47d2b5884092f8c2fe254c10bf8abec758847a
[Sun, 15 Dec 2013 18:03:15 -0800] 205.  http://pollett.org/git/cinequest.git/objects/22/4ffcae6489218f2c1b287009b719bb1cb29474
[Sun, 15 Dec 2013 18:03:15 -0800] 206.  http://pollett.org/git/cinequest.git/objects/db/c2c25bed1daadb495a88e8e0bf68cc7980088b
[Sun, 15 Dec 2013 18:03:15 -0800] 207.  http://pollett.org/git/cinequest.git/objects/0c/59cf0f5ad6ae85f0bbdec397c103d36f6a6256
[Sun, 15 Dec 2013 18:03:15 -0800] 208.  http://pollett.org/git/cinequest.git/objects/fa/c77a9963778a01582c78e752f714fc13965160
[Sun, 15 Dec 2013 18:03:15 -0800] 209.  http://pollett.org/git/cinequest.git/objects/8f/a9d28f818a31f81501f62cac730ce1b2784d81
[Sun, 15 Dec 2013 18:03:15 -0800] 210.  http://pollett.org/git/cinequest.git/objects/c7/c3b4384c2ccbd1522ccca92fd95b6ce75c1b06
[Sun, 15 Dec 2013 18:03:15 -0800] 211.  http://pollett.org/git/cinequest.git/objects/ce/cb63085e8b36163f95fdeb7847094c37cf5819
[Sun, 15 Dec 2013 18:03:15 -0800] 212.  http://pollett.org/git/cinequest.git/objects/04/088f20a12823de36dd91a0d6a9dac4ad658577
[Sun, 15 Dec 2013 18:03:15 -0800] 213.  http://pollett.org/git/cinequest.git/objects/62/c4dac4a8c1ee72eef188384f98d4aa9ad57802
[Sun, 15 Dec 2013 18:03:15 -0800] 214.  http://pollett.org/git/cinequest.git/objects/23/977c8207f79a2539b44088737412f3055430c3
[Sun, 15 Dec 2013 18:03:15 -0800] 215.  http://pollett.org/git/cinequest.git/objects/d4/a1197c2f34c842cb86961a6243831fca2fe7ce
[Sun, 15 Dec 2013 18:03:15 -0800] 216.  http://pollett.org/git/cinequest.git/objects/64/736d3084f5c124c510e4a2b5513c40a6ec2d9f
[Sun, 15 Dec 2013 18:03:15 -0800] 217.  http://pollett.org/git/cinequest.git/objects/b0/42082cca2a655236cef4aa5649baa5106dceb9
[Sun, 15 Dec 2013 18:03:15 -0800] 218.  http://pollett.org/git/cinequest.git/objects/b1/0e09c93d006f3a56e7ac9142765deb28265d0a
[Sun, 15 Dec 2013 18:03:15 -0800] 219.  http://pollett.org/git/cinequest.git/objects/07/847d4cdf93db340cc4a289d9cdb1f90e2ce921
[Sun, 15 Dec 2013 18:03:15 -0800] 220.  http://pollett.org/git/cinequest.git/objects/0f/65023ab5e8a0d6824a0dcdd36a2d06fd0d4d95
[Sun, 15 Dec 2013 18:03:15 -0800] 221.  http://pollett.org/git/cinequest.git/objects/c6/e2c15537e8c75a193e3ad31c1bc0a634916186
[Sun, 15 Dec 2013 18:03:15 -0800] 222.  http://pollett.org/git/cinequest.git/objects/1d/e2fb5e4239c12142fc9dd6f2d64984000dd425
[Sun, 15 Dec 2013 18:03:15 -0800] 223.  http://pollett.org/git/cinequest.git/objects/6c/72ea3c0034357119a3dae6897d8bf81c4252e2
[Sun, 15 Dec 2013 18:03:15 -0800] 224.  http://pollett.org/git/cinequest.git/objects/2f/6285dc5ce6564a0377a16952fe355181f51daf
[Sun, 15 Dec 2013 18:03:15 -0800] 225.  http://pollett.org/git/cinequest.git/objects/27/b612bbba87c22f55b42fab6e728343b2cdc218
[Sun, 15 Dec 2013 18:03:15 -0800] 226.  http://pollett.org/git/cinequest.git/objects/d0/abaa7c0b892e781b6f553453a0027efea014b9
[Sun, 15 Dec 2013 18:03:15 -0800] 227.  http://pollett.org/git/cinequest.git/objects/ed/2477402d14540f97fc7ca210d95c0b57731ee8
[Sun, 15 Dec 2013 18:03:15 -0800] 228.  http://pollett.org/git/cinequest.git/objects/67/c27e6734386a80c5d42a5dc61136b483d0cafc
[Sun, 15 Dec 2013 18:03:15 -0800] 229.  http://pollett.org/git/cinequest.git/objects/8b/592762dc7b471f9ae5f1d9a76defcf51b8ba32
[Sun, 15 Dec 2013 18:03:15 -0800] 230.  http://pollett.org/git/cinequest.git/objects/ba/82cbcf9057453832215dae5f38386c9a5700f9
[Sun, 15 Dec 2013 18:03:15 -0800] 231.  http://pollett.org/git/cinequest.git/objects/75/b89c05c39e76c1825f9d077ae262552d8cbada
[Sun, 15 Dec 2013 18:03:15 -0800] 232.  http://pollett.org/git/cinequest.git/objects/68/9e114a00763ad1e7e89162f371aed60509e244
[Sun, 15 Dec 2013 18:03:15 -0800] 233.  http://pollett.org/git/cinequest.git/objects/82/9431d7db1174f04ee622dfbcbb5f6804c7d6fe
[Sun, 15 Dec 2013 18:03:15 -0800] 234.  http://pollett.org/git/cinequest.git/objects/2d/2ce1fc82cd3418ed0610db22f6504fb1ef8042
[Sun, 15 Dec 2013 18:03:15 -0800] 235.  http://pollett.org/git/cinequest.git/objects/8e/e836408ad4b5426d9cadaf7f953ece4dfedd1b
[Sun, 15 Dec 2013 18:03:15 -0800] 236.  http://pollett.org/git/cinequest.git/objects/02/a5170f631b2811dd498c3376bbc2ed09f1c9ab
[Sun, 15 Dec 2013 18:03:15 -0800] 237.  http://pollett.org/git/cinequest.git/objects/46/0e4fb361c434fe8c5f44a4e0b4c843ba205563
[Sun, 15 Dec 2013 18:03:15 -0800] 238.  http://pollett.org/git/cinequest.git/objects/33/265aa5e2c14d3953386fd88f38b8b4fadb110d
[Sun, 15 Dec 2013 18:03:15 -0800] 239.  http://pollett.org/git/cinequest.git/objects/21/1e6a4e19ba4601e6c72afee11cadb726703893
[Sun, 15 Dec 2013 18:03:15 -0800] 240.  http://pollett.org/git/cinequest.git/objects/d4/7df568ce8390131ac910aa01b4942677c650dd
[Sun, 15 Dec 2013 18:03:15 -0800] 241.  http://pollett.org/git/cinequest.git/objects/39/fefa959239064f8e6660502d19ca2792265e4a
[Sun, 15 Dec 2013 18:03:15 -0800] 242.  http://pollett.org/git/cinequest.git/objects/c8/f4211820bc5e89c76f1a42bd99af43163ecfb9
[Sun, 15 Dec 2013 18:03:15 -0800] 243.  http://pollett.org/git/cinequest.git/objects/be/ca90b84763d121adc1b41f4b2c1cd10d82e086
[Sun, 15 Dec 2013 18:03:15 -0800] 244.  http://pollett.org/git/cinequest.git/objects/f4/88c85f92cf1147f50000e31921c1af15fac6eb
[Sun, 15 Dec 2013 18:03:15 -0800] 245.  http://pollett.org/git/cinequest.git/objects/0c/5533d0ea3def065e29f499954d4f9503e48a55
[Sun, 15 Dec 2013 18:03:15 -0800] 246.  http://pollett.org/git/cinequest.git/objects/fa/0f6768007a2575522338503230f1a9cf37689e
[Sun, 15 Dec 2013 18:03:15 -0800] 247.  http://pollett.org/git/cinequest.git/objects/29/d9b9635bf356e7c3f09865afb94018b0e0ffd4
[Sun, 15 Dec 2013 18:03:15 -0800] 248.  http://pollett.org/git/cinequest.git/objects/0b/eda8e72924a3ef7a5ef03378ef986ee35f0e61
[Sun, 15 Dec 2013 18:03:15 -0800] 249.  http://pollett.org/git/cinequest.git/objects/dc/a08274637a0e8a755689333bf0c0b2ee30f636
[Sun, 15 Dec 2013 18:03:15 -0800] 250.  http://pollett.org/git/cinequest.git/objects/62/79865bd476262baafa3de55b5c5861bdf8084b
[Sun, 15 Dec 2013 18:03:15 -0800] 251.  http://pollett.org/git/cinequest.git/objects/0d/0eab05447e71ca0b0320dc12b6aa085cc7ea62
[Sun, 15 Dec 2013 18:03:15 -0800] 252.  http://pollett.org/git/cinequest.git/objects/f4/a134821306cc5a62a91f02a3f43ed41536b7f4
[Sun, 15 Dec 2013 18:03:15 -0800] 253.  http://pollett.org/git/cinequest.git/objects/8a/4ecc2003ad2bfa344c873e5a68d00edb354795
[Sun, 15 Dec 2013 18:03:15 -0800] 254.  http://pollett.org/git/cinequest.git/objects/f5/78b65a95ff68fcc3a57b9284692852f2385271
[Sun, 15 Dec 2013 18:03:15 -0800] 255.  http://pollett.org/git/cinequest.git/objects/72/aed890eeffbf849407e6fa92f7a7a8b6deb83d
[Sun, 15 Dec 2013 18:03:15 -0800] 256.  http://pollett.org/git/cinequest.git/objects/57/23680df547ac20f32e56bb7536b01f7a78b438
[Sun, 15 Dec 2013 18:03:15 -0800] 257.  http://pollett.org/git/cinequest.git/objects/1a/cad3afb079e8394c21f03e8daa54cef53cbec1
[Sun, 15 Dec 2013 18:03:15 -0800] 258.  http://pollett.org/git/cinequest.git/objects/49/3e0824ae33927c1f6337ea2cb4f8f3b71a4631
[Sun, 15 Dec 2013 18:03:15 -0800] 259.  http://pollett.org/git/cinequest.git/objects/e1/58b1ae064c4104c58669b11b6bcc3838eff5b3
[Sun, 15 Dec 2013 18:03:15 -0800] 260.  http://pollett.org/git/cinequest.git/objects/4a/a96b01ef519d4802393ddf6b8da68de5e6af1d
[Sun, 15 Dec 2013 18:03:15 -0800] 261.  http://pollett.org/git/cinequest.git/objects/da/4124d88f6a702da573e0cfbfd60733fe364e79
[Sun, 15 Dec 2013 18:03:15 -0800] 262.  http://pollett.org/git/cinequest.git/objects/79/4dbdf78a1daea9f42f5c99ff9bdf25d0525c02
[Sun, 15 Dec 2013 18:03:15 -0800] 263.  http://pollett.org/git/cinequest.git/objects/51/e0cdedff38e1f0fac3bb961acb04830fe49857
[Sun, 15 Dec 2013 18:03:15 -0800] 264.  http://pollett.org/git/cinequest.git/objects/13/ae9855e4efcbd6c67646238deea1a39b5ded67
[Sun, 15 Dec 2013 18:03:15 -0800] 265.  http://pollett.org/git/cinequest.git/objects/52/d9dfa8cfaed349e8253d1d858e27c87cffaeb8
[Sun, 15 Dec 2013 18:03:15 -0800] 266.  http://pollett.org/git/cinequest.git/objects/66/e6067d494642567c29c6602a5ecdd3bac8df5f
[Sun, 15 Dec 2013 18:03:15 -0800] 267.  http://pollett.org/git/cinequest.git/objects/42/3ed532f4b6f3e2d7a078d790baec8d37bfb99a
[Sun, 15 Dec 2013 18:03:15 -0800] 268.  http://pollett.org/git/cinequest.git/objects/03/9ebc2f97b210e1b1415c2d43974d708d0aba32
[Sun, 15 Dec 2013 18:03:15 -0800] 269.  http://pollett.org/git/cinequest.git/objects/82/1c99b61465f034b04f8a8ed9ea2fd4ac0c4c4f
[Sun, 15 Dec 2013 18:03:15 -0800] 270.  http://pollett.org/git/cinequest.git/objects/b3/d102eb282d988b2d3c63af9e326df70e4cc2d7
[Sun, 15 Dec 2013 18:03:15 -0800] 271.  http://pollett.org/git/cinequest.git/objects/31/d707d8e309dcc82c3874410c572bc6e0cbd15f
[Sun, 15 Dec 2013 18:03:15 -0800] 272.  http://pollett.org/git/cinequest.git/objects/65/aa3993aef9a824dc98324b80bc4068d8cc04b4
[Sun, 15 Dec 2013 18:03:15 -0800] 273.  http://pollett.org/git/cinequest.git/objects/06/4ba92422213ea01d793867e0279044261e6b60
[Sun, 15 Dec 2013 18:03:15 -0800] 274.  http://pollett.org/git/cinequest.git/objects/f5/bd6a0e4246df0f2cc873b4bfb77db32a42fa41
[Sun, 15 Dec 2013 18:03:15 -0800] 275.  http://pollett.org/git/cinequest.git/objects/d0/abaa7c0b892e781b6f553453a0027efea014b9
[Sun, 15 Dec 2013 18:03:15 -0800] 276.  http://pollett.org/git/cinequest.git/objects/a9/6b5bf33adfb9673d05a917b229771725998ef4
[Sun, 15 Dec 2013 18:03:15 -0800] 277.  http://pollett.org/git/cinequest.git/objects/e3/b6d7c0f723648fcd5d7b23b470d4c58d4d9b13
[Sun, 15 Dec 2013 18:03:15 -0800] 278.  http://pollett.org/git/cinequest.git/objects/ad/4bd3781b52d9681013c66b341a674ca6df1153
[Sun, 15 Dec 2013 18:03:15 -0800] 279.  http://pollett.org/git/cinequest.git/objects/e1/c60aa558ebc4701d66d89c893b9185d92926ae
[Sun, 15 Dec 2013 18:03:15 -0800] 280.  http://pollett.org/git/cinequest.git/objects/ea/6d2bece713351eb4b8eef968c3891322093624
[Sun, 15 Dec 2013 18:03:15 -0800] 281.  http://pollett.org/git/cinequest.git/objects/cb/59a04f909a30094fc0f1c15271cf1eeacc6bd2
[Sun, 15 Dec 2013 18:03:15 -0800] 282.  http://pollett.org/git/cinequest.git/objects/1e/b0d8c74541f5f0801cd03b315741a84cf54d2e
[Sun, 15 Dec 2013 18:03:15 -0800] 283.  http://pollett.org/git/cinequest.git/objects/6a/a7d6985ceab27f9436456cea71e25178319dee
[Sun, 15 Dec 2013 18:03:15 -0800] 284.  http://pollett.org/git/cinequest.git/objects/22/c3713e9d0495b83aa6e2eff7907455a6d2a726
[Sun, 15 Dec 2013 18:03:15 -0800] 285.  http://pollett.org/git/cinequest.git/objects/e5/477f75461b5de2dfe21b4e9bf8d65870487332
[Sun, 15 Dec 2013 18:03:15 -0800] 286.  http://pollett.org/git/cinequest.git/objects/36/2bd1a2239560b9f235b7a08e0cad7e4834a419
[Sun, 15 Dec 2013 18:03:15 -0800] 287.  http://pollett.org/git/cinequest.git/objects/9c/0495c61dc645e7cb4f780dc0898063b3ee0f5b
[Sun, 15 Dec 2013 18:03:15 -0800] 288.  http://pollett.org/git/cinequest.git/objects/49/8c09b2bf9e0927a25d8c8b0ada1cf6249193d2
[Sun, 15 Dec 2013 18:03:15 -0800] 289.  http://pollett.org/git/cinequest.git/objects/db/d0eb922581c4e21a35858c3bc2ab9df9f83ac9
[Sun, 15 Dec 2013 18:03:15 -0800] 290.  http://pollett.org/git/cinequest.git/objects/92/a1fbf98d02bce5dce7274869f5115fc692c1c1
[Sun, 15 Dec 2013 18:03:15 -0800] 291.  http://pollett.org/git/cinequest.git/objects/cb/59a04f909a30094fc0f1c15271cf1eeacc6bd2
[Sun, 15 Dec 2013 18:03:15 -0800] 292.  http://pollett.org/git/cinequest.git/objects/98/36f59aa8551a16554f847ef4ecb098d53b2806
[Sun, 15 Dec 2013 18:03:15 -0800] 293.  http://pollett.org/git/cinequest.git/objects/e4/5b5d8888fea2b9f301f6758de51283e71bb776
[Sun, 15 Dec 2013 18:03:15 -0800] 294.  http://pollett.org/git/cinequest.git/objects/02/884c3fcd414e35852273a3902c3c08e253ae80
[Sun, 15 Dec 2013 18:03:15 -0800] 295.  http://pollett.org/git/cinequest.git/objects/f5/bd6a0e4246df0f2cc873b4bfb77db32a42fa41
[Sun, 15 Dec 2013 18:03:15 -0800] 296.  http://pollett.org/git/cinequest.git/objects/f3/d5a38c6d9bf12c8337238b05f8746a39995a05
[Sun, 15 Dec 2013 18:03:15 -0800] 297.  http://pollett.org/git/cinequest.git/objects/92/114656bc00bf6f4802220b06eaf3e277e5b186
[Sun, 15 Dec 2013 18:03:15 -0800] 298.  http://pollett.org/git/cinequest.git/objects/53/3a257a6bf4351c7ef09fff5bc2a52f7ef619f8
[Sun, 15 Dec 2013 18:03:15 -0800] 299.  http://pollett.org/git/cinequest.git/objects/1e/ddec917b680621be37bb53003c65643d836eea
[Sun, 15 Dec 2013 18:03:15 -0800] 300.  http://pollett.org/git/cinequest.git/objects/b5/919e8c12e30bf7700a5c7305d9ec405124ab20
[Sun, 15 Dec 2013 18:03:15 -0800]   Done Update Found Sites Array Time 0.007379
[Sun, 15 Dec 2013 18:03:15 -0800] Checking name server:
[Sun, 15 Dec 2013 18:03:15 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:03:15 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:03:15 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:03:15 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:03:15 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:03:15 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:03:15 -0800]   Current to crawl count:1
[Sun, 15 Dec 2013 18:03:15 -0800]   Current to crawl try again count:0
[Sun, 15 Dec 2013 18:03:15 -0800] So not checking scheduler.
[Sun, 15 Dec 2013 18:03:15 -0800] Fetch url list to download time 0.00062299999999993
[Sun, 15 Dec 2013 18:03:15 -0800] Downloading list of urls...
[Sun, 15 Dec 2013 18:03:15 -0800]   Init Get Pages 0.012766
[Sun, 15 Dec 2013 18:03:23 -0800]   Page Request time 7.237736
[Sun, 15 Dec 2013 18:03:23 -0800]   Get Page Content time 0.042576
[Sun, 15 Dec 2013 18:03:33 -0800]   Sort downloaded/not downloaded 0.00017400000000001
[Sun, 15 Dec 2013 18:03:33 -0800]   Scheduling again..
[Sun, 15 Dec 2013 18:03:33 -0800] ....done.
[Sun, 15 Dec 2013 18:03:33 -0800] Downloading complete
[Sun, 15 Dec 2013 18:03:33 -0800] Start process pages... Current Memory:15044920
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:33 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:03:34 -0800]   Process pages time: 0.298566 Current Memory: 16696192
[Sun, 15 Dec 2013 18:03:34 -0800] Number of summarized pages 100
[Sun, 15 Dec 2013 18:03:34 -0800]   Updating Found Sites Array...
[Sun, 15 Dec 2013 18:03:34 -0800] 301.  http://pollett.org/git/cinequest.git/objects/bd/116cd25027dfd68fd7820388d900fc3b2d8961
[Sun, 15 Dec 2013 18:03:34 -0800] 302.  http://pollett.org/git/cinequest.git/objects/45/f400621dc7c63ff38638ea8036e0e73685ddf4
[Sun, 15 Dec 2013 18:03:34 -0800] 303.  http://pollett.org/git/cinequest.git/objects/da/2e82ca428bd2ec72d04f5c82bd72d67fc76a7b
[Sun, 15 Dec 2013 18:03:34 -0800] 304.  http://pollett.org/git/cinequest.git/objects/cb/074d7a2c6bff8904cb1e7a7fc2c1fecd3018d6
[Sun, 15 Dec 2013 18:03:34 -0800] 305.  http://pollett.org/git/cinequest.git/objects/e3/9fbc5d9a7269d19ec5c2b6b0cd987099e2b436
[Sun, 15 Dec 2013 18:03:34 -0800] 306.  http://pollett.org/git/cinequest.git/objects/8d/f4dca589c6025250f360a1d92a31f77e62d9c8
[Sun, 15 Dec 2013 18:03:34 -0800] 307.  http://pollett.org/git/cinequest.git/objects/f8/8ee1e1d635a888e3d605c7d075a2d6aa1f3e82
[Sun, 15 Dec 2013 18:03:34 -0800] 308.  http://pollett.org/git/cinequest.git/objects/ff/42dcd2d17fc257f9100d05d97d6f0cb416b6c5
[Sun, 15 Dec 2013 18:03:34 -0800] 309.  http://pollett.org/git/cinequest.git/objects/3d/6f1d1a65ca5c17213ff87d08fa9c18af6b7c5f
[Sun, 15 Dec 2013 18:03:34 -0800] 310.  http://pollett.org/git/cinequest.git/objects/21/fa4d5a7ebba282d2940572603f7e3bfc34bf90
[Sun, 15 Dec 2013 18:03:34 -0800] 311.  http://pollett.org/git/cinequest.git/objects/8d/3bdf9458a56c154549c00e00d2d78494ccc55c
[Sun, 15 Dec 2013 18:03:34 -0800] 312.  http://pollett.org/git/cinequest.git/objects/5c/565432436b9cd4d277e18fa5b094b2f52c946d
[Sun, 15 Dec 2013 18:03:34 -0800] 313.  http://pollett.org/git/cinequest.git/objects/f5/bd6a0e4246df0f2cc873b4bfb77db32a42fa41
[Sun, 15 Dec 2013 18:03:34 -0800] 314.  http://pollett.org/git/cinequest.git/objects/a0/0aaa230d272aed92c8da5c2abac9a87d46af75
[Sun, 15 Dec 2013 18:03:34 -0800] 315.  http://pollett.org/git/cinequest.git/objects/40/18acdceedd7344347152eae702cbcc27ea4968
[Sun, 15 Dec 2013 18:03:34 -0800] 316.  http://pollett.org/git/cinequest.git/objects/d5/40a14e6215c1c30cc844bb66c809fd51d730c1
[Sun, 15 Dec 2013 18:03:34 -0800] 317.  http://pollett.org/git/cinequest.git/objects/ca/f68fe978c94ac0709396093d3e925a8a1d417f
[Sun, 15 Dec 2013 18:03:34 -0800] 318.  http://pollett.org/git/cinequest.git/objects/01/05edb4a98a4659bb80fe03e966f04cfd908386
[Sun, 15 Dec 2013 18:03:34 -0800] 319.  http://pollett.org/git/cinequest.git/objects/d4/d11ff6bc2100808e69279b57ecd12b5048755c
[Sun, 15 Dec 2013 18:03:34 -0800] 320.  http://pollett.org/git/cinequest.git/objects/43/e0e59c2256137e3371db05a915a5b7f63dbb0d
[Sun, 15 Dec 2013 18:03:34 -0800] 321.  http://pollett.org/git/cinequest.git/objects/ac/1f210e151ec6c47b094a190c5c4c0768b79318
[Sun, 15 Dec 2013 18:03:34 -0800] 322.  http://pollett.org/git/cinequest.git/objects/8c/d1f78eceb3b432d76eb568e18dfa150a9d3f5f
[Sun, 15 Dec 2013 18:03:34 -0800] 323.  http://pollett.org/git/cinequest.git/objects/14/3564a22f2f7ee5e0f8f510a2ad861f75cfeb67
[Sun, 15 Dec 2013 18:03:34 -0800] 324.  http://pollett.org/git/cinequest.git/objects/1d/9ec77d2b365b7d03ecd78762d019850315a1ce
[Sun, 15 Dec 2013 18:03:34 -0800] 325.  http://pollett.org/git/cinequest.git/objects/9d/b7a691b47dcf8f78a2de52e2d0848cc746ef52
[Sun, 15 Dec 2013 18:03:34 -0800] 326.  http://pollett.org/git/cinequest.git/objects/67/d537651d3dcb0d1f1983cc11c8c95370de9cb2
[Sun, 15 Dec 2013 18:03:34 -0800] 327.  http://pollett.org/git/cinequest.git/objects/44/89ab04f46ee8ba4b9f9e21ad14112fcbae3e46
[Sun, 15 Dec 2013 18:03:34 -0800] 328.  http://pollett.org/git/cinequest.git/objects/e3/674da46d81a8b54e1d3957227725ca623b86ff
[Sun, 15 Dec 2013 18:03:34 -0800] 329.  http://pollett.org/git/cinequest.git/objects/6b/09aeb77ec1d8b451814c3bc1d491c88345f676
[Sun, 15 Dec 2013 18:03:34 -0800] 330.  http://pollett.org/git/cinequest.git/objects/ac/4acb5153802222af4988465fa77a2d9a3ac57b
[Sun, 15 Dec 2013 18:03:34 -0800] 331.  http://pollett.org/git/cinequest.git/objects/3e/ecb6f0f7e2c6581116067fc41b8e6910f374b0
[Sun, 15 Dec 2013 18:03:34 -0800] 332.  http://pollett.org/git/cinequest.git/objects/b2/02716ff81fd68f9c6228e02b8dd7066c79f7dc
[Sun, 15 Dec 2013 18:03:34 -0800] 333.  http://pollett.org/git/cinequest.git/objects/b3/07ef777ff0b81a10ddc14fd709f537fad5b373
[Sun, 15 Dec 2013 18:03:34 -0800] 334.  http://pollett.org/git/cinequest.git/objects/59/6b0cd2de0c917a0cc60e41e55c16144e9a1ec7
[Sun, 15 Dec 2013 18:03:34 -0800] 335.  http://pollett.org/git/cinequest.git/objects/88/fcd521aaaea7768c20d4080c0739b2e1aaf4bc
[Sun, 15 Dec 2013 18:03:34 -0800] 336.  http://pollett.org/git/cinequest.git/objects/bd/b2c3a5a201e72ca5441b728441d15a108f5f95
[Sun, 15 Dec 2013 18:03:34 -0800] 337.  http://pollett.org/git/cinequest.git/objects/8e/7723cb54e4d14e1cab9a91bd895342ab884eb7
[Sun, 15 Dec 2013 18:03:34 -0800] 338.  http://pollett.org/git/cinequest.git/objects/f5/bd6a0e4246df0f2cc873b4bfb77db32a42fa41
[Sun, 15 Dec 2013 18:03:34 -0800] 339.  http://pollett.org/git/cinequest.git/objects/b8/ee44941bbc028936fcb0026002fe9240ee4b53
[Sun, 15 Dec 2013 18:03:34 -0800] 340.  http://pollett.org/git/cinequest.git/objects/47/2bdfb366bac9ce39027538e644e5131586d586
[Sun, 15 Dec 2013 18:03:34 -0800] 341.  http://pollett.org/git/cinequest.git/objects/18/b03e40baab28b2bfd97a28748f95a00ad1b763
[Sun, 15 Dec 2013 18:03:34 -0800] 342.  http://pollett.org/git/cinequest.git/objects/7a/d43ec06bded8807963e5ed00fec0470c3d7b71
[Sun, 15 Dec 2013 18:03:34 -0800] 343.  http://pollett.org/git/cinequest.git/objects/55/ea2fe9f84246cb881273b9a130a6c9956d4596
[Sun, 15 Dec 2013 18:03:34 -0800] 344.  http://pollett.org/git/cinequest.git/objects/18/b05de46f7dd5fdae6810d32ae04fb0ec7518c0
[Sun, 15 Dec 2013 18:03:34 -0800] 345.  http://pollett.org/git/cinequest.git/objects/3d/cbc95a97c9c8bbb5fa01720d8527a0fd865e0a
[Sun, 15 Dec 2013 18:03:34 -0800] 346.  http://pollett.org/git/cinequest.git/objects/86/e857ee584c4a07f83516be46312768a5f96a8d
[Sun, 15 Dec 2013 18:03:34 -0800] 347.  http://pollett.org/git/cinequest.git/objects/8d/c18b29b908330264782cf279cbe13c67edb448
[Sun, 15 Dec 2013 18:03:34 -0800] 348.  http://pollett.org/git/cinequest.git/objects/c0/d66843510bd7b0c5231187fe3e913aa7e02ddb
[Sun, 15 Dec 2013 18:03:34 -0800] 349.  http://pollett.org/git/cinequest.git/objects/9e/771863b7834c6483264bb655a7f5911b3866aa
[Sun, 15 Dec 2013 18:03:34 -0800] 350.  http://pollett.org/git/cinequest.git/objects/b4/3c71b3e015102798c7f6f2b4e45c4518a63a88
[Sun, 15 Dec 2013 18:03:34 -0800] 351.  http://pollett.org/git/cinequest.git/objects/eb/74187bd9b09851d172e4657c69bf1adac99093
[Sun, 15 Dec 2013 18:03:34 -0800] 352.  http://pollett.org/git/cinequest.git/objects/b7/f1f024e7c4e120155d82ad98f35034d054ed98
[Sun, 15 Dec 2013 18:03:34 -0800] 353.  http://pollett.org/git/cinequest.git/objects/20/81d809d6a24c7c68313710a5b66719edee46c9
[Sun, 15 Dec 2013 18:03:34 -0800] 354.  http://pollett.org/git/cinequest.git/objects/f5/bd6a0e4246df0f2cc873b4bfb77db32a42fa41
[Sun, 15 Dec 2013 18:03:34 -0800] 355.  http://pollett.org/git/cinequest.git/objects/c8/3e405e7f7560cd5ed728b02b8ef77f61a77be1
[Sun, 15 Dec 2013 18:03:34 -0800] 356.  http://pollett.org/git/cinequest.git/objects/f5/bd6a0e4246df0f2cc873b4bfb77db32a42fa41
[Sun, 15 Dec 2013 18:03:34 -0800] 357.  http://pollett.org/git/cinequest.git/objects/0e/16447d10a957ccdea4854ebbc6a722800e46ca
[Sun, 15 Dec 2013 18:03:34 -0800] 358.  http://pollett.org/git/cinequest.git/objects/b3/16bbb49b43251abfb2ef9fbff5f34ec72b4c90
[Sun, 15 Dec 2013 18:03:34 -0800] 359.  http://pollett.org/git/cinequest.git/objects/8a/0903df20be1f89924de5e1cd52fe5929ef911d
[Sun, 15 Dec 2013 18:03:34 -0800] 360.  http://pollett.org/git/cinequest.git/objects/a2/74bae4d634565a39e5b7f547a84c5b22ccf3f2
[Sun, 15 Dec 2013 18:03:34 -0800] 361.  http://pollett.org/git/cinequest.git/objects/49/b86db7b7b45f1441cdb459ca2eaa8e5013c4b6
[Sun, 15 Dec 2013 18:03:34 -0800] 362.  http://pollett.org/git/cinequest.git/objects/0f/7695aea0570d4be515f1dc2baf447e73a7d3cd
[Sun, 15 Dec 2013 18:03:34 -0800] 363.  http://pollett.org/git/cinequest.git/objects/49/3a3e89c5b34fd3e1b839d34cdee974a334d8c9
[Sun, 15 Dec 2013 18:03:34 -0800] 364.  http://pollett.org/git/cinequest.git/objects/51/f87f6e98a2412a9e605a7e4efc12ec7992bb9d
[Sun, 15 Dec 2013 18:03:34 -0800] 365.  http://pollett.org/git/cinequest.git/objects/fe/854895e6ecc75e8bfc8aee18c1c9709e59cbbb
[Sun, 15 Dec 2013 18:03:34 -0800] 366.  http://pollett.org/git/cinequest.git/objects/f9/f13ba53b8ec40d3ecdc7de86bf97dee503e86d
[Sun, 15 Dec 2013 18:03:34 -0800] 367.  http://pollett.org/git/cinequest.git/objects/da/5463e00e4eeb8b8c1e51febf0248be1aa0c09c
[Sun, 15 Dec 2013 18:03:34 -0800] 368.  http://pollett.org/git/cinequest.git/objects/d6/915e09ec714db860cc5246cfc006bf8d18d5f0
[Sun, 15 Dec 2013 18:03:34 -0800] 369.  http://pollett.org/git/cinequest.git/objects/01/ad30221a365a72ff32ff9f85fe294e93565a77
[Sun, 15 Dec 2013 18:03:34 -0800] 370.  http://pollett.org/git/cinequest.git/objects/7b/e46caf9565f4ad1b445e919ebf2acda2a8ea6d
[Sun, 15 Dec 2013 18:03:34 -0800] 371.  http://pollett.org/git/cinequest.git/objects/bf/627c8e241046eb0175c29bc452a372ae8695fd
[Sun, 15 Dec 2013 18:03:34 -0800] 372.  http://pollett.org/git/cinequest.git/objects/06/7617ab3c274a69ec61a461192a3b94bc439033
[Sun, 15 Dec 2013 18:03:34 -0800] 373.  http://pollett.org/git/cinequest.git/objects/75/ae4cde71b5d9f2147c8f348c444e764f954690
[Sun, 15 Dec 2013 18:03:34 -0800] 374.  http://pollett.org/git/cinequest.git/objects/98/f8ee25a64d2cafe4d1b748be3fab9c0f788536
[Sun, 15 Dec 2013 18:03:34 -0800] 375.  http://pollett.org/git/cinequest.git/objects/88/8c4e92613e7b2ab7e7e38b7be45db7c5cad70f
[Sun, 15 Dec 2013 18:03:34 -0800] 376.  http://pollett.org/git/cinequest.git/objects/49/214b2946c0bd21c7483a9bf84346acbe7579f5
[Sun, 15 Dec 2013 18:03:34 -0800] 377.  http://pollett.org/git/cinequest.git/objects/0f/14a8ffe25cdd8ce910acaca517594700e056d0
[Sun, 15 Dec 2013 18:03:34 -0800] 378.  http://pollett.org/git/cinequest.git/objects/a2/1a49529c97e68db8a12f1186956c87799b51d1
[Sun, 15 Dec 2013 18:03:34 -0800] 379.  http://pollett.org/git/cinequest.git/objects/90/323d984f960ece0e250ac12f52f7f2dc936ad6
[Sun, 15 Dec 2013 18:03:34 -0800] 380.  http://pollett.org/git/cinequest.git/objects/5c/d38bb1d152406857fb239e59460469fae56192
[Sun, 15 Dec 2013 18:03:34 -0800] 381.  http://pollett.org/git/cinequest.git/objects/7b/3e7012519e33e245548231f7fd125292266f31
[Sun, 15 Dec 2013 18:03:34 -0800] 382.  http://pollett.org/git/cinequest.git/objects/ad/8bfba404edaa239dd39cba25a450b65fce0f10
[Sun, 15 Dec 2013 18:03:34 -0800] 383.  http://pollett.org/git/cinequest.git/objects/bd/dd69888754483a48417bae782dfe7dc6ee4bdd
[Sun, 15 Dec 2013 18:03:34 -0800] 384.  http://pollett.org/git/cinequest.git/objects/fc/7c0e1703da62a52adc876c7069e38bf9352101
[Sun, 15 Dec 2013 18:03:34 -0800] 385.  http://pollett.org/git/cinequest.git/objects/f3/201aacb6fb01b361b93bb21e35fe03bc6636ea
[Sun, 15 Dec 2013 18:03:34 -0800] 386.  http://pollett.org/git/cinequest.git/objects/5b/5dab2ab7b1c50dea9cfe73dc5a269a92d2d4b4
[Sun, 15 Dec 2013 18:03:34 -0800] 387.  http://pollett.org/git/cinequest.git/objects/ac/8b229af950c29356abf64a6c4aa894575445f0
[Sun, 15 Dec 2013 18:03:34 -0800] 388.  http://pollett.org/git/cinequest.git/objects/ad/3d6346e00f246102f72f2e026ed0491988b394
[Sun, 15 Dec 2013 18:03:34 -0800] 389.  http://pollett.org/git/cinequest.git/objects/42/ccba269b6e91bef12ad0fa18be651b5ef0ee68
[Sun, 15 Dec 2013 18:03:34 -0800] 390.  http://pollett.org/git/cinequest.git/objects/5a/46b47cb16631068aee9e0bd61269fc4e95e5cd
[Sun, 15 Dec 2013 18:03:34 -0800] 391.  http://pollett.org/git/cinequest.git/objects/86/c2baa655eac8539db34f8d9adb69ec1226201c
[Sun, 15 Dec 2013 18:03:34 -0800] 392.  http://pollett.org/git/cinequest.git/objects/44/43fdc1a156babad4336f004eaf5ca5dfa0f9ab
[Sun, 15 Dec 2013 18:03:34 -0800] 393.  http://pollett.org/git/cinequest.git/objects/7c/9fa6c6edcfcdd3e5b77e6f547b719e6fc66e30
[Sun, 15 Dec 2013 18:03:34 -0800] 394.  http://pollett.org/git/cinequest.git/objects/ee/039dc096a38a3753f92519546eee94bcfbeffa
[Sun, 15 Dec 2013 18:03:34 -0800] 395.  http://pollett.org/git/cinequest.git/objects/45/e8928e5284adacea3f9ec07b9b50667d2ac65f
[Sun, 15 Dec 2013 18:03:34 -0800] 396.  http://pollett.org/git/cinequest.git/objects/7e/c70d11bfb2f77374dfd00ef61ba0c3647b5a0c
[Sun, 15 Dec 2013 18:03:34 -0800] 397.  http://pollett.org/git/cinequest.git/objects/5b/a708c39172a69e069136bd1309c4322c61f571
[Sun, 15 Dec 2013 18:03:34 -0800] 398.  http://pollett.org/git/cinequest.git/objects/79/30a558099bc8d92b4264eb67a0f040460f4a4f
[Sun, 15 Dec 2013 18:03:34 -0800] 399.  http://pollett.org/git/cinequest.git/objects/32/7beb50e80abdb0d05b68bd54eaa4f51b8c315a
[Sun, 15 Dec 2013 18:03:34 -0800] 400.  http://pollett.org/git/cinequest.git/objects/bf/68bc41e0ac49537cd15074e7ccb3ca1d112f7d
[Sun, 15 Dec 2013 18:03:34 -0800]   Done Update Found Sites Array Time 0.00697
[Sun, 15 Dec 2013 18:03:34 -0800]   Start Update Server 
[Sun, 15 Dec 2013 18:03:34 -0800] Updating machine: http://localhost/yioop/
[Sun, 15 Dec 2013 18:03:34 -0800] ...18320 bytes of cache page validation data
[Sun, 15 Dec 2013 18:03:34 -0800] ...5876 bytes of schedule data
[Sun, 15 Dec 2013 18:03:34 -0800]   Start building mini inverted index ...  Current Memory:15493800
[Sun, 15 Dec 2013 18:03:34 -0800] ..Still building inverted index. Have processed 0 of 400 documents.
Last url processed was http://pollett.org/git/cinequest.git/objects/07/73811b6c1fc88bdcf51e2d0f48d2d9d68dc2f0. Current memory usage:15651312
[Sun, 15 Dec 2013 18:04:04 -0800] ..Still building inverted index. Have processed 374 of 400 documents.
Last url processed was http://pollett.org/git/cinequest.git/objects/88/8c4e92613e7b2ab7e7e38b7be45db7c5cad70f. Current memory usage:36826944
[Sun, 15 Dec 2013 18:04:05 -0800]   Build mini inverted index time 31.019857
[Sun, 15 Dec 2013 18:04:05 -0800] Saving Mini Inverted Index...
[Sun, 15 Dec 2013 18:04:05 -0800] Merge index shard postings to string to save memory.
[Sun, 15 Dec 2013 18:04:06 -0800] ..Merge Index Posting Final Copy
[Sun, 15 Dec 2013 18:04:06 -0800] ..Done Merge Index Posting Final Copy
[Sun, 15 Dec 2013 18:04:06 -0800] Saving index shard .. done merge postings to string
[Sun, 15 Dec 2013 18:04:07 -0800] Saving index shard .. make prefixes
[Sun, 15 Dec 2013 18:04:07 -0800] Saving index shard .. packed header
[Sun, 15 Dec 2013 18:04:09 -0800] Saving index shard .. wrote doc map. Done save
[Sun, 15 Dec 2013 18:04:09 -0800] ...Finish Compressing seen URLs.
[Sun, 15 Dec 2013 18:04:09 -0800] ...6164972 bytes of index data
[Sun, 15 Dec 2013 18:04:09 -0800] ...
[Sun, 15 Dec 2013 18:04:09 -0800] Sending Queue Server Part 1 of 1...
[Sun, 15 Dec 2013 18:04:09 -0800] ...sending about 6189168 bytes.
[Sun, 15 Dec 2013 18:04:09 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:04:09 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:04:10 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:04:10 -0800] Messages from Fetch Controller:
[Sun, 15 Dec 2013 18:04:10 -0800] ... Data upload complete

[Sun, 15 Dec 2013 18:04:10 -0800] post_max_size has changed was 8000000. Now is 128000000.
[Sun, 15 Dec 2013 18:04:10 -0800] Queue Server info response code: 1
[Sun, 15 Dec 2013 18:04:10 -0800] Queue Server's crawl time is: 1387159304
[Sun, 15 Dec 2013 18:04:10 -0800] Web Server peak memory usage: 30246252
[Sun, 15 Dec 2013 18:04:10 -0800] This fetcher peak memory usage: 40606312
[Sun, 15 Dec 2013 18:04:10 -0800] Updated Queue Server, sent approximately 6189168 bytes:
[Sun, 15 Dec 2013 18:04:10 -0800] ...  Current Memory:19351624
[Sun, 15 Dec 2013 18:04:10 -0800]   Update Server Time 36.269942
[Sun, 15 Dec 2013 18:04:10 -0800] Checking name server:
[Sun, 15 Dec 2013 18:04:10 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:04:10 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:04:10 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:04:10 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:04:10 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:04:10 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:04:10 -0800]   Current to crawl count:1
[Sun, 15 Dec 2013 18:04:10 -0800]   Current to crawl try again count:0
[Sun, 15 Dec 2013 18:04:10 -0800] So not checking scheduler.
[Sun, 15 Dec 2013 18:04:10 -0800] Fetch url list to download time 0.00093399999999999
[Sun, 15 Dec 2013 18:04:10 -0800] Downloading list of urls...
[Sun, 15 Dec 2013 18:04:10 -0800]   Init Get Pages 0.011399
[Sun, 15 Dec 2013 18:04:18 -0800]   Page Request time 7.388114
[Sun, 15 Dec 2013 18:04:18 -0800]   Get Page Content time 0.086514
[Sun, 15 Dec 2013 18:04:28 -0800]   Sort downloaded/not downloaded 0.00018600000000002
[Sun, 15 Dec 2013 18:04:28 -0800]   Scheduling again..
[Sun, 15 Dec 2013 18:04:28 -0800] ....done.
[Sun, 15 Dec 2013 18:04:28 -0800] Downloading complete
[Sun, 15 Dec 2013 18:04:28 -0800] Start process pages... Current Memory:12605480
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:28 -0800]   Process pages time: 0.194816 Current Memory: 13922376
[Sun, 15 Dec 2013 18:04:28 -0800] Number of summarized pages 100
[Sun, 15 Dec 2013 18:04:28 -0800]   Updating Found Sites Array...
[Sun, 15 Dec 2013 18:04:28 -0800] 401.  http://pollett.org/git/cinequest.git/objects/6d/e68673673ed4eaf1b05739d6190ca3c60bc571
[Sun, 15 Dec 2013 18:04:28 -0800] 402.  http://pollett.org/git/cinequest.git/objects/f5/2ee39b9595d9aa943a1f45ddfb163b30e1e2eb
[Sun, 15 Dec 2013 18:04:28 -0800] 403.  http://pollett.org/git/cinequest.git/objects/31/c79f9c4e2f774da90e8dccec96636ebef75cc7
[Sun, 15 Dec 2013 18:04:28 -0800] 404.  http://pollett.org/git/cinequest.git/objects/37/5d4ad92ddf9d0a227112eb6307dee1ce915cc4
[Sun, 15 Dec 2013 18:04:28 -0800] 405.  http://pollett.org/git/cinequest.git/objects/28/efc946927fdf9e3c36a97e9167cb4927b262d2
[Sun, 15 Dec 2013 18:04:28 -0800] 406.  http://pollett.org/git/cinequest.git/objects/1b/95d7f4dc4c336a2c6498686e04f98ab53a48b8
[Sun, 15 Dec 2013 18:04:28 -0800] 407.  http://pollett.org/git/cinequest.git/objects/e8/85ced6c87c6f597edde55650adc09579865ef5
[Sun, 15 Dec 2013 18:04:28 -0800] 408.  http://pollett.org/git/cinequest.git/objects/dc/706797ffa7312c65f73c5d3f70b96b6b0d3879
[Sun, 15 Dec 2013 18:04:28 -0800] 409.  http://pollett.org/git/cinequest.git/objects/2d/505fbfe5d23b5a4795ad9c1aaef7e4c57eba91
[Sun, 15 Dec 2013 18:04:28 -0800] 410.  http://pollett.org/git/cinequest.git/objects/98/2f42c589ca781f4d4096a2272f076fa483c307
[Sun, 15 Dec 2013 18:04:28 -0800] 411.  http://pollett.org/git/cinequest.git/objects/84/d27b82c85e1e403a7914c649a8e5a61bce3077
[Sun, 15 Dec 2013 18:04:28 -0800] 412.  http://pollett.org/git/cinequest.git/objects/1f/6c8f2df6a29633b4bb407114046ec74ceffc7d
[Sun, 15 Dec 2013 18:04:28 -0800] 413.  http://pollett.org/git/cinequest.git/objects/5b/5dab2ab7b1c50dea9cfe73dc5a269a92d2d4b4
[Sun, 15 Dec 2013 18:04:28 -0800] 414.  http://pollett.org/git/cinequest.git/objects/ac/8b229af950c29356abf64a6c4aa894575445f0
[Sun, 15 Dec 2013 18:04:28 -0800] 415.  http://pollett.org/git/cinequest.git/objects/ad/3d6346e00f246102f72f2e026ed0491988b394
[Sun, 15 Dec 2013 18:04:28 -0800] 416.  http://pollett.org/git/cinequest.git/objects/42/ccba269b6e91bef12ad0fa18be651b5ef0ee68
[Sun, 15 Dec 2013 18:04:28 -0800] 417.  http://pollett.org/git/cinequest.git/objects/5a/46b47cb16631068aee9e0bd61269fc4e95e5cd
[Sun, 15 Dec 2013 18:04:28 -0800] 418.  http://pollett.org/git/cinequest.git/objects/86/c2baa655eac8539db34f8d9adb69ec1226201c
[Sun, 15 Dec 2013 18:04:28 -0800] 419.  http://pollett.org/git/cinequest.git/objects/44/43fdc1a156babad4336f004eaf5ca5dfa0f9ab
[Sun, 15 Dec 2013 18:04:28 -0800] 420.  http://pollett.org/git/cinequest.git/objects/7c/9fa6c6edcfcdd3e5b77e6f547b719e6fc66e30
[Sun, 15 Dec 2013 18:04:28 -0800] 421.  http://pollett.org/git/cinequest.git/objects/b2/73ff111d219c9b9a8b96d57683d0075fb7871a
[Sun, 15 Dec 2013 18:04:28 -0800] 422.  http://pollett.org/git/cinequest.git/objects/09/d1cdc856c292c4ab6dd818c7543ac0828bd616
[Sun, 15 Dec 2013 18:04:28 -0800] 423.  http://pollett.org/git/cinequest.git/objects/59/bd45b907c4fd965697774ce8c5fc6b2fd9c105
[Sun, 15 Dec 2013 18:04:28 -0800] 424.  http://pollett.org/git/cinequest.git/objects/6d/02426c114be4b57aabc0a80b8a63d9e56b9eb6
[Sun, 15 Dec 2013 18:04:28 -0800] 425.  http://pollett.org/git/cinequest.git/objects/2a/b019b73ec11a485fa09378f3a0e155194f6a5d
[Sun, 15 Dec 2013 18:04:28 -0800] 426.  http://pollett.org/git/cinequest.git/objects/0f/1a7e770e833e2598ea8cc420e5a7956e4b09e6
[Sun, 15 Dec 2013 18:04:28 -0800] 427.  http://pollett.org/git/cinequest.git/objects/32/7beb50e80abdb0d05b68bd54eaa4f51b8c315a
[Sun, 15 Dec 2013 18:04:28 -0800] 428.  http://pollett.org/git/cinequest.git/objects/bf/68bc41e0ac49537cd15074e7ccb3ca1d112f7d
[Sun, 15 Dec 2013 18:04:28 -0800] 429.  http://pollett.org/git/cinequest.git/objects/6d/e68673673ed4eaf1b05739d6190ca3c60bc571
[Sun, 15 Dec 2013 18:04:28 -0800] 430.  http://pollett.org/git/cinequest.git/objects/f5/2ee39b9595d9aa943a1f45ddfb163b30e1e2eb
[Sun, 15 Dec 2013 18:04:28 -0800] 431.  http://pollett.org/git/cinequest.git/objects/31/c79f9c4e2f774da90e8dccec96636ebef75cc7
[Sun, 15 Dec 2013 18:04:28 -0800] 432.  http://pollett.org/git/cinequest.git/objects/37/5d4ad92ddf9d0a227112eb6307dee1ce915cc4
[Sun, 15 Dec 2013 18:04:28 -0800] 433.  http://pollett.org/git/cinequest.git/objects/28/efc946927fdf9e3c36a97e9167cb4927b262d2
[Sun, 15 Dec 2013 18:04:28 -0800] 434.  http://pollett.org/git/cinequest.git/objects/1b/95d7f4dc4c336a2c6498686e04f98ab53a48b8
[Sun, 15 Dec 2013 18:04:28 -0800] 435.  http://pollett.org/git/cinequest.git/objects/e8/85ced6c87c6f597edde55650adc09579865ef5
[Sun, 15 Dec 2013 18:04:28 -0800] 436.  http://pollett.org/git/cinequest.git/objects/dc/706797ffa7312c65f73c5d3f70b96b6b0d3879
[Sun, 15 Dec 2013 18:04:28 -0800] 437.  http://pollett.org/git/cinequest.git/objects/2d/505fbfe5d23b5a4795ad9c1aaef7e4c57eba91
[Sun, 15 Dec 2013 18:04:28 -0800] 438.  http://pollett.org/git/cinequest.git/objects/98/2f42c589ca781f4d4096a2272f076fa483c307
[Sun, 15 Dec 2013 18:04:28 -0800] 439.  http://pollett.org/git/cinequest.git/objects/84/d27b82c85e1e403a7914c649a8e5a61bce3077
[Sun, 15 Dec 2013 18:04:28 -0800] 440.  http://pollett.org/git/cinequest.git/objects/ed/f011e6c46d24a66cd82b6a951b6d58161eb775
[Sun, 15 Dec 2013 18:04:28 -0800] 441.  http://pollett.org/git/cinequest.git/objects/9a/8ffb6a3d542c177fc7d6d538f18325ffe663b9
[Sun, 15 Dec 2013 18:04:28 -0800] 442.  http://pollett.org/git/cinequest.git/objects/09/22ef7a1c020367faf0e8e394850afaddc3f57b
[Sun, 15 Dec 2013 18:04:28 -0800] 443.  http://pollett.org/git/cinequest.git/objects/e0/e1685d845be6ed1eb739968cfb17bf17cf1daa
[Sun, 15 Dec 2013 18:04:28 -0800] 444.  http://pollett.org/git/cinequest.git/objects/74/3a15db0de17ac1761aee357f8f596f228afb8f
[Sun, 15 Dec 2013 18:04:28 -0800] 445.  http://pollett.org/git/cinequest.git/objects/57/802a40bafb54bd616c7cbcc173e71b6988c8bc
[Sun, 15 Dec 2013 18:04:28 -0800] 446.  http://pollett.org/git/cinequest.git/objects/c1/9d20fb1f4530b87654ed412147a82d994435a2
[Sun, 15 Dec 2013 18:04:28 -0800] 447.  http://pollett.org/git/cinequest.git/objects/d4/dc8b0ec27623179bf16c6072c9db5905184839
[Sun, 15 Dec 2013 18:04:28 -0800] 448.  http://pollett.org/git/cinequest.git/objects/b1/28e699efde4f6086924d2942040fb50b34432c
[Sun, 15 Dec 2013 18:04:28 -0800] 449.  http://pollett.org/git/cinequest.git/objects/98/05bcdb826ee5d526b937a80babc2e754d381b6
[Sun, 15 Dec 2013 18:04:28 -0800] 450.  http://pollett.org/git/cinequest.git/objects/17/6044e18606dae7d048702aae6578bc20ea923a
[Sun, 15 Dec 2013 18:04:28 -0800] 451.  http://pollett.org/git/cinequest.git/objects/16/6f53716e18d0030891259cd053d05b088371ce
[Sun, 15 Dec 2013 18:04:28 -0800] 452.  http://pollett.org/git/cinequest.git/objects/6d/775f995f94680d1371c71f383e291a65d272b3
[Sun, 15 Dec 2013 18:04:28 -0800] 453.  http://pollett.org/git/cinequest.git/objects/c1/a1020a1406be78ceaaf9b44a798c1df1404fc0
[Sun, 15 Dec 2013 18:04:28 -0800] 454.  http://pollett.org/git/cinequest.git/objects/16/a096e758aac16da7004b5e02dbb7c53e9a4e6c
[Sun, 15 Dec 2013 18:04:28 -0800] 455.  http://pollett.org/git/cinequest.git/objects/78/19df0528600323db8e0c252c1840fc7b3ceb85
[Sun, 15 Dec 2013 18:04:28 -0800] 456.  http://pollett.org/git/cinequest.git/objects/6c/abc2c468ed2d3269b6b704c4d913807e3c1b97
[Sun, 15 Dec 2013 18:04:28 -0800] 457.  http://pollett.org/git/cinequest.git/objects/a0/2133de3ff48e56bf9305b0e5d921ab1fc91228
[Sun, 15 Dec 2013 18:04:28 -0800] 458.  http://pollett.org/git/cinequest.git/objects/92/f81f63786f916fa1668b70cfacba1f56c1c419
[Sun, 15 Dec 2013 18:04:28 -0800] 459.  http://pollett.org/git/cinequest.git/objects/be/e4bfba28d03b391b62dafb8ae34ed8dced8bc7
[Sun, 15 Dec 2013 18:04:28 -0800] 460.  http://pollett.org/git/cinequest.git/objects/81/de4da4a9e2a5558fec502a8c36f4e33d8d36ea
[Sun, 15 Dec 2013 18:04:28 -0800] 461.  http://pollett.org/git/cinequest.git/objects/e1/f25fd84ca2c9b515731158e28b18967516f52d
[Sun, 15 Dec 2013 18:04:28 -0800] 462.  http://pollett.org/git/cinequest.git/objects/8a/6cb99cbc7f95780979d50f5d2969c465ca79f7
[Sun, 15 Dec 2013 18:04:28 -0800] 463.  http://pollett.org/git/cinequest.git/objects/24/4eacff44af40ce60a45b6669cb0ff2fa49bb51
[Sun, 15 Dec 2013 18:04:28 -0800] 464.  http://pollett.org/git/cinequest.git/objects/7e/793639f5f0f2f623e3623658603cd0d4175177
[Sun, 15 Dec 2013 18:04:28 -0800] 465.  http://pollett.org/git/cinequest.git/objects/27/8403e8f17e676a8fa74d65483badfd9a350dfa
[Sun, 15 Dec 2013 18:04:28 -0800] 466.  http://pollett.org/git/cinequest.git/objects/88/a7866897ac15f65a647897b6001dd32b0f0831
[Sun, 15 Dec 2013 18:04:28 -0800] 467.  http://pollett.org/git/cinequest.git/objects/1e/b3dd926f96a2f6f666ddfdb19efbeef8ab651b
[Sun, 15 Dec 2013 18:04:28 -0800] 468.  http://pollett.org/git/cinequest.git/objects/46/e63f59b2a55d2a8615134c713c7f357c438648
[Sun, 15 Dec 2013 18:04:28 -0800] 469.  http://pollett.org/git/cinequest.git/objects/c6/cc1946c47e60bd35a1b18111e49ef8583f1820
[Sun, 15 Dec 2013 18:04:28 -0800] 470.  http://pollett.org/git/cinequest.git/objects/c6/26fbb7b83cc72f99323d790dd3657bb186930a
[Sun, 15 Dec 2013 18:04:28 -0800] 471.  http://pollett.org/git/cinequest.git/objects/c5/3235a49e166a13ca29bb47e856d4aad62db380
[Sun, 15 Dec 2013 18:04:28 -0800] 472.  http://pollett.org/git/cinequest.git/objects/59/da2df671e88099229fb100950493c93e724808
[Sun, 15 Dec 2013 18:04:28 -0800] 473.  http://pollett.org/git/cinequest.git/objects/7e/b4268d41e1acbb4c94304c688c6dd6bf69a9a7
[Sun, 15 Dec 2013 18:04:28 -0800] 474.  http://pollett.org/git/cinequest.git/objects/5b/3531652d922178bde598656232d39edbab705a
[Sun, 15 Dec 2013 18:04:28 -0800] 475.  http://pollett.org/git/cinequest.git/objects/f1/f897b006a359aa91148e0ac130c106efa54b16
[Sun, 15 Dec 2013 18:04:28 -0800] 476.  http://pollett.org/git/cinequest.git/objects/67/d5119ca70ff6ba5403882d3e8bdc83e108490b
[Sun, 15 Dec 2013 18:04:28 -0800] 477.  http://pollett.org/git/cinequest.git/objects/00/3934e7212b0375ea562c9af87d6c8d2d71097f
[Sun, 15 Dec 2013 18:04:28 -0800] 478.  http://pollett.org/git/cinequest.git/objects/1e/3432c0a8f2b1f90dae879c2fde36d164e21acd
[Sun, 15 Dec 2013 18:04:28 -0800] 479.  http://pollett.org/git/cinequest.git/objects/e9/53ac04f19874aef2e1508c7edca1aeb09b220d
[Sun, 15 Dec 2013 18:04:28 -0800] 480.  http://pollett.org/git/cinequest.git/objects/78/1fe6191761d89f4bcc410588b396db3b4be82f
[Sun, 15 Dec 2013 18:04:28 -0800] 481.  http://pollett.org/git/cinequest.git/objects/25/07043a3f26b16ec7f2f64ae762a22f7a191f08
[Sun, 15 Dec 2013 18:04:28 -0800] 482.  http://pollett.org/git/cinequest.git/objects/61/fa29ccd83a2e7c10126943327054b458f19d6f
[Sun, 15 Dec 2013 18:04:28 -0800] 483.  http://pollett.org/git/cinequest.git/objects/3c/c8c796c87ac640decc13d72ee584b986e1f819
[Sun, 15 Dec 2013 18:04:28 -0800] 484.  http://pollett.org/git/cinequest.git/objects/f0/9f5aeb00dfad5a97325e79b0227cc730dbde9d
[Sun, 15 Dec 2013 18:04:28 -0800] 485.  http://pollett.org/git/cinequest.git/objects/cf/03cd4c1afa1d2bd2d76ad2eb54b629bed7663b
[Sun, 15 Dec 2013 18:04:28 -0800] 486.  http://pollett.org/git/cinequest.git/objects/6b/140aff615f840b98fa56756030d5679487774d
[Sun, 15 Dec 2013 18:04:28 -0800] 487.  http://pollett.org/git/cinequest.git/objects/50/a4613523c3e5a7a76a8642c4ecf6fde221ecf9
[Sun, 15 Dec 2013 18:04:28 -0800] 488.  http://pollett.org/git/cinequest.git/objects/07/8d1b0fa8a60eb67e8c2eaa5498568039d62002
[Sun, 15 Dec 2013 18:04:28 -0800] 489.  http://pollett.org/git/cinequest.git/objects/51/6550192a7129df4f3edb06c0f7f90e576f684e
[Sun, 15 Dec 2013 18:04:28 -0800] 490.  http://pollett.org/git/cinequest.git/objects/21/974c56cd702f2fe1b920244be7c1785edc7dec
[Sun, 15 Dec 2013 18:04:28 -0800] 491.  http://pollett.org/git/cinequest.git/objects/e7/a8683e48de50bc20b8cb378adc56138eac586a
[Sun, 15 Dec 2013 18:04:28 -0800] 492.  http://pollett.org/git/cinequest.git/objects/0b/d240e69df85b1266373183b94bb09f4f1c3ec2
[Sun, 15 Dec 2013 18:04:28 -0800] 493.  http://pollett.org/git/cinequest.git/objects/e5/f549fbf22860f5f44d502d57ed8f235b8dce50
[Sun, 15 Dec 2013 18:04:28 -0800] 494.  http://pollett.org/git/cinequest.git/objects/40/431ed8ec7f9897d912b9442349ab882232f55c
[Sun, 15 Dec 2013 18:04:28 -0800] 495.  http://pollett.org/git/cinequest.git/objects/2e/5300cfd4a69cad54f1b6b855069f17cfac8475
[Sun, 15 Dec 2013 18:04:28 -0800] 496.  http://pollett.org/git/cinequest.git/objects/ed/662392c5390a2845ba2ad7704d8e7192c297d6
[Sun, 15 Dec 2013 18:04:28 -0800] 497.  http://pollett.org/git/cinequest.git/objects/de/dfc7ff99b2bcd3947e991a2448fc67d8519f66
[Sun, 15 Dec 2013 18:04:28 -0800] 498.  http://pollett.org/git/cinequest.git/objects/11/2b40e7f8dcae5005c5e051368917b5b5e51ac0
[Sun, 15 Dec 2013 18:04:28 -0800] 499.  http://pollett.org/git/cinequest.git/objects/1d/8f7bbd9cbd07a4d4b9a8315987c695afbb25a2
[Sun, 15 Dec 2013 18:04:28 -0800] 500.  http://pollett.org/git/cinequest.git/objects/6c/4883f536d5334a660f8ca380bde3a0fc35f485
[Sun, 15 Dec 2013 18:04:28 -0800]   Done Update Found Sites Array Time 0.009207
[Sun, 15 Dec 2013 18:04:28 -0800] Checking name server:
[Sun, 15 Dec 2013 18:04:28 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:04:28 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:04:28 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:04:28 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:04:28 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:04:28 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:04:28 -0800]   Current to crawl count:1
[Sun, 15 Dec 2013 18:04:28 -0800]   Current to crawl try again count:0
[Sun, 15 Dec 2013 18:04:28 -0800] So not checking scheduler.
[Sun, 15 Dec 2013 18:04:28 -0800] Fetch url list to download time 0.00083800000000001
[Sun, 15 Dec 2013 18:04:28 -0800] Downloading list of urls...
[Sun, 15 Dec 2013 18:04:28 -0800]   Init Get Pages 0.011469
[Sun, 15 Dec 2013 18:04:36 -0800]   Page Request time 7.393629
[Sun, 15 Dec 2013 18:04:36 -0800]   Get Page Content time 0.098567
[Sun, 15 Dec 2013 18:04:46 -0800]   Sort downloaded/not downloaded 0.00018000000000001
[Sun, 15 Dec 2013 18:04:46 -0800]   Scheduling again..
[Sun, 15 Dec 2013 18:04:46 -0800] ....done.
[Sun, 15 Dec 2013 18:04:46 -0800] Downloading complete
[Sun, 15 Dec 2013 18:04:46 -0800] Start process pages... Current Memory:13995456
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:04:46 -0800]   Process pages time: 0.376041 Current Memory: 15997416
[Sun, 15 Dec 2013 18:04:46 -0800] Number of summarized pages 100
[Sun, 15 Dec 2013 18:04:46 -0800]   Updating Found Sites Array...
[Sun, 15 Dec 2013 18:04:46 -0800] 501.  http://pollett.org/git/cinequest.git/objects/06/c4c628c4066d0a1dc1e9f257e2bf25cf2d69d0
[Sun, 15 Dec 2013 18:04:46 -0800] 502.  http://pollett.org/git/cinequest.git/objects/dd/51e359c35b468fab45c0326f93013deedd176c
[Sun, 15 Dec 2013 18:04:46 -0800] 503.  http://pollett.org/git/cinequest.git/objects/fc/8d9d1a76ea92afabce92ef86ab28384addef6e
[Sun, 15 Dec 2013 18:04:46 -0800] 504.  http://pollett.org/git/cinequest.git/objects/1d/628a90e8389f15a40bdc6c976df2cc27d36b90
[Sun, 15 Dec 2013 18:04:46 -0800] 505.  http://pollett.org/git/cinequest.git/objects/e9/c1f16a2f2d2be0dec31751cb222bad12086ad5
[Sun, 15 Dec 2013 18:04:46 -0800] 506.  http://pollett.org/git/cinequest.git/objects/aa/96a841d956d1a049c2bda26d0c6b9dee98ec0f
[Sun, 15 Dec 2013 18:04:46 -0800] 507.  http://pollett.org/git/cinequest.git/objects/0f/aacbfec07ebc624700616fd7d7fb30c4e98bc7
[Sun, 15 Dec 2013 18:04:46 -0800] 508.  http://pollett.org/git/cinequest.git/objects/d1/cffc23ffb89fdfd3e2ac279fdcae29b26bb682
[Sun, 15 Dec 2013 18:04:46 -0800] 509.  http://pollett.org/git/cinequest.git/objects/c3/d02043cf03bef21b2ea371333b6f6a210a30cb
[Sun, 15 Dec 2013 18:04:46 -0800] 510.  http://pollett.org/git/cinequest.git/objects/fe/dc653ad27d83d8ec34e49133e6c48a261b47a0
[Sun, 15 Dec 2013 18:04:46 -0800] 511.  http://pollett.org/git/cinequest.git/objects/6a/1c7cc4559397a6dcab214445ab3b593c7d889d
[Sun, 15 Dec 2013 18:04:46 -0800] 512.  http://pollett.org/git/cinequest.git/objects/9c/203fba6356a9af2092e06dd9c70ae728bcaf3d
[Sun, 15 Dec 2013 18:04:46 -0800] 513.  http://pollett.org/git/cinequest.git/objects/64/de0ded6078f5eccc2f515f910c559faff1d395
[Sun, 15 Dec 2013 18:04:46 -0800] 514.  http://pollett.org/git/cinequest.git/objects/38/6f709b6ac6b58fff300921af8bd4ceceb53465
[Sun, 15 Dec 2013 18:04:46 -0800] 515.  http://pollett.org/git/cinequest.git/objects/86/e5a161761418498ca325ad2c19ddf1310763bb
[Sun, 15 Dec 2013 18:04:46 -0800] 516.  http://pollett.org/git/cinequest.git/objects/99/fdd40f1130df3ace1fdb0b0e85a114cf665598
[Sun, 15 Dec 2013 18:04:46 -0800] 517.  http://pollett.org/git/cinequest.git/objects/c2/249636d22ceb69c2bec95e4811ed349c5da802
[Sun, 15 Dec 2013 18:04:46 -0800] 518.  http://pollett.org/git/cinequest.git/objects/31/080d3d378b60927320ec2cde8e8e4f89dcd75e
[Sun, 15 Dec 2013 18:04:46 -0800] 519.  http://pollett.org/git/cinequest.git/objects/ed/f79767fbd724b94da63de0ef90a227ea294e9a
[Sun, 15 Dec 2013 18:04:46 -0800] 520.  http://pollett.org/git/cinequest.git/objects/b8/2f42e5f2f59f75769bc6ea1d564caf9aff36fe
[Sun, 15 Dec 2013 18:04:46 -0800] 521.  http://pollett.org/git/cinequest.git/objects/5c/afb07b7f41183792dde81ed00dad1e0fbbf2a1
[Sun, 15 Dec 2013 18:04:46 -0800] 522.  http://pollett.org/git/cinequest.git/objects/0f/cfbfe1cfe79789da31fb30ccdf9d5b4b61b441
[Sun, 15 Dec 2013 18:04:46 -0800] 523.  http://pollett.org/git/cinequest.git/objects/05/51d904219e9ec75a4cc51dac8cd95f6cd406a3
[Sun, 15 Dec 2013 18:04:46 -0800] 524.  http://pollett.org/git/cinequest.git/objects/66/2749c56b8812de3db3f29cb73fe6192e235ca2
[Sun, 15 Dec 2013 18:04:46 -0800] 525.  http://pollett.org/git/cinequest.git/objects/46/1f5e5972fb2a551ed4a12f9add592dfaae925e
[Sun, 15 Dec 2013 18:04:46 -0800] 526.  http://pollett.org/git/cinequest.git/objects/62/fcd2b20b716dd5c6e1bedb93e1f4de5e989c5e
[Sun, 15 Dec 2013 18:04:46 -0800] 527.  http://pollett.org/git/cinequest.git/objects/3d/b2b53b38d15879ecf3f9d5c7b72bc5bbcfc494
[Sun, 15 Dec 2013 18:04:46 -0800] 528.  http://pollett.org/git/cinequest.git/objects/5b/199b2a3e8889dd81525d9304eab5151e71dc2b
[Sun, 15 Dec 2013 18:04:46 -0800] 529.  http://pollett.org/git/cinequest.git/objects/d5/fd9b9ac984ca80ea92a1307424bbdab2f20b46
[Sun, 15 Dec 2013 18:04:46 -0800] 530.  http://pollett.org/git/cinequest.git/objects/0b/8f9b6f2c9ce2f83edac98fc0dab44b1ab18714
[Sun, 15 Dec 2013 18:04:46 -0800] 531.  http://pollett.org/git/cinequest.git/objects/9b/b27becec0bc75d276bd4b82a95011ce1a45c5a
[Sun, 15 Dec 2013 18:04:46 -0800] 532.  http://pollett.org/git/cinequest.git/objects/2c/94cb14b47ebb4bc02b2ef606c7828971bca228
[Sun, 15 Dec 2013 18:04:46 -0800] 533.  http://pollett.org/git/cinequest.git/objects/4e/5165a0fe36b8475b5125551705e6cadfef68aa
[Sun, 15 Dec 2013 18:04:46 -0800] 534.  http://pollett.org/git/cinequest.git/objects/8c/40f9104b287552df634507c607c02125c1d499
[Sun, 15 Dec 2013 18:04:46 -0800] 535.  http://pollett.org/git/cinequest.git/objects/1f/80e26a538c884d42d56a00cd577355358ce2e8
[Sun, 15 Dec 2013 18:04:46 -0800] 536.  http://pollett.org/git/cinequest.git/objects/af/330e4c7efe8f6592e7fa4410bbe3e0ca5ec39e
[Sun, 15 Dec 2013 18:04:46 -0800] 537.  http://pollett.org/git/cinequest.git/objects/48/69b6bcc8cd36b55cf8bb4da02f11836d6c18db
[Sun, 15 Dec 2013 18:04:46 -0800] 538.  http://pollett.org/git/cinequest.git/objects/a2/bec45441b2c77e56bb41ec32bd74bfd04250e2
[Sun, 15 Dec 2013 18:04:46 -0800] 539.  http://pollett.org/git/cinequest.git/objects/dc/893d547cd7c95aa9a35faf2554725643b961f1
[Sun, 15 Dec 2013 18:04:46 -0800] 540.  http://pollett.org/git/cinequest.git/objects/f8/3305890bcd42e2ea6808955ab9e83c2d1f59ea
[Sun, 15 Dec 2013 18:04:46 -0800] 541.  http://pollett.org/git/cinequest.git/objects/24/69821f538bb1a9b31053a821fcdba7e64f2f4d
[Sun, 15 Dec 2013 18:04:46 -0800] 542.  http://pollett.org/git/cinequest.git/objects/67/ff80c00eaa18fa578d70d19a13ee213a3e3f45
[Sun, 15 Dec 2013 18:04:46 -0800] 543.  http://pollett.org/git/cinequest.git/objects/a6/cbe7bd2165bd9700a1aa3a644c2f970caa972b
[Sun, 15 Dec 2013 18:04:46 -0800] 544.  http://pollett.org/git/cinequest.git/objects/ea/c51f6f8a1ffa7bf73af6d0383ee20b22882fef
[Sun, 15 Dec 2013 18:04:46 -0800] 545.  http://pollett.org/git/cinequest.git/objects/a9/02d871824308694f95fde09a3e8276463392fd
[Sun, 15 Dec 2013 18:04:46 -0800] 546.  http://pollett.org/git/cinequest.git/objects/f9/fbca49d262a99cd4cc462b3d4304a5aadd52c3
[Sun, 15 Dec 2013 18:04:46 -0800] 547.  http://pollett.org/git/cinequest.git/objects/24/e5b4838acb098970ebf0532baec44aa7c3185c
[Sun, 15 Dec 2013 18:04:46 -0800] 548.  http://pollett.org/git/cinequest.git/objects/92/5650be6612ad1e9ed1d2ce265426a20b5e058f
[Sun, 15 Dec 2013 18:04:46 -0800] 549.  http://pollett.org/git/cinequest.git/objects/f8/d83dd84eebc541eec00bc4443d7e55afa346a7
[Sun, 15 Dec 2013 18:04:46 -0800] 550.  http://pollett.org/git/cinequest.git/objects/79/5fab731e7c24adffd4f566a274a4d72ab96d6f
[Sun, 15 Dec 2013 18:04:46 -0800] 551.  http://pollett.org/git/cinequest.git/objects/90/3f73e93b0e8ef962e43ec532fd4e8673c76865
[Sun, 15 Dec 2013 18:04:46 -0800] 552.  http://pollett.org/git/cinequest.git/objects/59/d7bb29fbd4c37336a272ba09860e6ee75cb9ab
[Sun, 15 Dec 2013 18:04:46 -0800] 553.  http://pollett.org/git/cinequest.git/objects/07/c83968e8a424458bd510318e25af7a4e4d6308
[Sun, 15 Dec 2013 18:04:46 -0800] 554.  http://pollett.org/git/cinequest.git/objects/a1/6bf9eb0c13f3a8b21a4fe8759a9f57a1527529
[Sun, 15 Dec 2013 18:04:46 -0800] 555.  http://pollett.org/git/cinequest.git/objects/b7/2fb94eafac2fd24d9bc22e5a5e837d4b6057ee
[Sun, 15 Dec 2013 18:04:46 -0800] 556.  http://pollett.org/git/cinequest.git/objects/dc/7904243b3079769a54479a604a741b31c1bb9c
[Sun, 15 Dec 2013 18:04:46 -0800] 557.  http://pollett.org/git/cinequest.git/objects/9c/51579ba58173ac7c234fccc795fb842adeb87d
[Sun, 15 Dec 2013 18:04:46 -0800] 558.  http://pollett.org/git/cinequest.git/objects/42/d93654dea863e02945b30ffec62131de99a4a3
[Sun, 15 Dec 2013 18:04:46 -0800] 559.  http://pollett.org/git/cinequest.git/objects/b7/58ebaeeb2be70e29ca87515710fe96fede20f5
[Sun, 15 Dec 2013 18:04:46 -0800] 560.  http://pollett.org/git/cinequest.git/objects/d6/b71b39f697ff4be876d87302a79fb4d05336ca
[Sun, 15 Dec 2013 18:04:46 -0800] 561.  http://pollett.org/git/cinequest.git/objects/3c/600af0a5eee41f95da26addae5ca5708760dd1
[Sun, 15 Dec 2013 18:04:46 -0800] 562.  http://pollett.org/git/cinequest.git/objects/cc/8dee1fe5ff93ff5052671a867f1ff7c4bfe0e8
[Sun, 15 Dec 2013 18:04:46 -0800] 563.  http://pollett.org/git/cinequest.git/objects/d0/ad528df65559a8ec6c75feb7c6ed8bc48e2ac7
[Sun, 15 Dec 2013 18:04:46 -0800] 564.  http://pollett.org/git/cinequest.git/objects/36/97f421cf82ec696504a93ef070057111a6b3f8
[Sun, 15 Dec 2013 18:04:46 -0800] 565.  http://pollett.org/git/cinequest.git/objects/64/893bb99e49e1eb8b9053a1c8d6996836b0931d
[Sun, 15 Dec 2013 18:04:46 -0800] 566.  http://pollett.org/git/cinequest.git/objects/ec/e7349877e2951ffdf865f909750bdb990570d6
[Sun, 15 Dec 2013 18:04:46 -0800] 567.  http://pollett.org/git/cinequest.git/objects/7a/ebbc9e06785037a284f224ec24b8848efa5762
[Sun, 15 Dec 2013 18:04:46 -0800] 568.  http://pollett.org/git/cinequest.git/objects/48/590ecb96a74f5987d125e7fbc5a26c1392543a
[Sun, 15 Dec 2013 18:04:46 -0800] 569.  http://pollett.org/git/cinequest.git/objects/14/c9064f7f2c8b48fa98ed2c761dd38cb7595149
[Sun, 15 Dec 2013 18:04:46 -0800] 570.  http://pollett.org/git/cinequest.git/objects/a4/2e4744e7223305c6dfeaa340353318c90b0c3a
[Sun, 15 Dec 2013 18:04:46 -0800] 571.  http://pollett.org/git/cinequest.git/objects/81/aeca8645140f6747cfcf87d800e930da9f45c7
[Sun, 15 Dec 2013 18:04:46 -0800] 572.  http://pollett.org/git/cinequest.git/objects/29/0d087ac365f1c07b4954fb36a8b769b6432ef9
[Sun, 15 Dec 2013 18:04:46 -0800] 573.  http://pollett.org/git/cinequest.git/objects/ef/0bfe1c26bd89fe513b07ff08007b6c778e25a4
[Sun, 15 Dec 2013 18:04:46 -0800] 574.  http://pollett.org/git/cinequest.git/objects/51/390be737cdfa968c9cbf0bda3567e79f244a8e
[Sun, 15 Dec 2013 18:04:46 -0800] 575.  http://pollett.org/git/cinequest.git/objects/21/b5617feca6226d7a9d7b2d49139dfc3a0e2696
[Sun, 15 Dec 2013 18:04:46 -0800] 576.  http://pollett.org/git/cinequest.git/objects/21/2c32a8f0b1774658b4c7abdc770f1263a25a23
[Sun, 15 Dec 2013 18:04:46 -0800] 577.  http://pollett.org/git/cinequest.git/objects/dd/4e13aa45fb1a61f15158450b607381e73c6236
[Sun, 15 Dec 2013 18:04:46 -0800] 578.  http://pollett.org/git/cinequest.git/objects/96/e4632ddf29e61729e67c00762535aef4f16893
[Sun, 15 Dec 2013 18:04:46 -0800] 579.  http://pollett.org/git/cinequest.git/objects/e1/2032eece9541e48c08b77e2f218001e7e414fe
[Sun, 15 Dec 2013 18:04:46 -0800] 580.  http://pollett.org/git/cinequest.git/objects/13/e39e07fff77e1424c000b71aae37e311b38b14
[Sun, 15 Dec 2013 18:04:46 -0800] 581.  http://pollett.org/git/cinequest.git/objects/21/04765e3fd0c62051cc125a1d6c5d6ef0f1f5ad
[Sun, 15 Dec 2013 18:04:46 -0800] 582.  http://pollett.org/git/cinequest.git/objects/cc/36c7ebd5cb501f2ea5592c591852458d515207
[Sun, 15 Dec 2013 18:04:46 -0800] 583.  http://pollett.org/git/cinequest.git/objects/63/510ca2fc9e3c0c366545c0da7101ff6229ef72
[Sun, 15 Dec 2013 18:04:46 -0800] 584.  http://pollett.org/git/cinequest.git/objects/9c/7cd84c3d11c2d0cb43006f576d7c52dd3cef2e
[Sun, 15 Dec 2013 18:04:46 -0800] 585.  http://pollett.org/git/cinequest.git/objects/df/bbb092e9b2abef57a6ed39111b4344278e22cb
[Sun, 15 Dec 2013 18:04:46 -0800] 586.  http://pollett.org/git/cinequest.git/objects/ee/52d86d94a40e7092dc34d1b2760244ec7dccaf
[Sun, 15 Dec 2013 18:04:46 -0800] 587.  http://pollett.org/git/cinequest.git/objects/06/01548a42fbf5e2466111e1e70544397ff9903e
[Sun, 15 Dec 2013 18:04:46 -0800] 588.  http://pollett.org/git/cinequest.git/objects/e6/00e62939f3a44b0d98c21f3358cfdf49dee817
[Sun, 15 Dec 2013 18:04:46 -0800] 589.  http://pollett.org/git/cinequest.git/objects/b1/cdf17b5bb40b4839cfc80f7e91bbcf7b94f798
[Sun, 15 Dec 2013 18:04:46 -0800] 590.  http://pollett.org/git/cinequest.git/objects/87/050477027335ed11ed9aac05ea9ef56254bf67
[Sun, 15 Dec 2013 18:04:46 -0800] 591.  http://pollett.org/git/cinequest.git/objects/f5/e367ccfaab1c8a88cfb1dc4dd62539c81d31ec
[Sun, 15 Dec 2013 18:04:46 -0800] 592.  http://pollett.org/git/cinequest.git/objects/ee/5af40eb63ed16893e6886ecfe40aed52220147
[Sun, 15 Dec 2013 18:04:46 -0800] 593.  http://pollett.org/git/cinequest.git/objects/f0/86979731b0702c7ea19ae9df47df436fd622eb
[Sun, 15 Dec 2013 18:04:46 -0800] 594.  http://pollett.org/git/cinequest.git/objects/55/80128837f05c40df726d78a43298db89ba3e5e
[Sun, 15 Dec 2013 18:04:46 -0800] 595.  http://pollett.org/git/cinequest.git/objects/a3/e7ae4cc5da6285ba451071de9b342403703ab8
[Sun, 15 Dec 2013 18:04:46 -0800] 596.  http://pollett.org/git/cinequest.git/objects/47/aea109156a633a2e2cacecf5ac5b3171d6a3c6
[Sun, 15 Dec 2013 18:04:46 -0800] 597.  http://pollett.org/git/cinequest.git/objects/dd/9a41addef9148104e35573700aadeac7633236
[Sun, 15 Dec 2013 18:04:46 -0800] 598.  http://pollett.org/git/cinequest.git/objects/f0/284329ad7911942e7211a08c52144f4f614d99
[Sun, 15 Dec 2013 18:04:46 -0800] 599.  http://pollett.org/git/cinequest.git/objects/1f/17ddf268731d4842793b0aaaef78d6c9fb1465
[Sun, 15 Dec 2013 18:04:46 -0800] 600.  http://pollett.org/git/cinequest.git/objects/2b/9107831ea17750349ccd57328899d45498590e
[Sun, 15 Dec 2013 18:04:46 -0800]   Done Update Found Sites Array Time 0.010486
[Sun, 15 Dec 2013 18:04:46 -0800] Checking name server:
[Sun, 15 Dec 2013 18:04:46 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:04:46 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:04:46 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:04:46 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:04:46 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:04:46 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:04:46 -0800]   Current to crawl count:1
[Sun, 15 Dec 2013 18:04:46 -0800]   Current to crawl try again count:0
[Sun, 15 Dec 2013 18:04:46 -0800] So not checking scheduler.
[Sun, 15 Dec 2013 18:04:46 -0800] Fetch url list to download time 0.00068900000000005
[Sun, 15 Dec 2013 18:04:46 -0800] Downloading list of urls...
[Sun, 15 Dec 2013 18:04:46 -0800]   Init Get Pages 0.021832
[Sun, 15 Dec 2013 18:04:54 -0800]   Page Request time 7.406715
[Sun, 15 Dec 2013 18:04:54 -0800]   Get Page Content time 0.04445
[Sun, 15 Dec 2013 18:05:03 -0800]   Sort downloaded/not downloaded 0.00020200000000004
[Sun, 15 Dec 2013 18:05:03 -0800]   Scheduling again..
[Sun, 15 Dec 2013 18:05:03 -0800] ....done.
[Sun, 15 Dec 2013 18:05:03 -0800] Downloading complete
[Sun, 15 Dec 2013 18:05:03 -0800] Start process pages... Current Memory:13849256
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...JavaProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:03 -0800]   Process pages time: 0.187547 Current Memory: 15386776
[Sun, 15 Dec 2013 18:05:03 -0800] Number of summarized pages 100
[Sun, 15 Dec 2013 18:05:03 -0800]   Updating Found Sites Array...
[Sun, 15 Dec 2013 18:05:03 -0800] 601.  http://pollett.org/git/cinequest.git/objects/a7/2c6227abf9a5ffe35250bebbab17f1f0ebeb23
[Sun, 15 Dec 2013 18:05:03 -0800] 602.  http://pollett.org/git/cinequest.git/objects/8e/fd7525744368a7a5662659d98812954229ad80
[Sun, 15 Dec 2013 18:05:03 -0800] 603.  http://pollett.org/git/cinequest.git/objects/f1/5ca56c81ce76163b48ef555521e2f7655143ba
[Sun, 15 Dec 2013 18:05:03 -0800] 604.  http://pollett.org/git/cinequest.git/objects/3b/c415ed57a29e6d3db0b8eb8accb1acf2baf4b7
[Sun, 15 Dec 2013 18:05:03 -0800] 605.  http://pollett.org/git/cinequest.git/objects/fc/7fafdc054b1c2eb7d023ef37ea7e45b4d25b70
[Sun, 15 Dec 2013 18:05:03 -0800] 606.  http://pollett.org/git/cinequest.git/objects/cc/9bfeb206e477603f002070d4d2888ad078f168
[Sun, 15 Dec 2013 18:05:03 -0800] 607.  http://pollett.org/git/cinequest.git/objects/06/b049909628cbec53d81a5849097093b97510a0
[Sun, 15 Dec 2013 18:05:03 -0800] 608.  http://pollett.org/git/cinequest.git/objects/11/75df883867bc7f55ef99ec10a13b89a5019fa0
[Sun, 15 Dec 2013 18:05:03 -0800] 609.  http://pollett.org/git/cinequest.git/objects/5e/a528fdeb81c9cfc1000444cd975b174ed9c52f
[Sun, 15 Dec 2013 18:05:03 -0800] 610.  http://pollett.org/git/cinequest.git/objects/cb/c8dda58ca88832fb95cd35d99070b117555410
[Sun, 15 Dec 2013 18:05:03 -0800] 611.  http://pollett.org/git/cinequest.git/objects/71/2f162fe28624ee4d29b11f11b47b9883391961
[Sun, 15 Dec 2013 18:05:03 -0800] 612.  http://pollett.org/git/cinequest.git/objects/be/a70d582ae428abb131bb2cb28c02c61919bd14
[Sun, 15 Dec 2013 18:05:03 -0800] 613.  http://pollett.org/git/cinequest.git/objects/c0/62ecf147b1412f398475867b995a2dc3c1fd0c
[Sun, 15 Dec 2013 18:05:03 -0800] 614.  http://pollett.org/git/cinequest.git/objects/b5/584baf813392991fcdff109e4f98b51f29f725
[Sun, 15 Dec 2013 18:05:03 -0800] 615.  http://pollett.org/git/cinequest.git/objects/63/7e960069271c947008cb44f8fe216cb33dd557
[Sun, 15 Dec 2013 18:05:03 -0800] 616.  http://pollett.org/git/cinequest.git/objects/34/dfce3e92970eac7e31dcc299584e9a853b6f7c
[Sun, 15 Dec 2013 18:05:03 -0800] 617.  http://pollett.org/git/cinequest.git/objects/df/1da35eb4f9af740157267642bb5f660037eb1f
[Sun, 15 Dec 2013 18:05:03 -0800] 618.  http://pollett.org/git/cinequest.git/objects/b5/c3b7ada8eca5e4a9b79a5612723b425cce880e
[Sun, 15 Dec 2013 18:05:03 -0800] 619.  http://pollett.org/git/cinequest.git/objects/7d/c8ec09ca0ee19dfc084a3e5eea381fcf5da6d9
[Sun, 15 Dec 2013 18:05:03 -0800] 620.  http://pollett.org/git/cinequest.git/objects/58/9d20d40150564ab1c6ddca53d3258aa51e71cb
[Sun, 15 Dec 2013 18:05:03 -0800] 621.  http://pollett.org/git/cinequest.git/objects/14/b8d83547868d3a7b9510fa2bc6469ed19fc065
[Sun, 15 Dec 2013 18:05:03 -0800] 622.  http://pollett.org/git/cinequest.git/objects/25/29d475c24360b48c12bbec791c5e960275e8ce
[Sun, 15 Dec 2013 18:05:03 -0800] 623.  http://pollett.org/git/cinequest.git/objects/ff/d0a953160de25be1ba0baeb83dbbd68e8f40e2
[Sun, 15 Dec 2013 18:05:03 -0800] 624.  http://pollett.org/git/cinequest.git/objects/4d/2e95d27cb4025a61b633f56b5118ed37a81f6e
[Sun, 15 Dec 2013 18:05:03 -0800] 625.  http://pollett.org/git/cinequest.git/objects/db/c96fd9bf66188f3ffe95b9ad2782b3438f0b59
[Sun, 15 Dec 2013 18:05:03 -0800] 626.  http://pollett.org/git/cinequest.git/objects/16/2e443d135dd24625df51338378d7980afcf35c
[Sun, 15 Dec 2013 18:05:03 -0800] 627.  http://pollett.org/git/cinequest.git/objects/2e/53c7ac613e65914ea17de56d80221998f10287
[Sun, 15 Dec 2013 18:05:03 -0800] 628.  http://pollett.org/git/cinequest.git/objects/73/43c9a65eacd81111dff4712009a550c4775021
[Sun, 15 Dec 2013 18:05:03 -0800] 629.  http://pollett.org/git/cinequest.git/objects/c7/3dc236105a14ffcf1e1185e8b084aff5844781
[Sun, 15 Dec 2013 18:05:03 -0800] 630.  http://pollett.org/git/cinequest.git/objects/83/1105cc67f14c756a6d5a490bd125d3a0941c15
[Sun, 15 Dec 2013 18:05:03 -0800] 631.  http://pollett.org/git/cinequest.git/objects/1a/80ca7f5ecd5f6b29d220b6dbdac00caad0d17c
[Sun, 15 Dec 2013 18:05:03 -0800] 632.  http://pollett.org/git/cinequest.git/objects/54/e10a35fd5ed783c0750565020103f5779d1326
[Sun, 15 Dec 2013 18:05:03 -0800] 633.  http://pollett.org/git/cinequest.git/objects/ae/5824c4fc63ee029841cda14fd9818f16f744ce
[Sun, 15 Dec 2013 18:05:03 -0800] 634.  http://pollett.org/git/cinequest.git/objects/3b/dc0a20f24f715175d85d60c0ce210490d18f76
[Sun, 15 Dec 2013 18:05:03 -0800] 635.  http://pollett.org/git/cinequest.git/objects/32/6e0439638a8953db88eb45dea36cfe40f5037b
[Sun, 15 Dec 2013 18:05:03 -0800] 636.  http://pollett.org/git/cinequest.git/objects/2f/8acc243c44f6af64357ba78aa36a3078f1fea1
[Sun, 15 Dec 2013 18:05:03 -0800] 637.  http://pollett.org/git/cinequest.git/objects/ad/f21ed981fd5e6323f267cb6f3b3f31c41f5052
[Sun, 15 Dec 2013 18:05:03 -0800] 638.  http://pollett.org/git/cinequest.git/objects/3d/4f02d9e0162886eb9cd6c02ba098a52f8ad6a1
[Sun, 15 Dec 2013 18:05:03 -0800] 639.  http://pollett.org/git/cinequest.git/objects/82/5d5de8e9d87791d452dbca1b3eab206d7fd139
[Sun, 15 Dec 2013 18:05:03 -0800] 640.  http://pollett.org/git/cinequest.git/objects/be/243b4eeb5fb54fa26f1fbac54867563324fbe3
[Sun, 15 Dec 2013 18:05:03 -0800] 641.  http://pollett.org/git/cinequest.git/objects/41/9adff00ea99178017626d410b7acec05246bd9
[Sun, 15 Dec 2013 18:05:03 -0800] 642.  http://pollett.org/git/cinequest.git/objects/ae/0c0d3eaaf3d3e1c393bb45d1bd1677d3daef2b
[Sun, 15 Dec 2013 18:05:03 -0800] 643.  http://pollett.org/git/cinequest.git/objects/9b/d84b409e365be0877ff56a0fb1466acbdc9424
[Sun, 15 Dec 2013 18:05:03 -0800] 644.  http://pollett.org/git/cinequest.git/objects/23/66d1469155c9465c3a2266887d689b49d62bd4
[Sun, 15 Dec 2013 18:05:03 -0800] 645.  http://pollett.org/git/cinequest.git/objects/de/bc6857c0c39bf889d661b7928ed5f25a2ada02
[Sun, 15 Dec 2013 18:05:03 -0800] 646.  http://pollett.org/git/cinequest.git/objects/de/ba0ddd97de018230ccf16616d53dd8f38b9f23
[Sun, 15 Dec 2013 18:05:03 -0800] 647.  http://pollett.org/git/cinequest.git/objects/d0/448ae518625a6cb8a0448ccf9130e616acf509
[Sun, 15 Dec 2013 18:05:03 -0800] 648.  http://pollett.org/git/cinequest.git/objects/fe/1148261d16433fad0515f85fa335aac5cb57fa
[Sun, 15 Dec 2013 18:05:03 -0800] 649.  http://pollett.org/git/cinequest.git/objects/6f/cda378881f45ac76f5f7e99d0da8febf61f2af
[Sun, 15 Dec 2013 18:05:03 -0800] 650.  http://pollett.org/git/cinequest.git/objects/02/fa44d8edd92c09c2f74aa9fadd4a7127fc17e2
[Sun, 15 Dec 2013 18:05:03 -0800] 651.  http://pollett.org/git/cinequest.git/objects/76/0f148ffde31aacbcc15f30703a8394a08b0b9b
[Sun, 15 Dec 2013 18:05:03 -0800] 652.  http://pollett.org/git/cinequest.git/objects/4a/ce620633e1e4d2cd408bfa2c64d44e26065867
[Sun, 15 Dec 2013 18:05:03 -0800] 653.  http://pollett.org/git/cinequest.git/objects/e4/29ed517e4e7a1bb05d6c5f299a4343c6695497
[Sun, 15 Dec 2013 18:05:03 -0800] 654.  http://pollett.org/git/cinequest.git/objects/a9/3b076e0c93de0cc26a6c367c63645ea20f1251
[Sun, 15 Dec 2013 18:05:03 -0800] 655.  http://pollett.org/git/cinequest.git/objects/a7/a88d9c59c666c88b69e72b1ca9e5ab596d4719
[Sun, 15 Dec 2013 18:05:03 -0800] 656.  http://pollett.org/git/cinequest.git/objects/af/e3a38719a43c54ad337b1358b4e36246a4533a
[Sun, 15 Dec 2013 18:05:03 -0800] 657.  http://pollett.org/git/cinequest.git/objects/7e/377c4aad3c3c56261cb442c74bd22b97361d7e
[Sun, 15 Dec 2013 18:05:03 -0800] 658.  http://pollett.org/git/cinequest.git/objects/33/b72f6e5f2393ade0249c615bb10aeee0b6c8d5
[Sun, 15 Dec 2013 18:05:03 -0800] 659.  http://pollett.org/git/cinequest.git/objects/f9/b1a4723a0c660e7d6ca24db17ac6e1f82536e3
[Sun, 15 Dec 2013 18:05:03 -0800] 660.  http://pollett.org/git/cinequest.git/objects/b0/f0db00daa30e23e69d57b67120038449f083d0
[Sun, 15 Dec 2013 18:05:03 -0800] 661.  http://pollett.org/git/cinequest.git/objects/2b/efae44d47f9d6cf2dab0c46d2bdbdfbdba054e
[Sun, 15 Dec 2013 18:05:03 -0800] 662.  http://pollett.org/git/cinequest.git/objects/b9/ca59d09be9d3285e87758380514095aa5f7149
[Sun, 15 Dec 2013 18:05:03 -0800] 663.  http://pollett.org/git/cinequest.git/objects/2c/f21a5175880867056503d2ba9ba23f557c9a0a
[Sun, 15 Dec 2013 18:05:03 -0800] 664.  http://pollett.org/git/cinequest.git/objects/68/f1b2eaa2614cda7142eccfa56f0928fdf91823
[Sun, 15 Dec 2013 18:05:03 -0800] 665.  http://pollett.org/git/cinequest.git/objects/99/eed715257c4b3b93d3d5d7cb6978379beaf2b2
[Sun, 15 Dec 2013 18:05:03 -0800] 666.  http://pollett.org/git/cinequest.git/objects/c8/df5c946db7a3f9732960ab67810310cc24ea38
[Sun, 15 Dec 2013 18:05:03 -0800] 667.  http://pollett.org/git/cinequest.git/objects/2f/5e3406e110bef7f5fdffcee4e13068ef1860c6
[Sun, 15 Dec 2013 18:05:03 -0800] 668.  http://pollett.org/git/cinequest.git/objects/d7/972de8eb786e94b069554b9e61290405ccf52d
[Sun, 15 Dec 2013 18:05:03 -0800] 669.  http://pollett.org/git/cinequest.git/objects/64/0d786ed5af80119fcfa1631f6bc56ec1266ba0
[Sun, 15 Dec 2013 18:05:03 -0800] 670.  http://pollett.org/git/cinequest.git/objects/cb/1db24322f826e58a912859b39673822ac5457a
[Sun, 15 Dec 2013 18:05:03 -0800] 671.  http://pollett.org/git/cinequest.git/objects/a3/6d3bb12bb07e8f8e24e8f1bb29faa08aab7e5b
[Sun, 15 Dec 2013 18:05:03 -0800] 672.  http://pollett.org/git/cinequest.git/objects/4d/72a4ecb800d6991a5fc1237db3df3d702ee49d
[Sun, 15 Dec 2013 18:05:03 -0800] 673.  http://pollett.org/git/cinequest.git/objects/0c/b5de7224e4e764a636d7dff79cd0a58c3cb3f8
[Sun, 15 Dec 2013 18:05:03 -0800] 674.  http://pollett.org/git/cinequest.git/objects/6f/8765d14ae2e7dd96afb9486cb86ed5ea468a97
[Sun, 15 Dec 2013 18:05:03 -0800] 675.  http://pollett.org/git/cinequest.git/objects/1f/fa6c22e3b83b9d063a701f99b2bd5bb5b3e9f2
[Sun, 15 Dec 2013 18:05:03 -0800] 676.  http://pollett.org/git/cinequest.git/objects/49/e599c958d45250a665396ba934352b4edd222b
[Sun, 15 Dec 2013 18:05:03 -0800] 677.  http://pollett.org/git/cinequest.git/objects/ed/8343d8c959cbb942a66310664d3836e6bf07c1
[Sun, 15 Dec 2013 18:05:03 -0800] 678.  http://pollett.org/git/cinequest.git/objects/67/f71b6188e1a2b8d8a7ad14e5f24d996e3e393b
[Sun, 15 Dec 2013 18:05:03 -0800] 679.  http://pollett.org/git/cinequest.git/objects/a3/0eba96208b1594fc4c3bb32008472746c1b60a
[Sun, 15 Dec 2013 18:05:03 -0800] 680.  http://pollett.org/git/cinequest.git/objects/34/5f424f09d838ac5551bda21ae556cba0a0b748
[Sun, 15 Dec 2013 18:05:03 -0800] 681.  http://pollett.org/git/cinequest.git/objects/13/b3d90e8d42bdbe7297d5161ca4cddf90a96f03
[Sun, 15 Dec 2013 18:05:03 -0800] 682.  http://pollett.org/git/cinequest.git/objects/fb/c64271052a1155ef501db475c9305a0d25040a
[Sun, 15 Dec 2013 18:05:03 -0800] 683.  http://pollett.org/git/cinequest.git/objects/be/5c3ccd4c167f4253dba15864e957989af912cb
[Sun, 15 Dec 2013 18:05:03 -0800] 684.  http://pollett.org/git/cinequest.git/objects/a8/9b82faba7910c645fd1ae8cc285c3e86a0763d
[Sun, 15 Dec 2013 18:05:03 -0800] 685.  http://pollett.org/git/cinequest.git/objects/41/3396be6b5baaaf363d4aa1111e4935c234a1b9
[Sun, 15 Dec 2013 18:05:03 -0800] 686.  http://pollett.org/git/cinequest.git/objects/77/bc30c27400597b79ccc126fabd5bcc0fb3a41c
[Sun, 15 Dec 2013 18:05:03 -0800] 687.  http://pollett.org/git/cinequest.git/objects/03/e8eba939acaebddd108b1efb168708b9fcdeb9
[Sun, 15 Dec 2013 18:05:03 -0800] 688.  http://pollett.org/git/cinequest.git/objects/6c/4cb4efd6cbe8e6b08f520cb3e179496ef63253
[Sun, 15 Dec 2013 18:05:03 -0800] 689.  http://pollett.org/git/cinequest.git/objects/b8/47a0a1bd16c03f65a5c20d523b503ff542f2d1
[Sun, 15 Dec 2013 18:05:03 -0800] 690.  http://pollett.org/git/cinequest.git/objects/29/0272aa007ac6227bf66b75d7a16e328042cec1
[Sun, 15 Dec 2013 18:05:03 -0800] 691.  http://pollett.org/git/cinequest.git/objects/1a/b14b9dc931eeb1b624cca1bbf422a2445f1754
[Sun, 15 Dec 2013 18:05:03 -0800] 692.  http://pollett.org/git/cinequest.git/objects/df/987574cd4c8ab15a72042503068904d548e51e
[Sun, 15 Dec 2013 18:05:03 -0800] 693.  http://pollett.org/git/cinequest.git/objects/4d/34b73f359496e228b058c11e119507e311397d
[Sun, 15 Dec 2013 18:05:03 -0800] 694.  http://pollett.org/git/cinequest.git/objects/4f/a63077f555342bebd76ac5df366333070d4455
[Sun, 15 Dec 2013 18:05:03 -0800] 695.  http://pollett.org/git/cinequest.git/objects/98/2054899c08ff26a7244262197bd1c436d8f1fa
[Sun, 15 Dec 2013 18:05:03 -0800] 696.  http://pollett.org/git/cinequest.git/objects/0e/04d7fdf697b741f835a6d8ef6c1554e19a2ff0
[Sun, 15 Dec 2013 18:05:03 -0800] 697.  http://pollett.org/git/cinequest.git/objects/da/52f57b0b088a3d28b46264809235a31ae42967
[Sun, 15 Dec 2013 18:05:03 -0800] 698.  http://pollett.org/git/cinequest.git/objects/07/f918aeaa2132c40f6370132e75f4430869ee33
[Sun, 15 Dec 2013 18:05:03 -0800] 699.  http://pollett.org/git/cinequest.git/objects/4f/98f4f5c8f0cc879d2ddeb1429b4f779463930b
[Sun, 15 Dec 2013 18:05:03 -0800] 700.  http://pollett.org/git/cinequest.git/objects/03/897bd57314fc1ef4f8c6fdf3bdb8e7a1395db5
[Sun, 15 Dec 2013 18:05:03 -0800]   Done Update Found Sites Array Time 0.008708
[Sun, 15 Dec 2013 18:05:03 -0800] Checking name server:
[Sun, 15 Dec 2013 18:05:03 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:05:03 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:05:03 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:05:03 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:05:03 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:05:03 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:05:03 -0800]   Current to crawl count:1
[Sun, 15 Dec 2013 18:05:03 -0800]   Current to crawl try again count:0
[Sun, 15 Dec 2013 18:05:03 -0800] So not checking scheduler.
[Sun, 15 Dec 2013 18:05:03 -0800] Fetch url list to download time 0.00045899999999999
[Sun, 15 Dec 2013 18:05:03 -0800] Downloading list of urls...
[Sun, 15 Dec 2013 18:05:03 -0800]   Init Get Pages 0.005687
[Sun, 15 Dec 2013 18:05:05 -0800]   Page Request time 1.43121
[Sun, 15 Dec 2013 18:05:05 -0800]   Get Page Content time 0.03922
[Sun, 15 Dec 2013 18:05:11 -0800]   Sort downloaded/not downloaded 0.00012800000000002
[Sun, 15 Dec 2013 18:05:11 -0800]   Scheduling again..
[Sun, 15 Dec 2013 18:05:11 -0800] ....done.
[Sun, 15 Dec 2013 18:05:11 -0800] Downloading complete
[Sun, 15 Dec 2013 18:05:11 -0800] Start process pages... Current Memory:14931560
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Using Processor...TextProcessor
[Sun, 15 Dec 2013 18:05:11 -0800]   Process pages time: 0.153772 Current Memory: 15788072
[Sun, 15 Dec 2013 18:05:11 -0800] Number of summarized pages 54
[Sun, 15 Dec 2013 18:05:11 -0800]   Updating Found Sites Array...
[Sun, 15 Dec 2013 18:05:11 -0800] 701.  http://pollett.org/git/cinequest.git/objects/8e/b0b908483f7ca35159576552358773d22bacbf
[Sun, 15 Dec 2013 18:05:11 -0800] 702.  http://pollett.org/git/cinequest.git/objects/9d/49f6033f56dbfea1ac87eb3077428f8e98ca97
[Sun, 15 Dec 2013 18:05:11 -0800] 703.  http://pollett.org/git/cinequest.git/objects/d2/03ddbeb9099a5b90f99089c7f7d3f2f306d63c
[Sun, 15 Dec 2013 18:05:11 -0800] 704.  http://pollett.org/git/cinequest.git/objects/79/4964a23c2781f26706818917f4ceb63df8a818
[Sun, 15 Dec 2013 18:05:11 -0800] 705.  http://pollett.org/git/cinequest.git/objects/1c/5852b34a5b7d2ce14dd6f02585d1c27f896b80
[Sun, 15 Dec 2013 18:05:11 -0800] 706.  http://pollett.org/git/cinequest.git/objects/62/1a66a48e7fa0292dd4571e5e1b909d01f8ac36
[Sun, 15 Dec 2013 18:05:11 -0800] 707.  http://pollett.org/git/cinequest.git/objects/35/26899dc12215880bcb1af55d18e723896883e2
[Sun, 15 Dec 2013 18:05:11 -0800] 708.  http://pollett.org/git/cinequest.git/objects/63/66895d6a7304252ba127943a532e1c952cd10f
[Sun, 15 Dec 2013 18:05:11 -0800] 709.  http://pollett.org/git/cinequest.git/objects/b9/26a01e36f59b130569055f81674b3484d25a19
[Sun, 15 Dec 2013 18:05:11 -0800] 710.  http://pollett.org/git/cinequest.git/objects/99/fdf1425e60c31746d91f5c37a2dfb3d7778a99
[Sun, 15 Dec 2013 18:05:11 -0800] 711.  http://pollett.org/git/cinequest.git/objects/27/b1607a6f490f8bda6a6b8b0e023efe63200480
[Sun, 15 Dec 2013 18:05:11 -0800] 712.  http://pollett.org/git/cinequest.git/objects/54/de261fba6ee46236fd45bfdefef1bc2029ad20
[Sun, 15 Dec 2013 18:05:11 -0800] 713.  http://pollett.org/git/cinequest.git/objects/cf/18d24e47c5979b8ee2c38ba1029f531a8c2ae1
[Sun, 15 Dec 2013 18:05:11 -0800] 714.  http://pollett.org/git/cinequest.git/objects/6f/0357bb7d420bef77dc31beb3795473719e4477
[Sun, 15 Dec 2013 18:05:11 -0800] 715.  http://pollett.org/git/cinequest.git/objects/72/3bfb9788926fb6d2af07cc89124a2aaa8b4b08
[Sun, 15 Dec 2013 18:05:11 -0800] 716.  http://pollett.org/git/cinequest.git/objects/7f/6ff10a5105ceac2ad67ae2af278633f9de08f8
[Sun, 15 Dec 2013 18:05:11 -0800] 717.  http://pollett.org/git/cinequest.git/objects/36/a9e445c1e1d2ab3b3a32dd21785f4224dba8f8
[Sun, 15 Dec 2013 18:05:11 -0800] 718.  http://pollett.org/git/cinequest.git/objects/ba/fb654fa260ebccb3ca3345b5104fc010b71c9a
[Sun, 15 Dec 2013 18:05:11 -0800] 719.  http://pollett.org/git/cinequest.git/objects/42/d36bb2d65ec18596866a11d42533d6a8e45d5d
[Sun, 15 Dec 2013 18:05:11 -0800] 720.  http://pollett.org/git/cinequest.git/objects/d1/c2ca3f2f5d4d817c789e043195c97c1e37336b
[Sun, 15 Dec 2013 18:05:11 -0800] 721.  http://pollett.org/git/cinequest.git/objects/50/28a2d708491d7a4f398f38a1c246376d33b559
[Sun, 15 Dec 2013 18:05:11 -0800] 722.  http://pollett.org/git/cinequest.git/objects/3f/7e8b282c7b3c392293fdc2c00282f02e09d29e
[Sun, 15 Dec 2013 18:05:11 -0800] 723.  http://pollett.org/git/cinequest.git/objects/cd/2f376c64f37395fe136e6dbd5db0feb632f16b
[Sun, 15 Dec 2013 18:05:11 -0800] 724.  http://pollett.org/git/cinequest.git/objects/c5/bdbe4c127e86fcfd291f541b034a867abc51ee
[Sun, 15 Dec 2013 18:05:11 -0800] 725.  http://pollett.org/git/cinequest.git/objects/83/a8c26b71d9166b661a3bd937b0ae8552aae7d0
[Sun, 15 Dec 2013 18:05:11 -0800] 726.  http://pollett.org/git/cinequest.git/objects/e1/0f4900a61e877a8c9904721e09d17a651f6af1
[Sun, 15 Dec 2013 18:05:11 -0800] 727.  http://pollett.org/git/cinequest.git/objects/e8/1a1da5ee99c9ec71a3ba43f20cb7d73080518e
[Sun, 15 Dec 2013 18:05:11 -0800] 728.  http://pollett.org/git/cinequest.git/objects/ca/0ce9930dace9504b0cd309de67880cb57912e9
[Sun, 15 Dec 2013 18:05:11 -0800] 729.  http://pollett.org/git/cinequest.git/objects/28/845538e5c43a69c2eda751b08f8a1206efcc30
[Sun, 15 Dec 2013 18:05:11 -0800] 730.  http://pollett.org/git/cinequest.git/objects/1d/45f8cb1f5f2f4527a3e9521141a732dfc34d78
[Sun, 15 Dec 2013 18:05:11 -0800] 731.  http://pollett.org/git/cinequest.git/objects/44/1b625e13fb08fddca26139d1489002f0ebeaba
[Sun, 15 Dec 2013 18:05:11 -0800] 732.  http://pollett.org/git/cinequest.git/objects/6d/d6d27e5f46ee28a26a8fc02f32e586a6dd5059
[Sun, 15 Dec 2013 18:05:11 -0800] 733.  http://pollett.org/git/cinequest.git/objects/62/d51f3e1320b883d9e8695de4a6fa7d859625fd
[Sun, 15 Dec 2013 18:05:11 -0800] 734.  http://pollett.org/git/cinequest.git/objects/9a/d018caed3753ec0e690b001b3aa70d26125fbb
[Sun, 15 Dec 2013 18:05:11 -0800] 735.  http://pollett.org/git/cinequest.git/objects/11/cc2dfc242cc54d102472dc4db7edd7f00e5741
[Sun, 15 Dec 2013 18:05:11 -0800] 736.  http://pollett.org/git/cinequest.git/objects/83/290868ada7f6c8654593377b3c6062cbfd0e89
[Sun, 15 Dec 2013 18:05:11 -0800] 737.  http://pollett.org/git/cinequest.git/objects/1a/0a8e777ebce1cec7adcc72c6d081e14769d183
[Sun, 15 Dec 2013 18:05:11 -0800] 738.  http://pollett.org/git/cinequest.git/objects/5f/8c9af86a8727921540ae26b40a7fa7a2e8464a
[Sun, 15 Dec 2013 18:05:11 -0800] 739.  http://pollett.org/git/cinequest.git/objects/5c/eec68df8f29c41e50d99e9f5fbddb7fb0bbdd6
[Sun, 15 Dec 2013 18:05:11 -0800] 740.  http://pollett.org/git/cinequest.git/objects/03/16cbe439707f15e890adb6b99e5158c66c0449
[Sun, 15 Dec 2013 18:05:11 -0800] 741.  http://pollett.org/git/cinequest.git/objects/48/ebdec50aba056a1309cf83bc6bedbd4644a069
[Sun, 15 Dec 2013 18:05:11 -0800] 742.  http://pollett.org/git/cinequest.git/objects/71/6d993502a1285061fce30eb7ab0a8bcc477f68
[Sun, 15 Dec 2013 18:05:11 -0800] 743.  http://pollett.org/git/cinequest.git/objects/90/ae934db4e07a8f36f998bf0d6f949b83bb0ead
[Sun, 15 Dec 2013 18:05:11 -0800] 744.  http://pollett.org/git/cinequest.git/objects/8b/83cf6e887490acafba2bce7a418a1e516fc018
[Sun, 15 Dec 2013 18:05:11 -0800] 745.  http://pollett.org/git/cinequest.git/objects/be/b475e836d48faab62fae0cbb097b0d143d5754
[Sun, 15 Dec 2013 18:05:11 -0800] 746.  http://pollett.org/git/cinequest.git/objects/73/1233666d329acf173ef2bd78422226f9f7c8c3
[Sun, 15 Dec 2013 18:05:11 -0800] 747.  http://pollett.org/git/cinequest.git/objects/f7/edf970aa5c7bf3b11b08fc9d1aa871e690e5db
[Sun, 15 Dec 2013 18:05:11 -0800] 748.  http://pollett.org/git/cinequest.git/objects/e4/a281729256de3476cdbec805c4acc9a464dc20
[Sun, 15 Dec 2013 18:05:11 -0800] 749.  http://pollett.org/git/cinequest.git/objects/27/9e213e78135f370373f255ffd20a753d7bad1d
[Sun, 15 Dec 2013 18:05:11 -0800] 750.  http://pollett.org/git/cinequest.git/objects/0d/00b24c8e0c3563ff58b2dc749884beccd3c926
[Sun, 15 Dec 2013 18:05:11 -0800] 751.  http://pollett.org/git/cinequest.git/objects/8d/6a63cc445d3f2e29e32c8208d517f138e06043
[Sun, 15 Dec 2013 18:05:11 -0800] 752.  http://pollett.org/git/cinequest.git/objects/29/47bafa930027c0adc40b836175ee5db7520291
[Sun, 15 Dec 2013 18:05:11 -0800] 753.  http://pollett.org/git/cinequest.git/objects/d5/8c77fc1b1858e8bf18b5c7640214d7d46e7474
[Sun, 15 Dec 2013 18:05:11 -0800] 754.  http://pollett.org/git/cinequest.git/objects/95/d9323fa3d875d7ac29e828f54c98ed17d6faeb
[Sun, 15 Dec 2013 18:05:11 -0800]   Done Update Found Sites Array Time 0.006443
[Sun, 15 Dec 2013 18:05:11 -0800]   Start Update Server 
[Sun, 15 Dec 2013 18:05:11 -0800] Updating machine: http://localhost/yioop/
[Sun, 15 Dec 2013 18:05:11 -0800] ...16416 bytes of cache page validation data
[Sun, 15 Dec 2013 18:05:11 -0800] ...5340 bytes of schedule data
[Sun, 15 Dec 2013 18:05:11 -0800]   Start building mini inverted index ...  Current Memory:15117792
[Sun, 15 Dec 2013 18:05:11 -0800] ..Still building inverted index. Have processed 0 of 354 documents.
Last url processed was http://pollett.org/git/cinequest.git/objects/6d/e68673673ed4eaf1b05739d6190ca3c60bc571. Current memory usage:15385120
[Sun, 15 Dec 2013 18:05:35 -0800]   Build mini inverted index time 24.231048
[Sun, 15 Dec 2013 18:05:35 -0800] Saving Mini Inverted Index...
[Sun, 15 Dec 2013 18:05:35 -0800] Merge index shard postings to string to save memory.
[Sun, 15 Dec 2013 18:05:36 -0800] ..Merge Index Posting Final Copy
[Sun, 15 Dec 2013 18:05:36 -0800] ..Done Merge Index Posting Final Copy
[Sun, 15 Dec 2013 18:05:36 -0800] Saving index shard .. done merge postings to string
[Sun, 15 Dec 2013 18:05:37 -0800] Saving index shard .. make prefixes
[Sun, 15 Dec 2013 18:05:37 -0800] Saving index shard .. packed header
[Sun, 15 Dec 2013 18:05:38 -0800] Saving index shard .. wrote doc map. Done save
[Sun, 15 Dec 2013 18:05:39 -0800] ...Finish Compressing seen URLs.
[Sun, 15 Dec 2013 18:05:39 -0800] ...4877920 bytes of index data
[Sun, 15 Dec 2013 18:05:39 -0800] ...
[Sun, 15 Dec 2013 18:05:39 -0800] Sending Queue Server Part 1 of 1...
[Sun, 15 Dec 2013 18:05:39 -0800] ...sending about 4899676 bytes.
[Sun, 15 Dec 2013 18:05:39 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:05:39 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:05:39 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:05:39 -0800] Messages from Fetch Controller:
[Sun, 15 Dec 2013 18:05:39 -0800] ... Data upload complete

[Sun, 15 Dec 2013 18:05:39 -0800] Queue Server info response code: 1
[Sun, 15 Dec 2013 18:05:39 -0800] Queue Server's crawl time is: 1387159304
[Sun, 15 Dec 2013 18:05:39 -0800] Web Server peak memory usage: 25091084
[Sun, 15 Dec 2013 18:05:39 -0800] This fetcher peak memory usage: 40606312
[Sun, 15 Dec 2013 18:05:39 -0800] Updated Queue Server, sent approximately 4899676 bytes:
[Sun, 15 Dec 2013 18:05:39 -0800] ...  Current Memory:17610736
[Sun, 15 Dec 2013 18:05:39 -0800]   Update Server Time 27.962018
[Sun, 15 Dec 2013 18:05:39 -0800] Checking name server:
[Sun, 15 Dec 2013 18:05:39 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:05:39 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:05:39 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:05:39 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:05:39 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:05:39 -0800] MAIN LOOP CASE 4 -- WEB SCHEDULER
[Sun, 15 Dec 2013 18:05:39 -0800] Checking  http://localhost/yioop/ for a new schedule.
[Sun, 15 Dec 2013 18:05:39 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:05:39 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:05:39 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:05:39 -0800] Making request: 
[Sun, 15 Dec 2013 18:05:39 -0800] http://localhost/yioop/?c=fetch&a=schedule&time=1387159539&session=181ebbaa1e4565d3579d7c7448be0cc7&robot_instance=0-localhost-1387159138&machine_uri=/yioop/&crawl_time=1387159304&check_crawl_time=1387159539
[Sun, 15 Dec 2013 18:05:39 -0800] Time to check Scheduler 0.125279
[Sun, 15 Dec 2013 18:05:39 -0800] No data. Sleeping...
[Sun, 15 Dec 2013 18:05:54 -0800] Checking name server:
[Sun, 15 Dec 2013 18:05:54 -0800]   http://localhost/yioop/ to see if active crawl time has changed.
[Sun, 15 Dec 2013 18:05:54 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:05:54 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:05:54 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:05:54 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:05:54 -0800] MAIN LOOP CASE 1 -- SWITCH CRAWL OR NO CURRENT CRAWL
[Sun, 15 Dec 2013 18:05:54 -0800] No data. Sleeping...
[Sun, 15 Dec 2013 18:06:09 -0800] Checking name server:
[Sun, 15 Dec 2013 18:06:09 -0800]   http://localhost/yioop/ to see if should start crawling
[Sun, 15 Dec 2013 18:06:09 -0800]   Init curl request of a single page
[Sun, 15 Dec 2013 18:06:09 -0800]   Set curl options for single page request
[Sun, 15 Dec 2013 18:06:10 -0800]   Done curl exec
[Sun, 15 Dec 2013 18:06:10 -0800] End Name Server Check
[Sun, 15 Dec 2013 18:06:10 -0800] MAIN LOOP CASE 1 -- SWITCH CRAWL OR NO CURRENT CRAWL
[Sun, 15 Dec 2013 18:06:10 -0800] No data. Sleeping...
^C
sridhar-chunduris-MacBook-Pro:bin sridharchunduri$

SourceCode2.patch