| When | Event | Detail |
|---|
| 2026-11-16 05:03 | crawl_end | pages=4769 (+1385 new) hosts=2566 stats={'http_error': 63, 'fetched': 1508, 'fetch_error': 11, 'robots_blocked': 66, 'too_thin': 6, 'not_html': 4} top_authority=[('https://www.wikimedia.org/', 480), ('https://wikisource.org/wiki/Wikisource:Main_Page', 395), ('https://species.wikimedia.org/wiki/Main_Page', 393), ('https://commons.wikimedia.org/wiki/Main_Page', 393), ('https://foundation.wikimedia.org/wiki/Home', 393)] |
| 2026-11-16 05:00 | crawl_start | budget=1500 depth=4 per_host=1500 pages_before=3384 |
| 2026-11-16 04:59 | crawl_end | pages=3384 (+4 new) hosts=2529 stats={'http_error': 1, 'fetched': 4} top_authority=[('https://wikisource.org/wiki/Wikisource:Main_Page', 379), ('https://species.wikimedia.org/wiki/Main_Page', 377), ('https://commons.wikimedia.org/wiki/Main_Page', 377), ('https://www.wikidata.org/wiki/Wikidata:Main_Page', 374), ('https://www.mediawiki.org/wiki/MediaWiki', 373)] |
| 2026-11-16 04:59 | crawl_start | budget=3 depth=0 per_host=1200 pages_before=3380 |
| 2026-11-16 04:57 | crawl_end | pages=3380 (+3070 new) hosts=2525 stats={'fetched': 3205, 'fetch_error': 194, 'http_error': 465, 'robots_blocked': 153, 'not_html': 38, 'too_thin': 126} top_authority=[('https://wikisource.org/wiki/Wikisource:Main_Page', 379), ('https://species.wikimedia.org/wiki/Main_Page', 377), ('https://commons.wikimedia.org/wiki/Main_Page', 377), ('https://www.wikidata.org/wiki/Wikidata:Main_Page', 374), ('https://www.mediawiki.org/wiki/MediaWiki', 373)] |
| 2026-11-16 04:47 | crawl_start | budget=3200 depth=4 per_host=900 pages_before=310 |
| 2026-11-16 04:40 | crawl_start | budget=3500 depth=4 per_host=900 pages_before=0 |