Spidering https://xkcd.com/

1. Retrieving: https://xkcd.com/ at 21:14:31.
Size of page: 8.05kb. Starting indexing at 21:14:32. Re-indexed
Links found: 24. New links: 24
2. Retrieving: https://xkcd.com/ at 21:14:50.
Size of page: 8.05kb. Starting indexing at 21:14:50. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
3. Retrieving: https://xkcd.com/1/ at 21:14:50.
Size of page: 7.78kb. Starting indexing at 21:14:51. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
4. Retrieving: https://xkcd.com/150/ at 21:14:51.
Size of page: 8.26kb. Starting indexing at 21:14:52. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
5. Retrieving: https://xkcd.com/162/ at 21:14:52.
Size of page: 8.29kb. Starting indexing at 21:14:53. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
6. Retrieving: https://xkcd.com/2660/ at 21:14:53.
Size of page: 7.84kb. Starting indexing at 21:14:54. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
7. Retrieving: https://xkcd.com/2667/ at 21:14:54.
Size of page: 7.87kb. Starting indexing at 21:14:55. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
8. Retrieving: https://xkcd.com/2668/ at 21:14:56.
Size of page: 7.74kb. Starting indexing at 21:14:58.
Indexed
Links found: 24. New links: 3
9. Retrieving: https://xkcd.com/2669 at 21:15:09.
Size of page: 8.05kb. Starting indexing at 21:15:10. Page is a duplicate.
Links found: 0. New links: 0
10. Retrieving: https://xkcd.com/556/ at 21:15:10.
Size of page: 9.35kb. Starting indexing at 21:15:11. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
11. Retrieving: https://xkcd.com/688/ at 21:15:11.
Size of page: 8.68kb. Starting indexing at 21:15:12. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
12. Retrieving: https://xkcd.com/730/ at 21:15:13.
Size of page: 13.06kb. Starting indexing at 21:15:13. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
13. Retrieving: https://xkcd.com/about at 21:15:14.
Size of page: 5.62kb. Starting indexing at 21:15:15. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
14. Retrieving: https://xkcd.com/archive at 21:15:15.
Size of page: 164.46kb. Starting indexing at 21:15:16.