Spidering https://www.fbi.gov/

1. Retrieving: https://www.fbi.gov/ at 20:57:33.
Size of page: 71.00kb. Starting indexing at 20:57:34. Re-indexed
Links found: 106. New links: 106
2. Retrieving: https://delivery.fbi.gov/subscribe at 20:58:16.
Size of page: 47.25kb. Starting indexing at 20:58:18. Re-indexed
Links found: 2. New links: 1
3. Retrieving: https://delivery.fbi.gov/subscribe?utm_source=Email%20Icon%20-%20fbi.gov&utm_medium=Email%20Icon%20-%20fbi.gov&utm_campaign=Email%20Alerts%20Campaign&utm_term=email-alerts&utm_content=Email%20icon%20that at 20:58:26.
Size of page: 47.25kb. Starting indexing at 20:58:32. Re-indexed
Links found: 2. New links: 0
4. Retrieving: https://www.fbi.gov/ at 20:58:40.
Size of page: 71.00kb. Starting indexing at 20:58:46. MD5 sum checked. Page content not changed
Links found: 0. New links: 0
5. Retrieving: https://www.fbi.gov/++plone++castle/less/public/print.css at 20:58:46.
Not text or html
Links found: 0. New links: 0
6. Retrieving: https://www.fbi.gov/++plone++production/++unique++2022-03-31T19:42:50.984772/default.css at 20:58:47.
Not text or html
Links found: 0. New links: 0
7. Retrieving: https://www.fbi.gov/++theme++fbigov.theme/css/customx.css at 20:58:53.
Not text or html
Links found: 0. New links: 0
8. Retrieving: https://www.fbi.gov/++theme++fbigov.theme/css/index.css?v=10 at 20:58:54.
Not text or html
Links found: 0. New links: 0
9. Retrieving: https://www.fbi.gov/about at 20:59:00.
Size of page: 66.68kb. Starting indexing at 20:59:06. Re-indexed
Links found: 76. New links: 4
10. Retrieving: https://www.fbi.gov/about/community-outreach at 20:59:14.
Size of page: 78.77kb. Starting indexing at 20:59:15. Re-indexed
Links found: 91. New links: 19
11. Retrieving: https://www.fbi.gov/about/faqs at 20:59:27.
Size of page: 112.33kb. Starting indexing at 20:59:28. Re-indexed
Links found: 150. New links: 77
12. Retrieving: https://www.fbi.gov/about/leadership-and-structure at 20:59:49.
Size of page: 86.90kb. Starting indexing at 20:59:50. Re-indexed
Links found: 176. New links: 100
13. Retrieving: https://www.fbi.gov/about/mission at 21:00:17.
Size of page: 64.10kb. Starting indexing at 21:00:18. Re-indexed
Links found: 86. New links: 11
14. Retrieving: https://www.fbi.gov/about/partnerships at 21:00:28.
Size of page: 75.09kb. Starting indexing at 21:00:29. Re-indexed
Links found: 86. New links: 10
15. Retrieving: https://www.fbi.gov/accessibility at 21:00:37.
Size of page: 55.20kb. Starting indexing at 21:00:38. Re-indexed
Links found: 72. New links: 0
16. Retrieving: https://www.fbi.gov/atom.xml at 21:00:45.
Size of page: 28.49kb. Starting indexing at 21:00:46. Re-indexed
Links found: 43. New links: 15
17. Retrieving: https://www.fbi.gov/contact-us at 21:00:57.
Size of page: 111.07kb. Starting indexing at 21:00:57. Re-indexed
Links found: 80. New links: 7
18. Retrieving: https://www.fbi.gov/contact-us/fbi-headquarters at 21:01:04.
Size of page: 63.92kb. Starting indexing at 21:01:05. Re-indexed
Links found: 84. New links: 12
19. Retrieving: https://www.fbi.gov/contact-us/fbi-headquarters/the-fbi-experience at 21:01:14.
Size of page: 62.92kb. Starting indexing at 21:01:15. Re-indexed
Links found: 74. New links: 1
20. Retrieving: https://www.fbi.gov/contact-us/field-offices at 21:01:21.
Size of page: 144.51kb. Starting indexing at 21:01:22. Re-indexed
Links found: 132. New links: 59
21. Retrieving: https://www.fbi.gov/contact-us/field-offices/sanantonio/news/press-releases/fbi-statement-on-the-mass-shooting-at-robb-elementary-school-in-uvalde-texas at 21:01:40.
Size of page: 62.78kb. Starting indexing at 21:01:41.
Indexed
Links found: 80. New links: 6
22. Retrieving: https://www.fbi.gov/contact-us/field-offices/washingtondc/news/press-releases/new-jersey-man-found-guilty-by-jury-of-charges-for-actions-related-to-capitol-breach at 21:01:49.
Size of page: 42.87kb. Starting indexing at 21:01:55.
Indexed
Links found: 28. New links: 27
23. Retrieving: https://www.fbi.gov/contact-us/field-offices/washingtondc/news/press-releases/new-york-man-sentenced-to-41-months-in-prison-for-offenses-committed-during-january-sixth-capitol-breach at 21:02:06.
Size of page: 42.85kb. Starting indexing at 21:02:12.
Indexed
Links found: 28. New links: 0
24. Retrieving: https://www.fbi.gov/contact-us/field-offices/washingtondc/news/press-releases/north-carolina-man-pleads-guilty-to-felony-charge-for-actions-during-january-sixth-capitol-breach at 21:02:20.
Size of page: 44.37kb. Starting indexing at 21:02:22.
Indexed
Links found: 30. New links: 2
25. Retrieving: https://www.fbi.gov/contact-us/field-offices/washingtondc/news/press-releases/texas-man-pleads-guilty-to-felony-charge-for-actions-during-january-sixth-capitol-breach at 21:02:28.
Size of page: 43.90kb. Starting indexing at 21:02:29.
Indexed
Links found: 31. New links: 3
26. Retrieving: https://www.fbi.gov/contact-us/legal-attache-offices at 21:02:35.
Size of page: 114.92kb. Starting indexing at 21:02:36.
Indexed
Links found: 153. New links: 79
27. Retrieving: https://www.fbi.gov/fbi-kids at 21:03:31.
Size of page: 57.17kb. Starting indexing at 21:03:32.
Indexed
Links found: 72. New links: 0
28. Retrieving: https://www.fbi.gov/flickr at 21:03:41.
Size of page: 521.55kb. Starting indexing at 21:03:44.
Indexed
Links found: 38. New links: 35
29. Retrieving: https://www.fbi.gov/history at 21:03:59.
Size of page: 66.71kb. Starting indexing at 21:03:59.
Indexed
Links found: 85. New links: 10
30. Retrieving: https://www.fbi.gov/investigate at 21:04:09.
Size of page: 78.61kb. Starting indexing at 21:04:15.
Indexed
Links found: 83. New links: 11
31. Retrieving: https://www.fbi.gov/investigate/civil-rights at 21:04:23.
Size of page: 77.33kb. Starting indexing at 21:04:29.
Indexed
Links found: 83. New links: 11
32. Retrieving: https://www.fbi.gov/investigate/counterintelligence at 21:04:39.
Size of page: 74.10kb. Starting indexing at 21:04:40.
Indexed
Links found: 116. New links: 42
33. Retrieving: https://www.fbi.gov/investigate/cyber at 21:04:55.
Size of page: 79.14kb. Starting indexing at 21:04:55.
Indexed
Links found: 112. New links: 37
34. Retrieving: https://www.fbi.gov/investigate/organized-crime at 21:05:09.
Size of page: 75.20kb. Starting indexing at 21:05:10.
Indexed
Links found: 88. New links: 15
35. Retrieving: https://www.fbi.gov/investigate/public-corruption at 21:05:18.
Size of page: 70.79kb. Starting indexing at 21:05:19.
Indexed
Links found: 93. New links: 20
36. Retrieving: https://www.fbi.gov/investigate/terrorism at 21:05:27.
Size of page: 75.65kb. Starting indexing at 21:05:27.
Indexed
Links found: 97. New links: 15
37. Retrieving: https://www.fbi.gov/investigate/violent-crime at 21:05:35.
Size of page: 71.99kb. Starting indexing at 21:05:36.
Indexed
Links found: 87. New links: 13
38. Retrieving: https://www.fbi.gov/investigate/white-collar-crime at 21:05:44.
Size of page: 83.75kb. Starting indexing at 21:05:44.
Indexed
Links found: 84. New links: 11
39. Retrieving: https://www.fbi.gov/investigate/wmd at 21:05:54.
Size of page: 70.40kb. Starting indexing at 21:06:00.
Indexed
Links found: 105. New links: 30
40. Retrieving: https://www.fbi.gov/itunes.xml at 21:06:11.
Not text or html
Links found: 0. New links: 0
41. Retrieving: https://www.fbi.gov/jobs at 21:06:12.
Size of page: 43.12kb. Starting indexing at 21:06:23.
Indexed
Links found: 39. New links: 35
42. Retrieving: https://www.fbi.gov/legalnotices at 21:06:35.
Size of page: 84.92kb. Starting indexing at 21:06:41.
Indexed
Links found: 72. New links: 0
43. Retrieving: https://www.fbi.gov/manifest.json at 21:06:48.
Not text or html
Links found: 0. New links: 0
44. Retrieving: https://www.fbi.gov/news at 21:06:48.
Size of page: 80.84kb. Starting indexing at 21:06:59.
Indexed
Links found: 100. New links: 15
45. Retrieving: https://www.fbi.gov/news/apps at 21:07:05.
Size of page: 72.37kb. Starting indexing at 21:07:11.
Indexed
Links found: 102. New links: 28
46. Retrieving: https://www.fbi.gov/news/espanol at 21:07:21.
Size of page: 75.44kb. Starting indexing at 21:07:21.
Indexed
Links found: 92. New links: 18
47. Retrieving: https://www.fbi.gov/news/photos at 21:07:55.
Size of page: 54.43kb. Starting indexing at 21:08:02.
Indexed
Links found: 63. New links: 7
48. Retrieving: https://www.fbi.gov/news/podcasts at 21:08:08.
Size of page: 176.74kb. Starting indexing at 21:08:09.
Indexed
Links found: 142. New links: 64
49. Retrieving: https://www.fbi.gov/news/podcasts/inside-the-fbi-keeping-law-enforcement-officers-alive-051822 at 21:08:27.
Size of page: 85.40kb. Starting indexing at 21:08:38.
Indexed
Links found: 80. New links: 4
50. Retrieving: https://www.fbi.gov/news/podcasts/inside-the-fbi-missing-childrens-day-2022-052522 at 21:08:49.
Size of page: 90.78kb. Starting indexing at 21:08:49.
Indexed
Links found: 94. New links: 14
51. Retrieving: https://www.fbi.gov/news/press-releases at 21:09:03.
Size of page: 104.94kb. Starting indexing at 21:09:04.
Indexed
Links found: 178. New links: 77
52. Retrieving: https://www.fbi.gov/news/press-releases/atom.xml at 21:09:22.
Not text or html
Links found: 0. New links: 0
53. Retrieving: https://www.fbi.gov/news/press-releases/press-releases/fbi-director-christopher-wrays-statement-on-the-school-shooting-in-uvalde-tx at 21:09:22.
Size of page: 65.12kb. Starting indexing at 21:09:23.
Indexed
Links found: 77. New links: 1
54. Retrieving: https://www.fbi.gov/news/press-releases/press-releases/fbi-releases-2021-and-first-quarter-2022-statistics-from-the-national-use-of-force-data-collection at 21:09:36.
Size of page: 71.27kb. Starting indexing at 21:09:37.
Indexed
Links found: 82. New links: 4
55. Retrieving: https://www.fbi.gov/news/press-releases/press-releases/federal-jury-convicts-high-level-isis-member-of-providing-material-support-to-a-foreign-terrorist-organization-including-two-counts-resulting-in-death at 21:09:42.
Size of page: 43.71kb. Starting indexing at 21:09:53.
Indexed
Links found: 40. New links: 30
56. Retrieving: https://www.fbi.gov/news/press-releases/RSS at 21:10:08.
Not text or html
Links found: 0. New links: 0
57. Retrieving: https://www.fbi.gov/news/press-releases/rss.xml at 21:10:08.
Not text or html
Links found: 0. New links: 0
58. Retrieving: https://www.fbi.gov/news/pressrel at 21:10:09.
Timed out (no reply from server)
Links found: 0. New links: 0
59. Retrieving: https://www.fbi.gov/news/speeches at 21:10:40.
Size of page: 69.45kb. Starting indexing at 21:10:46.
Indexed
Links found: 103. New links: 26
60. Retrieving: https://www.fbi.gov/news/speeches/atom.xml at 21:10:53.
Not text or html
Links found: 0. New links: 0
61. Retrieving: https://www.fbi.gov/news/speeches/RSS at 21:10:54.
Not text or html
Links found: 0. New links: 0
62. Retrieving: https://www.fbi.gov/news/speeches/rss.xml at 21:10:54.
Not text or html
Links found: 0. New links: 0
63. Retrieving: https://www.fbi.gov/news/stories at 21:10:55.
Size of page: 75.88kb. Starting indexing at 21:10:56.
Indexed
Links found: 93. New links: 10
64. Retrieving: https://www.fbi.gov/news/stories/atom.xml at 21:11:02.
Not text or html
Links found: 0. New links: 0
65. Retrieving: https://www.fbi.gov/news/stories/fbi-honors-fallen-during-2022-police-week-events-051122 at 21:11:03.
Size of page: 83.01kb. Starting indexing at 21:11:08.
Indexed
Links found: 98. New links: 21
66. Retrieving: https://www.fbi.gov/news/stories/former-fbi-director-airs-warning-about-elder-fraud at 21:11:16.
Size of page: 70.91kb. Starting indexing at 21:11:17.
Indexed
Links found: 86. New links: 8
67. Retrieving: https://www.fbi.gov/news/stories/RSS at 21:11:22.
Not text or html
Links found: 0. New links: 0
68. Retrieving: https://www.fbi.gov/news/stories/rss.xml at 21:11:23.
Not text or html
Links found: 0. New links: 0
69. Retrieving: https://www.fbi.gov/news/testimony at 21:11:24.
Size of page: 84.53kb. Starting indexing at 21:11:25.
Indexed
Links found: 128. New links: 50
70. Retrieving: https://www.fbi.gov/news/testimony/atom.xml at 21:11:38.
Not text or html
Links found: 0. New links: 0
71. Retrieving: https://www.fbi.gov/news/testimony/RSS at 21:11:44.
Not text or html
Links found: 0. New links: 0
72. Retrieving: https://www.fbi.gov/news/testimony/rss.xml at 21:11:49.
Not text or html
Links found: 0. New links: 0
73. Retrieving: https://www.fbi.gov/news/videos at 21:11:55.
Size of page: 81.90kb. Starting indexing at 21:12:01.
Indexed
Links found: 98. New links: 21
74. Retrieving: https://www.fbi.gov/privacy-policy at 21:12:10.
Size of page: 64.21kb. Starting indexing at 21:12:11.
Indexed
Links found: 75. New links: 3
75. Retrieving: https://www.fbi.gov/resources at 21:12:15.
Size of page: 71.62kb. Starting indexing at 21:12:15.
Indexed
Links found: 91. New links: 16
76. Retrieving: https://www.fbi.gov/resources/businesses at 21:12:22.
Size of page: 74.15kb. Starting indexing at 21:12:23.
Indexed
Links found: 86. New links: 6
77. Retrieving: https://www.fbi.gov/resources/law-enforcement at 21:12:28.
Size of page: 70.04kb. Starting indexing at 21:12:29.
Indexed
Links found: 115. New links: 33
78. Retrieving: https://www.fbi.gov/resources/library at 21:12:38.
Size of page: 103.97kb. Starting indexing at 21:12:40.
Indexed
Links found: 128. New links: 48
79. Retrieving: https://www.fbi.gov/resources/victim-assistance at 21:12:52.
Timed out (no reply from server)
Links found: 0. New links: 0
80. Retrieving: https://www.fbi.gov/resources/victim-services at 21:13:23.
Size of page: 76.55kb. Starting indexing at 21:13:23.
Indexed
Links found: 139. New links: 65
81. Retrieving: https://www.fbi.gov/rss.xml at 21:13:36.
Size of page: 25.40kb. Starting indexing at 21:13:43.
Indexed
Links found: 28. New links: 0
82. Retrieving: https://www.fbi.gov/scams-and-safety at 21:13:46.
Size of page: 62.36kb. Starting indexing at 21:13:47.
Indexed
Links found: 82. New links: 5
83. Retrieving: https://www.fbi.gov/services at 21:13:51.
Size of page: 89.30kb. Starting indexing at 21:13:57.
Indexed
Links found: 92. New links: 8
84. Retrieving: https://www.fbi.gov/services/cirg at 21:14:05.
Size of page: 98.87kb. Starting indexing at 21:14:05.
Indexed
Links found: 88. New links: 13
85. Retrieving: https://www.fbi.gov/services/cjis at 21:14:19.
Size of page: 79.54kb. Starting indexing at 21:14:20.
Indexed
Links found: 90. New links: 8
86. Retrieving: https://www.fbi.gov/services/cjis/identity-history-summary-checks at 21:14:28.
Size of page: 100.59kb. Starting indexing at 21:14:28.
Indexed
Links found: 113. New links: 30
87. Retrieving: https://www.fbi.gov/services/cjis/ucr at 21:14:45.
Size of page: 69.27kb. Starting indexing at 21:14:50.
Indexed
Links found: 105. New links: 19
88. Retrieving: https://www.fbi.gov/services/information-management at 21:14:59.
Size of page: 62.10kb. Starting indexing at 21:15:00.
Indexed
Links found: 79. New links: 4
89. Retrieving: https://www.fbi.gov/services/information-management/foia at 21:15:05.
Timed out (no reply from server)
Links found: 0. New links: 0
90. Retrieving: https://www.fbi.gov/services/information-management/foipa at 21:15:36.
Size of page: 79.37kb. Starting indexing at 21:15:37.
Indexed
Links found: 91. New links: 12
91. Retrieving: https://www.fbi.gov/services/laboratory at 21:15:45.
Size of page: 86.86kb. Starting indexing at 21:15:51.
Indexed
Links found: 108. New links: 28
92. Retrieving: https://www.fbi.gov/services/operational-technology at 21:16:02.
Size of page: 69.27kb. Starting indexing at 21:16:03.
Indexed
Links found: 78. New links: 5
93. Retrieving: https://www.fbi.gov/services/training-academy at 21:16:08.
Size of page: 99.92kb. Starting indexing at 21:16:14.
Indexed
Links found: 89. New links: 14
94. Retrieving: https://www.fbi.gov/site-icon.png at 21:16:29.
Not text or html
Links found: 0. New links: 0
95. Retrieving: https://www.fbi.gov/site-icon.png?scale=16 at 21:16:34.
Not text or html
Links found: 0. New links: 0
96. Retrieving: https://www.fbi.gov/site-icon.png?scale=32 at 21:16:35.
Not text or html
Links found: 0. New links: 0
97. Retrieving: https://www.fbi.gov/sitemap at 21:16:41.
Size of page: 331.44kb. Starting indexing at 21:16:48.
Indexed
Links found: 776. New links: 419
98. Retrieving: https://www.fbi.gov/tips at 21:18:34.
Size of page: 56.87kb. Starting indexing at 21:18:40.
Indexed
Links found: 83. New links: 7
99. Retrieving: https://www.fbi.gov/wanted at 21:18:45.
Size of page: 68.25kb. Starting indexing at 21:18:46.
Indexed
Links found: 96. New links: 14
100. Retrieving: https://www.fbi.gov/wanted/additional/miguel-a.-alvarado at 21:18:53.
Size of page: 65.40kb. Starting indexing at 21:18:54.
Indexed
Links found: 96. New links: 11
101. Retrieving: https://www.fbi.gov/wanted/bank-robbers at 21:18:59.
Size of page: 58.74kb. Starting indexing at 21:19:00.
Indexed
Links found: 81. New links: 4
102. Retrieving: https://www.fbi.gov/wanted/capitol-violence at 21:19:05.
Size of page: 394.66kb. Starting indexing at 21:19:06.