In October of 1996, engineers at the the San Francisco-based Internet Archive launched their first web crawlers, taking snapshots of web pages. At the time, the World Wide Web was only 2.5 terabytes in size.
2010
2001
2005
2020
1997
2024
2019
2006
2018
2004
2012
1998
2002
2026
2023
1987
2016
2025