- Joined
- Oct 2, 2016
That doesn’t explain how a profile of that age is first archived last year, if it’s been around that long it had to have had an earlier archive which it doesn’t. It started getting attention last year which tells me that someone had to manually archive it and has been sitting on it.>In October of 1996, engineers at the the San Francisco-based Internet Archive launched their first web crawlers, taking snapshots of web pages. At the time, the World Wide Web was only 2.5 terabytes in size. In 1996, it was still impossible to predict how large the World Wide Web might become. Even in those early days of the Web, broken links (404 errors) were a growing problem, and it was clear that most Web pages were short-lived. Brewster Kahle and Bruce Gilliat invented a system for archiving Web pages before they vanished. The tools for this project were not terribly sophisticated; they were essentially PC applications built to capture entire websites by following the links from the main page.
>In this video, shot by Marc Weber and Kevin Hughes for the Web History Project, Brewster Kahle explains his hardware and process, while the first crawl is underway.
>25 years later, the Wayback Machine--which launched as a public search engine of web pages in 2001--has captured some 588 billion web pages by working with 800+ partners around the world. In 2021, Internet Archive founder, Brewster Kahle, reflects back on the most surprising advancement of his early innovation, the Wayback Machine.