Tuesday, September 2, 2008

September 2, 2008

"The combination of both automatic and manual collecting is the only way to ensure that, no matter what the technical wrapping, the most relevant Web content is found and archived" (Masanes, para 16).

Adrian Brown, in his book Archiving Websites (2006), discusses selective vs. unselective archiving. These two options carry with them many of the same selection and appraisal decisions long debated with paper records, like judgments regarding scope, evidential value, informational value, etc. Selective archiving, taking in some materials and not others, may lead to loss of contextual information. It involves more human interaction with the harvested materials, and consequently more resources. Unselective archiving, on the other hand, brings in (almost) everything, but ... it brings in (almost) everything. In the end, both still require some degree of human effort; the differences are in the amount of intervention and at which part of the process that intervention takes place.

Only having dipped my toes into the lake of theoretical literature as well as the practical examples of web archiving, I'm already seeing one trend: librarians and archivists seem to agree that unselective archiving, a la the Internet Archive, is not adequate in and of itself for long term preservation and access. The WebArchiv, as one example, does broad crawls of an entire domain as well as selective harvesting of sites targeted by curators. It also develops thematic collections. I get the impression that part of the desire to go beyond unselective archiving stems from our long history of adding value to collections through assignment of metadata and organization through cataloging. Another part is being shaped by the nature of the web. Though the material to be harvested is vast and changeable, a multi-pronged approach, which includes human quality control as well as scheduled broad harvesting, seems to be the only way to achieve the quality and quantity desired by many cultural institutions.

Coufal, L., & Žabička, P. (2007). Strategies and approaches to building thematic collections in WebArchiv. INFuture2007: Digital Information and Heritage, Zagreb.

Masanes, J. (202). Towards continuous web archiving: First results and an agenda for the future. D-Lib Magazine, 8(12) Retrieved from http://www.dlib.org/dlib/december02/masanes/12masanes.html