Tuesday, February 24, 2009

February 24, 2009

It's past time for another update, and things have been moving along slowly but surely. The most major accomplishment I can report is that I've finished a draft Web Site Collection Plan. I last mentioned this at the end of January. It's based on my assessment of other web site collection policies as well as the Collection Plan template from the Web-at-Risk project. This draft is available here.

Some parts of this policy are incomplete, simply because they will depend on an overarching digital preservation program. Other parts depend on current metadata practices here in Wilson Library that I haven't been able to pin down yet. Of course they're all flexible recommendations. I think it would be a good place to start, and possibly even a document that can be expanded to other collecting areas.

There's also been some headway on the Web Curator Tool (WCT) installation, thanks to help from staff at ibiblio.org. I gather that it is installed, but I could not yet get it to run. I'm sure this is due to my own tenuous knowledge of how to run things in a Unix environment.

Finally, I've been working on my poster presentation for DigCCurr 2009, which is looming on the horizon. The title is "Getting the Tar Off of Our Heels: Moving Forward with Archiving University of North Carolina at Chapel Hill Websites." Since this poster hinges on the successful trial of WCT, I'm hoping that I can get that tool running in some capacity soon. I've decided to develop a rubric for measuring different aspects of the web archiving tools I've trialed. The three facets will be (1) ease of installation/setup (2) ease of use (3) features. I'm trying to find a vetted set of characteristics for evaluating software, but am thus far not having luck. Barring that, the characteristics I have come up with are highly subjective, but hopefully still meaningful.

Tuesday, February 10, 2009

February 10, 2009

I've finished my little experiment, as mentioned in the last post. I have to say, it was pretty enlightening, and I'm glad I took the time to do it. (As a side note, when I was almost finished, I suffered a data loss - you would think that a student of digital curation would know better - and had to start over. So, let that be a lesson to me for backing up my own data.) So here's how it went.

Using a random number generator, I selected 20% of the completed records schedules. This gave me 16 different schedules, listed here:

K-12 International Outreach Office
Research & Evaluation (OIA)
Program in the Humanities and Human Values (CoAS)
City & Regional Planning
Dean's Office (School of Medicine)
Biochemistry & Biophysics (School of Medicine)
Medical Science Teaching Labs (School of Medicine)
Business & Finance (School of Dentistry)
Human Resources (School of Dentistry)
Student Services (Dept of Maternal & Child Health)
Center for Urban & Regional Studies
Manuscripts Department (Wilson Library)
Conservation (Wilson Library)
Grounds Services (Facilities)
Building Services (Facilities)
Housekeeping (Facilities)

I read each schedule, keeping track of which series were supposed to be transferred to University Archives (I'll call these "UARMS series" here). I then tried to locate each department's associated website, and was able to do so in all cases. Finally, I scoured these sites looking for any records that fall into the UARMS series.

Here's an example, Housekeeping (Facilities) has 6 series whose records are normally transferred to UARMS in paper format. Two of those six, photographs and policies/procedures, can be found on the Housekeeping website. This means that documents that fall into 33% of its UARMS series records types can be found to some degree in digital form on their website.

As anticipated, the website pages ranged widely in depth and type of content. Some were only one page of text, others were numerous pages deep with multiple file types present. Here are the general results of my survey:
  • The percentage of UARMS series document types that could be found on the departments' websites ranged from 0% to 67%.
  • The average number of those types found on the website across all sites was only 27%.
  • The department with the most record-worthy online content was, surprisingly, Grounds Services.
  • Many of these departments had scheduled records series in common. The most common were committee and council records (12 out of 16), correspondence (15 out of 16), photographs (12 out of 16), and polices and procedures (13 out of 16). Of these, only photographs were routinely found online (92% of the departments).
  • Photographs, policies/procedures, and conference/workshop (conducted) records were the most common types found online.
  • Only 10 of these 16 departments had "website records" on their record schedules, even though all had some sort of website.
After undertaking this survey, I decided to look at the finalized General Administration schedules and to do the same thing. Because there are so few, I did all of them:

Academic Affairs Administration (incl Int'l Programs)
CFNC-Pathways
NC in the World (NC Center for Int'l Understanding)
Licensure Office (Academic Affairs)
Research and Sponsored Programs (Academic Affairs)

To compare, here are some more findings:
  • The percentage of UARMS series document types that could be found on the departments' websites ranged from 10% to 57%.
  • The average number of those types found on the website across all sites was 39%.
  • Much more prevalent for these departments were reports (including annual) and publications.
Considering the caveats mentioned in my last post about my methodology, I still feel that this was an informative exercise.
  1. I am surprised that more information isn't online, especially considering that UNC is a state university. I had expected a lot more online information in the form of events, strategic planning documents, statistics, and meeting records. I was gratified by the fact that the General Administration sites, on average, did have a lot more of this type of information.
  2. In general, I was also surprised at how little information some of these departments have on their websites, and how out of date some of that information is.
  3. I am curious about the number of intranets that exist on campus. I found one or two sites that had log in pages, and one that required a log in to view committee minutes, which was a UARMS series. I think/hope that much of the information I mentioned in #1 may in fact be on the intranet instead of the public web.
  4. Harvesting these websites will pull in a lot fewer documents that qualify as records than I had expected.
Despite my statement in #4, I still think harvesting these sites would be a great asset for the following two reasons. First, those sites that do put up UARMS series often only have the most recent version of the record online. I imagine this is replaced each time a newer version comes out. Harvesting websites could capture all of those documents. Second, the "website records" series would be greatly enhanced with the captured pages. I personally feel that any department that has a website (and all of them did, in some form or another) should have that series on their schedule.

Again, my method has some faults. My sample is small compared to the gamut of UNC departments. Even though I chose randomly, many of the departments were from the same school/college. Also, those who have completed schedules probably are more records-aware in the first place, and may, as a result, have more content online. It also probably isn't fair to look for correspondence or some types of personnel records online, even though they are UARMS series. These aren't the types of things people would typically put on a website. Still, if nothing else, scanning through all of these websites in search of records has given me a better idea of what exactly this institution is putting out there and what, eventually, we would pull in.