Sent from my Verizon Wireless 4G LTE Smartphone
-------- Original message --------
From: Pamela Graham
Date: 10/16/2013 12:23 PM (GMT-07:00)
To: James Simon ,"Rader, Mary R"
Cc: Gary Hausman
Subject: Fwd: RE: Re: [Consald-l] documenting human rights
(From Pamela Graham at Columbia)
Dear CONSALD colleagues,
It's great to see a discussion of web archiving happening on the CONSALD list. Thanks to Mary and to David for bringing attention to the efforts that are underway for human rights-related web content. James' review of what's in both archives is very helpful. I know UT and Columbia can benefit from the expertise of CONSALD members and welcome any suggestions of sites that should be preserved.
I can share a few more details about selection issues and discovery that might be of interest to the group. At Columbia our collection guidelines were fairly basic when we started, and we did not want to develop too elaborate or complex a policy. We are collecting websites of human rights non-governmental organizations, blogs of research relevance and value, and the sites of some national human rights institutions or agencies (some goverment sponsored and some quasi-governmental). We are not archiving government sites or sites in countries that have robust web archiving initiatives (some Western European nations, the UK and Australia, namely). We have used a variety of methods to identify sites, including selector recommendation, public suggestions, and referrals from the sites and organizations we collect. At Columbia we seek permission to crawl from the site owners and respect take-down requests. We generate catalog records at the site level, and load these into OCLC.
We are in regular contact with our colleagues at UT and have occasionally checked to see which sites they are crawling, although we haven't pursued formal coordination. In web archiving, it's not always a bad thing to duplicate crawls given how content is constantly changing. Some redundancy can be a good and even desired thing. Interesting to see that there has not been a lot of duplication for South Asia sites.
Both Columbia and UT are using the Internet Archive's Archive-It service and you can search our collections simultaneously through the AI interface. We also developed our own interface to our collection, the Human Rights Web Archive. If you search the HRWA, our results lists display a "Search other sources" tab, which will allow you to re-run your search across the AI collections, including UT's sites. It's likely that search and discovery will continue to become more integrated, at least across the AI collections. We are crawling quarterly and can do crawls to respond to urgent needs. We're glad to share more details on our process and workflows with anyone who's interested. Our broader web collection program site has more information.
Our website nomination form is integrated into the HRWA. We may not be able to archive all nominated sites but will review and consider all suggestions.
Sourcing input from communities of experts is an important strategy for this kind of collecting and I join Mary in encouraging you to submit your suggestions. Your ideas are welcome at either or both web archives!
Pamela M. Graham
Director of Global Studies
Director, Center for Human Rights Documentation & Research
Columbia University Libraries / Information Services
318 International Affairs (Lehman Library)
420 W. 118th Street, New York, NY 10027
-------- Original Message --------
Subject: Re: [Consald-l] documenting human rights
Date: Mon, 14 Oct 2013 10:11:35 -0400
From: David Magier
To: James Simon
CC: Mary Rader , CONSALD , Pamela Graham
the UT human rights web archive is a great resource. Another one you should look at (with much more South Asia content already in it) is Columbia's Human Rights Web Archive: http://hrwa.cul.columbia.edu/, which I've reported on in earlier CONSALD meetings. It's been actively collecting websites of human rights organizations from around the world under Mellon grants since 2008. Like the UT archive, entries are nominated through an online form (http://hrwa.cul.columbia.edu/public_nomination), which has been used by area studies librarians including CONSALDers (as well as HR activists, NGO organizations, etc.) to build up an impressive collection. The sites are crawled regularly according to different schedules based on how frequently the target sites themselves are updated, to allow the archive to contain an ongoing picture of the evolution of the content. The interface allows searching as well as browsing by subjects, places and languages. Apparently, no explicit plans for content coordination between these two archives (i.e. coordinated collection development policies) have been made yet. I'm sure if you nominate a South Asia human rights organization for either one, it will be well documented, preserved (although perhaps at differing frequencies of capture), and kept accessible via the archives. But hopefully better centralization, coordination and planning will enable contributors to nominate entries to one place or the other (not both!) depending on topic or region. For now, my own occasional South Asia HR nominations (yes, somehow I am still doing this) are going to the CU site.
David Magier, PhD
Associate University Librarian for Collection Development
One Washington Road
Princeton, NJ 08544
On Oct 11, 2013, at 7:43 PM, James Simon wrote:
Thanks for this information, Mary. A nice feature is the ability to filter by area of coverage. South Asia does not appear to be widely represented. Perhaps folks already know of significant sites (a lot of us maintain profiles for HR) or have faculty/scholars who can recommend resources deserving of a longer life.
Sent via DroidX2
From: "Rader, Mary R" >
Sent: Fri, Oct 11, 2013 15:00:30 GMT+00:00
Subject: [Consald-l] documenting human rights
As many of you are already well aware, the UT Libraries have been actively engaged in documenting and preserving materials related to human rights through the Human Rights Documentation Initiative (HRDI, see http://lib.utexas.edu/hrdi) . One part of that broad initiative is to capture and archive web-based human rights documentation and related content from human rights organizations and advocates across the globe; the current collection of this activity can be accessed here:http://archive-it.org/collections/1475. The HRDI archivists know first-hand how important capturing and preserving this information can be—over the past few years, 56 of the sites included in the collection have either disappeared or ceased publishing which reminds us how ephemeral human rights web publishing can be.
The HRDI archivists have recently put out a call for new websites to archive, hence my message to you for your ideas. Sites should be recommended based on the quality of unique information presented as well as the perceived fragility/instability of the site. If you have suggestions, please do submit them through the online recommendation form: http://www.surveymonkey.com/s/hr-website-nomination-form.
If you have any questions or concerns, please don’t hesitate to contact me or T-Kay Sangwand, the UT’s HRDI Archivist (I’m also happy to discuss in person at Madison next week). We eagerly await your ideas and suggestions.
Global Studies Coordinator / South Asia Librarian
University of Texas Libraries
The University of Texas at Austin