Carl Malamud announced yesterday the inaugural meeting of the International Amateur Scanning League (IASL) (I'm already imagining cool swag!). Malamud is taking FedFlix program to the streets! Fedflix, a joint venture between the National Technical Information Service and Public.Resource.Org, digitizes NTIS video and makes them available on YouTube, the Internet Archive, and the public.resource.org Stock Footage Library.

Well now a gang of volunteers including members of DC CopyNight and Smithsonian employees working on their own time are going to the National Archives and Records Administration (NARA) and copying over 1,500 DVDs to be uploaded to the net.

Malamud said:

What makes this grassroots digitization effort so remarkable is that it has the full support of the government. Indeed, David Ferriero, the U.S. Archivist, joined me in the initial meeting where we taught volunteers how to rip DVDs!

Kudos to Malamud and the IASL!

And this makes me think that more libraries and librarians should be doing the same thing for govt documents. Why not set up your own scanning operations in your depository library (Book Liberator or DIY Book Scanner can show you how to digitize on the cheap!) and then deposit those scans into the Internet Archive's US Documents Collection (don't forget to follow FDLP digitization standards!). Scans could also be ingested into FDSys (when they've got that capability working ;-)). So get to it; what are you waiting for?!

Carl Malamud posed this question over on twitter: "What if our national cultural institutions all worked together on a common problem, attracted White House support?" In his post on the O'Reilly blog, "A National Scan Center: A Public Works Project", Malamud scopes out the issues and calls for Library of Congress, the Smithsonian Institution, the Government Printing Office, the National Archives and Records Administration, and the National Technical Information Service to come together and make the compelling case for funding a 5-year $500 million effort to create a National Scan Center. Here here Carl!

In the U.S., we face a similar deluge of paperwork that we faced in the 1930s. A huge backlog of paper, microfiche, audio, video, and other materials is located throughout the federal government. Little money has gone from Congress for digitization, and bureaucracies have resorted to a series of questionable private-public partnerships as a way of digitizing their materials. For example, the Government Accountability Office shipped 60 million pages of our Federal Legislative Histories (the record of each law from the initial bill through the hearings and conference reports) off to Thomson West, but didn't even get digital copies back. Another example is the recent failed effort by the Government Printing Office to digitize 60 million pages of the Federal Depository Library Program, an effort they tried to get through as a "zero dollar cost to the government" effort with the private sector.

There are no free lunches and there are no "no cost to the government" deals. The costs involve the government effort to supervise the contract, prepare the materials, and ship them, and in both the GAO and GPO cases, the government wasn't getting much back for its effort. What the government and the people usually get is a lien on the public domain, preventing the public from accessing these vital materials. Similar efforts are sprinkled throughout the government. I testified to Congress that I had learned that the National Archives was contemplating a scan of congressional hearings with LexisNexis under similar circumstances, and many may be aware of the questionable deal the Archives cut with Amazon where my favorite online superstore got de facto exclusive rights to 1,899 wonderful pieces of video.

Carl Malamud's FedFlix project is a joint venture with the National Technical Information Service (NTIS) whereby he takes NTIS videos, digitizes them and uploads them to the Internet Archive.

Well now he's expanding FedFlix to include public domain videos from the National Archives. He's released 41 videos into the public domain in this way, but has put together an Amazon Wish List in order to expand public access to public domain video content from the National Archives. If you see anything you'd like to buy the public domain, they'll take your DVD and upload the video to YouTube, the Internet Archive, and to public.resource.org's own rsync/ftp public domain stock footage library. So why not add a gift of the public domain to your favorite person's/people's stockings this year? We'll all be glad we did!

UPDATE 12/25/09: The wish list has been fulfilled. You can watch all of the donated NARA videos on YouTube, Internet Archive, or public.resource.org's bulk server. Thanks Carl!

[HT BoingBoing!]

We posted about Carl Malamud's address to the Gov2.0 Summit in september, but BoingBoing reminded us that there is now video of his address (below). Carl's speech is quite rousing and reminds all of us what we can and should be doing to facilitate access to government information. You can also get his pamphlet online to read along with the address.

And don't forget to read Appendix A: "29 things government could do today." One thing I would add to that list is that every witness statement inserted into the official record in the course of public Congressional hearings should be considered in the public domain regardless of its original copyright status (some witnesses submit published articles, book chapters and the like as part of their written statements which means that the Google Book Project *still* treats post-1923 scanned government publications as if they were in copyright and only shows snippets instead of full-text.)

“Government as platform” means exposing the core information that makes government function, information that is of tremendous economic value to society. Government information—patents, corporate filings, agriculture research, maps, weather, medical research—is the raw material of innovation, creating a wealth of business opportunities that drive our economy forward. Government information is a form of infrastructure, no less important to our modern life than our roads, electrical grid, or water systems. (p.21)

[Thanks for the reminder BoingBoing!]

The Princeton Center for Information Technology Policy (CITP) will host a 2-day workshop Open Government: Defining, Designing, and Sustaining Transparency at Princeton U, Jan 21-22, 2010. Along with a wide-ranging discussion on transparency, there will be a session on friday on the proposed law.gov registry and repository. I hope lots of people in the Princeton area will attend (FYI, there will be a law.gov symposium at Stanford on January 12, 2010. More to come).

Day 1: Thursday January 21 (9am - 5pm)

Defining Transparency:
This session will aim to take a critical look at what government transparency means. Some of the questions the panel will consider are: What do people mean when they use these terms? Are open government and government transparency a means or an end? What are the boundaries and tensions involved with different conceptions? What is the history of the use of these concepts and what are various flavors of transparency?

Designing Transparency:
This session seeks to take a deep look into architecting systems such that they support open government and transparency. Some fo the questions the panel will consider include: How do we design systems, infrastructures and processes to support transparency? Is transparency a value like security, privacy and usability that must be designed into systems from the beginning? If so, how do we include transparency into policy and technical processes? Are there still effective ways to make existing systems more transparent without ineffectively “bolting on” transparency support after policies and systems are fielded?

Sustaining Transparency:
We’d like to think that open government and transparency are not “fads” or “trends” that could disappear. It seems that now is the time to think deeply about how open government and transparency can sustain. Can we measure how open or transparent government is, such that we would notice any adverse downturns? How do we ensure that transparency is a value that outlasts changes in political winds? In addition to making data available on an ongoing basis, what are strategies for sustainable transparency? How do we educate the public to recognize the value of open government and demand transparency of governmental systems? How much of this can we control and what strategies can we conceptualize that will result in obvious public interest value to bolster open government?

Breakfast (8:30am - 9am)

Day 2: Friday January 22 (9am - 12:30pm)

Law.gov Session:
Access to primary legal materials in the United States is the subject of this session. We’ll discuss current provision of these materials by the Federal and State governments through government systems (such as the GPO’s FDSys and the Judiciary’s PACER system), through commercial providers such as Lexis and West, and various alternatives that have sprung up in both the private sector and from nongovernmental organizations such as Public.Resource, Altlaw, and the RECAP project. In addition to examining the current situation for access to materials, this session will include discussion of the Law.Gov effort, a year-long effort to document detailed specifications that would enable the Federal and then state and local governments to provide a distributed, open source, authenticated registry and repository for primary legal materials. Similar in spirit to the Data.Gov system recently launched, the Law.Gov effort includes a series of workshops at ten major law schools in early 2010.

Engaging Tinkerers:
The availability of data sources and access to government agencies are only a first step in projects involving open government and governmental transparency. The next step is matching the supply of such projects with demand for working on such projects. Tinkerers–those that would create systems that use data from and increased access to government systems–and governmental suppliers need to coordinate in some fashion to best realize project-based open government efforts. What are mechanisms that might match governmental supply of data and access to these tinkerers in an efficient manner? Would a mini-CFP system work, where tinkerers would be on a distribution list that governmental actors could post opportunities for project-based open government work and then decide which projects to work with? Are there legal barriers to such organization? Does it even make sense to “launch” such data sets and access opportunities with projects that benefited from exclusive access before a public launch?

[Originally tweeted by rschon. Thanks for the tip!]

Los Angeles Time business columnist Michael Hiltzik discusses key players in the Free Government Information movement in the article These crusaders bring transparency to government (28 September 2009).

[UPDATE: Michael Keller, University Librarian at Stanford University (and my boss), wrote a letter to USPTO as well. Thanks Carl for posting it to scribd.]

Carl Malamud made me aware (see his letter to USPTO CIO John Owens below) of a posting on FedBizOpps of a Request for Information (RFI) from the US Patent and Trademark Office:

"This RFI seeks to obtain information from interested parties, including the vendor community, about potential opportunities to acquire patent and trademark data in bulk (my emphasis) and to provide such data to the public without cost. The USPTO is seeking comments on the identified problem and solutions that will make the data available to the public without charge."

While there is mention in the RFI of IP data being easily accessible to the public, there's no mention of data.gov. This seems to be purely a "no-cost" way for USPTO to upgrade their IT infrastructure by giving away public domain information.

This is worrisome on so many levels as it is just one more example of a government agency looking to outsource and privatize public domain information *and* its IT infrastructure -- see for example the Thomson West contract with the GAO to digitize their legislative histories. Additionally, in a vague nod to transparency, USPTO will be holding 1 (yes only 1) vendor information meeting on Sept 24. I'm not sure how USPTO thinks that a 2 week notice for a meeting held in DC will help the cause of transparency. Shouldn't they have several meetings in different geographic locations to talk about such a huge and important public resource (nearly 2 petabytes of data!!)?

Luckily, this is only at the RFI stage, not RFP stage. USPTO is currently only looking for information on how to do this. This is the time for the government information/transparency communities to submit ideas for how the USPTO could make their patent information available *without* giving it away to vendors. Please contact the USPTO at the addresses below and give them ideas for making their data open, standardized and freely available in bulk.

Public Meeting:
Thursday, 24 September 2009
9:00 a.m. -11:00 a.m.
USPTO Campus in the Madison Auditorium
600 Dulany Street
Alexandria, VA, 22314

Contracting Office Address:
P. O. Box 1450 - Mail Stop 6
600 Dulany Street, MDE, 7th Floor
Alexandria, Virginia 22313-1450

Primary Point of Contact.:
publicdatadissemination@uspto.gov

Secondary Point of Contact:
V. Anne Tugbang,
Contracting Officer
vanne.tugbang@uspto.gov
Phone: 5712726550
Fax: 5712736550

In case you missed last week's lunchtime listen of Carl Malamud at the gov2.0 summit, the video's now been put online. Check it out. I defy anyone to say he wouldn't make a great public printer!

Carl Malamud (from public.resource.org) gave what was generally agreed was a rousing talk at Gov2.0 Summit this morning. The talk was entitled "By the people..." Please go to his site to access the pamphlet he created (and order it for your library!) and a live pre-recording of the address. I promise it'll be worth it!

Yesterday Library Journal published its annual list of notable government documents, "Looking Back, Moving On: 2008 Best Notable Government Documents" written by Jim Church and his team of selectors and judges on the Government Documents Round Table (GODORT) Notable Documents Panel. Every year since 1983, the panel has pulled together and highlighted state/local, federal and international government documents in order to "promote awareness and acquisition of government publications by libraries and use by library patrons."

This year's list highlighted such publications as Congressional Research Service (CRS) reports as well as free statistical databases from the United Nations (UNdata), the European Union (Eurostat) and the UN's Food and Agriculture Organization (FAOStat). Plus there was a special shout out to Carl Malamud and his Yes We Scan! campaign for Public Printer of the Government Printing Office. Check out this year's list of notable documents. You'll be amazed at the depth and breadth of publications by the various levels of governments. And by all means, if you have a favorite government document that you'd like to highlight, the Panel is always interested in nominations!

(Full disclosure: I'm the chair this year of GODORT's Publications Committee, which oversees the work of the Notable Documents Panel.)

Reason #273 for why working at Stanford is pretty cool! YesWeScan!!

Letter from Michael A. Keller, Stanford Universiity Librarian

Technemag.com just published "Techné Interviews Public Printer Candidate Carl Malamud". The interview focuses on online access to government information, of course, but I found this portion of the interview enlightening:

Techné: It seems that many of your proposals for the GPO can be put together under the headings of ‘increasing transparency’ and ‘updating the system for the 21st century.’ A great deal of both of these will involve the use of the internet and other new media platforms. How much printing do you envision as part of the GPO in the middle to long term? Is the title of ‘Public Printer’ any longer an accurate one—or would Chief Information Officer be more fitting?

Malamud: Publisher would be better than CIO. I’m a strong believe that there is a role, and will continue to be a role, for print. You’ll note in some of my proposals I’ve suggested that moving towards the “high end” is a way to continue to maintain jobs at GPO, which has some of the best printers and craftsmen in the world. Some things, such as “commodity printing” may go online or may get distributed, but remember that of the $1 billion in print business GPO does, about $800 million of that is already farmed out to private industry.

On 02.24.2009, FGI "wholeheartedly and without reservation" endorsed the YES WE SCAN campaign of Carl Malamud for Public Printer of the United States. Mother Jones unequivocally endorsed Malamud one week later: "President Obama, Appoint Carl Malamud!" (Jonathan Stein | Mon March 2, 2009):

"Carl Malamud is a badass. If you are a techie or a transparency geek, you probably already know who he is. If you've never heard of him, he is an internet pioneer who has worked for decades, at times using renegade means, to make government information public. He fought to make the information in the SEC's "EDGAR" database free and public (which it now is) and is currently leading a similar fight over the court records database PACER. Today, Malamud has another campaign. He wants to become the Public Printer of the United States, i.e. the head of the Government Printing Office (GPO)..."

The Lede Blog, NYTimes.com, looks at Malamud's campaign in "Yes He Scan" (03.04.2009): "To show that he’s the people’s choice, Mr. Malamud is asking for support in the form of links to his site. So far he says he’s got more than 700 endorsements, like these tweets, and this blog post by Lawrence Lessig, which says, in part:

'I can’t imagine a more exciting appointment. Sometimes an agency needs STASIS. Sometimes it needs CHANGE. Gov’t tech is certainly in the second category, and no one I know of could more effectively deliver on the commitment to open government than he.'" [Lessig Blog | 02.27.2009]

Yes we scan! Carl Malamud, great good friend to govt documents librarians and to the public domain, wants to be the next Public Printer of the United States. He takes as his guides in this pursuit former public printers Augustus E. "Gus" Giegengack and Ben Franklin. His inspiration to public service and his stated plan (below) will have a great and prolonged positive effect on libraries, the Government Printing Office (GPO), government transparency, and access to and preservation of govt information. It is for these reasons that FGI wholeheartedly and without reservation endorses Carl Malamud for Public Printer of the United States.

Yes we scan!

Please allow me to highlight a few of the items that I think we all need to pay attention to, and I invite you to contact me so we can continue to talk about these issues. Publication is a two-way street, and I hope this is the beginning of a long-term dialogue about the public domain and how the United States of America presents itself to the world:

1. America's Operating System. The Government Printing Office serves all 3 branches of government and prints the Official Journals of Government. GPO should lead the effort to make all primary legal materials produced by the U.S. readily available.

2. Librarians. Librarians are the bedrock of the public domain and the defenders of our fundamental right to access knowledge. GPO should work even more closely with our libraries and reform the Federal Depository Library Program to support them better.

3. Jobs. As commodity printing goes the way of the PDF file and the copy machine, GPO must retrain and refocus its workforce, working with the unions and the employees so we may face the challenges of the future. If nominated and confirmed, I would work to establish a United States Publishing Academy, reviving the grand tradition of GPO being in the lead for workforce development, vocational training for students, and educating the rest of the U.S. government on how to print and publish effectively.

4. Security. GPO produces passports and other secure documents. The current design for passports uses an RFID chip, which means that an American can be picked out of a crowd merely by having a passport in their pocket. If nominated and confirmed, I would ask security expert Bruce Schneier to form a Blue-Ribbon Commission to reexamine the design of passports and other secure documents so we can better protect the privacy and security of all Americans.

5. Jobs. The GPO workforce includes some of the best master printers, bookbinders, and other professionals of the publishing profession. With our cultural institutions, writers and other artists, and using the historical archives of the United States, the GPO should create more materials for the public domain, both as fully produced books as well as freely available master files for others to use and remix.

6. Rebooting .Gov. There is no reason why the U.S. Government should not be one of the top 10 destinations on the Internet! GPO should work with the rest of the U.S. Government to radically change how we present information on the Internet. Some of the initiatives would include installing a cloud for .gov to use, enshrining principles of bulk data distribution into legislation, and a massive upgrade in the government's video capabilities.

7. Full Transparency. GPO serves all 3 branches of government. As the nation's service bureau, GPO must be fully transparent in its own financial affairs and should be a forceful and effective advocate for the public domain. Most importantly, the GPO must be fully transparent to its clients—the Congress, the Executive Branch, and the Judiciary. If nominated and confirmed, I would pledge to serve on the front lines of customer service, working to understand the needs of our clients and the public.

Yes we scan!

Since Daniel mentioned yesterday about LOCKSS and digital deposit as recession insurance (which BTW is a GREAT oogly hook for open govt!!) I thought I'd mention a hot new article that Daniel and I wrote for the February 2009 issue of Against the Grain about the new U.S. Government Documents Private LOCKSS Network (citation below). The issue has not officially been released, but we got permission to post to FGI as a preprint.

The article describes the LOCKSS model of digital preservation and why that model is beneficial to apply to the realm of digital government information. We describe Carl Malamud's herculean efforts toward better access to government information; Then talk more specifically about the new USDOCS Private LOCKSS Network (USDocsPLN) using those documents harvested by Malamud. The paper concludes with a call to action.

Let us know what you think. and by all means, help us move forward with the USDocs network by participating. LOCKSS is great recession insurance and SO much more!

Citation: Distributed Globally, Collected Locally: LOCKSS for Digital Government Information. Daniel Cornwall and James R. Jacobs. Against the Grain, 21(1) February, 2009. p.42-44 (p.5-7 of the PDF)

The preservation of federal documents is too important to be left to the federal government alone; we have the makings of a viable system to preserve digital government publications. There are several ways you can help.

Join our private LOCKSS Network. Join the LOCKSS alliance, get a server for under $1,000, and contact us. The more servers in the USDocsPLN, the merrier.

Notify us of collections of electronic federal documents. LOCKSS staff can show you how easy it is to allow LOCKSS to ingest and preserve your materials.

Attack the root problem. Demanding your Members of Congress legislate and FUND a system that will ensure that GPO proactively deposits publications and data through the FDLP and other interested partners. While the USDocsPLN project is a good start and an excellent ad-hoc effort, it should be the government's responsibility to put information in the hands of taxpayers. We should not have to be prying it out of the government’s hands. A distributed digital FDLP benefits everyone.