There are several national systems for assessing, evaluating, or otherwise rating the quality of public libraries.
United States
Basic library statistics were initially maintained by the National Center for Educational Statistics; that body continues to collect data for academic libraries, but administration of the Public Libraries Survey and the State Library Agencies Survey was transferred to the Institute of Museums and Library Services in October 2007. IMLS continues to conduct public library surveys as well as distribute historical data from surveys back to 1988.
HAPLR and subsequent debate
The system that would become Hennen's American Public Library Ratings was first published in the January 1999 issue of American Libraries prepared by Thomas J. Hennen Jr., Director of Waukesha County Federated Library System in Wisconsin. Libraries were ranked on 15 measures with comparisons in broad population categories. HAPLR was updated annually through 2010 and was the focus of widespread professional debate in the field of librarianship. Oregon State Librarian Jim Scheppke noted that the statistics that HAPLR relies on are misleading because they rely too much on output measures, such as circulation, funding, etc. and not on input measures, such as open hours and patron satisfaction. "To give HAPLR some credit, collectively, the libraries in the top half of the list are definitely better than the libraries in the bottom half, but when it gets down to individual cases, which is what HAPLR claims to be able to do, it doesn't work." In contrast, John Berry III noted: "Unfortunately, when you or your library receives any kind of honor, it stimulates the flow of competitive hormones in your professional colleagues. This jealousy rears its ugly head in many ways. We've suffered endless tutorials on the defects in Hennen's rankings. So what? They work!" Keith Curry Lance and Marti Cox, both of the Library Research Service, took issue with HAPLR reasoning backwards from statistics to conclusion, point out the redundancy of HAPLR's statistical categories, and question its arbitrary system of weighting criteria. Hennen responded, saying Lance and Cox seem to suggest "that the job of comparing libraries cannot be done, so I am at fault for having tried. Somehow, unique among American public or private institutions, libraries are just too varied and too local to be compared. Yet despite these assertions, the authors urge individuals to use the NCES Public Library Peer Comparison tool to do this impossible task." A 2006 Library School Student Writing Award article questioned HAPLR's weighting of factors, and its failure to account for local factors in measuring a library's success, the index's failure to measure computer and Internet usage, and its lack of focus of on newer methods of evaluation, such as customer satisfaction or return on investment. Ray Lyons and Neal Kaske later argued for greater recognition of the strengths and limitations of ratings. They point out that, among other factors, imprecision in library statistics make ratings scores quite approximate, a fact rarely acknowledged by libraries receiving high ratings. The authors also note that HAPLR calculations perform invalid mathematical operations using ordinal rankings, making comparisons of scores between libraries and between years meaningless.
Star Libraries system
America's Star Libraries and Index of Public Library Service, an alternative system developed by Keith Curry Lance and Ray Lyons, was first introduced in the June 2008 issue of Library Journal. This method rates on four equally weighted per-capita statistics with comparison groups based on total operating expenditures: library visits, circulation, program attendance, and public internet computer use. The system awards 5-star, 4-star, and 3-star designations rather than numerical rankings. Creators of the LJ Index stress that it does not measure service quality, operational excellence, library effectiveness, nor the degree to which a library meets existing community information needs.
Great Britain adopted national standards, and in 2000 the Audit Commission began publishing both a summary annual reports of library conditions and individualized ratings of libraries. Audit Commission personnel base the reports on statistical data, long-range plans, local government commitment to the library, and a site visit. The Audit Commission is an independent body. Every library is assigned a score.
Germany
Bertelsmann Publishing partners with the German library association to produce BIX, a library index quite similar to HAPLR. The main difference between BIX and HAPLR, is that BIX was designed to provide comparisons of one library to another in a given year as well as over time. HAPLR compares all libraries to one another only during a given year.
