Fourth european conference on research and advanced technology for digital libraries ecdl2000. The proposed model is based on usercentered techniques, and it focuses on defining the structure of the analysis, the establishment of standards, and the evaluation criteria. We also provide maintenance releases for its forerunner, greenstone 2. Most team members will allocate an estimated 58 hours per week to the project for a period of up to 6 months. Also the results can be helpful for the software providers to resolve the weaknesses and reinforce the strengths of the software. The evaluation of digital libraries is yet in the primitive stage and the evaluation of open source digital library software is a very new concept. An evaluation model dissertation, rutgers university the main research goal of this disserta tion is to develop a model and a suite of instruments to evaluate the usability of academic digital libraries. A different sort of library has opened in texas, one that turns a new page on an old idea.
The staff of the national digital library program at the library of congress have identified ten challenges that must be met if large and effective digital libraries are to be created during the 21st century. The evaluation activity of the delos network of excellence has performed a largescale survey of current dl. Evaluation of digital repository software at the national library of. A few other scholars have presented library evaluation frameworks that focus on multiple perspectives. Evaluation of safetycritical software acm digital library. Eprints digital library software evaluation org introduction gnu eprints is a generic archive software developed by the university of southampton. Empirical research in usability of digital libraries is lean. Research and cultural heritage institutions are, as a matter. Chapter 7 eprints digital library software evaluation. To take part, join the digital library assessment interest group dlf aig discussion forum, which is open to anyone interested in learning about or collaborating on the improvement of this work. This selection of 10 solutions is fairly representative of what can be used to develop a digital library. The dpsp is a collection of software applications which support the goal of digital preservation.
Digital library evaluation slide 1 of 30 unt digital. Digital repository evaluation and selection working group charter last updated. Chapter 3 evaluation criteria defined for evaluating open. A digital library that provides diverse content will be characterized by heterogeneity in original format, in digital format and resolution, and in the level of detail and format of descriptive information that is available to support access. The evaluation included those systems and software already identified by the digital repository working group, as well as any new or previously overlooked software. Evaluation of digital library impact and user communities by. Some pertain to performance of technology others to performance of given processes or algorithms using technology.
To build a digital library under economical conditions open source software is. Evaluation of digital libraries summarizes research and practice on both sides of the atlantic and aims to answer the potential questions that both the theoretical and practical areas of digital library evaluation have posed during recent years. The digital tools we create for teaching and learning allow us to push beyond our museum walls and. Challenges to building an effective digital library. Evaluation of dl software evaluationin the context of digital library software means finding out software system performance software. The exponential growth of dls has created a need for the evaluation of these emergent information systems. The approach was first to analyze and then isolate or even deconstruct some 80. A theoretical framework for the holistic evaluation of. Image the device target and run dice evaluation software or similar product. The corpus in this analysis represents the majority of efforts in digital library evaluation that contain data. Methods and approaches for testing the reliability and trustworthiness of software remain among the most controversial issues facing this age of high technology. The digital tools we create for teaching and learning allow us to push beyond our museum walls and connect with learners and educators everywhere. Digital librariesevaluation and user studies wikiversity.
A study on the open source digital library softwares arxiv. To build a digital library under economical conditions open source software is preferable. While a number of kinds of evaluationresearch studies may be conducted during the design and development of a digital library e. A checklist was prepared for evaluation of digital library software in expert systems context. The purpose of this report is to provide an overview of works on digital library evaluation that included data. Planning and implementing a digital library project, indiana lsta digital project planning workshop, december 15, 2006, peabody public library, columbia city, in and december 16, 2006, porter county public library, valpairaiso, in. This module covers commonly used application software, which are specifically designed for the creation and development of digital library dl systems and similar types of collections and services, for example, digital repositories or open access archives. Open source digital library packages are gaining popularity nowadays. This report presents technical and organizational foundations for performing architectural analysis, and presents the seis atam, a technique for analyzing software architectures. Checklist for evaluating tech tools, apps, software, and.
Evaluation of using expert system features in information. To ease assessmentselection process, this paper attempts to evaluate four most popular open source digital library software. Evaluation of digital libraries rutgers university. Dpsp digital preservation software platform description.
Also provides links and guidelines for website accessibility. Based on a detailed evaluation of the relevant document types, customers will have a basis for the decision whether sap digital access is the suitable license model for the future. Toward an evolution of concepts tefkosaracevic abstract while there were many efforts in the research and practices of digi tal libraries, evaluation was not a conspicuous activity. It is a suite of software for building and distributing digital library collections that provides a way of organizing information and publishing it on the internet and or on.
Evaluation of digital libraries is not widely practiced. Conclusions, among others, speculate as to the reasons for a relatively low presence of evaluation in digital libray research and. Saracevic 2000 discussed the evaluation of digital libraries and presented a set of elements for evaluation. It is well recognized that digital library evaluation is a complex and difficult undertaking. Iranian research institute for science and technology issn 22518223. Dspace provides tools for management of digital assets, and is. Checklist for evaluating tech tools, apps, software, and hardware i have been searching high and low for an efficient, easytounderstand list of criteria for evaluating hardware, software, tools, and everything in between. Pdf a checklist for evaluating open source digital library software. Dspace is an open source digital library software developed jointly by mit libraries and. It has lots of things to read, but you wont find any shelves full of books.
The aim of the greenstone is to empower users, particularly universities,libraries and other public service institutions throughout the world, to build their own digital. Digital library evaluation how is digital library evaluation abbreviated. Digital library management system and then loading or. This is an important point to consider because it impinges on evaluation. Evaluation of digital repository software at the national. Chapter 4 cdsinvenio digital library software evaluation. This work proposes a contextual evaluation model of the functionalities for creating digital collections currently available in existing digital library creation tools. This list consisted of the different aspects of a digital library, including traditional library elements such as.
The concept of relevance is central to understanding the interactions between users, usage, information needs and informational content. A checklist for evaluating open source digital library software. With the freeofcharge digital access evaluation service, sap offers their customers support to determine the estimated initial number of digital access documents. However, a simple to use instrument to evaluate these dl software packages. From educational media to classroom activities, from a behindthescenes look at ideas were tinkering with to the vast riches of our explore section, our teaching tools support educators and. Evaluation of digital libraries article pdf available in international journal on digital libraries 8. In some cases, there may be no technology solution to the challenge, but through sharing of ideas, new thinking may emerge to help. In close collaboration with the american library association, new knowledge organization ltd. It includes xena, dpr, checksum checker, and manifest maker. What we learn from participants in the study will be a valuable contribution to the public library profession. An insight into useful applications and methods pp. Digital library evaluation slide 1 of 30 unt digital library. At the exploratorium, designing tools for teaching and learning is something we do every dayalmost all of our exhibits are created and tested here at the museum.
Greenstone 3 is under active development, and is recommended for download. Many open source software packages are available for organizations and individuals to create digital libraries dls. Quantitative methods for software selection and evaluation september 2006 technical note michael s. Marble idaho national laboratory, idaho falls, idaho 83415, usa an ongoing issue within humancomputer interaction hci is the need for simplified or discount methods. Special issue of information and software technology 39 11. Open source software invenio, greenstone, omeka, eprints, orioai, dspace and proprietary software mnesys, digitool, yoolib, contentdm, software for old documents mnesys, digitool, yoolib, contentdm, greenstone, omeka and software originally intended to open archives invenio. Dlf seeks to facilitate conversations and activities related to digital library assessment. The objectives of the present work are to develop a checklist for dl evaluation and use this checklist on four dl software packages. Newknowledge, a nonprofit research institute based in new york, n. However, a simple to use instrument to evaluate these dl software packages does not exist. There are very few studies carried out so far on evaluation of open source digital library software due to the fact that these software are very complex and their functinalities are different. This module focuses on the evaluation of digital libraries. Quantitative methods for software selection and evaluation. This 2006 report describes methods for selecting candidate commercial offtheshelf packages for further evaluation, possible methods for evaluation, and other factors besides requirements to be considered.
The national institutes of health nih national library of medicine nlm undertook an 18month project to evaluate, test and recommend digital. Digital library evaluation tech talk inatnan hall nathan. Snell library will be closed until further notice, but the northeastern university library staff are ready to help you online, and we have many digital resources for you to use. A checklist for evaluating open source digital library. A digital library is defined as the collection of digitized or digitally born items that are stored, managed, serviced, and preserved by digital library professionals. An experience with greenstone software author links open overlay paneljesustramullas. Apr 04, 2011 this refers to how the software is used, what it can produce, how much it can expand with increased use and access, and how it might expand to offer more services in the future. Method for architecture evaluation august 2000 technical report rick kazman, mark h. The digital preservation software platform dpsp is free and open source software developed by the national archives of australia.
The objective of the present work is to evaluate major open source digital library software ossdl available free and preferably under open source license. The evaluation was to include handson testing against a set of functional requirements based on the open archival information system oais model ingest, archival storage, data management, administration, preservation planning, and access as specified in the nlm digital repository policies and functional requirements. May 30, 2019 greenstone is a complete digital library creation, management and distribution package created and distributed by the new zealand digital library project. Proof of concept for a human reliability analysis method for heuristic usability evaluation of software ronald l. An adaptive systems approach to the implementation and evaluation of digital library recommendation systems. The concept of relevance is central to understanding the interactions between users, usage, information needs and informational con tent. In may 2007, the associate director for library operations approved the creation of the digital repository evaluation and selection working group wg to evaluate commercial systems and open source software and select one or a combination of systems and software for use as an nlm digital repository. Method for architecture evaluation sei digital library. This 2006 report describes methods for selecting candidate commercial offtheshelf packages for further evaluation, possible methods for evaluation, and other factors besides requirements to.
Pdf purpose many open source software packages are available for organizations and individuals to create digital libraries dls. Many open source software packages are available for organizations and individuals to. Chapter 9 greenstone digital library software evaluation. Digital repository evaluation and selection working group. The evaluation activity of the delos network of excellence has performed a largescale survey of current dl evaluation. Digital libraries dls are new and innovative information systems, under constant development and change, and therefore evaluation is of critical importance to ensure not only their correct evolution but also their acceptance by the user and application communities. An example of a digital library evaluation processing including the development and ranking of evaluation criteria and applying them to an existing collection. June 4, 2007 edward luczak, occs michael north, hmd deborah ozga, nih library john rees, hmd. Planning and implementing a digital library project. Checklist for evaluating tech tools, apps, software, and hardware. Evaluation of digital library impact and user communities. Greenstone is a complete digital library creation, management and distribution package created and distributed by the new zealand digital library project. Open source software oss have gained lot of acceptance in libraries all over the world to save exorbitant costs incurred in procuring commercial software as well as paying annual maintenance costs and upgrading costs incurred by commercial. Proceedings of the annual meetingamerican society for information science, 37, 3450.