<?xml version="1.0" encoding="UTF-8"?> <rss version="2.0" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:wfw="http://wellformedweb.org/CommentAPI/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:sy="http://purl.org/rss/1.0/modules/syndication/" xmlns:slash="http://purl.org/rss/1.0/modules/slash/" xmlns:creativeCommons="http://backend.userland.com/creativeCommonsRssModule"><channel><title>Disruptive Library Technology Jester &#187; imaging</title> <atom:link href="http://dltj.org/tag/imaging/feed/" rel="self" type="application/rss+xml" /><link>http://dltj.org</link> <description>We&#039;re Disrupted, We&#039;re Librarians, and We&#039;re Not Going to Take It Anymore</description> <lastBuildDate>Mon, 06 Feb 2012 20:04:22 +0000</lastBuildDate> <language>en</language> <sy:updatePeriod>hourly</sy:updatePeriod> <sy:updateFrequency>1</sy:updateFrequency> <cloud domain='dltj.org' port='80' path='/?rsscloud=notify' registerProcedure='' protocol='http-post' /> <creativeCommons:license>http://creativecommons.org/licenses/by-nc-sa/3.0/us/</creativeCommons:license> <item><title>Latest Views on JPEG2000 for Presentation and Archiving</title><link>http://dltj.org/article/jpeg2000-uk-report/</link> <comments>http://dltj.org/article/jpeg2000-uk-report/#comments</comments> <pubDate>Mon, 29 Nov 2010 20:22:17 +0000</pubDate> <dc:creator>Peter Murray</dc:creator> <category><![CDATA[JPEG2000]]></category> <category><![CDATA[imaging]]></category> <category><![CDATA[jpeg2000]]></category> <category><![CDATA[presentation]]></category> <category><![CDATA[preservation]]></category><guid isPermaLink="false">http://dltj.org/?p=1874</guid> <description><![CDATA[Earlier this month, the JPEG 2000 Implementation Working Group, the Wellcome Trust Library, and the U.K. Digital Preservation Coalition hosted a free one-day seminar called JPEG2000 for the Practitioner. The presentation slides are now linked to the seminar program and &#8230; <a href="http://dltj.org/article/jpeg2000-uk-report/">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description> <content:encoded><![CDATA[<abbr class="unapi-id ignore noPrint" title="http://dltj.org/?p=1874"></abbr><p>Earlier this month, the <a href="http://jp2k-uk.wikidot.com/" title="JP2K-UK Working Group wiki">JPEG 2000 Implementation Working Group</a>, the <a href="http://library.wellcome.ac.uk/" title="The Wellcome Library">Wellcome Trust Library</a>, and the <a href="http://www.dpconline.org/" title="Digital Preservation Coalition homepage">U.K. Digital Preservation Coalition</a> hosted a free one-day seminar called <a href="http://www.dpconline.org/events/details/19-jpeg-2000-for-the-practioner" title="Events - JPEG 2000 for the Practioner | Digital Preservation Coalition">JPEG2000 for the Practitioner</a>.  The presentation slides are now linked to the <a href="http://www.dpconline.org/events/details/19-jpeg-2000-for-the-practioner" title="Events - JPEG 2000 for the Practioner | Digital Preservation Coalition">seminar program</a> and is a <a href="http://jpeg2000wellcomelibrary.blogspot.com/2010/11/jpeg-2000-seminar-edited-highlights-1.html" title="JPEG 2000 at the Wellcome Library: JPEG 2000 seminar - edited highlights #1">short</a> <a href="http://jpeg2000wellcomelibrary.blogspot.com/2010/11/jpeg-2000-seminar-edited-highlights-2.html" title="JPEG 2000 at the Wellcome Library: JPEG 2000 seminar - edited highlights #2">report</a> of the event by Christy Henshaw of Wellcome Library.  The presentation slides by themselves carry a great deal of depth even without a recording of the audio.  In particular I can recommend &#8220;<a href="http://www.dpconline.org/component/docman/doc_download/525-jp2knov2010tanner" title="Presentation slides from &#038;039;What did JPEG 2000 ever do for us?&#038;039; by Simon Tanner">What did JPEG 2000 ever do for us?</a>&#8221; by Simon Tanner and &#8220;<a href="http://www.dpconline.org/component/docman/doc_download/522-jp2knov2010clark" title="Presentation slides from &#038;039;JPEG 2000 standardization - a pragmatic viewpoint&#038;039; by Richard Clark">JPEG 2000 standardization &#8211; a pragmatic viewpoint</a>&#8221; by Richard Clark.  As brief introductions to where we&#8217;ve been with JPEG 2000 and where we could go.</p><p>Hat tip to Ron Murray for pointing this out to me.</p>]]></content:encoded> <wfw:commentRss>http://dltj.org/article/jpeg2000-uk-report/feed/</wfw:commentRss> <slash:comments>4</slash:comments> </item> <item><title>LANL Releases Open Source JPEG2000 Image Server</title><link>http://dltj.org/article/lanl-jpeg2000-image-server/</link> <comments>http://dltj.org/article/lanl-jpeg2000-image-server/#comments</comments> <pubDate>Tue, 16 Sep 2008 15:38:48 +0000</pubDate> <dc:creator>Peter Murray</dc:creator> <category><![CDATA[JPEG2000]]></category> <category><![CDATA[imaging]]></category> <category><![CDATA[java]]></category> <category><![CDATA[jpeg2000]]></category> <category><![CDATA[Kakadu Software]]></category> <category><![CDATA[Los Alamos National Laboratory]]></category> <category><![CDATA[openurl]]></category><guid isPermaLink="false">http://dltj.org/?p=490</guid> <description><![CDATA[The lead article in the September/October issue of D-Lib Magazine release yesterday is on djatoka, the open source JPEG2000 Image Server from Los Alamos National Laboratory. The authors, Ryan Chute and Herbert Van de Sompel describe their effort in the &#8230; <a href="http://dltj.org/article/lanl-jpeg2000-image-server/">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description> <content:encoded><![CDATA[<abbr class="unapi-id ignore noPrint" title="http://dltj.org/?p=490"></abbr><p>The <a href="http://www.dlib.org/dlib/september08/chute/09chute.html" title="Introducing djatoka: A Reuse Friendly, Open Source JPEG 2000 Image Server">lead article</a> in the <a href="http://www.dlib.org/dlib/september08/09contents.html" title="D-Lib Magazine (September/October 2008)">September/October issue of D-Lib Magazine</a> release yesterday is on <a href="http://african.lanl.gov/aDORe/projects/djatoka/" title="aDORe djatoka Overview">djatoka</a>, the open source JPEG2000 Image Server from Los Alamos National Laboratory.  The authors, <a href="http://www.dlib.org/dlib/september08/authors/09authors.html#CHUTE" title="Ryan Chute&#039;s bio a D-Lib Magazine">Ryan Chute</a> and <a href="http://www.dlib.org/dlib/september08/authors/09authors.html#VANDESOMPEL" title="Herbert Van de Sompel&#039;s bio at D-Lib Magazine">Herbert Van de Sompel</a> describe their effort in the article abstract:<br /><blockquote>The ISO-standardized JPEG 2000 image format has started to attract significant attention. Support for the format is emerging in major consumer applications, and the cultural heritage community seriously considers it a viable format for digital preservation. So far, only commercial image servers with JPEG 2000 support have been available. They come with significant license fees and typically provide the customers with limited extensibility capabilities. Here, we introduce djatoka, an open source JPEG 2000 image server with an attractive basic feature set, and extensibility under control of the community of implementers. We describe djatoka, and point at demonstrations that feature digitized images of marvelous historical manuscripts from the collections of the British Library and the University of Ghent. We also call upon the community to engage in further development of djatoka.</p></blockquote><p><br />The article is very easy to read and is a great overview of how they built the djatoka image server.  LANL has a <a href="http://african.lanl.gov/adore-djatoka/" title="djatoja demonstration site">demonstration site</a> with images of the Magna Carta from the British Library.  The <a href="http://www.antifonarium-tsgrooten.be/highlights.htm" title="Universiteitsbibliotheek Gent | Antifonarium Tsgrooten">University of Ghent has also deployed a djatoka installation</a> with some digitized pages of a Gregorian choir book.  (The text of the site is in Dutch, I think, but you can click on the square boxes to the right of &#8220;Fol.&#8221; to bring up the images.)  LANL has also put together a screencast demonstration of djatoka, included below.</p><p>djatoka is available under the <a href="http://www.gnu.org/copyleft/lesser.html" title="About the GNU Lesser General Public License">GNU Lesser General Public License</a>.  The software has <a href="http://sourceforge.net/projects/djatoka" title="SourceForge.net: djatoka">a site on SourceForge</a> with forums for discussion.  It runs as a Java servlet, so it is pretty much cross-platform.  In the image server is the Kakadu JPEG2000 toolkit and the <a href="http://iipimage.sourceforge.net/" title="SourceForge.net: IIPImage">IIPImage JavaScript Viewer</a> toolkit.  One other key piece is a fascinating use of an <a href="http://en.wikipedia.org/wiki/OpenURL" title="OpenURL - Wikipedia">OpenURL</a> ContextObject to carry the service request information from the browser through the image server to the caching and rendering pieces.</p><p>Congratulations and kudos to Ryan, Herbert, and the team at LANL for putting together this great piece of software and releasing it as open source.<span class="Z3988" title="ctx_ver=Z39.88-2004&#038;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&#038;rft.jtitle=D-Lib+Magazine&#038;rft.id=info:DOI/10.1045%2Fseptember2008-chute&#038;rft.atitle=Introducing+djatoka%3A+A+Reuse+Friendly%2C+Open+Source+JPEG+2000+Image+Server&#038;rft.date=2008&#038;rft.volume=14&#038;rft.issue=9%2F10&#038;rft.spage=&#038;rft.epage=&#038;rft.artnum=http%3A%2F%2Fwww.dlib.org%2Fdlib%2Fseptember08%2Fchute%2F09chute.html&#038;rft.au=Ryan+Chute&#038;rft.au=Herbert+Van+de+Sompel&#038;bpr3.included=1&#038;bpr3.tags=Computer+Science%2CHuman-Computer+Interaction">Ryan Chute, Herbert Van de Sompel (2008). Introducing djatoka: A Reuse Friendly, Open Source JPEG 2000 Image Server <span style="font-style: italic;">D-Lib Magazine, 14</span> (9/10) DOI: <a rev="review" href="http://dx.doi.org/10.1045/september2008-chute" title="Handle Redirect">10.1045/september2008-chute</a></span></p>]]></content:encoded> <wfw:commentRss>http://dltj.org/article/lanl-jpeg2000-image-server/feed/</wfw:commentRss> <slash:comments>7</slash:comments> </item> <item><title>Thumbgrabber: a metadata augmentation tool</title><link>http://dltj.org/article/thumbgrabber-from-uiuc/</link> <comments>http://dltj.org/article/thumbgrabber-from-uiuc/#comments</comments> <pubDate>Tue, 29 Apr 2008 20:21:00 +0000</pubDate> <dc:creator>Peter Murray</dc:creator> <category><![CDATA[Raw Technology]]></category> <category><![CDATA[description]]></category> <category><![CDATA[imaging]]></category> <category><![CDATA[metadata]]></category> <category><![CDATA[oai-pmh]]></category> <category><![CDATA[paper]]></category> <category><![CDATA[UIUC]]></category><guid isPermaLink="false">https://dltj.org/?p=353</guid> <description><![CDATA[In reading a background paper for the American Social History Online portal, I was reacquainted with a paper by Muriel Foulonneau, Thomas Habing and Tim Cole from UIUC called &#8220;Automated Capture of Thumbnails and Thumbshots for Use by Metadata Aggregation &#8230; <a href="http://dltj.org/article/thumbgrabber-from-uiuc/">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description> <content:encoded><![CDATA[<abbr class="unapi-id ignore noPrint" title="https://dltj.org/?p=353"></abbr><p><span style="float: right; padding: 5px;"><a href="http://www.researchblogging.org" title="Research Blogging"><img alt="Blogging on Peer Review Research" src="http://cdn.dltj.org/wp-content/uploads/2008/04/ResearchBlogging-Medium-Trans.png" width="80" height="50" /></a></span>In reading a background paper for the American Social History Online portal, I was reacquainted with a paper by Muriel Foulonneau, Thomas Habing and Tim Cole from UIUC called &#8220;Automated Capture of Thumbnails and Thumbshots for Use by Metadata Aggregation Services.&#8221;<sup><a href="http://dltj.org/article/thumbgrabber-from-uiuc/#footnote_0_353" id="identifier_0_353" class="footnote-link footnote-identifier-link" title="Foulonneau, M., Habing, T.G., Cole, T.W. (2006). Automated Capture of Thumbnails and Thumbshots for Use by Metadata Aggregation Services. D-Lib Magazine, 12(1) DOI: 10.1045/january2006-foulonneau">1</a></sup> This is the abstract:<br /><blockquote>The practice of including thumbnails in short record displays, increasingly common in local implementations, is being adopted by metadata aggregation service providers as well. In addition, thumbnails and Web thumbshots have begun appearing as part of Web search results. This article reports on a project at the University of Illinois at Urbana-Champaign (UIUC) to make more comprehensible heterogeneous resources available on the UIUC CIC metadata portal by incorporating thumbnails and thumbshots of image and Webpage resources in the context of the OAI Protocol for Metadata Harvesting. In addition to thumbnails provided by partner data providers, UIUC has developed an automated process to generate thumbnails and thumbshots from the Webpages resources pointed to by the metadata records.</p></blockquote><p>The paper cites dissatisfaction with results from metadata portals that consist exclusively of textual descriptions of the objects.  It also cites studies that show the addition of thumbnail images to the results display improves user satisfaction.  With that in mind, UIUC wrote <span class="removed_link" title="http://cicharvest.grainger.uiuc.edu/thumb.asp">Thumbgrabber</span> &#8212; a Windows application written in Visual Basic that uses Internet Explorer to find images in websites and/or take image snapshots of web pages as they have been rendered.  In the UIUC context, the application is fed URLs from records harvested via OAI-PMH, although it would seem like it would be able to process any arbitrary list of URLs.</p><p>This is a useful tool to keep in mind as we think more about aggregating the metadata records into vertical (subject-specific) portals and repurpose metadata records in other ways.<p style="padding:0;margin:0;font-style:italic;" class="removed_link">The text was modified to remove a link to http://cicharvest.grainger.uiuc.edu/thumb.asp on January 28th, 2011.</p><h2>Footnotes</h2><ol class="footnotes"><li id="footnote_0_353" class="footnote"><span class="Z3988" title="ctx_ver=Z39.88-2004&#038;rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&#038;rft.aulast=Foulonneau&#038;rft.aufirst=Muriel&#038;rft.au=Muriel+ Foulonneau&#038;rft.au=Thomas+Habing&#038;rft.au=Timothy+Cole&#038;rft.title=D-Lib+Magazine&#038;rft.atitle=Automated+Capture+of+Thumbnails+and+Thumbshots+for+Use+by+Metadata+Aggregation+Services&#038;rft.date=2006&#038;rft.volume=12&#038;rft.issue=1&#038;rft.spage=&#038;rft.genre=article&#038;rft.id=info:DOI/10.1045%2Fjanuary2006-foulonneau"></span>Foulonneau, M., Habing, T.G., Cole, T.W. (2006). Automated Capture of Thumbnails and Thumbshots for Use by Metadata Aggregation Services. <span style="font-style: italic;">D-Lib Magazine, 12</span>(1) DOI: <a rev="review" href="http://dx.doi.org/10.1045/january2006-foulonneau" title="Handle Redirect">10.1045/january2006-foulonneau</a></li></ol>]]></content:encoded> <wfw:commentRss>http://dltj.org/article/thumbgrabber-from-uiuc/feed/</wfw:commentRss> <slash:comments>0</slash:comments> </item> <item><title>Is JPEG Good Enough for Archival Masters?</title><link>http://dltj.org/article/jpeg-as-master/</link> <comments>http://dltj.org/article/jpeg-as-master/#comments</comments> <pubDate>Wed, 06 Feb 2008 03:51:24 +0000</pubDate> <dc:creator>Peter Murray</dc:creator> <category><![CDATA[Raw Technology]]></category> <category><![CDATA[imaging]]></category> <category><![CDATA[j2karclib]]></category> <category><![CDATA[jpeg2000]]></category> <category><![CDATA[photography]]></category> <category><![CDATA[preservation]]></category><guid isPermaLink="false">http://dltj.org/article/jpeg-as-master/</guid> <description><![CDATA[On the ImageLib mailing list, Rob Lancefield (Manager of Museum Information Services for Wesleyan University) posted a link to the Universal Photographic Digital Imaging Guidelines (UPDIG) for image creators. The introduction says: &#8220;These 12 guidelines — provided as a Quick &#8230; <a href="http://dltj.org/article/jpeg-as-master/">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description> <content:encoded><![CDATA[<abbr class="unapi-id ignore noPrint" title="http://dltj.org/article/jpeg-as-master/"></abbr><p>On the <a href="http://listserv.arizona.edu/archives/imagelib.html" title="Archives of IMAGELIB@LISTSERV.ARIZONA.EDU">ImageLib mailing list</a>, Rob Lancefield (Manager of Museum Information Services for Wesleyan University) posted a link to the <a href="http://www.updig.org/guidelines/" title="Universal Photographic Digital Imaging Guidelines  homepage">Universal Photographic Digital Imaging Guidelines</a> (UPDIG) for image creators.  The introduction says: &#8220;These 12 guidelines — provided as a Quick Guide plus an in-depth Complete Guide — aim to clarify the issues affecting accurate reproduction and management of digital image files. Although they largely reflect a photographer&#8217;s perspective, anyone working with digital images should find them useful&#8230;.    This document, prepared by the UPDIG working group, represents the industry consensus as of September 2007.&#8221;  The <a href="http://www.updig.org/published/Updig.AboutUPDIG.html" title="About UPDIG">listed members of UPDIG</a> leads one to believe that this is a professional photography group.  One thing in the introduction to the guidelines caught my eye, though:<br /><blockquote>The chapter on archiving now has a discussion of JPEG as an archival format.</p></blockquote><p>Note that the authors do indeed mean JPEG (circa 1994), not JPEG2000.  The <a href="http://www.updig.org/guidelines/archiving.php" title="UPDIG: Archiving">chapter on archiving</a> lists the pros and cons of a number of formats, to include JPEG.  The following bullet points are excerpted from the text.</p><ul type="square"><li><b>Conversion to TIFF files</b>: By converting images to TIFF format [from camera RAW], the photographer is storing the images in the most accessible file format&#8230;  There is a downside, however. TIFF files are much larger than RAW files&#8230;  Another downside to conversion to TIFF is that it precludes the use of better RAW converters that are surely coming in the future.</li><li><b>Archiving JPEG files</b>: Conventional wisdom holds that the TIFF format holds a quality advantage over the JPEG format. This holds true only if the JPEG file is saved at less than 10 quality using the Photoshop standard. When using JPEG quality 10 or 12, the artifacts are either non-existent or insignificant. Higher bit-depth is really the only advantage of using TIFF over JPEG 10 or 12 (in terms of image quality)&#8230; <i>Update 2008-02-11:  Please see below.</i></li><li><b>Archiving RAW files</b>: If a photographer chooses to archive the RAW file, then he will be preserving the largest number of options for future conversion of the files&#8230; This, too, has its downside. RAW files will likely have to be converted to a more universal file format at some time in the future.</li><li><b>Archiving DNG files:</b> RAW files can be converted to DNG, a documented TIFF-based format created by Adobe that can store the RAW image data, metadata, and a color-corrected JPEG preview of the image. The DNG file format provides a common platform for information about the file and adjustments to the image&#8230;  DNG is likely to be readable long after the original RAW format becomes obsolete, simply because there will be so many more of them than any particular RAW file format&#8230;  There’s a downside to DNG, of course. Conversion to DNG requires an extra step at the time of RAW file processing; it does not take terribly long, but it is an extra process.</li></ul><p>Update 2008-02-11:  Ken Fleisher noted in the comments that the excerpt above was truncated before his reasoning was described.  In the interest of clarity, the full text of this bullet point on the UPDIG site is:<br /><blockquote>Archiving JPEG files: Conventional wisdom holds that the TIFF format holds a quality advantage over the JPEG format. This holds true only if the JPEG file is saved at less than 10 quality using the Photoshop standard. When using JPEG quality 10 or 12, the artifacts are either non-existent or insignificant. Higher bit-depth is really the only advantage of using TIFF over JPEG 10 or 12 (in terms of image quality). Some have argued that that JPEG, because of the way it encodes data, compromises color. This is a misconception. When using the highest quality settings, there is no loss of color fidelity. Therefore, if JPEG files are saved at 10-12 quality, and if they do not require much pixel editing before use, archiving JPEG files is not a bad concept, and it can save a lot of space. For many picture archives, the economics of storing large numbers of files dominates all other considerations, and JPEG offers a feasible solution to the problem.</p></blockquote><p>The notes at the end of the chapter say:  &#8220;The archiving JPEG section is based on research and analysis by Ken Fleisher.&#8221;</p><p>So I wonder what is going on here.  Does the cultural heritage community have a different definition of the word <em>archive</em> from the professional photography community?  Are there sufficient differences in our goals that warrant the differences in practices?</p><p>This topic is of interest because the program of the <span class="removed_link" title="http://www.ala.org/ala/lita/litamembership/litaigs/jpeg2000/jk2kig.cfm">JPEG2000 in Archives and Libraries Interest Group</span> of the <a href="http://www.lita.org/" title="LITA homepage">Library and Information Technology Association</a> (LITA) will be <a href="http://litablog.org/2008/01/16/2008mw-j2kig/" title="Minutes of the meeting of the JPEG 2000 Interest Group on Jan 14th in Philadelphia">holding a panel</a> at the <a href="http://www.ala.org/ala/eventsandconferencesb/annual/2008a/home.htm" title="ALA Annual Conference 2008 homepage">ALA Annual Conference in Anaheim this summer</a> on using the JPEG2000 file format for archival purposes.  Part of the discussion will center around the notion of visually lossless versus data lossless compression.  This mention of lossy-yet-high-quality JPEG compression seems to fit into the same topic.<p style="padding:0;margin:0;font-style:italic;" class="removed_link">The text was modified to remove a link to http://www.ala.org/ala/lita/litamembership/litaigs/jpeg2000/jk2kig.cfm on June 9th, 2011.</p>]]></content:encoded> <wfw:commentRss>http://dltj.org/article/jpeg-as-master/feed/</wfw:commentRss> <slash:comments>11</slash:comments> </item> <item><title>Xerox and Library of Congress Collaborate on JPEG2000 for Image Preservation</title><link>http://dltj.org/article/j2k-xerox-lc/</link> <comments>http://dltj.org/article/j2k-xerox-lc/#comments</comments> <pubDate>Wed, 31 Oct 2007 16:01:36 +0000</pubDate> <dc:creator>Peter Murray</dc:creator> <category><![CDATA[JPEG2000]]></category> <category><![CDATA[imaging]]></category> <category><![CDATA[jpeg2000]]></category> <category><![CDATA[Library of Congress]]></category> <category><![CDATA[preservation]]></category> <category><![CDATA[Xerox]]></category><guid isPermaLink="false">http://dltj.org/2007/10/j2k-xerox-lc/</guid> <description><![CDATA[Xerox and the Library of Congress announced a joint effort last week to study the use of JPEG 2000. This is welcome news! The project is &#8220;designed to help develop guidelines and best practices for digital content,&#8221; a result that &#8230; <a href="http://dltj.org/article/j2k-xerox-lc/">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description> <content:encoded><![CDATA[<abbr class="unapi-id ignore noPrint" title="http://dltj.org/2007/10/j2k-xerox-lc/"></abbr><p><a href="http://www.xerox.com/go/xrx/template/inv_rel_newsroom.jsp?app=Newsroom&#038;ed_name=NR_2007Oct25_LibraryofCongress_Xerox_Innovation_Research&#038;format=article&#038;view=newsrelease&#038;Xcntry=USA&#038;Xlang=en_US" title="Xerox press release">Xerox</a> and the <a href="http://www.loc.gov/today/pr/2007/07-213.html" title="Library of Congress press release">Library of Congress</a> announced a joint effort last week to study the use of JPEG 2000.  This is welcome news!  The project is &#8220;designed to help develop guidelines and best practices for digital content,&#8221; a result that will be most welcome for those of us that want to do the right thing but lack the time and/or technical expertise to pin down exactly what the right thing is.  I think it is safe to say that inertia has taken us this far with our collective TIFF-based practice, and even the most conservative preservationist would probably acknowledge that the state of the art has moved in the past quarter century to a point where there might be a better way.</p><p>I&#8217;m familiar with Rob Buckley&#8217;s work at Xerox, and that he is overseeing Xerox&#8217;s efforts in this collaboration means we can anticipate a great outcome.  As <a href="http://blog.historians.org/news/362/library-of-congress-and-xerox-to-team-up-on-digital-formats" title="American Historical Association Blog: Library of Congress and Xerox to Team Up on Digital Formats">others</a> have <a href="http://philobiblos.blogspot.com/2007/10/lc-and-xerox-to-tackle-digital-image.html" title="PhiloBiblos: LC and Xerox to Tackle Digital Image Format">noted</a>, the time is ripe for work in this area.</p>]]></content:encoded> <wfw:commentRss>http://dltj.org/article/j2k-xerox-lc/feed/</wfw:commentRss> <slash:comments>1</slash:comments> </item> <item><title>JPEG XR Could Be Neat, but JPEG2000 is Still Neater</title><link>http://dltj.org/article/hd-photo-versus-jpeg2000/</link> <comments>http://dltj.org/article/hd-photo-versus-jpeg2000/#comments</comments> <pubDate>Sat, 04 Aug 2007 22:23:37 +0000</pubDate> <dc:creator>Peter Murray</dc:creator> <category><![CDATA[JPEG2000]]></category> <category><![CDATA[hdphoto]]></category> <category><![CDATA[imaging]]></category> <category><![CDATA[jpeg2000]]></category> <category><![CDATA[preservation]]></category> <category><![CDATA[standards]]></category><guid isPermaLink="false">http://dltj.org/2007/08/hd-photo-versus-jpeg2000/</guid> <description><![CDATA[On Tuesday, the Joint Photographic Expert&#8217;s Group (a.k.a. &#8220;JPEG&#8221;) announced a new work item for the standardization of Microsoft&#8217;s HD Photo as JPEG XR (XR is short for &#8220;extended range&#8221; &#8212; a reference to its improvement over the original JPEG &#8230; <a href="http://dltj.org/article/hd-photo-versus-jpeg2000/">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description> <content:encoded><![CDATA[<abbr class="unapi-id ignore noPrint" title="http://dltj.org/2007/08/hd-photo-versus-jpeg2000/"></abbr><p>On Tuesday, the <a href="http://www.jpeg.org/" title="JPEG homepage">Joint Photographic Expert&#8217;s Group</a> (<abbr title="also known as">a.k.a.</abbr> &#8220;JPEG&#8221;) announced a new work item for the standardization of Microsoft&#8217;s HD Photo as JPEG XR (XR is short for &#8220;extended range&#8221; &#8212; a reference to its improvement over the original JPEG standard). You can read the publicity details in the <a href="http://www.microsoft.com/presspass/press/2007/jul07/07-31JPEGXRPR.mspx" title="Microsoft’s HD Photo Technology Is Considered for Standardization by JPEG press release">Microsoft press release</a> and the <a href="http://jpeg.org/newsrel19.html" title="JPEG 2000 Digital Cinema Successes and Proposed Standardization of JPEG XR press release">JPEG press release</a>, but beyond the public relations pieces I wonder if you are thinking about HD-Photo/JPEG-XR for digital archiving.  And if you&#8217;re thinking that I&#8217;ll bet your wondering about how HD Photo compares with JPEG 2000.  As with many things, the devil is in the details, so here is a first, gut-reaction pass at the details.</p><p><h2>Standards Free of Intellectual Property Concerns</h2><br />In terms of IP concerns, both formats seem to be on par.  Microsoft&#8217;s press release promises &#8220;if approved, Microsoft will offer a royalty-free grant for its patents that are required to implement the standard.&#8221;  JPEG 2000 Part 1, developed as a committee work item, is believed to be free of IP restrictions.  (More specifically, the <a href="http://www.jpeg.org/jpeg2000/CDs15444.html" title="JPEG2000 committee homepage">official JPEG2000 website</a> says, &#8220;In the case of technology submitted for consideration by JPEG for incorporation in Part 1 of the standard, the JPEG committee believes that the individual organisations concerned will make available licences to use this intellectual property, on a royalty- and fee-free basis, under specified conditions which may apply only to conforming implementations of the standard.&#8221;)</p><p><h2>HD Photo&#8217;s Technical Advantage?</h2><br />There are claims that HD Photo&#8217;s compression algorithm is faster and has a smaller memory footprint, yet yields compression results on par with JPEG 2000.  The most official statement from Microsoft that I could find was this:  &#8220;HD Photo delivers a lightweight, high performance algorithm with a small memory footprint that enables practical, in-device encoding and decoding. HD Photo delivers image quality that is comparable to JPEG-2000 and more than twice the quality of JPEG.&#8221;<sup><a href="http://dltj.org/article/hd-photo-versus-jpeg2000/#footnote_0_267" id="identifier_0_267" class="footnote-link footnote-identifier-link" title="HD Photo Specification Download. Version 1.0 dated November 16, 2006.  Date Visited: Fri Aug 03 2007 16:45:27 GMT-0400 (EDT) ">1</a></sup> The first statement is about performance that doesn&#8217;t directly compare HD Photo to other standards; the second statement is a one of quality equivalence with JPEG2000.  Taken together, that is not exactly a clear-cut endorsement of the more-efficient-than-while-having-the-same-quality-as-JPEG2000 claim, and clearly we need to see some published metrics support or refute this.  (Know of any published studies or statements that address this directly?  Tell me about them in the comments.)</p><p>This seems to be the only claim of superiority to the JPEG2000 standard.  Perhaps it is telling that HD Photo lives in the <a href="http://www.microsoft.com/whdc/" title="Windows Hardware Developers Central homepage">Windows Hardware Developers Central</a> area of the Microsoft website &#8212; it is a standard intended for embedded devices (cameras, etc.).  Even if it were true that JPEG2000 is more computationally intensive for compression and decompression, at the rate of general processor speed improvements is this enough to justify a new standard?  Perhaps it makes sense for today&#8217;s marketplace of digital cameras; I don&#8217;t think this justification holds much weight in our community.</p><p><h2>But What About the Metadata?</h2><br />Those of us in the cultural heritage community harp on this point:  it is not all about the image itself; its context is just as important, if not more so.  That context is provided by rich metadata support.  The big advantage to the JPEG2000 file format is the ability to include arbitrary things in &#8220;boxes&#8221; within the JPEG2000 file.  Those boxes can contain XML-based metadata of any schema, audio annotations, PDF renditions, whatever.  The <a href="http://www.microsoft.com/whdc/xps/wmphotodwn.mspx" title="HD Photo Specification">HD Photo file format specification</a> appears to only offer a dramatically reduced (albeit important subset) of metadata choices: ICC color profile, Adobe&#8217;s (proprietary) <a href="http://www.adobe.com/products/xmp/" title="Adobe XMP homepage">XMP Metadata</a>, (<i>de facto</i> standard) <a href="http://www.exif.org/" title="EXIF and related resources homepage">EXIF Metadata</a>, and TIFF-compatible Descriptive Metadata Tags.</p><p><h2>And Other JPEG2000 Advantages?</h2><br />A JPEG2000 practice means fewer derivative files:  an archival and delivery system based on JPEG2000 doesn&#8217;t need thumbnail and web presentation versions since those can be derived from the master file on-the-fly.  HD Photo offers this same sort of progressive resolution decoding that enables on-the-fly creation of derivatives to happen.  (It has not been as rigorously tested as JPEG2000 has, however; something we should expect to do before we adopt it in our own practice.)  What HD Photo doesn&#8217;t offer, though, is the use of the same image compression scheme and basic file format for both still images and moving images.</p><p>As the saying goes, &#8220;Never Put All of Your Eggs in One Basket.&#8221;  Digital archival formats is one exception to that rule:  simplicity &#8212; fewer baskets &#8212; is important.  Fewer baskets &#8212; fewer file formats &#8212; means less to keep track of over time.  Part 3 of JPEG2000 family of standards is called &#8220;Motion JPEG2000,&#8221; and as the JPEG committee press release describes, the &#8220;JPEG 2000 [Part 3] based <abbr title="Digital Cinema Initiative">DCI</abbr> specification 1.1 [will be used] for distribution of digital movies to theatres/cinemas worldwide.&#8221;  A file format used by the motion picture industry, with its deep pockets, for the production and distribution of movies is a standard that has a greater chance of standing the test of time.  So a JPEG2000 practice &#8212; our one &#8220;basket&#8221; &#8212; can preserve both our still images and our moving images file formats.  HD Photo does not have a corresponding moving image format.</p><p><h2>What is HD Photo&#8217;s Compelling Advantage?</h2><br />This is where the rubber meets the road.  Our community has used a TIFF-based practice for preserving still images for decades, and I&#8217;ve been saying that it would take compelling reasons to change our practice.  As <a href="http://dltj.org/2007/02/jpeg2000-for-digital-preservation/">posted here before</a>, I believe there are compelling advantages in JPEG2000 that are big enough to cause us to change our practices.  At this point, I don&#8217;t see those same compelling advantages in HD Photo, whether or not it earns the &#8220;JPEG XR&#8221; moniker.</p><p>Truth be told, this analysis of HD Photo versus JPEG2000 isn&#8217;t based on any empirical evidence &#8212; it is just what my gut is telling me based what I&#8217;ve read so far.  What we do for the long term preservation of cultural heritage materials shouldn&#8217;t be based on anecdotal analysis, though.  Gut reactions and/or evidence from others are welcome.</p><h2>Footnotes</h2><ol class="footnotes"><li id="footnote_0_267" class="footnote"><a href="http://www.microsoft.com/whdc/xps/wmphoto.mspx" title="HD Photo Specification Download: Version 1.0">HD Photo Specification Download</a>. Version 1.0 dated November 16, 2006.  Date Visited: Fri Aug 03 2007 16:45:27 GMT-0400 (EDT)</li></ol>]]></content:encoded> <wfw:commentRss>http://dltj.org/article/hd-photo-versus-jpeg2000/feed/</wfw:commentRss> <slash:comments>11</slash:comments> </item> <item><title>A View of Regional Digitization Centers</title><link>http://dltj.org/article/regional-digitization-centers/</link> <comments>http://dltj.org/article/regional-digitization-centers/#comments</comments> <pubDate>Mon, 18 Jun 2007 19:29:02 +0000</pubDate> <dc:creator>Peter Murray</dc:creator> <category><![CDATA[DRC]]></category> <category><![CDATA[digital libraries]]></category> <category><![CDATA[imaging]]></category> <category><![CDATA[libraries]]></category> <category><![CDATA[library consortia]]></category><guid isPermaLink="false">http://dltj.org/2007/06/regional-digitization-centers/</guid> <description><![CDATA[As a part of work for an OhioLINK strategic task force, I have been exploring the creation and operation of regional/collaborative/shared digitization centers. This is a report of findings to date after an open call for information. The report is &#8230; <a href="http://dltj.org/article/regional-digitization-centers/">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description> <content:encoded><![CDATA[<abbr class="unapi-id ignore noPrint" title="http://dltj.org/2007/06/regional-digitization-centers/"></abbr><p>As a part of work for an OhioLINK strategic task force, I have been exploring the creation and operation of regional/collaborative/shared digitization centers.  This is a report of findings to date after <a href="http://dltj.org/2007/05/seeking-information-about-regional-digitization-centers/">an open call for information</a>.  The report is structured with questions to be explored when considering a regional digitization center followed by narratives from conversations with the Collaborative Digitization Program (formerly the Colorado Digitization Program), the Mountain West Digital Library, and the Ohio Historical Society.  My thanks go out to Leigh Grinstead, Liz Bishoff, Karen Estlund, Angela O&#8217;Neal, and Phil Sager for their assistance.</p><p>I am still interested in talking with collaboratives about similar programs, both &#8220;on the record&#8221; and in private conversations.  Please get in touch with me if you would like to chat.<br /><br /><h2>Questions for Exploration</h2><br />Here are some items to be considered when forming a regional digitization center collaborative that came from the conversations supplemented with reading materials from various projects around the country.</p><ol><li><em>Who does the digital conversion?</em> Is it staff at the hosting institution (where the equipment is located), or does the institution contributing the materials perform the scanning operation at the host institution?</li><li><em>Where and when is the description done?</em> Description of the digitized item was universally done by the contributing institution, but the location (at the scanning center or at the contributing institution) and timing (before conversion, during conversion, or after conversion) vary.  Answers to the first question &#8212; whether contributing staff members are performing the conversion &#8212; affect this question.</li><li><em>Is contribution of materials to the Ohio Digital Resource Commons required?</em> If the regional scanning center is used to digitize materials (or in the case where the consortium is subsidizing a scanning service to perform the digital conversion), what conditions are put in place for contributing those materials to the central repository.</li><li><em>What is the cost structure for use of the regional scanning center?</em> Options range from complete subsidy by consortium (most notably when the CDP funded the equipment at their regional scanning centers) to contributing institutions being charged at cost recovery rates by hosting institutions.  There can be various cost structures applied, such as a consortial subsidy for equipment and training with labor supplied by contributing institution or contracted from hosting institution.</li><li><em>What training is offered?</em> Topics for training range from optimal use of digitization equipment to digitization project planning to metadata creation standards.  The training can be based on group instruction, one-on-one consultation with contributing institutions, or a combination of both.</li><li><em>Who will fill the role of &#8220;metadata editor&#8221;?</em> The need for a collective expert in metadata creation was found in many of the projects.  This person is typically charged with training contributing staff on the appropriate use of local metadata conventions, coaching individual staff on particular projects, and reviewing records that will become part of a consortial database.</li></ol><p><h2>Report from the CDP</h2><br />In 1998 the project began as the Colorado Digitization Project (CDP) and they started with a survey of institutional needs and institutional capacity. Within the first year found a need for scanners at many institutions public and academic libraries, as well as historical societies and, museums. Starting in 1999, the CDP established seven regional scan centers over five years, distributed throughout Colorado such that no institution was more than an hour and a half to two hours from a center. This narrative is derived from research and phone conversations with Leigh Grinstead and Liz Bishoff.</p><p>The original climate that generated the interest in scanners was one where institutions did not want to outsource digitization because they didn&#8217;t want the materials leaving their direct control. The CDP, on the other hand, did not want institutions to buy cheap scanners that would result in lower-quality scans. The CDP purchased the scanners ($2,500 each, in 1999 dollars) plus desktop workstations and created a training program for the use of the equipment.  The center provided the location for the equipment and hands-on assistance with using the equipment; it was incumbent on the staff at the institution with materials to be digitized to perform the scanning themselves.  Before using the equipment, those performing the scanning had to attend a CDP &#8220;Introduction to Digital Imaging&#8221; training session on the proper use and techniques for obtaining high-quality images. Scanning projects that received CDP funding had priority over other users of the equipment, but there was little contention for the equipment at the centers. Descriptive metadata could be keyed at the time of the scan; CDP provided a web-based template (called &#8220;DC builder&#8221;) or staff could use their own system (an ILS, ContentDM, etc.). Contribution of the associated metadata to the CDP union catalog of metadata &#8212; Heritage West &#8212; was required for CDP-funded grant projects.  Images were locally hosted.</p><p>In 2003, the CDP conducted an evaluation of the scan centers in the form of focus groups.  They found two different responses.  First, institutions on the western slopes of Colorado made much heavier use of their scan centers.  These institutions tended to be smaller and/or economically disadvantaged, and the availability of the hardware and software to conduct the scanning operations was more critical.  In front range libraries, where institutions tend to be better-funded, the centers were not as heavily used for projects and tended to be used for training and demonstration sites; these participants felt that the greatest value in the CDP came from the professional networking and training opportunities the locations, the grants that the CDP provided and the creation of the best practices and website that brought all this together.</p><p>The regional scan centers are not used today.  The primary reason is the diffusion of experience within the community that was spurred by the early success of the centers.  As funding cycles continued, institutions purchased their own equipment (generally replicating the equipment at the centers) so as avoid the need to transport materials and staff to a regional center for larger projects. The focus of grant funding within CDP also shifted from image-based collections to EAD and sound collections.  There is still an &#8220;Introduction to Digital Imaging&#8221; workshop, but the focus is now on requirements for in-house equipment and/or what to seek from a vendor in an RFP.  The imaging workshop is typically taught as part of a three-day workshop series with an &#8220;Introduction to Digital Project Management&#8221; (storage, preservation, handling socially sensitive materials, how to display them) before and &#8220;Introduction to Metadata&#8221; (focused on Dublin Core) after.  The biggest issue facing the consortium now is oversized scanning; only the very largest university library would have this kind of equipment.</p><p>The Colorado model of teaching staff at the institution on the use of the equipment along with the creation of regional scan centers was picked up by several states: North Carolina; Alabama; Kansas; Missouri; and Wyoming (except that regional centers were not practical due to the wide population dispersion).  Tennessee is working under a current IMLS grant to build three regional center plus a suite of mobile equipment.</p><p>Liz suggests that we should look for ways to support collaborative efforts within the institution with museum and archives on the campus. The Florida Center for Library Automation (FCLA) has a program in place where the local university library is the contact in partnerships with public libraries and local museums.</p><p>Leigh noted that in recent years, CDP projects include a &#8220;metadata editor&#8221; that is hired to look at record quality and work with individual institutions to improve records.  Having a metadata editor, someone familiar with the CDP guidelines and the field in general, look at four or five records at the very early stage of a project is critical to the success of the quality of the rest of the project.  In a recent project, nearly half of the partners were going to export records out of a local collection management system.  It was discovered that the records were not consistent; local implementation/practice of cataloging standards has a higher overall impact than community best practice.  Having a local cataloger participate on the team migrating the records from a local system to a central system is key to success.</p><p><h2>Mountain West Digital Library</h2><br />The Mountain West Digital Library (MWDL) was established approximately six years ago.  My contact was Karen Estlund at the University of Utah; although the University of Utah was the lead institution in the MWDL project, Karen has been with the project only since August 2006.  The MWDL is made up of a federation of ContentDM installations at seven institutions in the region (five in Utah: Univ of Utah, Brigham Young Univ, Utah State Univ, Weber State Univ and Southern Utah Univ; and two in Nevada: Univ of Nevada Reno and Univ of Nevada Las Vegas; plus the Utah State Archives).  Metadata is harvested from these ContentDM installations via OAI-PMH to a portal operating at the University of Utah.  (Up until the recent past, MWDL used the ContentDM Multi-site server; they recently switched to using OAI harvesting.)</p><p>Content is ingested into the MWDL either through digital conversion centers at the regional institutions or through the efforts of the contributing institution.  The regional institutions perform digital conversion for contributing institutions at cost-recovery rates.  These regional centers use the equipment and staff at the hosting institution, and are very busy at times resulting in difficult choices to balance needs of the host institution with that of requests from other institutions.</p><p>The regional centers also conduct on-site training and technical education at contributing institutions about best practice for digital conversion.  The on-site program includes a technical evaluation of the equipment to be used to ensure that it can produce conversions that meet the minimum requirements for the MWDL.  In the course of this evaluation, staff at contributing institutions are taught some technical aspects of scanning such as the actual DPI scanning capabilities of the hardware versus interpolated resolutions (and why this is important). Staff also receive an introduction to Photoshop for de-skewing and other standard practices.  They also are instructed in the Western Standard Metadata Best Practices. This hands-on approach &#8212; with the contributing institution&#8217;s people, equipment and materials &#8212; enables strong connections between the contributing institution and the hosting institution.  It makes the contributing institution feel like a part of the larger program.  Most contributing institutions with local digital conversion operations will FTP files to the ContentDM server at the regional institution; some institutions contribute materials through the transportation of a portable hard drive.</p><p>Each regional hosting center is responsible for the digital preservation of the material on their server.  At this point there is no common agreement across the MWDL for standards on digital preservation; this is an area of work to be addressed in the near future by the cooperative.</p><p>The cooperative is starting work in several new areas.  First is the digital conversion and posting of oral histories from contributing institutions.  While it is anticipated that such resource will be highly valued, quick progress on this project is hampered by the same permission problems that face similar projects with relatively old audio.  The cooperative also has a state LSTA grant for a Utah institutional repository with a portal connected to the MWDL.  The state archives are also beginning a program to post state government documents, including items related to the Olympic Games held in Utah. The hands-on approach to training staff at contributing institutions is very labor-intensive and uneven across the project participants.  MWDL is in the process of hiring a program director, and a component of that job description is to provide this kind of training across the project.</p><p><h2>Ohio Memory Project (Ohio Historical Society)</h2><br />The Ohio Historical Society (OHS) provided scanning support for the Ohio Memory Project (OMP).  At the beginning of the project in 2000, institutions contributing to the OMP generally wanted to send materials to OHS to be digitized.  By the end of the grant-funded phase of the project in 2003, most institutions shifted to using their own equipment. OHS will still digitized for some cultural heritage institutions on a contract basis, although the primary focus of late has been on oversized materials that must be digitized on specialized equipment.</p><p>OHS staff will work with contributing institutions on a one-on-one basis as well as conduct workshops on introduction to scanning.  Many of the participants are from contributing institutions that have had staff changes and the new staff want to know how to use the equipment purchased during the grant-funded phase of the project.  There is also a desire for more advanced training, such as Photoshop basics.</p><p>OHS staff recognize that a compromise is needed between institutional capabilities for scanning and the very best practices in the field. They have found it hard to establish and mandate an absolute standard for the parameters and quality of digital scans.  Institutions that scan their own materials are responsible for their own storage and preservation.</p>]]></content:encoded> <wfw:commentRss>http://dltj.org/article/regional-digitization-centers/feed/</wfw:commentRss> <slash:comments>1</slash:comments> </item> <item><title>Meeting of the JPEG 2000 Interest Group on Jun 23rd in Washington, DC</title><link>http://dltj.org/article/j2kig-in-dc/</link> <comments>http://dltj.org/article/j2kig-in-dc/#comments</comments> <pubDate>Wed, 13 Jun 2007 19:36:20 +0000</pubDate> <dc:creator>Peter Murray</dc:creator> <category><![CDATA[JPEG2000]]></category> <category><![CDATA[Meeting]]></category> <category><![CDATA[ALA Annual Conference 2007]]></category> <category><![CDATA[imaging]]></category> <category><![CDATA[j2karclib]]></category> <category><![CDATA[jpeg2000]]></category> <category><![CDATA[Library and Information Technology Association]]></category><guid isPermaLink="false">http://dltj.org/2007/06/meeting-of-the-jpeg-2000-interest-group-on-jun-23rd-in-washington-dc/</guid> <description><![CDATA[There will be a meeting of the LITA JPEG 2000 Interest Group during the annual conference of the American Library Association in Washington, DC, from June 23th from 10:30am to noon. The meeting will be held in the Congressional room &#8230; <a href="http://dltj.org/article/j2kig-in-dc/">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description> <content:encoded><![CDATA[<abbr class="unapi-id ignore noPrint" title="http://dltj.org/2007/06/meeting-of-the-jpeg-2000-interest-group-on-jun-23rd-in-washington-dc/"></abbr><div class="vevent" id="hcalendar-JPEG-2000-Interest-Group-Meeting" style="display:inline">There will be a meeting of the <a href="http://www.lita.org/" title="ALA/LITA Home page">LITA</a> <span class="removed_link" title="http://j2karclib.info/j2kig"><span class="summary">JPEG 2000 Interest Group</span></span> during the <a href="http://www.ala.org/annual" title="ALA Annual Conference 2007 homepage">annual conference of the American Library Association</a> in Washington, DC, from <abbr class="dtstart" title="20070623T1030-0400">June 23th from 10:30am</abbr> to <abbr class="dtend" title="20070623T1200-0400">noon</abbr>.  The meeting will be held in the <span class="location">Congressional room in the <a href="http://doubletree.hilton.com/en/dt/hotels/index.jhtml?ctyhocn=WASDTDT" title="Website for Doubletree hotel near the convention center in Washington DC">Doubletree Washington hotel</a></span>.</div><p> At the meeting we will be sharing observations and experiences with JPEG 2000 for access and preservation of still and moving pictures as well as discussing ideas for  advocacy and spreading information.  Membership in LITA is not required to attend the meeting.  Get <a href="http://suda.co.uk/projects/microformats/hcalendar/get-cal.php?uri=http://http://dltj.org/2007/06/j2kig-in-dc/" title="iCal file">this meeting as an iCal file</a> suitable for importing into most calendar programs.<br /></p><div class="geo"><img src="http://cdn.dltj.org/wp-content/uploads/2007/06/geo.png" width="80" height="15" alt="Geo microformat" /><span class="latitude">38.9077&deg;</span> by <span class="longitude">-77.0353&deg;</span></div><p style="padding:0;margin:0;font-style:italic;" class="removed_link">The text was modified to remove a link to http://j2karclib.info/j2kig on January 19th, 2011.</p>]]></content:encoded> <wfw:commentRss>http://dltj.org/article/j2kig-in-dc/feed/</wfw:commentRss> <slash:comments>0</slash:comments> </item> <item><title>Seeking Information about Regional Digitization Centers</title><link>http://dltj.org/article/seeking-information-about-regional-digitization-centers/</link> <comments>http://dltj.org/article/seeking-information-about-regional-digitization-centers/#comments</comments> <pubDate>Fri, 18 May 2007 20:35:48 +0000</pubDate> <dc:creator>Peter Murray</dc:creator> <category><![CDATA[Economies of Scale]]></category> <category><![CDATA[OhioLINK]]></category> <category><![CDATA[digital libraries]]></category> <category><![CDATA[imaging]]></category><guid isPermaLink="false">http://dltj.org/2007/05/seeking-information-about-regional-digitization-centers/</guid> <description><![CDATA[I&#8217;m looking for information about the formation and management of regional digitization centers for one of the OhioLINK strategic task forces. For our purposes, a &#8220;regional digitization center&#8221; is a place that has the hardware, software, and human expertise to &#8230; <a href="http://dltj.org/article/seeking-information-about-regional-digitization-centers/">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description> <content:encoded><![CDATA[<abbr class="unapi-id ignore noPrint" title="http://dltj.org/2007/05/seeking-information-about-regional-digitization-centers/"></abbr><p>I&#8217;m looking for information about the formation and management of regional digitization centers for one of the OhioLINK strategic task forces.  For our purposes, a &#8220;regional digitization center&#8221; is a place that has the hardware, software, and human expertise to convert a variety of media to digital form.  (We&#8217;re primarily looking at small format imaging, but could also include broadside imaging, audio capture, and video transformation.)  There is plenty of information to be found about the services that centers provide and even more evidence of regional groups <em>wanting</em> to create these centers, but precious little about the operation of the centers themselves.  (As in zilch in professional literature searches, and only a few hits via general web searching.)  The kinds of things I&#8217;m looking for are:</p><ul><li>Operational structures, ranging from staff at the center that do the actual digitization to centers that just provide equipment and the organization wanting the digitized materials providing the staffing.</li><li>Cost structures for initial center development and ongoing support.</li><li>Project plans for building and promoting regional digitization centers.</li></ul><p>Here&#8217;s what I&#8217;ve found so far.  There is <span class="removed_link" title="http://lists.mdch.org/public/digistates/2003-September/000020.html">a really good message from Liz Bishoff</span> from the time she was the Executive Director of the Colorado Digitization Program.  There is also this bit from an article Liz Bishoff wrote for First Monday:</p><blockquote><p>To assure that the institutions had access to equipment that supported these standards, the CDP established five regional scan centers. These centers provide the Colorado institutions with relatively easy access to scanning equipment, assistance by trained staff in scanning, and access to the union catalog and local databases via the Web. Each institution has to do their own scanning. Training sessions on scanning and metadata are being conducted throughout the spring and summer, 2000 at these regional scan centers. It is hoped that the combination of consulting on scanning, training, and quality equipment will result in a consistent quality image, as well as developing expertise at the local institution level.<sup><a href="http://dltj.org/article/seeking-information-about-regional-digitization-centers/#footnote_0_237" id="identifier_0_237" class="footnote-link footnote-identifier-link" title="Bishoff, L. (2000). Interoperability and standards in a museum/library collaborative. First Monday, 5(6). Retrieved May 18, 2007, from http://www.firstmonday.org/issues/issue5_6/bishoff/.">1</a></sup></p></blockquote><p>The same themes are repeated in <a href="http://www.nyu.edu/its/humanities/ninchguide/interviews/interview08.html" title="NINCH Interview Reports">an interview from the NINCH Guide to Good Practice</a>.  Beyond the CDP project, though, the findable information drops off quickly.  I&#8217;ve found that the Making of Modern Michigan project has spawned quite a number of regional centers, as have other efforts.  I&#8217;m going to get in touch with folks in Colorado and Michigan, but in the meantime if you know of something I&#8217;ve missed (or you run one of these kinds of centers yourself) please let me know.<p style="padding:0;margin:0;font-style:italic;" class="removed_link">The text was modified to remove a link to http://lists.mdch.org/public/digistates/2003-September/000020.html on January 20th, 2011.</p><h2>Footnotes</h2><ol class="footnotes"><li id="footnote_0_237" class="footnote">Bishoff, L. (2000). Interoperability and standards in a museum/library collaborative. First Monday, 5(6). Retrieved May 18, 2007, from http://www.firstmonday.org/issues/issue5_6/bishoff/.</li></ol>]]></content:encoded> <wfw:commentRss>http://dltj.org/article/seeking-information-about-regional-digitization-centers/feed/</wfw:commentRss> <slash:comments>3</slash:comments> </item> <item><title>Truly Lossless JPEG2000 Compression</title><link>http://dltj.org/article/lossless-jpeg2000/</link> <comments>http://dltj.org/article/lossless-jpeg2000/#comments</comments> <pubDate>Thu, 03 May 2007 14:15:01 +0000</pubDate> <dc:creator>Peter Murray</dc:creator> <category><![CDATA[JPEG2000]]></category> <category><![CDATA[imagemagick]]></category> <category><![CDATA[imaging]]></category> <category><![CDATA[jasper]]></category> <category><![CDATA[jpeg2000]]></category> <category><![CDATA[Kakadu Software]]></category> <category><![CDATA[photoshop]]></category> <category><![CDATA[preservation]]></category><guid isPermaLink="false">http://dltj.org/2007/05/almost-lossless-jpeg2000/</guid> <description><![CDATA[This posting used to have the tag &#8220;&#8211; Except for Grayscale?&#8221; appended to the end of the title. That is no longer needed; see the bottom of the post for an explanation. We have been implementing University of Michigan&#8217;s DLXS &#8230; <a href="http://dltj.org/article/lossless-jpeg2000/">Continue reading <span class="meta-nav">&#8594;</span></a>]]></description> <content:encoded><![CDATA[<abbr class="unapi-id ignore noPrint" title="http://dltj.org/2007/05/almost-lossless-jpeg2000/"></abbr><p>This posting used to have the tag &#8220;&#8211; Except for Grayscale?&#8221; appended to the end of the title.  That is no longer needed; see the bottom of the post for an explanation.  We have been implementing University of Michigan&#8217;s DLXS software, and DLXS uses JPEG2000 for its image masters.  We have been investigating reports of perceived changes in images in the conversion from our old media server to DLXS, and along the way I discovered an important fact:  the default parameters for two popular JPEG2000 codecs results in an irreversible transformation.  Here is how to address that.</p><p><h2>Testing For Equivalence</h2><br />We performed four tests to determine whether the source image was equivalent to the converted image.  Three tests use Photoshop:</p><ul><li>On a pixel-by-pixel basis, at high magnification, we looked for differences in the RGB and CMYK values between the source TIFF and the converted JPEG2000 image.</li><li>Comparison by copying and pasting the JP2 on top of the TIF image and selecting &#8220;Difference&#8221; blending mode between the layers.  We then look at the histogram of the resulting image.  It should be all black, which shows as a black bar on the far left of the histogram view with the mean, median and standard deviation values all exactly 0.</li><li>Using &#8220;Images &gt; Calculations&#8230;&#8221; with 100% opacity difference blending between source images (the TIFF and the JP2) with the results put into a new document shows in a completely black image.  (This is likely equivalent to the test above, but we do it just to be sure).</li></ul><p>Another test uses <code>geoimgcmp</code>, which is <a href="http://homepage.mac.com/gregcoats/jp2.html" title="GeoJPEG2000 and JPEG2000 Info, by Greg Coats">part of GeoJasPer version</a> 1.3.2.  This command should return &#8220;0&#8243;:</p><div class="wp_syntax"><div class="code"><pre class="bash" style="font-family:monospace;">geoimgcmp <span style="color: #660033;">-f</span> source.tif <span style="color: #660033;">-F</span> destination.jp2 <span style="color: #660033;">-m</span> rmse</pre></div></div><p><h2>Jasper via ImageMagick</h2><br />The first thing we tried was <a href="http://www.ece.uvic.ca/~mdadams/jasper/" title="Jasper homepage">Jasper</a> 1.701 as compiled into <a href="http://www.imagemagick.org/" title="ImageMagick homepage">ImageMagick</a> 6.2.9.  The command looked something like this:</p><div class="wp_syntax"><div class="code"><pre class="bash" style="font-family:monospace;">convert source.tif <span style="color: #660033;">-o</span> destination.jp2</pre></div></div><p>I ran though the tests, though, and it would appear Jasper/ImageMagick is not using the reversible (integer) wavelet transform.</p><p><h2>Kakadu</h2><br />Next we tried <a href="http://www.kakadusoftware.com/" title="Kakadu Software homepage">Kakadu</a>.  Although it is commercial software, it is relatively inexpensive and we acquired a developer&#8217;s license for our work on the Ohio Digital Resource Commons.   A straight compress doesn&#8217;t get one a reversible transformation:</p><div class="wp_syntax"><div class="code"><pre class="bash" style="font-family:monospace;">kdu_compress <span style="color: #660033;">-i</span> source.tif <span style="color: #660033;">-o</span> destination.jp2</pre></div></div><p>A colleague did offer some help in the form of parameters that he uses to achieve truly lossless compression:</p><div class="wp_syntax"><div class="code"><pre class="bash" style="font-family:monospace;">kdu_compress <span style="color: #660033;">-i</span> source.tif <span style="color: #660033;">-o</span> destination.jp2 \
       <span style="color: #007800;">Creversible</span>=<span style="color: #c20cb9; font-weight: bold;">yes</span> <span style="color: #660033;">-rate</span> -,<span style="color: #000000;">1</span>,<span style="color: #000000;">0.5</span>,<span style="color: #000000;">0.25</span> <span style="color: #007800;">Clevels</span>=<span style="color: #000000;">5</span></pre></div></div><p>The parameters mean this (from the Kakadu usage documentation):</p><dl><dt><code>Creversible=yes</code></dt><dd>Reversible compression?</dd><dt><code>-rate -,1,0.5,0.25</code></dt><dd>One or more bit-rates, expressed in terms of the ratio between the total number of compressed bits (including headers) and the product of the largest horizontal and  vertical image component dimensions.  A dash, &#8220;-&#8221;, may be used in place of the first bit-rate in the list to indicate that the final quality layer should include all compressed bits.  Specifying a very large rate target is fundamentally different to using the dash, &#8220;-&#8221;, because the former approach may cause the incremental rate allocator to discard terminal coding passes which do not lie on the rate-distortion convex hull.  This means that reversible compression might not yield a truly lossless representation if you specify `-rate&#8217; without a dash for the first rate target, no matter how large the largest rate target is.</dd><dt><code>Clevels=5</code></dt><dd>Number of wavelet decomposition levels, or stages.</dd></dl><p>Note that this implies this important default as well.</p><dl><dt><code>Corder=LRCP</code></dt><dd>Default progression order.  The four character identifiers have the following interpretation: L=layer; R=resolution; C=component; P=position. The first character in the identifier refers to the index which progresses most slowly, while the last refers to the index which progresses most quickly.</dd></dl><p><h2>Conclusions</h2></p><ol><li>Although one might expect the default options for image conversion programs to be lossless, ImageMagick&#8217;s &#8216;convert&#8217; and Kakadu&#8217;s &#8216;kdu_compress&#8217; commands do result in lossy transformations.</li><li>For our sample images, using the Kakadu command line options &#8220;<code>Creversible=yes -rate -,1,0.5,0.25 Clevels=5</code>&#8221; do appear to result in lossless transformations for source TIFF images.</li></ol><p>Thanks go out to Rob Buckley, Ron Murray, Kevin DeVorsey, Greg Coats, and David Taubman for their help in figuring this out.</p><p><h2>4-May-2007 Update</h2><br />There used to be a third conclusion above that said:  &#8220;For our sample greyscale images, we have not yet found a way to perform a lossless transformation to JPEG2000 when a downstream derivative is JPEG; there are perceptible differences between the JPEG created from the TIFF file versus the JPEG created from the losslessly compressed JPEG2000 file.&#8221; <a href="http://tech.groups.yahoo.com/group/kakadu_jpeg2000/message/4751" title="Message posted to the &#039;kakadu_jpeg2000&#039; mailing list">David Taubman&#8217;s message on the Kakadu mailing list</a> caused me to go back and look at this again.  I think I found an error in the way I was creating the test images.  With that fixed, I can show empirically that a JPEG derived from the lossless JP2 <em>is exactly the same</em> as the JPEG derived from the TIFF (when using identical parameters for the conversion).  That, along with the earlier finding that the TIFF and the JP2 are identical would seem to mean that the differences in the RGB/CMYK values displayed in Photoshop were a <a href="http://wordnetweb.princeton.edu/perl/webwn?o2=&amp;o0=1&amp;o7=&amp;o5=&amp;o1=1&amp;o6=&amp;o4=&amp;o3=&amp;s=red+herring&amp;i=1&amp;h=1000#c" title="Wordnet Entry for &#039;red herring&#039;">red herring</a>.</p><p>In response to the question of the lossy settings as a default, Dr. Taubman also notes &#8220;that quality is somewhat better (particularly at reduced resolutions) when viewing lossy compressed images using the irreversible options rather than the reversible.&#8221;  There are reasons for this, primarily due with what I understand as the elimination of image signal noise through through the act of lossly compression, but they are too complicated to address in this already-too-large correction text.<p style="padding:0;margin:0;font-style:italic;">The text was modified to update a link from http://wordnet.princeton.edu/perl/webwn?s=red+herring to http://wordnetweb.princeton.edu/perl/webwn?o2=&#038;o0=1&#038;o7=&#038;o5=&#038;o1=1&#038;o6=&#038;o4=&#038;o3=&#038;s=red+herring&#038;i=1&#038;h=1000#c on January 20th, 2011.</p>]]></content:encoded> <wfw:commentRss>http://dltj.org/article/lossless-jpeg2000/feed/</wfw:commentRss> <slash:comments>3</slash:comments> </item> </channel> </rss>
<!-- Served from: dltj.org @ 2012-02-11 10:51:52 by W3 Total Cache -->
