History of the Raw file debate

Battlefield chronology

The only purpose of this historical perspective is to set the stage for the discussion.

  1. 2001: The TIFF/EP standard is published by the ISO in an attempt to define common metrics for digital camera sensors. This appears to be the foundation for most popular RAW image formats.
  2. The Adobe/Nikon conflict seems to go back to 2003 at least.
  3. 9/27/04 Adobe announces the new DNG format.
  4. 2/08/05 NC 4.2.0 from Nikon is available with D2X support.
  5. 2/25/05 Nikon D2X becomes available in Europe and Japan.
  6. 2/25/05 First D2X review appears on the web.
  7. 3/10/05 First web discussion regarding Nikon “encryption”.
  8. 3/18/05 First review of the D2X and NC 4.2.1 appears on the web.
  9. 3/19/05 Hasselblad and Leica plan to support Adobe DNG file format.
  10. 3/23/05 Bibble 4.2.2 supports Nikon D2X including white balance.
  11. 4/17/05 Thomas Knoll (Adobe) fires a shot across the Nikon bow.
  12. 4/21/05 Dave Coffin and Eric Hyman (Bibble) announce code hacks.
  13. 4/22/05 First Nikon public Advisory.
  14. 4/25/05 Adobe PS CS2 available (without D2X support).
  15. 5/02/05 ACR 3.1 available with limited D2X white balance support.
  16. 6/02/05 Microsoft announces planned OS support for Digital Raw in cooperation with Adobe Systems Inc., Canon Inc., Fuji Photo Film Co. Ltd. and Nikon Corp.
  17. 6/20/05 The answer is 42, as in TIFF/EP version 42. It is the answer to life, the universe, and everything as in the HHGTTG.

The nice thing about standards,
there are so many to chose from

TIFF stands for Tag Image File Format.   TIFF 6.0 is owned by Adobe through acquisition of Aldus PageMaker (1986-1992).   TIFF/EP "Electronic Photography" is owned by the ISO (2001).   Participants include Adobe, Canon, Kodak, Nikon, Fujifilm, Olympus, and the CIE among many others.   It has new metadata tags for sensor data and camera metrics.   Apparently, not everything that Adobe and some other image editing software seem to need and want.

IPTC stands for International Press and Telecommunications Council (1965).   The IPTC addresses author, copyright, and publishing related information.

EXIF stands for eXchangeable Image File Format.   This format was part of the DCF standard created by JEIDA or the Japan Electronics Industry Development Association (1998), now JEITA.   EXIF includes tags relating to the image data structure, camera make and model, copyright information, user comments and keywords, shooting data, timestamps, and such.   The “Makernotes” tag is an area for manufacturers to store undefined and semi-private data. These tags may be imbedded in almost any image or media file type.   DCF stands for Design rule for Camera File system.   DCF also includes a CIFF standard, which stands for Camera Image File Format.   This addresses rules for storage and management of removable memory media such as compact flash.

OECF stands for Opto-Electronic Conversion Function.   It is the foundation of nearly all of the ISO/TC42 performance standards, documented in ISO 14524.   It defines the relationship between exposure, or reflectance, and digital count values of a capture device.   It is most often used or referenced in other performance standards, test image targets, and benchmarks.

XML, eXtensible Markup Language is an industry standard from the W3C, or The World Wide Web Consortium (1996-2001).   It is in turn based on an ISO SGML standard.   This is primarily a syntax definition.   It is a framework for encapsulation of common tags and semantics for multiple industries.

XMP, eXtensible Metadata Platform is owned by Adobe (January 2004).   It is an Adobe implementation of XML for image and camera related data tags.

These are all employed to some extent in the raw image formats that are popular today.   In addition, Adobe has proposed its DNG (Digital NeGative) format as a standard for all raw files.

Metadata

Metadata is defined as data that describes data.   Like a dictionary it consists of two basic types of information.   The first is the syntax, like the spelling and pronunciation of a particular word.   For computer data, this helps us extract or “parse” the words.   The second part is the semantics, like the dictionary usage and meaning of a particular word.   This is described in the reference standards or through accompanying documentation.   By definition, proprietary data would not be fully described in a standards document.

Image metadata is simply information about the image.   This is recorded by the camera to describe the raw data and information about the camera, including camera settings.   Metadata written by a digital camera may include physical properties of the camera, exposure information, color information, white balance, camera settings, date and time, GPS, lens information and more.   Since most of this is not adequately covered by existing standards, much of it is included in the EXIF “Makernotes” area.

The metadata written by a digital camera in a RAW file is needed to accurately render the raw data into a finished image.   Some portions of this metadata are critical to proper image processing.   Other metadata items can provide important clues to help describe and categorize the image or to analyze your shooting skills.

Cheers, Rags :-)
So long, and thanks for all the fish!


Rags Gardner
Rags Int., Inc.
204 Trailwood Drive
Euless, TX 76039
(817) 267-2554
Send Email
www.rags-int-inc.com
May 21, 2005

This page last updated on: Thursday April 12 2007
You are visitor number 6,480 since 06/28/05