Academy Color Encoding System
The Academy Color Encoding System is a color image encoding system created by hundreds of industry professionals under the auspices of the Academy of Motion Picture Arts and Sciences. ACES allows for a fully encompassing color accurate workflow, with "seamless interchange of high quality motion picture images regardless of source".
The system defines its own color primaries that completely encompass the visible spectral locus as defined by the CIE xyY specification. The white point is approximate to the CIE D60 standard illuminant, and ACES compliant files are encoded in 16-bit half-floats, thus allowing ACES OpenEXR files to encode 30 stops of scene information. ACES supports both high dynamic range and wide color gamut.
The version 1.0 release occurred in December 2014, and has been implemented by multiple vendors, and used on multiple motion pictures and television shows. ACES received a Primetime Engineering Emmy Award in 2012. The system is standardized in part by the Society of Motion Picture and Television Engineers standards body.
Hundreds of productions, from films to television series to commercials, and VR content has been produced using ACES, including The Lego Movie, The Lego Batman Movie, Guardians of the Galaxy Vol. 2, ', The Grand Tour, Café Society, Bad Santa 2, The Legend of Tarzan, Chef's Table, Chappie, The Wedding Ringer, ' and The Wave.
Background
The ACES project began its development in 2004 in collaboration with 50 industry technologists. The project began due to the recent incursion of digital technologies into the motion picture industry. The traditional motion picture workflow had been based on film negatives, and with the digital transition, scanning of negatives and digital camera acquisition. The industry lacked a color management scheme for diverse sources coming from a variety of digital motion picture cameras and film. The ACES system is designed to control the complexity inherent in managing a multitude of file formats, image encoding, metadata transfer, color reproduction, and image interchanges that are present in the current motion picture workflow.System overview
The system comprises several components which are designed to work together to create a uniform workflow:- Academy Color Encoding Specification : The specification that defines the ACES colorspace, allowing half-float high-precision encoding in scene linear light as exposed in a camera, and archival storage in files.
- Input Device Transform : This name was deprecated in version 1.0 and replaced by Input Transform. The process that takes captured images from any ingestible source material and transforms the content into the ACES color space and encoding specifications. There are many IDT’s, which are specific to each class of capture device and likely specified by the manufacturer using ACES guidelines. It is recommended that a different IDT be used for tungsten versus daylight lighting conditions.
- Input Transform: The current terminology name for an Input Device Transform, as per ACES version 1.0 and above.
- Look Modification Transform : A specific change in look that is applied systematically in combination with the RRT and ODT’s.
- Output Transform: As per ACES version 1.0 naming convention, this is the overall mapping from the standard scene-referred ACES colorimetry to the output-referred colorimetry of a specific device or family of devices. It is always the concatenation of the Reference Rendering Transform and a specific Output Device Transform, as defined below. For this reason the Output Transform is usually shortened in "RRT+ODT".
- Reference Rendering Transform : Converts the scene-referred colorimetry to display-referred, and resembles traditional film image rendering with an S-shaped curve. It has a larger gamut and dynamic range available to allow for rendering to any output device.
- Output Device Transform : A guideline for rendering the large gamut and wide dynamic range of the RRT to a physically realized output device with limited gamut and dynamic range. There are many ODT’s, which will be likely generated by the manufacturers to the ACES guidelines.
- Academy Viewing Transform: A combined reference of a LMT and an Output Transform, i.e. "LMT+RRT+ODT".
- Academy Printing Density : A reference printing density defined by the AMPAS for calibrating film scanners and film recorders.
- Academy Density Exchange : A densitometric encoding similar to Kodak's Cineon used for capturing data from film scanners.
- ACES color space SMPTE Standard 2065-1 : The principal scene-referred color space used in the ACES framework for storing images. Standardized by SMPTE as document ST2065-1. Its gamut includes the full CIE standard observer's gamut with radiometrically linear transfer characteristics.
- ACEScc : A color space definition that is slightly larger than the ITU Rec.2020 color space and logarithmic transfer characteristics for improved use within color correctors and grading tools.
- ACEScct : A color space definition that is slightly larger than the ITU Rec.2020 color space and logarithmically encoded for improved use within color correctors and grading tools that resembles the toe behavior of Cineon files.
- ACEScg : A color space definition that is slightly larger than the ITU Rec.2020 color space and linearly encoded for improved use within computer graphics rendering and compositing tools.
- ACESproxy : A color space definition that is slightly larger than the ITU Rec.2020 color space, logarithmically encoded and represented with either 10-bits/channel or 12-bits/channel, integer-arithmetics digital representation. This encoding is exclusively designed for transport-only of codevalues across digital devices that don't support floating-point arithmetics encodings, like SDI cables, monitors, and infrastructure in general.
ACES Color Spaces
- They are based on the RGB color-additive model.
- Their codevalues are scene-referred, i.e. the numerical values represent some form of color-neutral numerical encoding of light as it is emitted and reflected by real scene objects. As a consequence of this: there is no theoretical upper bound to the codevalues ; the all-zero codevalue triple corresponds to the optical absence of light, though negative codevalues are possible as they correspond to tristimuli outside of the gamut primaries. Usually, scene-referred codevalues captured by a camera relate are directly related to luminous exposure via the same transfer characteristics.
- The reference illuminant is chosen to be close to CIE D60 standard illuminant, with chromaticities.
primaries | AP0 Red | AP0 Green | AP0 Blue | AP1 Red | AP1 Green | AP1 Blue |
AP0 is defined as the smallest set of primaries that encloses the whole CIE 1964 standard-observer spectral locus; thus theoretically including, and exceeding, all the color stimuli that can be seen by the average human eye. The concept of using non-realizable or imaginary primaries is not new, and is often employed with color systems that wish to render a larger portion of the visible spectral locus. The ProPhoto RGB and the ARRI Wide Gamut are two such color spaces. Values outside the spectral locus are maintained with the assumption that they will later be manipulated through color timing or in other cases of image interchange to eventually lie within the locus. This results in color values not being “clipped” or “crushed” as a result of post-production manipulation.
AP1 is instead contained well within the CIE standard observer's chromaticity diagram, yet still being considered “wide gamut”. It is conceived with primaries “bent” to be closer to those of display-referred color spaces for mainly two reasons:
- color-imaging and color-grading operations acting independently on the three RGB channels produce variations naturally-perceived on red, green, blue components. This might not be naturally perceived when operating on the “unbent” RGB axes of AP0 primaries.
- all the codevalues contained in the range represent colors that, converted into output-referred colorimetry via their respective Output Transforms, can be displayed with either present or future projection/display technologies.
ACES2065-1
ACES2065-1 codevalues are linear values scaled in an Input Transform so that:
- a perfectly white diffuser would map to RGB codevalue.
- a photographic exposure of an 18% grey card would map to RGB codevalue.
The internal processing and storage of ACES2065-1 codevalues must be in floating-point arithmetics with at least 16 bits per channel.
Pre-release versions of ACES, i.e. those prior to 1.0, defined ACES2065-1 as the only color space. Legacy applications might therefore refer to ACES2065-1 when referring to “the ACES color space”. Furthermore, because of its importance and linear characteristics, and being the one based on AP0 primaries, it is also improperly referred to as either “Linear ACES”, “ACES.lin”, “SMPTE2065-1” or even “the AP0 color space”.
Standards are defined for storing images in the ACES2065-1 color space, particularly on the metadata side of things, so that applications honoring ACES framework can acknowledge the color space encoding from the metadata rather than inferring it from other things. For example:
- SMPTE ST2065-4 defines the correct encoding of ACES2065-1 still images within OpenEXR files and file sequences and their mandatory metadata flags/fields.
- SMPTE 2065-5 defines the correct embedding of ACES2065-1 video sequences within MXF files and their mandatory metadata fields.
ACEScg
ACEScc
Converting ACES2065-1 RGB values to CIE ''XYZ'' values
Converting CIE ''XYZ'' values to ACES2065-1 values
Standards
ACES is defined by several Standards by SMPTE and documentations by AMPAS, which include:- - Academy Color Encoding Specification
- - Academy Printing Density : Spectral Responsivities, Reference Measurement Device and Spectral Calculation
- - Academy Density Exchange Encoding : Encoding Academy Printing Density Values
- - ACES Image Container File Layout
- - Material Exchange Format: Mapping ACES Image Sequences into the MXF Generic Container
- - ACESproxy: An Integer Log Encoding of ACES Image Data
- - ACEScc: A Logarithmic Encoding of ACES Data for use within Color Grading Systems
- - ACEScg: A Working Space for CGI Render and Compositing
- - ACEScct: A Quasi-Logarithmic Encoding of ACES Data for use within Color Grading Systems
- - Recommended Procedures for the Creation and Use of Digital Camera System Input Device Transforms
- - Academy Color Encoding System Documentation Guide
- - Academy Color Encoding System Version 1.0 User Experience Guidelines
- - Informative Notes on SMPTE ST 2065-1 - Academy Color Encoding Specification
- - Informative Notes on SMPTE ST 2065-2 - Academy Printing Density – Spectral Responsivities, Reference Measurement Device and Spectral Calculation and SMPTE ST 2065-3 Academy Printing Density Exchange Encoding - Encoding Printing Density Values
- - Informative Notes on SMPTE ST 2065-4 - ACES Image Container File Layout
- - Informative Notes on SMPTE ST 268:2014 – File Format for Digital Moving Picture Exchange
- - Academy Color Encoding System Clip-level Metadata File Format Definition and Usage
- - Design, Integration and Use of ACES Look Modification Transforms
- - Academy Color Encoding System Version 1.0 Component Names
- - Derivation of the ACES White Point CIE Chromaticity Coordinates