Network Device Interface


Network Device Interface is a royalty-free software standard developed by NewTek to enable video-compatible products to communicate, deliver, and receive high-definition video over a computer network in a high-quality, low-latency manner that is frame-accurate and suitable for switching in a live production environment.

Technology

NDI is designed to run over gigabit Ethernet, with the NDI codec expected to deliver 1080i HD video at VBR data rates typically around 100 Mbit/s.
By Default, NDI uses the mDNS discovery mechanism to advertise sources on a local area network, such that NDI receiving devices can automatically discover and offer those sources, although 2 other discovery modes allow for operations across subnets, and without mDNS. Sources are created using an arbitrarily selected TCP port from a range of ports on the NDI send host. When a source is requested, a TCP connection is established on the appropriate port with the NDI receiver connecting to the NDI sender. NDI 3.x has options to use UDP multicast or unicast with forward error correction instead of TCP, and can load balance streams across multiple network interface controllers NICs without using link aggregation. NDI 4.0 introduces multi-TCP connections.
NDI carries video, multichannel uncompressed audio and metadata. Metadata messages can be sent in both directions allowing the sender and receiver to message one another over the connection with arbitrary metadata in XML form. This directional metadata system allows for functionality such as active tally information fed back to sources to understand that they are on-air. NDI also allows senders to determine the number of connected receivers, so they can skip unnecessary processing and network bandwidth utilisation when there are no NDI receiver clients connected. NDI Receivers can opt to connect to various combinations of streams, to support things like audio-only or metadata-only connections where video is not required.
The NDI software development kit is available for Windows, Linux and macOS, and has also been ported to iOS, tvOS, Android, Raspberry Pi, and FPGA. The SDK is available via a royalty-free proprietary license.

Comparison of common IP video protocols

Other IP video protocols emerging for use in professional video production include SMPTE 2022, SMPTE 2110, ASPEN and Sony NMI. There are clear differences in the technology used by these protocols.
NDINDI HXNDI HX2SMPTE SMPTE 2110ASPENNMI
TransportTCP/UDP/Multi-TCPUDP TCP/UDP/Multi-TCPUDPUDPUDPUDP
Image formatSize / Aspect IndependentSize / Aspect IndependentSize / Aspect IndependentSDI Formats onlySize / Aspect Independent
Tally
Bidirectional device control
Integrated alpha channel
CompressionNDI Codec NDI|HX H.264/H.265NONENONENONE / LLVC Codec
ConnectionSocket, Unicast / Multicast and FECUnicast / MulticastSocket, Unicast / Multicast and FECMulticastMulticastMulticastMulticast / ?
HD data rate~100 Mbit/s8–20 Mbit/s~1–50 Mbit/s>1.5 Gbit/s>1.1 Gbit/s>1.5 Gbit/s>1.5 Gbit/s / up to 14:1
Essence packingDiscrete audio, metadata and fideo frame packets, single connectionDelivered as discrete audio, metadata and video frame packets, single connectionDiscrete audio, metadata and video frame packets, single connectionPacketized raw SDI bitstreamDiscrete audio, video and Metadata on separate connections with different protocolsMultiple MPEG transport streamsFrame aligned 2022-6 / LLVC
InfrastructureGigabit / wireless / load balanced multi NIC / 10 GBitGigabit / wirelessGigabit / wireless10 GBit minimum10 GBit minimum10 GBit minimumGigabit / 10 GBit
Service DiscoveryBonjour, NDI Access, server automatic via HX driverBonjour, NDI Access, server NMOSAMWA IS-04JSON-RPCPlug & play
APIRoyalty-free license, SDK libraries for Win, Mac, Linux, iOS, FPGA referenceHardware encode, decode with NDI librariesSend with NDI embedded SDK, receive with NDI librariesSMPTE standardSMPTE standardSMPTE RDD

History

NDI was publicly revealed by NewTek on 8 September 2015 and was demonstrated at the IBC broadcast exhibition in Amsterdam that week. The first device shown using NDI was the NewTek TriCaster which delivered an NDI feed from each of its SDI inputs as well as four output feeds from its vision mixer. The TriCaster could also receive up to two NDI sources from other devices.
NDI devices from other vendors followed during 2016. The first third-party products came from Gallery Sienna and included an NDI signal generator for macOS, a desktop scan converter for macOS and the NDICam camera app for iPhone which delivers a native NDI stream from iOS devices.
NewTek had previously created a predecessor of NDI called AirSend to get video from external devices into their TriCaster products. AirSend had been implemented by a number of character generator vendors including VizRT and Chyron. In order to quickly bring these products into the NDI space, NewTek created a new driver to replace the existing AirSend driver, which could be installed on these existing AirSend compatible devices, instantly converting them to NDI compatible devices with no change required by the original CG vendors.
Another early adopter of NDI was VMix, a Windows-based vision mixer which offers NDI inputs and outputs. A significant increase in the NDI installed base came when live streaming application XSplit added support for NDI.
Later in 2016, NewTek delivered NDI 2.0 which added features including support for service discovery across subnets. In the first half of 2017, BirdDog began demonstrating and shipping BirdDog Studio NDI - a PoE powered portable FPGA based NDI encoder with HDMI and SDI inputs with Tally, supporting up to 1080p60 video resolutions.
On 12 July 2017 NewTek announced NDI 3.0 which added multicast, NDIHX and other new features, introducing support for specific PTZ Cameras with H.264 chipsets and updated firmware.
In April 2018 at the NAB Show, Microsoft announced they had added NDI support to Skype for Content Creators. Other announcements at NAB2018 included NDI 3.5, and new NDI support from vendors including EVS and Avid.
Version 3.4 of ffmpeg added input and output support for NDI when optionally compiled by the end-user to a non-open-source NewTek library. However, NewTek was later found to be redistributing pre-compiled binaries of FFmpeg that incorporated their non-opensource library in violation of the GNU General Public License, causing the FFmpeg project to remove NDI support from their codebase in March 2019.
In April 2019, ahead of NAB, NewTek announced the addition of Multi-TCP mode to NDI 4.0 which is reported to leverage hardware TCP acceleration present in silicon, assisting lower-spec processors with NDI transport. NDI 4.0 shipped in September 2019 to coincide with the IBC exhibition.
VersionReleasedFeatures/Enhancements
1.0April 2016Initial Release
2.0Sept 2016Cross subnet support via Access Manager, ARM encoding support, iOS SDK
3.0July 2017NDI-HX support, Option for multicast transport with FEC, PTZ support.
3.5June 2018Defaults to Unicast UDP transport method with FEC.
3.6July 2018Packet level bonding improvements.
3.7Sept 2018Discovery improvements.
3.8Nov 2018Performance Enhancements, NDI Embedded SDK for FPGA development.
4.0Sept 2019Multi-TCP Transport mode, HDR 16-bit support, Native synchronised recording, Discovery Server, NDI HX2
4.1Nov 2019Performance improvements.
4.5March 2020New Multi-TCP implementation, Lower latency with NDI-HX, Predictable port numbers for firewall rules, Improvements to codec quality.

Use in Wi-Fi and wide area networks

NDI was designed to work on good quality gigabit local area networks using TCP and Bonjour technologies. In order to work across subnets that don't pass mDNS, NDI supports a mechanism known as NDI Access which allows manual entry of the IP address of machines on other subnets which may be running NDI sources.
Some NDI adopters have run the protocol across fibre connections up to 15 km, although NDI's use of the TCP protocol makes it less suitable for long-distance, high-latency connections due to factors such as bandwidth-delay product and TCP packet loss recovery. The NDI 3.5 libraries now default to a UDP transfer method with forward error correction. This removes the latency requirements that are inherent with TCP connections. NDI|HX uses a lower data rate making it easier to use in bandwidth-limited connections.
To provide an extension of NDI to wide area networks, tools have been developed including the Sienna Cloud for NDI protocol which uses node gateways in each LAN to bridge NDI sources across continents. In July 2017, United States Specialty Sports Association successfully made the first truly wide area network NDI sports coverage using NDI with 5 cameras backhauled across the public internet from a stadium 200 miles away into an NDI based production gallery.
NDI is also used within cloud-based production systems, with its compressed video and unicast transmissions making suitable for cloud-based services like AWS and Azure. in 2019 Sienna demonstrated a complete cloud-based production workflow using NDI, including remote contribution and final publishing via content delivery networks like YouTube Live.

CPU architecture support

NDI, when running on x86 architectures, requires CPUs that include the SSSE3 instruction set. Most Intel CPU designs starting in 2006 have this instruction set, AMD added support starting in 2011. While not a requirement, NDI will take advantage of Advanced Vector Extensions and AVX2 instructions sets for additional performance.
NDI can run on 32-bit or 64-bit CPU architectures, although performance is increased when using 64-bit.
NDI is available with encode support for ARM-based systems, but generally not video decode. Exceptions to this are Sienna NDI Monitor for iOS which does provide NDI decoding on ARM, and Sienna NDI Monitor TV for AppleTV 4k.
NDI|HX devices are typically transmit-only and based on proprietary platforms with hardware H.264 encoder chips. Examples of NDI|HX devices are PTZ cameras, and the NDI Connect Spark SDI to NDI|HX converter box. The NDI stream itself is formed at the stream consumption end via the platform-specific NDI|HX driver, presenting the same uncompressed data to the application software consuming the NDI source regardless of original HX source hardware and compression. NDI|HX2 is a purer implementation of H.264 in NDI packets and will allow software and hardware systems to embed H.264 essence into NDI streams using the NDI Embedded SDK.
NewTek, Birddog and Magewell have all developed FPGA encoding implementations of NDI. In April 2018 NewTek announced the Connect Spark Pro which will be their first FPGA based NDI product. Birddog and Magewell also offer FPGA-based decode of full NDI streams. Newtek offers a licensable FPGA reference design for third-party NDI encoders as part of their NDI Embedded SDK.
With NDI 4.0 NewTek announced the addition of a Multi-TCP transport mode. This takes advantage of the hardware TCP acceleration in silicon which helps lower-spec processors handle heavy network load, in contrast to UDP which does not benefit from the hardware acceleration.

Metadata and extensions to the NDI specification

NDI supports arbitrary metadata as XML blocks, embedded in video and audio frames, as well as stand-alone metadata frames.
The content of these metadata blocks form 3 families.
  1. Internal metadata used by NDI invisibly. These messages are used for connectivity and some other fundamental tasks like Tally. They are typically invisible to NDI clients.
  2. Defined public metadata. These messages include things like the NDI PTZ Protocol. They are defined by NewTek as part of the NDI SDK.
  3. Third-party metadata schemes. These messages are implemented in the same way as defined NDI metadata but the content is based on third-party designs.
There are 8 published examples of third-party NDI metadata schemes: