Video and Audio

The previous chapter was all about USB and Thunderbolt, and you would be forgiven for thinking those two standards were the alpha and omega. But for video and audio connections, USB and Thunderbolt over USB-C are just two of several possible choices.

You might have a computer or mobile device with some standard or smaller flavor of DisplayPort or HDMI built in. USB-C–heavy computers may omit video connectors, requiring you to add a USB-C adapter or dock to plug in your display. In a small number of cases, a display comes with native USB-C support or offers it as one of two or more connections.

Audio shouldn’t be an afterthought, but in modern devices it’s often incorporated directly into the video standard, obviating the need for a separate audio connection, cable, or configuration. I explain where audio fits in as necessary.

First, let’s ask our most pressing audio and video questions. Next, we need a quick detour into compression and why it matters for video standards. Then I take you through DisplayPort and HDMI as standards and what they offer. Finally, we can get into the nitty-gritty of what plugs into what and what number of displays are possible, and at which resolutions and refresh rates.

Video Questions and Answers

People usually pose one of the four following questions about connecting video displays to host devices:

  • What cable do I need? Let me start with this one, because that answer is in DisplayPort and HDMI Capabilities. It’s very straightforward once you know what display and resolution you’re using, as determined from the next questions and the rest of this chapter.

  • How can I connect a display with a particular resolution and refresh rate to my computer or other device? And…

  • Why doesn’t my host device support higher resolutions or refresh rates when connected to my display? And…

  • How many displays can I attach to my host device?

Those last three questions are linked together. The general answer is that you need to know the capabilities of your host device and display or displays—ones you own or might buy—to see where they intersect. Every piece of hardware has a limit as to how many and what kind of displays you can connect to it; every display has a set of built-in resolutions and refresh rates that it can negotiate with a host controller.

Let’s consider a scenario. Suppose Neha owns a desktop computer that predates Thunderbolt 3 and USB-C. It includes just an HDMI port for external video. Should she purchase a 6K display? No: HDMI is limited to at most 4K. See HDMI and HDMI Standards as Deployed later in this chapter. Could she add a 6K display?

If her computer has card slots, she might be able to buy a video card with a version of DisplayPort and DisplayPort jacks that handles 6K. See DisplayPort and DisplayPort Standards as Deployed. What if she purchased an HDMI-to-DisplayPort adapter? She would still be limited to the maximum resolution and refresh rate supported by the controller driving her HDMI jack. See Adapt Among Video Standards.

Let’s look at another common situation. Phil has an Apple M1 Mac mini and wants to add three external displays. He looks up specs and sees that he can add up to a 6K display at 60 Hz via a USB-C DisplayPort adapter and plug in a 4K display via the Mac mini’s HDMI port. But what about a third? He could use a DisplayLink adapter, which pushes video over USB 3.x and requires a software driver; see DisplayLink Isn’t Part of DisplayPort. Otherwise, he’s limited to two.

As I noted in Identify Jacks and Plugs, you can Read Technical Specifications and Find Operating System Information for some details. For display-related information:

  • Find the technical specifications for your host device or display. Most manufacturers list those on their website even for hardware they no longer sell.

  • Turn to third-party resources. Websites and apps can help you track down the specifics. For Apple hardware, I turn to the free Mactracker app, which provides a thorough explanation of the number and type of displays you can add (Figure 32).

    Figure 32: Mactracker offers a full accounting under Display Support and External Resolution about display possibilities.
    Figure 32: Mactracker offers a full accounting under Display Support and External Resolution about display possibilities.
  • Plug in and see what happens: macOS and Windows provide details when you connect a computer jack and a display. This can reveal what the operating system has negotiated (Figure 33).

Figure 33: With two displays plugged in, one via USB-C and an adapter and one via HDMI, macOS confirms they’re both at 4K.
Figure 33: With two displays plugged in, one via USB-C and an adapter and one via HDMI, macOS confirms they’re both at 4K.

Uncompressed Video Eats Bandwidth

Nearly all video you stream online is compressed. Using clever algorithms, the audio and video components of an original recorded video or audio file are reduced in size by recognizing repetitive elements and ones that aren’t perceived by eye or ear when removed. Compression makes internet-streamed video possible.

You may notice compression at times when you see odd artifacts. YouTube and other services sometimes stall and restart or have strange jitters when you go back 15 or 30 seconds. You’ll see what seems like a combination of a previous frame and only portions that are new. That’s showing some of the underlying aspects of the compression, in which a keyframe captures a scene and then only the differences are recorded while the video remains mostly fixed in place.

HDMI and DisplayPort come from an earlier era in which compression was expensive: it required a lot of computational power or pricey specialized chips. As a result, the standards were built around uncompressed data streams. It’s also the case that when using apps on a computer or mobile display, a user wants 1:1 pixel accuracy, refreshed at the highest available frequency. Some lossless compression algorithms that preserve every bit can reduce the data stream somewhat, but at times it might be nearly as broad as uncompressed video.

These days, compression is affordable and no big deal. Nearly everybody who isn’t an audio or video professional captures all the sound and movement on their mobile devices in high-quality compressed form; most non-professional photographers do the same on cameras.

The difference is huge. An uncompressed 4K video stream at 30 Hz consumes 6 Gbps; at 60 Hz, it eats up 12.5 Gbps. The latest best video compression algorithm, H.265, would require only about 15 Mbps and 50–60 Mbps for the same 4K streams.

But because display standards are built around uncompressed video for home A/V, and because app users want full fidelity, HDMI and DisplayPort remained uncompressed until relatively recently.

HDMI started using a selective data omission called chroma subsampling that using less data to achieve a similar picture quality. Our eyes perceive most colors less well than we perceive differences in tone, or luminance, which is where we observe most of the fine detail in a still or moving image. Chroma subsampling in HDMI essentially streams color information at a lower effective resolution than luminance. It can be noticeable when using a computer, but it’s nearly invisible or imperceptible for filmed content. This is typically used in HDMI for higher refresh rates, providing smoother motion.

DisplayPort separately added support for Display Stream Compression (DSC), which reduces both color and luminance data in a way that’s designed to not be noticed, either. It can achieve up to 3:1 compression and enables higher refresh rates and much higher resolution within the constraints of bandwidth that wouldn’t otherwise support it. HDMI adopted DSC for very high resolution and refresh rates.

Even with compression, HDMI and DisplayPort have to reserve space on a given bus for video. Depending on the version of each standard, the space required can range from about 4 Gbps all the way up to 80 Gbps. The 10 to 25 Gbps range is more typical for 4K and 5K displays.

Video Standards

In every case, though, no matter the connector, DisplayPort and HDMI rule the video roost in the way that USB and Thunderbolt now dominate data standards. Also like those two standards, DisplayPort and HDMI have matured to be fairly inter-compatible, reducing frustration when attempting to connect displays or devices.

HDMI

Designed to carry digital audio and video from devices like DVD players into what were then newfangled high-definition televisions (HDTV), HDMI now encompasses both home-entertainment and computing purposes.

Work started on HDMI 1.0 in 2002 to serve the nascent HDTV market. It was intended to be backward compatible with an existing computer video standard, DVI (Digital Video Interface). Within a few years, HDMI appeared on tens of millions of TV sets.

You don’t need to know much about the standard, but it’s worth a quick run-through because device makers often put the HDMI release number on their equipment without additional explanation.

Here’s the version history for HDMI:

  • 1.0–1.1 (3.96 Gbps): Up to 1080p at 60 Hz

  • 1.2–1-2a (3.96 Gbps): Up to 1440p at 30 Hz

  • 1.3-1.4b (8.16 Gbps): Up to 4K at 30 Hz (normal) or 75 Hz (chroma subsampling)

  • 2.0-2.0b (14.4 Gbps): Up to 5K at 30 Hz (normal), 5K at 60 Hz (chroma subsampling), or 8K at 30 Hz (chroma subsampling)

  • 2.1 (42.6 Gbps): Up to 4K at 144 Hz (normal) or 240 Hz (DSC), 5K at 60 Hz (normal) or 120 Hz (DSC), or 8K at 30 Hz (normal) or 120 Hz (DSC), 10K at 120 Hz (DSC)

HDMI also started supporting a deeper color palette in version 1.3, allowing over a billion colors to nearly 300 trillion (30-bit, 36-bit, or 48-bit color) compared to normal displays, which offer tens of millions (24-bit). Its advantage? Areas of similar color that might otherwise show banding or artificial colors show smooth transitions. Deep color add a nearly proportional increase in raw bandwidth, such as 25% more for 30-bit color. With compression, that disadvantage drops significantly.

On top of deep color, HDMI added support for high dynamic range (HDR) video in version 2.0, a technology you’ve probably seen in photography that offers a richer tonal range, providing more differentiation of tone and color in the lightest and darkest areas while being able to show both at once. Version 2.1 added Dynamic HDR—points off for the way it sounds redundant—which tweaks the HDR tonal range to as fine a level as frame by frame.

Fancier and newer features require implementation both in the HDMI controller on a host device and on the display. Just having an HDMI 1.3, 2.0, or 2.1 controller and display won’t mean that you get deep color or either form of HDR.

DisplayPort

DisplayPort is a somewhat newer spec than HDMI, emerging in version 1.0 form in 2006. Where HDMI aimed itself at TVs, DisplayPort focused on evolving a new interface with higher data rates than DVI and the quite old VGA format.

As with HDMI, a quick romp through DisplayPort versions will help you understand what your device or display is capable of (highest resolutions and refresh rates, plus where compression is needed):

  • 1.0 (5.18 or 8.64 Gbps) or 1.1 (8.64 Gbps): 1440p at 60 Hz

  • 1.2 (17.28 Gbps): 4K at 60 Hz

  • 1.3–1.4a (25.92 Gbps): 4K at 120 Hz, 8K at 60 Hz (DSC)

  • 2.0/2.1 (77.36 Gbps): 8K at 60 Hz, 10K at 60 Hz, 16K at 60 Hz (DSC)

Other improvements came along with the version updates:

  • Multi-Stream Transport (MST) in 1.2: MST allows multiple video signals over a single jack and used to be a heavily stressed marketing term. A few years ago, it just became something people expected. Displays can be daisy-chained if they support DisplayPort 1.2 or later with MST and have two DisplayPort connectors. However, don’t get too excited: it’s useful only for lower-resolution displays, and Apple never added support for it in macOS. MST allows connecting five displays below 1080p (1680 by 1050), four at 1080p, two at 1440p, or one at 4K.

  • HDR in 1.4: As in HDMI, high-dynamic range video came to DisplayPort paired with 30-bit deep color. (For irritating standards reasons, some DisplayPort 1.2 devices can handle HDR, too.)

  • Full use of Thunderbolt 3 and 4 for video in 2.0: You’ll note that DisplayPort 2.0 offers a huge 77.36 Gbps of video data. It manages this trick only over Thunderbolt by taking over both directions of 40 Gbps data streams, typically split 80-20 for regular data and DisplayPort data.

Plug into Video (and Audio)

As with any other peripheral, there are three parts to consider: the host device, the cable that connects them, and the peripheral. You can check the host and display’s specifications to make sure the host can output at the highest resolution you want to use on the display. But you also need to make sure you have the correct generation of HDMI or DisplayPort cable or the right adapter.

Adapt Among Video Standards

You might find a USB-C, DisplayPort, or HDMI jack on a computer or other device—or more than one, and multiples of each. If you’re not plugging natively into a display using the same standard as the jack’s, what can you expect to come out the other end? Here’s what to expect when you connect hosts and displays together:

  • USB-C DisplayPort via USB-C Alt Mode or Thunderbolt: Connections from a host with either of these standards are limited to DisplayPort 1.4, but a controller can support compression for up to 6K or even 8K displays. (I’ve seen only 6K supported so far.) Future upgrades to USB4 and Thunderbolt will include support for DisplayPort 2.1.

  • USB-C HDMI Alt Mode: Output from a host’s controller is limited to HDMI 1.4b—typically no more than a 4K display.

  • USB-C to USB-C: A display with a USB-C plug wired into it or USB-C to USB-C support uses USB-C Alt Mode or Thunderbolt DisplayPort, and thus is limited to DisplayPort 1.4, no matter what controller manages the jack on a host. With future versions of USB4 and Thunderbolt, these connections should also allow for DisplayPort 2.1.

  • DisplayPort to HDMI: Most host DisplayPort controllers include an unlabeled feature called Dual-Mode (DP++) that automatically detects an HDMI adapter connected to the jack or at the end of a cable and produces HDMI-compatible signals. The HDMI output may be a lower resolution or refresh rate than native DisplayPort if the controller lacks same-generation HDMI support.

  • HDMI to DisplayPort: HDMI lacks inverse support, so a powered external adapter box is required when you want to output from a controller’s HDMI jack into a native DisplayPort jack on a display. Many displays include both HDMI or DisplayPort or only HDMI, so this is often not an issue: use an HDMI-to-HDMI cable.

HDMI Standards as Deployed

Interestingly, native HDMI ports tend to be deployed using older standards for lower resolutions than DisplayPort over USB-C. For instance, the latest version of HDMI supported by Apple on its most recently shipped computers remains version 1.4: 4K at up to 30 Hz on consumer-level devices and up to 60 Hz on professional-level devices.

HDMI can be used over USB-C, which includes an alternative mode for HDMI 1.4b. USB-C natively, and Thunderbolt 3 and 4 within USB-C, can encapsulate DisplayPort over USB-C. If you insert HDMI into that environment, such as using a USB-C to HDMI adapter or cable, you’re limiting your maximum display capability to the lowest compatible level between the display and the version of DisplayPort coming out of the USB-C port.

HDMI connectors come in three varieties: Micro HDMI, Mini HDMI, and standard HDMI (Figure 34). Each fits a niche: digital cameras often use Micro HDMI; cameras more commonly now opt for Mini HDMI, as do video cameras and some mobile devices; and standard HDMI is found on computers, TV sets, and home-entertainment gear.

Figure 34: You can see the compact formats of Micro HDMI, Mini HDMI, and standard HDMI plugs. (Photo: Nico Jenner)
Figure 34: You can see the compact formats of Micro HDMI, Mini HDMI, and standard HDMI plugs. (Photo: Nico Jenner)

If the display has both HDMI and DisplayPort jacks, you need to check that its HDMI port can deliver the same resolution and refresh rate as its DisplayPort side so you’re not using the best output possible.

To use later HDMI standards, you typically need to install an add-on video card in a pro-level computer that supports it.

DisplayPort Standards as Deployed

The Mini DisplayPort connector that’s also used for Thunderbolt and Thunderbolt 2 hasn’t appeared on new devices for years. You’re almost certain to either have a standard DisplayPort jack on a display and standard DisplayPort on your host device, like a computer, or require a USB-C adapter for DisplayPort on a host device (Figure 35).

Figure 35: Standard DisplayPort remains in wide use (left); Mini DisplayPort seems to have served its purpose and faded away.
Figure 35: Standard DisplayPort remains in wide use (left); Mini DisplayPort seems to have served its purpose and faded away.

Audio Output

This chapter has absolutely been dominated by video because choosing your display’s resolution and refresh rate are often the most complicated choices you make. Both DisplayPort and HDMI support various kinds of audio incorporated in the same data stream as video. In typical use, you use your operating system to select the display as audio output (Figure 36).

Figure 36: macOS lets you select displays with built-in audio in System Preferences > Sound > Output. Here my LG HDR 4K and ViewSonic VX2475 both appear as options.
Figure 36: macOS lets you select displays with built-in audio in System Preferences > Sound > Output. Here my LG HDR 4K and ViewSonic VX2475 both appear as options.

If you’re using a computer with a separately installed graphics card or one that you configure at the time of purchase, you might have to use the audio outputs of the card—the card might not carry audio over a DisplayPort or HDMI connection.

Most computing devices include built-in speakers, which can range from poor and tinny to super high-fidelity that you paid a lot extra for or are a selling point of the device. In most cases, the only audio output option from a computer or mobile device is a standard 3.5 mm (⅛-inch) stereo or hybrid mic/stereo output cable. (See Audio Capabilities.)

Cope with Copy Protection

One of the most frequent problems with computer-to-display connections, particularly with video projectors, is the inability to watch downloaded and streaming video content. That’s due to HDCP (High-bandwidth Digital Content Protection), a form of DRM (digital rights management) came to be because the film industry didn’t want to allow high-fidelity digital video to be copied just by plugging in a cable.

Of course, HDCP doesn’t really prevent an effective way to reduce piracy. Instead, it just makes it harder for all of us with legitimate purposes to do what we want while not deterring or derailing those who make unauthorized copies.

Nevertheless, it’s an HDCP world and we live in it. HDCP was built into HDMI from the start and added to DisplayPort in version 1.1.

Any hardware or software you use that requires HDCP—like a standalone Blu-ray player, Netflix web player, or Apple’s QuickTime Player app—has to engage in a handshake with the display on which its content plays. This handshake typically takes place as a negotiation over a cable, though for built-in displays, like with a laptop, it’s entirely invisible.

If the handshake fails for some reason, you will see an irritating message in varying forms. Sometimes it will read, “Content not authorized,” but it might have a more technical messages like “HDCP handshake failed” or “HDCP unauthorized.”

Here are some of the potential causes:

  • Bad cable or incorrect cable tier: Surprisingly, you can plug in an HDMI cable and have some video work while HDCP-based content fails. This can happen if the HDMI cable is poorly made, has an internal fault, or doesn’t meet the spec for your resolution and refresh rate. See DisplayPort and HDMI Capabilities.

  • Lack of support in display: An external display sold in the last 15 years should fully support HDCP, but if you’re using a perfectly good older display, it may lack necessary code. It’s also possible the HDCP software was poorly implemented by the display’s maker and is incompatible with what you’re playing back. The way to rule that problem out is to try the same content using the same cable with another display to see if that works.

  • Lack of support in projector: Older video projectors often lacked HDCP compliance, in part because it costs money to deploy HDCP and not all projector makers felt that was worthwhile. Newer projectors—those of the last decade, certainly—should be labeled as HDCP compliant or not.

  • Lack of external display support for HDCP: A complaint I commonly hear—in my confessor, er, public support role as a long-time writer of how-to material for Apple users—is that someone has an Apple laptop and HDCP has stymied them. The formulation is usually that they have connected a 1080p or higher external display, and—whether mirroring or using an extended desktop—cannot get the content to play at a resolution above 480p (standard definition) or they see an HDCP error message. This problem appears to have disappeared around 2017 or so, potentially overlapping the rise of Thunderbolt 3. It’s plausible that HDCP over DisplayPort directly from a USB-C port works where output via a Mini DisplayPort or HDMI adapter didn’t.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset