TV Technology
NBCU’s Summer Olympics operation is a herculean effort at the best of times without having Covid to contend with. The Games’ postponement in 2020 at least gave the network some breathing space to revise its plans but with uncertainties around travel and health regulations changing up until the last minute, the logistics are staggering.
https://www.tvtechnology.com/news/nbcs-olympics-coverage-honed-from-decades-of-tech-experience
Nonetheless, David Mazza,
senior vice president and CTO for NBC Sports Group and NBC Olympics is doing
his level best to keep the machine well oiled.
“We have aggressive plans,
as does [IOC host broadcaster] OBS, to make this the most immersive experience
for fans especially since so many can’t come to the games,” Mazza says. “My
main job as we approach the games is trying to predict when the train is going
to go off the track and bump it back on before there’s an actual wreck. You’ve
got to be ready to minimize the damage.”
Other than the not
inconsiderable challenge of meeting Covid protocols, the biggest logistical
shift sees NBC relocating 400 staff and a number of venue control rooms back
home. These are the control rooms for basketball, beach volleyball, diving,
golf and tennis.
With Stamford already
utilizing all eight control rooms, four mobile units have been docked on site.
Then, to make sure everyone is socially distanced, NBC also moved three
dayparts out: one to Telemundo Center in Miami from where Telemundo Deportes is
presented; another to 30 Rockefeller Plaza in Manhattan and another daypart to
CNBC in Englewood Cliffs, NJ. A further 150 people working on digital editorial
are set-up in a hotel near the Stamford HQ.
Nonetheless, in Japan the number of NBC crew including freelancers is
still around 1600.
From SDI to IP for UHD
As if the shifting sands of
Covid weren’t enough, NBC is undertaking a key technical upgrade too. It is
finally retiring the SDI router after 15 years and five Games of service and
implementing an IP core at its broadcasting center in Tokyo and Stamford. This
is based on ST 2110 Grass Valley gear, Cisco routers and the same VSN control
system used for the past couple of Games.
“We pretty much gutted all
our RIBs [racks-in-a-box] down to bare metal,” he said. “Our original plan was
to get that IP to settle in for Tokyo as our big step before tackling 4K HDR at
the Beijing Winter Games February 2022.”
Then the pandemic happened.
“We realized there is such a short turnaround [six months] between successive
Games closing and opening ceremonies and that we were not going to be able to
make the shift in time,” Mazza added. “So, we accelerated the HDR 4K shift into
Tokyo.”
HDR is being prioritized by
broadcasters around the world as a step-change in enhancing viewer experience.
It can boost the look of shows regardless of whether they are in SD, HD or 4K.
In NBC’s judgment, it wanted to bring improved content to the home far sooner
than wait for another Games cycle.
NBC could lean on three
years’ worth of Notre Dame football in preparation for HDR at scale. It has
spent a great deal of effort on single stream productions [shooting 1080p and
down-converting to the 99% of the audience still viewing SD] and also on the
round trip process [for graphics, for example] of elements produced in SDR,
upLUTed to HDR, and downLUTed to SDR.
“HDR is tricky stuff,”
Mazza says. “There’s a lot of ways to screw it up if you don’t convert it
properly. But after all the work that’s gone into the LUT conversion for round
tripping, we think we’re in a good place.”
The Notre Dame coverage
enabled NBCU to experiment with different LUTs for up and down conversion. This
was based on OBS’ HLG LUTs (aka “look-up tables,” which help color grade
footage) which the Olympic broadcaster shared with NBC. After some adjustments
the broadcaster arrived at “NBC LUTs” which it recently offered to the
industry.
“We’re using both OBS’ and
our LUTs for our HDR coverage depending on how it best fits our workflow,”
Mazza explains. “The main OBS idea that we preserved was leaving more room for
highlights in SDR. It means we have some latitude in the down-conversion for
those HDR highlights which we think enhances the SDR signal.”
At the venues
The key events for the
domestic primetime audience are the ceremonies, athletics, gymnastics,
swimming, diving and beach volleyball. While switching for the latter two moved
home, the rest remain in Tokyo.
At those primetime venues
NBC is fielding crews of 80-100 while NBC’s setup at the International
Broadcast Centre is home to the program tech leaders and decision makers. All
unilateral NBC feeds plus host material is aggregated at the IBC for transfer
as 1080P HDR over 8x10Gig pipes to Stamford which then becomes the U.S.
aggregation point for onward distribution to Telemundo, CNBC and 30Rock.
Mazza explains, “At the
venue we book a video split of an OBS camera feed [such as super slo-mo] into
our switcher. In Stamford they record all the OBS host feeds and some
multi-clips [such as super slo-mos that didn’t go to air] running in parallel
to the live feed. Our digital and social teams can dive into that extra
content.”
This includes bespoke
content for Amazon Twitch such as primetime sidecasting, where Twitch creators
will commentate on the live events, encouraging viewers to tune in for NBC's live
coverage at the same time.
The scheduling and time
zones (Tokyo is 16 hours ahead of L.A.) works for showing swimming and
athletics live in primetime but for some sports—like gymnastics which attracts
a huge audience—quick turnaround edits (2-3 hours) will be made at the venue.
Additional edit suites in Tokyo and Stamford will craft feature programming.
Its presentation of the
Games’ opening ceremonies will offer a hint of that: On Friday, July 23, NBC
will offer a first—a live morning broadcast of the opening spectacle, starting
at 6:55 a.m., followed by a special broadcast of “Today” and a daytime Olympic
program. There will also be a traditional primetime broadcast.
“OBS coverage is fabulous
but as always we’ll supplement their cameras at those five big prime time
venues with 8-12 of our own in order to tell the U.S. story,” Mazza said. “For
the other 25 sports we’ll augment the host feed with a 'mix zone camera' typically transmitting via
a LiveU unit. The only announcers on site will be those for the bigger sports.
Back in Stamford there are 30 announce booths for calling the other sports.”
NBC will further augment
coverage by accessing Content+, a web-based platform primarily dedicated to
short-form and digital content. This EVS-based server system and MAM houses
ISOs, non-aired shots and specific angles plus archive of previous Olympics.
“Over the years we’ve
worked with OBS so that when they publish a clip to Content+ it alerts our MAM
and our system then requests that clip and pulls it over,” Mazza says. “They
are not the same system but they are pretty well tied together. For example, in
our MAM we might have a logger doing subjective logging [e.g pointing out that
Michael Phelps’ mom is in the crowd] but we have also integrated OBS’ EVS logs
so we don’t need to duplicate that effort.”
Home run to Connecticut
All of the broadcast
circuits are lightly compressed back to Stamford in J2k while NBC will use OBS
MPEG-4 feeds for monitoring.
“If we can afford the 2-5
second latency to trade for higher picture quality it’s Long GOP MPEG-4,” Mazza
said, referring to the format that uses a mixture of inter- and intra-coding.
For monitoring where we care more about latency—such as for our announcers—it’s
a lower bitrate MPEG-4. I think we’ll all be shifting to HEVC for UHD
deliverables but most of the HD is MPEG-4 today.”
In event of failure, NBC
has a “belt and braces” safety net with four fibre paths carrying 215 HD feeds
back to the US, managed by AT&T. If a massive series of undersea
earthquakes knocked them all out (unlikely), then line cuts of the main cable
and primetime shows are available via satellite.
“Because the risk of
failing is too great for our primetime shows, we also have the ‘lifeboat’ of a
small coax router,” Mazza says. “The IP network is fully redundant but in the
event of any problem we have a coax back-up.”
All told, NBCU is expected
to broadcast and stream around 7,000 hours of Olympics coverage.
It’s a battle out there
Mazza says his biggest fear
is not having the right expert in the right place at the right time. “There are
a handful of people who understand how IP works. We have to get them to the
right place where the problem is. That is daunting with all the Covid
regulations in place.”
Nonetheless, he says he
enjoys the challenge. “We’re taking a whole bunch of finicky kit halfway round
the world, setting it up in a hurry and getting 1,200 freelancers who arrive
just a week before the Games up to speed on how to operate it. Then having it
run at peak performance on the night of the opening ceremony and for the 16-day
marathon after that. It’s incredibly gratifying when all those pieces come
together at exactly the right time to make the program.”
Mazza describes the process
of going into battle.
“I tell my crew, lots of
stuff is going to go wrong. Don’t spend time lamenting the problem. We need to
react and figure it out so it doesn’t burn us again. Work the problem, don’t
look back. Fix it and get back on the air.”