NAB Show 2019

This year the NAB Show seemed to emphasize its roots – the “B” in National Association of Broadcasters. Gone or barely visible were the fads of past years, such as stereoscopic 3D, 360-degree video, virtual/augmented reality, drones, etc. Not that these are gone – merely that they have refocused on the smaller segment of marketshare that reflects reality. There’s not much point in promoting stereo 3D at NAB if most of the industry goes ‘meh’.

Big exhibitors of the past, like Quantel, RED, Apple, and Autodesk, are gone from the floor. Quantel products remain as part of Grass Valley (now owned by Belden), which is the consolidation of Grass Valley Group, Quantel, Snell & Wilcox, and Philips. RED decided last year that small, camera-centric shows were better venues. Apple – well, they haven’t been on the main floor for years, but even this year, there was no off-site, Final Cut Pro X stealth presence in a hotel suite somewhere. Autodesk, which shifted to a subscription model a couple of years ago, had a demo suite in the nearby Renaissance Hotel, focusing on its hero product, Flame 2020. Smoke for Mac users – tough luck. It’s been over for years.

This was a nuts-and-bolts year, with many exhibits showing new infrastructure products. These appeal to larger customers, such as broadcasters and network facilities. Specifically the world is shifting to an IP-based infrastructure for signal routing, control, and transmission. This replaces copper and fiber wiring of the past, along with the devices (routers, video switchers, etc) at either end of the wire. Companies that might have appeared less relevant, like Grass Valley, are back in a strong sales position. Other companies, like Blackmagic Design, are being encouraged by their larger clients to fulfill those needs. And as ever, consolidation continues – this year VizRT acquired NewTek, who has been an early player in video-over-IP with their proprietary NDI protocol.

Adobe

The NAB season unofficially started with Adobe’s pre-NAB release of the CC2019 update. For editors and designers, the hallmarks of this update include a new, freeform bin window view and adjustable guides in Premiere Pro and content-aware, video fill in After Effects. These are solid additions in response to customer requests, which is something Adobe has focused on. A smaller, but no less important feature is Adobe’s ongoing effort to improve media performance on the Mac platform.

As in past years, their NAB booth was an opportunity to present these new features in-depth, as well as showcase speakers who use Adobe products for editing, sound, and design. Part of the editing team from the series Atlanta was on hand to discuss the team’s use of Premiere Pro and After Effects in their ‘editing crash pad’.

Avid

For many attendees, NAB actually kicked off on the weekend with Avid Connect, a gathering of Avid users (through the Avid Customer Association), featuring meet-and-greets, workshops, presentations, and ACA leadership committee meetings. While past product announcements at Connect have been subdued from the vantage of Media Composer editors, this year was a major surprise. Avid revealed its Media Composer 2019.5 update (scheduled for release the end of May). This came as part of a host of many updates. Most of these apply to companies that have invested in the full Avid ecosystem, including Nexis storage and Media Central asset management. While those are superb, they only apply to a small percentage of the market. Let’s not forget Avid’s huge presence in the audio world, thanks to the dominance of Pro Tools – now with Dolby ATMOS support. With the acquisition of Euphonix years back, Avid has become a significant player in the live and studio sound arena. Various examples of its S-series consoles in action were presented.

Since I focus on editing, let me discuss Media Composer a bit more. The 2019.5 refresh is the first major Media Composer overhaul in years. It started in secret last year. 2019.5 is the first iteration of the new UI, with more to be updated in coming releases. In short, the interface has been modernized and streamlined in ways to attract newer, younger users, without alienating established editors. Its panel design is similar to Adobe’s approach – i.e. interface panels can be docked, floated, stacked, or tabbed. Panels that you don’t want to see may be closed or simply slid to the side and hidden. Need to see a hidden panel again? Simply side it back open from the edge of the screen.

This isn’t just a new skin. Avid has overhauled the internal video pipeline, with 32-bit floating color and an uncompressed DNx codec. Project formats now support up to 16K. Avid is also compliant with the specs of the Netflix Post Alliance and the ACES logo program.

I found the new version very easy to use and a welcomed changed; however, it will require some adaptation if you’ve been using Media Composer for a long time. In a nod to the Media Composer heritage, the weightlifter (aka ‘liftman’) and scissors icons (for lift and extract edits) are back. Even though Media Composer 2019.5 is just in early beta testing, Avid felt good enough about it to use this version in its workshops, presentations, and stage demos.

One of the reasons to go to NAB is for the in-person presentations by top editors about their real-world experiences. No one can top Avid at this game, who can easily tap a host of Oscar, Emmy, BFTA, and Eddie award winners. The hallmark for many this year was the presentation at Avid Connect and/or at the show by the Oscar-winning picture and sound editing/mixing team for Bohemian Rhapsody. It’s hard not to gather a standing-room-only crowd when you close your talk with the Live Aid finale sequence played in kick-ass surround!

Blackmagic Design

Attendees and worldwide observers have come to expect a surprise NAB product announcement out of Grant Petty each year and he certainly didn’t disappoint this time. Before I get into that, there were quite a few products released, including for IP infrastructures, 8K production and post, and more. Blackmagic is a full spectrum video and audio manufacturer that long ago moved into the ‘big leagues’. This means that just like Avid or Grass Valley, they have to respond to pressure from large users to develop products designed around their specific workflow needs. In the BMD booth, many of those development fruits were on display, like the new Hyperdeck Extreme 8K HDR recorder and the ATEM Constellation 8K switcher.

The big reveal for editors was DaVinci Resolve 16. Blackmagic has steadily been moving into the editorial space with this all-in-one, edit/color/mix/effects/finishing application. If you have no business requirement for – or emotional attachment to – one of the other NLE brands, then Resolve (free) or Resolve Studio (paid) is an absolute no-brainer. Nothing can touch the combined power of Resolve’s feature set.

New for Resolve 16 is an additional editorial module called the Cut Page. At first blush, the design, layout, and operation are amazingly similar to Apple’s Final Cut Pro X. Blackmagic’s intent is to make a fast editor where you can start and end your project for a time-sensitive turnaround without the complexities of the Edit Page. However, it’s just another tool, so you could work entirely in the Cut Page, or start in the Cut Page and refine your timeline in the Edit Page, or skip the Cut Page all together. Resolve offers a buffet of post tools that are at your disposal.

While Resolve 16’s Cut Page does elicit a chuckle from experienced FCPX users, it offers some new twists. For example, there’s a two-level timeline view – the top section is the full-length timeline and the bottom section is the zoomed-in detail view. The intent is quick navigation without the need to constantly zoom in and out of long timelines. There’s also an automatic sync detection function. Let’s say you are cutting a two-camera show. Drop the A-camera clips onto the timeline and then go through your B-camera footage. Find a cut-away shot, mark in/out on the source, and edit. It will ‘automagically’ edit to the in-sync location on the timeline. I presume this is matched by either common sound or timecode. I’ll have to see how this works in practice, but it demos nicely. Changes to other aspects of Resolve were minor and evolutionary, except for one other notable feature. The Color Page added its own version of content-aware, video fill.

Another editorial product addition – tied to the theme of faster, more-efficient editing – was a new edit keyboard. Anyone who’s ever cut in the linear days – especially those who ran Sony BVE9000/9100 controllers – will feel very nostalgic. It’s a robust keyboard with a high-quality, integrated jog/shuttle knob. The feel is very much like controlling a tape deck in a linear system, with fast shuttle response and precise jogging. The precision is far better than any of the USB controllers, like a Contour Shuttle. Whether or not enough people will have interest in shelling out $1,025 for it awaits to be seen. It’s a great tool, but are you really faster with one, than with FCPX’s skimming and a standard keyboard and mouse?

Ironically, if you look around the Blackmagic Design booth there does seem to be a nostalgic homage to Sony hardware of the past. As I said, the edit keyboard is very close to a BVE9100 keyboard. Even the style of the control panel on the Hyperdecks – and the look of the name badges on those panels – is very much Sony’s style. As humans, this appeals to our desire for something other than the glass interfaces we’ve been dealing with for the past few years. Michael Cioni (Panavision, Light Iron) coined this as ‘tactile attraction’ in his excellent Faster Together Stage talk. It manifests itself not only in these type of control surfaces, but also in skeuomorphic designs applied to audio filter interfaces. Or in the emotion created in the viewer when a colorist adds film grain to digital footage.

Maybe Grant is right and these methods are really faster in a pressure-filled production environment. Or maybe this is simply an effort to appeal to emotion and nostalgia by Blackmagic’s designers. (Check out Grant Petty’s two-hour 2019 Product Overview for more in-depth information on Blackmagic Design’s new products.)

8K

I won’t spill a lot of words on 8K. Seems kind of silly when most delivery is HD and even SD in some places. A lot of today’s production is in 4K, but really only for future-proofing. But the industry has to sell newer and flashier items, so they’ve moved on to 8K pixel resolution (7680 x 4320). Much of this is driven by Japanese broadcast and manufacturer efforts, who are pushing into 8K. You can laugh or roll your eyes, but NAB had many examples of 8K production tools (cameras and recorders) and display systems. Of course, it’s NAB, making it hard to tell how many of these are only prototypes and not yet ready for actual production and delivery.

For now, it’s still a 4K game, with plenty of mainstream product. Not only cameras and NLEs, but items like AJA’s KiPro family. The KiPro Ultra Plus records up to four channels of HD or one channel of 4K in ProRes or DNx. The newest member of the family is the KiPro GO, which records up to four channels of HD (25Mbps H.264) onto removable USB media.

Of course, the industry never stops, so while we are working with HD and 4K, and looking at 8K, the developers are planning ahead for 16K. As I mentioned, Avid already has project presets built-in for 16K projects. Yikes!

HDR

HDR – or high dynamic range – is about where it was last year. There are basically four formats vying to become the final standard used in all production, post, and display systems. While there are several frontrunners and edicts from distributors to deliver HDR-compatible masters, there still is no clear path. In you shoot in log or camera raw with nearly any professional camera produced within the past decade, you have originated footage that is HDR-compatible. But none of the low-cost post solutions make this easy. Without the right monitoring environment, you are wasting your time. If anything, those waters are muddier this year. There were a number of HDR displays throughout the show, but there were also a few labelled as using HDR simulation. I saw a couple of those at TV Logic. Yes, they looked gorgeous and yes, they were receiving an HDR signal. I found out that the ‘simulation’ part of the description meant that the display was bright (up to 350 nits), but not bright enough to qualify as ‘true’ HDR (1,000 nits or higher).

As in past transitions, we are certainly going to have to rely on a some ‘glue’ products. For me, that’s AJA again. Through their relationship with Colorfront, AJA offers two FS-HDR products: the HDR Image Analyzer and the FS-HDR convertor. The latter was introduced last year as a real-time frame synchronizer and color convertor to go between SDR and HDR display standards.  The new Analyzer is designed to evaluate color space and gamut compliance. Just remember, no computer display can properly show you HDR, so if you need to post and delivery HDR, proper monitoring and analysis tools are essential.

Cameras

I’m not a cinematographer, but I do keep up with cameras. Nearly all of this year’s camera developments were evolutionary: new LF (large format sensor) cameras (ARRI), 4K camcorders (Sharp, JVC), a full-frame mirrorless DSLR from Nikon (with ProRes RAW recording coming in a future firmware update). Most of the developments were targeted towards live broadcast production, like sports and megachurches.  Ikegami had an 8K camera to show, but their real focus was on 4K and IP camera control.

RED, a big player in the cinema space, was only there in a smaller demo room, so you couldn’t easily compare their 8K imagery against others on the floor, but let’s not forget Sony and Panasonic. While ARRI has been a favorite, due to the ‘look’ of the Alexa, Sony (Venice) and Panasonic (Varicam and now EVA-1) are also well-respected digital cinema tools that create outstanding images. For example, Sony’s booth featured an amazing, theater-sized, LED 8K micro-pixel display system. Some of the sample material shown was of the Rio Carnival, shot with anamorphic lenses on a 6K full-frame Sony Venice camera. Simply stunning.

Finally, let’s not forget Canon’s line-up of cinema cameras, from the C100 to the C700FF. To complement these, Canon introduced their new line of Sumire Prime lenses at the show. The C300 has been a staple of documentary films, including the Oscar-winning film, Free Solo, which I had the pleasure of watching on the flight to Las Vegas. Sweaty palms the whole way. It must have looked awesome in IMAX!

(For more on RED, cameras, and lenses at NAB, check out this thread from DP Phil Holland.)

It’s a wrap

In short, NAB 2019 had plenty for everyone. This also included smaller markets, like products for education seminars. One of these that I ran across was Cinamaker. They were demonstrating a complete multi-camera set-up using four iPhones and an iPad. The iPhones are the cameras (additional iPhones can be used as isolated sound recorders) and the iPad is the ‘switcher/control room’. The set-up can be wired or wireless, but camera control, video switching, and recording is done at the iPad. This can generate the final product, or be transferred to a Mac (with the line cut and camera iso media, plus edit list) for re-editing/refinement in Final Cut Pro X. Not too shabby, given the market that Cinamaker is striving to address.

For those of us who like to use the NAB Show exhibit floor as a miniature yardstick for the industry, one of the trends to watch is what type of gear is used in the booths and press areas. Specifically, one NLE over another, or one hardware platform versus the other. On that front, I saw plenty of Premiere Pro, along with some Final Cut Pro X. Hardware-wise, it looked like Apple versus HP. Granted, PC vendors, like HP, often supply gear to use in the booths as a form of sponsorship, so take this with a grain of salt. Nevertheless, I would guess that I saw more iMac Pros than any other single computer. For PCs, it was a mix of HP Z4, Z6, and Z8 workstations. HP and AMD were partner-sponsors of Avid Connect and they demoed very compelling set-ups with these Z-series units configured with AMD Radeon cards. These are very powerful workstations for editing, grading, mixing, and graphics.

©2019 Oliver Peters

FCP Helpers

Apple Final Cut Pro is generally said to be an 80/20 application, trading off some niche features for a lower price. More often than not, this descriptor is meant in the negative. Avid editors using FCP frequently lament about media management, render files and so on when comparing FCP with Media Composer. Yet, the fact that Apple targets the sweet middle, has left the field open for high-end systems on the Mac, like Avid Symphony, Autodesk Smoke and now, Blackmagic Design DaVinci Resolve. This means advanced systems are available for the tiny market segment that wants them, without the need for Apple to develop a similar application itself.

I tend to view this 80/20 scenario as an opportunity for innovation. Avid, Autodesk, Quantel and others largely handle R&D internally. Although they embrace some openness in the interchange of media and file formats, their core features are typically closed to outside development, unless there’s an applicable SDK or API. Final Cut Pro incorporates a number of open and extensible technologies often available through the OS itself, like XML, QuickTime, Apple Events, Core Image and others. Granted, these are typically Apple-specific and not actual ratified standards, but they do provide a wide open development field for small and large entrepreneurs alike.

These technologies provide a relatively easy path for programmers to create a mix of plug-ins, utilities and applications that augment the native power of FCP. I’ll be the first to admit that I like to have everything inside the application, but the sheer diversity of options exceeds what’s available in the competing systems. For example, if you want Avid-style media management or control of project preferences, there are several different developers who have such solutions. The beauty of this for the user is more control and customization over your system – sort of the “shade tree mechanic” approach to media.

Here is a concise list of most of the companies building useful tools to enhance your Final Cut environment. Unlike effects plug-ins, these solutions are designed to improve productivity, reliability, efficiency and generally make your FCP experience better.

Assisted Editing

Automatic Duck

AV3 Software / GET

Boris FX / XML Transfer / AAF Transfer

Boris FX / MyMusicSource

Digital Heaven

Digital Rebellion

Edit Groove

Edit Mule

Glue Tools

Post Haste

Singular Software / PluralEyes / DualEyes

Smart Sound

Spherico

VideoToolShed

XMEdit / Traffic

XMiL

Update: With this post, the DigitalFilms blog passed 500,000 views, since its launch in March 2008. I’m glad many of you have found it helpful! Thanks.

©2010 Oliver Peters

Tips for Small Camera and Hybrid DSLR Production

blg_cams

It started in earnest last year and has no sign of abating.  Videographers are clearly in the midst of two revolutions: tapeless recording and the use of the hybrid still/video camera (HDSLR). The tapeless future started with P2 and XDCAM, but these storage devices have been joined by other options, including Compact Flash, SD and SDHC memory cards. The acceptance of small cameras in professional operations first took off with DV cameras from Sony and Panasonic, especially the AG-DVX100. These solutions have evolved into cameras like the Sony HVRZ7U and PMWEX3 and Panasonic’s AG-HPX170 and AVCCAM product line. Modern compressed codecs have made it possible to record high-quality 1080 and 720 HD footage using smaller form factors than ever before.

This evolution has sparked the revolution of the HDSLR cameras, like the Canon EOS 5D Mark II, the new Canon EOS 7D and 1D Mark IV and the Nikon D90, D300s and D3s, to name a few. Although veteran videographers might have initially scoffed at such cameras, it’s important to note that Canon developed the 5D at the urging of Reuters and the Associated Press, so its photographers could deliver both stills and motion video with the least hassle. Numerous small films, starting with photographer Vincent Laforet’s Reverie, have more than proven that HDSLRs are up to the task of challenging their video cousins. From the standpoint of a news or sports department, we have entered an era where every reporter can become a video journalist, simply by having a small camera at the ready. That’s not unlike the days when reporters carried a Canon Scoopic 16mm, in case something newsworthy happened.

These cameras come with challenges, so here is some advice that will make your experience more successful:

1. Ergonomics / stability – Both small video camcorders and HDSLRs are designed for handheld, not shoulder-mounted, operation. This isn’t a great design for stability while recording motion. In order to get the best image out of these cameras, invest in an appropriate tripod and fluid head. For more advanced operations, check out the various camera mounting accessories from companies like Zacuto and Red Rock Micro.

2. Rolling shutter – This phenomenon affects all CMOS cameras to varying degrees. It is caused by horizontal movement and results in an image that is skewed. This distortion is caused by the time differential between information at the top and the bottom of the sensor. The HDSLRs have been criticized for these defects, but others like the EX or the RED One have also displayed the same artifacts to a lesser degree. This defect can be minimized by using a tripod and slow (or no) camera movement.

3. Focus – One of the reasons that shooters like HDSLRs is the large image sensor (compared to video cameras) and film lenses, which provide a shallow depth-of-field. This is a mixed blessing when you are covering a one-time event. Still photo zoom lenses aren’t mechanically designed to be zoomed and focused during the shot like film or video zoom lenses. This makes it harder to nail the shot on-the-fly. Since the depth-of-field is shallow, the focus is also less forgiving. Lastly, the focus is often done using an LCD viewer instead of a high-quality viewfinder. Many shooters using both small video cameras and HDSLRs have added an externally-mounted LCD monitor, as a better device for judging shots.

4. Audio – The issue of audio depends on whether we are talking about a Canon 5D or a Panasonic 170. Professional and even prosumer camcorders have been designed to have mics connected. To date, HDSLRs have not. If you are shooting extensive sync-sound projects with a hybrid camera, then you will want to consider using double-system sound with a separate recorder and mixer (human). At the very least, you’ll want to add an XLR mic adapter/mixer, like the BeachTek DXA-5D.

5. Movie files – Each of these cameras records its own specific format, codec and file wrapper. Production and post personnel have become comfortable with P2 and XDCAM, but the NLE manufacturers are still catching up to the best way of integrating consumer AVCHD content or files from these HDSLRs. Regardless of the camera system you plan to use, make sure that the file format is compatible with (or easily transcoded to) your NLE of choice.

6. Capacity – Most of the cameras use a recording medium that is formatted as FAT32. This limits a single file to 4GB, which in the case of the Canon 5D means the longest recording cannot exceed 12 minutes of HD (1920x1080p at 30fps). Unlike P2, there is no spanning provision to extend the length of a single recording. Make sure to plan your shot list to stay within the file limit. Come with enough media. In the case of P2, many productions bring along a “data wrangler” and a laptop. This person will offload the P2 cards to drives and then reformat (erase) the cards so that the crew can continue recording throughout the day with a limited number of P2 cards.

7. Back-up – Always back-up your camera media onto at least two devices in the original file format. I’ve known producers who merely transferred the files to the edit system’s local array and then trashed the camera media, believing the files were safe. Unfortunately, I’ve seen Avids quarantine files, making them inaccessible. On rare occasion, I’ve also seen Final Cut Pro media files simply disappear. The moral of the story is to treat your original camera media like film negative. Make two, verified back-ups and store them in a safe place should you ever need them again.

The new generation of small video camcorders and Hybrid DSLRs offers the tantalizing combination of lower operating cost and stunning imagery. That’s only possible with some care and planning. These tools aren’t right for every application, but the choices will continue to grow in the coming years. Those who embrace the trend will find new and exciting production options.

© 2009 Oliver Peters

Written for NewBay Media and TV Technology magazine

What’s wrong with this picture?

blg_whatswrong

“May you live in interesting times” is said to be an ancient Chinese curse. That certainly describes modern times, but no more so than in the video world. We are at the intersection of numerous transitions: analog to digital broadcast; SD to HD; CRTs to LCD and plasma displays; and tape-based to file-based acquisition and delivery. Where the industry had the chance to make a clear break with the past, it often chose to integrate solutions that protected legacy formats and infrastructure, leaving us with the bewildering options that we know today.

 

Broadcasters settled on two standards: 720p and 1080i. These are both full-raster, square pixel formats: 1280x720p/59.94 (60 progressive frames per seconds in NTSC countries) – commonly known as “60P” – and 1920x1080i/59.94 (60 interlaced fields per second in NTSC countries) – commonly known as “60i”. The industry has wrestled with interlacing since before the birth of NTSC.

 

Interlaced scan

 

Interlaced displays show a frame as two sequential sets of alternating odd and even-numbered scan lines. Each set is called a field and occurs at 1/60th of a second, so two fields make a single full-resolution frame. Since the fields are displaced in time, one frame with fast horizontal motion will appear like it has serrated edges or horizontal lines. That’s because odd-numbered scan lines show action that occurred 1/60th of a second apart from the even-numbered, adjacent scan lines. If you routinely move interlaced content between software apps, you have to careful to maintain proper field dominance (whether edits start on field 1 or field 2 of a frame) and field order (whether a frame is displayed starting with odd or even-numbered scan lines).

 

Progressive scan

 

A progressive format, like 720p, displays a complete, full-resolution frame for each of 60 frames per second. All scan lines show action that was captured at the exact same instance in time. When you combine the spatial with the temporal resolution, the amount of data that passes in front of a viewer’s eyes in one second is essentially the same for 1080i (about 62 million pixels) as for 720p (about 55 million pixels).

 

Progressive is ultimately a better format solution from the point-of-view of conversions and graphics. Progressive media scales more easily from SD to HD without the risk of introducing interlace errors that can’t be corrected later. Graphic and VFX artists also have a better time with progressive media and won’t have issues with proper field order, as is so often the case when working with NTSC or even 1080i. The benefits of progressive media apply regardless of the format size or frame rate, so 1080p/23.98 offers the same advantages.

 

Outside of the boundary lines

 

Modern cameras, display systems and NLEs have allowed us to shed a number of boundaries from the past. Thanks to Sony and Laser Pacific, we’ve added 1920x1080psf/23.98. That’s a “progressive segmented frame” running at the video-friendly rate of 23.98 for 24fps media. PsF is really interlacing, except that at the camera end, both fields are captured at the same point in time. PsF allows the format to be “superimposed” onto an otherwise interlaced infrastructure with less impact on post and manufacturing costs.

 

Tapeless cameras have added more wrinkles. A Panasonic VariCam records to tape at 59.94fps (60P), even though you are shooting with the camera set to 23.98fps (24P). This is often called 24-over-60. New tapeless Panasonic P2 camcorders aren’t bound by VTR mechanisms and can record a file to the P2 recording media at any “native” frame rate. To conserve data space on the P2 card, simply record at the frame rate you need, like 23.98pn (progressive, native) or 29.97pn. No need for any redundant frames (added 3:2 pulldown) to round 24fps out to 60fps as with the VariCam.

 

I’d be remiss if I didn’t address raster size. At the top, I mentioned full-raster and square pixels, but the actual video content recorded in the file cheats this by changing the size and pixel aspect ratio as a way of reducing the data rate. This will vary with codec. For example, DVCPRO HD records at a true size of 960×720 pixels, but displays as 1280×720 pixels. Proper display sizes of such files (as compared with actual file sizes) are controlled by the NLE software or a media player application, like QuickTime.

 

Mixing it up

 

Editors routinely have to deal with a mix of frame rates, image sizes and aspect ratios, but ultimately this all has to go to tape or distribution through the funnel of the two accepted HD broadcast formats (720p/59.94 and 1080i/59.94). PLUS good old fashioned NTSC and/or PAL. For instance, if you work on a TV or film project being mastered at 1920x1080p/23.98, you need to realize several things: few displays support native 23.98 (24P) frame rates. You will ultimately have to generate not only a 23.98p master videotape or file, but also “broadcast” or “air” masters. Think of your 23.98p master as a “digital internegative”, which will be used to generate 1080i, 720p, NTSC, PAL, 16×9 squeezed, 4×3 center-cut and letterboxed variations.

 

Unfortunately your NLE won’t totally get you there. I recently finished some spots in 1080p/23.98 on an FCP system with a KONA2 card. If you think the hardware can convert to 1080i output, guess again! Changing FCP’s Video Playback setting to 1080i is really telling the FCP RT engine to do this in software, not in hardware. The ONLY conversions down by the KONA hardware are those available in the primary and secondary format options of the AJA Control Panel. In this case, only the NTSC downconversion gets the benefit of hardware-controlled pulldown insertion.

 

OK, so let FCP do it. The trouble with that idea is that yes, FCP can mix frame rates and convert them, but it does a poor job of it. Instead of the correct 2:3:2:3 cadence, FCP uses the faster-to-calculate 2:2:2:4. The result is an image that looks like frames are being dropped, because the fourth frame is always being displayed twice, resulting in a noticeable visual stutter. In my case, the solution was to use Apple Compressor to create the 1080i and 720p versions and to use the KONA2’s hardware downconversion for the NTSC Beta-SP dubs. Adobe After Effects also functions as a good, software conversion tool.

 

Another variation to this dilemma is the 720pn/29.97 (aka 30PN) of the P2 cameras. This is an easily edited format in FCP, but it deviates from the true 720p/59.94 standard. Edit in FCP with a 29.97p timeline, but when you change the Video Playback setting to 59.94, FCP converts the video on-the-fly to send a 60P video stream to the hardware. FCP is adding 2:2 pulldown (doubling each frame) to make the signal compliant. Depending on the horsepower of your workstation, you may, in fact, lower the image resolution by doing this. If you are doing this for HD output, it might actually be better to convert or render the 29.97p timeline to a new 59.94p sequence prior to output, in order to maintain proper resolution.

 

Converting to NTSC

 

But what about downconversion? Most of the HD decks and I/O cards you buy have built-in downconversion, right? You would think they do a good job, but when images are really critical, they don’t cut it. Dedicated conversion products, like the Teranex Mini do a far better job in both directions. I delivered a documentary to HBO and one of the items flagged by their QC department was the quality of the credits in the downconverted (letterboxed) Digital Betacam back-up master. I had used rolling end credits on the HD master, so I figured that changing the credits to static cards and bumping up the font size a bit would make it a lot better. I compared the converted quality of these new static HD credits through FCP internally, through the KONA hardware and through the Sony HDW-500 deck. None of these looked as crisp and clean as simply creating new SD credits for the Digital Betacam master. Downconverted video and even lower third graphics all looked fine on the SD master – just not the final credits.

 

The trouble with flat panels

 

This would be enough of a mess without display issues. Consumers are buying LCDs and plasmas. CRTs are effectively dead. Yet, CRTs are the only device to properly display interlacing – especially if you are troubleshooting errors. Flat panels all go through conversions and interpolation to display interlaced video in a progressive fashion. Going back to the original 720p versus 1080i options, I really have to wonder whether the rapid technology change in display devices was properly forecast. If you shoot 1080p/23.98, this often gets converted to a 1080i/59.94 broadcast master (with added 3:2 pulldown) and is transmitted to your set as a 1080i signal. The set converts the signal. That’s the best case scenario.

 

Far more often, the production company, network and local affiliate haven’t adopted the same HD standard. As a result, there may be several 720p-to-1080i and/or 1080i-to-720p that happen along the way. To further complicate things, many older consumer sets are native 720p panels and scale a 1080 image. Many include circuitry to remove 3:2 pulldown and convert 24fps programs back to progressive images. This is usually called the “film” mode setting. It generally doesn’t work well with mixed-cadence shows or rolling/crawling video titles over film content.

 

The newest sets are 1080p, which is a totally bogus marketing feature. These are designed for video game playback and not TV signals, which are simply frame-doubled. All of this mish-mash – plus the heavy digital compression used in transmission – makes me marvel at how bad a lot of HD signals look in retail stores. I recently saw a clip from NBC’s Heroes on a large 1080p set at a local Sam’s Club. It was far more pleasing to me on my 20” Samsung CRT at home, received over analog cable, than on the big 1080p digital panel.

 

Progress (?) marches on…

 

We can’t turn back time , of course, but my feeling about displays is that a 29.97p (30P) signal is the “sweet spot” for most LCD and plasma panels. In fact, 720p on most of today’s consumer panel looks about the same as 1080i or 1080p. When I look at 23.98 (24P) content as 29.97 (24p-over-60i), it looks proper to my eyes on a CRT, but a bit funky on an LCD display. On the other hand 29.97 (30P) strobes a bit on a CRT, but appears very smooth on a flat panel. Panasonic’s 720p/59.94 looks like regular video on a CRT, but 720p recorded as 30p-over-60p looks more film-like. Yet both signals actually look very similar on a flat panel. This is likely due to the refresh rates and image latency in an LCD or plasma panel as compared to a CRT. True 24P is also fine if your target is the web. As a web file it can be displayed as true 24fps without pulldown. Remember that as video, though, many flat panels cannot display 23.98 or 24fps frame rates without pulldown being added.

 

Unfortunately there is no single, best solution. If your target distribution is for the web or primarily to be viewed on flat panel display devices (including projectors), I highly recommend working strictly in a progressive format and a progressive timeline setting. If interlacing is involved, them make sure to deinterlace these clips or even the entire timeline before your final delivery. Reserve interlaced media and timelines for productions that are intended predominantly for broadcast TV using a 480i (NTSC) or 1080i transmission.

 

By now you’re probably echoing the common question, “When are we going to get ONE standard?” My answer is that there ARE standards – MANY of them. This won’t get better, so you can only prepare yourself with more knowledge. Learn what works for your system and your customers and then focus on those solutions – and yes – the necessary workarounds, too!

 

Does your head hurt yet?

 

© 2009 Oliver Peters

Adobe Creative Suite 4 – A First Look

Hot on the heals of last year’s huge Adobe software release, the company has quickly turned around another batch of impressive updates in its new Creative Suite 4 line-up. Once again, these products can be purchased individually or as part of various collections for web, video and print. Plus the all-in-one Master Collection. All CS4 products will ship by the end of Q4 2008. The Creative Suite family constitutes major growth for Adobe, which expects to ship approximately 500,000 pieces of just the video portion of this software to over 300,000 customers by the end of 2008.

 

I’ll focus my comments on Adobe Creative Suite 4 Production Premium – the collection for video professionals. Its main applications include Premiere Pro, After Effects, Photoshop Extended, Illustrator, Flash Professional, Encore, OnLocation and Soundbooth. In addition, there are also other utilities designed to aid your workflow, such as Bridge, Device Central, Dynamic Link and Adobe Media Encoder.

 

Common feature enhancements

 

Going into depth on each application in the collection would require the entire magazine, so I’ll stick to the highlights. Across the board, Adobe has concentrated on several big improvements and additions between CS3 and CS4. These include user interface changes, searchable metadata based on XMP support and speech-to-text technology. The user interfaces of the various applications continue to move closer to a common Adobe layout. This tabbed workspace design is most completely implemented in Premiere Pro, After Effects and Soundbooth. Most of the applications have gained search fields that operate like Apple’s Spotlight. Typing information into the search field of a Premiere Pro bin will filter the displayed contents to match your criteria. In After Effects, for example, you can filter timeline layers to only display tracks where the object’s position has been altered, simply by typing “position” into the search field. Most of the applications have been metadata-enabled so meaningful descriptions, titles, keywords and copyright information can be captured and embedded into files using open source XMP technology.

 

Both Premiere Pro and Soundbooth have added a powerful, new speech recognition technology called Speech Search to automatically transcribe dialogue into searchable text. After the transcription process is complete, simply click on a word in the generated text (now part of the clip’s metadata) and the media file will instantly cue to the corresponding point. It’s a great technology, but I was less than satisfied with the accuracy of the automatic transcription. I picked one of Adobe’s demo clips (an interview with cinematographer Rob Legato) and had Soundbooth create a transcription. Legato speaks quickly but clearly, however the accuracy was only about 50% and turned such phrases as “a short shooting schedule” into “the court shaving scandal”. The latter might make for an interesting movie plot, but I wonder whether the time required to edit a transcription is too great of an offset to effectively use this feature on a real project. The accuracy was better on a different test file, but still at least 25% of the phrases were incorrect. In spite of that, Speech Search seems like a very useful tool for documentary editors. In fact, even some Avid editors have theorized that you could use Soundbooth CS4 to create transcriptions that in turn could be imported into Avid Media Composer for use with their

ScriptSync feature.

 

Aside from Speech Search, the biggest new product feature in Adobe Premiere Pro CS4 and After Effects CS4 is the native support for various tapeless camera formats. You can natively edit content from Panasonic P2 (DVCPRO, DVCPRO HD and AVC-Intra), Sony XDCAM-HD and XDCAM-EX media without transcoding or rewrapping. Premiere Pro can access the metadata for these clips and edit directly from the cards or use its built-in Media Browser to transfer the media to your local media drives for better performance. Running Premiere Pro CS4 on a dual-core 2.8 GHz iMac was a pleasure. Native 720p/23.98 DVCPROHD clips (imported from P2) played smoothly and JKL transport controls were very responsive even on media playing from the internal drive.

 

Although not technically part of this release, Adobe is currently working with RED Digital Cinema to develop a plug-in that would enable Premiere Pro and After Effects users to natively edit with RED’s .R3D camera raw files. You can see demos of how this will work at Dave Helmly’s blog. Adobe recognizes the potential of a raw workflow and plans to give editors access to debayering, gamma, ISO and white balance controls within their software.

 

The biggest changes

 

The most radical change in the Production Premium bundle is Adobe OnLocation CS4. The interface has been “Adobe-ized” and no longer sports the appearance of physical test gear installed in a rack. It now runs on both Macs and PCs and operates as the front-end, direct-to-disk recorder for an integrated end-to-end Adobe workflow. As before, it turns your desktop or laptop into a recording station, complete with monitor (your screen) and software scopes, but now features better clip management and the ability to add metadata to clips. DV and HDV cameras connected via FireWire work with OnLocation.

 

Soundbooth CS4 has evolved from a two-track to multi-track audio tool. Adobe does not view Soundbooth as a DAW competitor. It offers Audition (only sold individually) for those customers. Instead, Soundbooth CS4 is designed as a “helper” application to be used with Premiere Pro by video editors or Flash Professional by web developers. Soundbooth is designed as a less complex, task-based application for audio recording, editing, clean-up, mixing and music production. Although you can drill down into the effect filters and make custom adjustments, Soundbooth groups its processes by tasks with default presets. There are a decent set of tools for two-track audio production, similar to what you might find in BIAS Peak Pro or Sony Sound Forge. These are augmented with music composition tools using Adobe’s royalty-free scores. You can purchase new scores from Adobe’s Resource Central website, as well as download a wealth of free sound effects. Score creation with Soundbooth CS4 is similar to using Smart Sound’s Sonic Fire Pro, letting you tailor the length and arrangement of the score to your video. Now with multi-track support, you can mix dialogue, music and effects within Soundbooth CS4. A video editor will find Soundbooth CS4 useful for its clean-up and music tools, but a web producer would potentially do 100% of the audio production for a Flash website or a podcast with Soundbooth CS4.

 

The rest of the collection

 

Changes in the other applications might seem less dramatic depending on your needs. Photoshop CS4 Extended has gained 3D layer support. For the first time, you can import 3D objects into Photoshop. These can be manipulated in 3D space, including the ability to add textures, paint and make color modification. After Effects CS4 supports these 3D layers and also gained numerous enhancements. It includes a new built-in cartoon effect and comes bundled with Imagineer Systems’ Mocha for After Effects 2.5D planar motion tracking application.

 

Video layers were added last year to Photoshop CS3 Extended, so CS4 makes Photoshop an even more powerful tool for motion graphics of all types. Even the basic version offers more power than most video editors use, so I wish Adobe would offer a cheaper version with features that fit between Photoshop Elements and Photoshop CS4. I’m also surprised that Adobe hasn’t developed natural media painting features in Photoshop. This still seems to be an area left solely to Corel Painter.

 

In the past, you had to access the Adobe Media Encoder through Premiere Pro, but it is now included as a standalone application. It includes presets for all the popular media options (MPEG2, H264, iPod, Flash, etc.) and is one of the cleanest encoders I’ve used. I think you’ll find it a worthy rival for Apple Compressor, Sorenson Squeeze or Telestream Episode.

 

Although Flash CS4 Professional is part of this video bundle, you can now generate a Flash project directly from After Effects. Flash CS4 Professional received a total makeover with a timeline more like After Effects, but if you’re still more comfortable working in After Effects, then start there and later export to Flash CS4 Professional for completion. Another Adobe application that works with Flash is Encore. As in CS3, the updated CS4 version lets you author standard DVDs, Flash projects and Blu-ray high-def DVDs from a single project file. The CS3 version limited the Flash projects to 640×480 window sizes, but this limitation has been lifted in CS4. Now interactive Flash projects created in Encore can be designed in up to HD window sizes. Speaking of interactivity, Adobe is touting better Blu-ray authoring in Encore, though no BD-J authoring. I had no way to test this, but Blu-ray authoring is not yet a mature process. There have been compatibility issues with early players and Adobe has posted a number of trouble-shooting suggestions online. Since Blu-ray is an evolving technology, do your research if the sole interest in this software is to create Blu-ray DVDs.

 

More tools for your tool chest

 

As in the past, this collection is one of the most comprehensive “studio” bundles with a price that bests the competition in value. If you’re an Adobe fan, CS4 is a worthy upgrade. If you rely on Apple Final Cut Pro or Avid Media Composer for editing, Adobe is betting that there are enough essential applications in the bundle to make it worth your while just to pick up the whole package. Photoshop and After Effects are integral tools for most editors and Encore continues as a powerful, yet low-cost DVD authoring tool, so right there in three applications, you have paid for all the rest.

 

Adobe is a company that’s neutral in many of the big platform debates. They sell software and don’t have a vested interest in selling hardware. As such, there’s plenty of third party hardware and plug-in support to make Premiere Pro attractive to first time NLE users or switchers from other systems. With integrated metadata support, native operation with the most popular tapeless cameras and the ability to export to just about every one of today’s popular media formats, Adobe Creative Suite 4 Production Premium is a package you’ll want to add to your system.

 

Written by Oliver Peters for Videography magazine and NewBay Media, LLC.