Developed online editor!What is "WipetRacker", a service that automatically analyzes the performer's wipe video with AI?

"Reaction Wipe" video that captures the facial expressions of the performers in a small window, which is indispensable for TV variety and information programs. Until now, all of the performers have been cut out manually from camera footage and processed. WipeTraker is a service that can automatically recognize and track the face of a person from the shooting material by automatic processing by AI.

"The process of wiping is a simple task of manually hitting keyframes and cutting out the performer's face. Conventionally, wiping a TV program requires 6 to 8 frames per hour. It was necessary to keep track of the time.For a two-hour program, it would take from morning to midnight.From the people who actually used it, one person could do the two-person system, and the work time was shortened. It has been well received.”

That's what Shigeyuki Koeda of G-CaL Co., Ltd., who provides the service said. After working in post-production, Koeda has been active as an online editor even after becoming independent, and he himself has been searching for ways to improve the efficiency of his workflow on a daily basis while working as an editor himself. Since he originally had programming knowledge, G-CaL is developing a video production support service that utilizes programming. WipeTracker started service in July this year, and has already been introduced in Golden programs. Recently, there are many special programs that are 3 or 4 hours long, so it is said that they are being favorably received at the site.

Features of WipeTracker

WipeTracker reads video files into dedicated software developed by Koeda, recognizes the performers' faces simply by analyzing them, and places them in the center of the screen every 10 frames. are doing As shown in the photo below, if the face is hidden by movement in the front, back, left and right, clapping, etc., it can be tracked even if the face is turned sideways with a mask on.

In addition, even if multiple performers are captured by one camera, it is possible to track them individually. There is no upper limit on the number of people, and the analysis results line up tracks for each person.

The parsed data will be delivered in xml or Premiere project file. When you open it in Premiere Pro, the analyzed data has an "anchor point" keyframe set every 10 frames. "Scale" is corrected so that the size of the face is constant for forward and backward movements, and a key frame is struck every 5 seconds.

How to use WipeTracker

There are three ways to use WipeTracker. The main client is expected to be a TV program production company. The usage fee for the service starts at 30,000 yen per hour of broadcasting. +10,000 yen for on-site analysis. You can apply using a dedicated form from the WipeTracker website. Currently, we are running a campaign of 10,000 yen per hour for the first trial (first 10 people).

After offline editing, put the material in storage and mail it, and return it after analysis. Or go to the site, analyze it, and deliver it as an xml or Premiere Pro project file on the spot.

Analyze material after studio recording and deliver as xml or Premiere Pro project file.

After offline editing, export the video file (mp4 or ProRes) and send it to online storage. After analysis, it is delivered as a Premiere sequence.

"As an online editor myself, I decided to develop this service when I made wipe adjustments for a 5-hour program. We should spend as little time as possible on this work and improve efficiency with the power of AI. If we were to spend the same amount of money and time, I think it would be better to spend more creative work such as program composition and design.I would like many program producers to use it.

●About service details and where to apply

https://gcal.jp/wipetracker/