Extracting fluid from a video for efficient post-production

Makoto Okabe*, Ken Anjyo, Rikio Onai

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)


We propose a method to extract fluids from a video that is captured outside a special studio. Since such a video usually has a complex background and the fluids overlap with much transparency, it is a difficult, time-consuming task for a designer to extract them. Our goal is to develop an efficient method to solve the problem: we estimate the background of an input video, and then compute the foreground and alpha matte at each frame. Our method estimates the background by observing only pixels that have little motion at each frame. Given the estimated background, we estimate an initial alpha matte based on the color difference at every pixel between each frame and the estimated background. Since the initial alpha matte usually includes many artifacts, we employ the gradient-domain image processing approach to refine it: our method attenuates unrequired gradients adequately, and then integrate them to recover the refined alpha matte. The foreground, which explains about the color and texture pattern of the fluid itself, is also estimated in a similar manner. We demonstrate that our method enables to extract the fluids from a video, which were difficult to achieve using the previous methods.

Original languageEnglish
Title of host publicationProceedings - Digital Production Symposium 2012, DigiPro 2012
Number of pages6
Publication statusPublished - 2012
Externally publishedYes
EventDigital Production Symposium 2012, DigiPro 2012 - Glendale, CA, United States
Duration: 2012 Aug 42012 Aug 4


OtherDigital Production Symposium 2012, DigiPro 2012
Country/TerritoryUnited States
CityGlendale, CA


  • Alpha matte
  • Fluid
  • Post-production
  • Video processing

ASJC Scopus subject areas

  • Industrial and Manufacturing Engineering


Dive into the research topics of 'Extracting fluid from a video for efficient post-production'. Together they form a unique fingerprint.

Cite this