Proceedings: GI 2014

VisionSketch: integrated support for example-centric programming of image processing applications

Jun Kato, Takeo Igarashi

Proceedings of Graphics Interface 2014: Montréal, Québec, Canada, 7 - 9 May 2014, 115-122

  • BibTex

    author = {Kato, Jun and Igarashi, Takeo},
    title = {VisionSketch: integrated support for example-centric programming of image processing applications},
    booktitle = {Proceedings of Graphics Interface 2014},
    series = {GI 2014},
    year = {2014},
    issn = {0713-5424},
    isbn = {978-1-4822-6003-8},
    location = {Montr{\'e}al, Qu{\'e}bec, Canada},
    pages = {115--122},
    numpages = {8},
    publisher = {Canadian Human-Computer Communications Society},
    address = {Toronto, Ontario, Canada},


We propose an integrated development environment (IDE) called "VisionSketch", which supports example-centric programming for easily building image processing pipelines. With VisionSketch, a programmer is first asked to select the input video. Then, he can start building the pipeline with a visual programming language that provides immediate graphical feedback for algorithms applied to the video. He can also use a text-based editor to create or edit the implementation of each algorithm. During the development, the pipeline is always ready for execution with a video player-like interface enabling rapid iterative prototyping. In a preliminary user study, VisionSketch was positively received by five programmers, who had prior experience of writing text-based image processing programs and could successfully build interesting applications.