Turn videos into comics, with the power of AI 🎉
In our project, we present a Web-based working solution for video comixification - a task of
converting a video into a comics. We split this task into two separate problems: (a) frame
extraction and (b) style transfer. To extract meaningful, representative frames from the video we
employ a keyframe extraction algorithm based on Reinforcement Learning, while for transferring the
style into comics we implement a generative adversarial network (GANs) model. Since there have been
many works published on the so-called neural style transfer, we evaluate them all on the very same
task, namely frame comixification and select the most appropriate method. We examined different
combinations of Adaptive Instance Normalization, Universal Style Transfer and GAN models and
confront them to find their advantages and disadvantages in terms of qualitative and quantitative
analysis. In the near future we would like to introduce next two parts: Comic Grid Layout Generation
and Speech Extraction.
* Max size of video is 100 MB, max length of the video is 25 minutes.
comic - url to result comics
Please cite the following paper if you use the API:
Comixify: Transform video into a comics
Maciej Pęśko, Adam Svystun, Paweł Andruszkiewicz, Przemysław Rokita, Tomasz Trzciński
We would like to thank Google for granting us free Google Cloud Platform credits that enabled us to
develop our project.
Data processing info:
We do not store your uploaded video. After your video is processed,
it is immediately deleted. We do store the generated comics.