comixify
web-based working solution for video comixification
Screenshots
Hunter's comment
ok, this is really fricking cool, i've already got a use case solution for this and i'll be using this at some point, what a great idea and just shows you the power of modern day modelling and algorithms, super sick! what are you gonna turn into a comic? :)
We split this task into two separate problems: (a) frame extraction and (b) style transfer. To extract meaningful, representative frames from the video we employ a keyframe extraction algorithm based on Reinforcement Learning, while for transferring the style into comics we implement a generative adversarial network (GANs) model
big thing to note here is giving access to people who have ideas to the cloud resources to pull these things off.. they even have an api to be able to send video too but you wanna keep it to 50mb and mp4 it looks like in this first version -- sick code thou.
We would like to thank Google for granting us free Google Cloud Platform credits that enabled us to develop our project.
Link
https://comixify.ii.pw.edu.pl/
Contributors
Hunter: @teamhumble
Makers and Contributors:
- @steemhunt.fund (85% beneficiary of this article)
This is posted on Steemhunt - A place where you can dig products and earn STEEM.
View on Steemhunt.com
Congratulations! Your hunt has been reviewed and approved! Thank you for a great hunt.
Please read our posting guidelines. If you have any questions, please join our Discord Group.
Aaaarghhh!! So frustrating...I can't get it working (says 'error - try later', which I will be doing).
If this does what I expect it to, then I'm hooked, and will definitely be using it. Even if it's only half as good as I'm expecting it to be, I'll be hooked.
I'm pretty sure you can re-create the effect using After Effects and/or Photoshop (with a lot of importing/exporting/re-framing), but that's a very lengthy process. And if this works in a fraction of the time, with similar (or the same effects), then it'll be an awesome tool.
So...thank you for the hunt, and my fingers are crossed, my toes are crossed... :)
Hi, I am one of co-authors of the paper.
Sorry for the inconvenience - we still have problems with DOS. Interest has exceeded our expectations ;)
We have just added an additional machine - now it should be a little better.
We are also working on dynamic layout generation, adding automatic speech recognition and text generation to introduce dialogs into our comics. And we have many other improvements planned. Stay tuned and if you have any other comments feel free to send us an email to any of the addresses from the paper: [email protected], [email protected], [email protected], [email protected].
i've delegated you 50SP to give you some power to REPLY, comment and post on the steem block chain.. you need that here, it's called RC (resource credits, they recharge like an energy bar in a fighting game, MANA!)
hope this helps you write about your resources and maybe we can make it better and better! please tell us all about it on steem.
No problem, it looks really promising - I'm excited to use it :) Thanks for taking the time to reply.
wow, that's great that you found this via steemhunt and got back in touch! welcome! :) -- i'd love to talk to you about speeding this up and spinning up my own instance maybe for a donation? is the code open source?
Sorry for late reply,
We have open-sourced current version of our algorithm on CC BY-NC 4.0 license. You can find it on https://github.com/maciej3031/comixify
Demo application is not the best when it comes to architecture (especially considering the level of interest), it would be useful to have some task queue like celery.
But we're still working on improvements!
awesome, yeah the ability to spin up our own version of it would be cool, i delegated you some steem so you had RC/MANA to be able to post etc.
i can't wait this improvement
to be realized. Will stay tuned..
Wooww.. this really unique and cool video editing. Convert video into comics.😂😂 I think I must try for my life video story into comics page.
Seems like a very easy to use web based solution for video creators. There are several options to choose from and the interface needs to polish a bit other than that it seems a good tool.
Nice hunt
its another creative thing for editors and comic makers ...
amazing thing to give a try i think lots of movie makers of drama makers would be using it if not before than after this hunt surely they will have another great mind and application 😍
yes this make it very easy to model and testing algorithm .
good hunt friend keep on hunting 😊 upvoted 😉
Wow... that's cool! I tested it myself with a short clip from Youtube, the result is really great. Too bad there are so few pictures, I would like to convert a 90 mintues movie to a comic. Thanks for the great hunt.
This is a good idea to present something in comics. Some problems you mentioned in the post needs to be addressed to make it a big hit. But the idea is super amazing
thank you for sharing this.
A cool tool for video editing that can be done though a web base tool. Seems it is easy to use too.
Nice hunt
A good idea to convert some pics and videos into comics. I will definetly give it a try.
Congratulations!
We have upvoted your post for your contribution within our community.
Thanks again and look forward to seeing your next hunt!
Want to chat? Join us on: