Possible to Add A.I. StyleGAN(Generative Adversarial Network) to TVPaint? Updated 7-15-2019

This section is dedicated to the feature & improvement requests (be sure what you are asking does not exist yet in TVPaint Animation ;) )
Post Reply
TheQuestionMark
Posts: 170
Joined: 26 Sep 2013, 12:01

Possible to Add A.I. StyleGAN(Generative Adversarial Network) to TVPaint? Updated 7-15-2019

Post by TheQuestionMark » 17 Feb 2019, 09:39

I know this is crazy to request something this big. But is possible to add AI to TVPaint? It might be beyond knowledge and understanding.

Here are the videos for StyleGAN
https://twitter.com/roadrunning01/statu ... 8034757633
https://twitter.com/_Ryobot/status/1096565388165300225

It seems great potential that it can probably do in-between maybe even more that can allow you to skip a few key frames.

https://www.dropbox.com/s/z0iqlkj4e0nxk ... e.mp4?dl=0 This one seems convincing that it can potential do in between. Even doing 60FPS Animation for Anime. It's still learning I think it's only 5 days?

It's seems open-source AI?
https://github.com/NVlabs/stylegan

There's another GAN too, to do anime backgrounds.
https://medium.com/syncedreview/reprodu ... 30d583736e
Last edited by TheQuestionMark on 16 Jul 2019, 03:26, edited 1 time in total.
Windows 10 64-Bit TvPaint Professional 11.0.8 (64-Bit)

TheQuestionMark
Posts: 170
Joined: 26 Sep 2013, 12:01

Re: Possible to Add A.I. StyleGAN(Generative Adversarial Network) to TVPaint?

Post by TheQuestionMark » 16 Jul 2019, 03:24

There's an update on A.I.! They can do moving paintings! If they can they do that, they can do animation! I saw that they can do it with the Mona Lisa! It feels like doing traditionally feels finally dead. TVPaint please take this seriously it's not a joke! I think it's the future. TVPaint could be left in the dust if it's not researching or experimenting it. I think Disney could be adding it to Meander, and I think there's no way TVPaint can compete against big corporation like Disney in R&D. What is TVPaint going to do?



There's also a pose estimation A.I. For those anime crowd scenes.

Windows 10 64-Bit TvPaint Professional 11.0.8 (64-Bit)

Jet
Posts: 44
Joined: 31 Jul 2015, 10:48
Location: Japan

Re: Possible to Add A.I. StyleGAN(Generative Adversarial Network) to TVPaint?

Post by Jet » 16 Jul 2019, 14:21

TheQuestionMark wrote:
16 Jul 2019, 03:24
[...] It feels like doing traditionally feels finally dead. [...] TVPaint could be left in the dust if it's not researching or experimenting it. I think Disney could be adding it to Meander, and I think there's no way TVPaint can compete against big corporation like Disney in R&D.
What problem do you think this solves exactly? :|

If it's for production cost/speed, TVPaint can speed up the tweening process by building vector layers that support shape tweening like in Adobe Animate (Flash), job done. There's one guy on GitHub adding this to OpenToonz, so we'll see what happens. This is what was used to produce Long Way North and someone could correct me if I remember this wrong, but the producer said it allowed them to keep everything in house instead of outsourcing.

Dofus Livre 1: Julith was produced using the same technique (TVPaint was used for animating, Animate/Flash used for cleanup, tweening and color).

Image

Using shape tweening for something like the image below, is much less expensive to do and also not possible with this AI unicorn stuff, you'll never get this level of nuance from machines, at least not in my lifetime.

Image
OS: Win 10 [x64] / CPU: 1950X Threadripper [4.0GHz] / RAM: 128GB / GPU: 2x GTX 1080Ti / Display: Cintiq 27QHD
TVP: 10.5.7 Pro [x64] / 11.0.8 Pro [x64]

Post Reply