Page 1 of 1

Stylit convert 3D object into a hand drawn style drawings

Posted: Tue Sep 18, 2018 5:11 am
by ruscular3d
https://www.youtube.com/watch?v=F6ex4pogilA

This could be great for making new background setting for the MOHO animation.

Re: Stylit convert 3D object into a hand drawn style drawing

Posted: Tue Sep 18, 2018 11:22 am
by Maestral
This one (since there is a lot more these guys have done) is very interesting but I have not figured out how to actually apply it!? Have you?

p.s.
Does anybody know how to make aquarelle convincingly animated, preferably in 2D? Mesh would, more or less, solve the mapping/texturing but StyLit offers these fine changes of light and shade through the movement and I`m looking for something similar.

Re: Stylit convert 3D object into a hand drawn style drawing

Posted: Tue Sep 18, 2018 5:11 pm
by ruscular3d
I am not seeing anywhere that being applicable to us now, seems to be in the demo stage for now. I dont even have a price info either.

Re: Stylit convert 3D object into a hand drawn style drawing

Posted: Tue Sep 18, 2018 10:21 pm
by Maestral
I`ve seen a 3D still life scene (fruits, baskets, cloths...) on which some style from StyLit was applied. Looks great but than again, no details on "How it`s made" ,)

Re: Stylit convert 3D object into a hand drawn style drawing

Posted: Wed Sep 19, 2018 2:29 pm
by dkwroot
I'm guessing that it's using a constitutional neural network that's been trained for style transfer. The program renders the 3d scene like normal, then samples the style created by the artist, then applies it to the render using the neural network.

Style Transfer Info: http://genekogan.com/works/style-transfer/

More info: https://medium.com/tensorflow/neural-st ... 541ac31398

Re: Stylit convert 3D object into a hand drawn style drawing

Posted: Wed Sep 19, 2018 3:52 pm
by Maestral
Your comment made me look through their full (patented) paper.

"The deep neural network approach of Gatys et al. [2015] strongly depends on visual patterns used during the training phase. In our scenario this approach completely fails (Fig. 10h); without proper guidance it is impossible to recover a meaningful assignment between the source and target features."

Later on, they are mostly relying on LPE channels and even gave the recommended PC`s specs along with rendering time estimation for a 1 megapixel image (3-15mins, respectively to HW configurations). That made me think some standalone app could be found. Alas, the ending of the paper brought a hint - "Sponsored by Adobe" ,)

StyLit org provides Windows (only) demo where one may play with a printed template and painting their own style which would be then applied onto existing models/examples, within the demo. I think I saw a few dependencies along the way but can`t be sure will those be really necessary.

Although this sounds like 3D oriented sw, actually these guys already made it available for stylizing animation/video with a peculiar attention on minimizing frame by frame differences and preservation of character/BG integrity through the movement - while still having the desired style applied properly.