A few days ago I talked a little bit about a new project on the way called Leonardo.AI. There is a feature that I didn't include in the last post because I didn't explore it enough to talk about it and present its capabilities and flaws.
I'm talking about fine-tuning your own models in Stable Diffusion. First of all, I needed a target to work towards and luckily my inspiration was right here on Hive. I saw this Splinterlands Art Contest Week 229 post and that sparked the idea.
I'm going to create a fine-tuned model that can create some kind of Splinterlands art. There are so many amazing-looking cards that I didn't know what to choose from. I went with my all-time favorite element from video game, Water.
At this point, I wasn't really sure what to expect from this fine-tuning process or how exactly it works so I needed to pick a theme from the card available.
So I went with half-fish half-humanoid monsters. Clicked on the Train Model and... well waited, haha.
I was expecting to wait for at least an hour when I saw this message. But to my surprise, I got an email in about 20 minutes.
Well, it was time to try it out. My first prompt was aimed to create a character that looks like a
screaming Medusa with golden hair that is holding a trident. And this was the result:
I mean, it was a first try, but I didn't want to give up on it yet, I started toying around with different styles for prompts and when I tried an anime style prompt I started getting something closer to what I wanted.
This looked... better but not quite. Also, bear in mind that none of these images are upscaled because I can only upscale 10 images per day so I had to pick and choose when it would be the right time to use those. So I figure, the image on the left was getting closer to my target so why not see how it looks upscaled, this is what I got.
Even though a lot of stuff on the image didn't make much sense the style in which the image was drawn was getting pretty close. Now, I have to say that this image was the last one that got anywhere close and after 50 or even more failed images it was getting obvious that I won't be making any more progress with this model.
So I went all the way back and retrained a model.
I added a bunch more monsters from the Water element and went a little bit looser on the theme and just wanted to add more different weapons and poses into the mix. In the help section of the Leonardo.AI website, they say that you shouldn't add too many training images to avoid overtraining the model. But hey, I had to try it and see for myself.
This started to look better from the start and my hope was high at this point. Instead of trying to get that golden hair medusa with a trident (which I didn't get btw) I opted to just let it create all sorts of characters and classes. And at one point I generated this one and just knew I want to use it for this contest.
This one looked cool and if you ask me the style is really close. Anyway, I loved it! But that wasn't good enough so I needed to add some modifications and do a little bit more manual work.
Image by Kevin Phillips from PixabayFound this neat-looking background on pixabay and incorporated it into the image.
Had to remove the first background, and added the new one, after that, I returned the glow on the left orb that was removed when I made a mask, and lastly some finishing touches. At the last moment, I noticed that tiny anomaly on her waist so I had to get rid of it.
And voila! This is my entry for the contest.
Medusa Mystic.
I hope you like the end result as much as I do and that you learned something new about AI capabilities along the way.
As always, thank you for reading.
Another great lesson tutorial. 👍 !PIZZA
Thanks! Always showing up for support. I appreciate it very much!
The last model looks cool its more Splinterlands look than the first ones, first models didn't generate the face quite correctly, I have been looking at AI too but mostly at beat generation and voice changing
Yeah, faces were really terrible with the first version, haha. Do you have any recommendations for beat making AIs? I only really tried one called Soundful. I like to dabble with all kinds of AIs.
Awesome arts man. Good luck for the contest.
Thanks for the support!
https://leofinance.io/threads/@awesomeintrigue/re-leothreads-qhdqma8y
The rewards earned on this comment will go directly to the people ( @awesomeintrigue ) sharing the post on LeoThreads.
Yay! 🤗
Your content has been boosted with Ecency Points, by @awesomeintrigue.
Use Ecency daily to boost your growth on platform!
Support Ecency
Vote for new Proposal
Delegate HP and earn more
Congratulations @awesomeintrigue! You have completed the following achievement on the Hive blockchain And have been rewarded with New badge(s)
Your next target is to reach 400 comments.
You can view your badges on your board and compare yourself to others in the Ranking
If you no longer want to receive notifications, reply to this comment with the word
STOPTo support your work, I also upvoted your post!
Check out our last posts:
Support the HiveBuzz project. Vote for our proposal!
Do you know you can win a Chaos Legion pack and many other things just by following some simple steps ?? Check out our Latest Daily Showcase and Participate our latest Giveaway. Thanks
I gifted $PIZZA slices here:
@blitzzzz(13/20) tipped @awesomeintrigue (x1)
Send $PIZZA tips in Discord via tip.cc!
Well, I am not surprised the work turned out great
I've used AI and I can attest to how great it can be
Thanks for sharing
I'm just amazed myself how specific you can get with training your own model. I know it can be scary to artists how we can copy their style by using techniques like this. I just hope those creative minds can adapt this technology and drive this even further.
Exactly... I really hope they don't get afraid of the new development but rather adapt it and take it to a greater level
Thanks for sharing! - castleberry#6859
