Learning OpenArt & Stable Diffusion w/ the help of Lux | Splinterlands

in Splinterlands2 months ago

image.png

Today I wanted to learn to use a new AI image-editing tool called OpenArt which uses Stable Diffusion. It's a very popular tool, but there's a bit more of an on-ramp than products like ChatGPT & Grok (which are very basic prompt-only tools) or even Midjourney (which combines prompting with semi-advanced editing options). Stable Diffusion is a tool more akin to Photoshop, with a focus on AI tooling for image creation and image editing.

My model for the day is the wonderful Lux Vega. I created the starter image below (after a lot of trial and error) using ChatGPT (and feeding it the original art as reference).

4cef1120-961d-4c20-b3b5-3c2dad1a96d5 - Copy.jpg

Next, I moved over to OpenArt.

EXPAND

The first task I wanted to achieve was to expand the frame significantly. This is something that's incredibly difficult to do with ChatGPT/Grok as you can't keep the reference image intact. With OpenArt, it's extremely trivial.

image.png


Expanding provides a few different options (as many as you select) so you can see different renderings.

image.png

image.png


I did a second expand to get all the way down to Lux's feet.

image.png

image.png


The results are quite frankly incredible. It did an amazing job of preserving the style of the existing reference image, and gave me a great image to continue from.

STYLIZE

Next I tried the "stylize" option, which allows you to take a reference image and stylize it based on some presets, or a reference image of your choosing.

image.png


I picked pre-set styles provided in the UI, and let's just say that the results weren't very good. I tried a variety of styles, some of which I thought would just alter the mood and others that were different illustrative approaches, but they all significantly altered the reference image and I wasn't happy with the results.

image.png

image.png

image.png

INPAINT

Next I wanted to try the "Inpaint" option, which lets you select an area of the image and replace it with something else.

image.png


First I tried with her "wand", trying to replace it with something more like a mystical cane from the original art. However I wasn't a big fan of where that ended up.

image.png


Next I tried altering the look of Lux's dress/skirt. The results this time were quite impressive. I alternated between the "high quality" render and the "photorealistic" render but felt both were quite similar. Ultimately I found several that were great improvements.

image.png

image.png

image.png

image.png


I tried one other Inpaint, this time for her hat. I was trying to change it to a single red gem like the original art rather than the steampunk glasses in my render, but the results were really (and I mean really) bad. See for yourself.

image.png


BACKGROUND

Next I wanted to test out switching the background.

First off, I was SUPER impressed by the tool's ability to detect the background and properly lasso around the main image. See below.

image.png


Next, I got ChatGPT's help to describe a scene I thought would be a great background for Lux.

image.png


After generating the images, I was surprised by how strange they came out. They didn't match the image at all.

image.png


So I tried a different description that specifically started with a mention of the images being "photorealistic", thinking that might change the output style. However, it continued along similar lines of what it had done before. Overall I wasn't very happy with the background editing, but I have a feeling it may be because I didn't quite figure out how to tune it.

image.png

image.png

BONUS: VIDEOS!

As a bonus item, I decided to take the original art and create some videos using Hailuo AI. Unfortunately I used the original art rather than the final one, and ran out of credits on Hailuo... I'm not yet convinced it's worth paying for that service TBH. In any case though, these two turned out quite well :)

302811090411745283.gif

302807682623623173.gif


SUMMARY

OpenArt, powered by Stable Diffusion, is a really powerful AI art tool that enables the creation and editing of images.

I felt that the "expand image" function worked flawlessly, while other functions (Inpaint, background editing, and stylize) were more difficult to get right.

Overall, with more effort than ChatGPT/Grok but still fairly minimal work, I was able to get some very good results with OpenArt.

Hope this was helpful and that some of you will experiment with this tool!

Sort:  

This is detailed and absolutely amazing. I will give it a try myself!

That is insanely cool!

 2 months ago  

Consider me intrigued. I will be checking this out this weekend. Cheers, BT!

Yeah OpenArt was a cool tool to use. Can't say if it's the "best", but it was easy to get started with thanks to a good amount of trial credits included when signing up.

Other ones I considered were:

  • Using Stable Diffusion's own tools, particularly Stable Assistant: https://stability.ai/stable-assistant
  • Ideogram, a tool I saw lots of content creators mention and that looks amazing: https://ideogram.ai/. Ultimately didn't go with this one because to get the editing features required a paid subscription, and I wanted to try before I buy

This post has been supported by @Splinterboost with a 15% upvote! Delagate HP to Splinterboost to Earn Daily HIVE rewards for supporting the @Splinterlands community!

Delegate HP | Join Discord

Thanks for sharing! - @isaria

Tbh the expand function is more than impressive! It did an amazing job preserving the original style: just that feature alone may come in handy in a lot of different scenarios!