Playing with ComfyUI Using Online Resources

I stumbled upon this very detailed article on how to convert children's drawings into Comfy AI. It explained the various components of the image recognition and generation process, and even had an existing json workflow that we could easily import into our own ComfyUI instance.

It was not difficult to follow up from there. I looked at the various .safetensors files that are loaded for the workflow, and merely googled the exact names. Then, it was easy to google where to place those respective files and we are good to go.

In a nutshell, the workflow is about identifying what had been drawn, getting AI to describe the drawing, and then using various image generation components to create an AI depiction.

I got my son into the activity first by showing him the blog. The moment he got home he started drawing and finished before I completed the set up. Here is the original drawing and the final outcome:

Next, I got both my children to draw (including myself).

My son started off with a small drawing. It didn't render too well considering it isn't exactly a frog. But we figured it might need to be of a larger size for it to be able to describe the drawing better.

My daughter's simple stick figure rendered quite nicely.

Knowing that he should draw it larger, my son did another drawing. This time larger and with more colours.

The effect was quite interesting, although it rendered a girl but he was drawing a boy. I couldn't figure out how to amend it yet, because the AI described it as a girl, and I couldn't interfere with the workflow to change the description to a boy. But I could regenerate and hence there are two examples of what was rendered here.

I also took the chance to do one of my own. It rendered quite well, but did not get one of the hands and the teeth correct. Nonetheless, it was quite a good quality image.

AI generation isn't perfect for sure, but it has been amazing how far we have gone. In the past, you needed graphic designers to draw your concept professionally, but we can get quite a rough prototype out in less than a minute.