FLUX.1-Fill-dev for Sprite Sheets


Testing out black-forest-labs/FLUX.1-Fill-dev
model on their playground.
We want to see if fill/in-painting model can be used to create a character sprite that is in-style and in-context.
Setup:
Find a existing sprite sheet template and mark the area for in-painting.
Then use some prompt:
pixel art character cute fireman
school uniform girl pixel art
pixel art guitarist rock
Also tried out "Expand feature:
pixel art character sheet for side scrolling game
This does generate many in a batch which is pretty nice.
Fill in-the blank strategy seems to work great for creating directed variations with controlled style and scale.
I want to understand what I can do to create rotations of characters. Perhaps I will need a template and use it to generate.
I couldn’t get Flux nor MJ to generate the rotations. Also tried asking it to produce walk cycle, neither one of them was good at doing that.
MJ produces animations that are reminiscent of 3D voxel animation which isn’t what I want.
Sora’s Remix feature was able to generate rotations without losing style somewhat.
The video feature was somewhat hectic though.
I think I can use Sora Remix for generating character turnaround sheets and use it as template.
Logging off here.
Subscribe to my newsletter
Read articles from Sprited Dev directly inside your inbox. Subscribe to the newsletter, and don't miss out.
Written by
