A guide for creative collaboration with Gen AI, and how to use it’s help for automating creative processes.

I’m both an artist and an automation engineer, and as one, I see the importance of automating processes. Efficiency and consistency are paramount in software development, where automating repetitive tasks allows me to focus on innovation and problem-solving. This approach not only accelerates project timelines but also enhances the quality of our solutions. So it’s only natural for me to apply automation ideas on my art.

Me, doing art manually hehe. Generated by Ideogram.

When the Gen AI boom erupted, I couldn’t resist diving in. It wasn’t about finding a magical solution but rather uncovering a dynamic collaborator — a tool that turned me from a frustrated artist into an AI alchemist.

Learning to wield Gen AI felt like rediscovering a forgotten language — familiar yet bursting with unexpected possibilities. It wasn’t about replacing my creativity; it was about outsourcing those pesky, repetitive tasks to a tireless assistant.

AI not only helped me explore new styles and techniques but also became my reliable ally in avoiding grammatical mistakes and finding the perfect word when my own vocabulary fell short. And its assistance doesn’t stop there; AI can tackle countless other creative challenges. Whether refining melodies, suggesting plot twists, or generating visual concepts, AI offers a breadth of capabilities that amplify artistic vision and execution.

It can give a voice to those who need it most. By providing a platform for expression in unconventional ways, AI empowers individuals to share their unique narratives with the world.

Take for example a poem I wrote to my partner, with the aid of chat GPT —

In lands where dreams dance in the light,
I glimpsed a vision, soft and bright.
Two homes we’d hold, one in the city’s cheer,
Where love and laughter draw us near.

Amidst the buzz, amidst the crowd,
Our hearts entwined, forever proud.
And in a place where nature’s grace,
Unveils its charm, a serene embrace.

By a tranquil lake, beneath the sky,
Our love would bloom, never to die.
Two places, two hearts, one sweet song,
In this fairytale, where we belong.

So let’s chase this hope, hand in hand,
Across the hills, across the land.
For in these homes, our love shall soar,
Forever and ever, more and more.

The two houses, generated by Ideogram.

When writing this piece and others (including this article), I used aspects of the given practice. My approach to AI in art differs from the world of coding. There, it’s a brainstorming buddy, bouncing ideas around like playful sparks. But in the realm of art, I transform into a thoughtful conductor, leading the AI with a gentle hand and a heart full of creative potential. Imagine it as a collaborative game of leapfrog towards artistic maturity. I have the vision, but the AI translates it into reality.

When my mind races ahead, sketching the overall composition, the AI catches up, meticulously filling in the details. It’s a partnership built on mutual respect and a shared passion for artistic expression.

Now, let’s delve into the nitty-gritty: here are some essential rules I’ve found invaluable in my journey with Gen AI to unlock its creative potential across various artistic mediums.

The Secret Sauce of Artistic Alchemy

Look at them small floating bubbles! Generated by Ideogram.

There are four parts to the guide:

1. Before you start

2. General guidelines

3. Avoiding pitfalls

4. Specifications: Essential details

Before you start:

Make sure you read my previous article if you haven’t already, it’s has some important basics. Then quickly come back!

Every AI tool has its own quirks, but there are universal truths – the artistic equivalent of brushstrokes harmonizing

• Build a strong artistic foundation: Aspiring artist? Take a beat and hone your core skills! A keen eye and artistic fundamentals are the tools that unlock the true potential of AI.

• Master working with AI: Think of AI as a meticulously crafted new tool in your artistic toolbox. The more you practice, the richer the colors and textures you can create on your creative canvas.

• Embrace collaboration: AI is your artistic wingman, not a robotic replacement. Let it handle the tedious tasks while you focus on the grand vision, the artistic symphony you're composing.

General guidelines

Generated by Ideogram.

1. Define your goals:
   Clearly outline your objective. Are you looking for inspiration for a new project? Brainstorming ideas for a song? Or perhaps help with specific aspects like lyrics or melody?

2. Start small & experiment:
   Don’t overwhelm yourself. Begin by incorporating AI into specific stages, like staring with brainstorming first “Let’s brainstorm some initial ideas for a story. Generate a few opening lines in a science fiction setting with a sense of wonder.”

3. Provide context:
   Give the AI a foundation to build upon: “Here’s a mood board capturing the aesthetic I envision — a cyberpunk cityscape with neon lights and a sense of mystery.”

4. Iterate & refine:
   Perfection isn’t the goal. Provide feedback and refine the AI’s outputs: “I like this direction with the lonely robot character. Can you explore variations where he encounters a friendly AI companion?” Acknowledge positive results with phrases like “That’s a cool twist!” or “This unexpected detail adds depth to the story, but let’s try another direction, like...”

5. Community & experimentation:
   Connect with online communities. Share your experiences and learn from others.

6. Challenge the expected:
   Push boundaries: “Surprise me with a story concept that blends fantasy elements with a historical setting.”

7. Focus on the journey:
   Embrace the exploration: “Let’s see where this creative journey takes us and let’s investigate the given subject”.

8. Leverage different tools:
   Explore a variety of AI tools, each with unique strengths, like using image generation for a thinking of a concept.

9. Human-in-the-loop workflow:
   Maintain creative control, curate and refine the ideas using your creative vision.

10. Style transfer:
    Pay homage to artistic influences: “Let’s apply the style of Van Gogh’s starry night to a landscape scene in our story.”

11. Positive reinforcement:
    Positive reinforcement plays a crucial role in your AI collaboration.

Why positive reinforcement is important?

Just look at it! Generated by Ideogram.

• Encourages exploration: Positive feedback motivates the AI to explore new ideas that align with your vision. Prompt the AI: “This character description is intriguing! Can you generate some backstory elements that explain their motivations?”

• Improves training: Positive reinforcement helps the AI learn your preferences, Ask the AI: "Based on the feedback I've provided, can you suggest additional story elements that fit the overall tone?"

• Boosts collaboration: Positive feedback fosters a productive partnership: Acknowledge the AI's contribution with phrases like "Thank you for this suggestion. It opens up interesting possibilities!"

• Maintains motivation: Positive reinforcement keeps the AI engaged: Prompt the AI: "We've come a long way with this story. What unexpected twists could we introduce next?"

• Overall improvement: By using positive reinforcement, you're shaping the AI's understanding and fostering a more effective creative partnership.

Avoiding pitfalls

Generated by Ideogram.

Important considorations:

• Over-reliance on AI: Maintain your creative voice. While the AI’s ideas can be interesting, try to ensure they ultimately serve the story you want to tell.

• Bias considerations: Be aware of potential biases and review the outputs to ensure they are free from stereotypes or harmful content. The data the AI works with is not free of mistakes and biases, as it is based on human input.

• Referencing and Fact-Checking: Always cross-check facts and provide proper references. AI can generate plausible-sounding information, but it’s crucial to verify its accuracy to maintain credibility and avoid misinformation.

• Ethical Use: Consider the ethical implications of the content generated. Ensure that your use of AI respects privacy, intellectual property rights, and the broader impact on society.

• Creative Ownership: Clearly define the ownership of AI-generated content. Understand the legal and ethical boundaries regarding authorship and rights to AI-created works.

After we cleared this up, we can focus on the next two ideas:

A. Open prompting
By phrasing prompts for openness, you can avoid some of the complications all together, ask different questions and doubt:

• Surprise me: “Surprise me with a creative concept for a children’s book that combines humor with environmental awareness.”

• Open-ended questions: “What emotions might a character feel after discovering a hidden portal in their attic?”

• Encouraging exploration: “Offer me several variations on this poem, each with a different emotional tone.”

• Beyond the expected: “When generating visuals for this music piece, explore abstract interpretations alongside more literal representations.”

B. Inviting the AI’s input
Go beyond one-way communication. Here’s some examples to how encourage the AI to become an active participant in the creative process:

• What do you think questions: After receiving outputs, ask the AI for its perspective: “What aspects of this scene do you find most evocative?”

• Alternative solutions: If stuck on a specific detail, prompt the AI: “Suggest alternative approaches for this character development that maintain the overall style and direction.”

• Creative collaborator: Frame the AI as a partner: “As my creative collaborator, what unexpected elements could we introduce to this story?”

• Expand upon this idea: Encourage the AI to elaborate: “This musical motif is intriguing. Can you expand upon it by generating a full melody that captures the feeling of hope and wonder?”

Remember: The more you engage the AI in a conversation, the more it can learn your preferences and adapt its suggestions to better align with your vision.

Generated by Ideogram.

Specifications: Essential details

To harness the full potential of generative AI in your creative projects, providing clear instructions is crucial. Here are four key details to include when guiding the AI towards your vision:

Describe your vision:

• Genre and Style: Specify the genre (e.g., science fiction novel, blues song) and desired aesthetic.

• Mood and Tone: Convey the emotional atmosphere you want to evoke (e.g., suspenseful, whimsical).

• Tempo (Music): Indicate the desired pace for musical pieces (e.g., fast-paced, ballad).

Refine the details:

• Visuals: Specify colors, desired composition (layout of elements), or objects to be included.

• Text: Provide keywords, phrases, or specific lyrics to steer the AI's content generation.

• Music: Offer melody ideas or preferred instruments.

• Characters and Setting: Craft detailed descriptions of characters, plot elements, or the desired setting for your story.

Leverage existing materials:

• Visual References: Include existing artwork that reflects your desired style.

• Writing Starters: Provide starting lines of poems, scripts, or stories to give the AI a foundation.

• Sketches or Storyboards (Optional): Incorporate visual aids to further illustrate your vision.

Define the structure:

• Length: Specify the desired word count, number of stanzas (poetry), or video/audio duration.

• Size (Images/Videos): Indicate the preferred dimensions or resolution.

• Song Structure or Story Framework: Outline the desired structure (e.g., number of verses in a song, chapters in a story).

Important to remember

Generated by Ideogram.

• Break down complex tasks. For larger projects, break down the creative process into smaller steps and involve the AI at each stage.

• Consider providing additional context like references to existing works or your target audience to refine the AI’s understanding of your project.

• Provide feedback consistently. Regular feedback throughout the process helps the AI refine its outputs: Acknowledge positive aspects and offer suggestions for improvement.

• Maintain a playful attitude! Don't be afraid to experiment and have fun: "Let's see what happens if we combine these two seemingly unrelated ideas!"

By following these guidelines, even just a few, and fostering a collaborative environment, you can unlock the full potential of generative AI and embark on a truly enriching creative journey. Don’t forget the potential of automating the mundane parts, too.