🎙️WhisperNote : Vibe-Detecting Voice App

Hamna KaleemHamna Kaleem
2 min read

Okay so... I was supposed to be doing something productive. But then I had a random thought: what if I could turn a voice note into a transcript and find out what kind of mood I sounded like?

Boom — WhisperNote happened.

No overengineering, no backend stress — just Whisper, Hugging Face, and Gradio.


🔥 What Does WhisperNote Do?

  1. You upload a voice recording (WAV, MP3, whatever).

  2. It uses OpenAI's Whisper to transcribe your audio to text.

  3. It passes that text to a Hugging Face emotion classifier.

  4. It shows you your transcript + what emotion it thinks you're vibing.


🧠 Why I Did This

  • I was bored.

  • I like building tiny things with big brains (aka Whisper + Transformers).

  • I wanted to hear what my voice feels like. LOL.


🛠️ How To Run It (in Colab)

!pip install -q openai-whisper torchaudio transformers librosa gradio

Then copy-paste this magic:

import whisper
import gradio as gr
from transformers import pipeline

whisper_model = whisper.load_model("base")
emotion_pipeline = pipeline("text-classification", model="j-hartmann/emotion-english-distilroberta-base")

def process_audio(audio):
    result = whisper_model.transcribe(audio)
    text = result['text']
    emotion = emotion_pipeline(text)[0]
    return f"Transcript:\n{text}\n\nEmotion: {emotion['label']} (Confidence: {emotion['score']:.2f})"

gr.Interface(
    fn=process_audio,
    inputs=gr.Audio(sources="upload", type="filepath"),
    outputs="text",
    title="🎙️ WhisperNote",
    description="Upload a voice note. We'll transcribe and analyze your emotion!"
).launch()

✨ Output Example

Transcript:
I'm kinda tired but really proud of this lil app.

Emotion: pride (Confidence: 0.87)

💡 What’s Next?

  • Add emojis for emotions

  • Use Whisper-large for better transcripts

  • Live mic input? Gradio can do it!


🧃 Final Thoughts

Not everything has to be a startup. Sometimes you just wanna build a mini tool, smile at the output, and show it off to your friends.

Thanks Whisper + Python + Gradio for making this super easy!

Let me know if you remix this. I’d love to see your vibe detector 🔮

0
Subscribe to my newsletter

Read articles from Hamna Kaleem directly inside your inbox. Subscribe to the newsletter, and don't miss out.

Written by

Hamna Kaleem
Hamna Kaleem