🎙️WhisperNote : Vibe-Detecting Voice App

Okay so... I was supposed to be doing something productive. But then I had a random thought: what if I could turn a voice note into a transcript and find out what kind of mood I sounded like?
Boom — WhisperNote happened.
No overengineering, no backend stress — just Whisper, Hugging Face, and Gradio.
🔥 What Does WhisperNote Do?
You upload a voice recording (WAV, MP3, whatever).
It uses OpenAI's Whisper to transcribe your audio to text.
It passes that text to a Hugging Face emotion classifier.
It shows you your transcript + what emotion it thinks you're vibing.
🧠 Why I Did This
I was bored.
I like building tiny things with big brains (aka Whisper + Transformers).
I wanted to hear what my voice feels like. LOL.
🛠️ How To Run It (in Colab)
!pip install -q openai-whisper torchaudio transformers librosa gradio
Then copy-paste this magic:
import whisper
import gradio as gr
from transformers import pipeline
whisper_model = whisper.load_model("base")
emotion_pipeline = pipeline("text-classification", model="j-hartmann/emotion-english-distilroberta-base")
def process_audio(audio):
result = whisper_model.transcribe(audio)
text = result['text']
emotion = emotion_pipeline(text)[0]
return f"Transcript:\n{text}\n\nEmotion: {emotion['label']} (Confidence: {emotion['score']:.2f})"
gr.Interface(
fn=process_audio,
inputs=gr.Audio(sources="upload", type="filepath"),
outputs="text",
title="🎙️ WhisperNote",
description="Upload a voice note. We'll transcribe and analyze your emotion!"
).launch()
✨ Output Example
Transcript:
I'm kinda tired but really proud of this lil app.
Emotion: pride (Confidence: 0.87)
💡 What’s Next?
Add emojis for emotions
Use Whisper-large for better transcripts
Live mic input? Gradio can do it!
🧃 Final Thoughts
Not everything has to be a startup. Sometimes you just wanna build a mini tool, smile at the output, and show it off to your friends.
Thanks Whisper + Python + Gradio for making this super easy!
Let me know if you remix this. I’d love to see your vibe detector 🔮
Subscribe to my newsletter
Read articles from Hamna Kaleem directly inside your inbox. Subscribe to the newsletter, and don't miss out.
Written by
