NSSpain 2023: On-device Whisper and our Possible Future

Detailed image description of the sketchnote

• record ourselves 24/7 with an iPhone... & transcribe audio

Whisper

• supports 99 languages
• transcribes audio to text
• C, C++, 25k lines of code

Active Function

• start and end keyword: "cookie, weight, 76 kg, END cookie"
• use cases: Data Journal, Calories counter, Sleep data, ...

Passive Functions

• Sentiment Analysis
• Relationship Thermometer

Siri vs Whisper

Siri:

• limited commands
• Stored on servers
• Synch

Whisper:

• unlimited commands
• 100% private
• asynch
• no feedback

Why?

• Personal Assistant

Why not?

• Data only safe in your own hands