Sign to voice · FaceTime

You sign.
Hermes speaks.

Call Hermes on FaceTime and sign in American Sign Language. It says your words out loud in natural English, and shows what the other person says back as large captions.

Line: +1 (702) 510-9706
Use a FaceTime Video call from an iPhone, iPad or Mac.

HERMES
You sign · I speak · REPLY listens
YOU signer
Where is the bathroom?
Signs: BATHROOM WHERE
REPLY hearing person
Straight ahead, first door on your right.

How it works

No app to install. Hermes joins your FaceTime call as the other participant and does the interpreting in between.

  1. You sign

    One sign at a time: raise your hands, sign, lower them. Hermes watches your hands, face and shoulders.

    MediaPipe
  2. It recognizes

    Each whole sign is matched by hand shape, where it is relative to your face, and how it moves.

    Trained on Google's ASL dataset
  3. It speaks

    Pause for three seconds and your signs become one natural English sentence, said out loud.

    Gemini + ElevenLabs
  4. You read the reply

    When the other person talks, their words appear under REPLY on Hermes' video.

    ElevenLabs speech-to-text

Try these first

These signs are the most reliable. Tap a sign to see how it's made.

Hello.

Where is the bathroom?

I'm thirsty, can I have some water, please?

No, I'm not hungry.

My mom is at home.

I'm done, goodbye.

Getting recognized

Hermes judges a sign when your hands come down, so give each one a clear start and end.

Show your face and shoulders

Sit back so the camera sees from the top of your head to your chest. Hermes measures where your hands are relative to your face.

One sign, then hands down

Raise your hands, make the sign once, then lower them to your lap or out of view.

Pause to send

Three seconds with no new sign finishes the sentence and Hermes says it.

Not picked up? Sign again

If Hermes isn't sure, it adds nothing rather than guessing. Just repeat the sign.

What to expect

Hermes is a hackathon demo, not a certified interpreter. Here is how it does today.

49everyday signs
84%right first try, for signers it never saw
3 spause, and Hermes says your sentence

Why "Hermes"?

In the Odyssey, Hermes is the messenger who carries words between gods and mortals. This Hermes carries them between signers and speakers. Built in 36 hours at HackUTA 2026.

Chert FaceTime APILiveKitMediaPipescikit-learnGoogle GeminiElevenLabsPython