← Roni Arbel, MD PhD A novel auditory orthography

Visual-to-auditory sensory substitution

Every letter is a sound.
Every sound has a shape.

OVAL is an auditory orthography developed for blind readers. Each character is a small arrangement of dots and vertical lines, and the EyeMusic algorithm turns that arrangement into sound: left to right is time, high to low is pitch, and colour is the instrument you hear. Write a word below in transcription or in Hebrew, then follow the sweep as it reads.

Write

Compose a word

Write in the Latin transcription the paper prints beside the alphabet, or in Hebrew — both reach the same 22 characters. Pauses follow the original app: 0.5s for a space, 0.75s for a comma, 1s for a full stop.

Try
Normal
The sound image

The sweep line reads left to right; the mark under it is the one sounding.

Loading sounds…

0.0 / 0.0s

Space play or pause · ← → previous or next letter · Home / End jump to the start or the end · tap a letter, or drag the marker, to move the reading position

The alphabet

Twenty-two characters

Every character combines up to four dots and vertical lines, borrowing the spatial patterns of Braille and the temporal patterns of Morse. Lines run vertically rather than horizontally so that a line is heard as a chord instead of a long tone. Tap any character to hear it. The eleven marked with a ring are the ones participants were trained on.

How it works

Reading with your ears

OVAL was designed so that characters stay distinguishable once a shape has become sound. This page is a web port of the original Android app and plays the same recordings.

A sweep line

Each character is scanned left to right, so the marks are heard in the order they are drawn.

Height is pitch

Vertical position maps onto a pentatonic scale, and a line becomes a chord.

Colour is timbre

A redundant cue that made readers both faster and more accurate than monochrome ones.

Seventeen speeds

Every character was recorded at 17 tempos, from eight steps slower to eight steps faster.

Beyond the lab

Taught as a reading system

Every OVAL study until 2022 had taught the alphabet to people who could already read, in Hebrew, their first language. A master's thesis in education took it somewhere else.

A Comparative Study of Braille as a Tactile Orthography with the Auditory Orthography OVAL to Teach Reading to Preliterate, English as an Additional Language, Adult Learners Who Have Visual Disabilities

Michelle J. Strutzenberger · Master of Arts in Education, Ontario Tech University, December 2022 · supervised by Dr. Allyson Eamer

Seven adults with visual disabilities joined from six countries. All of them had come to Braille after the age of ten, past the stage at which reading is usually learned, and all were learning English as an additional language. Alongside the retention tests, a certified Braille and English instructor observed the sessions and the participants were asked what they made of reading by ear.

Both orthographies met the criteria for a beginner reading programme, the thesis concluded, though an auditory one holds the potential to remove some of the barriers that come with a tactile one. Roni provided the training on OVAL over several sessions online.

Read the thesis
  • 71.29% average accuracy in retaining OVAL characters across the seven participants
  • 100% OVAL retention for the two participants measured against Braille, which reached 44.50%