Reading Hebrew with taamim tune — scoping notes

Prepared 2026-11-17, after the user picked this direction from the tiny-voca brainstorm (Nov 16 evening, "Reading Hebrew with taamim tune"). No building yet — direction first. This note answers the three open questions the assistant asked, with evidence, and recommends a first proof.

The core insight (why this is not just tiny-voca in Hebrew)

Trop is almost algorithmic. Each ta'am is a short melodic motif, and a pasuk's melody is the sequence of its motifs. So the tune may not need a neural model at all: a small voice for the syllables plus trop rules for the melody could be smaller than tiny-voca's 18 MB.

The hard part is the reverse of tiny-voca's trick. Tiny-voca worked because a bigger TTS existed to generate its 19 hours of training audio. No big TTS sings taamim — commercial Hebrew TTS reads niqqud but explicitly does not apply cantillation melody (SpeechGen: "Cantillation melody (ta'amei ha-mikra) is not applied"), and defaults to Modern Israeli phonology. So there is no teacher model to copy from. The melody has to come from somewhere else: either rendered from the marks by rule, or recorded.

Text: solved, open data

Text, nikud and taamim are not the bottleneck. Pronunciation is: Ashkenazi vs Sephardi/Modern Israeli is a real choice, and existing TTS defaults to Modern Israeli (final-syllable stress, merged gutturals).

Trop system: scope is bigger than "Torah vs Haftarah"

Eastern Ashkenazi tradition has six modes (Malin, Hebrew University): 1. Torah, normal Shabbat/weekday/festival 2. Torah, High Holidays (Rosh Hashanah / Yom Kippur mornings) 3. Haftarah 4. Lamentations (Tisha B'Av) 5. Esther (Purim) 6. Festive Megillot — Shir Hashirim, Rus, Koheles

Plus special melodies inside Torah mode for Aseret haDibrot and Az Yashir, and a coda motif for the last few words of each reading (and a different one at the end of each sefer).

Recommendation: scope v1 to Torah mode only, Ashkenazi. Haftarah is the natural v2 (same marks, different melodies). Megillot / Eicha / Esther are separate modes — defer, don't promise them in v1.

What already exists (the gap is specific, not empty)

Recorded-audio lein tools already exist and are good: - Trope on the Go (cantor-built, Ashkenazic Torah + Haftarah, 4,000+ word/phrase library, record-and-compare, animated sound maps) - Torah Morah (Sefaria-powered, recordings of every aliyah, iPhone) - PocketTorah, Trope Trainer, Virtual Tikkun Kahal (launched Nov 11, 2026, native apps, $10/mo)

None of them synthesises arbitrary text. Their audio is a fixed recording library. The gap a tiny-voca-style voice would fill: hear ANY pasuk or aliyah read correctly on demand — any aliyah, any week, including ones no recording library covers — offline, in-app, in a voice you own.

That is also the fit with what he already ships: Tikkun Korim (his Torah reading app — a Leonard Berkowitz print bug is open on it) is the natural home, with Shafeh's learning tools as the second home. A lein-practice tool (hear any aliyah, then try it yourself) is sharper than passive listening inside the Siddur.

Two architectures

A. Rule-rendered melody over a tiny syllable voice (recommended to test first). Record / synthesise one voice saying syllables, then pitch-shift and time-stretch each syllable along the motif for its ta'am. Needs a motif table: one short melody per ta'am, in Torah mode, Ashkenazi — a finite set, plus the verse-end coda and the special-section melodies. Risk: sounds chant-like but flat if the motifs are wrong; needs a cantor to verify the motif table by ear.

B. Neural TTS trained on sung audio. Needs a training corpus of sung taamim, which does not exist as open data. Would have to be recorded: a cantor singing the motif set, or full aliyot. That is a recording project before it is a model project. Do not start here.

Either way, the training-data question from the brainstorm stands: the synthetic recipe works for the syllables, not for the tune.

Recommended first proof (small, checkable)

One aliyah, Torah mode, Ashkenazi: Parshat Vayetzei, first aliyah (this week's parsha, Shabbat Nov 21, 2026). Steps: 1. Confirm the motif table for Torah mode (one melody per ta'am + coda) against a known cantor recording. 2. Render Vayetzei 28:10–12 (first few pesukim) with a placeholder voice + rule-rendered trop, and listen. 3. If it sounds like leining, the architecture works; if not, the motif table or the voice is the problem, and that is cheap to learn now.

Decisions still his (3)

  1. Torah only for v1, or Torah + Haftarah from the start? (Recommend: Torah only.)
  2. Which trop tradition? (Presumed Ashkenazi — his community, Chabad — but not confirmed. Sephardi is a different melody set.)
  3. What is it for — learn-to-lein (hear any aliyah, practise it) or listening inside Siddur/Tehillim? (Recommend: learn-to-lein, in Tikkun Korim.)

Also open: pronunciation for the syllable voice (Ashkenazi Hebrew, with its vowel values, vs Modern Israeli), and whether the voice should be a real cantor's recorded motifs or fully synthetic.

Sources checked 2026-11-17