Pāḷi Chanting Text to Speech

Following results were obtained by training the 20 hour Pali dataset here for about 700 epochs on a RTX 3090 GPU. The training took about 24 hours.

The trained model is included in the releases section of this repository here

Example texts for the following voice synthesis come from the Chaṭṭha Saṅgāyana Tipiṭaka

TODO: Currently there is only one speaker in the dataset. If we can obtain few different speakers with each speaker contributing about 1 hour of high quality recordings of given text prompts, we could possibly improve the quality of the model further. Also this would give the option of generating recordings with the styles of those different speakers at the inference time.

Paragraph style

namo tassa bhagavato arahato sammāsambuddhassa.
Dīghanikāyo.
Sīlakkhandhavaggapāḷi.
Brahmajālasuttaṃ.
Evaṃ me sutaṃ - ekaṃ samayaṃ bhagavā antarā ca rājagahaṃ antarā ca nāḷandaṃ addhānamaggappaṭipanno hoti mahatā bhikkhusaṅghena saddhiṃ pañcamattehi bhikkhusatehi.

Mūlapariyāyasuttaṃ.
Evaṃ me sutaṃ - ekaṃ samayaṃ bhagavā ukkaṭṭhāyaṃ viharati subhagavane sālarājamūle. Tatra kho bhagavā bhikkhū āmantesi - “Bhikkhavo”ti. “Bhadante”ti te bhikkhū bhagavato paccassosuṃ. Bhagavā etadavoca - “Sabbadhammamūlapariyāyaṃ vo, bhikkhave, desessāmi. Taṃ suṇātha, sādhukaṃ manasi karotha, bhāsissāmī”ti. “Evaṃ, bhante”ti kho te bhikkhū bhagavato paccassosuṃ. Bhagavā etadavoca -

Dasasikkhāpadaṃ.
Pāṇātipātā veramaṇī sikkhāpadaṃ samādiyāmi.
Adinnādānā. Abrahmacariyā. Musāvādā. Surāmerayamajjapamādaṭṭhānā. Vikālabhojanā. Mālā-gandha-vilepana-dhāraṇa-maṇḍana-vibhūsanaṭṭhānā. Uccāsayana-mahāsayanā. Jātarūpa-rajatapaṭiggahaṇā veramaṇī-sikkhāpadaṃ samādiyāmi.

Gāthā style

“Evaṃ abhikkantadassāviṃ, atthi pañhena āgamaṃ;
Kathaṃ lokaṃ avekkhantaṃ, maccurājā na passati”.

“Suññato lokaṃ avekkhassu, mogharāja sadā sato;
Attānudiṭṭhiṃ ūhacca, evaṃ maccutaro siyā;
Evaṃ lokaṃ avekkhantaṃ, maccurājā na passatī”ti.

Manopubbaṅgamā dhammā, manoseṭṭhā manomayā;
Manasā ce paduṭṭhena, bhāsati vā karoti vā;
Tato naṃ dukkhamanveti, cakkaṃva vahato padaṃ.

Akkocchi maṃ avadhi maṃ, ajini maṃ ahāsi me;
Ye ca taṃ upanayhanti, veraṃ tesaṃ na sammati.

From Aṭṭhakathā and Tīkā

nissattaṭṭhasuññataṭṭhasaṅkhātenāti dhammamattatāya nissattatāsaṅkhātena niccasubhasukhaattasuññatatthasaṅkhātena. sabhāvaṭṭhenāti yathābhūtasabhāvaṭṭhena.

Imaṃ pañhaṃ pucchi. Tassāyaṃ saṅkhepattho - jaṭāti taṇhāya jāliniyā etaṃ adhivacanaṃ. Sā hi rūpādīsu ārammaṇesu heṭṭhupariyavasena punappunaṃ uppajjanato saṃsibbanaṭṭhena veḷugumbādīnaṃ sākhājālasaṅkhātā jaṭā viyāti jaṭā, sā panesā sakaparikkhāraparaparikkhāresu sakaattabhāvaparaattabhāvesu ajjhattikāyatanabāhirāyatanesu ca uppajjanato antojaṭā bahijaṭāti vuccati.