🗣️

Human Evaluation of Amharic
Text-to-Speech (TTS) System

Research Study · University Evaluation Protocol

Thank you for participating in this research study. This study evaluates the naturalness and intelligibility of an Amharic TTS system.

You will listen to 35 short audio samples and answer a few questions for each one. Please use headphones in a quiet environment.

⏱Estimated time: 10–15 minutes · 🔒 All responses are anonymous and used only for research purposes.

📋 Section 1

Participant Information

Please complete the fields below before starting the audio evaluation.

1. Native Language *

Amharic (Native speaker) Amharic (Fluent non-native) Other

2. Age Group *

18–25 26–35 36–45 46+

3. Gender Optional

Male Female

🎧 Section 2

Audio Evaluation — Sample 1 of 35

Listen to the audio sample, then answer the questions below.

🎧 Audio Sample 1

0:000:00

Loading audio…

Q1. Naturalness *

How natural does this speech sound?

1 – Completely unnatural5 – Human-like

Q2. Intelligibility *

How easy was it to understand the sentence?

1 – Very difficult5 – Very clear

Q3. Transcription *

Please write exactly what you heard in Amharic:

Q4. Phonetic Clarity Optional

Did you notice any unclear or mispronounced sounds?

No, everything was clear Yes – ejective sounds unclear (ጥ, ቅ, ጽ, etc.) Yes – gemination unclear Yes – number pronunciation unclear Yes – other

✅ Section 3

Overall System Evaluation

🎉You've rated all 35 audio samples! Please rate the system as a whole.

1. Overall Naturalness *

How natural does the system sound overall?

1 – Completely unnatural5 – Human-like

2. Overall Intelligibility *

How understandable is the system overall?

1 – Very difficult5 – Very clear

3. Would you use this voice in real applications? *

Yes Maybe No

4. Additional Comments Optional

Please provide feedback about pronunciation, rhythm, numbers, or clarity.

✓

Thank You!

Your evaluation has been recorded successfully.