Chatbot listing, virtual agents, virtual assistants, chat bot directory, conversational agents, virtual human news, chatterbot list
NEWS: Chatbots.org survey on 3000 US and UK consumers shows it is time for chatbot integration in customer service!read more..
Different measurements metrics to evaluate a chatbot system
A chatbot is a software system, which can interact or “chat” with a human user in
natural language such as English. For the
annual Loebner Prize contest, rival chatbots have been assessed in terms of ability
to fool a judge in a restricted chat session.
We are investigating methods to train and
adapt a chatbot to a specific user’s language use or application, via a usersupplied training corpus. We advocate
open-ended trials by real users, such as an
example Afrikaans chatbot for Afrikaansspeaking researchers and students in
South Africa. This is evaluated in terms of
“glass box” dialogue efficiency metrics,
and “black box” dialogue quality metrics
and user satisfaction feedback. The other
examples presented in this paper are the
Qur'an and the FAQchat prototypes. Our
general conclusion is that evaluation
should be adapted to the application and
to user needs.
| Download Paper | |
| Full Title | Different measurements metrics to evaluate a chatbot system |
| Year | 2007 |
| Language | English |
| Book | Bridging the Gap: Academic and Industrial Research in Dialog Technologies |
| Keywords | chatbot, Loebner Prize contest, natural language processing, Afrikaans chatbot, dialogue efficiency metrics, dialogue quality metrics, user satisfaction feedback |
| Synonym | Chatbot |
New Comment
Only registered members are allowed to comment.
or login
Browse Topics
