A survey on metrics for the evaluation of user simulations
Guardado en:
| Publicado en: | The Knowledge Engineering Review vol. 28, no. 1 (Mar 2013), p. 59-73 |
|---|---|
| Autor principal: | |
| Otros Autores: | |
| Publicado: |
Cambridge University Press
|
| Materias: | |
| Acceso en línea: | Citation/Abstract Full Text - PDF |
| Etiquetas: |
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 1289469692 | ||
| 003 | UK-CbPIL | ||
| 022 | |a 0269-8889 | ||
| 022 | |a 1469-8005 | ||
| 024 | 7 | |a 10.1017/S0269888912000343 |2 doi | |
| 035 | |a 1289469692 | ||
| 045 | 2 | |b d20130301 |b d20130331 | |
| 084 | |a 79065 |2 nlm | ||
| 100 | 1 | |a Pietquin, Olivier | |
| 245 | 1 | |a A survey on metrics for the evaluation of user simulations | |
| 260 | |b Cambridge University Press |c Mar 2013 | ||
| 513 | |a Feature | ||
| 520 | 3 | |a Abstract User simulation is an important research area in the field of spoken dialogue systems (SDSs) because collecting and annotating real human-machine interactions is often expensive and time-consuming. However, such data are generally required for designing, training and assessing dialogue systems. User simulations are especially needed when using machine learning methods for optimizing dialogue management strategies such as Reinforcement Learning, where the amount of data necessary for training is larger than existing corpora. The quality of the user simulation is therefore of crucial importance because it dramatically influences the results in terms of SDS performance analysis and the learnt strategy. Assessment of the quality of simulated dialogues and user simulation methods is an open issue and, although assessment metrics are required, there is no commonly adopted metric. In this paper, we give a survey of User Simulations Metrics in the literature, propose some extensions and discuss these metrics in terms of a list of desired features. [PUBLICATION ABSTRACT] | |
| 653 | |a Computer simulation | ||
| 653 | |a Systems design | ||
| 653 | |a Machine learning | ||
| 653 | |a Simulation | ||
| 653 | |a Datasets | ||
| 653 | |a Performance evaluation | ||
| 653 | |a Interactive computer systems | ||
| 653 | |a Human-computer interaction | ||
| 653 | |a User behavior | ||
| 700 | 1 | |a Hastie, Helen | |
| 773 | 0 | |t The Knowledge Engineering Review |g vol. 28, no. 1 (Mar 2013), p. 59-73 | |
| 786 | 0 | |d ProQuest |t ABI/INFORM Global | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/1289469692/abstract/embedded/7BTGNMKEMPT1V9Z2?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text - PDF |u https://www.proquest.com/docview/1289469692/fulltextPDF/embedded/7BTGNMKEMPT1V9Z2?source=fedsrch |