Delwedd Flaen

Evaluating the Markov assumption in Markov Decision Processes for spoken dialogue management

Wedi'i Gadw mewn:
Cyhoeddwyd yn:Language Resources and Evaluation vol. 40, no. 1 (Feb 2006), p. 47-66
Prif Awdur: Paek, Tim
Awduron Eraill: David Maxwell Chickering
Cyhoeddwyd:
Springer Nature B.V.
Pynciau:
Markov analysis
Decision making models
Verbal communication
Voice communication
Speech
Reinforcement
Beliefs
Computer simulation
Optimization
Markov chains
Simulation
Experiments
Action
Assumptions
Models
Robustness
Alternative approaches
Mynediad Ar-lein:Citation/Abstract
Full Text
Full Text - PDF
Tagiau: Ychwanegu Tag
Dim Tagiau, Byddwch y cyntaf i dagio'r cofnod hwn!
Crynodeb:The goal of dialogue management in a spoken dialogue system is to take actions based on observations and inferred beliefs. To ensure that the actions optimize the performance or robustness of the system, researchers have turned to reinforcement learning methods to learn policies for action selection. To derive an optimal policy from data, the dynamics of the system is often represented as a Markov Decision Process (MDP), which assumes that the state of the dialogue depends only on the previous state and action. In this article, we investigate whether constraining the state space by the Markov assumption, especially when the structure of the state space may be unknown, truly affords the highest reward. In simulation experiments conducted in the context of a dialogue system for interacting with a speech-enabled web browser, models under the Markov assumption did not perform as well as an alternative model which classifies the total reward with accumulating features. We discuss the implications of the study as well as its limitations. [PUBLICATION ABSTRACT]
ISSN:1574-020X
1574-0218
0010-4817
DOI:10.1007/s10579-006-9008-2
Ffynhonnell:Arts & Humanities Database