The performance of real‐time speech recognition systems is observed to depend upon the environments in which they are used. Human factors, caused for example by operator frustration, significantly affect success rates. A set of experiments with a word recognition system is described which quantifies this change, whilst the system is being used to control the movement of a displayed cross on a screen.