ISSN:0737-0024    

DOI:10.1080/07370024.1997.9667238

出版商:Lawrence Erlbaum Associates, Inc.    

年代:1997

数据来源: Taylor

摘要:

Although graphical interfaces have provided a host of advantages to the majority of computer users, they have created a significant barrier to blind computer users. To meet the needs of these users, a methodology for transforming graphical interfaces into nonvisual interfaces has been developed. In this design, the salient components of graphical interfaces are transformed into auditory interfaces. Based on a hierarchical model of the graphical interface, the auditory interface utilizes auditory icons to convey interface objects. Users navigate the interface by traversing its hierarchical structure. This design results in a usable interface that meets the needs of blind users and provides many of the benefits of graphical interfaces.

ISSN:0737-0024    

DOI:10.1080/07370024.1997.9667239

出版商:Lawrence Erlbaum Associates, Inc.    

年代:1997

数据来源: Taylor

摘要:

Mathematics relies on visual forms of communication and is thus largely inaccessible to people who cannot communicate in this manner because of visual disabilities. This article outlines the Mathtalk project, which addressed this problem by using computers to produce multimodal renderings of mathematical information. This example is unusual in that it is essential to use multiple modalities because of the nature and the difficulty of the application. In addition, the emphasis is on nonvisual (and hence novel) modalities. Crucial to designing a usable auditory interface to algebra notation is an understanding of the differences between visual and listening reading, particularly those aspects that make the former active and the latter passive. A discussion of these differences yields the twin themes of compensation for lack of external memory and provision of control over information flow. These themes were addressed by: the introduction of prosody to convey algebraic structure in synthetically spoken expressions; the provision of structure-based browsing functions; and the use of a prosody-based musical glance based on algebra earcons. The addition of prosody, when compared to a traditional method of presenting spoken algebra, was experimentally shown to increase the recovery of algebraic structure, enhance the retention of content, and reduce mental workload. These three factors can be said to compensate for the lack of an adequate external memory. Evaluations showed that the browsing functions and associated command language gave the fast and accurate control over information flow that is necessary for active reading. The algebra earcon was experimentally shown to convey the presence, location, and size of algebraic constructs within an expression in a manner that might be used as a rapid glance. Finally, an evaluation of the integrated components showed that the design principles derived from the Mathtalk program can give a more usable, active reading of algebra notation than that possible with traditional methods.

ISSN:0737-0024    

DOI:10.1080/07370024.1997.9667240

出版商:Lawrence Erlbaum Associates, Inc.    

年代:1997

数据来源: Taylor

摘要:

Dynamic interactive maps with powerful interface capabilities are beginning to emerge for a variety of geographical information systems, including ones situated on portables for travelers, students, business and service people, and others working in field settings. In part through the design of more expressive and flexible input capabilities, these map systems can provide new capabilities not supported by conventional interfaces of the past. In this research, interfaces supporting spoken, pen-based, and multimodal input were analyzed for their effectiveness in interacting with map systems. Input modality and map display format were varied as people completed realistic tasks with a simulated map system. The results identified a constellation of performance difficulties with speech-only map interactions, including elevated performance errors, lengthier task completion time, and more complex and disfluent input—problems that declined substantially when people could interact multimodally. These difficulties also mirrored a strong user preference to interact multimodally. The error-proneness and unacceptability of speech-only input to maps was traced to people's difficulty articulating spatially oriented descriptions. Analyses also indicated that map displays can be structured to minimize performance errors and disfluencies effectively. Implications of this research are discussed for the design of high-performance multimodal interfaces for future map systems.

ISSN:0737-0024    

DOI:10.1080/07370024.1997.9667241

出版商:Lawrence Erlbaum Associates, Inc.    

年代:1997

数据来源: Taylor

摘要:

New user interface challenges are arising because people need to explore and perform many diverse tasks involving large quantities of abstract information. Visualizing information is one approach to these challenges. But visualization must involve much more than just enabling people to "see" information. People must also manipulate it to focus on what is relevant and reorganize it to create new information. They must also communicate and share information in collaborative settings and act directly to perform their tasks based on this information. These goals suggest the need for information visualization workspaces with new interaction approaches. We present several systems—Visage, SAGE, and selective dynamic manipulation (SDM)—that comprise such a workspace and a suite of user interface techniques for creating and manipulating integrative visualizations. Our work in this area revealed the need for interfaces that enable people to communicate with systems in multiple complementary ways. We discuss four dimensions for analyzing user interfaces that reveal the combination of design approaches needed for visualizations to support information analysis tasks effectively. We discuss the results of our attempts to provide multiple forms of expression using direct manipulation and propose areas where multimodal techniques are likely to be more effective.

ISSN:0737-0024    

DOI:10.1080/07370024.1997.9667242

出版商:Lawrence Erlbaum Associates, Inc.    

年代:1997

数据来源: Taylor

摘要:

A multimodal presentation planning mechanism must take into consideration the structure of the discourse and the constraints imposed by discourse relations. This requires that different processes that perform multimodal presentation planning be able to communicate with each other. In this article, we introduce a multiagent architecture based on the blackboard system that satisfies this requirement. In addition, we describe a constraint propagation mechanism that transfers plan constraints from one level of the presentation planning process to the next, and we discuss the cooperation and negotiation processes between modality-specific agents in a prototype system that implements the multiagent planning mechanism.

ISSN:0737-0024    

DOI:10.1080/07370024.1997.9667243

出版商:Lawrence Erlbaum Associates, Inc.    

年代:1997

数据来源: Taylor