Beschreibungmypie is a multimodal interface enabling users to access Gmail, Gcontact and Gcalendar using voice and visual modality. A single voice command can check and search desired email or calendar entries. Also supported is a calendar quick-add using voice, such as "Schedule a meeting with Tom at 3PM next Tuesday" will instantly show the new schedule on the screen, to be confirmed before added to a calendar. Email can be searched by saying, "Mail from Tom today", will find out all Tom's email received today. To make a phone call, simply saying, "Make a phone call to Tom" which will ask to choose desired phone number if Tom has multiple phone types in the contact. All these voice commands can be issued at the mypie main menu, which provides instant access to Email, Contact and Calendar. When voice utterence is not proper, the screen menu can be used to check, search or add your information.
Since the mypie voice and visual input sensors are always simultaneously active, users can choose the modality at any way wanted to complete a transaction. For instance, user can open up the mail search window by selecting the menu. Then the user can say the subject keyword to search, rather than typing in. This is the advantage of the multimodality interaction.