Smart phone-based context-aware augmentative and alternative communications system

Abstract

A smartphone-based context-aware augmentative and alternative communication (AAC) was applied was in order to enhance the user’s experience by providing simple, adaptive, and intuitive interfaces. Various potential context-aware technologies and AAC usage scenarios were studied, and an efficient communication system was developed by combining smartphone’s multimedia functions and its optimized sensor technologies. The experimental results show that context-awareness accuracy is achieved up to 97%.

Keywords

augmentative alternative communication system / context awareness / mobile system / location based services

References

[1] McnaughtonD, LightJ. The iPad and mobile technology revolution: Benefits and challenges for individuals who require augmentative and alternative communication [J]. Augmentative and Alternative Communication, 2013, 29(2): 107-116

[2] ShaneH C, LaubscherE H, SchlosserR W, FlynnS, SorceJ F, AbrmsonJ. Applying technology to visually support language and communication in individuals with autism spectrum disorders [J]. Journal of Autism and Developmental Disorders, 2012, 42(6): 1228-1235

[3] LiuJ-b, ChenR-z, PeiL, GuinnessR, KuusniemiH. A hybrid smartphone indoor positioning solution for mobile LBS [J]. Sensors, 2012, 12: 17208-17233

[4] WilkinsonK M, LightJ, DragerK. Considerations for the composition of visual scene displays: Potential contributions of information from visual and cognitive sciences [J]. Augmentative and Alternative Communication, 2012, 28(3): 137-147

[5] BeukelmanD, MirendaPAugmentative and alternative communication: Supporting children and adults with complex communication needs [M], 20134th edBaltimore, MD, Paul Brookes Publishing Co.: 120-210

[6] SchiltB, AdamsN, WantN R. Context-aware computing applications [C]. Proceedings of the 1st International Workshop on Mobile Computing Systems and Applications, 1994, Santa Cruz, CA, IEEE: 85-90

[7] ArcherL A. Blissymbolic-A nonvocal communication system [J]. Journal of Speech and Hearing Disorders, 1977, 42(4): 568-579

[8] KrishnamurthyS, ChakrabortyD, JindalS, MittalS. Context-based adaptation of mobile phones using near-field communication [C]. Mobile and Ubiquitous Systems-Workshops, 2006, San Jose, CA, IEEE: 1-10

[9] DaveH. Mobile technology and AAC apps from an AAC developer’s perspective [J]. SIC 12 Perspectives on Augmentative and Alternative Communication, 2011, 20(1): 28-33

[10] FernandesB. iTherapy: The revolution of mobile devices within the field of speech therapy [J]. Perspectives on School-Based Issues, 2011, 12(2): 35-40

[11] ParkD G, HanK I, KimS H. Developing a digital device, named ATTI, as an augmentative and alternative communication aid [C]. International Symposium on Augmentative Alternative Communications, 2010, Barcelona, Spain, IEEE: 234-240

[12] QuerciaD, LathiaN, CalabreseF, LorenzoG D, CrewcroftJ. Recommending social events from mobile phone location data [C]. IEEE International Conference on Data Mining, 2010, Vancouver, Canada, IEEE: 971-976

[13] AssistivewareB VProloguo2go. Assistive Ware-Proloque2go official web site [EB/OL], 2013

[14] SilverKTouch chat ACC with word power [EB/OL], 2014

[15] PockettappsCEasy speak [EB/OL], 2011

[16] SpeechCAAC-scroll and speak [EB/OL], 2011