MuMIES (Multi-modal Interface based Education and Support) system: An Open Source Android Application
This research presents an investigation into the development of a Smartphone based multi-modal learning platform for children with special needs. This includes three steps: (i) an ethnographic case study on special needs children to identify their learning activities for software requirement analysis, (ii) children focused user friendly interface design and,3 (iii) intelligent modelling for behaviour analysis for guided learning. In order to achieve these objectives, an ethnographic case study is conducted to demonstrate how the special needs children overcome various learning difficulties using existing digital technologies. Our first phase of the research suggests that an
intelligent multimodal interface can enable them to become independent, develop social interactions and skills, and release personal excellence. A preliminary evaluation and analysis of the proposed system shows very encouraging results. The interaction with the proposed system seemed to have, in general, a positive influence on the learning ability development of the children.
For current status of the research, todo and participation, please visit the link below