according toMicrosoft Research AsiaOfficials have disclosed that the institute is in partnership withShanghaiThe city's mental health centers have teamed up to conduct a joint study based on the Microsoft Azure OpenAI service in theMultimodal large model, was developed to utilize multiple modal data (Such as voice, text, pictures, music and other information), a framework for personalized cognitive training, opens up new possibilities for cognitive training in patients with cognitive impairment.
Microsoft Research Asia has learned that by integrating the recommendations of experts from the Shanghai Mental Health Center and the needs of patients, researchers from Microsoft Research Asia have developed a personalized cognitive training framework, "ReMe", based on the dimensions of ease-of-use, user-friendliness of the interface, professionalism in functionality, and ease-of-entry.The tool is based on the Microsoft Azure OpenAI service model, with instant interactive response function, supporting text, image, voice and other modal input and output, providing users with a new cognitive training experience in the form of a conversational robot.
In terms of process and functionality, the personalized cognitive training framework "Remember Me" starts with the uploading of personal memories through cell phones or wearable devices, and then adopts a more life-like approach.Individualized situational memory or open memory training for world knowledge. The researchers also provide a training framework that allows researchers such as physicians in the field to quickly create personalized training games using built-in cognitive game templates. On top of that, the tool includes interactive assessments to keep track of a patient's cognitive level and adjust training tasks as needed.
Not only that, Microsoft Research Asia and Shanghai Mental Health Center are continuously expanding more training functions and tasks to the training framework. In addition to open and individualized training tasks, the natural interaction experience through voice dialogues is also compatible with and implements mature cognitive training tasks that have been verified to be effective.Examples include color recognition, which exercises flexibility of thought, and mathematical operations, which exercise working memory.At the same time. At the same time, Microsoft Research Asia is also trying to record important nodes and events in daily life in an opportunistic sensing way through wearable devices based on sensor technology to promote more convenient personalized personal memory training.