Computer scientists at the University of North Carolina at Chapel Hill have developed software and an augmented reality (AR) headset that allows clinicians to analyze the movements of people with Parkinson’s disease to help guide physical therapy.
Clinicians can also use their AR headsets to immerse themselves in the patient’s reality by replaying the patient’s activities.
Parkinson’s disease is caused by the loss of neurons (nerve cells) that produce dopamine, a signaling molecule that helps control movement. As a result, patients develop motor symptoms such as tremors, stiffness and rigidity, and difficulty with balance, which increases the risk of falls.
Physical activity may help reduce motor symptoms and slow disease progression
Reduced physical activity is associated with a rapid decline in motor function in people with Parkinson’s disease, and there is evidence to suggest that increased physical activity can reduce motor symptoms and slow disease progression.
Physical therapy plays an important role in improving the quality of life for people with Parkinson’s disease. However, not all patients have insurance that covers regular physical therapy sessions. Additionally, patients in rural areas or those with limited walking ability often do not have access to facilities that support this type of care.
To overcome these limitations, researchers at the University of North Carolina at Chapel Hill (UNC-Chapel Hill), in collaboration with physicians at the University of the Carolinas, launched the Augmented Reality Parkinson’s Disease Project.
Patients wear an AR headset and motion sensors that track their movements and interactions with their surroundings. This software allows clinicians to observe and analyze patient movements in real-world home environments.
“The only technology that can capture this data is the technology you wear every day,” said Henry Fuchs, Federico Gil Distinguished Professor of Computer Science at UNC-Chapel Hill and one of the researchers involved in the project. Dr. University news articles.
This is ideal for Parkinson’s disease, but can also be applied to so many different conditions for rehabilitation.
The project uses PD-Insighter software developed by PhD student Jade Kandel
The project leverages the power of the PD-Insighter software, developed by computer science doctoral student Jade Kandel under the supervision of Dr. Daniel Zafir, assistant professor of computer science, and Fuchs.
“What do you do with all this data?” Zafir said. “How do we make it intuitive? How do we enable people to use their expertise so that they don’t have to be professional data scientists to make sense of all the information coming in?”
The software combines graphics and data visualization with a desktop dashboard that summarizes patient behavior and quickly identifies “freezes” and movement disorders, allowing clinicians to spend minutes instead of hours. You can check the data.
AR glasses are different from virtual reality headsets typically used in gaming. The person wearing it can see their surroundings, but it is enhanced with graphics.
Clinicians can use headsets to understand patient movement patterns
In addition, clinicians can use their AR headsets to see a digital recreation of the patient’s 3D anatomy and patient environment.
“So what will you be wearing every day in 10 years?” We think it will be your glasses. The glasses have several cameras that can look out, look down, and look in, so they can capture things like your facial expressions and your body,” Fuchs said. .
Although the project was initially developed for Parkinson’s disease, researchers believe the software could also provide support to patients with other conditions, such as those who have experienced a stroke or are recovering from surgery. thinking about.
“I love thinking about that. Yes, this is great for Parkinson’s disease, but it can also be applied to so many different conditions for rehabilitation,” Kandel said.
