Current limitations in technology-based cognitive assessment for severe mental illnesses: a focus on feasibility, reliability, and ecological validity

Cognitive impairments are frequently observed in subjects with severe mental illnesses (SMI), leading to a remarkable impact in their real-world functioning. Well-validated and gold standard instruments are available for the assessment of cognitive deficits, but different limitations should be considered, such as the need for specific training, lengthy administration times, practice effects, or reliance on subjective reports. Recent advances in digital technologies, such as ecological momentary assessments (EMA), virtual reality (VR), and passive digital phenotyping (DP), offer promising complementary approaches for capturing real-world cognitive functioning. In the current mini-review, we examine current research gaps that limit the application of these technologies, with a specific focus on feasibility, reliability and ecological validity. EMA may capture real-world functioning by increasing the number of evaluations throughout the day, but its use might be hindered by high participant burden and missing data. Furthermore, to achieve an accurate interpretation of EMA, studies should account for sampling and moment selection biases and the presence of several confounding factors. DP faces significant ethical and logistical challenges, including privacy and informed consent concerns, as well as challenges in data interpretation. VR could serve as a platform for both more ecologically valid cognitive assessments and rehabilitation interventions, but current barriers include technological and psychometric limitations, underdeveloped theoretical frameworks, and ethical considerations. Addressing these issues is crucial for ensuring that these novel technologies can effectively serve as valuable complements to traditional neuropsychological cognitive batteries.