To establish evidence for the reliability and validity of the Philips IntelliSpace Cognition (ISC) digital test battery.

ISC is a cloud-based digital cognitive assessment platform that is classified as an FDA Class II medical device. It consists of digitized versions of traditional cognitive tests. Although the tests are similar to their traditional versions, digital testing might introduce unforeseen differences in the psychometric properties of tests. We conducted a large study to establish evidence for reliability and validity in a representative sample of healthy US-based adults.

Reliability was assessed in a sample of 102 US-based participants who completed either the ISC battery or a traditional version of the battery twice across two consecutive visits. We calculated and compared separate test-retest correlations for the traditional and ISC test versions. Validity was assessed in another sample of 200 US-based participants who completed each version once across two consecutive visits. We assessed equivalence between modalities through Pearson correlations and equivalence tests. In addition, we conducted measurement invariance analyses based on confirmatory factor analysis to assess whether performance on both test versions was related to the same underlying cognitive domains.

Test-retest correlations for the traditional tests ranged from .29 to .89, and the ISC test-retest correlations ranged from .37 to .79. In general, the retest correlations for the ISC tests were lower compared to the traditional tests. In addition, the correlations between test versions ranged from .55 to .76. Importantly, measurement invariance analyses indicated that both modalities measured the same underlying cognitive domains.

The findings demonstrate broad support for both the reliability and validity of the ISC test battery. Despite small differences between modalities, performance on the ISC test versions can be interpreted in the same way as their traditional counterparts, provided that digital norms are used.