The development of artificial intelligence (AI) is rapidly expanding, showing promise in the dermatological field. Skin checks are a resource-heavy challenge that could potentially benefit from AI-tool assistance, particularly if provided in widely available AI solutions. A novel smartphone application(app)-based AI system, "SCAI," was developed and trained to recognize spots in paired images of skin, pursuing identification of new skin lesions. This pilot study aimed to investigate the feasibility of the SCAI-app to identify simulated skin changes in vivo. The study was conducted in a controlled setting with healthy volunteers and standardized, simulated skin changes (test spots), consisting of customized 3-mm adhesive spots in three colors (black, brown, and red). Each volunteer had a total of eight test spots adhered to four areas on back and legs. The SCAI-app collected smartphone- and template-guided standardized images before and after test spot application, using its backend AI algorithms to identify changes between the paired images. Twenty-four volunteers were included, amounting to a total of 192 test spots. Overall, the detection algorithms identified test spots with a sensitivity of 92.0% (CI: 88.1-95.9) and a specificity of 95.5% (CI: 95.0-96.0). The SCAI-app's positive predictive value was 38.0% (CI: 31.0-44.9), while the negative predictive value was 99.7% (CI: 99.0-100). This pilot study showed that SCAI-app could detect simulated skin changes in a controlled in vivo setting. The app's feasibility in a clinical setting with real-life skin lesions remains to be investigated, where the challenge with false positives in particular needs to be addressed.