Background Chronic low back pain (CLBP) is a major economic and social problem worldwide. Despite the variety of recommended treatments, long-term self-management of this condition is complex and requires the development of innovative interventions. Mobile health (mHealth) technologies hold great promise for the management of chronic pain, particularly to support physical activity. However, their implementation is challenged by a lack of user compliance and limited engagement, which may be due to insufficient consideration of the needs of potential users during development. Objective This study aims to explore the needs of people with CLBP and health care professionals regarding mHealth technologies to support self-managed physical activity, and to delineate design recommendations based on identified needs. Methods A participatory study was conducted using a 3-phase, user-centered design approach: needs investigation with a group of experts in a workshop (phase 1), needs exploration with end users in focus groups (phase 2), and validation of needs using Delphi questionnaires followed by the development of a set of recommendations (phase 3). Results A total of 121 people with CLBP, expert patients, health care professionals, rehabilitation researchers, and biomechanical engineers participated in this study. The results indicated how technology could help people with CLBP overcome their difficulties with managing physical activity. Specific needs were formulated concerning device objectives, expected strategies, functionalities, technical features, conditions of use, and potential facilitators and barriers to use. These needs were validated by consensus from the potential end users and translated into design recommendations. Conclusions This study provides design recommendations for the development of an mHealth device specifically adapted for people with CLBP.