Conversion of Videoconference Speech into Text based on WebRTC and Web Speech APIs

Abstract

The spread of coronavirus disease necessitates a significant demand for videoconference meetings increases, such as work meetings, eLearning, healthcare. Moreover, some of the participants in the videoconference may prefer to read the speech of the other participants as a text. This paper presents a solution that converts the speech of videoconference participants in to text in real time. The proposed solution depends on modern browsers JavaScript application programming interfaces (APIs): Web Real-Time Communication (WebRTC) APIs and Web Speech API that enable developers to develop applications for video conferences, chatting, sharing desktop, or sharing data in real-time between browsers, and also convert speech to text in real time. The proposed solution has used OpenVidu framework, that is an open-source videoconference application based on WebRTC technology. Then, adding the feature of speech to text by developing the frontend of OpenVidu framework by integration with Web Speech API.