Abstract
This paper presents the architecture, data processing modules as well as work algorithms of the developed system of distributed event support. The developed system is based on audio, video and presentation equipment state analysis choices a multimedia context for remote participants for discussion understanding. In addition, the system forms report data of meeting results by defined templates. The paper presents the architecture of control server and developed system, which includes five main modules for audiovisual data processing. The example of modules work mode changing and synchronization of audio and video content for transmitting remote participant, depended on receiving events from sound source localization, videomonitiong and multimedia devices control modules, is described. The organization of interaction between modules for formation of meeting multimedia report and history of participants behavior is considered. The structure of relational database main part, which is used for storage data from soft and hardware modules as well as information about carried out meetings and participants, is described. The structure of a relational database, which is used for store of data from various hardware and software modules, and information on the events and their participants, is considered. The experimental results show that time for displaying of a wrong content was about 3 % at whole time of meeting. The developed system is implemented in a smart room of SPIIRAS and is used during distributed meetings.
Keywords: intelligent environments, distributed event support, videoconferencing, distant learning, computer vision, audiovisual data processing, multimodal interfaces, web applications
Authors:
V.Yu. BUDKOV
St.Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences, 39, 14-th Line V.O., St. Petersburg, 199178, Russia, Ph.D., e-mail: budkov@iias.spb.su
M.V. PRISHCHEPA
St.Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences, 39, 14-th Line V.O., St. Petersburg, 199178, Russia, Ph.D., e-mail: prischepa @iias.spb.su
A.L. RONZHIN
St.Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences, 39, 14-th Line V.O., St. Petersburg, 199178, Russia, Ph.D., e-mail: ronzhinal @iias.spb.su
A.I. SAVELIEV
St.Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences, 39, 14-th Line V.O., St. Petersburg, 199178, Russia, e-mail: saveliev @iias.spb.su
References
1. Erol B., Li Y. An overview of technologies for e-meeting and e-lecture. Proceedings IEEE International Conference on Multimedia and Expo. 2005. P. 6-12.
2. Cicco L., Mascolo S., Palmisano V. Skype Video congestion control: An experimental investigation. Computer Networks, 2011, vol. 55, iss. 3, pp. 558-571.
3. Ganbat D., Ronzhin A.L., Naidandorzh R., Budkov V.Yu., Prishchepa M.V. Razrabotka veb-sistemy dlya pre-dostavleniya obuchayushchikh servisov udalennym mobil'nym pol'zovatelyam [Development of web-system for providing learning services for remote mobile users]. Trudy SPIIRAN – SPIIRAS Proceedings, 2010, iss. 1 (12), pp. 21-34.
4. Volfin I., Cohen I. Dominant speaker identification for multipoint videoconferencing. Computer Speech and Language, 2013, vol. 27, iss. 4, pp. 895-910.
5. Basov O.O., Nosov M.V., Shalaginov V.A. Issledovanie kharakteristik dzhittera perioda osnovnogo tona rechevogo signala [Pitch-jitter analysis of the speech signal]. Trudy SPIIRAN – SPIIRAS Proceedings, 2014, iss. 1 (32), pp. 27-34.
6. Ronzhin A.L., Budkov V.Yu. Tekhnologii podderzhki gibridnykh e-soveshchanii na osnove metodov audiovi-zual'noi obrabotki [Support Technologies of E-Meetings Based on Methods for Audiovisual Processing]. Vestnik komp'yuternykh i informatsionnykh tekhnologii – Herald of computer and information technologies, 2011, no. 4, pp. 31-35.
7. Wu D., Liang C., Liu Y., Ross K.W. Redesigning multi-channel P2P live video systems with View-Upload Decoupling. Computer Networks, 2010, vol. 54, iss. 12, pp. 2007-2018.
8. Savel'ev A.I., Prishchepa M.V. Arkhitektura obmena dannymi bez poter' v piringovom veb-prilozhenii videokonferents-svyazi [Architecture of lossless data exchange in pear-to-pear web application of videoconference]. Doklady Tomskogo gosudarstvennogo universiteta sistem upravleniya i radioelektroniki – Proceedings of Tomsk State University of Control Systems and Radioelectronics, 2014, no. 2 (32), pp. 238-245.
9. Savel'ev A.I. Optimizatsiya algoritmov raspredeleniya potokov mul'timediinykh dannykh mezhdu serverom i klientom v prilozheniyakh videokonferentssvyazi [Optimization algorithms distribution streams of multimedia data between server and client in videoconferencing application]. Trudy SPIIRAN – SPIIRAS Proceedings, 2013, iss. 8 (31), pp. 61-79.
10. Meshcheryakov R.V. Struktura sistem sinteza i raspoznavaniya rechi [Structure of speech synthesis and recognition systems]. Izvestiya Tomskogo politekhnicheskogo universiteta – Bulletin of the Tomsk Polytechnic University, 2009, vol. 315, no. 5, pp. 127-132.
11. Ronzhin A.L. Topologicheskie osobennosti morfofonemnogo sposoba predstavleniya slovarya dlya raspo-znavaniya russkoi rechi [Topological features of a morfofonemny way of submission of the dictionary for recognition of the Russian speech]. Vestnik komp'yuternykh i informatsionnykh tekhnologii – Herald of computer and information technologies, 2008, no. 9, pp. 12-19.
12. Tiunov S.D., Meshcheryakov R.V., Chernykh D.V. Optimizatsiya vychisleniya odnovremennoi maskirovki rechevogo signala [Optimization of calculation of frequency masking of speech signal]. Trudy SPIIRAN – SPIIRAS Proceedings, 2014, iss. 1 (32), pp. 45-57.
13. Ronzhin A., Budkov V., Karpov A. Multichannel System of Audio-Visual Support of Remote Mobile Participant at E-Meeting. Smart Spaces and Next Generation Wired/Wireless Networking. Third Conference on Smart Spaces, ruSMART 2010, and 10th International Conference, NEW2AN 2010, St. Petersburg, Russia, August 23-25, 2010. Proceedings. Berlin, Heidelberg, Springer-Verlag, 2010. Lecture Notes in Computer Science, 2010, vol. 6294, pp. 62-71. DOI: 10.1007/978-3-642-14891-0_6
