close

Вход

Забыли?

вход по аккаунту

?

JP2005123959

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2005123959
PROBLEM TO BE SOLVED: To provide a highly realistic communication conference device which
can hear an opinion or look at it with eyes and can feel a situation of speaking and feel a sense of
presence participating in a conference. SOLUTION: An information input device 1 provided to a
false head 2, a posture control device 3 provided to a false head 2, devices 10 and 11 for
grasping the movement of the head of a remote place participant 9, a remote place participant In
the highly realistic communication conference apparatus having the information presentation
apparatus 8 for 9, the pseudo head is installed at a predetermined position in the conference
center, and the information input apparatus 1 is installed at a position corresponding to both
ears of the pseudo head 2. The remote participant 9 has a binaural sound reproducing device 25
for reproducing the acoustic signal collected by the sound collection device on both ears of the
remote participant 9, and the voice of the remote participant 9 is collected. Highly realistic
communication with a pseudo-head speech apparatus 41 having a participant sound-collecting
device 42 that sounds, and reproducing an acoustic signal picked up by the participant soundcollection device 42 at a position corresponding to the mouth of the pseudo head 2 Conference
equipment. [Selected figure] Figure 5
High reality communication conference device
[0001]
The present invention relates to a highly realistic communication apparatus, and in particular, a
configuration in which a pseudo head is installed in a conference hall on behalf of a conference
participant in a remote area is employed, and the remote participant actually participates in the
conference in the conference hall. A high presence communication meeting where you can feel
the situation you are speaking by hearing opinions or looking at your eyes like you are, and
actually speaking in a conference room It relates to the device.
10-05-2019
1
[0002]
The conventional communication conference apparatus picks up the voice of the speaker at the
conference hall with a microphone, and transmits the picked up voice signal and the position
information of the speaker to a remote place.
The remote location has a database of sound image localization filters corresponding to the
position of the speaker and the position of the speaker, and the remote voice participant
performs processing of the sound source localization filter corresponding to the position of the
speaker on the received voice signal. Faithfully simulate and generate binaural signals that would
be heard at the conference hall. When a remote participant listens to this binaural signal with a
headphone or a speaker equivalent thereto, he can hear the voice of the speaker at the
conference place with a sense of localization (see Patent Documents 1 and 2).
[0003]
On the other hand, as a technique of binaural recording using a pseudo head, a basic technique
of manipulating the pseudo head from a remote place is also being studied (see Non-Patent
Document 1). Meanwhile, a technology has also been developed in which a small camera is
provided on a pseudo head adopting a configuration for binaural recording, and auditory-visual
composite information for adding visual information with good precision without discomfort to
auditory information to a remote place (See Patent Document 3). Japanese Patent Application
Laid-Open No. 07-303148 Japanese Patent Laid-Open No. 10-42396 Japanese Patent
Application Laid-open No. 5-153687 Toshiki, Toshio Uematsu, Tatsuya Hirahara, "Dummy head
following head movement", Proceedings of the Fall Meeting of the Acoustical Society of Japan
Shu, pp. 439-440 (2002)
[0004]
Since the techniques described in Patent Documents 1 and 2 use a database of sound image
localization filters, it is necessary to prepare in advance a database of an unspecified number of
participants, and even if the prepared sound image localization filters are localized There is a
problem that the performance of feeling does not have the theoretical effect in many cases. And
10-05-2019
2
the technique of the binaural recording disclosed by nonpatent literature 1 is not applied to a
teleconference as it is. That is, the technique of binaural recording using a pseudo head disclosed
in Non-Patent Document 1 is merely merely playing a voice at a remote place by setting
microphones on both ears of the pseudo head. .
[0005]
In addition, the technology described in Patent Document 3 also transmits auditory-visual
composite information that adds visual information with good precision without discomfort to
auditory information to a remote location, adds visual information, and simply makes auditory
information appropriate. It is only to be evaluated. After all, the techniques described in NonPatent Document 1 and Patent Document 3 take part in a teleconference held at a remote place,
as if remote participants are actually participating in the meeting at the conference hall. It is not
a technology relating to a teleconference device that seeks to realize listening to opinions or
seeing with eyes and actualizing the situation that they are speaking.
[0006]
The present invention adopts a configuration in which a pseudo head is installed in a conference
room on behalf of a remote conference participant, and the remote conference participant hears
an opinion as if actually participating in the conference in the conference room. Further, it is
possible to provide a highly-realistic communication conference apparatus which can see the
situation with eyes and feel the situation of speaking, and feel as if it were actually participating
in the conference at the conference hall.
[0007]
Claim 1: The pseudo head 2 simulating the head of the remote area participant 9 installed in the
conference hall, the information input device 1 provided on the pseudo head 2, the attitude
control device 3 provided on the pseudo head 2, remote A highly realistic communication
conference apparatus comprising devices 10 and 11 for grasping the movement of the head of
the ground participant 9, an information presentation device 8 for the remote participant 9, and
a device 6 for communicating between the conference hall and the remote location In the field,
the pseudo head 2 is installed at a predetermined position, and has the sound pickup devices 21
and 22 installed at positions corresponding to both ears of the pseudo head 2 as the information
input device 1. A participant collecting device 42 having a binaural sound reproducing device 25
for reproducing an acoustic signal collected by the sound collecting device in the ear, and having
a participant collecting device 42 for collecting the voice of the remote participant 9; A pseudo
head that reproduces an acoustic signal collected by the participant collecting device 42 at a
10-05-2019
3
position corresponding to the mouth To constitute a high sense of realism communication
conference device was installed voice device 41.
[0008]
And Claim 2: A pseudo head 2 simulating the head of the remote area participant 9 installed in
the conference hall, an information input device 1 equipped to the pseudo head 2, a posture
control device 3 equipped to the pseudo head 2 A highly real-time communication conference
apparatus comprising devices 10 and 11 for grasping the movement of the head of the remote
area participant 9, an information presentation apparatus 8 for the remote area participant 9,
and an apparatus 6 for communicating between the conference center and the remote area In the
conference hall, the pseudo head 2 is installed at a predetermined position, and has the sound
pickup devices 21 and 22 installed at positions equivalent to both ears of the pseudo head 2 as
the information input device 1; The binocular sound reproducing device 25 for reproducing the
sound signal collected by the sound collecting device in both ears of the image pickup devices
31, 32 installed at the position corresponding to the both eyes of the pseudo head 2; Video
display that presents video signals captured by the imaging device to both eyes of participant 9
To constitute a high virtual space teleconferencing system and a location 33.
[0009]
In a third embodiment of the highly realistic communication conference device according to the
first aspect of the present invention, the imaging devices 31 and 32 installed at positions
corresponding to both eyes of the pseudo head 2 and the remote participant 9 A highly realistic
communication conference apparatus is configured having a video display device 33 for
presenting a video signal captured by the imaging device to both eyes.
Furthermore, in the highly-realistic communication conference apparatus according to claim 3,
the binaural sound reproducing apparatus 25, the image display apparatus 33, and the
participant collecting apparatus 42 are integrated as a presentation apparatus 52. We
constructed a high reality communication conference device.
[0010]
In the highly-realistic communication conference apparatus according to any one of the first to
fourth aspects, the number of pseudo heads 2 installed in the conference center is equal to the
number of remote area participants. We constructed a highly realistic communication conference
device with multiple devices.
10-05-2019
4
[0011]
According to the present invention, an artificial head 2 simulating the head of a remote
participant 9 installed in a conference room, an information input device 1 provided on the
artificial head 2, an attitude control device 3 provided on the artificial head 2, a remote Highly
immersive communication conference apparatus comprising devices 10, 11 for grasping the
movement of the head of the ground participant 9, information presentation equipment 8 for the
remote participant 9, and equipment 6 for communicating between the conference hall and the
remote location The sound pickup devices 21 and 22 installed at positions corresponding to both
ears of the pseudo head 2 as the input device 1 are used to reproduce an acoustic signal
collected by the sound collection device on both ears of the remote participant 9 A participant
collecting device 42 having a binaural sound reproducing device 25 and picking up the voice of
the remote participant 9 and collecting the participant sound collecting device 42 at a position
corresponding to the mouth of the pseudo head 2 It comprises the structure which installs the
pseudo | simulation head speech apparatus 41 which reproduces | regenerates the acoustic
signal.
That is, by adopting a configuration in which the pseudo head 2 is installed in the conference
room on behalf of the conference participants in the remote area, the opinion is heard as if the
conference participants in the remote area are actually participating in the conference at the
conference area You can feel the situation you are speaking, and feel as if you are actually
participating in the conference at the conference hall.
[0012]
The imaging devices 31 and 32 installed at positions corresponding to the two eyes of the
pseudo head 2 and the video display device 33 for presenting the video signal captured by the
imaging device to both eyes of the remote participant 9 By setting it as a highly realistic
communication conference device, in addition to listening to opinions, it is possible to also realize
the situation that you are looking at with eyes, and to feel more realism of actually participating
in the conference in the conference hall Can.
Further, by combining the binaural sound reproducing device 25, the image display device 33,
and the participant collecting device 42 in a compact form as a presentation device 52 and
10-05-2019
5
integrating them together, vision in a situation similar to that performed by human beings with
the ear Since the perceptual information is perceived and sound is collected at the mouth to be
produced, high S / N voice information can be picked up without a sense of incongruity, and the
presentation device 52 can be easily worn and handled.
[0013]
The best mode for carrying out the invention will be described with reference to the
embodiments shown in the drawings.
FIG. 1 is a diagram for comprehensively explaining an embodiment. 1 is an information input
device, 2 is a pseudo head simulating the head of a remote conference participant installed in the
conference hall, 3 is an attitude control device for moving the pseudo head, 4 is a motor control
device, 5 is a conference hall A communication processor 6, a network 7, a communication
processor at a remote location, 8 an information presentation device, 9 a remote location
participant, 10 a head movement detection device, and 11 a head movement analysis device. The
information input device 1 is attached and installed to a pseudo head 2 simulating the head of a
remote conference participant, and in the conference room, the pseudo head 2 is installed at a
position where the remote participant should actually sit. The information collected by the
information input device 1 is subjected to encoding, high S / N, high reliability, and other general
signal processing by the communication processor 5 of the conference room, and then to remote
control via the network 6. It is transmitted to the communication processor 7 on the side of the
conference participant on the ground. The attitude control device 3 for moving the pseudo head
2 has a control motor, and is controlled and driven by the motor control device 4. For example, in
the case of three-dimensional control, control is performed in the low, yaw, and pitch directions.
As information used for control, information obtained by decoding the signal transmitted from
the communication processor 7 at a remote place via the network 6 by the communication
processor 5 of the conference hall or other general signal processing Is used.
[0014]
At a remote location, the signal transmitted from the communication processor 5 of the
conference hall via the network 6 is decoded by the communication processor 7 at the remote
location, and information obtained by performing other general signal processing is obtained. ,
And is presented to the information presentation device 8 as information on the conference hall.
When the remote participant 9 moves his head in the direction of his / her interest according to
10-05-2019
6
the information of the conference center presented to the information presentation device 8, the
motion is detected by the head motion detection device 10 and the head motion is The analysis
device 11 analyzes the direction, speed, etc. of the movement. This information is subjected to
coding, high reliability, and other general signal processing by the communication processor 7 at
a remote place, and is transmitted to the communication processor 5 of the conference center via
the network 6. The above signal transmission and signal processing are repeatedly performed
during the communication conference between the conference center and the remote place.
[0015]
The description given above with reference to FIG. 1 is described on the assumption that auditory
information and visual information are input collectively via the information input device 1.
Hereinafter, the case of inputting auditory information and the case of inputting visual
information will be specifically described separately. Referring to FIG. 2, this is a diagram for
explaining the case of handling auditory information. 21 is a left sound collecting device at the
position of the left ear of the pseudo head 2, 22 is a right sound collecting device at the position
of the right ear of the pseudo head 2, 23 is an amplifier for the left sound collecting device, 24 is
for the right sound collecting device An amplifier 25 indicates a binaural sound reproducing
apparatus for reproducing an audio signal to a remote conference participant.
[0016]
In the conference hall, the pseudo head 2 attached with the left sound collecting device 21 at the
position of the left ear of the artificial head 2 and the right sound collecting device 22 at the
position of the right ear of the artificial head 2 Is placed in the position where it should actually
sit. Auditory information, which is an audio signal collected by the left sound collection device 21
and the right sound collection device 22, is encoded by the communication processor 5 of the
conference hall, and the general signal such as high S / N, high reliability, etc. Processing is
performed and transmitted to the communication processor 7 at a remote location via the
network 6. At the remote site, the communication processor 7 at the remote site decodes the
signal transmitted from the communication processor 5 at the conference hall via the network 6
and performs other general signal processing to join the remote site. Audio information of the
conference site is presented by a binaural sound reproducing apparatus 25 that reproduces the
sound signal to the person. The remote participant 9 can perceive the direction of the speaker by
the binaural sound signal equivalent to the conference site presented by the binaural sound
reproducing device 25. When the user moves his / her head in the direction of the speaker who
is interested in the remote participant 9 or the object being discussed, the movement is detected
10-05-2019
7
by the head movement detection device 10.
[0017]
Referring to FIG. 3, this is a diagram for explaining the case of handling visual information. 31 is
a left imaging device at the position of the left eye of the pseudo head 2, 32 is a right imaging
device at the position of the right eye of the pseudo head 2, and 33 is a video display device for
presenting a video signal to the remote participant 9 . In the conference hall, the pseudo head 2
attached with the left imaging device 31 at the position of the left eye of the pseudo head 2 and
the right imaging device 32 at the position of the right eye of the pseudo head 2 It is placed in a
position to sit in The visual information captured by the left imaging device 31 and the right
imaging device 32 is subjected to encoding, high S / N, high reliability, and other general signal
processing in the communication processor 5 of the conference site, and the network 6 And sent
to the communication processor 7 at a remote location.
[0018]
At the remote location, the communication processor 7 at the remote location performs decoding
and other general signal processing on the signal transmitted from the communication processor
5 at the conference site via the network 6 to obtain the remote location. The visual information
of the conference center is presented to the participant 9 by the video display device 33. The
remote participant 9 can perceive the direction of the speaker by the video display device 33
presenting a video signal of both eyes equivalent to the conference room. When the head is
moved in the direction of the speaker who is interested and the object being discussed, the
movement is detected by the head movement detection device 10. Referring to FIG. 4, this is a
view for explaining the case of handling the utterance information of the remote participant 9
and the pseudo head 2 installed in the conference hall.
[0019]
Reference numeral 41 denotes a simulated head speech device installed at the position of the
mouth of the simulated head 2 installed in the conference room, and reference numeral 42
denotes a participant collection device for picking up the voice of the remote participant 9. The
speech information uttered by the pseudo head speech device 41 placed at the position of the
mouth of the pseudo head 2 installed in the conference center is the communication processor 5
10-05-2019
8
of the conference center via the network 6 and the communication processor at a remote
location The signal transmitted from 7 is obtained by performing decoding and other general
signal processing. At the remote location, the voice of the remote participant 9 is collected by the
participant collection device 42 that picks up the voice of the remote participant 9. The collected
sound information is subjected to coding, high reliability and other general signal processing in
the communication processor 7 at a remote place, and is transmitted to the communication
processor 5 of the conference center via the network 6 . The speech handling of the remote
conference participant and the simulated head installed in the conference room is repeatedly
performed during the teleconference between the conference room and the remote place. As a
result, the remote participant 9 can speak in the conference hall as if he / she is actually
participating in the conference, as if actually participating in the conference in the conference
hall. I can feel it.
[0020]
Referring to FIG. 5, this is a view for explaining the case where the auditory information of FIG. 2,
the visual information of FIG. 3 and the utterance information of FIG. 4 are handled. The pseudo
head 2 of the conference room is equipped with a sound collecting device, an imaging device,
and an utterance device in the conference room collectively. The remote participant 9 has a
binaural sound reproducing device 25 for reproducing an acoustic signal to the remote
participant 9, a video display 33 for presenting a video signal to the remote participant, and
audio of the remote participant 9. The participant sound collection devices 42 that collect sound
are collectively provided as the presentation device 52. The pseudo head 2 equipped with a
sound collecting device, an image pickup device, and an utterance device in a conference room
collectively includes the left sound collecting device 21 at the position of the left ear and the
right sound collecting device 22 at the position of the right ear. The right imaging device 32 is
attached to the position of the left imaging device 31 and the right eye, and the pseudo head
speech device 41 is attached to the position of the mouth. The artificial head 2 has a sound
collecting device, an imaging device, and an utterance device all at once, so it collects auditory
and visual information in the same situation as a human does with an ear and eyes and a human
does it with a mouth Voice information can be presented in the same situation as
[0021]
As described above, the function of the device for reproducing the audio signal to the remote
participant, the function of the device for presenting the video signal to be imaged, the function
of the device for picking up the voice are integrated. A binaural sound reproducing device 25
10-05-2019
9
that reproduces to the ear, a video display device 33 that presents a video signal to a remote
location participant, and a participant sound collection device 42 that collects sound are
integrally configured. Because they are integrated, they perceive visual and auditory information
in the same situation as humans do with their ears and pick up sound at their pronouncing
mouth, so they can pick up high S / N voice information without discomfort. Can. In addition,
since it is compact, it is easy to wear and handle. A remote participant can realize a situation
where he / she attends the conference realistically and speaks as if he / she is in front of the
conference hall.
[0022]
This embodiment displays the function of the sound collection device, the function of the image
pickup device, the pseudo head integrating all the functions of the voice generation device, the
function of the device which reproduces the audio signal to remote participants, and the video
signal to be picked up. The invention has been described in which a presentation device
integrated with the function of the device and the function of the device for picking up an
utterance is given to a remote participant. Depending on the environment used, a pseudo-head
integrated by selecting and integrating the two functions required of the sound collection device
and the voice generation device, and the function and voice of the device for reproducing the
acoustic signal to the remote participant In some cases, sufficient effects can be obtained even by
using a presentation device that integrates the function of the device that picks up the sound, in
which case more economical communication can be achieved if these necessary functions are
selected and integrated. Become a conferencing device.
[0023]
Although the case where one pseudo head is used in the conference room has been described
with reference to FIGS. 1 to 5, the number of pseudo heads may be set to a plurality equal to the
number of remote area participants. In the ultimate case, all the participants in the conference
can participate from a remote place, and only a pseudo head of each participant can be installed
in the conference room. By the way, in the above-mentioned highly realistic communication
conference device, the information input device 1 has the sound collection devices 21 and 22
installed at positions equivalent to both ears of the pseudo head 2, and both ears of the remote
participant 9 Transmission of sound having a binaural sound reproduction device 25 for
reproducing sound signals collected by a sound collection device, imaging devices 31 and 32
installed at positions corresponding to both eyes of the pseudo head 2, and remote participants
The remote participant 9 is restricted in speech even by the transmission of only two parties of
10-05-2019
10
the transmission of the video having the video display device 33 presenting the video signal
captured by the imaging device to both eyes of 9. Within that range, you can attend highly
immersive communication conferences.
[0024]
The figure explaining an Example. The figure explaining the case where handling auditory
information is carried out. The figure explaining the case where visual information is handled.
The figure explaining the case where the voice of a false head installed in the meeting place of a
remote place and a meeting place is handled. The figure explaining the case where handling
auditory information, visual information, and utterance information is carried out.
Explanation of sign
[0025]
Reference Signs List 1 information input device 2 pseudo head 3 attitude control device 4 motor
control device 5 communication processor in conference hall 6 network 7 remote location
communication processor 8 information presentation device 9 remote location participant 10
head movement detection device 11 head movement analysis Apparatus 21 left sound collecting
device 22 right sound collecting device 23 amplifier for left sound collecting device 24 amplifier
for right sound collecting device 25 binocular sound reproduction device 31 left image pickup
device 32 right image pickup device 33 image display device 41 pseudo head speech device 42
participation Person collecting device 52 Presentation device
10-05-2019
11
Документ
Категория
Без категории
Просмотров
2
Размер файла
23 Кб
Теги
jp2005123959
1/--страниц
Пожаловаться на содержимое документа