close

Вход

Забыли?

вход по аккаунту

?

DESCRIPTION JP2015220655

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2015220655
The present invention provides a communication environment similar to that in the same space
for both speakers in different floors or rooms in different locations. An in-spatial control unit
(10a, 10b) controls an image pickup unit (1a, 1b), an image display unit (2a, 2b), an audio
collection unit (3a, 3b), and an audio output unit (4a, 4b). 10b) is a two-way communication
system between distant points in which mutual communication is performed, and the space
control unit (10a, 10b) is an audio signal collected by a sound collection unit in its own space;
When it is determined that an echo state including a part of the audio signal output from the
audio output unit in its own space is generated, the echo signal output from the audio output unit
in its own space is The audio output unit is controlled to eliminate the echo condition by
reducing the directivity or reducing the sound pressure. [Selected figure] Figure 2
Long distance two-way communication system and long distance two-way communication
method
[0001]
According to the present invention, a distance-to-point two-way communication system and a
distance-to-distance point that realize a communication environment similar to that in the same
space by expressing video and audio as if separate spaces are continuous with each other It
relates to an interactive communication method.
[0002]
There is a conventional technique for reducing an acoustic echo due to a reflected wave of a
sound wave emitted from a speaker when performing bidirectional voice communication using a
voice input / output device provided with a microphone and a speaker (for example, see Patent
16-04-2019
1
Document 1) ).
[0003]
The audio input / output device according to Patent Document 1 includes a microphone, a
speaker having a planar speaker surface and outputting a voice corresponding to an input voice
signal as a plane wave, and a voice representing a voice collected by the microphone A
communication control unit that transmits a signal to a partner apparatus via a communication
network, supplies a voice signal received from the partner apparatus via the communication
network to a speaker, and emits a voice according to the voice signal; The speaker is held in a
state where the speaker surface is inclined by a predetermined angle with respect to the facing
wall surface, and the main body holding the microphone is provided in the vicinity of the
speaker.
[0004]
With such a configuration, when bi-directional voice communication is performed using a voice
input / output device provided with a flat speaker and a microphone, sound resulting from a
reflected wave of a sound wave (flat wave) output from the flat speaker It is possible to reduce
the echo.
[0005]
Japanese Patent Application Publication No. 2007-28220
[0006]
However, the prior art has the following problems.
When creating an environment in which both rooms are moved to one wall and simultaneously
exchange audio as well, the prior art does not accompany the audio even if the screens are
displayed on each other, or it is possible for both parties to stand and talk. Problems that can not
provide an environment that
[0007]
16-04-2019
2
In the case of voice, in the method disclosed in Patent Document 1, the voice (input side)
generated by the user is output from the speaker (output side) of the other side and picked up
again by the microphone of the other side, It will be outputted from the speaker on its own side
as the voice generated by the other party.
As a result, it prevented the free exchange of information to talk at the same time.
[0008]
With regard to sound related to such acoustic echo, there is a technique of using an echo
canceler to prevent the microphone from picking up the sound from the speaker.
However, in this case, it is not possible to hear the other party's voice and your own voice at the
same time.
That is, simultaneous conversations with each other were impossible.
[0009]
Also, as a technology for preventing the microphone from picking up the sound from the
speaker, directional voice transmission can be used.
With such a technology, it becomes possible to realize each other's conversation without echoing
for the first time by clearly distinguishing the voice area of the speaker from the voice area
generated by the directional speaker.
[0010]
However, in order to make use of this technology, it is necessary to prevent the area picked up
by the microphone from reaching the area generated by the speaker. Therefore, there is a
problem that when the area picked up by the microphone is released, the speaker's natural
16-04-2019
3
generated sound can not be picked up.
[0011]
Also, when talking, the generated sound area is diffused due to the size of the sound generated
by the other party or the reflection by the body of the listener, and the microphone can pick up
the sound generated from the speaker There is sex. Furthermore, by having directivity, the
position of the user and the number of users may be limited.
[0012]
The present invention has been made to solve the problems as described above, and the same
communication as in the same space to both speakers who are in different floors or rooms in
different locations. An object of the present invention is to obtain a far-point two-way
communication system and a far-point two-way communication method that provide an
environment.
[0013]
A far-distance two-way communication system according to the present invention includes an
image pickup unit, an image display unit, an audio collection unit, and an audio output unit
installed in a living room in both the first space and the second space. The inter-space control
unit controlling each other communicates with each other to transmit and receive both images
and sounds in real time, and the speaker in the first space and the speaker in the second space
recognize both by the image And the voice output unit is a directivity of the voice signal in a
direction perpendicular to the image display unit based on an external control signal. Each of the
in-space control units provided in the first space and the second space has an arrangement
capable of adjusting the sound pressure, and an image capturing unit in another space acquired
through mutual communication. Image taken with Is displayed on the image display unit in its
own space, and an audio signal collected through an audio collection unit in another space
acquired through mutual communication is output from the audio output unit in its own space
Causes an echo condition in which a part of the audio signal output from the audio output unit in
its own space is included in the audio signal collected by the audio collection unit in its own
space. When it is determined that the voice signal is output from the voice output unit in its own
space, the control signal is output so as to eliminate the echo state by reducing the sound
pressure. .
[0014]
16-04-2019
4
Further, according to the two-way communication method between distant points according to
the present invention, an image pickup unit, an image display unit, a sound collection unit, and a
voice installed in the living room of both the first space and the second space apart. The space
control unit controlling the output unit performs mutual communication to transmit and receive
both images and voices in real time, and the speaker in the first space and the speaker in the
second space are both by the image. A method for two-way communication between long
distance points used in a long distance point-to-point two-way communication system which
recognizes a voice and performs mutual conversation by voice, which is provided in a first space
and a second space. In each of the control units, an image display step for displaying on the
image display unit in its own space the image signal acquired by the image pickup unit in
another space acquired through the mutual communication, and the mutual communication And
an audio output step for outputting from the audio output unit in its own space the audio signal
collected by the audio collection unit in another space, and the audio collection unit in its own
space Determining whether or not an echo state in which a part of the audio signal output from
the audio output unit in its own space is included in the sounded audio signal is generated; echo
state determining step; echo state When it is determined in the determination step that an echo
state is generated, a configuration capable of adjusting the directivity and sound pressure of the
audio signal in the direction perpendicular to the image display unit based on the control signal
from the outside is provided. An audio output control that outputs a control signal so as to
eliminate an echo state by narrowing the directivity of an audio signal output from an audio
output unit in its own space or reducing the sound pressure with respect to an audio output unit
having With step Is shall.
[0015]
According to the present invention, mutual images are copied on the wall of each other's living
room, and mutual audio is also sent to each other's living room.
At this time, the directivity and sound pressure of the audio signal can be controlled so that the
audio signal output from the audio output unit in the space is not collected by the audio
collection unit.
As a result, it is possible to obtain a remote point-to-point two-way communication system that
provides the same communication environment as when in the same space to both speakers in
different floors or rooms in different locations. .
16-04-2019
5
[0016]
It is a figure for demonstrating the concept of the two-way communication system between
distant points in Embodiment 1 of this invention.
It is a block diagram of the two-way communication system between distant points in
Embodiment 1 of this invention. The two-way communication system between distant points
according to Embodiment 1 of the present invention shows an image diagram in which the space
A and space B remote from each other are expressed as if they are the same adjacent spaces. FIG.
7 is a view schematically showing a state in which an image in space B is displayed on the image
display unit in space A in the far-distance point two-way communication system according to
Embodiment 1 of the present invention. It is explanatory drawing regarding the audio | voice
sound-collection part and audio | voice output part which are used with the two-way
communication system between far distances in Embodiment 1 of this invention. FIG. 7 is an
explanatory diagram regarding control of an audio output unit for suppressing the occurrence of
an echo in the far-distance point-to-point bi-directional communication system according to the
first embodiment of the present invention. FIG. 7 is an explanatory view showing a control
method for solving an echo problem in the far-distance point-to-point bi-directional
communication system according to the first embodiment of the present invention. FIG. 7 is an
explanatory diagram of a method of controlling voice output for a plurality of speakers in the fardistance point-to-point bi-directional communication system according to the first embodiment of
the present invention. FIG. 7 is an explanatory diagram of a method of controlling voice output
for a plurality of speakers in the far-distance point-to-point bi-directional communication system
according to the first embodiment of the present invention. FIG. 7 is an explanatory diagram of a
method of performing one-to-one bidirectional communication in the long distance point-to-point
two-way communication system according to the first embodiment of the present invention. FIG.
11 is an explanatory diagram different from FIG. 10, which is a method of performing one-to-one
bidirectional communication in the long distance point-to-point two-way communication system
according to the first embodiment of the present invention.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION Preferred embodiments of the long distance
two-way communication system and the long distance two-way communication method of the
present invention will be described below with reference to the drawings.
[0018]
16-04-2019
6
Embodiment 1
First of all, the concept and configuration of a long distance point-to-point bi-directional
communication system according to the present invention will be described using FIGS. 1 to 4.
The two-way communication system between distant points in the first embodiment expresses
two spaces A and B, which are mutually separated spaces, as if it were an image (image) and a
voice as if it were the same space. is there.
[0019]
FIG. 1 is a diagram for explaining the concept of a two-way communication system between
distant points in the first embodiment of the present invention. FIG. 2 is a block diagram of a twoway communication system between distant points in the first embodiment of the present
invention.
[0020]
One of the two spaces A is a space A control unit 10a, an image pickup unit 1a connected to the
space A control unit 10a, an image display unit 2a, an audio sound collection unit 3a, and an
audio output unit 4a. It consists of
[0021]
The other space B of the two spaces is the space B control unit 10b, the image pickup unit 1b
connected to the space B control unit 10b, the image display unit 2b, the sound collection unit
3b, and the sound output. And 4b.
[0022]
Further, an integrated control unit 20 is connected to the space A control unit 10a and the space
B control unit 10b and controls the entire system.
The space A control unit 10a, the space B control unit 10b, and the general control unit 20 are
connected via, for example, a network.
16-04-2019
7
In addition, the general control unit 20 is not necessarily required, and the space A control unit
10a and the space B control unit 10b may be configured to directly communicate with each
other.
[0023]
The image capturing units 1a and 1b correspond to cameras for capturing a space in which the
image capturing units 1a and 1b are installed. That is, the image capturing unit 1 a captures an
inside of the space A, and the image capturing unit 1 b captures an inside of the space B.
[0024]
The image display units 2a and 2b correspond to the wall surface of the room in which the image
captured in the other space is displayed. That is, the image display unit 2a corresponds to the
wall surface of the space A, and an image in the remote space B captured by the image pickup
unit 1b is displayed on the wall surface in the space A, so that the space A and the space B are
obtained. And are represented as if they were adjacent spaces.
[0025]
Similarly, the image display unit 2b corresponds to the wall surface of the space B, and an image
in the remote space A captured by the image pickup unit 1a is displayed on the wall surface in
the space B, thereby the space A and the space B is expressed as if it were an adjacent space.
[0026]
The sound collection units 3a and 3b correspond to microphones that collect sound in the space
in which the sound collection units 3a and 3b are installed.
That is, the sound collecting unit 3a is provided to collect the voice of the speaker in the space A,
and the sound collecting unit 3b is provided to collect the voice of the speaker in the space B. It
is done.
16-04-2019
8
[0027]
The audio output units 4a and 4b correspond to speakers that output the sound collected in the
other space. That is, the voice output unit 4a outputs the voice in the remote space B collected by
the voice collection unit 3b into the space A, so that the voice by the speaker in the space B is in
the space A. Communicate to the speaker.
[0028]
Similarly, the voice output unit 4b outputs the voice in the remote space A collected by the voice
collection unit 3a into the space B, so that the voice by the speaker in the space A is in the space
B. Communicate to the speakers of
[0029]
FIG. 1 shows equipment installed in each of such two spaces A and B.
However, in FIG. 1, illustration of the space A control unit 10a, the space B control unit 10b, and
the general control unit 20 is omitted.
[0030]
FIG. 3 shows an image diagram in which a space A and a space B which are remote from each
other are represented as if they are the same space adjacent to each other in the far-point twoway communication system according to the first embodiment of the present invention. It is. As
described with reference to FIGS. 1 and 2, an image in the other party's space is displayed on its
own wall, and although not shown in FIG. 3, the voice collected in the other party's space is
displayed. The space A and the space B which are remote from each other can be expressed as
the same space which is adjacent to each other by outputting in the space of its own.
[0031]
FIG. 4 is a view schematically showing a state in which an image in space B is displayed on the
16-04-2019
9
image display unit 2a in space A in the long distance point two-way communication system
according to Embodiment 1 of the present invention. It is.
[0032]
The speaker who is in the space A obtains the image in the space B displayed on the image
display unit 2a corresponding to the wall surface of the space A and the voice in the space B
output from the voice output unit 4a of the space A. Thus, it is possible to make two-way
communication with the speaker in space B as if space B was adjacent to its own space A.
[0033]
Similarly, the speaker who is in the space B is an image in the space A displayed on the image
display unit 2b corresponding to a wall surface of the space B and a voice in the space A output
from the voice output unit 4b in the space B. As a result, it is possible to make two-way
communication with the speaker in the space A as if the space A was adjacent to its own space B.
[0034]
In the two-way communication system between the far distance points in the first embodiment,
in the processing of voice and image as described above, in particular, the voice output units 4a
and 4b have a directivity and sound pressure adjustment mechanism, and voice output To
control properly.
Therefore, the details will be described below focusing on this feature.
In the following description, the inside of space A will be described as an example, but the same
technology can be applied to space B as well.
[0035]
The voice output unit 4a in the first embodiment is characterized in that the directivity and the
sound pressure can be variably controlled.
16-04-2019
10
FIG. 5 is an explanatory diagram of the sound collection unit 3a and the sound output unit 4a
used in the two-way communication system between distant points in the first embodiment of the
present invention. As shown in FIG. 5, in the first embodiment, a directional speaker or a narrow
directional speaker is used as the voice output unit 4a to allow the speakers in different spaces to
talk with each other. It is realized without echoing.
[0036]
As shown in FIG. 5, the sound generation area of the directional speaker is installed so as not to
overlap with the sound collection area of the sound collection unit (microphone) 3a. In such a
case, since the voice output from the voice output unit 4a is not input to the voice collection unit
3a, the problem of echo does not occur.
[0037]
However, when the output from the voice output unit 4a becomes large or when the speaker
moves, the voice output from the voice output unit 4a is reflected by the body of the speaker
listening to the voice. , And may be input to the sound collection unit 3a, which may cause an
echo problem. Then, the countermeasure of this invention with respect to such a problem is
demonstrated in detail using FIG. 6, FIG.
[0038]
FIG. 6 is an explanatory diagram regarding control of the voice output unit 4a for suppressing
the occurrence of echo in the far-distance point-to-point bi-directional communication system
according to the first embodiment of the present invention. More specifically, in FIG. 6A, when
the output (sound pressure) from the sound output unit 4a is increased, the sound reflected by
the speaker's body is taken into the sound collection unit 3a, It shows a state in which an echo
problem has occurred. Further, FIG. 6B shows a state where directivity and sound pressure are
controlled as an output from the audio output unit 4a in order to eliminate the problem of echo.
[0039]
Although not shown in FIG. 6, the space A control unit 10a in the first embodiment is output
from the voice output unit 4a, and the voice reflected by the body of the speaker on the listening
16-04-2019
11
side is the voice collection unit 3a. If a microphone is recognized, as shown in FIG. 6B, the voice
output unit 4a is controlled in real time so that no echo due to reflection occurs.
[0040]
FIG. 7 is an explanatory view showing a control method for solving an echo problem in the farpoint two-way communication system according to Embodiment 1 of the present invention.
A specific control method will be described based on a series of processes from step S1 to step
S4 of FIG.
[0041]
(Step S1) The audio output space A control unit 10a from the audio output unit 4a acquires the
audio of the space B collected by the audio collection unit 3b acquired through the space B
control unit 10b as the audio output unit 4a. Output from At this time, the voice signal output
from the voice output unit 4a includes a characteristic frequency in order to specify that it is the
output voice from the voice output unit 4a.
[0042]
(Step S2) Voice Input by Voice Collection Unit 3a The voice collection unit 3a collects the voice in
the space A. At that time, when the characteristic frequency is included in the collected audio
signal, the space A control unit 10a generates an audio output from the audio output unit 4a
because an echo problem has occurred. Determine that it is necessary to control.
[0043]
(Step S3) If the feedback space A control unit 10a to the audio output unit 4a determines that the
echo problem does not occur from the audio output from the audio output unit 4a, the audio
output from the audio output unit 4a As it is. On the other hand, if the space A control unit 10a
determines that an echo problem is occurring due to the audio output from the audio output unit
16-04-2019
12
4a, the process proceeds to step S4, and controls the audio output.
[0044]
(Step S4) The voice output control space A control unit 10a of the voice output unit 4a controls
the directivity of the voice output unit so that the characteristic frequency included in the voice
output is not taken into the voice collection unit 3a. Or control the sound pressure. Specifically, it
is conceivable to lower the sound pressure to limit the volume, narrow the directivity, or control
both the sound pressure and the directivity to appropriate values.
[0045]
In the above steps S1 to S4, not only the echo problem can be solved, but also the audio output
units 4a and 4b can be configured to switch two types of speakers depending on the situation as
described below. . That is, when a directional speaker is adopted as the audio output units 4a and
4b to perform audio output, a part of the normal frequency band is deleted, which tends to be
different from the actual audio. . On the other hand, the sound output from a normal high-quality
speaker is close to a natural sound.
[0046]
Then, the usage method of the hybrid type | mold which used the directional speaker and the
speaker of the high sound quality together as audio | voice output part 4a, 4b can be considered.
According to such a usage method, a speaker with high sound quality is adopted when no echo
problem occurs, and switching to a directional speaker is performed when an echo problem
occurs, thereby the sound quality is changed. Can be suppressed.
[0047]
In the above description, the case where there is only one speaker in the space has been
described. However, the present invention can cope with the case where there are a plurality of
speakers, and will be specifically described with reference to FIGS. 8 and 9.
16-04-2019
13
[0048]
FIGS. 8 and 9 are explanatory views of a method of controlling voice output for a plurality of
speakers in the far-distance point-to-point bi-directional communication system according to the
first embodiment of the present invention. As shown in FIG. 8, in this example, six microphones,
which are the sound collection unit 3a, are provided in front of the image display unit 2a, and
there are four speakers.
[0049]
Further, as shown in FIG. 9, as the audio output unit 4a, it is conceivable to use together an audio
output unit 4a (1) having superdirectivity and an audio output unit 4a (2) having narrow
directivity. Here, the voice output unit 4a (1) having superdirectivity can set the generated sound
area such that only one person can hear the voice in a spot manner to one of four speakers. It
has become. In addition, the voice output unit 4a (2) having narrow directivity can set a
generated sound area that can be heard in a certain width at one to the remaining three of the
four speakers. There is.
[0050]
As described above, the audio output unit 4a according to the first embodiment includes the
audio output unit 4a capable of adjusting a desired sound generation area in the direction
perpendicular to the image display unit 2a which is a wall of a space. Further, in front of the
image display unit 2a, sound collecting units 3a are provided at a plurality of places. As a result,
even when there are a plurality of speakers in the same space, it is possible to provide a
mechanism that enables conversation simultaneously.
[0051]
Next, the case of performing one-to-one bi-directional communication between space A and space
B remote from each other will be specifically described using FIGS. 10 and 11. FIG. FIG. 10 is an
explanatory diagram of a method of performing one-to-one bidirectional communication in the
long distance point-to-point two-way communication system according to the first embodiment
16-04-2019
14
of the present invention. Specifically, it is shown that the speaker 5a in the space A performs oneto-one two-way communication with the speaker 5b in the space B, which is a remote point,
using the system according to the present invention. .
[0052]
In the following description, image processing and sound processing in the space A will be
described, and the description in the space B in which the same processing is performed will be
omitted.
[0053]
The sound collected by the sound collection unit 3b is transmitted to the space A from the space
B, which is a remote point, together with the image of the speaker 5b captured by the image
capturing unit 1b.
Then, the space A control unit 10a causes the image display unit 2a in the space A to display the
image of the speaker 5b acquired via the image pickup unit 1b. Furthermore, the space A control
unit 10a causes the sound output unit 4a in the space A to output the sound acquired via the
sound collection unit 3b.
[0054]
Here, in the space A, the voice of the speaker 5b is output from the speaker as the voice output
unit 4a to the speaker 5a with directivity. As a result, the generated sound area remains within
the range shown in FIG. 10 and does not reach other areas. Therefore, the speaker 5a in the
space A can listen to the voice of the speaker 5b, but the voice collection unit 3a in the space A
can not reach the voice of the speaker 5b.
[0055]
Therefore, only the sound generation area by the speaker 5a reaches the sound collection unit 3a
in the space A, and is output from the sound output unit 4b on the space B side. By mutually
utilizing this mechanism, it is possible to eliminate the phenomenon that the output sound in the
16-04-2019
15
space is re-input to the sound collection unit and can be heard as an echo.
[0056]
Further, the volume of the sound generated by the speaker 5b in the space B increases or
decreases depending on the distance between the speaker 5b and the sound collection unit 3b or
the amount of voice of the speaker 5b. Therefore, when the space A control unit 10a does not
control the voice output unit 4a, the voice output from the voice output unit 4a is leaked from
the side or reflected even if there is directivity. However, it may be picked up by the sound
collection unit 3a, and an echo problem may occur.
[0057]
Therefore, the space A control unit 10a controls the size (sound pressure) of the voice in addition
to the directivity of the voice output unit 4a by the method described with reference to FIGS. It is
possible to completely prevent the phenomenon that the sound collecting unit 3a picks up the
reflected sound of.
[0058]
In the example of FIG. 10, the method of performing one-to-one bidirectional communication
based on one image displayed on the image display unit 2a has been described.
However, the present invention is not limited to such a configuration, and it is also possible to
display a plurality of images. FIG. 11 is a method for performing one-to-one bidirectional
communication in the long distance two-way communication system according to the first
embodiment of the present invention, and is an explanatory view different from FIG.
[0059]
In the configuration of FIG. 11, two cameras of an image capturing unit 1b (1) for capturing the
entire space B and an image capturing unit 1b (2) for capturing a speaker are provided in the
space B. The case where it is installed is illustrated. With such a configuration, the space A
control unit 10a can display two images acquired in parallel via the image pickup units 1b (1)
16-04-2019
16
and 1b (2). Moreover, it is also possible to display only any one sheet as needed.
[0060]
As described above, according to the first embodiment, the directivity and the sound pressure of
the audio signal can be controlled so that the audio signal output from the audio output unit in
the space is not collected by the audio collection unit. It has a configuration. As a result, when
performing two-way communication, each speaker in another space can simultaneously speak
naturally, and more realistic conversation becomes possible.
[0061]
Furthermore, by displaying an image of a remote place, remote spaces are displayed as if they
were continuous spaces, and by exchanging video and audio, a communication environment
similar to that in the same space can be realized. As a result, it is possible to reduce office
expenses by interconnecting offices with high land costs and offices with low land costs and
creating a similar space environment.
[0062]
Also, for example, even in an underground room, in an office where the outside is shut off, not
only the outside image is projected, but by appropriately controlling the sound pressure, an
environment is created in which the sound can be heard only a little. be able to.
[0063]
In addition, even when an office employee in one space of communication destination is absent,
by monitoring an image in the other space, it becomes possible to take a crime prevention
measure because it can be known when someone enters.
Furthermore, even in a place where the manager is absent, remote confirmation can be
performed, and safety management and welfare management can be performed.
16-04-2019
17
[0064]
1a, 1b image pickup unit, 2a, 2b image display unit, 3a, 3b voice collection unit, 4a, 4b voice
output unit, 10a space A control unit (in-space control unit), 10b space B control unit (in-space
control Department), 20 General control department.
16-04-2019
18
Документ
Категория
Без категории
Просмотров
0
Размер файла
29 Кб
Теги
jp2015220655, description
1/--страниц
Пожаловаться на содержимое документа