close

Вход

Забыли?

вход по аккаунту

?

JP2011138151

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2011138151
An object of the present invention is to enable sound field reproduction in a form that expresses
the directivity of a virtual sound source. SOLUTION: Measurement of impulse response
corresponding to each of a plurality of measurement speakers arranged on a first closed curved
surface on the basis of a voice generated by directing a directional speaker in a plurality of
directions is measured in the plurality of directions. The respective transfer functions are
determined, and these transfer functions perform arithmetic processing on the input speech
signal. In this way, the reproduction audio signal obtained by the arithmetic processing based on
the transfer function can include information on the directional direction of the sound produced
by the directional speaker. Therefore, in the environment different from the environment where
the measurement was performed, for example, these reproduction audio signals are arranged
according to the geometrically equivalent positional relationship with the arrangement positions
of the plurality of measurement speakers arranged on the first closed surface. If output from
each of the reproduction speakers, it is possible to reproduce the sound field (reverberation or
sound image localization) of the measurement environment in the form of the directivity of the
virtual sound source in the space surrounded by the reproduction speakers. [Selected figure]
Figure 10
Sound signal processing method, sound field reproduction system
[0001]
The present invention relates to an audio signal processing method suitable for reproducing the
sound field of one environment in another environment. A sound comprising: a recording device
for recording information on a recording medium; and an audio signal processing device for
04-05-2019
1
generating a reproduction audio signal for performing sound field reproduction based on the
information recorded on the recording medium. It relates to the field reproduction system.
[0002]
JP 2002-186100 A
[0003]
For example, in the case of viewing content such as a movie or music, reverberation is added in
order to give a sense of reality to reproduced sound.
A so-called digital reverb method is known as the reverberation addition processing. This digital
reverb method generates a lot of delay information that is considered to be a random delay time
to the original sound, and further reduces the volume as the delay time becomes longer, applies
feedback at a location where the delay time is long, and reverberation time It performs signal
processing such as taking a long time. Thereby, it is possible to artificially generate a
reverberation effect on the original sound. However, since the parameters for generating the
delay information are set based on the aural feeling of the operator who sets the parameters, this
setting operation becomes complicated. In addition, there is no concept of localizing the original
sound because the reverberation is artificially generated, and the reproduction of the sound field
is not excellent.
[0004]
On the other hand, for example, the technique described in Patent Document 1 is known as a
method for actually measuring impulse response in a sound field space and obtaining a
reverberation effect based on spatial information such as localization of a sound source. There is.
In the technology described in Patent Document 1, for example, as shown in FIG. 1, a speaker 3
for measurement is disposed as a sound source in a measurement environment (measurement
sound field) 1 such as a hole. Then, an audio signal for impulse response measurement, which is
a TSP (Time Streched Pulse) signal or the like, is supplied to the measurement speaker 3, and a
plurality of measurement microphones 4 (a) are disposed at required positions in the same sound
field. The measuring sound output from the measuring speaker 3 is input to pp). In this case, for
example, in the measurement microphone 4a, as shown by the arrow in FIG. 1, the direct sound
from the measurement speaker 3 and the reflected sound output from the measurement speaker
04-05-2019
2
3 and reflected in the hole as a measurement environment Can be detected. Although illustration
is omitted, the same applies to the other measurement microphones 4b, 4c and 4d. Then, based
on the audio signal detected by each of the measurement microphones 4 (a to d), the transfer
function corresponding to each of the measurement speakers 3 to each of the measurement
microphones 4 is measured by measuring an impulse response including reverberation. You can
ask for
[0005]
If such a transfer function is used, for example, as shown in FIG. 3, in an environment where the
speakers 8 (a to p) are arranged in the same positional relationship as each measuring
microphone 4 in FIG. The sound field in the measurement environment can be reproduced. That
is, when the transfer functions corresponding to the respective arrangement positions of the
measurement microphones 4 are obtained as described above, the audio signals to be
reproduced are respectively convoluted using these transfer functions, whereby the arrangement
of the speakers 8 is obtained. An audio signal to be output can be obtained from the position.
Therefore, by outputting the audio signals from the speakers 8 arranged at corresponding
positions, it is possible to obtain the same reverberation effect as the measurement environment
of FIG. 1 in the space surrounded by the speakers 8. Such a method uses the transfer function
actually measured, and therefore is excellent in the reproducibility of the sound field at the time
of reproduction. At the same time, it also becomes clearer as sound image localization in the
reproduction sound field.
[0006]
At this time, it is important that the measurement microphones 4 (a to p) in the measurement
environment of FIG. 1 and the speakers 8 (a to p) in the reproduction environment of FIG. It is
important to By doing this, the localization (sound image localization) of the sound source of the
measurement sound field is clearly reproduced in the area (closed surface) surrounded by the
speakers 8 in the reproduction environment, and the sound field of the measurement
environment Can be clearly reproduced.
[0007]
By the way, according to the method described in the above-mentioned Patent Document 1, the
04-05-2019
3
measurement speaker 3 for outputting the measurement signal in the measurement environment
is non-directional, whereby sound can be emitted from one point to the entire space. As a result,
the information (spatial information of the measurement environment) for expressing the sound
caused by the size of the measurement space, the material of the wall, the floor, the ceiling, the
geometric structure, etc. was measured. However, in practice, it can be assumed that the
directivity of the sound source to be reproduced as a virtual sound image at the arrangement
position of the measurement speaker 3 is also reproduced. In such a case, if the sound field is
reproduced based on the result of measuring the impulse response using the measurement
speaker 3 with nondirectionality as described above, the directivity of the sound source can not
be reproduced. It will be.
[0008]
Therefore, in the present invention, in view of the above problems, the following method is used
as an audio signal processing method. That is, first, the first sound generation step of generating
a sound by directing a directional speaker arranged at a virtual sound image position outside the
first closed curved surface in a plurality of directions is included. Further, there is provided a first
measurement step of measuring voices in the respective directions emitted in the first sound
generation step at a plurality of positions on the first closed surface. A plurality of first transfer
function groups corresponding to each of the plurality of positions on the first closed curved
surface from the virtual sound image position based on the sound measured in the first
measurement step are It has a first transfer function generation step of generating for each
direction. Furthermore, arithmetic processing based on the first transfer function group
generated for each of the plurality of directions is performed on the input audio signal to
correspond to each of the plurality of positions on the first closed surface. The first reproduction
audio signal generating step is provided to obtain a first reproduction audio signal.
[0009]
As described above, the first transfer function group obtained based on voices generated by
directing directional speakers in a plurality of directions can be obtained by performing
arithmetic processing on an input voice signal. The first reproduction audio signal can include
information on the directional direction of the sound produced by the directional speaker.
Therefore, if the first reproduction audio signals are output from the reproduction speakers,
which are arranged, for example, in a positional relationship geometrically equivalent to a
plurality of positions on the first closed curved surface, the reproduction speakers In the
enclosed space, it is possible to reproduce the sound field (reverberation or sound image
04-05-2019
4
localization) of the measurement environment by expressing the directivity of the virtual sound
source.
[0010]
Thus, according to the present invention, the reproduction of the sound field of the measurement
environment can be realized in the form of expressing the pointing direction of the virtual sound
source.
[0011]
It is a schematic diagram for demonstrating a measurement environment.
FIG. 2 is a block diagram showing a basic configuration of a reproduction system of reproduced
speech in a reproduction environment. It is a schematic diagram for demonstrating a
reproduction environment. It is the figure which showed typically the mode for the measurement
in the measurement environment in, when reproducing a several virtual sound image position.
FIG. 6 is a diagram showing a configuration of a reproduced signal generation device
corresponding to a case where a plurality of virtual sound image positions are reproduced. FIG. 7
is a diagram schematically showing a reproduction environment in the case of reproducing a
plurality of virtual sound image positions. It is the figure which showed typically the mode of the
measurement in the measurement environment in, when performing the sound field
reproduction in a 2nd closed surface. It is the block diagram which showed the structure of the
reproduction signal production | generation apparatus in, when performing sound field
reproduction | regeneration with a 2nd closed surface. It is a figure explaining the reverberation
sound field at the time of making the inside of a 2nd closed curve into a listening position in a
reproduction environment, and sound image localization. It is the figure which showed typically
the mode of the measurement environment in, when reproducing a specific directivity direction.
It is a schematic diagram for demonstrating the method to reproduce a specific directivity
direction in a reproduction | regeneration environment. It is the figure which showed typically
the mode of the measurement in the measurement environment in the case of simulating a
performance type. It is a block diagram shown about composition of a reproduction signal
generation device corresponding to a case of performing a performance style simulation. It is a
data structure figure showing the data structure example of the Direction corresponding
information. FIG. 6 is a view schematically showing a measurement environment in the case of
reproducing two sound sources of Rch and Lch at one virtual sound image position. It is a block
diagram shown about composition of a reproduction signal generation device corresponding to a
case where two sound sources of Rch and Lch are reproduced for one virtual sound image
04-05-2019
5
position. It is a figure for demonstrating the recording method of the sound source in the case of
performing sound field reproduction which considered the directivity of a sound source, and the
sound emission characteristic for every directivity direction. It is a block diagram shown about
composition of a reproduction signal generation device corresponding to a case of performing
sound field reproduction in consideration of directivity of a sound source and sound emission
characteristics for each directivity direction. It is a figure for demonstrating the method to
surround sound source three-dimensionally and to record audio | voices. It is the figure which
showed typically the mode of the measurement in measurement environment in, when
performing sound field reproduction corresponding to, when carrying out sound recording by
three-dimensionally surrounding a sound source. It is the figure which showed typically the
mode of ambience recording in a measurement environment. It is a block diagram shown about
composition of a reproduction signal generation device corresponding to a case where sound
field reproduction is performed using ambience. It is a figure for demonstrating the measurement
method in the measurement environment in, when performing sound field reproduction
according to a camera angle.
It is the figure shown about the operation process which should be performed by the production
side in the sound field reproduction system as an embodiment, and the composition of a
recording device. It is a block diagram showing composition of a reproduction signal generating
device in a sound field reproduction system as an embodiment. It is a data structure figure shown
about the data structure example of angle / Direction / transfer function corresponding
information.
[0012]
Hereinafter, modes for carrying out the invention (hereinafter referred to as embodiments) will
be described. The description will be made in the following order. <1. Basic configuration> 11. Reproduction of one sound image position 1-2. Reproduction of multiple sound image
positions 1-3. Sound field reproduction on the second closed surface <2. Sound Field
Reproduction as Embodiment> 2-1. Reproduction of pointing direction of sound source 2-2.
Simulating the playing form 2-3. Reproduction of stereo effector 2-4. Reproduction of directivity
of sound source and sound emission characteristics for each directional direction 2-5. Addition of
ambience data 2-6. Sound field reproduction according to the camera viewpoint 2-7.
Configuration example of sound field reproduction system
[0013]
In the present specification, unless otherwise specified, the “operation processing based on
04-05-2019
6
transfer function” for an audio signal means that the transfer function is subjected to
convolutional integration processing for the audio signal, or the transfer function is set as a filter
coefficient. It refers to applying a filtering process to an audio signal by an FIR (Finite Impulse
Response) filter.
[0014]
<1.
Basic Configuration> 1-1. Reproduction of One Sound Image Position FIG. 1 is a view
schematically showing a measurement environment for sound field reproduction. なお、この「
1. The sound field reproduction technology described in “Basic configuration” is a
technology based on which the sound field reproduction as the present embodiment to be
described later is realized, and this content is the prior application of the present applicant. It is
described also in "Japanese Patent Application Laid-Open No. 2002-186100".
[0015]
In FIG. 1, the measurement environment 1 is a sound field to be reproduced in a reproduction
environment to be described later, and in this case, it may be considered as, for example, a
concert hall or a live hall. In this measurement environment 1, for example, the measurement
microphones (microphones) 4a, 4b, 4c, 4d, 4e, 4f, 4g, 4h on the circumference having a radius
R_bnd at a position not close to the wall of the measurement environment 1. , 4i, 4j, 4k, 4l, 4m,
4n, 4o, 4p. In the following, the circumference having such radius R_bnd will be referred to as a
first closed curved surface 10.
[0016]
Each of the measurement microphones 4 (a to p) directs its directivity outward in the normal
direction of the first closed surface 10. In addition, the arrow shown by the microphone in the
following description in the present specification indicates the directivity. Further, the
measurement speaker 3 is disposed as a virtual sound source at a position having a radius R_sp
from the center of the first closed curved surface 10. The measurement signal reproduction unit
2 supplies a measurement signal to the measurement speaker 3. As the measurement signal, a
04-05-2019
7
TSP (Time Streched Pulse) signal for impulse response measurement described later is output. In
addition, since the measurement speaker 3 is provided to reproduce a virtual speaker in a
reproduction environment to be described later, it is desirable that the directivity and the
frequency characteristic be assumed to be the listener's hearing in the reproduction environment.
[0017]
In the measurement in the measurement environment 1, the measurement signal TSP is supplied
to the measurement speaker 3, and the measurement voices output from the measurement
speaker 3 are input to the respective measurement microphones 4 (a to p). In FIG. 1, the path of
sound from the measurement speaker 3 to the measurement microphone 4a is schematically
shown. The audio signal detected by each of the measurement microphones 4 (a to p) is supplied
to an impulse response measurement device (not shown), and here, based on the sound pressure
of the sound detected by each of the measurement microphones 4, measurement is performed
The impulse response corresponding to each of the measurement microphones 4 (a to p) is
measured from the speaker 3. The impulse response may be about 5 to 10 seconds in a large
hole or the like, but may be shorter in a small hole or a less noisy hole. This measurement makes
it possible to obtain a transfer function based on each impulse response. That is, FIG. 1 shows a
voice path in the case of obtaining a transfer function Ha corresponding to the measurement
microphone 4a. Although not shown, transfer functions Hb to Hp corresponding to the
measurement microphones 4b to 4p can be obtained similarly. The measurement of the impulse
response may be performed for each of the measurement microphones, or may be performed
simultaneously for all of the measurement microphones 4 (a to p). Further, the measurement
signal is not limited to the TSP signal, and pseudo random noise or a music signal may be used.
Also in the following description, the transfer function from the measurement speaker to the
measurement microphone in the measurement environment 1 is represented by “H”.
[0018]
Thus, in the measurement environment 1, transfer functions Ha, Hb, Hc, Hd... Hp corresponding
to the measurement microphones 4a, 4b, 4c, 4d. Then, by using these transfer functions Ha to
Hp, the sound field of the measurement environment 1 can be reproduced in an environment
(reproduction environment) different from the measurement environment 1.
[0019]
04-05-2019
8
FIG. 2 shows the configuration of a reproduction system (reproduction signal generation device)
of reproduction speech in a reproduction environment. In the reproduced signal generation
device 5, the audio reproduction unit 6 can output an arbitrary audio signal S. The audio signal S
output from the audio reproduction unit 6 is supplied to the arithmetic units 7a, 7b, 7c, 7d,... 7n,
7o, 7p. Of the transfer functions Ha to Hp measured corresponding to the measurement
microphones 4 a to 4 p as described above, transfer functions to which the same subscript
(alphabet) is attached are given to the individual operation units 7 (a to p). H is set, and each
arithmetic unit 7 performs arithmetic processing based on the transfer function H set for each of
the supplied audio signals S. As a result, reproduction signals SHa, SHb, SHc, SHd,..., SHn, SHo,
and SHp in which an impulse response corresponding to the transfer function is convoluted with
the audio signal S from each arithmetic unit 7 (a to p). Is output. As described above, the
operation of each operation unit 7 can also be realized by an FIR filter in which transfer functions
(impulse responses) set respectively are set as filter coefficients. The same applies to all
"calculation units" described later.
[0020]
Reproduction signals SH (a to p) are supplied to reproduction speakers 8a, 8b, 8c, 8d,... 8n, 8o,
8p arranged in a reproduction environment. As a result, from each of the reproduction speakers
8 (a to p), sounds based on the reproduction signals SH (a to p) based on the transfer functions H
(a to p) in the measurement environment 1 are output.
[0021]
FIG. 3 is a schematic view for explaining the reproduction environment. The reproduction
environment 11 is, for example, an anechoic chamber or a studio with little reverberation. In this
reproduction environment 11, the reproduction speakers 8 (a to p) shown in FIG. 2 are arranged.
In this case, the reproduction speakers 8 (a to p) correspond to the arrangement positions of the
measurement microphones 4 (a to p) shown in FIG. 1 and on the outer periphery of the first
closed curved surface 10 formed with a radius R_bnd. It is placed towards the inside. That is, the
arrangement positions of the reproduction speakers 8 (a to p) and the measurement
microphones 4 (a to p) with the same suffix (alphabet) attached thereto correspond to each other.
Although the first closed surface 10 in the measurement environment 1 and the first closed
surface 10 in the reproduction environment 11 are closed surfaces existing in different spaces,
they are geometrically equivalent here formed by the same radius. The same reference numerals
04-05-2019
9
are given for the sake of convenience for the closed surface of.
[0022]
Then, the reproduction signals SH (a to p) are supplied and output from the reproduction
speakers 8 (a to p) as shown in FIG. The listener who is present can feel as if the sound field
when reproducing the audio signal S from the measurement speaker 3 shown in FIG. 1 is
artificially reproduced outside the first closed curved surface 10.
[0023]
Here, when there is no sound source in a closed surface, in order to accurately reproduce the
sound field at another place, the sound pressure and the normal direction of the outer periphery
of the closed surface in the original sound field and the reproduction sound field. It is known that
it is sufficient to match particle velocities (see publicly known document: "Acoustic system and
digital processing" edited by the Institute of Electronics, Information and Communication
Engineers (corona).
Specifically, as many bidirectional microphones are installed on a closed surface, and the sound
pressure and particle velocity at each installation point are measured. Therefore, in the first
closed surface 10 in the measurement environment 1, innumerable measurement microphones
are installed outward in the normal direction, and in the first closed surface 10 in the
reproduction environment 11, the innumerable number corresponding to these measurement
microphones. When the inside of the first closed curved surface 10 in the reproduction
environment 11 is set as the viewing position by arranging the reproduction speakers, the same
localization as the case where the listener is in the first closed curved surface 10 of the
measurement environment 1 A feeling and reverberation can be obtained, and furthermore, a
virtual sound image can be perceived at the position of the measurement speaker 3 which is not
in the reproduction environment 11. That is, at any listening position inside the first closed
curved surface 10 of the reproduction environment 11, a sound field feeling equivalent to that of
the measurement environment 1 can be obtained outside the listening position. However, as
described above, it is difficult to actually achieve this by requiring innumerable microphones and
reproduction speakers. Therefore, the present applicant focused on the fact that sound pressure
and particle velocity components are included in the output of a directional microphone, for
example, a unidirectional microphone, to reproduce a finite number of directional microphones
and the corresponding number thereof. It was confirmed by experiments that almost the same
sound effect can be obtained by the speaker.
04-05-2019
10
[0024]
Thus, for example, the sound field in the measurement environment 1 such as a hole can be
reproduced in the reproduction environment 11 as an anechoic chamber. Here, according to this,
if the measurement of the impulse response in the measurement environment 1 is performed
once as shown in FIG. 1, then, by using these measurement data (transfer function), the
reproduction environment 11 etc. The sound field of the measurement environment 1 can be
artificially reproduced at any time in an environment other than the measurement environment
1. And, in this case, according to the configuration of FIG. 2 described above, any sound can be
used as the sound to be reproduced in the sound field reproduced in this way, so any sound can
be reproduced in the measured hole. It can be reproduced as being played (any playing has been
performed).
[0025]
1−2. Reproduction of plural sound image positions In the above description, one sound
image position in the reproduction environment 11 based on the result of measuring the impulse
response from one measurement speaker 3 to each of the measurement microphones 4 (a to 4 p)
in the measurement environment 1 However, by applying this technique, it becomes possible to
reproduce a plurality of measurement speakers 3 arranged as shown in the following FIG. 4, that
is, a plurality of sound image positions.
[0026]
In FIG. 4, first, in this case, in the measurement environment 1 in which the measurement
microphones 4a to 4p similar to those in FIG. 1 are arranged, as shown in the drawing, a plurality
of measurement speakers 3-1, 3-2, and 3-3. , 3-4 are arranged at different positions outside the
first closed surface 10, respectively. Here, the arrangement position of the measurement speaker
3-1 is referred to as Position 1, and the arrangement position of the measurement speaker 3-2 is
referred to as Position 2. Similarly, the arrangement positions of the measurement speaker 3-3
and the measurement speaker 3-4 are assumed to be Position 3 and Position 4, respectively.
[0027]
04-05-2019
11
The measurement in the measurement environment 1 in this case is performed by supplying the
measurement signal TSP to each of the measurement speakers 3. At this time, in each of the
measurement microphones 4 (a to p), an output sound signal of each of the measurement
speakers 3 is detected. The audio signal for each of the measuring speakers 3 obtained by each
of the measuring microphones 4 is also supplied to an impulse response measuring device (not
shown) in this case, whereby the measuring speakers 3 (3-1 to 3-4) are obtained. The impulse
response corresponding to each of the measurement microphones 4 (a to p) is measured, and
based on the result, the transfer function corresponding to each of the measurement speakers 3
to each of the measurement microphones 4 can be obtained. . For example, in FIG. 4, a path for
obtaining a transfer function Ha-1 corresponding to the measuring speaker 3-1 to the measuring
microphone 4a and a transfer function Hb-1 corresponding to the measuring speaker 3-1 to the
measuring microphone 4b It is shown schematically. Similarly, regarding a path for obtaining a
transfer function Ha-3 corresponding to the measurement speaker 3-3 to the measurement
microphone 4a, and a transfer function Ho-3 corresponding to the measurement speaker 3-3 to
the measurement microphone 4o Is also shown schematically.
[0028]
Thus, according to the measurement signal TSP output for each of the measurement speakers 3,
transfer functions Ha-1 to Hp-1 corresponding to the measurement microphones 3-1 to the
measurement microphones 4a to 4p, and measurement Transfer function Ha-2 to Hp-2
corresponding to each of the measurement microphones 4a to 4p, and transfer function Ha-3 to
3 corresponding to each of the measurement microphones 3a to 4p. Hp-3, transfer functions Ha4 to Hp-4 corresponding to the measurement microphones 4a to 4p can be obtained. In this case,
it is desirable that the measurement of the impulse response is performed by outputting the
measurement signal TSP for each measurement speaker 3 so that the sound from the
measurement speakers 3 of different Positions is not mixed. In addition to arranging the plurality
of measurement speakers 3, one measurement speaker 3 may be sequentially arranged at each
position.
[0029]
FIG. 5 is a reproduction for performing sound field reproduction based on these transfer
functions Ha-1 to Hp-1, Ha-2 to Hp-2, Ha-3 to Hp-3, and Ha-4 to Hp-4. The configuration of the
reproduced signal generation device 15 that generates an audio signal (also referred to simply as
a reproduced signal) is shown. The reproduction signal generation device 15 has a configuration
04-05-2019
12
corresponding to the case where different sounds are output, for example, for each of a plurality
of sound image positions (Position 1 to Position 4). For this purpose, a total of four audio
reproduction units, that is, audio reproduction units 6-1, 6-2, 6-3, and 6-4, corresponding to each
Position are provided. Also in this case, each audio reproduction unit 6 can output an arbitrary
audio signal S. Here, the audio signals S output from the audio reproduction units 6 are shown as
audio signals S1, S2, S3 and S4 in association with the respective Position numbers.
[0030]
Further, four sets corresponding to each of Position 1 to Position 4 are provided as the operation
unit 7 in this case. That is, arithmetic units 7a-1 to 7p-1 corresponding to Position 1, arithmetic
units 7a-2 to 7p-2 corresponding to Position 2, arithmetic units 7a-3 to 7p-3 corresponding to
Position 3, and an arithmetic unit corresponding to Position 4 7a-4 to 7p-4 are provided. As
shown in the drawing, for the arithmetic units 7a-1 to 7p-1, transfer functions Ha-1 to Hpobtained in accordance with the outputs from the measurement speakers 3-1 (Position 1) to the
respective measurement microphones 4 are illustrated. 1 is set. The arithmetic units 7a-1 to 7p-1
perform arithmetic processing based on the set transfer function H on the audio signal S1 input
from the audio reproduction unit 6-1, and reproduce signals SHa-1 to SHp. Output -1. As a result,
first, a reproduced signal for reproducing the sound image position of the measurement speaker
3-1 (Position 1) is obtained. Further, for the calculation units 7a-2 to 7p-2, transfer functions Ha2 to Hp-2 obtained according to the outputs from the measurement speaker 3-2 (Position 2) to
the respective measurement microphones 4 are These arithmetic units 7a-2 to 7p-2 perform
arithmetic processing based on the transfer function H set on the audio signal S2 input from the
audio reproduction unit 6-2, and reproduce the reproduced signal SHa-2 Output ~ SHp-2. As a
result, a reproduced signal for reproducing the sound image position of the measurement
speaker 3-2 (Position 2) is obtained. Similarly, in the calculation units 7a-3 to 7p-3, transfer
functions Ha-3 to Hp-3 obtained in accordance with the measurement speaker 3-3 (Position 3)
are set, and from the sound reproduction unit 6-3, respectively. Arithmetic processing based on
the set transfer function H is performed on the input audio signal S3, and reproduced signals
SHa-3 to SHp-3 are output. As a result, a reproduced signal for reproducing the sound image
position of the measurement speaker 3-3 (Position 3) is obtained. Further, transfer functions Ha4 to Hp-4 obtained according to measurement loudspeaker 3-4 (Position 4) are set to operation
units 7a-4 to 7p-4, and are input from audio reproduction unit 6-4, respectively. Arithmetic
processing based on the set transfer function H is performed on the audio signal S4 to be
reproduced to output reproduced signals SHa-4 to SHp-4. As a result, a reproduction signal for
reproducing the sound image position of the measurement speaker 3-4 (Position 4) is obtained.
[0031]
04-05-2019
13
The adders 9a to 9p are provided in a one-to-one relationship with the reproduction speakers 8a
to 8p, and operation units 7a-1 to 7p-1, operation units 7a-2 to 7p-2, and operation units 7a-3.
.About.7p-3, among the arithmetic units 7a-4 to 7p-4, the output from the arithmetic unit 7 to
which the corresponding subscript (alphabet) is attached is input, and they are added to add the
corresponding subscript. To the reproduction speaker 8. That is, for example, the adder 9a
receives four reproduction signals SHa-1, SHa-2, SHa-3, and SHa-4 from the arithmetic units 7a1, 7a-2, 7a-3, and 7a-4, These are added and supplied to the reproduction speaker 8a. As a result,
reproduction sound corresponding to the path from all the positions shown in FIG. 4 to the
measurement microphone 4a can be output from the speaker 8a. Further, the adder 9p receives
the four reproduction signals SHp-1, SHp-2, SHp-3 and SHp-4 from the operation units 7p-1, 7p2, 7p-3 and 7p-4, Are added and supplied to the reproduction speaker 8p. As a result, from the
speaker 8p, it is possible to output reproduced voice corresponding to the path from all the
positions shown in FIG. 4 to the measurement microphone 4p. Such addition of the reproduced
signal SH is similarly performed in the adders 9b to 9o, so that the corresponding speakers 8b to
8o correspond to the paths from all Positions to the corresponding measurement microphones 4
as well. A reproduced signal can be output. As a result, the listener inside the first closed curved
surface 10 in the reproduction environment 11 surrounded by the reproduction speakers 8a to
8p is the listener of each of the measurement speakers 4 (Position 1, Position 2, Position 3,
Position 4) shown in FIG. It can be felt that the sound field in the case where the sound is
reproduced from each of them is artificially reproduced outside the first closed curved surface
10. That is, the sound image can be reproduced (localized, presented) at each position of
Position1, Position2, Position3, and Position4.
[0032]
FIG. 6 schematically shows the reproduction environment 11 in this case. The reproduced signal
generation device 15 shown in FIG. 5 is configured to be able to independently input separate
voices for each of Position1, Position2, Position3, and Position4. According to this, for example,
by inputting voices of different players such as vocals, drums, guitars, keyboards (keyboard
instruments), etc. for each Position, as shown in FIG. Player 1), Position 2 drum (Player 2),
Position 3 guitar (Player 3), Position 4 keyboard (Player 4), etc., it will be possible to present the
sound image of the player appropriate to the appropriate Position.
[0033]
04-05-2019
14
1−3. Sound Field Reproduction on the Second Closed Surface Here, in the method of sound
field reproduction as described above, the number of arrangement of the measurement speakers
4 and the number of arrangement of the reproduction speakers 8 in the reproduction
environment 11 are increased. The sense of localization of the sound image (reproducibility of
the sound field) can be increased. According to this, although an environment in which as many
reproduction speakers 8 as possible can be arranged is desirable as the reproduction
environment 11, it is considered that, for example, a room of a general household is used as an
actual reproduction environment. Be In an environment such as a room of a general home, the
number of loudspeakers arranged is limited, and in addition to the limitation of the number of
loudspeakers arranged as described above, the arrangement relationship of each loudspeaker is
different in each home. Is expected. Therefore, assuming sound field reproduction in a typical
home, according to the conditions, in the measurement environment such as a hole,
measurement is made according to the arrangement relationship and the arrangement number of
the measurement microphones 4 according to the respective conditions. Need to do. However,
according to this, for example, in order to correspond to the condition of the number and
arrangement of new speakers, it is necessary to go to the target hole one by one and to perform
the measurement by the arrangement of the measurement microphone according to the
condition The result is a lot of labor and expense in this regard.
[0034]
Here, as described above, the fact that the sound field in the measurement environment 1 can be
reproduced inside the first closed surface 10 in the reproduction environment 11 means that the
second further inside of the first closed surface 10 Also in the case of the closed surface, if the
calculation process using the transfer function from each speaker on the first closed surface 10
is performed, the reproduced signal for reproducing the sound field of the measurement
environment 1 can be obtained. That is, this makes it possible to reproduce the sound field of the
measurement environment 1 in the second closed curved surface. According to this, for example,
if the measurement in the target hall is performed once, the measurement for adaptation to the
actual reproduction environment such as the room of the home does not go to the target hall or
the like. In, for example, an experimental facility or the like as the reproduction environment 11,
the process can be performed from each of the reproduction speakers 8 on the first closed
curved surface 10 to the respective measurement microphones on the second closed curved
surface 14.
[0035]
04-05-2019
15
In addition, to describe for confirmation here, the sound field reproduction on the first closed
surface 10 in the reproduction environment 11 is not limited to the application to the room of
the home or the like in the above-mentioned experimental facility etc. A variety of applications
can be envisioned. For example, as an event such as live, in addition to the form in which the
artist actually plays in the hall (hall), a hall where a screen for projecting an image in an actual
live hall is arranged, which is performed as a so-called film live. There are also cases where live
audio is played by In such a film live venue, a relatively large number of reproduction speakers 8
can be arranged (in other words, a large number of measurement microphones 4 can be
arranged at the time of measurement). Based on the reproduced sound from these reproduction
speakers 8, it is possible to reproduce the sound field just like an actual live venue. At this time, if
the position of each player is determined in advance, measurement is performed for each
position in advance at an actual venue, and at the time of reproduction, the sound of the player
corresponding to that position is measured at that position. By performing arithmetic processing
based on the result (transfer function), the sound image position of each player can be accurately
reproduced.
[0036]
FIG. 7 is a schematic diagram for explaining a method of measuring an impulse response when
performing sound field reproduction on the second closed surface in the first closed surface 10
as described above. Here, in order to simplify the description, the case where only one
measurement speaker 3 is disposed in the measurement environment 1 and only one sound
image position is reproduced is illustrated. In FIG. 7, in this case, the measurement microphones
13A, 13B, 13C, 13D, and 13E are disposed inside the first closed curved surface 10 in the
reproduction environment 11. These measurement microphones 13 (A to E) may be arranged as
long as they correspond to reproduction speakers arranged in a reproduction environment
(reproduction environment 20 described later) which is, for example, a room of a home. The
number and arrangement relationship thereof are not limited to those illustrated. In this figure, a
closed curved surface formed with the measurement microphones 13 (A to E) as the outer
periphery is shown as a second closed curved surface 14. The inside of the second closed curved
surface 14 is a listening position in a reproduction environment, which is a room of a home. In
addition, since it is necessary to form the 2nd closed curved surface 14 inside the 1st closed
curved surface 10, when measuring in the measurement environment 1, the width of the 2nd
closed curved surface 14 is considered and the 1st closed It is desirable to form the curved
surface 10. Further, in this case, it is preferable to arrange as many measurement microphones 4
as possible for measurement in a hole and to obtain a transfer function H for as many points as
possible on the first closed curved surface 10. As a result, the target sound field can be
reproduced with higher reproducibility in the measurement environment 1 → reproduction
environment 11, and a higher reproducibility can be realized as adaptation to a reproduction
04-05-2019
16
environment such as a home room.
[0037]
Then, in this case, as shown in the figure, the measurement signal reproduction device 2 outputs
the measurement signal TSP to each of the reproduction speakers 8 (a to p) disposed on the first
flat curved surface 10, The impulse response corresponding to each of the measuring
microphones 13 from the speaker 8 is measured. From these impulse responses, it is possible to
obtain the transfer function in each path of each speaker 8 → each measurement microphone
13.
[0038]
The transfer function from such a reproduction speaker disposed on the first closed curved
surface 10 to the measurement microphone disposed on the second closed curved surface 14 is
represented by “E”. For example, as also shown in FIG. 7, the transfer function from the
reproduction speaker 8a to the measurement microphone 13A is represented as Ea-A. The
transfer function from the reproduction speaker 8b to the measurement microphone 13A is Eb-A,
and the transfer function from the reproduction speaker 8c is Ec-A. Although not shown, the
transfer functions from the reproduction speaker 8a to the remaining measurement microphones
13B to 13E are Ea-B, Ea-C, Ea-D, Ea-E, and the above-mentioned reproduction. The transfer
functions from the speaker 8b for measurement to the measurement microphones 13B to 13E
are Eb-B, Eb-C, Eb-D, Eb-E, and the transfer functions from the reproduction speaker 8c to the
measurement microphones 13B to 13E are Ec- B, Ec-C, Ec-D, Ec-E. Similarly, the lower case
alphabet indicates the other of the measurement speaker 8 and the capital alphabet after the
hyphen indicates the other of the measurement speaker 13 so that the transfer function E is
expressed as the correspondence of the speaker → the microphone.
[0039]
Here, if the transfer function E obtained as described above is used, the sound field reproduced
inside the first closed surface 10 can be reproduced in the second closed surface 14. As
described above, since the sound field of the measurement environment 1 can be reproduced
using the transfer function H inside the first closed surface 10 in the reproduction environment
11, according to this, even within the second closed surface 14 described above The sound field
04-05-2019
17
of measurement environment 1 can be reproduced.
[0040]
FIG. 8 shows the configuration of the reproduction signal generator 19 for reproducing the
sound field of the measurement environment 1 in the second closed surface 14 in this way. Note
that, in this figure, reproduction speakers 18A, 18B,... 18E arranged in an actual reproduction
environment 20, which is a room of a home, etc., are shown. First, the audio signal S from the
audio reproduction unit 6 is input to each of the operation units 7a to 7p in which transfer
functions Ha to Hp are set as in the case shown in FIG. As described above, the audio signals S
are arithmetically processed by the arithmetic units 7a to 7p based on the transfer functions Ha
to Hp, respectively, whereby reproduction signals SHa to SHp corresponding to the reproduction
speakers 8a to 8p are obtained.
[0041]
Here, as can be seen with reference to FIG. 7 above, the output sound from the reproduction
speaker 8 on the first closed curved surface 10 in this case is input to each of the microphones
13 on the second closed curved surface 14. Ru. And in connection with this, as the transfer
function E, the number according to the speakers 8a-8p for reproduction | regeneration on the
1st closed curved surface 10 is obtained, respectively about the microphone 13 for
measurement. That is, Ea-A, Eb-A ... Ep-A corresponding to the measurement microphone 13A,
Ea-B, Eb-B ... Ep-B corresponding to the measurement microphone 13B, for measurement Ea-C,
Eb-C,... Ep-C are obtained corresponding to the microphone 13C. Also, Ea-D, Eb-D... Ep-D
corresponding to the measurement microphone 13 D, and Ea-E, Eb-E... Ep-E corresponding to the
measurement microphone 13 E can be obtained. It is a thing. Therefore, in order to obtain
reproduction signals corresponding to each position of each of the measurement microphones
13 on the second closed curved surface 14 (that is, the reproduction speaker 18 in the actual
reproduction environment 20), the position of the measurement microphone 13 as illustrated.
Arithmetic units 16a-A to 16p-A, 16B-a to 16B-p... 16E-a to 16E, in which transfer functions E of
a to p for each of the microphones 13 described above are set for each of (A to E). 16E-p is
provided. Then, as shown in the figure, these arithmetic units 16a-A to 16p-A, 16B-a to 16B-p...
16E-a to 16E-p are reproduced signals SHa reproduced from the above-mentioned arithmetic
units 7a to 7p. The reproduction signals SH to which the corresponding subscripts are attached
are supplied as ~ SHp, whereby each arithmetic unit 16 performs arithmetic processing based on
the transfer function E set for each of the reproduction signals SH input thereto. Make it
04-05-2019
18
[0042]
With such a configuration, for each arrangement position of measurement microphones 13A to
13E (arrangement position of reproduction speakers 18A to 18E), according to each path of
measurement speakers 8a to 8p on first closed curved surface 10 The reproduced signal SHE
calculated and processed by the transfer function E can be obtained. That is, for example,
corresponding to the measurement microphones 13A (reproduction speakers 18A), reproduction
signals SHEA-a to SHEA-p calculated by the transfer function E corresponding to the paths from
the measurement microphones 8a to 8p, respectively. Is obtained. Similarly, corresponding to the
measurement microphone 13B (reproduction speaker 18B), the reproduction signals SHEB-a to
SHEB-p processed by the transfer function E according to the respective paths from the
measurement microphones 8a to 8p are It can be obtained. Likewise, the outputs from the
arithmetic units 16a-C-16p-C, 16D-a-16D-p, 16E-a-16E-p are SHEC-a-SHEC-p and SHED-a-SHEDp, respectively. , SHEE-a to SHEE-p.
[0043]
The adders 17A, 17B,... 17E are provided in a one-to-one relationship with the reproduction
speakers 18A, 18B,. As illustrated, the adders 17A, 17B,... 17E are SHEA-a to p from the
operation units 16a-A to 16p-A, and SHEB-a to p ... 16a from the 16a-B to 16p-B. SHEE-a to p
from -E to 16p-E are input, added together, and supplied to the corresponding one of the
reproduction speakers 18A, 18B,... 18E. As understood from the above description, the
reproduced signals SHE (a to p) input to each of the adders 17 are processed based on the
transfer function H and the transfer function E, respectively, and the respective measurement
microphones 13 (reproduction The reproduced signal corresponds to each of the speakers 18).
Therefore, as described above, by adding them by each adder 17 and supplying them to the
corresponding reproduction speaker 18, the reproduction signal SHE for reproducing the sound
field in the measurement environment 1 from each reproduction speaker 18 respectively. (SHEA,
SHEB ... SHEE) will be output. That is, in an actual reproduction environment 20 in which such a
reproduction speaker 18 is arranged in the same manner as the measurement microphone 13 on
the second closed surface 14, the sound field of the measurement environment 1 in the second
closed surface 14 is It can be reproduced.
[0044]
04-05-2019
19
FIG. 9 shows the actual reproduction environment 20, the measurement environment 1 as a
virtual sound field, and the first closed surface 10 when the sound field of the measurement
environment 1 is reproduced by the second closed surface 14 in this way. It is shown
schematically. The reproduction speakers 18 (A to E) in the reproduction environment 20 have
the microphones 13 for measurement shown in FIG. 7 on the second closed curved surface 14
having the same radius as the second closed curved surface 14 shown in FIG. It arrange |
positions by the positional relationship equivalent to AE. That is, the reproduction speakers 18 in
the reproduction environment 20 are arranged in a geometrically equivalent positional
relationship with the measurement microphones 13. Then, as shown in the drawing, these
reproduction speakers 18 (A to E) are disposed on the second closed curved surface 14 so as to
be directed inward, and from the reproduction speaker 18A, the reproduction signal SHEA and
the reproduction speaker 18B are provided. Is a reproduction signal SHEB, a reproduction signal
SHEC from the reproduction speaker 18C, a reproduction signal SHED from the reproduction
speaker 18D, and a reproduction signal SHEE from the reproduction speaker 18E, the listening
being inside the second closed surface 14 For the user, a sound field equivalent to the sound field
reproduced by the reproduction speakers 8 (a to p) disposed on the first closed curved surface
10 indicated by a broken line can be felt. That is, it is possible to artificially perceive the sound
field of the measurement environment 1 indicated by the broken line (sound image position of
the reverberation and measurement speaker 3). Therefore, when the inside of the second closed
curved surface 14 is at the listening position, the reverberation sound field and the sound image
localization in the measurement environment 1 can be obtained. This makes it possible to listen
to the audio as the content, for example, by a reverberation sound field such as a hall and sound
image localization while staying in a room at home, for example.
[0045]
Here, the case where only one position is assumed is exemplified as one measuring speaker 3 is
arranged in the measurement environment 1, but if a plurality of positions are assumed, the
number of the increased number of positions The configuration prior to each adder 17 shown in
FIG. 8 may be added. That is, for example, assuming two Positions of Position 1 and Position 2,
the audio reproduction unit 6 (6-2) for Position 2 and the operation units 7a to 7p (7a-2 to 7p)
are further provided with respect to the configuration shown in FIG. -2), operation units 16A-a16A-p, 16B-a-16B-p... 16E-a-16E-p (16A-a-2 to 16A-p-2, 16B-a-2 16B-p-2 ... 16E-a-2 to 16E-p-2)
are added. Then, the reproduction output from the added operation units 16A-a-2 to 16A-p-2,
16B-a-2 to 16B-p 2 ... 16E-a-2 to 16E-p-2. With regard to the signals, in this case also, the adders
17A to 17E may be configured to input and add those with the same suffix (upper case alphabet).
However, in this case, in the arithmetic units 7a to 7p and the arithmetic units 7a-2 to 7p-2 that
process the reproduction signal S based on the transfer function H from the measurement
environment 1 to the first closed surface 10, the transmissions set for each The functions H (ab)
04-05-2019
20
are also different. That is, for example, assuming that the transfer function H set by the
calculation units 7a to 7p is Ha-1 to Hp-1 corresponding to each of the measurement
microphones 8 from Position 1, the transmission set by the calculation units 7a to 7p-2 The
function H measures Ha-2 to Hp-2 corresponding to the measurement microphones 8 from
Position2. With the above configuration, as the outputs of the adders 17A to 17E, the sound
image positions of Position 1 and Position 2 are taken into consideration in the correspondence
of the measurement environment 1 → the first closed surface 10, and the first closed surface 10
→ the second closed surface 14 In the correspondence of the above, the reproduced signal SHE
(A to E) adapted by the transfer function E is obtained. As a result, reproduction signals capable
of reproducing the sound image positions of Position 1 and Position 2 can be output from the
reproduction speakers 18 (A to E), whereby the second closed curved surface 14 can also listen
to the inner side thereof. The person can perceive the respective sound images at Position 1 and
Position 2 in the measurement environment 1 as the virtual sound field.
[0046]
<2. Sound Field Reproduction as Embodiment> 2-1. Reproduction of pointing direction of
sound source Here, in the method of sound field reproduction described so far, the measurement
speaker 3 for outputting the measurement signal in the measurement environment 1 is
nondirectional, and from one point by this Information for expressing the sound caused by the
size of the measurement space, the material of the wall, floor, ceiling, geometric structure, etc. so
that sound can be emitted to the entire space (spatial information of measurement environment
1) It was supposed to measure. However, in practice, as a sound source to be reproduced as a
virtual sound image at the arrangement position of the measurement speaker 3, one having
directivity may be assumed. In such a case, if the sound field is reproduced based on the result of
measuring the impulse response using the measurement speaker 3 with nondirectionality as
described above, the directivity of the sound source can not be reproduced. It will be.
[0047]
Therefore, in the present embodiment, a directional speaker is used as a measurement speaker
for outputting a measurement signal in the measurement environment 1, and based on the result
of measuring the impulse response by directing this to a required direction, Reproduce the place.
FIG. 10 shows a schematic view of the measurement environment 1 in the case of reproducing a
specific directivity direction of a sound source as sound field reproduction according to the
present embodiment. In FIG. 10, also in this case, in the measurement environment 1, the
measurement microphones 4a to 4p are disposed outward on the first closed curved surface 10,
04-05-2019
21
respectively. Then, in this case, the measurement signal TSP is output in a state in which the
unidirectional measurement speaker 21 is directed to a specific direction as illustrated as a
directional measurement speaker, Thereafter, the measurement of the impulse response
corresponding to the measurement microphones 4a to 4p is performed as in the above to obtain
the transfer function H. Here, in FIG. 10, the direction in which the measurement speaker 21 is
directed is Direction 2, and the arrangement position of the measurement speaker 21 is Position
1. Then, the transfer function H obtained for each of the measurement microphones 4 (a to p) as
described above in the state of being directed to this Direction 2 is the transfer function of each
of the measurement microphones 4a, 4b,. Ha-dir2, Hb-dir2, Hc-dir2 ... Hp-dir2 are shown.
[0048]
FIG. 11 schematically shows how the sound field of the measurement environment 1 is
reproduced in the reproduction environment 11 based on the transfer function H obtained in this
manner. First, in this case, the line recording sound source (Player 1) 22 is assumed as the sound
source. The line recording sound source 22 is a sound source directly recorded from the target
player, for example, an electric signal detected by a microphone in vocals, and an audio output
terminal in electric musical instruments such as a guitar and a keyboard. Directly from the
electrical signal from the For the purpose of confirmation, “Player” mentioned here
corresponds to each one of the virtual sound image positions (Position) to be reproduced, and as
shown in FIG. For example, it corresponds to each performer separately, such as a vocal, a drum,
a guitar, and a keyboard. Here, the virtual sound image is indicated by a broken line, assuming
that Player 1 is a vocal.
[0049]
Also in this case, in the reproduction environment 11, the reproduction speakers 8a to 8p are
disposed on the first closed curved surface 10 in the same positional relationship as the
measurement microphones 4a to 4p in the measurement environment 1. Then, the audio signals
as line recording data from the line recording sound source 22 are subjected to the transfer
functions Ha-dir2, Hb-dir2, Hc-dir2, ... Hp-dir2 in which the pointing directions of the sound
sources are added as described above. Arithmetic processing is performed based on each, and
they are respectively output from the corresponding reproduction speakers 8. As a result, the
listener in the first closed curved surface 10 perceives that the Player 1 is emitting sound toward
the pointing direction indicated by the arrow in the figure at the virtual sound image position of
the Position 1 in the measurement environment 1 it can. That is, in this way, it is possible to
reproduce the sound field when the sound is emitted from the virtual sound image position of
04-05-2019
22
Position 1 in the measurement environment 1 toward the specific directivity direction in the
reproduction environment 11. In addition, as a structure of the reproduction signal generation
apparatus which produces | generates the reproduction signal which each speaker 8a-8p should
output in this case, the transfer function H set to each calculating part 7 differs from what was
shown in above-mentioned FIG. The other configurations are the same.
[0050]
2−2. Simulating a Performance Form In this way, if a specific pointing direction can be
expressed, it is possible to simulate a performance type such as, for example, a player such as a
vocal or guitar looking back while playing, or turning an instrument. The method will be
described below. FIG. 12 is a view schematically showing the state of the measurement
environment 1 for realizing the simulation of the playing style in this manner. First, in this case,
the measurement speaker 21 is directed in each direction about the virtual sound image position
to measure the impulse response. Here, a speaker with directivity of 60 ° is used as the
measurement speaker 21, and six directions (Direction 1, Direction 2... Direction 6) are defined as
the directivity directions of the sound source. Then, as illustrated, the impulse response when the
measurement speaker 21 is directed to each Direction is measured by the measurement
microphones 4 (a to p) disposed on the first closed curved surface 10, and the measurement
speaker 21 is measured. A transfer function H corresponding to each measurement microphone
4 is obtained for each Direction. At this time, the transfer function H to each of the measurement
microphones 4 (a to p) when it is Direction 1 is expressed as "Ha-dir1, Hb-dir1 ... Hp-dir1".
Similarly, transfer functions to each of the measurement microphones 4 (a to p) when Direction2,
Direction3, Direction4, Direction5, and Direction6 are "Ha-dir2, Hb-dir2 ... Hp-dir2", "Ha -dir3,
Hb-dir3 ... Hp-dir3 "," Ha-dir4, Hb-dir4 ... Hp-dir4 "," Ha-dir5, Hb-dir5 ... Hp-dir5 "," Ha-dir6 " , Hbdir6 ... Hp-dir6 ".
[0051]
In this way, by obtaining the transfer function H for each Direction, the directionality of the voice
emitted from the sound source can be obtained by performing the arithmetic processing on the
input voice signal while changing it to the transfer function H according to different Direction
with time. The directions can be made to differ sequentially. For example, by sequentially
changing the transfer function H used for arithmetic processing to one corresponding to
Direction 1 → Direction 2 → Direction 3 ... → Direction 6, the player at the virtual sound image
position is in the direction of Direction 1 → Direction 2 → Direction 3 ... → Direction 6 It is
possible to reproduce the sounding state while rotating to.
04-05-2019
23
[0052]
FIG. 13 shows the configuration of the reproduced signal generation device 25 in the case of
performing such control of the pointing direction. In addition, in this figure, the structure
corresponding to, when reproducing several Position (Position 1-Position 4) in the measurement
environment 1 as FIG. 4-FIG. 6 above showed is shown. As described above, assuming that a
plurality of Positions are assumed, the transfer function H has an impulse response by the same
method as that described in FIG. 12 for the measurement speakers 21 (21-1 to 21-4) disposed at
each Position. It can be determined based on the result of the measurement.
[0053]
In FIG. 13, first, since the reproduced signal generation device 25 in this case corresponds to a
plurality of Positions (1 to 4) in this way, each Position is the same as that shown in FIG. An
audio reproduction unit (6-1 to 6-4) for each and an operation unit for each Position are
provided. Also in this case, the audio reproduction units corresponding to each Position (each
Player) are shown as audio reproduction units 6-1, 6-2, 6-3, 6-4 in order from Position 1.
Moreover, about the calculating part for every Position, it is set as calculating part 26a-1 to 26p1, 26a-2 to 26p-2, 26a-3 to 26p-3, 26a-4 to 26p-4 in order from Position1. Furthermore, in this
case as well, adders 27a to 27p provided according to the one-to-one relationship with the
reproduction speakers 8a to 8p are provided. Among the adders 27a to 27p, among the
operation units 26a-1 to 26p-1, the operation units 26a-2 to 26p-2, the operation units 26a-3 to
26p-3, and the operation units 26a-4 to 26p-4, The output from the operation unit 26 to which
the corresponding subscript (alphabet) is attached is input, and they are added and supplied to
the corresponding reproduction speaker 8. As a result, reproduction signals representing the
sound image position of each Position can be output from each reproduction speaker 8.
[0054]
Then, in this case, the controller 28 and the ROM 29 are provided as a configuration for
controlling the pointing direction by sequentially changing and setting the transfer function H
obtained for each Direction in the above manner. In the ROM 29, information of the transfer
function H for each Position and each Direction obtained in advance as a result of measurement
in the measurement environment 1 is stored as the Direction correspondence information 29a.
04-05-2019
24
FIG. 14 shows the data structure of the Direction correspondence information 29 a stored in the
ROM 29. As shown in this figure, in this case, information of the transfer function H when the
measurement speaker 21 is directed to each Direction can be obtained for each Position. Here,
with respect to transfer functions Ha to Hp corresponding to the respective measurement
microphones 4 (a to p), the position is indicated by numbers attached immediately thereafter.
Furthermore, each Direction is represented by the number of "-dir" added after. For example, the
transfer function H to the measurement microphone 4a when the measurement speaker 21 of
Position 1 is directed in the direction of Direction 2 is expressed as "Ha1-dir2", and the
measurement speaker 21 of Position 3 is directed in the direction of Direction 6 The transfer
function H to the measurement microphone 4b is expressed as "Hb3-dir6".
[0055]
The controller 28 is issued from each Position by variably setting the transfer function H set in
each operation unit 26 based on the information of the transfer function H for each Position and
each Direction stored in the ROM 29. Control the pointing direction of voice. For example, when
it is assumed that the pointing direction for Position 1 is rotated in the Direction1 → Direction2
→ Direction3 direction, the transfer function Ha1-dir1 to Hp1-dir1 → Ha1-dir2 to Hp1-dir2 →
Ha1-dir3 to Hp1-dir3 from the ROM 29 Are sequentially read, and these are sequentially set to
the operation units 26a-1 to 26p-1. As a result, the pointing direction for Position 1 can be
rotated sequentially as Direction 1 → Direction 2 → Direction 3 as time passes.
[0056]
Here, in order to express smoother rotation, it is necessary to shorten the interval of changing
Direction as much as possible. For this purpose, it is conceivable to define finer Direction
segments and obtain transfer functions H for more directions. However, this is not realistic
because it causes an increase in the number of times of measurement, and in order to actually
represent the rotation, the transfer function H of the adjacent Direction is interpolated to
generate the transfer function H for each Direction by further finer division. , These are
sequentially changed and set according to the passage of time. According to this, it is possible to
express smooth rotation even when relatively few Direction are defined.
[0057]
04-05-2019
25
Although the configuration for instructing the controller 28 to change the pointing direction is
omitted here, such an instruction on the changing direction of the pointing direction is, for
example, provided with an operation unit for user operation. It can be performed by giving in
advance instruction information for instructing on which direction should be set at which timing
on the reproduction time axis of the audio signal or on the reproduction time axis of the audio
signal. This is also true for the specification of the sound source (Position) to be subjected to
directional control.
[0058]
2−3. Reproduction of Stereo Effector By the way, in the above description, it is assumed that
the input sound signal is a monaural sound signal, but the input sound signal may be a stereo
sound signal. For example, in an electric musical instrument such as an electric guitar, although
the output sound itself is monaural, when it passes through a so-called effector that effects this,
the monaural signal may be processed and output as a stereo signal. When it is desired to
reproduce the rendering effect by such an effector as it is, it is conceivable to reproduce two
sound sources of Rch (channel) and Lch at one virtual sound image position. Here, an example
will be described in which such reproduction of Rch and Lch is performed using the concept of
the directivity direction of the sound source described above.
[0059]
FIG. 15 schematically shows the state of the measurement environment 1 in the case of
reproducing two sound sources of Rch and Lch at one virtual sound image position as described
above. Here, if the respective sound sources are based on Rch and Lch, the pointing directions
corresponding to these sound sources may be reversed or at least not made the same. Therefore,
in this case, Direction 6 is defined for the pointing direction of the Rch sound source, and
Direction 2 is defined for the pointing direction of the Lch sound source as illustrated. Then, in
response to this, as the measurement in this case, the impulse response to each of the
measurement microphones 4 when the measurement speaker 21 is directed to the Direction 6
direction corresponding to the Rch sound source, and the Direction 2 direction corresponding to
the Lch sound source The impulse response to each of the measurement microphones 4 when
the measurement speaker 21 is directed to is measured to obtain the transfer functions H
corresponding to the Rch sound source and the Lch sound source. Also in this case, assuming
that the arrangement position of the measurement speaker 21 is Position 1, the transfer function
H obtained for each of the microphones 4 when directed to the Direction 6 as described above is
“Ha1-dir6, Hb1-dir6. It is indicated as "Hp1-dir6". Similarly, the transfer function H obtained for
04-05-2019
26
each of the microphones 4 when directed to the Direction 2 is indicated as "Ha1-dir2, Hb1-dir2...
Hp1-dir2".
[0060]
FIG. 16 generates reproduction signals to be output from the reproduction speakers 8 (a to p) in
the reproduction environment 11 when reproducing two sound sources of Rch and Lch at one
virtual sound image position as described above. 3 shows the configuration of the reproduced
signal generation device 30 for The reproduction signal S from the audio reproduction unit 6 is
input to the stereo effect processing unit 31. The stereo effect processing unit 31 subjects the
input monaural audio signal to digital effect processing such as so-called flanger or digital delay
to generate a stereo audio signal by Rch and Lch. Although the configuration in which the stereo
effector is incorporated is shown here, it is also possible to directly input the Rch audio signal
and the Lch audio signal obtained by performing stereo effect processing in an external effector.
[0061]
In the calculation units 31a-R, 31b-R... 31p-R, the transfer functions Ha1-dir6, Hb1-dir6... Hp1dir6 obtained for the Rch sound source as described above are obtained. It is set. Further,
transfer functions Ha1-dir2 and Hb1-dir2... Hp1-dir2 determined corresponding to the Lch sound
source are set in the arithmetic units 31a-L, 31b-L. Arithmetic units 31a-R, 31b-R... 31p-R
perform arithmetic processing based on the transfer function H set for the Rch audio signals
input thereto. As a result, reproduced signals to be output from the reproduction speakers 8 in
order to reproduce the Rch sound source having the directional direction of Direction 6 are
obtained. Similarly, the arithmetic units 31a-L, 31b-L,... 31p-L are caused to perform arithmetic
processing based on the transfer function H set for the Lch audio signal respectively input,
whereby Direction 2 Reproduction signals to be output from the reproduction speakers 8 can be
obtained in order to reproduce the Lch sound source having the pointing direction.
[0062]
The adders 32a to 32p respectively input and add reproduced signals from the arithmetic unit
31 having the same suffix among the arithmetic units 31a-R to 31p-R and 31a-L to 31p-L. The
result is also supplied to the same reproduction speaker 8 with the same suffix. In this way, the
reproduced signal for reproducing the pointing direction of the Rch sound source and the
04-05-2019
27
reproduced signal for reproducing the pointing direction of the Lch sound source are
respectively added and output from the corresponding reproduction speaker 8. The sound field
of the measurement environment 1 can be reproduced in the form of expressing the pointing
direction of the Rch sound source and the pointing direction of the Lch sound source in the first
closed surface 10 in the reproduction environment 11 in which the reproduction speakers 8 are
arranged. .
[0063]
2−4. Here, the so-called acoustic instruments which are not electric musical instruments
such as piano, violin, drum etc. The sound characteristics will be different. Strictly speaking, the
directivity of each musical instrument (sound source) and the sound emission characteristics of
each directional direction individually affect the entire acoustic space such as a hole to form the
acoustic characteristics of the sound source. Therefore, when the virtual sound image as the
sound source is to be reproduced more realistically, it is effective to perform the sound field
reproduction in the form of considering the directivity and the sound emission characteristics for
each directivity direction.
[0064]
A method in the case where sound field reproduction is performed in consideration of the
directivity of a sound source and the sound emission characteristics for each directivity direction
as described above will be described with reference to the following FIGS. 17 to 20. FIG. 17 is a
view schematically showing a state of recording of a sound source in this case, and FIG. 17 (a)
shows a perspective view thereof and FIG. 17 (b) shows a top view thereof. In this case, first, a
sound source recording surface 35 is defined which encloses the required sound source 36 in a
circular shape on a certain plane. Then, on the sound source recording surface 35, a plurality of
recording microphones 37 (directional microphones) are arranged so as to surround the sound
source 36. Also in this case, the directions of the arrows marked on the microphones 37 indicate
directivity directions, and as can be seen from these arrows, the microphones 37 are disposed in
the direction facing the sound source 36. By recording the voice from the sound source 36 for
each of a plurality of directional microphones arranged in this way, it is possible to reflect the
directivity of the sound source 36 and the sound emission characteristics for each directivity
direction in each recorded voice. it can. Here, an example is shown in which six recording
microphones 37 each having directivity of 60 ° are arranged on the sound source recording
surface 35 and six directions of Direction 1 to Direction 6 are defined. As shown, the recording
microphone 37 of Direction 1 is arranged as the recording microphone 37-1 and the recording
04-05-2019
28
microphone 37 of Direction 2 is arranged as the recording microphone 37-2, and the code of the
recording microphone 37 is arranged by the numbers following the hyphen. Indicates another
direction. By surrounding the sound source 36 in six directions in this manner, six directions are
defined as the directivity directions for the sound source 36 in this case. Furthermore, by
recording the sound by the recording microphones 37 arranged in six directions in this manner,
the sound emission characteristics of the sound source 36 for each of the six directivity
directions are recorded as the recording sound of each of the recording microphones 37. Each
can be reflected.
[0065]
According to this, in this case, if the sound recorded by each recording microphone 37 is emitted
outward for each Direction, the directivity of the sound source 36 and the emission
characteristics for each directivity direction are reproduced. can do. That is, directional
directional speakers of the same directivity 60 ° are arranged outward at the positions of the
recording microphones 37 arranged for each Direction in FIG. 17, and recording is performed by
the recording microphones 37 respectively corresponding to these speakers. By outputting the
sound, the sound source 36 can be reproduced in a form that reflects the directivity of the sound
source 36 and the sound emission characteristics for each directivity direction. In this case, the
recording of the sound source 36 by each of the recording microphones 37 is as close as
possible to the sound source 36 (so-called "on" state) so as not to include the space information
at the recording site. It is preferred to be done.
[0066]
In this manner, the directivity of the sound source 36 is obtained by recording the sound from
each Direction so as to surround the sound source 36 and outputting each recorded sound by the
directional speaker arranged so as to have the same Direction relationship. It is possible to
reproduce the sound emission characteristics for each directivity direction, and in the present
embodiment, the sound field as the measurement environment 1 in which such a sound source
36 is disposed is replaced with the reproduction environment 11 which is another environment.
To reproduce. Here, in order to express the directional direction of Direction 1 to Direction 6 of
the sound source 36 disposed in the measurement environment 1 in the reproduction
environment 11, as described above, the transfer function H should be obtained for each of these
Directions. Just do it. In this case, since the recorded sound from the sound source 36 exists for
each Direction, the recorded sound of each Direction is convoluted with the transfer function H
of the same Direction among the transfer functions H obtained for each Direction, Reproduction
04-05-2019
29
signals for each Direction can be obtained.
[0067]
Here, six directions are defined as the directivity directions for the sound source 36. Therefore,
as a method for obtaining the transfer function H for each Direction, as described in FIG. The
impulse response corresponding to each of the measurement microphones 4 (a to p) when the
measurement speakers 21 are directed to each direction (Direction 1 to Direction 6) may be
measured. That is, for example, assuming that the arrangement position of the sound source 36
in the measurement environment 1 is Position 1 (Player 1), transfer functions Ha1-dir1, Hb1dir1... Hp1-dir1 for Direction1, transfer functions Ha1- for Direction2. dir2, Hb1-dir2... Hp1-dir2
are obtained. Similarly, for Direction 3, transfer functions Ha1-dir3, Hb1-dir3 ... Hp1-dir3, for
Direction 4 transfer functions Ha1-dir4, Hb1-dir4 ... Hp1-dir4, for Direction 5 transfer functions
Ha1-dir5, With regard to Hb1-dir5... Hp1-dir5 and Direction 6, transfer functions Ha1-dir6 and
Hb1-dir6... Hp1-dir6 are obtained.
[0068]
FIG. 18 shows a configuration of the reproduced signal generating device 40 corresponding to
the case of performing sound field reproduction in consideration of the directivity of a sound
source and the sound emission characteristics for each directivity direction. In this case, the
audio reproduced by the audio reproducing unit 6 is an audio signal recorded for each Direction.
Here, the audio reproduction unit 6 that reproduces the audio recorded by the recording
microphone 37-1 disposed in the Direction 1 is referred to as an audio reproduction unit 6-1-1,
and the recording microphone 37-2 disposed in the Direction 2 The audio reproduction unit 6
that reproduces the audio recorded in the above is shown as an audio reproduction unit 6-1-2.
Similarly, the audio reproduction unit 6 for reproducing the audio signals recorded by the
recording microphones 37-3, 37-4, 37-5, and 37-6 is referred to as an audio reproduction unit 61-3, 6-1-4. , 6-1-5, 6-1-6. In the code attached to the audio reproduction unit in this case, the
number after the first hyphen is a number corresponding to the case where the sound source 36
is assumed to be Player 1 temporarily disposed at Position 1, for example, Position 2 In the case
of the player 2 placed in the, "2" is attached. The same applies to the reference numerals of the
respective parts described below.
[0069]
04-05-2019
30
Then, the arithmetic units 41-1-1a to 41-1-1p, and the arithmetic unit 41-1- 1 are provided to
process the audio signals recorded for each of the Directions based on the transfer function H
obtained for each of the Directions. 2a to 41-1-2p, calculation units 41-1-3a to 41-1-3p,
calculation units 41-1-4a to 41-1-4p, calculation units 41-1.5a to 41- 1-5p, Arithmetic units 411-6a to 41-1-6p are provided. In the calculation units 41-1-1a to 41-1-1p, transfer functions H
(Ha1-dir1 to Hp1) corresponding to the respective measurement microphones 4 (a to p) when
the measurement speaker 21 is directed to Direction 1. -dir1) is set, and each processes the audio
signal supplied from the audio reproduction unit 6-1-1 based on the set transfer function H. As a
result, it is possible to obtain reproduced signals to be output from the reproduction speakers 8
(a to p) in order to express the sound recorded in the Direction 1 as sound emitted in the
Direction 1 first. Further, transfer functions Ha1-dir2 to Hp1-dir2 are set in the arithmetic units
41-1-2a to 41-1-2p, and the recorded audio signals of the Direction 2 reproduced from the audio
reproduction units 6-1-2 are respectively set. By performing arithmetic processing based on the
set transfer function H, it is possible to obtain reproduced signals to be output from the
reproduction speakers 8 in order to express the recorded sound of the Direction 2 as that
emitted in the Direction 2 direction. Similarly, calculation units 41-1-3a to 41-1-3p, calculation
units 41-1-4a to 41-1-4p, calculation units 41-1.5a to 41- 1-5p, and calculation unit 41-1 6a to
41-1-6p, transfer functions Ha1-dir3 to Hp1-dir3, transfer functions Ha1-dir4 to Hp1-dir4,
transfer functions Ha1-dir5 to Hp1-dir5, transfer functions Ha1-dir6 to Hp1-dir6 Are set, and the
audio signals from the audio reproduction units 6-1-3, 6-1-4, 6-1-5, and 6-1-6 are processed
based on the set transfer function H. As a result, the recorded voice of Direction 3 in the
calculation units 41-1-3a to 41-1-3p, the recorded voice of Direction 4 in the calculation units
41-1-4a to 41-1-4p, and the calculation units 41-1.5a to 41-41. With respect to the recorded
voice of Direction 5 in 1-5 p and the reproduced voice of Direction 6 in arithmetic units 41-1-6 a
to 41-1-6 p, reproduction signals to be output from the reproduction speakers 8 (a to p) are
obtained. .
[0070]
The adders 42a, 42b... 42p are provided in a one-to-one relationship with the reproduction
speakers 8a, 8b... 8p, and the reproduced signals from the operation units 41 with the
corresponding subscripts are Inputting and adding up, the result is supplied to the reproduction
speaker 8 with the same subscript. Thereby, the reproduction signal to be output for each
reproduction speaker 8 obtained for each Direction as described above is added for each
reproduction speaker 8 and output from the corresponding reproduction speaker 8 It becomes.
[0071]
04-05-2019
31
With such a configuration of the reproduction signal generation device 40, for example, recorded
audio in Direction 1 can be reproduced as output in the directional direction of Direction 1 in
measurement environment 1, and similarly, recorded audio in Direction 2 is measured
environment 1 Can be reproduced in the reproduction environment 11 as being output in the
directional direction of Direction2. Also, the voices recorded in other Direction can be reproduced
as being output in the corresponding Direction direction of the corresponding Direction. As a
result, in the first closed surface 10 of the reproduction environment 11, the virtual sound image
in the measurement environment 1 can be reproduced more realistically by reflecting the
directivity of the sound source and the sound emission characteristics for each directivity
direction.
[0072]
Here, since six directions are defined by using six recording microphones 37 having directivity of
60 °, the transfer function H is the measurement results of the six directions similar to FIG.
Although the example used is described, for example, when different numbers of directivity
directions are defined, for example, the directivity direction of 18 directions is defined by the
recording microphone 37 of directivity 20 °, the transfer function H for each of the defined
directivity directions You can ask for Alternatively, even if measurement of the transfer function
H is not performed for all directions actually defined, the transfer function H is obtained for less
directions, and the transfer functions H of adjacent directions among them are interpolated to
define The transfer function H may be obtained according to the direction. This can reduce the
number of measurements.
[0073]
In addition, although the case where the voice recording from the sound source is planarly
performed is illustrated here, for example, as shown in FIG. 19 below, it is conceivable to perform
voice recording by three-dimensionally surrounding the sound source. In FIG. 19, the example
which encloses a sound source cylindrically is shown. The recording of the sound source in this
case is performed by dividing the cylinder by upper, middle, and lower circular planes as shown,
and arranging a plurality of recording microphones 51 on the respective circular planes. Here,
the upper, middle, and lower circular planes are shown as a circular plane 50-1, a circular plane
50-2, and a circular plane 50-3, respectively. Then, the recording microphone 51 disposed on the
outer periphery of the upper circular plane 50-1 is 51-1, and the recording microphone 51
04-05-2019
32
disposed on the outer periphery of the middle circular plane 50-2 is 51-2; The recording
microphone 51 disposed on the outer periphery of the circular plane 50-3 is denoted by 51-3.
Also in this case, on each of the circular planes, the recording microphones 51 have directivity of
60 °, and six directions of Direction 1 to Direction 6 are defined. In this case, the Direction of
each recording microphone 51 is represented by the number after the second hyphen. For
example, the recording microphone 51 disposed in the upper Direction 2 represents the
recording microphone 51-1-2, and the recording microphone 51 disposed in the lower Direction
6 is expressed as 51-3-6.
[0074]
As described above, when the sound source is three-dimensionally surrounded and voice
recording is performed by each of the recording microphones 51, for example, assuming that the
sound source is a human, the noise of clothes rubbing, the sound of foot action, etc. In addition to
voices, it becomes possible to record a plurality of sound sources including their emission
characteristics for each directivity and directivity direction. That is, at the same arrangement
position as the recording microphone 51 shown in FIG. 19, the same directivity 60 °
reproduction speaker is disposed outward, and recorded from the corresponding recording
microphone 51. By outputting the voice, it is possible to make it possible for the human being as
the recording target to be present in the space surrounded by the circular flat surfaces 51-1 to
51-3.
[0075]
FIG. 20 is a view schematically showing the state of the measurement environment 1 when the
sound source surrounded in a three-dimensional manner is reproduced in the reproduction
environment 11 as described above. First, in this case, since three-dimensional reproduction is
performed, a three-dimensional space is also assumed as the first closed surface 10. In this case,
a space of a rectangular parallelepiped is assumed as the first closed curved surface 10, and the
measurement microphone is arranged to face outward at a required position covering the first
closed curved surface 10 of the rectangular parallelepiped. The measurement microphones thus
three-dimensionally arranged are denoted by 53a to 53x as illustrated. Note that this does not
necessarily mean that the number of measurement microphones 4 to be arranged is different
from that in the case of the first closed curved surface 10 according to the previous planes, and
the measurement microphones 53 are a to p It can also be done. In the above description, the
first closed curved surface 10 is circular, but here, for convenience, the same reference numeral
is given also to a solid closed curved surface.
04-05-2019
33
[0076]
And measurement in this case assumes circular plane 50 -1, 50-2, and 50-3 in the outside of the
first closed curved surface 10 by the above-mentioned solid, and measures it for each Direction
same as at the time of recording on these circular planes It arranges and performs the speaker
52 for. That is, the measurement speakers 52 are disposed in accordance with the arrangement
relationship that is geometrically equivalent to the recording microphone 51 shown in FIG. A
directional speaker with a directivity of 60 ° is also used as the measurement speaker 52. Also
in this case, the reference numerals of the measurement speakers 52 indicate that the numbers
after the first hyphen indicate the positions of the circular planes 50-1, 50-2, and 50-3 to be
arranged, and the numbers after the second hyphen. Represents another of Direction 1 to
Direction 6. Then, the measurement signal TSP from the measurement signal reproduction device
2 (not shown) is output for each of the measurement speakers 52, and at this time, each
measurement microphone 53a arranged on the first closed curved surface 10 The impulse
response (transfer function H) obtained corresponding to 53x is measured. For example, since
there are x measurement microphones 53 on the first closed surface 10 and 6 × 3 = 18
measurement speakers 52, a total of 18 × x transfer functions H can be obtained. It will be.
[0077]
Although illustration is omitted, in the reproduction environment 11 in this case, the first closed
surface 10 of the same cube is assumed according to the assumption of the first closed surface
10 as a cube in the measurement environment 1, and measurement is also performed in this case
as well. The reproduction speakers 8a to 8x are arranged in a geometrically equivalent
arrangement relationship with the measurement microphone 53 arranged in the environment 1.
The configuration of a reproduced signal generating apparatus for generating reproduced signals
to be output by the reproduction speakers 8a to 8x is basically the same as that shown in FIG.
That is, also in this case, when looking at one circular plane 50, for each of the six directions
from Direction 1 to Direction 6, the recorded sound is convoluted with the corresponding
transfer function H, and the reproduction signal to be output from each reproduction speaker 8
is Since there is no change in obtaining, it is assumed that the configuration (that is, six sound
reproducing units 6 and six sets of operation units 41 (1a to 1p, 2a to 2p,... 6a to 6p)) is further
increased by two. I can catch it. However, in this case, since the measurement microphones 53
are a to x, the transfer function H obtained for each of the measurement speakers 52 is from Ha
to Hx. That is, as one set of operation units 41 provided for each of the recorded voices, ones
having Ha to Hx set are provided. Similarly, since a to x are also used as the reproduction speaker
04-05-2019
34
8, even the adder 42 is provided to a to x corresponding to each reproduction speaker 8. Also in
this case, each adder 42 inputs and adds the reproduced signal from the operation unit 41 with
the same subscript, and supplies the result to the reproduction speaker 8 with the same
subscript. Configure.
[0078]
With such a configuration, it is assumed that the recording audio from each recording
microphone 51 is emitted from each reproduction speaker 8 to each Direction in each of the
circular flat surfaces 50-1, 50-2, and 50-3. A reproduced signal that can be reproduced is output.
As a result, the listener in the first closed surface 10 in the reproduction environment 11 in
which the reproduction speaker 8 is arranged has a human being as a recording target in this
case in the cylindrical space as the virtual sound image position in the measurement environment
1 You will be able to feel as you do. In other words, in the first closed curved surface 10 of the
reproduction environment 11, reproduction can be performed such that a human being as a
recording target is present in the cylindrical space as the virtual sound image position of the
measurement environment 1.
[0079]
Such a method is suitably adopted as a method of after-recording (after-recording) such as
animation and CG. In other words, by recording the voice actor in a cylindrical shape by
enclosing it in the form of a cylinder, recording including the sound of rubbing clothes and
footsteps as well as the voice is performed. Then, as the transfer function H to be used, for
example, according to the relationship between the position where the character is present in the
scene and the space surrounding it, the selection of the measurement environment 1, the virtual
sound image position in that and the first closed The arrangement relationship with the curved
surface 10 is selected and measured. Thereby, in the reproduction environment 11, it is possible
to reproduce as if the character exists in the cylindrical space as the assumed virtual sound
image position in the assumed space.
[0080]
Although an example in which the sound source is enclosed in a cylindrical shape is shown here
as an example of surrounding the sound source in a three-dimensional manner, it may be
04-05-2019
35
surrounded in a spherical shape, for example. That is, in this case, the recording microphone 51
is disposed for each Direction defined arbitrarily on the spherical surface surrounding the sound
source to perform voice recording. At this time, in the measurement environment 1, the
measurement loudspeakers 52 may be arranged on the same spherical surface at a position
geometrically equivalent to the arrangement position of the recording microphones 51 and the
same impulse response may be measured. . When the arrangement number of the recording
microphone 51 and the measurement microphone 53 (that is, the measurement speaker 52 and
the reproduction speaker 8) is the same as the configuration of the reproduction signal
generation apparatus, the same configuration as that described above is used. It becomes
composition.
[0081]
Further, although the case of measuring the impulse response by arranging a plurality of
measuring speakers 52 is illustrated here, the measurement of the impulse response in the
measurement environment 1 is not limited to arranging a plurality of measuring speakers 52
actually, it is one It is also possible to perform the measurement speakers 52 sequentially toward
each Direction at each position on the outer periphery of each circular plane 50. Also in this case,
it is also possible to reduce the number of measurements by interpolating the transfer function H
in the adjacent Direction.
[0082]
2−5. Adding ambience data Here, it is effective to add ambiences other than the performance
sounds that occur at the venue, such as cheering of audiences and applause, in order to
reproduce the sense of presence in events such as live more realistically It is. Here, the method in
the case of performing a more realistic sound field reproduction by adding such an ambience will
be described.
[0083]
FIG. 21 schematically shows the state of the measurement environment 1 in the case of
recording about such an ambience. First, in this case, the recording microphones 64a to 64p are
disposed on the first closed surface 10 at the same number and position as when the
measurement of the impulse response is performed. The directional microphones are also used
04-05-2019
36
as the recording microphones 64a to 64p. In addition, as microphones arranged at the same
position on the first closed curved surface 10 of the same measurement environment 1, although
different codes are attached to the recording microphone 64 and the measurement microphone
4, the same microphone is used It may be
[0084]
Then, as shown in the drawing, a plurality of persons as a plurality of extras are arranged at a
required position outside the first closed curved surface 10 to emit predetermined voices as
ambiences such as cheers and applause, and for each recording The voice is recorded by the
microphone 64. As a result, the recording microphones 64 a to 64 p can record ambience in a
form including the spatial information of the measurement environment 1. Here, the recorded
audio signals of the ambience obtained respectively by the recording microphones 64a, 64b, 64p
are called ambience-a, ambience-b, ... ambience-p.
[0085]
In the reproduction environment 11, the first closed by sound output of ambience-a, ambience-b,
... ambience-p by the reproduction speakers 8a, 8b, ... 8p disposed on the first closed surface 10.
The listener inside the curved surface 10 can feel as if the spectator is outside the first closed
curved surface 10 in the measurement environment 1.
[0086]
FIG. 22 shows the configuration of the reproduction signal generation device 60 in the case of
adding such an ambience.
Note that this figure shows the configuration of the reproduced signal generation device
corresponding to the case of performing sound field reproduction in consideration of the
directivity of the sound source and the sound emission characteristics for each directivity
direction shown in FIG. As shown in this figure, the ambiences -a, ambiences-b ... ambiences-p
recorded in the measurement environment 1 are reproduced and output by the reproduction
units 61a, 61b ... 61p, respectively. In this case, adders 62a to 62p are further provided to the
subsequent stages of the adders 42a to 42p provided in a one-to-one relationship with the
reproduction speakers 8a to 8p, and the reproduction units 61a, 61b,. 61p supplies ambience-a,
ambience-b, ... ambience-p to the adders 62a, 62b, ... 62p.
04-05-2019
37
[0087]
Thus, the ambiences -a, ambiences-b, ..., ambiences-p are added to the supply lines of the
reproduction signals of the reproduction speakers 8a, 8b, ... 8p and output. That is, the ambiencea, the ambience-b, and the ambience-p recorded by the recording microphones 64a, 64b,... 64p in
the measurement environment 1 are arranged at geometrically equivalent positions in the
reproduction environment 11. The reproduction speakers 8a, 8b,... 8p output to the inside of the
first closed curved surface 10, respectively. As a result, the listener inside the first closed surface
10 in the reproduction environment 11 can feel as if the spectator in the measurement
environment 1 is outside the first closed surface 10, giving a more realistic presence. Can.
[0088]
2−6. Sound Field Reproduction According to the Camera Viewpoint So far, the case of mainly
reproducing only the sound in the reproduction environment 11 has been described, but for
example, AV (Audeo and Video) as content containing a live event of a certain artist It can be
considered as content. That is, in accordance with this, in the reproduction environment 11, the
live recorded audio and the recorded video synchronized with this are reproduced. Here, as AV
content recording live video, there is one in which a subject (artist) is captured not from only one
viewpoint (one angle) from the beginning but from a large number of angles. As described above,
when there is an image for capturing a subject from a plurality of angles, by performing sound
field reproduction corresponding to each angle, it is possible to give a sense of reality
corresponding to each camera angle.
[0089]
FIG. 23 is a diagram schematically showing the method. FIG. 23 shows the state of the
measurement environment 1 as a hall where an event such as live is actually performed, and FIG.
23 (a) shows an image recording by the camera 65 when the live is actually performed. Is
schematically shown, and FIG. 23 (b) schematically shows the state of measurement according to
the camera angle. Here, it is assumed that there are a plurality of players on the stage 66, and the
positions thereof are indicated by Position 1 to Position 4 shown in the drawing. For example, as
shown in FIG. 23A, when the camera 65 captures an artist on the stage 66, the stage 66 at the
same angle in the hole as the same measurement environment 1 shown in FIG. 23B. The impulse
04-05-2019
38
response at each position on the stage 66 is measured by the measurement microphones 68a to
68x arranged in a manner to capture. In FIG. 23B, as the first closed surface 10 in the
measurement environment 1 in this case, a three-dimensional space is assumed as in the case of
FIG. 20, and microphones for measuring a to x as in the case of FIG. 68 are arranged. The threedimensional space formed by the first closed curved surface 10 is inclined to the stage 66 at an
angle equivalent to the camera angle in FIG. The impulse response of each of the measurement
microphones 68 (ax) is measured for the measurement signal TSP output for each of the
measurement speakers 67 (67-1 to 67-4) arranged for each. By this, x × 4 transfer functions H
corresponding to each of the measurement speakers 67 (1 to 4) to each of the measurement
microphones 68 (a to x) are obtained.
[0090]
Then, at the time of reproduction in the reproduction environment 11, the reproduced sound
signal is convoluted using these transfer functions H corresponding to the scene of the angle, and
the reproduction signal obtained thereby is arranged in the measurement environment 1 for
measurement The reproduction may be performed by the reproduction speakers 8 (a to x)
arranged so as to have a geometrically equivalent positional relationship with the microphones
68 (a to x). Thus, when the viewer within the first closed curved surface 10 surrounded by the
reproduction speakers 8 (a to x) in the reproduction environment 11 reproduces an image
captured on the stage 66 at the angle shown in FIG. If you look at the stage 66 at the same angle,
you will be able to feel the sound field.
[0091]
Furthermore, by performing sound field reproduction by such a method for a plurality of camera
angles assumed, it is possible to make the sound field in a case where the stage 66 is viewed at
each angle for each camera angle. it can. That is, in this case, the transfer function H is measured
for the plurality of assumed angles by the same method as that described in FIG. 23 (b), and the
correspondence information between the camera angle and the transfer function H Create At this
time, with respect to the video signal, information of the camera angle for each scene is
embedded as, for example, metadata. Then, at the time of reproduction of the recorded video and
audio, the corresponding transfer function H is selected from the correspondence information of
the angle / transfer function H based on the angle information embedded in the video signal, and
this is calculated as needed. The reproduction audio signal is set with respect to the unit, is
arithmetically processed, and is output from the reproduction speakers 8 (a to x). Thus, for each
of a plurality of camera angles in the video, it is possible to perceive a sound field when the stage
04-05-2019
39
66 is viewed at that angle. If sound field reproduction can be performed according to each
camera angle as described above, it is preferable because entertainment can be increased.
[0092]
Here, in the measurement of the transfer function H for each camera angle, a solid is assumed as
the first closed surface 10, but it may be replaced with a plane. Further, in FIG. 23B, the
measurement speaker for outputting the measurement signal TSP and the measurement
microphone disposed on the first closed curved surface 10 are respectively given the reference
numerals of the measurement speaker 67 and the measurement microphone 68. However, these
are equivalent to the measurement speaker 21 and the measurement microphone 4 respectively.
[0093]
2−7. Example of Configuration of Sound Field Reproduction System In the above, the method
and configuration for realizing the individual functions as the sound field reproduction system of
the present embodiment have been described. However, the method and the reproduction system
for realizing these functions The entire configuration is described below. Here, for convenience of
explanation, the directivity of the sound source and the sound emission characteristics for each
directivity direction as described in FIGS. 17 to 20 are not taken into consideration, and the
stereo effector described in FIGS. The structure in the case where it does not respond to is
demonstrated. The additional configuration in the case of coping with these will be described
later. Here, as a reproduction environment for actually reproducing a sound field, a reproduction
environment 20 as a room of a home or the like is assumed, and a configuration in the case of
performing sound field reproduction on the second closed curved surface 14 will be described.
Further, in this case, it is assumed that three players (Positions) to be presented as virtual sound
image positions are Player 1 to Player 3 and six directions are defined as the directivity
directions of the sound source at each position.
[0094]
First, as a premise, the sound field reproduction system according to the present embodiment
includes recording of various audio and video for creating AV content including live video and its
audio, and transmission for reproducing virtual sound image position. It can be divided into a
production side that measures functions and the like, and a user side that actually reproduces the
04-05-2019
40
sound field in the reproduction environment 11. In this case, the production side records the
recorded video and audio, transfer function and the like on a required medium, and on the user
side, a sound field is generated based on the information recorded on the medium by a
reproduction signal generation device described later. It shall be reproduced.
[0095]
FIG. 24 is a view showing the work process to be performed on the production side in this case,
and the configuration of the recording apparatus 70 for recording the information obtained by
these work processes on the medium 77. First of all, the recording apparatus 70 in this case
obtains the angle / direction / transfer function correspondence information, the reproduction
environment / transfer function correspondence information, the ambience data, and the line
recording of each player from the information obtained by the work processes S1 to S4 in the
figure. An angle / direction / transfer function correspondence information generation unit 71, a
reproduction environment / transfer function correspondence information generation unit 72, an
ambience data generation unit 73, and a line recording data generation unit 74 of each Player
are provided. Also, an angle information / Direction instruction information adding unit 75 is
provided to add angle information / Direction instruction information to the recorded video
obtained by the work process S5 in the figure. Furthermore, each data obtained by the angle /
direction / transfer function correspondence information generation unit 71, the reproduction
environment / transfer function correspondence information generation unit 72, the ambience
data generation unit 73, and the line recording data generation unit 74 of each Player, A
recording unit 76 is provided for recording the video data to which the angle information /
direction instruction information is added by the angle information / direction instruction
information adding unit 75 on a medium 77, which is, for example, an optical disk recording
medium. The recording device 70 is realized by, for example, a personal computer.
[0096]
In FIG. 24, first, in the operation process S1, measurement of the transfer function H is
performed for each position while changing the angle / Direction. This is a work necessary to
realize the control of the directivity direction of the virtual sound image described above with
reference to FIGS. 12 to 14 and the sound field reproduction according to the camera angle
described with reference to FIG. In this operation step S1, in the measurement environment 1
such as a hole, the directional measurement speakers 21 are disposed at each Position (in this
case, three positions of Position 1 to Position 3) assumed as virtual sound image positions, and A
predetermined number of measurement microphones 68 (measurement microphones 4) are
04-05-2019
41
arranged on the closed surface 10 in a predetermined arrangement relationship. At this time, the
measurement signal TSP is output from each measurement speaker 21 while changing the
direction of the measurement speaker 21 to Direction 1, Direction 2... Direction 6 for each
position. On the other hand, the measurement of the impulse response based on the detection
result of the measurement signal TSP by each of the measurement microphones 68 is as shown
in FIG. The measurement is performed while changing the angle of the first closed surface 10 on
which the measurement microphone 68 is disposed. As a result, a plurality of transfer functions
H corresponding to each of the measurement microphones 68 can be obtained for each of the
Positions in the case of using each Direction and Angle. That is, in this case, a transfer function H
corresponding to each of the measurement microphones 68 is obtained by the number of
Position number × Direction number × the assumed number of angles.
[0097]
Here, for convenience of explanation, the number of measurement microphones 68
(measurement microphones 4) disposed on the first closed curved surface 10 of the
measurement environment 1 is not a to x shown in FIG. Suppose that there is. Also in this case,
one measurement speaker 21 is disposed for each position, but one measurement speaker 21
may be sequentially disposed at each position to output the measurement signal TSP.
[0098]
In the recording device 70, the angle / direction / transfer function correspondence information
generation unit 71 generates angles / directions / transmission as shown in the following FIG. 26
based on the information of each transfer function H obtained by the operation process S1.
Generate function correspondence information. That is, as shown in FIG. 26, the information of
the transfer function H obtained corresponding to each of the measurement microphones 68
when each angle and each Direction are stored for each Position assumed as the virtual sound
image position is stored. It is a thing. Here too, the suffixes (a to p) of the transfer function H
indicate which of the measurement microphones 68 (a to p) corresponds to. Also, the numbers
following this subscript indicate the position of Position. Furthermore, the following "ang"
numbers indicate the different angles, and the last "dir" numbers indicate the different directions.
[0099]
04-05-2019
42
Further, in FIG. 24, in the operation process S2, the measurement of the transfer function E is
performed while changing the number / arrangement of the measurement microphones 13 of
the second closed surface. In this operation step S2, as shown in FIG. 7 above, on the first closed
curved surface 10 in the reproduction environment 11, each of the measurement microphones
68 (four) arranged on the first closed curved surface 10 in the measurement environment 1 The
reproduction speaker 8 is arranged in such a way that the same positional relationship as that in
(1) can be obtained. Then, in the first closed surface 10 in the reproduction environment 11, the
arrangement number and arrangement relation of the reproduction speakers 18 in the actual
reproduction environment (reproduction environment 20) are assumed to be the arrangement
number and the arrangement relation of the reproduction speakers 18. The impulse response of
the measurement signal TSP output for each of the reproduction speakers 8 is measured while
changing the arrangement number and arrangement relationship of the measurement
microphones 13 arranged on the second closed curved surface 14. Thus, the transfer function E
corresponding to each of the measurement microphones 13 is determined for each arrangement
number and arrangement pattern. Also in this operation step S2, it is possible to measure
impulse responses by using only one measurement microphone 13 and sequentially arranging it
at the assumed arrangement position on the second closed curved surface 14.
[0100]
The reproduction environment / transfer function correspondence information generation unit
72 generates transfer function E information for each arrangement number and arrangement
relationship of the measurement microphone 13 obtained in this operation step S2 with
information on each arrangement number and arrangement relationship. Generates
corresponding reproduction environment and transfer function correspondence information.
[0101]
Subsequently, in operation process S3, ambience recording is performed.
That is, as shown in FIG. 21 above, the person as the extra is arranged outside the first closed
curved surface 10 in the measurement environment 1 to emit a predetermined voice as an
ambience such as cheers and applause. This voice is recorded by the recording microphones 64
disposed at the same positions as the measurement speakers 68 disposed on the first closed
surface 10 in the previous operation process S1. That is, as described above, each ambience
needs to be recorded at the position of each measurement microphone 68 arranged at the time
of measurement of the impulse response, and therefore, the same number of measurement
04-05-2019
43
microphones 68 as the recording microphone 64 is required. It is necessary to use and arrange
each of the recording microphones 64 at the same position as the respective measurement
microphones 68 arranged at the time of measurement. In this case, since the measurement
microphones 68a to 68p are used as the measurement microphone 68 as described above, the
recording microphones 64a to 64p are also used as the recording microphone 64. Although the
measurement microphone 68 and the recording microphone 64 have different reference
numerals, the same microphone can be used.
[0102]
The ambience data generation unit 73 generates ambience data based on the recorded audio
signal of each ambience recorded in the operation process S3. That is, in this case, ambience data
in which the ambience-a to the ambience-p respectively recorded by the recording microphones
64a to 64p are managed as individual data is generated.
[0103]
In the work process S4, line recording of each player is performed. That is, for example, if the
musical instrument played by the player is an electric musical instrument, an audio signal output
electrically is recorded. Alternatively, in the case other than electric musical instruments such as
vocals and drums, voice recording may be performed by a microphone placed close to the sound
source.
[0104]
The line recording data generation unit 74 of each player generates line recording data for each
player based on each recording voice in the work process S4. That is, in this case, the line
recording audio signals of Player 1 to Player 3 generate line recording data for each Player
managed as individual data.
[0105]
In the work process S5, video recording is performed. That is, an event performed in the
04-05-2019
44
measurement environment 1 such as a hole actually measured is video-recorded by the video
camera. The angle information / direction instruction information adding unit 75 also uses angle
information to indicate which angle is to be selected as the transfer function H for the recorded
video data obtained in the operation process S5, and also the transfer function H. As metadata,
add Direction indication information to indicate which Direction should be selected for each
Player. In this case, the angle information is determined by a person on the production side
judging which camera angle each scene corresponds to by actually playing back the recorded
video. The angle information / direction instruction information adding unit 75 adds angle
information to the recorded video data, based on each scene determined in this way and
information on the corresponding angle. Similarly, as the Direction indication information, when
there is a scene where the player looks back after actually playing back the recorded video,
Direction such that the person on the production side expresses the direction of orientation
according to the movement of the player. Judge and decide. Then, the angle information /
direction instruction information adding unit 75 adds the direction instruction information to the
recorded video data such that the direction instruction information determined in this manner is
added to the specified scene.
[0106]
The recording unit 76 includes each data obtained by the angle / direction / transfer function
correspondence information generation unit 71, the reproduction environment / transfer
function correspondence information generation unit 72, the ambience data generation unit 73,
and the line recording data generation unit 74 of each player. And the video data to which the
angle information / direction instruction information is added by the angle information /
direction instruction information adding unit 75 is recorded on the medium 77. At this time, as
the ambience data, since there are a plurality of audio signals from ambience-a to ambience-p,
they are recorded on the medium 77 so that they are separately recorded on separate tracks.
Similarly, with regard to the line recording data of each player, the line recording audio signal for
each player is recorded on a separate track.
[0107]
In addition, if it states for confirmation here, the process number attached | subjected to each
operation process in this FIG. 24 does not necessarily show the order which should perform each
process.
[0108]
04-05-2019
45
FIG. 25 shows the configuration of the reproduction signal generation device 80 used for sound
field reproduction in the reproduction environment 20 on the user side.
Although not shown, as the reproduction environment 20 in this case, five reproduction speakers
18 arranged on the second closed curved surface 14 in the reproduction environment 20 shown
in FIG. It can be considered as 18A, 18B and 18C. Further, in this case, since three virtual sound
image positions are assumed to be Position 1 to Position 3, one virtual sound image position
shown as a measurement speaker 3 by a broken line in FIG. 9 is three. Further, in this case, since
the AV content recorded on the medium 77 is reproduced to perform video output, a display
device for that purpose is arranged in the reproduction environment 20, but this display device is
located inside the second closed curved surface 14. Alternatively, it may be disposed at a position
on the second closed curved surface 14 on the virtual sound image position side as viewed from
the viewer (listener). By arranging the virtual sound image side in this way, the positions at which
each player is displayed on the screen can be made to coincide with the direction of the virtual
sound image position, and the display position of each player and the virtual sound image
position reproduced You can increase your sense of unity. In FIG. 25, the illustration of the
display device is omitted.
[0109]
In FIG. 25, the reproduced signal generation device 80 in this case includes arithmetic units 26 a1 to 26 p-1, arithmetic units 26 a-2 to 26 p-2 and an arithmetic unit 26 a similar to those
described in FIG. -3 to 26p-3 are provided. That is, it is an operation unit that can change and set
the transfer function H. Here, Player 1 to Player 3 are assumed, so among FIG. 13, out of the four
sets up to Player 4, three sets up to Player 3 are provided. Then, the output from the
corresponding suffixed calculation unit 26 among the calculation units 26 is added, and
reproduction corresponding to each reproduction speaker 8 (a to p) on the first closed curved
surface 10 is performed. Adders 27a-27p are provided for obtaining signals. Further, adders 62a
to 62p provided so as to have a one-to-one relationship with the adders 27a to 27p are provided.
These adders 62a to 62p are similar to those shown in FIG. 22 described above, and are provided
to add audio signals as corresponding ambiences.
[0110]
Then, at the subsequent stage, operation units 86A-a to 86A-p, operation units 86B-a to 86B-p,
04-05-2019
46
and operation units 86C-a to 86C-p are provided. These operation units 86 basically operate on
the second closed surface 14 from each of the reproduction speakers 8 (a to p) disposed on the
first closed surface 10 in the same manner as shown in FIG. The transfer function E obtained
corresponding to each of the measurement microphones 13 arranged in the above is set. Here,
the reproduction speaker 18 on the actual second closed surface 14 is processed as the
reproduction environment matching processing. In order to make the arrangement number
correspond to the arrangement relationship, the transfer function E corresponding to each of the
operation units 86 is set from the controller 83 described later.
[0111]
The arithmetic units 86A-a to 86A-p, the arithmetic units 86B-a to 86B-p, and the arithmetic
units 86C-a to 86C-p respectively have the same suffixes (a to p) among the adders 62a to 62p.
The output from the adder 62 is input and processed based on the set transfer function E. As a
result, in the operation units 86A-a to 86A-p, the measurement microphones 13A (for
reproduction) on the second closed curved surface 14 from the respective reproduction speakers
8 (a to p) on the first closed curved surface 10 in the reproduction environment 11 Reproduction
signals (SHEA-a to SHEA-p) corresponding to the speakers 18A) are obtained, and in the
operation units 86B-a to 86B-p, the reproduction speakers 8 (a to p) are used to reproduce the
reproduction speakers 18B. Corresponding reproduced signals (SHEB-a to SHEB-p) are obtained.
In addition, in the operation units 86C-a to 86C-p, reproduced signals (SHEC-a to SHEC-p)
corresponding to each of the reproduction speakers 8 (a to p) to the reproduction speaker 18C
are obtained.
[0112]
The adders 17A, 17B, 17C have a one-to-one relationship with the reproduction speakers 18 (in
this case, 18A, 18B, 18C) disposed on the second closed surface 14 in the same manner as
shown in FIG. It will be provided as The adder 17A inputs and adds the outputs from the
arithmetic units 86A-a to 86A-p, and supplies the result to the reproduction speaker 18A.
Further, the adder 17B inputs and adds the output from each of the arithmetic units 86B-a to
86B-p, supplies the result to the reproduction speaker 18B, and the adder 17C further calculates
the arithmetic units 86C-a to 86C-. The output from each of p is input and added, and the result
is supplied to the reproduction speaker 18C.
[0113]
04-05-2019
47
Then, the reproduction signal generation device 80 in this case reproduces various information
recorded in the medium 77, and performs a control based on this, the media reading unit 81, the
buffer memory 82, the controller 83, A memory unit 84 and a video reproduction system 85 are
provided. The media reading unit 81 reads various information recorded on the medium 77
loaded in the reproduction signal generation device 80 and supplies the read information to the
buffer memory 82. The buffer memory 82 buffers read data and reads buffered data under the
control of the controller 83.
[0114]
The controller 83 is configured by a microcomputer and performs overall control of the
reproduced signal generation device 80. A memory unit 84 comprehensively shows a storage
device such as a ROM, a RAM, and the like included in the controller 83. Although not shown,
various control programs are stored in the memory unit 84. The controller 83 stores various
control programs based on the control programs. It is supposed to carry out control. Here, as
described above with reference to FIG. 24, for the medium 77, angle / direction / transfer
function correspondence information, reproduction environment / transfer function
correspondence information, ambience recording data, line recording data of each player, and
Video data in which angle information and direction instruction information are embedded is
recorded. The controller 83 causes the media reading unit 81 to read angle / direction / transfer
function correspondence information and reproduction environment / transfer function
correspondence information from among these pieces of information, and the angle / direction in
the memory 84 so as to illustrate these. The transfer function correspondence information 84a
and the reproduction environment and transfer function correspondence information 84b are
stored.
[0115]
Furthermore, the controller 83 also causes the media reading unit 81 to read the video data in
which the ambience recording data, the line recording data of each Player, the angle information
and the Direction indication information are embedded, and buffering this in the buffer memory
82. Let As shown in the figure, from this buffer memory 82, ambience-a, ambience-b, ...
ambience-p as ambience recording data are supplied to the adders 62a, 62b, ... 62p. There is.
Similarly, with regard to the line recording data of each Player, the recording audio signal of
Player 1, the recording audio signal of Player 2, and the recording audio signal of Player 3 are
04-05-2019
48
calculated by arithmetic units 26a-1 to 26p-1, and arithmetic units 26a-2 to 26p-2. , And is
supplied to the arithmetic units 26a-3 to 26p-3. Furthermore, the video data in which the angle
information and the Direction instruction information are embedded is supplied to the video
reproduction system 85.
[0116]
Here, the buffer memory 82 reads out and buffers video data in which all ambience recording
data recorded on the medium 77, line recording data of each player, and angle information and
direction indication information are embedded. It is also conceivable that the controller 83
controls the read operation of the buffer memory 82 so that the buffered data is continuously
supplied to the corresponding units. However, in practice, it takes a very long time to read and
buffer all the data from the medium 77 in this manner, so that each data is read from the
medium 77 sequentially only the amount of data necessary for time division. Alternatively, the
buffer memory 82 may be configured to control the read operation of the buffer memory 82 so
as to sequentially supply the same to each part.
[0117]
A video reproduction system 85 comprehensively shows the configuration of a reproduction
system such as a compression / decompression decoder for video data and an error correction
processing unit. The video reproduction system 85 performs reproduction processing by the
compression / decompression decoder, the error correction processing unit, and the like on the
video data supplied from the buffer memory 82 to display a video on a display device (not
shown) arranged in the reproduction environment 20. To generate a video signal for performing,
and supplying it to a display device as a video output shown in the drawing. Also, the video
reproduction system 85 in this case is configured to extract angle information and Direction
indication information added as metadata to the video data, and supply these to the controller
83.
[0118]
The controller 83 is thus based on the angle information and the Direction instruction
information supplied from the video reproduction system 85, and the angle / Direction / transfer
function correspondence information 84a stored in the memory unit 84 as described above. An
04-05-2019
49
angle / direction changing unit 83a is provided to change and set the transfer function H to be
set for each calculation unit 26. As the angle / direction changing unit 83a, the transfer function
H specified by the input angle information and the direction instruction information is read from
the angle / direction / transfer function correspondence information 84a in the memory unit 84,
and these are read. It sets up to operation part 26. For example, when the angle information
indicates “angle 1” and the Direction indication information indicates that Player 1 (Position 1)
indicates Direction 1, Player 2 (Position 2) indicates Direction 2, and Player 3 (Position 3)
indicates Direction 6. From Angle / Direction / Transfer Function Correspondence Information
64a as shown in FIG. 26, “Ha1-ang1-dir1 to Hp1-ang1-dir1” for Player 1 and “Ha2-ang1-dir2
to Hp2-ang1” for Player 2 For "dir2", "Ha3-ang1-dir6 to Hp3-ang1-dir6" is read for Player3.
And about said "Ha1-ang1-dir1-Hp1-ang1-dir1", calculating part 26a-1-26p-1, and about "Ha2ang1-dir2-Hp2-ang1-dir2", calculating part 26a-2-26p 2, “Ha3-ang1-dir6 to Hp3-ang1-dir6”
are set in the calculation units 26a-3 to 26p-3. By such operation of the angle / direction
changing unit 83, each time a new angle / direction is instructed as each of the angle information
and the direction instruction information to each operation unit 26, the transfer function H
according to the angle / direction is successively It is set. As a result, sound field reproduction
according to the change of the angle and control of the designated directivity direction of the
player can be performed.
[0119]
Note that, for confirmation, the angle / direction changing unit 83a is a block diagram showing
the function of the controller 83, and is actually realized by the software processing of the
controller 83. The same applies to the reproduction environment matching processing unit 83b
described below.
[0120]
Further, the controller 83 is based on the reproduction environment / transfer function
correspondence information 84b stored in the memory unit 84 and the arrangement pattern
information 84c stored in advance in the same memory unit 84, the actual number of
arrangement of the reproduction speakers 18 And the arrangement relation to the arrangement
relationship, and the reproduction environment adjustment processing unit 83b for performing
the reproduction environment adjustment processing for setting the transfer function E. Here,
the arrangement pattern information 84c is information indicating the pattern of the number of
arrangements and the arrangement relationship of the reproduction speakers 18, which is set in
advance as the reproduction signal generation device 80 corresponds. In the reproduction
04-05-2019
50
environment matching processing unit 83b, the reproduction environment / transfer function
correspondence information 84b is stored in association with the corresponding pattern based
on the pattern information of the arrangement number and the arrangement relation shown in
the arrangement pattern information 84c. Transfer functions E (Ea-A to Ep-A, Ea-B to Ep-B, Ea-C
to Ep-C) are read out, and these are set in the corresponding operation units 86, respectively. As
a result, a transfer function E according to the arrangement number and arrangement
relationship of the reproduction speakers 18 in the actual reproduction environment 20 is set in
each operation unit 86, and as a result, the arrangement number of reproduction speakers 18 in
the actual reproduction environment 20 -It is possible to perform appropriate sound field
reproduction according to the arrangement relationship.
[0121]
If the reproduced signal generation device 80 can cope with the arrangement number /
arrangement relationship of a plurality of patterns, an operation unit may be provided so that the
user can select a corresponding pattern from among those patterns. .
[0122]
Here, as described above, the configuration of the sound field reproduction system described the
configuration in the case where the directivity of the sound source and the sound emission
characteristics for each directional direction are not considered, and the stereo effector is not
compatible. In the case of the configuration corresponding to these, the recording device 70 and
the reproduction signal generation device 80 may be configured as follows.
Here, as an example, it is assumed that only the Player 1 performs sound field reproduction in
consideration of the directivity of the sound source and the sound emission characteristics for
each directivity direction, and the line recording data of the Player 2 is through the stereo
effector To illustrate. In this case, on the production side, in the work process S4, the sound is
recorded by the recording microphone 37 disposed so as to surround, for example, the six
directions of Direction 1 to Direction 6 as shown in FIG. As for Player 2, the line recording data
passed through the stereo effector is input to the recording device 70. That is, in this case, the
line recording data generation unit 74 of each player generates six recording data of Direction 1
to Direction 6 for Player 1, and generates two recording data of Lch and Rch for Player 2. Be
done. Then, the recording unit 76 is configured to record the recorded data on the medium 77.
[0123]
04-05-2019
51
In this case, in response to the presence of six recorded data of Player 1 corresponding to
Direction 1 to Direction 6 as the reproduced signal generation device 80, the arithmetic unit 26
inputs the recorded data corresponding to Direction 1 of Player 1 respectively. The units 26a-1-1
to 26p-1-1 and the operation units 26a-1-2 to 26p-1-2 which respectively input the recorded
data according to the Direction 2 are added. Similarly, with regard to the recorded data of
Direction 3, Direction 4, Direction 5 and Direction 6, calculation units 26a-1-3 to 26p-1-3,
calculation units 26a-1-4 to 26p-1-4, and calculation units 26a-1 are also included. 5 to 26p-1-5,
and operation units 26a-1 to 6 to 26p-1-6 are added. In this case, the angle / direction changing
unit 83a includes the arithmetic units 26a-1-1 to 26p-1-1, the arithmetic units 26a-1-2 to 26p-12, and the arithmetic units 26a-1-3 to 26p-. 1-3, for the operation units 26 a-1 to 4-26 p-1-4,
operation units 26 a-1-5 to 26 p- 1-5, and operation units 26 a-1-6 to 26 p- 1-6, The transfer
function H to be set is changed only in accordance with the angle information. In other words, "dir1" is given to the operation units 26a-1-1 to 26p-1-1, "-dir2" is given to the operation units
26a-1-2 to 26p-1-2, and the operation unit 26a-1- 1 3 to 26 p-1-3 for "-dir 3", arithmetic units
26a-1-4 to 26 p-1-4 for "-dir 4", arithmetic units 26 a-1 to 5 to 26 p- 1-5 The transfer function H
by "-dir6" is always set in the calculation units 26a-1 to 6-6p-1-6. These operation units 26a-1-1
to 26p-1-1, operation units 26a-1-2 to 26p-1-2, operation units 26a-1-3 to 26p-1-3, operation
units 26a-1-4 The same suffixes (a to p) are attached to the outputs of the arithmetic units 26a-1
to 26-4, the arithmetic units 26a-1 to 5-6p-1-5, and the arithmetic units 26a-1 to 6-26p-1-6,
respectively. It is configured to be supplied to the added adder 27.
[0124]
Further, two sets of operation units 26 (a to p) corresponding to Lch and Rch are provided as the
operation units 26 for inputting the recorded data of the Player 2 respectively. That is,
calculation units 26a-L to 26p-L and calculation units 26a-R to 26p-R are provided. The angle /
direction changing unit 83a changes the setting of the transfer function H according to only the
angle information for the calculation units 26a-L to 26p-L and the calculation units 26a-R to
26p-R. For example, when Direction2 is defined as Lch and Direction6 is defined as Rch as shown
in FIG. 15 above, “-dir2” is used for the operation units 26a-L to 26p-L, and “-dir2” is used
for the operation units 26a-R to 26p-R. The transfer function H by "-dir6" is always set. The
outputs from the arithmetic units 26a-L to 26p-L and the arithmetic units 26a-R to 26p-R are
also supplied to the adders 27 with the same suffix (a to p). .
[0125]
04-05-2019
52
In the description of FIG. 24 to FIG. 26 up to this point, the production side sells the media 77
recording various information necessary for sound field reproduction as a premise of the sound
field reproduction system of the present embodiment. Sound field reproduction is performed on
the basis of the medium 77 by the user. However, various types of information necessary for
reproducing the sound field can be provided not only to the user side via the media 77, but also,
for example, via a network. In this case, on the production side, it is possible to record and hold
various information necessary for reproducing the sound field on a required recording medium,
and transmit the held various information to an external device via the network. An information
processing apparatus is provided. On the other hand, the reproduction signal generation device
80 on the user side is configured to be capable of data communication via the network. Thus, by
being able to provide various information for sound field reproduction via the network, the
production side can provide the various information to the user side in real time, and according
to this, the reproduction environment 20 can be provided. It is also possible to reproduce the
sound field in the measurement environment 1 in real time.
[0126]
In the above description, the reproduction signal to be output from each reproduction speaker
18 is generated on the user side (reproduction signal generation device 80 side), but instead, on
the production side (recording device 70 side) By providing the configuration for generating the
reproduction signal shown in FIG. 25, the reproduction signal to be output from each
reproduction speaker 18 is recorded on the medium 77, and the reproduction on the medium 77
is performed on the user side. It is also possible to configure so that sound field reproduction can
be performed only by reproducing the signal. According to this, the configuration of the device
provided on the user side can be simplified. However, on the other hand, on the production side,
it is necessary to create and sell a plurality of types of media 77 corresponding to the pattern of
the number and layout relationship of the reproduction speakers 18 assumed in the actual
reproduction environment 20. It will be. On the other hand, according to the sound field
reproduction system of this example described above, only one type of media 77 can be created
on the production side, and efficiency can be improved in this respect.
[0127]
In the description of FIGS. 24 and 25, it is assumed that the angle / direction / transfer function
correspondence information and the reproduction environment / transfer function
correspondence information are recorded on the medium 77 together with the recorded data and
04-05-2019
53
video data for each player. Information necessary for sound field reproduction, such as recording
of recorded data and video data for each player on media 77 and providing information on angle
/ direction / transfer function correspondence information and playback environment / transfer
function correspondence via a network It can also be configured to provide some of the services
via a network. In particular, with regard to reproduction environment / transfer function
correspondence information, all information other than the information set in the calculation unit
86 is unnecessary information. Therefore, for example, the required server device on the network
holds the reproduction environment / transfer function correspondence information, and the
user side first accesses this server device in sound field reproduction, and the corresponding
reproduction speaker It is configured to download the transfer function E according to the
pattern of the arrangement number and arrangement relationship of eighteen. As a result, the
amount of information recorded on the medium 77 can be reduced, and unnecessary
reproduction of information in the reproduced signal generation device 80 is not required,
thereby eliminating unnecessary read operations and reducing the processing load on the
controller 83. .
[0128]
Although FIG. 25 shows the arithmetic unit 26, the adder 27, the adder 62, the arithmetic unit
86, and the adder 17 as hardware components, the functions of these units are realized by the
software processing of the controller 83. Can also be configured to
[0129]
Although FIG. 25 exemplifies a case where the reproduction signal generation device 80 includes
the reading unit of the medium 77, the reproduction signal generation device 80 inputs each
information read from the medium 77 outside. After that, it can be configured as an AV amplifier
that performs the same operation based on the respective information.
[0130]
In the above description, the medium 77 is an optical disk recording medium, but it may be
another disk medium (a magnetic disk such as a hard disk or a magneto-optical disk).
Alternatively, other than disk media, such as a recording medium using a semiconductor
memory, can be used.
04-05-2019
54
[0131]
Further, in the above description, in reproducing the sound field on the second closed surface 14,
after the reproduced audio signal is subjected to arithmetic processing based on the transfer
function H to generate reproduced signals, these reproduced signals are further converted to the
transfer function E By performing arithmetic processing based on the above, the reproduction
signal corresponding to each arrangement position of the reproduction speaker 18 disposed on
the second closed surface 14 is obtained, but instead, the transfer function H and the transfer
function E The same result can be obtained by generating a transfer function by adding together
and processing the reproduced speech on the basis of the synthesized transfer function.
Specifically, for example, a reproduction signal generation system in this case for Player 1 shown
in FIG. 25 will be described. Transfer function H-1 (a to p) + transfer function E-A (a to p),
transfer function H- 1 set (a to p) + transfer function E-B (a to p), transfer function H-1 (a to p) +
transfer function E-C (a to p) And provide recorded audio signals of Player 1 to each of them. As
a result, reproduction signals (a to p) to be output from the reproduction speaker 18A can be
obtained from the operation unit in which the transfer function H-1 (a to p) + the transfer
function E-A (a to p) are set. These are added by the adder 17A and supplied to the reproduction
speaker 18A. Further, from the operation part in which the transfer function H-1 (a to p) + the
transfer function E-B (a to p) is set, reproduced signals (a to p) to be output from the
reproduction speaker 18B can be obtained. These are added by the adder 17B and supplied to
the reproduction speaker 18B. Furthermore, from the operation part in which the transfer
function H-1 (a to p) + the transfer function E-C (a to p) is set, reproduced signals (a to p) to be
output from the reproduction speaker 18C are obtained. Are added by the adder 17C and
supplied to the reproduction speaker 18C. The same configuration is adopted for the other
players, and as a result, the same sound field reproduction as the configuration shown in FIG. 25
can be performed. In this case, the variation of the transfer function H for each angle and
direction may be configured to variably set the transfer function H to be added to the transfer
function E in each of the above-described operation units. According to the above configuration,
the ambience can not be added after the reproduction signal is convoluted with the transfer
function H (a to p) as shown in FIG. When adding the ambience corresponding to the
configuration in this case, computing units 86A-a to 86A-p, which respectively input the
ambiences a to p separately from the configuration of the reproduction signal generation system
described above, Sections 86B-a to 86B-p and operation sections 86C-a to 86C-p, and the outputs
of these sections are similarly added to the adders 17A, 17B and 17C to which the same suffix (A,
B, C) is added, respectively. It may be configured to input and add. Thus, the transfer function E
from the first closed curved surface 10 to the second closed curved surface 14 is generated for
each reproduced signal to be output from each of the reproduction speakers 18A, B and C
generated by the reproduced signal generation system described above. The folded ambience can
04-05-2019
55
be added, and the ambience can be reproduced as in the configuration shown in FIG.
Even when the reproduced speech signal is convoluted with the synthesized transfer function in
which the transfer function H and the transfer function E are added in this way, the reproduced
speech signal is reproduced based on the transfer function H as a result. Since the same effect as
when the signal is arithmetically processed by the transfer function E is obtained, also when
arithmetically processing the reproduced signal by such a synthetic transfer function, the
reproduced signal obtained by arithmetically processing the reproduced speech signal based on
the transfer function H It is regarded as having been processed by the transfer function E.
[0132]
As mentioned above, although embodiment of this invention was described, as this invention, it
should not be limited to this. For example, in the embodiment, although the present invention is
applied to sound field reproduction in the case of reproducing sound in a film live hall or a room
of a home, the case of reproducing the sound in a car audio system is exemplified. It can apply.
Alternatively, the present invention can be suitably applied to virtual reality industrial devices
such as, for example, a sense of presence, an immersive amusement, and a game.
[0133]
DESCRIPTION OF SYMBOLS 1 Measurement environment, 2 Signal reproduction part for
measurement, 3, 21, 52, 67 Speaker for measurement, 4, 13, 53, 68 Microphone for
measurement, 5, 15, 19, 25, 30, 40, 60, 80 Reproduction signal Generation device, 6 sound
reproduction unit, 7, 16, 26, 31, 41, 86 operation unit, 8, 18 speaker for reproduction, 9, 17, 27,
32, 42, 62 adder, 10 first closed surface, 11 20 reproduction environment 14 second closed
curved surface 28 controller 29 ROM 29a Direction correspondence information 31 stereo effect
processing unit 35 sound source recording surface 36 sound source 37 51 51 microphone for
recording 50 circular plane 61 a 61 61p Reproduction unit, 65 cameras, 66 stages, 70 recording
devices, 71 angles / Direction / transfer function correspondence information generation unit, 72
reproduction environment / transfer function correspondence information generation unit, 73
ambience Data generation unit 74 Line recording data generation unit of each player 75 Angle
information / direction instruction information addition unit 76 recording unit 77 media 81
media reading unit 82 buffer memory 83 controller 83a angle / direction change unit , 83b
reproduction environment matching processing unit, 84 memory unit, 84a angle / direction /
transfer function correspondence information, 84b reproduction environment / transfer function
correspondence information, 84c arrangement pattern information, 85 video reproduction
system
04-05-2019
56
04-05-2019
57
Документ
Категория
Без категории
Просмотров
0
Размер файла
95 Кб
Теги
jp2011138151
1/--страниц
Пожаловаться на содержимое документа