close

Вход

Забыли?

вход по аккаунту

?

JPH05244683

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JPH05244683
[0001]
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a
recording method for simultaneously recording sound and video, and a reproduction method for
reproducing recorded sound and video, and in particular, to position information of a sound
source or a sound detecting device The present invention relates to a recording method and a
reproduction method capable of recording a scene including the sound source and
photographing the scene including the sound source and reproducing it as a real sound image
from the sound source of the reproduction video. More specifically, the recording method of the
present invention relates to a method of multiplexing and storing a video signal and a sound
source position signal in a video channel.
[0002]
2. Description of the Related Art Research on stereoscopic television is in progress. In this threedimensional television, from the viewpoint of how to faithfully reproduce the three-dimensional
reproduction (reproduction) of the video, how to record the video and record the sound, how to
faithfully reproduce the video from these recorded sound and video The question is whether to
play the sound. Also, there is a demand for reproducing sound as a real sound image, and various
recording methods and reproduction methods as to how to faithfully reproduce (reproduce)
sounds such as sounds and sounds having spatial spread as a real sound image Has been
proposed and tried.
10-05-2019
1
[0003]
For example, with regard to sound, “Intensity stereo method, which is a general sound collecting
and reproducing method, collects sound using a large number of microphones, and sets a
plurality of channels, for example, a level difference and a time difference to N channels.
Information is added, distributed, and recorded, and at the time of reproduction, a sound image is
generated by N speakers disposed at a predetermined position. In addition, a binaural sound
pickup reproduction method and a one-point sound pickup reproduction method are also known
for sound pickup and reproduction. Further, there is known an attempt to arrange a large
number of speakers to form a real sound image (for example, JP-A-2-224495).
[0004]
Also, as for video recording, a method is known in which information on the sound source
position and size on the video is simultaneously multiplexed and recorded on an audio channel or
a video signal.
[0005]
SUMMARY OF THE INVENTION The conventional audio and video recording / reproduction
methods represented by the above-mentioned examples reproduce virtual sound images, and
therefore the original purpose of generating real sound images It can not be achieved.
In particular, the video and sound can not be reproduced as the sound is emitted from the sound
source of the reproduced video. As a result, there is still a problem caused by the virtual sound
image, for example, the reproduction position of the sound is limited, the image of the sound is
not formed when the position is shifted, and the real feeling is not obtained when approaching
the position of the virtual sound image. In addition, an attempt to form a real sound image by
arranging a large number of speakers is also a control to the speakers arranged in a matrix, and
control corresponding to the sound source is not performed, and a real sound image is formed. It
is not possible.
[0006]
Further, in the method of simultaneously multiplexing and recording information on the sound
10-05-2019
2
source position and the size on the video described above, the video and the audio are stored in
the same channel, and the reproduction signal processing is complicated. Furthermore, the real
sound image can not be reproduced from the sound source of the reproduced image.
[0007]
In general, the generation of a real sound image in the context of video is not only the collection
and imaging, and the reproduction of these, but of course the overall conditions from the
collection and imaging process to the reproduction process of sound and video It needs to be
considered. For this purpose, it is necessary to consider the recording method and editing
method. An object of the present invention is to solve the problems in the above-described
conventional recording / reproducing system, and to provide a video and sound recording system
capable of generating a real sound image from a sound source in reproduced video and a
reproduction system thereof.
[0008]
In order to solve the above-mentioned problems, the recording system of the present invention
comprises a sound detecting means for detecting a sound from a sound source, an arrangement
position of the sound detecting means and a position of the sound source or Position information
providing means for providing any one position information, imaging means for imaging a
landscape including the sound source, means for multiplexing and recording an imaging signal
from the imaging means and the position information in a video channel, And means for
recording the detected sound signal simultaneously with the recording of the imaging signal. The
recording system of the present invention further comprises sound source size providing means
for providing the size of each of the sound sources, and the signal multiplexing means further
multiplexes and stores the sound source sizes in the video channel. Furthermore, the recording
system of the present invention further comprises directivity providing means for providing the
directivity of the sound source and the sound detection means or any one of the above, and the
multiplexing means further multiplexes and stores the directivity in the video channel. Do. The
recording method of the present invention has means for multiplexing and storing the imaging
position of the imaging means in the video channel in association with the position of the sound
source.
[0009]
10-05-2019
3
The reproduction method of the present invention comprises: means for reading out a video
signal and a video channel in which the position of the sound source and / or the position of the
sound detection or one of the positions are multiplexed and stored; and sound recorded
simultaneously with the recording of the video signal. Means for reading out the signal and the
amplitude and the delay time of the read sound signal are comprehensively adjusted to generate
a real sound image based on the read position signal, and the adjusted sound signal is used as
sound. And sound reproducing means for outputting. Further, the reproduction method of the
present invention comprises: means for reading out the video signal, the position of the sound
detection means and the position of the sound source, or any one of the positions, and the video
channel in which the size of the sound source is multiplexed and stored; Means for reading out
the stored sound signal in synchronism with the storage of the video signal, and the amplitude
and delay time of the read sound signal to generate a real sound image based on the read
position signal and the dimensions of the sound source Means for comprehensively adjusting,
and sound reproducing means for outputting the adjusted sound signal as a sound. Furthermore,
in the reproduction method of the present invention, the video signal, the sound source position
of the sound signal and the arrangement position of the sound detection means or the position
signal of the sound signal, the dimensions of the sound source of the sound signal, the directivity
of the sound source A means for reading out these signals from the video channel in which the
directivity of the sound detection means is multiplexed and stored; a means for reading out the
sound signal stored simultaneously with the storage of the video signal; Means for
comprehensively adjusting the amplitudes and delay times of the plurality of read sound signals
to generate a real sound image based on the size and directivity of the sound source, and sound
for outputting the adjusted sound signal as sound And regeneration means. Preferably, in the
reproduction system of the present invention, the means for reading and reproducing the
imaging signal and the sound reproduction means are integrally configured, and the sound is
reproduced so as to emit a corresponding sound from the sound source position of the
reproduced image.
[0010]
Further, according to the present invention, there is provided a method according to the above
recording method and reproduction method. That is, according to the recording method of the
present invention, the video signal and the position signal indicating the position of the sound
source and / or the position of the sound detection means are multiplexed and recorded on the
video channel, and simultaneously with this multiplexed recording. Store the sound from the
sound source in the audio channel. Further, according to the reproducing method of the present
invention, the video signal and the sound source position signal multiplexed and stored in the
video channel are read and reproduced, and the audio signal recorded simultaneously with the
10-05-2019
4
video signal is read out. Adjust the amplitude, delay time, etc. of the sound signal based on the
position signal to reproduce a real sound image on the basis of the sound signal and output the
sound as sound so that the adjusted sound signal is emitted from the sound source position of
the reproduced video .
[0011]
[Operation] A scene including a sound source is imaged and stored in a video channel. At this
time, the position of the sound source is multiplexed and stored with the video signal in the video
channel. The sound detection signal is stored in the audio channel at the same timing as this
multiplexed storage. Since the sound signal and its positional relationship correspond at the same
storage timing, the sound to generate a real sound image in consideration of the positional
relationship of a plurality of sound sources and the arrangement position of the sound detecting
means in the editing and reproducing stages. It is possible to edit and play By storing the position
information in the low frequency band of the video channel in which the video signal is stored,
the video channel can be effectively used. The addition of the source size to the multiplexing in
the video channel makes the generation of the real sound image more accurate. If directivity is
further added, generation of a real sound image can be realized more accurately. The channel for
multiplexing the directivity may be different from the channel in which the sound signal is
multiplexed.
[0012]
Further, in addition to the formation of the actual sound image of the sound, the actual sound
image can be generated from the sound source in the reproduced image by storing the position
of the imaging means in relation to the position of the sound source.
[0013]
In the reproduction method of the present invention, the video and the sound are reproduced
based on the video signal, the sound signal and the position signal recorded by the above
recording method.
Since the positional relationship between the video and the sound source is associated in the
video channel, a real sound image can be emitted from the sound source in the reproduced
image. In addition to the position signal, a more accurate real-sound image is generated based on
10-05-2019
5
the source size and directivity.
[0014]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows a block diagram of a
recording apparatus as a first embodiment of a recording system (recording system or recording
apparatus) of the present invention. "Recording" in the present specification means recording of
video and recording of sound. Also, "reproduction" described later means reproduction of sound
and video in the present specification. The recording apparatus shown in FIG. 1 will be described
in relation to a specific example, for example, when performing live recording of a performance
at a concert venue.
[0015]
Generally speaking, the processing of sound is, for example, the position, size, sound collecting
microphone position, sensitivity characteristics of a sound source to be picked up and
reproduced, such as a performance sound of a concert, an engine sound in a car stadium, etc.
How can we generate a real-sound image, taking as a whole a series of related items such as
sound collection conditions such as directivity, editing method and its device conditions,
reproduction method, and performance of the device used for sound processing From the point
of view, the conditions in each process will be determined again. Further, in the recording
apparatus of the present invention, it is necessary to perform recording in which the sound and
the video are associated with each other. Therefore, in consideration of editing and reproducing
the sound from the sound source by associating the image of the sound source with the image of
the sound source, the recording device of the present invention is recorded so as to be able to
reproduce the real sound image in relation to the reproduced video. Do.
[0016]
In FIG. 1, in addition to a plurality of musical instruments such as a piano 1 and a violin 3 as
sound sources to be collected, sounds from the audience at the concert hall 5 exist in the concert
hall. The recording apparatus shown in FIG. 1 detects the sound from the piano 1, the first
microphone 11 for detecting the sound from the piano 1, the Mth microphone 12 for detecting
the sound from the violin 3, and the sound from the hall 5 (M + 1) The fourth microphone 14 to
the Nth microphone 15 are provided. The recording apparatus also has a first position detection
10-05-2019
6
device 21 that provides information indicating the position of the first microphone 11 and an
Mth position detection device 22 that provides information indicating the position of the Mth
microphone 12. . The recording apparatus further includes an imaging device 61 for imaging the
concert hall 5 and a plurality of imaging devices (not shown). Specifically, these imaging devices
are television cameras. Furthermore, the sound collection device has a first multiplexer 31, a
second multiplexer 32, and a recorded signal processing storage device 40.
[0017]
The first microphone 11 is disposed in the vicinity of the piano 1, detects a sound mainly using
the piano 1 as a sound source, and outputs the detected sound to the second multiplexer 32.
Similarly, the M-th microphone 12 is disposed in the vicinity of the violin 3 and detects a sound
mainly having the violin 3 as a sound source and outputs it to the second multiplexer 32.
[0018]
The first position detector 21 outputs the position of the piano 1, and the Mth position detector
22 outputs the position of the violin 3. The microphone position information detection signals
MP1 and MPM are input to the first multiplexer 31, respectively. The position information
provided from the first position detecting device 21 and the Mth position detecting device 22 is,
for example, a relative position in the orthogonal coordinate system with the position of the
conductor of the concert hall 5 as the origin of the coordinate position. Or shown as an absolute
position. In addition, these pieces of position information are not limited to orthogonal
coordinates, but may be represented by a polar coordinate system. Musical instruments such as
the piano 1 and the violin 3 in the concert hall are usually disposed at fixed positions in the
concert hall 5. Thus, in this example, the first position sensing device 21 and the Mth position
sensing device 22 provide positioning position signals of the fixed piano 1 and the violin 3. The
position information of the sound from the audience at the concert hall 5 is set in the sound
pickup signal processing storage device 40 as the position information of the whole hall.
[0019]
The first multiplexer 31 multiplexes (multiplexes) the microphone position information detection
signal MP1 from the first position detection device 21 and the microphone position information
detection signal MPM from the M-th position detection device 22. Similarly, the second
10-05-2019
7
multiplexer 32 multiplexes (multiplexes) the microphone detection sound signal S1 from the Mth
microphone 12 and the microphone detection sound signal SM from the Mth microphone 12.
Note that multiplexing of the microphone detection sound is optional and may not be
multiplexing. These multiplexed signals are input to the collected signal processing storage unit
40, respectively. Further, the video signal VD from the imaging device 61 for imaging the concert
hall 5 is also input to the recorded signal processing storage device 40. The multiplexing position
signal P from the first multiplexer 31 and the imaging device 61 may be multiplexed in the third
multiplexer 33 and input to the recorded signal processing storage device 40. Also, in place of
the multiplexers 31 to 33 described above, multiplexing processing can be performed in the
recorded signal processing storage device 40.
[0020]
As multiplexing methods in the first multiplexer 31, multiplexing of position signals and video
signals in the third multiplexer 33, or multiplexing of audio signals in the second multiplexer 32,
for example, in analog signal processing It is performed by a suitable frequency multiplexing
method or a time division multiplexing method suitable for digital signal processing.
[0021]
First, frequency multiplexing processing of the position signal P and the video signal VD will be
described with reference to FIG.
The horizontal axis of FIG. 2 and the frequency are shown. Since the frequency of the video
signal is very high, the high frequency band is used to store the video signal VD, and the low
frequency band is used to multiplex a plurality of position signals MP1 to MPM. The microphone
detection sound signal S can also be frequency-multiplexed by using different frequency bands.
The video signal and the position signal are multiplexed on the same video channel, but the
microphone detection sound signal S is multiplexed on the audio channel.
[0022]
The time division multiplexing process will be described with reference to FIG. The video signal
and the position signal are multiplexed on the same video channel according to the passage of
time. The microphone detection sound signal S is also time-division multiplexed with respect to
the plurality of microphone detection sound signals S. Also in this time division multiplexing
10-05-2019
8
processing, the video signal and the position signal are multiplexed on the same video channel,
and the microphone detection sound signal S is multiplexed on the audio channel. This
multiplexing process may be performed in the recorded signal processing storage device 40 as
described above. In any case, from the recorded signal processing storage device 40, the video
signal and the position signal are multiplexed and output to the same video channel. Further, the
microphone detection sound signal S is multiplexed from the recording signal processing storage
device 40 to the audio channel and output.
[0023]
The video signal VD1 from the imaging device 61 is input to the recorded signal processing
storage device 40, and is recorded as a video signal. The shooting position of the imaging device
61 is set in the recording signal processing storage device 40 as the absolute position or the
relative position with respect to the sound source such as the piano 1 or the like. When the
imaging device 61 moves like the first microphone 11, a position detection device may be
provided for the imaging device 61 as in the first position detection device 21 to detect their
positions. In that case, the multiplexer 31 multiplexes with the position signal from the first
position detector 21 or the like.
[0024]
The recorded signal processing and storage unit 40 receives the microphone detection sound
signals SM + 1 and SN of the (M + 1) th microphone 14 to the Nth microphone 15, and outputs
them without multiplexing. The (M + 1) th microphones 14 to the Nth microphones 15 are
disposed at various places in the concert hall 5 to detect the sound of the entire audience in the
concert hall 5 in this embodiment. These sounds are usually used to give a sense of reality, but
are not particularly associated with position information, and are used as background sounds.
[0025]
Recording to the video channel and the N channel audio channel in the recorded signal
processing storage device 40 is, for example, recording for each audio channel independent on
various recording media such as recording on a magnetic tape, recording on an optical disk,
recording on a semiconductor memory Remember to remember. The video signal stored in the
video channel stored in the storage medium in the recorded signal processing storage device 40
10-05-2019
9
and the storage signal to the audio channel are edited in the editing device 50 as needed and
reproduced in the sound and video reproduction device 100 Ru. In the editing process in the
editing apparatus 50, the video signal and the position signal are multiplexed and stored in the
video channel different from the audio channel, so that the audio editing work in relation to the
image reproduction becomes possible. Further, without passing through the editing operation,
sound information including the position information stored in the sound collection device can
be directly reproduced in the sound and video reproduction apparatus 100. Alternatively, a
signal obtained by multiplexing sound information and position information for each audio
channel and a signal not to be multiplexed are output to the direct sound and video reproduction
apparatus 100 without being stored in the storage medium in the recorded signal processing
storage device 40, The sound and video reproduction apparatus 100 can also directly reproduce.
The reproduction processing in the sound and video reproduction apparatus 100 will be
described later.
[0026]
In the embodiment described above, the dimensions (sizes) of the sound sources such as the
piano 1, the violin 3 and the concert hall 5 are added to the microphone detection sound signal S
and the microphone position information detection signal MP to multiplex them. It is suitable for
information editing processing and reproduction to form a real sound image. The dimensions of
the sound source are also multiplexed in the same manner as the position information.
[0027]
Furthermore, the directivity of the piano 1, the violin 3 or the like, or the directivity of the first
microphone 11 and the M-th microphone 12, etc. is added to the microphone detection sound
signal S, the microphone position information detection signal MP, the size of the sound source.
Multiplexing is suitable for editing and playback as well as adding source dimensions. This
directivity multiplexing is also performed on the same channel as the above-described source size
multiplexing.
[0028]
As provision of position information in the first position detection device 21 and the M-th
position detection device 22, in addition to providing the sound source position as position
10-05-2019
10
information, the arrangement positions of the first microphone 11 and the M-th microphone 12
Also provide. Alternatively, as the position information, the arrangement positions of the first
position detection device 21 and the M-th position detection device 22 are provided as position
information. By storing accurate position information together with sound information in this
manner, it is possible to form a more accurate real sound image through editing processing and
reproduction processing.
[0029]
In this embodiment, the sound is collected at the concert hall 5, the piano 1, the violin 3 and the
like are at fixed positions, and the arrangement positions of the first microphone 11 and the Mth
microphone 12 are also fixed. Therefore, in this embodiment, position information indicating the
above-mentioned arrangement relationship is set in advance in the recording signal processing
storage device 40 without using the first position detection device 21 and the M-th position
detection device 22; The first position detection device 21 and the M-th position detection device
22 may be omitted. However, the position information thus set is superimposed on the
microphone detection sound signal S from the first microphone 11 and the M-th microphone 12
in the recording signal processing storage device 40. Since the position information is fixed, the
method of superposing the position information may not be always multiplexed, but may be
stored in each voice channel in the head part or the like.
[0030]
FIG. 4 shows a recording apparatus as a second embodiment of the recording system of the
present invention. The recording device is particularly adapted for recording when the sound
source is moving. As an example of moving a sound source, there is a case where a singer having
a microphone sings while moving on the stage in a performance hall. As described above, in
sound collection when the singer having the first microphone 11 is moving, it is preferable to
detect the position of the singer using the first position detection device 21 of the wireless
system. .
[0031]
In FIG. 4, the first microphone 11 is not fixed near the piano 1 as shown in FIG. Also, the Mth
microphone 12 is owned by another moving singer. The sound from the piano 1 (not shown) is
10-05-2019
11
detected by the (M + 1) th microphone 14, and the sound from the violin 3 is detected by the Nth
microphone 15.
[0032]
The ultrasonic waves are emitted from the first position detection device 21 integrated with the
first microphone 11 held by the moving singer, and the ultrasonic wave reception devices
disposed at various places in the concert hall 5 The sound wave is received and notified to the
microphone position detection device 35 by radio waves or the like. The microphone position
detection device 35 detects the radio wave to detect the position of the first microphone 11.
Similarly, ultrasonic waves are emitted from the Mth position detection device 22 integrated with
the Mth microphone 12, and the position of the Mth microphone 12 is detected through the
microphone position detection device 35. it can. As the position detection in the microphone
position detection device 35, other methods such as a method of emitting radio waves from the
first position detection device 21 and positioning the position from the strength of the received
radio waves at two or more distant positions are taken. be able to.
[0033]
In this example, the positions of musical instruments such as piano 1 and violin 3 not shown in
FIG. 4 are fixed. Therefore, the positions of these musical instruments are stored in advance as
fixed position information in the recording signal processing storage device 40, and the
microphone position from the microphone position detection device 35 indicating the position of
the first microphone 11 held by the moving singer The information detection signal MP1 and the
microphone position information detection signal MPM are multiplexed on the same video
channel in the recorded signal processing storage device 40. In this case, as described with
reference to FIG. 1, the microphone detection sound signals SM + 1 to SN from the (M + 1) th
microphone 14 to the Nth microphone 15 are not multiplexed.
[0034]
Multiplexing in the multiplexers 31, 32, 33 or the recorded signal processing storage unit 40 is
the same as that in the first embodiment. Also in the sound pickup apparatus of the second
embodiment, similarly to the first embodiment, the information of the sizes of the sound sources
such as the singer, the piano 1 and the violin 3, the microphone or the directivity of these sound
10-05-2019
12
sources is added The signal S can be multiplexed. Furthermore, also in this embodiment, the
multiplexers 31, 32, and 33 may be deleted and the above-described multiplexing processing
may be performed in the recording signal processing storage device 40.
[0035]
Although the recording signal processing and storage device 40 shown in FIGS. 1 and 4 has
shown an example in which processing of video is simultaneously performed in addition to
position information processing such as sound signal processing and sound source position,
video signal processing and sound signal processing It is also possible to process with different
devices. As described above, the signal processing in the recording signal processing storage
device 40 may be performed in synchronization with the sound and the video if there is temporal
synchrony, and the processing can be separated.
[0036]
FIG. 5 shows the configuration of a sound reproduction apparatus 100A as an embodiment of the
reproduction system of the present invention. That is, how to reproduce (form) a real sound
image will be described first. Therefore, in this example, the display of the first image pickup
device 61 and the second image pickup device 62 or the image pickup signal selectively used is
assumed to be displayed on a TV monitor or the like, and the TV monitor or the like An example
of reproducing a real sound image centering on the image of FIG.
[0037]
The sound reproducing apparatus 100A shown in FIG. 5 includes a first sound reproducing
system 110, a second sound reproducing system 120, a third sound reproducing system 130,
and a speaker system 140. Although the case where there are N voice channels is described in
the above-described recording method, FIG. 5 will be described only for four independent
channels for the sake of illustration.
[0038]
10-05-2019
13
The first sound reproduction system 110 includes a decoder 111, a signal delay circuit 112 and
an amplitude adjustment circuit 113, a signal delay circuit 114 and an amplitude adjustment
circuit 115, a signal delay circuit 116 and an amplitude adjustment circuit 117, a signal delay
circuit 118 and It consists of four parallel sound adjustment circuits consisting of an amplitude
adjustment circuit 119. The circuit configurations of the second sound reproduction system 120
and the third sound reproduction system 130 are also similar to those of the first sound
reproduction system 110. The speaker system 140 includes the signal addition circuit 141, the
power amplification circuit 142 and the speaker 151, the signal addition circuit 143, the power
amplification circuit 144 and the speaker 152, the signal addition circuit 145, the power
amplification circuit 146 and the speaker 153, and the signal addition. It comprises a circuit 147,
a power amplification circuit 148 and a speaker 154.
[0039]
At the previous stage of the first sound reproduction system 110, the second sound reproduction
system 120, and the third sound reproduction system 130, the recording signal processing and
storage device 40 illustrated in FIG. There is provided a circuit for reading out and separating the
separated sound signal and position signal into separate position information detection signals
P1, P2 and P3 and microphone detection sound signals S1, S2 and S3, respectively; doing.
Alternatively, when the multiplexed signal is directly applied to the sound reproducing apparatus
100A from the recorded signal processing storage device 40 shown in FIG. 1, a circuit for
separating the multiplexed signal may be provided.
[0040]
Furthermore, the sound collecting method and the reproducing method of the present invention
can be integrally configured, in which case the signals of the microphones 11 and 12 and the
position detectors 21 and 22 are not multiplexed by the multiplexers 31 and 32, respectively. ,
Can also be used directly. In the following description, it will be described how the read out
separated position information and the microphone detection sound signal are used for
reproduction.
[0041]
FIG. 6 shows the arrangement of the speakers of the speaker system 140 shown in FIG. 6 (A)
10-05-2019
14
shows a front view of the speaker system 140, and FIG. 6 (B) shows a cross-sectional view
thereof. In this example, M speakers are arranged in a concave shape. The speaker arrangement
itself is proposed by Olson (e.g., Olson, translated by Nishimaki, "Sound Engineering", 1959). In
this speaker system, if a large number of speakers are arranged in an array and the amount of
delay of the signal to be added is adjusted to create a sound wave focus at one point in space, a
very high sound pressure is synthesized at one point near the listener In this point, a situation
occurs as if an actual sound source exists, and the auditory psychology is also based on the
ground that the position is perceived as a sound image (for example, Komiyama et al., “The
perspective of the sound image for stereoscopic television "Development of control technology",
NHK Giken R & D, February 1991, No. 2, pages 10-14). Although only four speakers 151 to 154
are shown in FIG. 5, generally speaking, M speakers are disposed as shown in FIG.
[0042]
The decoder 111 changes the delay amount of the signal delay circuits 112, 114, 116 and 118
to which the microphone detection sound signal S1 is applied from the actual position
information detection signal P1 multiplexed and inputted. Further, the decoder 111 adjusts the
amplitudes of the microphone detection sound signals delayed in the signal delay circuits 112,
114, 116 and 118 in the amplitude adjustment circuits 113, 115, 117 and 119. The amount of
delay according to the position information in the signal delay circuit 112 is determined based
on the position of the sound source and the position of the microphone or the position of one of
the microphones. The position of the sound source and how to use the position of the
microphone are defined in accordance with the object, conditions, purpose and the like of sound
collection and reproduction. When sound reproduction processing is performed using actual
position information as described above, reproduction sound areas 161, 162, and 163 are
generated at positions corresponding to the existence positions of the real sound image.
[0043]
In the above-described recording apparatus, when the sizes of the sound sources are also
multiplexed, the decoder 111 changes the amplitude adjustment circuits 113, 115, 117, 119
according to the size of the sound sources and also considering positional information as
necessary. The amplitude adjustment amount of each is changed. This makes it possible to
generate a more accurate real-sound image.
[0044]
10-05-2019
15
Similarly, in the recording apparatus, when the directivity is multiplexed, the decoder 111
calculates the delay amount and the amplitude adjustment amount based on the directivity, and
the signal delay circuits 112, 114, 116 and 118, and the amplitude adjustment circuit 113. , 115,
117, 119 are adjusted.
[0045]
In the above-described reproduction method, an example has been described in which the delay
amount and the amplitude amount are adjusted independently for each audio channel, but in the
present invention, the sound signal and position information of each channel, and further From
the overall viewpoint of sound reproduction by adding information such as directivity, the delay
amount of each signal delay circuit in each sound reproduction system 110, 120, 130, and the
amplitude adjustment amount of each amplitude adjustment circuit To define.
This overall adjustment may be performed in the editing apparatus 50 at the editing stage, or
coefficients may be calculated according to position information, the size of a sound source, etc.,
and each system may be adjusted with the coefficients.
[0046]
The above embodiment has described the case where video reproduction and sound
reproduction are separated and performed independently, but in the following embodiments, an
embodiment will be described in which reproduction is performed so that a real sound image is
present in the sound source in the reproduction image. .
[0047]
FIG. 7 shows a perspective view of an apparatus 100B for performing first video and sound
reproduction.
In FIG. 7, the TV monitor device 170 has a TV monitor display unit 171. The video captured by
the first imaging device 61 or the second imaging device 62 is displayed on the TV monitor
display section 171. A real sound image is present at the position of the sound source in the
display screen, for example, the piano 1. As such, speakers 181 to 183 having directivity in a
plurality of arbitrary directions are disposed on the front of the TV monitor display section 171.
10-05-2019
16
The sound source displayed on the TV monitor display section 171, for example, the position on
the TV monitor display section 171 of the piano 1 is specified by the relationship between the
position of the first imaging device 61 and the position of the piano 1. The directivity of the
beam 191 is controlled by the sound source position information, and the speakers 181 to 183
are direction-controlled so that the corresponding sound is directed to the sound source as a
reproduced image on the display surface of the TV monitor display unit 171. As a result, the
actual sound image position 172 is defined at the position directed by the beam 191 at the
position corresponding to the sound source position on the surface of the TV monitor display
171, and the sound as if from the image position of the sound source displayed on the TV
monitor display 171 The viewer feels as if That is, a real sound image is formed on the TV
monitor display section 171.
[0048]
FIG. 8A shows a perspective view of a second apparatus 100B for reproducing video and sound,
and FIG. 8B shows a plan view of a transparent electrode plate 200. FIG. The TV monitor 170
shown in FIG. 8A is similar to the TV monitor 170 shown in FIG. The transparent electrode plate
200 is disposed on the front surface of the TV monitor display unit 171. This transparent
electrode plate 200 is a substantially transparent sheet member which is vibrated by an electrical
voice signal as disclosed in the utility model registration application "Speaker device" filed by the
present applicant on December 17, 1984. Is formed, emitting sound from the front position on
the front. The transparent electrode plate 200 is divided into a plurality of sections 201 to 209,
and predetermined ones of these sections are selectively driven. Selection of the sections 201 to
209 is performed in the same manner as described with reference to FIG. 7 in accordance with
the sound source displayed on the TV monitor display section 171. As a result, the sound is
emitted from the portion where the sound source of the TV monitor display section 171 is
displayed, and a real sound image is present at the corresponding position on the display screen
of the TV monitor display section 171.
[0049]
FIG. 9A is a perspective view of a third apparatus 100D for reproducing video and sound, and
FIG. 8B is a cross-sectional view thereof. The sound and video reproducing apparatus 100D uses
a color liquid crystal display 210 as a display device. Each of the pixels 221 to 224 of the color
liquid crystal display 210 includes R, G, and G, and sound output holes 211, 212, and 213 are
formed in the periphery of these pixels. The sound output from the small speaker 231 is output
from the sound output hole 213. The selection of the small speaker 231 is performed
10-05-2019
17
corresponding to the image position of the sound source displayed on the color liquid crystal
display 210 as described with reference to FIG. Also in this embodiment, a corresponding sound
is output from the sound source displayed on the screen of the color liquid crystal display 210,
and a real sound image is present there.
[0050]
FIG. 10 shows a cross-sectional view of a fourth video and sound reproducing apparatus 100E.
The sound and video reproduction apparatus 100 E is a display apparatus of a projection display
method, and an image is projected from the projector 250 onto the screen 260. A large number
of sound output holes 261 to 269 are bored in the screen 260, and speakers 271 to 279 are
disposed on the back side of these holes. A speaker corresponding to the sound source displayed
on the screen 260 is driven, and a corresponding sound is output from the image position
displayed on the screen 260.
[0051]
FIG. 11 shows a cross-sectional view of a fifth video and sound reproducing apparatus 100F. This
embodiment is also a display device of a projection display method in which an image is
projected from the projector 300 onto the screen 311 as in the display device shown in FIG. The
plate 313 is vibrated, the position corresponding to the sound source displayed on the screen
311 is vibrated, and the sound is output therefrom. Therefore, also in this example, the actual
sound is emitted from the sound source displayed on the screen 311.
[0052]
The embodiment of the present invention is not limited to the above-described embodiment, and
various modifications can be made. In the practice of the present invention, the above-described
embodiments can be combined as appropriate.
[0053]
As described above, according to the recording method of the present invention, when video and
10-05-2019
18
sound are recorded, multiplexed and recorded, in addition to the multiplexing of the video signal,
the position information of the sound source is also displayed. Since multiplexing is performed
on the channel, it is possible to easily generate a real sound image in relation to the video signal
in editing and reproduction in a later stage. In particular, effective use of the multiplexing
frequency becomes possible in consideration of the frequency difference of the position signal of
the video signal. Further, according to the recording method of the present invention, it is
possible to realize a real sound image further by multiplexing the size, directivity and the like of
the sound source to the position information and multiplexing the sound information. According
to the reproduction method of the present invention, since the sound is reproduced using a
plurality of speakers based on the signals recorded by the above recording method and
multiplexed for each audio channel, a real sound image can be generated. Furthermore,
according to the reproduction method of the present invention, it becomes possible to reproduce
the corresponding sound from the position of the sound source in the reproduced image
recorded by the above-mentioned recording method.
10-05-2019
19
Документ
Категория
Без категории
Просмотров
1
Размер файла
33 Кб
Теги
jph05244683
1/--страниц
Пожаловаться на содержимое документа