close

Вход

Забыли?

вход по аккаунту

?

DESCRIPTION JP2013051686

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2013051686
Abstract: To provide a video presentation device that allows a user to easily grasp the
correspondence between video and audio. A video presentation apparatus simultaneously
displays a plurality of videos on a video display unit, sets the position of a virtual sound source of
the video at each position where a plurality of videos are displayed on a screen, and audio is
transmitted from the virtual sound source. The operation unit includes: an operation unit that
causes an audio reproduction unit to output an audio signal that reproduces the generated state
in aural or visual sense; and an operation input unit that receives an operation input and outputs
the operation input to the operation unit. [Selected figure] Figure 3
Image presentation apparatus, image presentation method, image presentation program, storage
medium
[0001]
The present invention relates to a technique for presenting video.
[0002]
In recent years, information has been distributed to homes from various media.
For example, TV and radio image / sound broadcasts are distributed to homes via terrestrial
broadcasts, communication satellite broadcasts, CATV cable networks and the like.
11-04-2019
1
[0003]
In addition, in recent years, digital broadcasting systems that digitize and transmit television
signals in CS (communication satellite) broadcasting, CATV (cable TV), and the like have become
widespread. In these systems, it is possible to secure several hundred channels by adopting
digital compression / transmission technology. Therefore, it has become possible to provide more
television / radio (music) programs than ever before.
[0004]
In addition, as AV equipment has become more digitalized, video and audio sources as recorded
media such as DVD (Digital Versatile Disk), DV (Digital Video), video and audio sources as
package media such as digital cameras, digital video recorders, etc. Many sources are also in the
home.
[0005]
Furthermore, it is thought that the number of routes for video and audio information to flow into
the home will be expanded by digitization of broadcasting and maintenance of the
communication infrastructure to be performed in the future.
[0006]
Thus, while services for providing a wide variety of video and audio information from various
media are increasing, the time during which a user can enjoy these services is limited.
Therefore, recently, a multi-window reproduction function has been realized in which a plurality
of windows are simultaneously opened on a large display, and different information sources are
allocated to the individual windows for reproduction.
[0007]
Also, a multi-window video search system has been proposed in which a large number of videos
are displayed in a list at one time using the above-mentioned multi-window display function to
11-04-2019
2
search for content desired by the user.
With respect to a plurality of videos displayed in a list on the screen, when the user is interested
in another video while paying attention to a certain video, the video content can be instantly
confirmed without switching the screen. By exploiting such human visual processing ability, the
user can confirm more search candidates at one time, and can efficiently find a desired program
to watch.
[0008]
In the above multi-window video search system, if the sound of the video content is output
simultaneously with each video so that the user can distinguish each sound, it is effective as
auxiliary information for quickly checking the video content. Therefore, a method has been
proposed in which a plurality of videos displayed by the multi-window function and their sounds
can be simultaneously viewed.
[0009]
The following Patent Document 1 describes a technique for simultaneously emitting sounds
corresponding to a plurality of videos displayed on one screen from a speaker at a position
corresponding to a display position of the videos. Thus, the user can sensibly associate the video
and the audio simultaneously displayed on the screen.
[0010]
Patent Document 2 below describes a technique for adjusting the volume balance of audio
signals to be added to speakers installed on the left, center, and right according to the size and
position of a window in which an image is displayed. As a result, the user can intuitively
recognize the correspondence between each sound and window synthesized by each speaker by
the volume.
[0011]
11-04-2019
3
Patent Document 3 listed below describes a technique for limiting the frequency band of the
audio signal of the sub screen to a narrow band such as that of a telephone. As a result, the user
can distinguish the main screen audio and the sub screen audio based on the difference in sound
quality.
[0012]
JP-A-8-98102 JP-A-2000-69391 JP-A-9-322094
[0013]
In the technology described in Patent Document 1, the installation position of the speaker is
fixed.
Therefore, in order to allow the user to appropriately grasp the correspondence between video
and audio, it is necessary to adjust the window display position, the number of audio channels to
be simultaneously output, and the like in accordance with the speaker installation position. That
is, in the technology described in Patent Document 1, video and audio are easily restricted by the
speaker installation position.
[0014]
In Patent Document 1, when simultaneously displaying two images, the audio of the image
displayed on the left screen is output from the speaker on the left side of the screen, and the
audio of the image displayed on the right screen is the speaker on the right side of the screen An
example of outputting from is described. However, no specific method is described as to how to
divide the screen when simultaneously displaying three or more videos and which speaker
corresponds to each video.
[0015]
In the technique described in Patent Document 2, in order to properly grasp the correspondence
between the video and the audio in the window, the distance between the user and the left
11-04-2019
4
speaker and the distance between the user and the right speaker are approximately equal. The
user needs to be located at the place. For example, when the user is located at a position
extremely close to the right speaker, the sound output from the right speaker is easily felt as if it
is generated from near. Therefore, even if the window arrangement is even between the left and
right, only the sound of the right image can be heard large, and the balance between the image
and the sound is shifted.
[0016]
Patent Document 2 can cope with the case where a single user is positioned in front of the screen
due to the above circumstances, but it becomes difficult to cope with a situation in which a
plurality of users are lined up in front of the screen. there is a possibility.
[0017]
In the technology described in Patent Document 3, there is a possibility that the frequency band
of the region of high information density in the main screen sound and the frequency band of the
sub screen sound outputted after the filtering overlap.
At this time, it is difficult for the user to distinguish between the two.
[0018]
That is, in Patent Document 3, depending on the combination of the main screen audio and the
sub screen audio, it may be difficult for the user to associate the video with the audio. Further,
Patent Document 3 does not describe, as in Patent Document 1, a specific method as to which
speaker corresponds to each video when simultaneously displaying three or more videos.
[0019]
The present invention has been made to solve the problems as described above, and it is an
object of the present invention to provide a video presentation apparatus that allows a user to
easily grasp the correspondence relationship between video and audio.
[0020]
11-04-2019
5
The video presentation apparatus according to the present invention sets a virtual sound source
at a position where a video is displayed, and forms a sound field that simulates a state in which
sound is generated from the virtual sound source.
[0021]
According to the video presentation device of the present invention, the position of the video on
the screen matches the position of the sound source recognized by the user, so that the user can
easily grasp the correspondence between the video and the audio.
[0022]
FIG. 1 is a functional block diagram of a video presentation device 100 according to Embodiment
1.
FIG. 6 is a diagram showing an example of screen display of a screen display unit 150.
It is a figure which shows a mode that the audio | voice output part 160 simulates the sound field
which generate | occur | produces from the virtual sound source 161 using a wave front
synthetic | combination technique.
FIG. 18 is a diagram showing an example in which the depth direction position of the virtual
sound source 161 is set to the back side of the screen display unit 150, that is, the side away
from the user 200; FIG. 16 is a functional block diagram of a video presentation device 100
according to Embodiment 3. It is a figure which shows the detail of the button with which the
remote control 180 is provided. It is a figure which shows the example of an initial screen of
screen transition mode. It is a figure which shows the example of a screen transition in screen
transition mode. It is a figure which shows the example of a screen transition in the in-screen
selection mode. FIG. 17 is a diagram showing an example of screen transition when the user
presses determination button 184 of remote control 180 in the in-screen selection mode. FIG. 16
is an operation flowchart of the video presentation device 100 according to the third
embodiment. It is a figure which shows the example which comprised the video presentation
apparatus 100 of FIG. 1 as a television apparatus. It is a figure which shows the example which
comprised the video presentation apparatus 100 of FIG. 1 as a television apparatus. It is a figure
which shows the example which comprised the video presentation apparatus 100 of FIG. 1 as a
television apparatus. It is a figure which shows the example which comprised the video
11-04-2019
6
presentation apparatus 100 of FIG. 1 as a video projection system. It is a figure which shows the
example which comprised the video presentation apparatus 100 of FIG. 1 as a video projection
system. It is a figure which shows the example which comprised the video presentation apparatus
100 of FIG. 1 as a system which consists of a television board and a television apparatus. FIG. 6 is
a diagram showing an example of the configuration of an audio output unit 160.
[0023]
First Embodiment FIG. 1 is a functional block diagram of a video presenting apparatus 100
according to a first embodiment of the present invention. The video presentation device 100 is a
device that reproduces video information and audio information and presents it to the user, and
the arithmetic processing unit 110, the content storage unit 120, the video signal reproduction
unit 130, the audio signal reproduction unit 140, the screen display unit 150, The voice output
unit 160 is provided.
[0024]
The arithmetic processing unit 110 controls the overall operation of the video presentation
device 100. The arithmetic processing unit 110 also controls the operations of the video signal
reproduction unit 130 and the audio signal reproduction unit 140. The arithmetic processing
unit 110 can be configured using, for example, an arithmetic device such as a CPU (Central
Processing Unit). The operation of the arithmetic processing unit 110 can also be realized by
separately providing a program in which the control operation is described and the arithmetic
device executing the program.
[0025]
The content storage unit 120 is a storage device that stores content data in which video
information and audio information are recorded. The content storage unit 120 can be configured
using, for example, a storage device such as an HDD (Hard Disk Drive). Content data may be, for
example, television broadcast waves, storage media such as DVDs, video and audio signals output
by video players and video tape recorders, and various content sources such as downloads from
servers that distribute digital content via networks It can be obtained. The video presentation
apparatus 100 appropriately includes an interface for receiving content data from a content
source as needed.
11-04-2019
7
[0026]
The video signal reproduction unit 130 reads the content data from the content storage unit 120,
decodes the video information and the like to generate a video signal, performs processing such
as video effects, and processes it into a predetermined screen layout. The video signal
reproduction unit 130 outputs the video signal to the screen display unit 150 for screen display.
[0027]
The audio signal reproduction unit 140 reads out content data from the content storage unit
120, decodes audio information to generate an audio signal, applies an audio effect as needed,
performs D / A conversion, and amplifies an analog signal. Then, the voice output unit 160
outputs the voice and outputs the voice.
[0028]
The screen display unit 150 is a screen display device configured using, for example, a liquid
crystal display device.
The screen display unit 150 displays an image on the screen based on the video signal output
from the video signal reproduction unit 130. The process of driving the screen display unit 150
may be performed by the video signal reproduction unit 130 or may be performed by the
arithmetic processing unit 110.
[0029]
The audio output unit 160 is configured using one or more audio output devices (for example,
speakers). In the first embodiment, a speaker array in which a plurality of speakers are linearly
arranged is assumed, but the present invention is not limited to this. For convenience of
explanation, it is assumed that the audio output unit 160 is installed below the screen display
unit 150.
11-04-2019
8
[0030]
FIG. 2 is a view showing a screen display example of the screen display unit 150. As shown in
FIG. The video signal reproduction unit 130 reads one or more pieces of content data from the
content storage unit 120, and generates a video signal that causes the video information to be
displayed on a predetermined position on the screen display unit 150. Here, an example in which
three pieces of video information are simultaneously displayed on the screen display unit 150
has been shown. The user views the three video contents simultaneously on the screen display
unit 150.
[0031]
The audio output unit 160 individually reproduces the audio of each video content. At this time,
it is desirable that the generation source of the audio and the on-screen position of each video
coincide with each other. By matching these, the user can associate video and audio and easily
grasp the content of the content.
[0032]
The configuration of the video presentation device 100 has been described above. Next, a
method for correlating the video and the sound on the screen display unit 150 will be described
together with the wavefront synthesis method using the speaker array.
[0033]
<Embodiment 1: Loudspeaker Array> Even in a crowd like a cocktail party, there is a
phenomenon called a so-called cocktail party effect in which the conversation of a person of
interest can be naturally heard. As can be seen from the example of this effect, human beings can
hear multiple sounds at the same time depending on the difference in position of the sound
image (image of the sound to be recognized) or the difference in the sound itself.
[0034]
11-04-2019
9
It is considered to make use of such human auditory ability in the image presentation device 100.
If each sound image can be localized at a plurality of video positions, the user can selectively
hear the sound of a specific video.
[0035]
It is desirable to make the sound field reproduced by the audio output unit 160 as close as
possible to the original sound field in order to naturally distinguish a plurality of sounds as in the
cocktail party effect. Therefore, wavefront synthesis technology using a speaker array is applied
to the sound output unit 160.
[0036]
The wavefront synthesis technology is to assume that there is a sound source on the back side of
the speaker array (virtual sound source), and synthesize the wavefronts of the sound field by the
sum of the wavefronts emitted from the respective speakers of the speaker array. By using the
wavefront synthesis technology, it is possible to reproduce the sense of direction and the sense
of spread of the sound as if the actual sound source is actually present at the position of the
virtual sound source.
[0037]
FIG. 3 is a diagram showing how the sound output unit 160 simulates the sound field generated
from the virtual sound source 161 using the wavefront synthesis technology. Here, in order to
simplify the description, an example in which the screen display unit 150 displays a single video
content on the screen is shown.
[0038]
FIG. 3A shows a screen display example of the screen display unit 150. It is assumed that the
video signal reproduction unit 130 causes the screen display unit 150 to display one video
content at a position slightly leftward toward the screen. The user views and listens to the video
11-04-2019
10
content on the assumption that the sound is generated from the position where the video content
is displayed on the screen.
[0039]
FIG. 3B is a top view of the screen display unit 150 and the audio output unit 160 as viewed
from above. The audio signal reproduction unit 140 assumes that the sound source is at the
position on the screen of the video content shown in FIG. 3A, and sets the virtual sound source
161 at that position. It is assumed that the user 200 is located in front of the screen display unit
150. Specifically, arithmetic processing unit 110 acquires the position of the video display
window on the screen (for example, the center coordinates of the window) from video signal
reproduction unit 130, and sets it in audio signal reproduction unit 140 as the position of virtual
sound source 161. .
[0040]
When the virtual sound source 161 is at the position shown in FIG. 3B, the user 200 assumes
that a sound wave plane as shown by the solid line arc in FIG. 3B is formed. If this sound wave
plane is reproduced by wavefront synthesis technology, the user 200 can illusion that the sound
source is at the position of the virtual sound source 161, and the on-screen position of the video
content can correspond to the sound source position.
[0041]
In order to simulate the sound wave plane shown by the solid arc in FIG. 3B, the audio signal
reproduction unit 140 synthesizes the sound wave planes generated by the speakers as shown
by the dotted arc, and the synthesized wave becomes a solid arc. In this way, the sound output
from each speaker may be controlled. As a result, the sound wave surface that reaches the user
200 is like a solid arc, so that it is possible to simulate a sound field in which sound is generated
from the virtual sound source 161.
[0042]
11-04-2019
11
In this example, for the sake of convenience of explanation, it is assumed that the reproduction is
performed by the wavefront synthesis reproduction method, but when reproducing the
wavefront within the range of the frequency range of the actual audible range, the speakers must
be arranged at 8.5 mm intervals on a two-dimensional plane. It is not realistic. Therefore,
products using realistic-aperture speakers are on the market based on the idea similar to Wave
Field Synthesis (WFS) based on linear arrayed speaker arrays. In those implementations, the
synthesis of the wavefront is only possible in the low frequency band, but such an approximation
can also perceptually give an effect similar to that of combining the wavefronts. The present
invention also presupposes an approximate reproduction method by such an implementation.
[0043]
Also, from a psychoacoustic view point, it is said that the key to perceiving the sound image is
the sound pressure difference and the time difference of the sound that enters both ears, but the
wave-field synthesis method is simultaneously applied to multiple users. If it is interpreted as a
system that allows such a sound to be heard, any reproduction system may be used instead of a
system that attempts to strictly combine wavefronts as long as it is a reproduction system that
produces such an effect.
[0044]
In any reproduction method, the audio output unit 160 has to know the position of each speaker
at the time of reproduction, but since each speaker is usually installed and fixed to the device, the
speaker position can be known.
Alternatively, the speaker may be movable, and along with the movement, the speaker position
may also be set automatically or by user operation.
[0045]
Note that FIG. 3 shows an example in which the sound wave plane is combined on the horizontal
plane for the convenience of description. This makes use of the fact that human hearing is
generally insensitive to vertical misalignment rather than horizontal sound image-to-image
misalignment. Furthermore, together with a video, when a sound image corresponding to the
video is presented from a different place from the video position, a so-called belly talk effect is
used in which the sound image is drawn to the video. If the horizontal position of the virtual
11-04-2019
12
sound source is reproduced from these perceptual effects, even if the sound image position in the
vertical direction (the height of the sound image position) deviates from the image, the user can
hear the sound from the image Illusion. Therefore, it is sufficient to arrange the speakers in a
straight line in the horizontal direction at the upper end or the lower end of the screen and to
output the sound so that there is no deviation between the image and the sound image.
[0046]
In this case, the virtual sound source position need not necessarily coincide with the video
position, and may be located on or near a straight line extending in the vertical direction from the
video position. The virtual sound source does not have to be located on or behind the screen, and
may be located, for example, on or before or after the speaker array. However, of course, the
sound wave surface may be synthesized in the height direction as well.
[0047]
For example, on the assumption that the virtual sound source 161 is installed at the position in
the height direction where the screen display unit 150 displays the video content on the screen,
the sound output from each speaker is controlled. If necessary, a plurality of speaker arrays may
be arranged in the height direction, and sound wave surface synthesis in the height direction
may be performed.
[0048]
Not only monaural sound but also stereo (2 ch) and surround sound (5.1 ch) are widely spread as
normal video contents. In order to reproduce the content having these multi-channel audio
signals in association with one virtual sound source in the scheme of the present invention, it is
necessary to downmix to monaural audio. The downmixing method may be performed by a
method commonly used in a television or the like. Alternatively, with regard to surround sound,
the sound signal of the rear channel has a lot of reverberation components, and there is a
possibility that it becomes difficult to localize the sound image in the normal downmix system,
for example, only the front 3 channels (FR, FC, FL) May be added, divided by 3, and so on.
[0049]
11-04-2019
13
Even when the screen display unit 150 simultaneously displays a plurality of video contents, the
virtual sound sources 161 of the individual video contents are individually set by the same
method as FIG. 3, and the on-screen position of each video content and the position of the virtual
sound source 161 Can simulate the corresponding sound field. Thereby, the user can easily grasp
the correspondence between the position of the virtual sound source 161 and the on-screen
position of each video content.
[0050]
Although in the first embodiment, the audio signal reproduction unit 140 determines the position
of the virtual sound source 161 for the sake of simplicity, the arithmetic processing unit 110
may perform arithmetic processing or the like for that purpose. The same applies to the
following embodiments.
[0051]
As described above, the video presenting apparatus 100 according to the first embodiment sets
the position of the virtual sound source 161 at the position where the screen display unit 150 is
displaying a video, and the virtual sound source 161. The sound output unit 160 simulates a
sound field that is assumed to be voiced from the above. As a result, the user can easily associate
the video position on the screen display unit 150 with the sound heard from the sound output
unit 160.
[0052]
Further, according to the video presentation device 100 according to the first embodiment, the
user can associate the video with the audio, regardless of the layout of the video content
displayed on the screen by the screen display unit 150. Video content can be easily identified.
Thereby, desired video content can be quickly found in any screen layout.
[0053]
11-04-2019
14
This effect is effective in a multi-user environment where the screen layout is different for each
user. That is, when each user customizes the screen layout, it is difficult to correspond the video
position and the sound source position conventionally because which video content is
individually displayed on which portion of the screen. According to the first embodiment, since
the virtual sound source position and the video display position can be corresponded with high
freedom, it is possible to flexibly associate video and audio regardless of what the screen layout
is. it can.
[0054]
Second Embodiment In the first embodiment, it is assumed that the virtual sound source 161 is
disposed along the screen display unit 150, but the position of the virtual sound source can be
set arbitrarily. For example, the virtual sound source 161 can be disposed on the side farther
from the user than the screen display unit 150. One example of the second embodiment of the
present invention will be described. The configuration of the video presentation device 100 is the
same as that described in the first embodiment.
[0055]
FIG. 4 is a diagram showing an example in which the depth direction position of the virtual sound
source 161 is set deeper than the screen display unit 150, that is, the side away from the user
200. For comparison, an example in which the virtual sound source 161 is arranged as in FIG. 3
is also shown in FIG. 4 (a).
[0056]
In FIG. 4B, the screen display unit 150 simultaneously displays three video contents on the
screen. The position and size of the video content 151 are the same as in FIG. 4 (a). The other
two video contents 152 and 153 are disposed on the right side toward the screen display unit
150. The screen size of the video content 152 is smaller than that of the video content 151, and
the screen size of the video content 153 is still smaller.
[0057]
11-04-2019
15
The user generally assumes that the volume of the video being displayed is small. The audio
signal reproduction unit 140 reflects this in the position of the virtual sound source, and sets the
position of the virtual sound source of each video content.
[0058]
In FIG. 4, the position of the virtual sound source 162 of the video content 152 is set behind the
position of the virtual sound source 161. This reflects that the screen size of the video content
152 is smaller than the screen size of the video content 151, and the virtual sound source 162 is
disposed farther from the user 200 than the virtual sound source 161 is. The position of the
virtual sound source 163 of the video content 153 is set further back.
[0059]
Regarding the relationship between the display size of the video content and the depth of the
virtual sound source, assuming that the depth of the content (video content 151 in FIG. 4)
displayed the largest on the screen is 0, the screen of the video content as viewed from the user
The relative depth of the video content 152, 153 is calculated according to the size. The depth
information of the virtual sound source calculated in this manner is output from the video
reproduction unit 130 to the arithmetic processing unit simultaneously with the position on the
screen of the virtual sound source (the center position of the display window) and is set in the
audio information reproduction unit 140. Ru.
[0060]
The method of setting the position in the depth direction of the virtual sound source is a
reproduction method using the concept of the virtual sound source, and it is generally defined as
a method of reproducing the position in the depth direction of the virtual sound source. It shall
be in accordance with the method. Usually, for example, the volume is adjusted, the phase of the
sound wave surface is adjusted, and the like.
[0061]
11-04-2019
16
<Embodiment 2: Summary> As described above, according to the size of the image displayed on
the screen by the screen display unit 150, the image presentation device 100 according to the
second embodiment determines the depth of the virtual sound source corresponding to the
image. Set the direction position. Thus, the correspondence between the screen size of the video
and the audio can be easily grasped, so that the user can immediately understand which audio
corresponds to which video.
[0062]
Third Embodiment In the third embodiment of the present invention, an operation example will
be described in which the screen displayed by the screen display unit 150 is scrolled or moved to
switch the video content to be displayed. Further, a remote control is taken as an example of an
operation device for the user to instruct the image presentation apparatus 100 to switch the
screen.
[0063]
FIG. 5 is a functional block diagram of the video presentation apparatus 100 according to the
third embodiment. The image presentation apparatus 100 according to the third embodiment
includes an operation input unit 170 and a remote control 180 in addition to the configurations
described in the first and second embodiments. Except the matters regarding the operation input
unit 170 and the remote control 180, the second embodiment is the same as the first and second
embodiments.
[0064]
The remote control 180 is an operating device for giving an operation instruction to the video
presentation device 100 by the user. The details of the remote control 180 will be described
again with reference to FIG. The operation input unit 170 receives an operation signal
transmitted by the remote control 180, and outputs the content of the operation instruction to
the arithmetic processing unit 110.
11-04-2019
17
[0065]
FIG. 6 is a diagram showing details of buttons provided on the remote control 180. As shown in
FIG. The remote controller 180 includes a search mode button 181, a search mode end button
182, a direction instruction button 183, an enter button 184, and a back button 185, in addition
to the power button, the channel button, and the volume button.
[0066]
The video presentation apparatus 100 selects one of the video content by switching the video
content displayed by the screen display unit 150 according to an operation instruction input by
the user using the remote control 180 and fixing the video content displayed on the screen.
Switch between in-screen selection mode to select. Further, the screen display unit 150 switches
the video content displayed on the screen. Below, the example of operation and the example of
screen transition are explained.
[0067]
FIG. 7 is a diagram showing an example of an initial screen of the screen transition mode. When
the user presses the search button 181 of the remote control 180, the operation input unit 170
receives an operation signal to that effect and outputs the operation signal to the arithmetic
processing unit 110. The arithmetic processing unit 110 switches the operation mode of the
video presentation device 100 to the screen transition mode.
[0068]
The arithmetic processing unit 110 reads content data (for example, the latest content data) to be
displayed on the initial screen of the screen transition mode from the content storage unit 120
according to a predetermined rule, decodes video information and audio information, and so on.
A signal and an audio signal are generated and output from the screen display unit 150 and the
audio output unit 160, respectively. The processing relating to the virtual sound source is the
same as in the first and second embodiments, so the description will be omitted. The same
applies to the following.
11-04-2019
18
[0069]
The layout of each video content when the screen display unit 150 displays the video content on
the screen follows a predetermined rule. Here, the time at which the video content was acquired
(for example, recorded) in the horizontal axis direction of the screen, the broadcast channel of
the video content was allocated in the vertical axis direction of the screen, and both attributes of
each video content were made to correspond on a two-dimensional plane. An example is shown
above.
[0070]
FIG. 8 is a diagram showing an example of screen transition in the screen transition mode. The
screen transition shown in FIG. 8 will be described below.
[0071]
FIG. 8A is a view showing an example of a screen after the user presses the left direction button
following FIG. 7. The left direction in FIG. 8 is a direction in which the recording time is old.
Therefore, when the operation processing unit 110 receives an operation signal in the left
direction from the remote control 180, it reads out from the content storage unit 120 content
data having the same channel and an older recording time, and the screen display unit 150 in the
same procedure as FIG. Display the screen. The number of content data to be newly read out is
appropriately determined in accordance with the screen size of the screen display unit 150 or
the like, or the arithmetic processing unit 110 determines an appropriate value each time.
[0072]
FIG. 8B is a view showing an example of a screen after the user presses the upward direction
button following FIG. 8A. The upward direction in FIG. 8 is a direction toward increasing the
channel number. Therefore, when the operation processing unit 110 receives an upward
operation signal from the remote control 180, the operation processing unit 110 reads content
data having the same recording time zone and a large channel number from the content storage
unit 120, and the screen display unit 150 in the same procedure as FIG. Display on the screen.
11-04-2019
19
[0073]
FIG.8 (c) is a figure which shows the example of a screen after a user presses a left direction
button following FIG.8 (b). The operation procedure is the same as that of FIG.
[0074]
FIG. 9 is a diagram showing an example of screen transition in the in-screen selection mode.
When the user presses the determination button 184 of the remote control 180 in the screen
transition mode, the operation input unit 170 receives an operation signal to that effect and
outputs the operation signal to the arithmetic processing unit 110. The arithmetic processing
unit 110 switches the operation mode of the video presentation device 100 to the in-screen
selection mode.
[0075]
FIG. 9A shows an example of an initial screen of the in-screen selection mode. In the initial screen
of the in-screen selection mode, the video signal reproduction unit 130 highlights, for example,
the video content closest to the center of the screen among the video contents displayed on the
screen by the screen display unit 150 in the previous screen transition mode. Apply video effects.
This allows the user to easily grasp which video content is currently selected on the screen.
[0076]
FIG.9 (b) is a figure which shows the example of a screen after a user presses a downward
direction button following FIG.9 (a). The arithmetic processing unit 110 receives a downward
operation instruction signal from the remote controller 180 via the operation input unit 170. The
arithmetic processing unit 110 instructs the video signal reproduction unit 130 to highlight the
video content currently displayed on the screen below the video content currently highlighted.
The video signal reproduction unit 130 highlights the video content according to the instruction.
When a plurality of video contents exist below, for example, the video contents on the left side
are highlighted in order from the left to the screen.
11-04-2019
20
[0077]
FIG.9 (c) is a figure which shows the example of a screen after a user presses a downward
direction button following FIG.9 (b). The operation procedure is the same as that of FIG. 9 (b).
[0078]
FIG. 10 is a view showing an example of screen transition when the user presses the
determination button 184 of the remote control 180 in the in-screen selection mode.
[0079]
When the arithmetic processing unit 110 receives an operation signal of the determination
button 184 from the remote control 180 in the in-screen selection mode, the arithmetic
processing unit 110 instructs the video signal reproduction unit 130 to display the video content
highlighted at that time full screen.
In response to the instruction, the video signal reproduction unit 130 causes the screen display
unit 150 to display the video content in the full screen mode.
[0080]
The arithmetic processing unit 110 sets the position of the virtual sound source of the video
content to the center of the screen display unit 150 as the video content is switched to the full
screen mode. Since the screen size of the video content is increased by the full screen, the depth
direction position of the virtual sound source may be adjusted accordingly.
[0081]
FIG. 11 is an operation flowchart of the video presentation apparatus 100 according to the third
embodiment. Hereinafter, each step of FIG. 11 will be described.
11-04-2019
21
[0082]
(FIG. 11: Step S1100) When the power of the image presentation apparatus 100 is turned on, the
arithmetic processing unit 110 appropriately executes an initialization process by reading a
control program from a memory or the like, and then starts this operation flow.
[0083]
(FIG. 11: Step S1101) The arithmetic processing unit 110 causes the screen display unit 150 to
display an initial screen.
For example, the content data name and window position of the video content displayed on the
screen by the screen display unit 150 when the power is turned off last time are stored in the
memory when the power is turned off, and read again when the power is turned on. This makes
it possible to reproduce the screen state when the power was turned off last time.
[0084]
(FIG. 11: Step S1102) The arithmetic processing unit 110 waits for the operation signal from the
remote control 180. When the arithmetic processing unit 110 receives an operation signal from
the operation input unit 170, the process advances to step S1103 and repeats this step until the
operation signal is received and waits for the operation signal.
[0085]
(FIG. 11: Step S1103) The arithmetic processing unit 110 determines whether the operation
signal received from the remote control 180 is an operation instruction to cause the screen
display unit 150 to perform full screen display. Specifically, if the current screen mode is the inscreen selection mode described in FIG. 9 and the pressed button is the determination button
184, an operation instructing to display the video content selected by the user full screen It turns
out that it is an instruction. If the instruction is a full screen instruction, the process advances to
step S1107; otherwise, the process advances to step S1104.
11-04-2019
22
[0086]
(FIG. 11: Step S1104) The arithmetic processing unit 110 determines which screen mode the
operation signal received from the remote control 180 indicates. If it is an operation signal
instructing a screen search mode, the process advances to step S1105; if it is an operation signal
instructing a screen transition mode, the process advances to step S1106.
[0087]
(FIG. 11: Step S1104: Supplement) If the pressed button is the search button 181, it is
determined that it is an instruction to shift to the screen transition mode. Alternatively, when the
return button 185 is pressed when the current screen mode is the in-screen selection mode, it is
determined that the instruction is to instruct transition to the screen transition mode. If the
current screen mode is the screen transition mode and the pressed button is the determination
button 184, it is determined that the instruction is to instruct transition to the in-screen selection
mode.
[0088]
(FIG. 11: Step S1105) The arithmetic processing unit 110 executes the in-screen search mode
described with reference to FIG.
[0089]
(FIG. 11: Step S1106) The arithmetic processing unit 110 executes the screen transition mode
described with reference to FIG.
[0090]
(FIG. 11: Step S1107) The arithmetic processing unit 110 executes the full screen display mode
described in FIG.
[0091]
(FIG. 11: Step S1108) The arithmetic processing unit 110 ends the operation flow when ending
the operation of the video presentation device 100, and returns the process to step S1102 and
repeats the same processing when continuing the operation.
11-04-2019
23
[0092]
The operation of the video presentation apparatus 100 according to the third embodiment has
been described above.
In the third embodiment, the remote control 180 is exemplified as the operation device, but other
operation devices can also be used.
For example, an operation button similar to that of the remote control 180 may be provided on
the main body of the video presentation apparatus 100.
[0093]
<Embodiment 3: Summary> As described above, the image presentation device 100 according to
the third embodiment displays the screen display unit 150 when the direction instruction button
183 is pressed while the screen transition mode is being executed. It instructs the video signal
reproduction unit 130 to switch the video content to be displayed on the screen.
As a result, the user can visually search for desired video content while simultaneously displaying
a plurality of video content on the screen.
Further, it is possible to aurally identify desired content while associating video and audio by the
effect of the virtual sound source.
[0094]
Further, the video presenting apparatus 100 according to the third embodiment fixes the screen
transition mode for switching the video content to be simultaneously displayed in the screen
according to the direction operation instruction from the remote control 180 and the video
content to be displayed in the screen. Switch to the in-screen selection mode to select video
11-04-2019
24
content. As a result, in the screen transition mode, it is possible to display a plurality of video
contents in the screen, roughly search for desired video contents, and decide the video contents
in the in-screen selection mode. In particular, in the screen transition mode, since it is possible to
search for desired video content while associating video and audio, the effect as a video content
search device can also be exhibited.
[0095]
Fourth Embodiment In the fourth embodiment of the present invention, implementation
examples of the first to third embodiments will be briefly described. The present invention can be
used for any device that is accompanied by video. Various examples of devices to which the
present invention can be applied will be described with reference to FIGS. 12-18.
[0096]
12 to 14 each show an example in which the video presentation device 100 of FIG. 1 is
configured as a television device. FIGS. 15 and 16 each show an example in which the video
presentation device 100 of FIG. 1 is configured as a video projection system. FIG. 17 is a diagram
showing an example in which the video presentation apparatus 100 of FIG. 1 is configured as a
system including a television board and a television apparatus. Although the example which
arranged ten speakers as a speaker array is given in any of FIGS. 12-17, the number of speakers
should just be plural.
[0097]
When the video presentation apparatus 100 according to the present invention is implemented
by a television set, the arrangement of the audio output unit in the television set may be freely
determined. As in the television set shown in FIG. 12, a speaker array may be provided below the
television screen, in which the speakers in the audio output unit are linearly arranged. As in the
television set shown in FIG. 13, a speaker array in which the speakers in the audio output unit
are linearly arranged may be provided above the television screen. Like a television set shown in
FIG. 14, a speaker group in which transparent film type speakers in an audio output unit are
linearly arranged may be embedded in a television screen.
11-04-2019
25
[0098]
Further, the video presentation device 100 according to the present invention can be used for a
video projection system. As in the video projection system shown in FIG. 15, the speaker array
may be embedded in a projection screen on which the video is projected by the video projector.
As in the video projection system shown in FIG. 16, a speaker array may be disposed behind a
sound transmission type screen on which the video is projected by the video projector.
[0099]
Besides, the video presentation device 100 according to the present invention can be
implemented by a television device and a television stand (television board). As in a system
(home theater system) shown in FIG. 17, a speaker array in which speakers are arranged may be
embedded in a television stand for mounting a television device.
[0100]
When the video presentation process according to the present invention is applied to the
apparatus as described with reference to FIGS. 12 to 17, the user can perform the wavefront
synthesis reproduction process (the arithmetic processing unit 110 or the audio signal
reproduction unit 140 in FIG. It is also possible to provide a switching unit that switches whether
or not to perform the process in (4) by a button operation provided on the apparatus main body
or a user operation performed by remote controller operation or the like. For example, when only
one video is displayed on the screen and wavefront synthesis reproduction processing is not
performed, a virtual sound source is disposed as shown in FIG. May be
[0101]
FIG. 18 is a diagram showing an exemplary configuration of the audio output unit 160. As shown
in FIG. As shown in FIG. 18, the sound output unit 160 may perform wave-field synthesis using
only the two end speakers 1601 L and 1601 R of the array speaker 1601 to reproduce sound.
Similarly, wavefront synthesis reproduction may be performed for 5.1ch audio data, or only the
front three channels may be reproduced using only the central speaker 1601C and the two
speakers 1601L and 1601R on both sides.
11-04-2019
26
[0102]
Fifth Embodiment The program for realizing the functions of the arithmetic processing unit 110,
the video signal reproduction unit 130, and the audio signal reproduction unit 140 of the video
presentation apparatus 100 described in the above first to fourth embodiments can be read by
computer. The processing of each functional unit may be realized by recording on a storage
medium, reading the program recorded on the storage medium into a computer system, and
executing the program. Note that the “computer system” mentioned here includes hardware
such as an operating system (OS) and peripheral devices.
[0103]
Further, the program may be for realizing a part of the functions described above, and further,
the functions described above may be realized in combination with a program already recorded
in a computer system. .
[0104]
Further, the "storage medium" storing the above program includes a flexible disk, an optical
magnetic disk, a ROM (Read Only Memory), a computer readable portable medium such as a CDROM, a hard disk incorporated in a computer system, etc. Storage device etc.
Furthermore, such as communication lines in the case of transmitting a program via a network
such as the Internet or a communication line such as a telephone line, the one dynamically holds
the program for a short time, and the server or client in that case. Such as volatile memory in the
computer system, which holds the program for a certain period of time is also included.
[0105]
100: Video presentation device, 110: Arithmetic processing unit, 120: Content storage unit, 130:
Video signal reproduction unit, 140: Audio signal reproduction unit, 150: Screen display unit,
151 to 153: Video content, 160: Audio output unit , 1601: array speaker, 1601 L, 1601 R: both
ends speaker, 1601 C: center speaker, 161 to 163: virtual sound source, 170: operation input
unit, 180: remote control, 181: search mode button, 182: search mode end button, 183: Direction
indication button, 184: determination button, 185: back button, 200: user.
11-04-2019
27
11-04-2019
28
Документ
Категория
Без категории
Просмотров
0
Размер файла
42 Кб
Теги
jp2013051686, description
1/--страниц
Пожаловаться на содержимое документа