close

Вход

Забыли?

вход по аккаунту

?

JP2010072695

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2010072695
The present invention provides a tablet PC that can continue to use an audio signal collected
from a microphone without requiring user intervention when the mode is changed from the PC
use mode to the tablet use mode. A tablet PC (13) comprises a plurality of microphones
constituting a microphone array. The tablet PC can operate in a voice enhancement mode in
which the voice signal collected from the microphone is processed to form the enhancement
space 200 and a non-processing mode in which the voice signal is processed without forming the
enhancement space. When the user operates the display housing of the tablet PC to change from
the PC use mode to the tablet use mode, the tablet PC detects it. When the tablet PC detects a
change in use mode, the tablet PC operates by processing the emphasis space so that the voice
signal collected by the microphone can be used in the tablet use mode. [Selected figure] Figure 4
Tablet computer having a microphone and control method
[0001]
The present invention relates to a compatible tablet computer equipped with a microphone, and
more particularly to a technology for controlling processing of an audio signal collected by the
microphone according to a use mode of the tablet computer.
[0002]
Personal computer (hereinafter referred to as PC)
04-05-2019
1
Among them, the thin type that can be operated by pen input to the display is called a tablet PC.
The tablet PC is called a notebook computer (hereinafter referred to as a notebook PC) by
operating with pen input without using a keyboard. Provide the same function as). Tablet PCs are
roughly divided into two types, convertible types and pure tablet types. The convertible type has
a structure that can be used as a tablet PC by changing the direction of the display of a notebook
PC equipped with a keyboard. The pure tablet type has a structure in which only a pen input
operation is performed without a keyboard.
[0003]
Some tablet PCs convert a user's voice signal collected by a microphone into digital data, and use
the voice data for various purposes after voice recognition. Because noise is present in the
normal speech input environment, it is necessary to separate the target speech from the noise or
to emphasize it against the noise in order to improve the speech recognition accuracy. Here, the
voices are collected by a plurality of microphones constituting the microphone array, and the
target sound is enhanced by using the phase difference of the voice signal received by each
microphone based on the direction of the sound source and the distance between the
microphones. There is known a technique called beam forming which suppresses
[0004]
Beamforming processes the audio signal to increase the sensitivity to the target sound from a
particular direction relative to the microphone array and to reduce the sensitivity to noise from
other directions. Patent Document 1 discloses a technique of collecting an acoustic signal with a
plurality of microphones, emphasizing a target signal included in the acoustic signal, and
obtaining an acoustic signal in which a noise signal is suppressed. Unexamined-Japanese-Patent
No. 2003-223198
[0005]
In the compatible type tablet PC, when using it by keyboard input (hereinafter referred to as PC
use mode). When using with pen input) (hereinafter referred to as tablet use mode). And), the
position of the user's mouth with respect to the microphone is different. Therefore, even if the
sensitivity direction of beamforming is set so that the voice emitted from the user's mouth is
enhanced in the PC usage mode, it may not be enhanced and suppressed in the tablet usage
04-05-2019
2
mode. Then, the user may misunderstand that the device is broken if the voice is not recognized
after changing from the PC use mode to the tablet use mode. If the user stops the beam forming
function, the tablet PC can use the voice mixed with noise without enhancement processing,
which improves the convenience, but the beam forming function is changed every time the mode
of use is changed. There are complications associated with manipulating functions.
[0006]
Therefore, it is an object of the present invention to provide a compatible type tablet that can
continue to use the audio signal collected from the microphone without requiring user
intervention when the mode is changed from the PC use mode to the tablet use mode. To provide
a computer. A further object of the present invention is to provide a method and computer
program for controlling an audio signal in such a tablet computer.
[0007]
The compatible tablet computer according to the present invention comprises a plurality of
microphones constituting a microphone array. The tablet computer can operate in a speech
enhancement mode for emphasizing and processing an audio signal collected from a plurality of
microphones and a non-processing mode for processing without forming an emphasis space.
When the tablet computer is operated in the enhanced mode in the PC use mode, the direction
and range of the directional axis of the enhanced space so that the user's mouth assumed in the
PC use mode does not enter the enhanced space and does not receive unnecessary noise. The
size of the corner is set optimally. When the user operates the display housing of the tablet
computer to change the setting from the PC use mode to the tablet use mode, the tablet
computer detects it.
[0008]
If the user's mouth may not enter the highlighting space in the tablet use mode, the tablet
computer can not utilize the audio signal collected by the microphone. When the tablet computer
detects a change in usage mode, it processes and operates the enhanced space so that the audio
signal collected by the microphone can be used in the tablet usage mode. As a result, even if the
mode of use is changed, the tablet computer can continue to use the collected audio from the
microphone without the need for user intervention.
04-05-2019
3
[0009]
In one method of operating the emphasis space to operate in a tablet usage mode to enable the
use of audio signals, the tablet computer transitions from the speech emphasis mode to the nonprocessing mode to eliminate the emphasis space. As a result, since the tablet computer does not
perform emphasizing processing, it is possible to use the sound collected from the direction
according to the performance of the microphone. The sound also includes noise, but it is more
convenient than in a situation where the user's mouth enters the suppression space and no voice
signal is available at all. Also, when the tablet use mode is changed to the PC use mode, the tablet
computer detects it and shifts from the non-processing mode to the voice enhancement mode.
Then, the user's mouth enters the emphasis space, and the tablet computer can use the audio
signal in which the noise is suppressed and the target sound is emphasized.
[0010]
In another method of processing the enhanced space to operate to enable the use of audio
signals in the tablet usage mode, the tablet computer maintains the audio enhancement mode
even in the tablet usage mode. However, after the tablet computer is changed to the tablet use
mode, the pointing axis and / or the directional range angle of the emphasis space is set to a
value different from the value in the PC use mode. As a result, the user's mouth comes into the
emphasis space, and the tablet computer can continue using the audio signal. In the tablet use
mode, the user is usually located on the lower side of the display screen, so that by detecting the
direction of the display screen, the pointing axis may be directed to the user's mouth so that the
user's mouth enters the emphasis space it can.
[0011]
The tablet computer changes the relationship between the position of the user's mouth and the
pointing axis according to the tilt angle of the housing. Therefore, the tilt angle of the tablet
computer may be detected, and the direction of the directional axis may be changed according to
the tilt angle so that the user's mouth enters the emphasis space. When the user holds the tablet
computer and uses it in the tablet use mode, the tablet computer may shake. When the housing
of the tablet computer shakes, the pointing axis and the position of the user's mouth change in
response to the shake. In this case, by making the size of the pointing range angle of the
04-05-2019
4
emphasis space larger than the value in the PC use mode, the user's mouth can be made to enter
the emphasis space even if it is shaking.
[0012]
The present invention provides a compatible tablet computer that can continue to use the audio
signal collected from the microphone without requiring user intervention when the mode is
changed from the PC use mode to the tablet use mode. We were able to. Furthermore, according
to the present invention, it has been possible to provide a method and computer program for
controlling an audio signal in such a tablet computer.
[0013]
[Configuration of Tablet PC] Hereinafter, preferred embodiments of the present invention will be
described with reference to the drawings. FIG. 1 is a perspective view showing the appearance of
a tablet PC 10 according to an embodiment of the present invention. The tablet PC 10 is a
convertible type, and includes a system housing 11 and a display housing 13 which are both
substantially rectangular. The system housing 11 includes an input unit 15 having a keyboard
and a pointing device, and the display housing 13 has an input that enables a screen display and
an input by a touch pen by overlapping a touch panel input unit on a liquid crystal display (LCD)
A display panel 17 is provided.
[0014]
Furthermore, the system housing 11 and the display housing 13 are connected by a connecting
portion 21 at the center of each end. The connecting portion 21 rotatably supports the housings
in the directions to open and close each other. Furthermore, in a state where the display housing
13 is opened from the system housing 11, the display housing 13 can be rotated at least 180
degrees around the coupling portion 21. In the PC use mode shown in FIG. 1A, the tablet PC 10
can be used by operating the input unit 15 including a keyboard and a mouse as in a normal
notebook PC. Further, the display housing 13 is rotated as shown in FIG. 1B, and the display
housing 13 is folded so as to overlap the system housing 11 as shown in FIG. Turns to the front,
the tablet use mode shown in FIG. 1 (D) is obtained. In the tablet use mode, the tablet PC 10 can
be used by instructing the input display panel 17 with a touch pen or a finger.
04-05-2019
5
[0015]
The display housing 13 includes four edges 12 a, 12 b, 12 c and 12 d at the periphery of the
input display panel 17. The display direction rotation button 23 is provided on the edge 12a.
Every time the user presses the display direction rotation button 23, the direction of the screen
displayed on the input display panel 17 is rotated by 90 degrees in a predetermined direction.
The direction of rotation may be set clockwise, counterclockwise, or any selected direction.
Furthermore, when rotating 180 degrees, you may make it rotate 180 degrees at once, without
rotating 90 degrees at a time.
[0016]
The edge 12a is further provided with two nondirectional microphones 19a and 19b. The
microphones 19a, 19b constitute a microphone array for forming a sound enhancement space on
the front surface of the display housing 13 by the technique of beam forming. In this
embodiment, although the number of microphones is two, the microphone array may be
configured by three or more microphones.
[0017]
[Hardware Configuration] FIG. 2 is a block diagram showing a schematic configuration of
hardware of the tablet PC 10. As shown in FIG. The CPU 51 is an arithmetic processing unit
having a central function of the tablet PC 10, and executes an OS, a BIOS, a device driver, an
application program, and the like. The CPU 51 controls each device connected via various buses
to a chip set configured around the north bridge 55 and the south bridge 61. The north bridge
55 is configured to include a memory controller function to control an access operation to the
main memory 53 and a data buffer function to absorb a difference in data transfer speed
between buses. There is.
[0018]
The main memory 53 is a volatile RAM used as a read area of a program executed by the CPU 51
and a work area to which processing data is written. The video controller 57 has a video chip and
04-05-2019
6
a VRAM (not shown), receives a drawing command from the CPU 51, generates an image to be
drawn, writes it to the VRAM, and draws an image read from the VRAM. It sends to the display
17b as data. At the same time, in response to the operation of the display direction rotation
button 23, the video controller 57 can execute a function of rotating the direction of the screen
displayed on the display 17b counterclockwise by 90 degrees.
[0019]
A south bridge 61 is connected to the north bridge 55. The south bridge 61 has a function as a
bridge between the north bridge 55 and the LPC bus 65. The south bridge 61 also includes
functions as a serial ATA interface and a USB interface (not shown), and is connected to a hard
disk drive (HDD) 63 through the serial ATA interface and to the audio controller 59 through the
USB interface. Connected The HDD 63 stores programs necessary for the tablet PC 10 to execute
the present invention. The program may be stored in a non-volatile memory other than the HDD
63.
[0020]
Microphones 19a and 19b are connected to the audio controller 59. An embedded controller (EC)
67, a button controller 71 and an I / O controller 73 are connected to the LPC bus 65. The EC67
is a microcomputer consisting of 8 to 16 bits of CPU, ROM, RAM, etc., and is equipped with
multiple channels of A / D input terminals, D / A output terminals, timers, and digital input /
output terminals. There is. The EC 67 can execute a program related to management of the
operating environment of the tabled PC 10 independently of the CPU 51. An acceleration sensor
69 and a mode switch 25 are connected to the EC 67.
[0021]
The acceleration sensor 69 measures the acceleration externally applied to the tablet PC 10, and
outputs the corresponding analog voltage to the A / D input terminal of the EC 67. The EC 67 A /
D converts the voltage input from the acceleration sensor 69 to obtain an acceleration value. The
obtained acceleration value is stored in the RAM of the EC 67 and periodically read by the CPU
51 that executes an application program requiring the acceleration value. The mode switch 25
detects that the tablet PC 10 is completely set to the tablet use mode as shown in FIG. 1D,
generates a tablet signal, and changes from the full tablet use mode to the PC use mode. When
04-05-2019
7
detected, a PC signal is generated and notified to the EC 67. When the EC 67 receives a tablet
signal or a PC signal from the mode switch 25, the EC 67 interrupts the CPU 51 to notify a
control program to be described later.
[0022]
A display direction rotation button 23 is connected to the button controller 71. The button
controller 71 detects an input from the display direction rotation button 23 and notifies the
video controller 57. The video controller 57 changes the direction of the display screen displayed
on the display 17b based on the notification. The I / O controller 73 is connected to the input
unit 15 used in the PC use mode and the touch panel input unit 17 a used in the tablet use mode.
The touch panel input unit 17a and the display 17b constitute the input display panel 17 of FIG.
[0023]
Note that FIGS. 1 and 2 merely illustrate the simplified configuration and connection of main
hardware related to the present embodiment in order to explain the present embodiment. Many
devices are used to configure the tablet PC 10 other than those mentioned above. However, they
are well known to those skilled in the art and will not be mentioned in detail here. Those skilled
in the art can arbitrarily select a plurality of blocks described in the drawings as one integrated
circuit or device, or conversely, divide one block into a plurality of integrated circuits or devices.
Within the scope of the present invention, Further, types of buses and interfaces connecting
between respective devices are merely examples, and other connections are included in the scope
of the present invention as long as those skilled in the art can arbitrarily select. Be
[0024]
[Software Configuration] FIG. 3 is a schematic block diagram showing a software configuration
related to the present embodiment. The software shown in FIG. 3 is stored in the HDD 63 and is
read into the main memory 53 when the CPU 51 executes it. The control program 101, the voice
processing program 103, and the voice using program 105 run on the OS 107, exchange data
with other programs through the API of the OS 107, control hardware, and perform tasks
intended by the user. Is a program that The control program 101 controls the voice processing
program 103 so that the voice use program 105 can use voice data in either the PC use mode or
the tablet use mode according to the PC signal or the tablet signal received from the mode switch
04-05-2019
8
25. . The control method will be described later.
[0025]
The control program 101 periodically receives an acceleration value detected by the acceleration
sensor 69 from the EC 67, and calculates and holds an inclination angle at which the system
housing 11 is inclined from the horizontal state in the tablet use mode. The tilt angles are
respectively calculated for two axial directions intersecting at right angles on the plane of the
input display panel 17. The control program 101 determines whether or not the system housing
11 is rocking from the magnitude of the inclination angle which changes with time. The control
program 101 receives, through the video driver 111, information on the direction of the current
display screen displayed on the display 17b.
[0026]
The speech processing program 103 is a program for emphasizing a target sound using a
microphone array technology and suppressing non-target sound which is directional noise. The
audio processing program 103 receives the audio signals collected by the microphones 19a and
19b from the audio driver 113, and the received audio signal has a magnitude between both
signals due to the distance between the microphones 19a and 19b and the direction of the sound
source. By performing arithmetic processing based on the phase difference, an emphasis space
and a suppression space of the audio signal are formed in front of the microphones 19a and 19b.
The speech processing technology by the speech processing program 103 is called beam
forming.
[0027]
Various techniques such as delay and sum, subtractive beamforming, adaptive beamforming, and
Griffiths-Jim beamforming are introduced to beamforming using microphone array technology,
but the present invention There is no need to limit them in particular. In addition, an audio
controller incorporating the arithmetic function of the speech processing program 103 may be
employed to perform processing at the hardware level in order to form an emphasis space and a
suppression space on the front surface of the display housing 13. Furthermore, other known
speech enhancement techniques different from beamforming for forming the emphasis space
and the suppression space to separate the target sound and the directional noise may be
04-05-2019
9
employed.
[0028]
The voice processing program 103 has an interface to the control program 101 operating in the
application layer and the voice utilization program 105. The voice utilization program 105 is a
program for performing work such as chat, IP phone, or text input to perform a character-based
conversation in real time through a computer network using the voice signal of the user collected
by the microphones 19a and 19b. The voice using program 105 receives voice data that has
been subjected to emphasis processing from the voice processing program 103 when the voice
processing program 103 is being executed, and when the voice processing program 103 is not
being executed, the nondirectional microphone 19a. , 19b receive from the audio driver 113
audio data generated by the audio controller 59 from the collected audio signal.
[0029]
The button driver 109 controls the button controller 71 to transfer a signal of an operation
button such as the display direction rotation button 23 to the OS 107. The video driver 111
controls the video controller 57 to process an image signal to be displayed on the display 17b.
When the video driver 111 receives an event to change the display direction of the screen of the
display 17b from the OS 107, the video driver 111 controls the video controller 57 to change the
display direction.
[0030]
When the video driver 111 changes the orientation of the display screen, the OS 107 notifies the
control program 101 that the screen setting has been changed. In response to this, the control
program 101 inquires the setting information of the screen to the OS 107, and obtains
information on the display method of the new screen. The audio driver 113 controls the audio
controller 59 based on an instruction from the control program 101 to transfer an audio signal
converted into digital data to the audio processing program 103 or the audio use program 105.
The intermediate driver 115 is a program for the control program 101 to communicate with the
EC 67.
04-05-2019
10
[0031]
[Enhanced Space] FIG. 4 is a view for explaining the appearance of the enhanced space formed
on the front surface of the display housing 13 by the audio processing program 103. As shown
in FIG. 4A is a perspective view, and FIG. 4B is a plan view of the display housing 13 opened
vertically to the system housing 11 as viewed from above. The emphasizing space 200 is a space
for emphasizing the sound from the sound source existing around the display case 13 by
performing arithmetic processing on the sound data corresponding to the sound signals collected
by the microphones 19a and 19b by the sound processing program 103. It is defined.
[0032]
In the vicinity of the display housing 13, the emphasis space 200 spreads like a fan from the
plane of the display housing 13 in the left-right direction and extends in a cylindrical shape in
the top-bottom direction. In other words, the cylinder is cut in two planes parallel to the central
axis and forming a predetermined angle with the central axis. A central axis 201 of the emphasis
space 200 (hereinafter referred to as a directional axis. ) Is a plane perpendicular to the surface
of the display housing 13 and equally divides the emphasis space 200 left and right. The
directivity range angle θ indicating the expansion of the emphasizing space 200 in the left-right
direction is set to 60 degrees when the tablet PC 10 is in the PC use mode, and the directivity
axis 201 is set to a direction perpendicular to the surface of the display housing 13. The surface
of the display housing 13 substantially corresponds to the surface of the input display panel 17.
[0033]
The distance (length of the radius of the sector) and the range in the height direction from the
display housing 13 of the emphasis space 200 depend on the capabilities of the microphones
19a, 19b and the audio controller 59. In the space around the tablet PC 10, a space other than
the emphasis space 200 such as the positions 203 and 205 is defined as a suppression space.
The sound signal from the sound source present in the suppression space is processed by the
speech processing program 103 so as to be suppressed or canceled. When the user uses the
tablet PC 10 in the PC usage mode, it is usual to face the front of the display housing 13 and talk
to the microphones 19a and 19b, so the user's mouth serving as a sound source exists in the
emphasis space 200. . As a result, the user's voice is emphasized and the noise from the sound
source present in the suppression space is suppressed.
04-05-2019
11
[0034]
The direction of the pointing axis of the emphasis space and the size of the pointing range angle
θ ensure that the user's mouth enters the emphasis space in the PC use mode, and the emphasis
space becomes larger than necessary and noise is mixed It is set as an optimal value that does
not happen. However, when the tablet PC 10 is used in the tablet use mode, problems occur in
the configuration of the enhanced space 200 shown in FIG. When the user uses the tablet PC 10
in the tablet use mode, after folding the display housing 13 as shown in FIG. 1D, the system
housing 11 is held by one hand and the touch pen is operated by the other hand. . At this time,
the user's body is usually located on the side of the edge 12 b or 12 d.
[0035]
In this case, as is apparent from FIG. 4A, the mouth of the user enters the suppression space.
When the user who has spoken in the suppression space speaks toward the microphones 19a
and 19b, it is difficult for the voice data to be transmitted to the voice use program 105, and the
user may recognize that the voice system has failed. At this time, the user can operate the
window screen for the user interface of the speech processing program 103 to stop the
execution of the speech processing program 103.
[0036]
The audio driver 113 is configured to transfer voice data from the audio driver 113 directly to
the voice utilization program 105 when the voice processing program 103 stops executing. This
corresponds to the disappearance of both the emphasis space 200 and the suppression space.
Then, the voice using program 105 can use voice data not subjected to emphasis processing. In
this specification, a state in which the voice processing program 103 is executed and voice data
subjected to emphasis processing is used by the voice use program 105 is referred to as a voice
emphasis mode, and the execution of the voice processing program 103 is stopped. A state in
which the use program 105 uses voice data not subjected to emphasis processing is referred to
as a non-processing mode.
[0037]
04-05-2019
12
In the present invention, when the tablet PC 10 is changed to the tablet use mode while
operating in the PC use mode and in the voice enhancement mode, the voice use program 105 is
continuously transmitted without the user's operation. Can be supplied to continue using the
voice. The first method for realizing this is to detect the change to the tablet use mode, and
automatically change the operation mode from the voice enhancement mode to the nonprocessing mode. In the second method, the user is prevented from entering the suppression
space by changing the direction of the directional axis and / or the size of the directional range
angle while maintaining the speech enhancement mode. In either method, change processing is
added to the generated emphasis space in the PC use mode.
[0038]
First Embodiment FIG. 5 is a flowchart showing a procedure for shifting from the voice emphasis
mode to the non-processing mode when the tablet PC 10 is changed from the PC use mode to the
tablet use mode. In block 301, the display housing 13 of the tablet PC 10 is set to a PC use mode
as shown in FIG. 1 (A). Since the EC 67 has already sent a PC signal to the control program 10,
the control program 101 recognizes that the tablet PC 10 is currently set to the PC use mode.
The speech processing program 103 and the speech utilization program 105 are read out to the
main memory 53 in advance.
[0039]
In block 303, the control program 101 recognizing that the PC use mode is set causes the speech
processing program 103 to be executed. The voice processing program 103 forms an
emphasizing space 200 in which the directional axis angle 201 shown in FIG. 4 is perpendicular
to the surface of the display housing 13 and the directional range angle θ is 60 degrees. Then,
when the voice utilization program 105 is executed by the user, the voice data collected by the
microphones 19 a and 19 b is enhanced through the audio driver 113 and the voice processing
program 103 and supplied to the voice utilization program 105. Ru.
[0040]
In block 305, the control program 101 determines whether the user has changed the tablet PC
10 to the tablet use mode shown in FIG. 1D based on the tablet signal from the EC 67. In block
04-05-2019
13
307, when the control program 101 receives a tablet signal from the EC 67, the execution of the
speech processing program 103 is stopped. In block 307, when the control program 101 notifies
the audio driver 113 that the audio processing program 103 has been stopped, the audio driver
113 transfers the audio data directly to the audio use program 105 thereafter. The OS 107
monitors the execution state of the audio processing program 103 without directly interposing
the control program 101 in the method of directly transferring audio data from the audio driver
113 to the audio use program 105, and the audio data from the audio driver 113 is monitored.
The transfer destination may be controlled. Then, in block 309, the tablet PC 10 operates in the
non-processing mode.
[0041]
In the non-processing mode, since the emphasizing space and the suppressing space are not
formed, the emphasizing process of emphasizing the target sound from the noise is not
performed on the audio signals collected by the omnidirectional microphones 19a and 19b. Since
the speech does not enter the suppression space, the speech utilization program 105 can
continue the utilization of speech data. In block 311, the control program 101 determines
whether the user has changed the tablet PC 10 to the PC use mode shown in FIG. 1A based on
the PC signal from the EC 67. When receiving the PC signal from the EC 67, the control program
101 shifts to a block 303 to execute the voice processing program 103 so as to correspond to
the PC use mode. According to this procedure, the user is relieved of the complexity of operating
the window screen for the user interface.
[0042]
Second Embodiment FIG. 6 shows the orientation of the directional axis 201 and the size of the
directional range angle θ while maintaining the voice emphasis mode when the tablet PC 10 is
changed from the PC use mode to the tablet use mode. Or it is a flowchart which shows the
procedure which changes either one. FIG. 7 is a diagram showing how the orientation of the
pointing axis 201 or the magnitude of the pointing range angle θ is changed. In FIG. 7, the user
501 is located on the side of the edge 12 b or 12 d of the display housing 13 in any case.
Further, in FIGS. 7A to 7C, the directivity range angle θ is described narrowly to make the
description easy to understand, but the actual directivity range angle θ is 60 degrees adopted in
the PC use mode. is there.
[0043]
04-05-2019
14
Since the blocks 401 to 401 in FIG. 6 are the same as the steps from the blocks 301 to 305 in
FIG. At block 407, the control program 101 having received the tablet signal from the EC 67
recognizes the relationship between the vertical direction and the edge of the screen currently
displayed on the input display panel 17. Data on the vertical direction of the screen is transferred
from the video driver 111 to the control program 101 each time the screen direction is changed.
The control program 101 determines on the premise that the user 501 exists at the lower side of
the screen.
[0044]
When the control program 101 recognizes in block 409 that the upper side of the screen is
located on the edge 12 b or 12 d, it determines that it is necessary to change the direction of the
directional axis 203 of the emphasis space 200 and shifts to block 411. When the control
program 101 determines that the upper side of the screen is positioned on the edge 12a or 12c,
the direction of the directional axis 203 and the directional range angle θ (60 degrees) in the PC
use mode are determined without changing the direction of the directional axis 203. maintain. As
shown in FIG. 4A, when the user is positioned on either side of the edge 12a or the edge 12c, the
user's mouth is in the emphasis space 200 in the PC use mode, so the voice utilization program
105 is used. Are supplied with emphasized voice data.
[0045]
In the tablet use mode, the user often holds and uses the system housing 11 while slightly tilting
it with one hand. As shown in FIG. 7A, based on a standard angle at which the control program
101 instructs the voice processing program 103 in block 411 to tilt the system case 11 when the
user holds the system case 11. The pointing axis of the emphasis space 200 a is changed to face
the user's face. The sound processing program 103 inclines the lower side of the screen to a
predetermined angle so that the angle α of the directional axis 201 with respect to the surface
of the display panel 13 is smaller than 90 degrees. The pointing range angle of the emphasis
spaces 200a to 200c is 60 degrees. By orienting the direction of the directional axis 201 in the
direction assumed to be the user based on the direction of the display screen in this manner, the
user's mouth will not enter the suppression space, and the voice processing program 103 can
The supply of voice data to can be continued.
04-05-2019
15
[0046]
At block 413, the control program 101 determines based on the PC signal from the EC 67
whether the user has changed the tablet PC 10 to the PC use mode shown in FIG. 1 (A). When
receiving the PC signal from the EC 67, the control program 101 shifts to a block 403 to execute
the voice processing program 103 so as to correspond to the PC use mode.
[0047]
At block 413, if the control program 101 recognizes that the tablet use mode is continuing, it
proceeds to blocks 415, 419 or 421. The control program 101 periodically receives acceleration
information on the system housing 11 from the EC 67, and recognizes an inclination angle with
respect to the posture or horizontal position of the system housing 11 at that time. In block 415,
from the standard inclination angle of the system housing 11 when the direction of the
directional axis 201 is changed in block 411, the control program determines whether the
system housing 11 is inclined in the direction of the edge 12b or in the direction of the edge 12c.
101 makes a decision.
[0048]
For example, when the user places the tablet PC 10 on the horizontal desk surface as shown in
FIG. 7B, the user's mouth may enter the suppression space in the direction of the directional axis
201 set in block 411. Further, when the user further tilts the tablet PC 10 as shown in FIG. 7C,
the user's mouth may enter the suppression space unless the direction of the directional axis 201
is changed again. When the control program 101 determines that the system housing 11 is
inclined at a predetermined angle or more in block 415, the control program 101 shifts to the
block 417 and instructs the voice processing program 103, and the pointing axis 201 makes an
angle with the surface of the display housing 13. After changing α by an angle according to the
inclination angle, the process proceeds to block 413.
[0049]
The direction in which the pointing axis 201 is changed is the direction of the arrow B opposite
to the tilting direction of the system housing 11 indicated by the arrow A. When the display
04-05-2019
16
housing 13 is in a state close to vertical, the angle α becomes larger than the value set in block
411. If the control program 101 determines in block 415 that the system housing 11 is not tilted
by a predetermined angle or more, the process proceeds to block 413. In block 419, when the
display direction rotation button 23 is operated, the video driver 111 interrupts the CPU 51 and
transmits information on the vertical direction of the current display screen to the control
program 101 and shifts to a block 407. At block 407, when the vertical direction of the screen
changes so as to be positioned in the direction of the edge 12b or 12d, the direction of the
directional axis is changed at block 409.
[0050]
In block 421, it is determined whether the system case 11 is shaking based on the acceleration
information periodically observed by the control program 101. When the control program 101
determines that the system housing 11 is swinging in the direction of the arrow C as shown in
FIG. 7D, the control program 101 proceeds to block 423 so as to make the directivity range
angle θ larger than 60 degrees. The voice processing program 103 is instructed to make the
user's mouth enter the emphasis space even if the system case 11 shakes. If the control program
101 determines in the block 421 that the system casing 11 does not shake, if the pointing range
angle θ has spread to 60 degrees or more up to that point, it is returned to 60 degrees, and the
process moves to the block 413.
[0051]
Although the present invention has been described above with reference to the specific
embodiments shown in the drawings, the present invention is not limited to the embodiments
shown in the drawings, and the present invention is not limited as far as the effects of the
present invention can be obtained. It goes without saying that any configuration can be adopted.
[0052]
It is a perspective view which shows the external appearance of the tablet PC concerning
embodiment of this invention.
It is a block diagram which shows schematic structure of the hardware of the tablet PC
concerning this Embodiment. It is a block diagram which shows the structure of the software
relevant to this Embodiment. It is a figure explaining the mode of the emphasis space formed in
04-05-2019
17
the front of a display case by a voice processing program. When a tablet PC is changed into PC
use mode from PC use mode, it is a flowchart which shows the procedure which transfers to
voice un-processing mode from audio | voice emphasis mode. When a tablet PC is changed from
PC use mode to tablet use mode, it is a flowchart which shows the procedure which changes
direction of the direction of a directional axis, and / or the size of a directional range angle,
maintaining voice emphasis mode. . It is a figure which shows a mode when changing the
magnitude | size of direction or directional range angle of a directional axis.
Explanation of sign
[0053]
DESCRIPTION OF SYMBOLS 10 ... Tablet PC 11 ... System housing 12a, 12b, 12c, 12d ... Edge 13
... Display housing 17 ... Input display panel 17a ... Touch-panel input part 17b ... Display 23 ...
Display direction rotation button 200, 200a, 200b, 200c, 200 d: Emphasized space 201: pointing
axis θ: pointing range angle 203, 205: suppression space
04-05-2019
18
Документ
Категория
Без категории
Просмотров
0
Размер файла
33 Кб
Теги
jp2010072695
1/--страниц
Пожаловаться на содержимое документа