close

Вход

Забыли?

вход по аккаунту

?

DESCRIPTION JP2012249252

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2012249252
A portable terminal device, an audio output control method, and an audio output control
program are provided that can easily use a speaker that emits air conducted sound and an
oscillator that vibrates a human body and transmits audio in a state suitable for a use
environment. . A mobile terminal device includes a control unit controlling an output of voice, a
speaker which is controlled by the control unit to emit air-conducted sound, and a vibrator which
is controlled by the control unit and vibrates. The contact portion 123, which is disposed in the
vicinity of the speaker 122 and receives the vibration of the vibrator 123a to be vibrated and
brought into contact with the human body, transmits the vibration to the human body, and it is
difficult to hear the voice. And a control change unit 152 that changes the content of the audio
output control by the control unit 150 according to the determination of the determination unit
151. [Selected figure] Figure 4
PORTABLE TERMINAL DEVICE, AUDIO OUTPUT CONTROL METHOD, AND AUDIO OUTPUT
CONTROL PROGRAM
[0001]
The present invention relates to a portable terminal device having a speaker that emits airconducted sound and a vibrator that transmits sound by transmitting vibration to a human body,
a sound output control method, and a sound output control program.
[0002]
A mobile terminal device such as a mobile phone terminal is provided with a speaker that
11-04-2019
1
generates received sound as air conduction sound.
The sound from this speaker sounds clear when used in a quiet environment, but sometimes it is
difficult to hear in noisy environments.
[0003]
On the other hand, portable terminal devices that transmit voice using a method called bone
conduction have already been put to practical use. In bone conduction, the vibrator is vibrated to
transmit vibration mainly to the skull of the human body, and the vibration of the skull is directly
transmitted to the cochlea to transmit voice to the auditory nerve. Therefore, even in a noisy
environment, easy-to-hear voice transmission can be realized.
[0004]
However, bone conduction is poor in sound quality as compared with a speaker that emits
normal air conduction sound, and many people feel uncomfortable. Thus, under normal
circumstances, it is often desirable to use a common speaker.
[0005]
Patent Document 1 discloses a hybrid listening apparatus combining an air conduction receiver
and a bone conduction receiver. In the technique of Patent Document 1, the volume control of
the air conduction receiver and the bone conduction receiver is performed by operating the
variable resistor.
[0006]
Further, Patent Document 2 discloses a bone conduction receiving device having a leaf spring as
a pressure adjusting means for adjusting the pressure at which the vibrating surface of the
vibrator and the tragus come in contact, and an adjusting screw for adjusting the biasing force of
the leaf spring. Is disclosed. In the technique of this patent document 2, the pressure is adjusted
11-04-2019
2
by manual operation to change the transmission ratio of the voice information via the cartilage
conduction and the voice information via the air conduction.
[0007]
JP, 2001-245384, A Patent 4541111
[0008]
However, in the method of Patent Document 1, it is necessary for the user to operate the variable
resistor, the operation is complicated, it is difficult to adjust to the setting suitable for the use
situation, and the convenience is not good.
In addition, when performing an adjustment operation during a call, if the operation is performed
by mistake, there is a possibility that the setting may be difficult to hear the voice, and there is
also a possibility that the user may miss the content of the call.
[0009]
Further, in the method of Patent Document 2, the vibration itself of the vibrating body is not
changed, and when a higher sound volume is required in a high level noise environment or the
like, the sound volume is insufficient and the voice can not be clearly transmitted. There was a
fear. Furthermore, in the method of Patent Document 2, there is a possibility that the user may
feel discomfort because an unnatural way of closing the tragus part by pressing the tragus part
to the external ear canal with the projection part is performed.
[0010]
An object of the present invention is to provide a portable terminal device, a voice output control
method, and a voice output control program, which can easily use a speaker that emits air
conducted sound and a vibrator that vibrates a human body and transmits voice in a state
suitable for use environment. To provide.
[0011]
11-04-2019
3
The present invention proposes the following matters in order to solve the above-mentioned
problems.
In addition, in order to make an understanding easy, although the code | symbol corresponding
to embodiment of this invention is attached and demonstrated, it is not limited to this.
[0012]
(1) In the present invention, a control unit (150, 250, 350) for controlling an output of voice, a
vibrator (123a) controlled to vibrate by the control unit, and vibration of the vibrator are
transmitted to vibrate Contact portion (123) for transmitting vibration to the human body by
being brought into contact with the human body, a judgment portion (151, 251, 351) for judging
whether or not it is difficult to hear voice, and the judgment portion And a control change unit
(152, 252, 352) for changing the content of the audio output control by the control unit
according to the determination of the above.
[0013]
According to the present invention, the control unit controls the output of voice.
The vibrator is controlled by the control unit to vibrate. The contact portion transmits the
vibration of the vibrator to the human body by being vibrated and brought into contact with the
human body. The determination unit determines whether or not it is difficult to hear the voice.
The control change unit changes the content of the audio output control by the control unit
according to the determination of the determination unit. Therefore, the portable terminal device
can easily use the speaker that emits air-conduction sound and the vibrator that vibrates the
human body to transmit the sound in a state suitable for the use environment. In addition, since
the content of output control is automatically changed, it is possible to prevent missed calls and
the like.
[0014]
(2) The present invention provides the portable terminal device according to (1), further
including a pressure detection unit (125, 332) for detecting that the contact portion (123) is
pressed against a human body, the determination The portable terminal device (100, 300) is
characterized in that the unit (150, 350) determines whether or not it is difficult to hear the
11-04-2019
4
voice using the detection result of the press detection unit. .
[0015]
According to the present invention, the press detection unit detects that the contact unit is
pressed against the human body.
The determination unit uses the detection result of the press detection unit to determine whether
it is difficult to hear the voice. Therefore, the mobile terminal device can determine whether or
not it is difficult to hear the voice with a simple configuration. In addition, with regard to noise
that changes at any time, it is possible to immediately adjust to an output that is easy to hear
only by the operation of adjusting the degree of pressing.
[0016]
(3) According to the present invention, in the portable terminal device according to (2), a speaker
(122) which is controlled by the control unit (150, 350) to emit air-conducted sound is provided
in the vicinity of the contact unit (123). The pressure detection unit (125, 332) can obtain a
detection result corresponding to a force with which the speaker and / or the contact unit is
pressed against the human body, and the control change unit (152, 352) Changing the drive of
the vibrator (123a) between ON and OFF in response to the force of the speaker and / or the
contact portion acquired by the pressure detection unit being pressed against the human body
And a mobile terminal device (100, 300) characterized by
[0017]
According to the present invention, the speaker is provided in the vicinity of the contact portion,
and is controlled by the control portion to emit air conduction sound.
The pressure detection unit can obtain a detection result corresponding to the force with which
the speaker and / or the contact portion is pressed against the human body. The control
changing unit changes the drive of the vibrator between ON and OFF in accordance with the
force with which the speaker and / or the contact unit acquired by the pressing detection unit is
pressed against the human body. Therefore, the portable terminal device can automatically use
the vibrator when the user presses the speaker or the contact portion against the ear or the like
11-04-2019
5
with a predetermined force or more.
[0018]
(4) In the portable terminal device according to (2) or (3), the control changing unit (152, 352)
may include the contact unit (123) acquired by the pressing detection unit (125, 332). The
mobile terminal device (100, 300) is characterized in that the vibration amplitude is changed
according to the force that is pressed against the human body.
[0019]
According to the present invention, the control changing unit changes the vibration amplitude in
accordance with the force with which the contact unit acquired by the pressing detection unit is
pressed against the human body.
Therefore, the larger the force with which the user presses the speaker or the contact portion
against the ear or the like, the larger the amplitude of the vibrator, and the easier the user can
listen to the portable terminal device.
[0020]
(5) In the portable terminal device according to (3), in the portable terminal device according to
(3), in the control change unit (152), the contact unit acquired by the press detection unit (125,
332) is pressed against a human body. The portable terminal device (100, 300) is characterized
in that the volume of the speaker (122) is changed according to the force.
[0021]
According to the present invention, the control changing unit changes the sound volume of the
speaker in response to the force with which the contact unit acquired by the pressing detection
unit is pressed against the human body.
Therefore, the mobile terminal device can increase the sound volume of the speaker and make it
easier to hear as the force with which the user presses the speaker or the contact portion against
the ear increases.
11-04-2019
6
[0022]
(6) In the portable terminal device according to any one of (2) to (5), the pressure detection unit
(125) detects a pressure acting on any position of the housing. The portable terminal device
(100) is characterized by detecting that the contact portion (123) is pressed against the human
body by doing.
[0023]
According to this invention, the pressure detection unit detects that the contact portion is
pressed against the human body by detecting the pressure acting on any position of the housing.
Therefore, the pressure detection unit can directly detect the pressure that increases in
accordance with the force with which the contact portion is pressed against the human body, and
can perform simple and highly accurate determination.
[0024]
(7) In the portable terminal device according to any one of (2) to (5), the present invention
provides a shaft (330) and a first rotatable relative to the shaft. A housing (110) and a second
housing (120), and the pressure detection unit (332) is configured to set the relative rotation
angle of the first housing and the second housing to the axis The portable terminal device (300)
is characterized by detecting that the contact portion (123) is pressed against a human body by
detecting in the unit.
[0025]
According to the present invention, the first housing and the second housing are relatively
rotatable around the shaft.
The pressure detection unit detects that the contact portion is pressed against the human body
by detecting the relative rotation angle of the first housing and the second housing in the shaft
portion. Therefore, the pressure detection unit can directly detect the rotation angle of the shaft
portion that increases in accordance with the force with which the contact portion is pressed
11-04-2019
7
against the human body, and can perform simple and highly accurate determination.
[0026]
(8) In the portable terminal device according to (7), in the portable terminal device according to
the present invention, in the shaft portion (330), relative to the first case (110) and the second
case (120). A biasing member (340) is provided to bias the rotating position to a predetermined
position, and by applying a predetermined force or more to the first housing and / or the second
housing The first housing and the second housing can rotate relative rotational positions of the
first housing and the second housing beyond the predetermined position against the biasing
force of the biasing member. 332) proposes a portable terminal device (300) characterized by
detecting a rotational angle beyond the predetermined position.
[0027]
According to this aspect of the invention, the shaft portion is provided with the biasing member
that biases the relative rotational position of the first housing and the second housing at the
predetermined position.
The first housing and the second housing are relative to each other against the biasing force of
the biasing member by applying a predetermined or more force to the first housing and / or the
second housing. The rotational position can be rotated beyond the predetermined position. The
press detection unit detects a rotation angle beyond a predetermined position. Therefore, with a
simple configuration, it is possible to detect the rotation angle of the shaft portion that increases
in accordance with the force with which the contact portion is pressed against the human body.
[0028]
(9) In the portable terminal device according to any one of (2) to (5), the pressure detection unit
detects the deflection of the housing (110, 120). The portable terminal device is characterized by
detecting that the contact portion (123) is pressed against a human body.
[0029]
According to the present invention, the pressure detection unit detects that the contact portion is
pressed against the human body by detecting the bending of the housing.
11-04-2019
8
Therefore, the pressure detection unit can detect that the contact portion is pressed against the
human body using distortion (distortion) of the housing that increases in accordance with the
force with which the contact portion is pressed against the human body. Therefore, the present
invention can be easily used even in a terminal of a so-called straight type or a smartphone type.
[0030]
(10) In the portable terminal device according to any one of (2) to (5), the present invention
includes a touch panel for performing an input operation, and the press detection unit is
configured to contact with the touch pressure on the touch panel The portable terminal device is
characterized by detecting that the contact portion is pressed against a human body using at
least one of the area.
[0031]
According to the present invention, the touch panel performs an input operation.
The pressure detection unit detects that the contact portion is pressed against the human body
using at least one of the contact pressure and the contact area on the touch panel. Therefore, if it
is terminals, such as what is called a smart phone provided with a touch panel, the present
invention can be used without adding a sensor etc.
[0032]
(11) In the portable terminal device according to (1), the present invention includes a
microphone unit (112) for acquiring an environmental sound, and the judging unit (251) uses
the environmental sound acquired by the microphone unit. It has been proposed to make a
portable terminal device (200) characterized by determining whether or not it is difficult to hear
voice.
[0033]
According to the present invention, the microphone unit acquires an environmental sound.
11-04-2019
9
The determination unit determines whether the environment sound acquired by the microphone
unit is difficult to hear the voice. Therefore, the portable terminal device can automatically
operate the vibrator in a noise environment regardless of the user's operation.
[0034]
(12) In the portable terminal device according to (11), the microphone unit (112) can obtain a
detection result corresponding to the sound pressure of the environmental sound, and the
control changing unit (252) The portable terminal device (200) is characterized in that the
driving of the vibrator (123a) is changed between ON and OFF in accordance with the sound
pressure of the environmental sound acquired by the microphone unit. ing.
[0035]
According to the present invention, the microphone unit can obtain the detection result
corresponding to the sound pressure of the environmental sound.
The control changing unit changes driving of the vibrator between ON and OFF in accordance
with the sound pressure of the environmental sound acquired by the microphone unit. Therefore,
the portable terminal device can automatically use the vibrator when the sound pressure of the
environmental sound exceeds a predetermined level.
[0036]
(13) In the portable terminal device according to (11) or (12), the control changing unit (252)
corresponds to the sound pressure of the environmental sound acquired by the microphone unit
(112). A mobile terminal (200) is proposed, characterized in that the vibration amplitude is
changed.
[0037]
According to the present invention, the control changing unit changes the vibration amplitude in
accordance with the sound pressure of the environmental sound acquired by the microphone
unit.
11-04-2019
10
Therefore, the larger the sound pressure of the environmental sound, the larger the amplitude of
the vibrator, and the easier the user can hear the portable terminal device.
[0038]
(14) The present invention provides the portable terminal device according to any one of (11) to
(13), including a speaker (122) that is controlled by the control unit (250) to emit air conduction
sound. The mobile terminal device (200), wherein the control changing unit (252) changes the
volume of the speaker (122) in accordance with the sound pressure of the environmental sound
acquired by the microphone unit (112). Is proposed.
[0039]
According to the present invention, the control changing unit changes the volume of the speaker
in accordance with the sound pressure of the environmental sound acquired by the microphone
unit.
Therefore, as the sound pressure of the environmental sound increases, the mobile terminal
device can increase the sound volume of the speaker and make it easier to hear.
[0040]
(15) In the present invention, a controller (150, 250) for controlling the output of voice, a
vibrator (123a) controlled to vibrate by the controller, and vibration of the vibrator are
transmitted and vibrated. A voice output control method of a portable terminal device (100, 200)
including a contact portion (123) for transmitting vibration to the human body by being brought
into contact with the human body, and it is difficult to hear voices or not Audio output control
method in which the control change unit (152, 252) changes the content of audio output control
by the control unit according to the determination of the determination unit (151, 251). Is
proposed.
[0041]
According to the present invention, the control unit controls the output of voice.
11-04-2019
11
The vibrator is controlled by the control unit to vibrate. The contact portion transmits the
vibration of the vibrator to the human body by being vibrated and brought into contact with the
human body. The determination unit determines whether or not it is difficult to hear the voice.
The control change unit changes the content of the audio output control by the control unit
according to the determination of the determination unit. Therefore, the audio output control
method can control the audio output of the portable terminal device so that the speaker that
emits air conduction sound and the vibrator that vibrates the human body and transmits the
audio can be easily used in a state suitable for the use environment. .
[0042]
(16) In the present invention, a controller (150, 250) for controlling the output of voice, a
vibrator (123a) controlled to vibrate by the controller, and vibration of the vibrator are
transmitted and vibrated. An audio output control program of a portable terminal device (100,
200) comprising a contact part (123) for transmitting vibration to the human body by being
brought into contact with the human body, the computer (150, 250) comprising: Control means
(152, 252) for judging whether or not it is difficult to hear the user, and control changing means
(152, 252) for changing the content of the audio output control by the control unit according to
the judgment of the judgment means. Has proposed a voice output control program to function
as.
[0043]
According to the present invention, the control unit controls the output of voice.
The vibrator is controlled by the control unit to vibrate. The contact portion transmits the
vibration of the vibrator to the human body by being vibrated and brought into contact with the
human body. The determination means determines whether or not it is difficult to hear the voice.
The control changing means changes the content of the audio output control by the control unit
in accordance with the judgment of the judging means. Therefore, the voice output control
program can operate the portable terminal device so that the speaker emitting air conduction
sound and the vibrator for vibrating the human body to transmit the voice can be easily used in a
state suitable for the use environment. it can.
[0044]
According to the present invention, it is possible to achieve an effect that a speaker that emits
11-04-2019
12
air-conducted sound and a vibrator that vibrates a human body and transmits sound can be
easily used in a state suitable for a usage environment.
[0045]
FIG. 1 is a perspective view showing a first embodiment of a mobile terminal device 100 using an
audio output control method and an audio output control program according to the present
invention.
FIG. 2 is a diagram showing the portable terminal device 100 in an open state. It is the figure
shown in the state where the portable terminal device 100 was closed. FIG. 2 is a block diagram
showing a configuration of a portion related to audio output of the mobile terminal device 100. 5
is a flowchart showing a flow of an operation related to audio output of the mobile terminal
device 100. It is a figure which shows the relationship between a pressure value, the sound
volume of a speaker, and the amplitude of a vibrator | oscillator. It is a block diagram which
shows the structure of the part regarding the audio | voice output of the portable terminal device
200 of 2nd Embodiment. It is a flowchart which shows the flow of operation | movement
regarding the audio | voice output of the portable terminal device 200 of 2nd Embodiment. It is a
figure which shows the relationship between the volume of environmental sound, the volume of a
speaker, and the amplitude of a vibrator. It is a figure which shows 3rd Embodiment of the
portable terminal device 300 using the audio | voice output control method and audio | voice
output control program by this invention. It is a block diagram which shows the structure of the
part regarding the audio | voice output of the portable terminal device 300 of 3rd Embodiment.
It is a flowchart which shows the flow of operation | movement regarding the audio | voice
output of the portable terminal device 300 of 3rd Embodiment. It is a figure which shows the
relationship between a rotation angle, the sound volume of a speaker, and the amplitude of a
vibrator | oscillator.
[0046]
Hereinafter, embodiments of the present invention will be described in detail with reference to
the drawings. In addition, the component in this embodiment can be suitably substituted with the
existing component etc., and various variations including combinations with other existing
components are possible. Therefore, the description of the present embodiment does not limit
the contents of the invention described in the claims.
11-04-2019
13
[0047]
First Embodiment FIG. 1 is a perspective view showing a voice output control method according
to the present invention and a first embodiment of a portable terminal device 100 using a voice
output control program. FIG. 2 is a diagram showing the portable terminal device 100 in an open
state. Fig.2 (a) is a front view, FIG.2 (b) is a side view. FIG. 3 is a diagram showing the portable
terminal device 100 in a closed state. Fig.3 (a) is a front view, FIG.3 (b) is a side view.
[0048]
The mobile terminal device 100 according to the present embodiment is a mobile phone terminal
in which the first housing 110 and the second housing 120 can be folded around the shaft 130.
FIG. 1 shows a state in which the first case 110 and the second case 120 are opened, and
hereinafter, when the first case 110 and the second case 120 are folded, they face each other.
The face, i.e. the face seen in FIG. 1 is called the surface. On the other hand, the surface exposed
to the outside when the first housing 110 and the second housing 120 are folded, that is, the
surface hidden in FIG. 1 is called the back surface.
[0049]
Operation keys 111 and a microphone 112 are provided on the surface of the first housing 110.
Further, the first casing 110 is provided with an abutting portion 113 at an end portion on the
side of the shaft portion 130. The operation key 111 is an operation member operated when
inputting numbers and characters, making various selections, and the like. The microphone 112
is a microphone for inputting voice during a call. The contact portion 113 contacts a pressure
sensor portion 125 described later, and regulates the relative open angle of the first housing 110
and the second housing 120 in the open state.
[0050]
On the surface of the second housing 120, a main display 121, a speaker 122, and a contact
portion 123 are provided. In addition, a sub display 124 is provided on the back surface of the
second housing 120. Furthermore, the second housing 120 includes a pressure sensor unit 125
11-04-2019
14
at an end on the shaft unit 130 side.
[0051]
The main display 121 is a display unit that displays various information of the mobile terminal
device 100.
[0052]
The speaker 122 is disposed near the end opposite to the shaft portion 130, and is a speaker that
outputs voice during a call as air conduction sound, and outputs voice as air conduction sound
when playing back a ringtone or music. is there.
Although FIG. 1 shows an example in which a single speaker 122 is used as a speaker during a
call and a speaker used during music reproduction or the like, a speaker may be separately
provided for music reproduction or the like.
[0053]
The contact portion 123 is a portion used to transmit voice using bone conduction, and is
disposed in the vicinity of the speaker 122, and the vibration of a vibrator 123a (see FIG. 4)
described later is transmitted to vibrate Do. The contact portion 123 transmits vibration to the
user's skull or the like by being brought into contact with the user's head or the like. Details of
the part related to bone conduction will be described later.
[0054]
The sub display 124 is a display unit that displays various information in a state in which the
first housing 110 and the second housing 120 are closed. The sub display 124 may be omitted.
[0055]
11-04-2019
15
The pressure sensor unit 125 abuts on the contact portion 113 in a state in which the first
housing 110 and the second housing 120 are opened. Thus, the pressure sensor unit 125
regulates the relative open angle of the first housing 110 and the second housing 120 in the
open state. In addition, the pressure sensor unit 125 is provided with a pressure sensor that
detects a pressure generated by a pressing force received from the contact portion when in
contact with the contact portion 113. As a pressure sensor, for example, a piezoelectric element
or a pressure-sensitive resistor element can be used. When a portion where the speaker 122 and
the contact portion 123 of the first housing 110 are provided is pushed in the direction of arrow
A in FIG. 2B, the contact portion 113 provided on the side of the shaft portion 130 and The
pressing force with the pressure sensor unit 125 is increased. Therefore, the pressure sensor unit
125 also has a function as the speaker 122 and a pressure detection unit that detects that the
contact unit 123 is pressed against the vicinity of the user's ear.
[0056]
FIG. 4 is a block diagram showing the configuration of a portion related to audio output of the
mobile terminal device 100. As shown in FIG. The portable terminal device 100 is provided with
a vibrator 123a, a control unit 150, a vibrator drive circuit 170, and a speaker drive circuit 180
as a configuration relating to audio output, in addition to the above-described configuration.
[0057]
The vibrator 123a is driven by a vibrator drive circuit 170 described later to vibrate according to
the audio signal. Further, the contact portion 123 is integrally provided in the vibrator 123 a,
and the vibration of the vibrator 123 a is transmitted to the contact portion 123 as it is. As the
vibrator 123a, for example, a bimorph vibrator in which piezoelectric elements are stacked can
be used.
[0058]
By vibrating the vibrator 123a, it is possible to transmit the vibration according to the audio
signal to the human body via the contact portion 123. For example, when the vibration is
transmitted to the skull, the skull is vibrated, and the vibration is transmitted to the cochlea
which is an auditory organ through the bone, so that so-called voice transmission by bone
conduction is realized. In addition, even if the vibration of the vibrator is weak and does not
11-04-2019
16
cause the vibration of the skull to vibrate, it is possible to vibrate the human body such as the
pinna near the user's ear in accordance with the audio signal. This vibration can generate an air
conduction sound in the ear canal, and the user can sense the air conduction sound by the
tympanic membrane and recognize it as a sound. Transmission of voice by bone conduction etc.
using vibrator 123a is a situation where it is difficult to hear voice, such as under a high level
noise environment, compared to transmission of voice using speaker 122 that generates air
conduction sound. , Easy to convey voice. However, when the vibrator 123a is used, the sound
quality may be degraded as compared with the case where the speaker 122 is used. In addition,
in the case of using the vibrator 123a, it is always necessary to bring the contact portion 123
into contact with the human body. Therefore, in the mobile terminal device 100 of the present
embodiment, the output is appropriately changed and used in accordance with the situation of
the speaker 122 and the vibrator 123a.
[0059]
The control unit 150 controls the audio output of the mobile terminal device 100. The control
unit 150 can be realized, for example, by executing a program on a CPU and a memory provided
in the mobile terminal device 100. The control unit 150 receives audio information to be output.
The sound output controlled by the control unit 150 may be, for example, the sound of a
telephone received by the mobile terminal device 100 or the sound generated by the mobile
terminal device 100 itself. The control unit 150 also receives a pressure detection value from the
pressure sensor unit 125. Furthermore, the control unit 150 includes a determination unit 151
and a control change unit 152.
[0060]
The determination unit 151 determines whether or not it is difficult to hear the voice.
Specifically, based on the pressure detection value acquired from the pressure sensor unit 125,
the determination unit 151 determines whether it is in a situation where it is difficult to hear
voice. In a situation where it is difficult to hear voice, such as under a high level noise
environment, the user often performs an operation of pressing the speaker 122 against the ear.
When the speaker 122 is pressed against the ear, the speaker approaches and the first case 110
blocks the ear, making it difficult for the environmental sound to reach the tympanic membrane,
making it easier to hear the call sound. Conversely, when the speaker 122 is pressed against the
ear, it is very likely that the user is in a situation where it is difficult to hear the voice. When the
speaker 122 is pressed against the ear, the detected pressure value obtained from the pressure
sensor unit 125 is higher than when not pressed. Therefore, when the detection value of the
11-04-2019
17
pressure obtained from the pressure sensor unit 125 becomes equal to or more than the
predetermined threshold value, the determination unit 151 determines that the user is in a
situation where it is difficult to hear the voice.
[0061]
The control changing unit 152 changes the content of the audio output control by the control
unit 150 according to the determination result of the determining unit 151. Specifically, when
the determination unit 151 determines that it is difficult to hear the sound, the control change
unit 152 starts voice transmission using the vibrator 123a. In that state, the control changing
unit 152 increases or decreases the driving amount of the vibrator 123 a in accordance with the
detected pressure value obtained from the pressure sensor unit 125. That is, when the detected
pressure value obtained from the pressure sensor unit 125 is increased or decreased, the drive
amount of the vibrator 123a is increased or decreased in proportion thereto. Furthermore, when
the control change unit 152 is performing sound transmission using the vibrator 123a, the
operation of the vibrator 123a is performed when the detected pressure value obtained from the
pressure sensor unit 125 becomes smaller than a predetermined threshold. Stop. In addition, the
control changing unit 152 changes the output of the speaker 122 according to the detected
pressure value obtained from the pressure sensor unit 125.
[0062]
The vibrator drive circuit 170 drives the vibrator 123a according to the instruction of the control
unit 150 to vibrate the vibrator 123a in response to the audio signal.
[0063]
The speaker drive circuit 180 drives the speaker 122 according to the instruction of the control
unit 150 to cause the speaker 122 to generate sound corresponding to the audio signal.
[0064]
FIG. 5 is a flowchart showing the flow of the operation relating to the audio output of the mobile
terminal device 100.
FIG. 6 is a diagram showing the relationship between the pressure value and the volume of the
11-04-2019
18
speaker and the amplitude of the vibrator.
In step (hereinafter referred to as S) 100, voice reception or generation is performed. The voice
received or generated in this step is transmitted to the user in the following steps.
[0065]
In S110, the determination unit 151 detects the pressure applied between the pressure sensor
unit 125 and the contact unit 113 using the pressure sensor unit 125.
[0066]
In S120, the determination unit 151 determines whether the detected pressure value is smaller
than a threshold.
If the detected pressure value is smaller than the threshold value, the process proceeds to S130,
and if the detected pressure value is equal to or more than the threshold value, the process
proceeds to S150.
[0067]
In S130, the control changing unit 152 increases or decreases the volume of the speaker 122
according to the pressure value acquired from the pressure sensor unit 125. For example, the
control changing unit 152 instructs the speaker driving circuit 180 to increase or decrease the
volume of the speaker 122 between the initial setting value and the MAX volume according to
the pressure value according to the relationship shown in FIG.
[0068]
In S140, the control changing unit 152 controls the speaker driving circuit 180 to cause the
speaker 122 to generate sound.
[0069]
11-04-2019
19
In S150, the control changing unit 152 increases or decreases the volume of the speaker 122
and the driving amount of the vibrator 123a according to the pressure value acquired from the
pressure sensor unit 125.
For example, the control changing unit 152 instructs the speaker driving circuit 180 to increase
or decrease the volume of the speaker 122 according to the pressure value according to the
relationship shown in FIG. 6, and the transducer 123a according to the pressure value. The
oscillator drive circuit 170 is instructed to increase or decrease the amplitude of
[0070]
In S160, the control changing unit 152 controls the speaker driving circuit 180 to cause the
speaker 122 to generate sound. Further, the control changing unit 152 controls the vibrator
drive circuit 170 to drive the vibrator 123a, and enables voice transmission by bone conduction
and the like using the vibrator 123a.
[0071]
At S170, control unit 150 determines whether or not to continue voice output. This
determination is made based on, for example, whether or not voice input and generation are
continued. If voice output is to be continued, the process returns to S100. When the voice output
is finished, the operation is finished.
[0072]
As described above, according to the first embodiment, the portable terminal device 100 starts
driving the vibrator 123a or drives the vibrator 123a according to the detected pressure value
obtained from the pressure sensor unit 125. Change the amount. Therefore, the user can use
voice transmission using the transducer 123a that is easier to hear when it is a situation where it
is difficult to hear a sound without performing a special operation. In addition, since the amount
of vibration of the vibrator 123a is changed according to the pressure value, the vibrator can be
vibrated by an appropriate amount of vibration according to the difficulty of hearing, and a
vibration state easy for the user to hear is automatically made. It can be set. Furthermore, since
11-04-2019
20
the volume of the speaker 122 is also changed according to the pressure value, an appropriate
volume can be secured according to the difficulty of listening. Furthermore, since the volume of
the speaker 122 and the vibration amount of the vibrator 123a are combined and changed
according to the pressure value, both the speaker 122 and the vibrator 123a can be used without
giving a sense of discomfort to the user. It is. In addition, the portion of the contact portion 123
does not have to have a special shape, and does not give a sense of discomfort to the user.
[0073]
Second Embodiment The mobile terminal device 200 of the second embodiment does not have
the pressure sensor unit 125 in the first embodiment, and the operation of the control unit 250
is different from that of the mobile terminal of the first embodiment. It differs from the terminal
device 100. Therefore, the same code | symbol is attached | subjected to the part which fulfill |
performs the function similar to 1st Embodiment mentioned above, and the overlapping
description is abbreviate | omitted suitably.
[0074]
The portable terminal device 200 of the second embodiment does not have a portion
corresponding to the pressure sensor unit 125 in the first embodiment. Instead of this, the
mobile terminal device 200 is provided with a second contact portion that merely contacts the
contact portion 113.
[0075]
FIG. 7 is a block diagram showing the configuration of a portion related to audio output of the
mobile terminal device 200 of the second embodiment. The mobile terminal device 200 includes
a control unit 250. The control unit 250 controls the audio output of the mobile terminal device
200. The control unit 250 receives audio information to be output. The voice output controlled
by the control unit 250 may be, for example, the voice of the telephone received by the mobile
terminal device 200 or the voice generated by the mobile terminal device 200 itself. Further, the
control unit 250 receives the voice acquired from the microphone 112. Furthermore, the control
unit 250 includes a determination unit 251 and a control change unit 252.
11-04-2019
21
[0076]
The determination unit 251 determines whether or not it is difficult to hear the voice.
Specifically, based on the voice acquired from the microphone 112, the determination unit 251
determines whether or not it is difficult to hear the voice. In a situation where it is difficult to
hear voice, such as under a high level noise environment, the sound acquired by the microphone
112 includes environmental sounds in addition to the user's voice. Also, in situations where it is
difficult to hear the voice, the user often unconsciously makes the voice louder in many cases.
Therefore, when the sound pressure of the sound acquired from the microphone 112 becomes
equal to or higher than a predetermined threshold, the determination unit 251 of the second
embodiment determines that the user is in a situation where it is difficult to hear the sound. The
voice acquired from the microphone 112 used to determine whether the determination unit 251
is in a situation where it is difficult to hear the voice is located at a position different from the
microphone 112, for example, on the back side of the first housing 110. A microphone for
environmental sound acquisition is separately provided, and the difference between the sound
acquired by the microphone for environmental sound acquisition and the sound acquired by the
microphone 112 is calculated to remove or reduce the component of the voice spoken by the
user. Voice data may be used.
[0077]
The control changing unit 252 changes the content of the audio output control by the control
unit 250 according to the result of the determination of the determining unit 251. Specifically,
when the determination unit 251 determines that it is difficult to hear a sound, the control
changing unit 252 starts voice transmission using the vibrator 123a. In this state, the control
changing unit 252 increases or decreases the driving amount of the vibrator 123 a according to
the sound pressure of the sound acquired from the microphone 112. That is, when the sound
pressure of the sound acquired from the microphone 112 increases or decreases, the driving
amount of the vibrator 123a is increased or decreased in proportion thereto. Furthermore, the
control changing unit 252 stops the operation of the vibrator 123a when the sound pressure of
the sound acquired from the microphone 112 becomes smaller than a predetermined threshold
while the sound transmission using the vibrator 123a is being performed. Let In addition, the
control changing unit 252 changes the output of the speaker 122 according to the sound
pressure of the sound acquired from the microphone 112.
[0078]
11-04-2019
22
FIG. 8 is a flowchart showing the flow of the operation regarding the audio output of the mobile
terminal device 200 of the second embodiment. FIG. 9 is a diagram showing the relationship
between the volume of the environmental sound and the volume of the speaker and the
amplitude of the vibrator. In S200, voice reception or generation is performed. The voice
received or generated in this step is transmitted to the user in the following steps.
[0079]
In S210, the determination unit 251 detects an environmental sound by the microphone 112.
[0080]
In S220, the determination unit 251 determines whether the sound pressure of the
environmental sound obtained by the microphone 112 is smaller than a threshold.
If the detected environmental sound is smaller than the threshold, the process proceeds to step
S230. If the detected environmental sound is greater than or equal to the threshold, the process
proceeds to step S250.
[0081]
In S230, the control changing unit 252 increases or decreases the volume of the speaker 122
according to the sound pressure of the environmental sound acquired from the microphone 112.
For example, the control changing unit 252 instructs the speaker driving circuit 180 to increase
or decrease the volume of the speaker 122 between the initial setting value and the MAX volume
according to the environmental sound according to the relationship shown in FIG.
[0082]
In S240, the control changing unit 252 controls the speaker driving circuit 180 to cause the
speaker 122 to generate sound.
[0083]
11-04-2019
23
In S250, the control changing unit 252 increases or decreases the volume of the speaker 122
and the driving amount of the vibrator 123a according to the sound pressure of the
environmental sound obtained by the microphone 112.
For example, the control changing unit 252 instructs the speaker driving circuit 180 to increase
or decrease the volume of the speaker 122 according to the sound pressure of the environmental
sound according to the relationship shown in FIG. In response to this, the oscillator drive circuit
170 is instructed to increase or decrease the amplitude of the oscillator 123a.
[0084]
In S260, the control changing unit 252 controls the speaker driving circuit 180 to cause the
speaker 122 to generate sound. Further, the control changing unit 252 controls the vibrator
driving circuit 170 to drive the vibrator 123a, and enables voice transmission by bone
conduction and the like using the vibrator 123a.
[0085]
In S270, the control unit 250 determines whether to continue the voice output. This
determination is made based on, for example, whether or not voice input and generation are
continued. If voice output is to be continued, the process returns to S200. When the voice output
is finished, the operation is finished.
[0086]
As described above, according to the second embodiment, the driving of the vibrator 123a is
started or the driving amount of the vibrator 123a is changed according to the sound pressure of
the environmental sound obtained by the microphone 112. Therefore, the user can use voice
transmission using the transducer 123a that is easier to hear when it is a situation where it is
difficult to hear a sound without performing a special operation. In addition, even if the user does
not press the portable terminal device 200, it is possible to automatically utilize voice
transmission using the vibrator 123a with an appropriate amount of vibration.
11-04-2019
24
[0087]
Third Embodiment A portable terminal device 300 according to a third embodiment differs from
the portable terminal device 100 according to the first embodiment in that the configuration of
the shaft unit 330 and the operation of the control unit 350 are different. Therefore, the same
code | symbol is attached | subjected to the part which fulfill | performs the function similar to
1st Embodiment mentioned above, and the overlapping description is abbreviate | omitted
suitably.
[0088]
FIG. 10 is a view showing a third embodiment of the portable terminal device 300 using the
voice output control method and the voice output control program according to the present
invention. FIG. 10A is a diagram showing the storage state in which the first case 110 and the
second case 120 are closed, and FIG. 10B is a view showing the first case 110 and the second
case. 10 (c) is a view showing a use state in which the case 120 of FIG. 10 is opened, and the first
case 110 and the second And the housing 120 is open.
[0089]
The shaft unit 330 of the mobile terminal device 300 according to the third embodiment
includes a shaft 331, an angle sensor unit 332 (see FIG. 11), and a biasing member 340.
[0090]
The shaft 331 is a shaft provided at the rotation center of the first housing 110 and the second
housing 120.
[0091]
The angle sensor unit 332 is a sensor that detects a relative rotation angle between the first
housing 110 and the second housing 120. For example, an electrical contact may be used, or
magnetic detection may be used. It may be
11-04-2019
25
The angle sensor unit 332 has a function as a pressure detection unit that detects that the
speaker 122 and the contact unit 123 are pressed against the vicinity of the user's ear, as
described later.
[0092]
The biasing member 340 is a torsion coil spring, and the shaft 331 is provided to pass through
the central annular portion.
One arm 340 a of the biasing member 340 is provided to be able to abut on a pin 116 provided
on the first housing 110. Further, the other arm 340 b of the biasing member 340 is provided so
as to be able to abut on a pin 126 provided on the second housing 120.
[0093]
In the closed storage state of FIG. 10A, the biasing member 340 is in the free state, and no
biasing force from the biasing member 340 to the first housing 110 and the second housing 120
is generated.
[0094]
In the open state of use of FIG. 10 (b), one arm 340a of the biasing member 340 abuts against
the pin 116 provided on the first housing 110, and the other arm 340b It abuts on a pin 126
provided on the second housing 120.
In this position, a click mechanism or the like may be provided so that the relative rotational
angle between the first housing 110 and the second housing 120 can stay in this use state.
[0095]
When the second housing 120 is pushed as shown by arrow B in FIG. 10C from the use state of
FIG. 10B, the first housing 110 and the second housing 120 are: The rotation angle can be
further opened from the position of FIG. At this time, the biasing member 340 is charged, and the
11-04-2019
26
biasing force in the direction in which the first housing 110 and the second housing 120 close is
increased. Here, when the force of the arrow B is removed from the state of FIG. 10 (c), the first
case 110 and the second case 120 are shown in FIG. 10 (b) by the biasing force of the biasing
member 340. Return to the position of.
[0096]
With the above-described configuration, when the user presses the speaker 122 against his / her
ear when it is difficult for the user to hear the voice, the first housing 110 and the second
housing 120 are as shown in FIG. The rotation angle of the both changes so as to be a further
open position (for example, the position of FIG. 10C) from the position of. The angle sensor
portion 332 is provided so as to be able to detect at least a rotation angle greater than the use
state of FIG. 10 (b). In the third embodiment, by providing the biasing member 340, the force
required as the arrow B increases according to the opening angle when opening beyond the
predetermined use position. Therefore, it can be determined that the larger the open angle, the
greater the force with which the user presses the contact portion 123 against the human body.
[0097]
FIG. 11 is a block diagram showing the configuration of a portion related to audio output of the
mobile terminal device 300 of the third embodiment. The portable terminal device 300 includes
a control unit 350. Control unit 350 controls the audio output of portable terminal device 200.
The control unit 350 receives audio information to be output. The voice output controlled by the
control unit 350 may be, for example, the voice of the telephone received by the mobile terminal
device 300 or the voice generated by the mobile terminal device 300 itself. Also, the rotation
angle acquired from the angle sensor unit 332 is input to the control unit 350. Furthermore, the
control unit 350 includes a determination unit 351 and a control change unit 352.
[0098]
The determination unit 351 determines whether or not it is difficult to hear the voice.
Specifically, based on the rotation angle acquired from the angle sensor unit 332, the
determination unit 351 determines whether or not it is difficult to hear the voice. That is, in the
third embodiment, instead of the pressure in the first embodiment, the rotation angle is used to
detect the operation of the user pressing the speaker 122 against the ear and the degree of the
11-04-2019
27
pressing.
[0099]
The control changing unit 352 changes the content of the audio output control by the control
unit 350 according to the result of the determination of the determining unit 351. Specifically,
when the determination unit 351 determines that it is difficult to hear a sound, the control
changing unit 352 starts voice transmission using the vibrator 123a. In this state, the control
changing unit 352 increases or decreases the driving amount of the vibrator 123a according to
the rotation angle acquired from the angle sensor unit 332. That is, when the rotation angle
acquired from the angle sensor unit 332 is increased or decreased, the drive amount of the
vibrator 123a is increased or decreased in proportion thereto. Furthermore, the control changing
unit 352 stops the operation of the vibrator 123a when the rotation angle acquired from the
angle sensor unit 332 becomes smaller than a predetermined threshold in a state in which voice
transmission using the vibrator 123a is performed. Let In addition, the control changing unit 352
changes the output of the speaker 122 according to the rotation angle obtained from the angle
sensor unit 332.
[0100]
FIG. 12 is a flowchart showing the flow of the operation regarding the audio output of the mobile
terminal device 300 of the third embodiment. FIG. 13 is a diagram showing the relationship
between the rotation angle and the volume of the speaker and the amplitude of the vibrator. In
S300, voice reception or generation is performed. The voice received or generated in this step is
transmitted to the user in the following steps.
[0101]
In S310, the determination unit 351 detects the relative rotation angle between the first casing
110 and the second casing 120 by the angle sensor unit 332.
[0102]
In S320, the determination unit 351 determines whether the rotation angle obtained by the angle
sensor unit 332 is smaller than a threshold.
11-04-2019
28
If the detected rotation angle is smaller than the threshold, the process proceeds to S330. If the
detected rotation angle is equal to or more than the threshold, the process proceeds to S350.
[0103]
In S330, the control changing unit 352 increases or decreases the volume of the speaker 122
according to the rotation angle acquired from the angle sensor unit 332. For example, the control
changing unit 252 instructs the speaker driving circuit 180 to increase or decrease the volume of
the speaker 122 between the initial setting value and the MAX volume according to the rotation
angle according to the relationship shown in FIG.
[0104]
In S340, the control changing unit 352 controls the speaker driving circuit 180 to cause the
speaker 122 to generate sound.
[0105]
In S350, the control changing unit 352 increases or decreases the volume of the speaker 122
and the driving amount of the vibrator 123a according to the rotation angle obtained by the
angle sensor unit 332.
For example, the control changing unit 352 instructs the speaker driving circuit 180 to increase
or decrease the volume of the speaker 122 according to the rotation angle according to the
relationship shown in FIG. 13, and the transducer 123a according to the rotation angle. The
oscillator drive circuit 170 is instructed to increase or decrease the amplitude of
[0106]
In S360, the control changing unit 352 controls the speaker driving circuit 180 to cause the
speaker 122 to generate sound. Further, the control changing unit 352 controls the vibrator
drive circuit 170 to drive the vibrator 123a, and enables voice transmission by bone conduction
11-04-2019
29
and the like using the vibrator 123a.
[0107]
In S370, the control unit 350 determines whether to continue the audio output. This
determination is made based on, for example, whether or not voice input and generation are
continued. If voice output is to be continued, the process returns to S300. When the voice output
is finished, the operation is finished.
[0108]
As described above, according to the third embodiment, the drive of the vibrator 123a is started
or the drive amount of the vibrator 123a is changed according to the rotation angle obtained by
the angle sensor unit 332. Therefore, the user can use voice transmission using the transducer
123a that is easier to hear when it is a situation where it is difficult to hear a sound without
performing a special operation.
[0109]
The processing of the portable terminal device is recorded in a computer readable recording
medium, and the program recorded in the recording medium is read by the portable terminal
device and executed to execute the portable terminal device and the audio output control method
of the present invention. It can be realized. The computer system referred to here includes
hardware such as an OS and peripheral devices.
[0110]
The "computer system" also includes a homepage providing environment (or display
environment) if the WWW (World Wide Web) system is used. The program may be transmitted
from a computer system in which the program is stored in a storage device or the like to another
computer system via a transmission medium or by transmission waves in the transmission
medium. Here, the “transmission medium” for transmitting the program is a medium having a
function of transmitting information, such as a network (communication network) such as the
11-04-2019
30
Internet or a communication line (communication line) such as a telephone line.
[0111]
Further, the program may be for realizing a part of the functions described above. Furthermore,
it may be a so-called difference file (difference program) that can realize the above-described
functions in combination with a program already recorded in the computer system.
[0112]
Although the embodiments of the present invention have been described in detail with reference
to the drawings, the specific configuration is not limited to this embodiment, and includes design
and the like within the scope of the present invention.
[0113]
(Modified form) (1) In each embodiment, the portable terminal device 100 gave and
demonstrated the example which changes both the sound volume of the speaker 122, and the
vibration amount of the vibrator 123a.
Not limited to this, for example, one may be fixed, or both may be fixed and switching may be
performed.
[0114]
(2) In each embodiment, the portable terminal device 100 has been described by way of an
example in which the pressure is detected to determine that it is difficult to hear the sound. Not
limited to this, for example, deflection of the housing may be detected and used. In the form of
detecting the bending of the housing, the present invention can be easily used even in a terminal
such as a so-called straight type or a smartphone type.
[0115]
11-04-2019
31
(3) In each embodiment, the portable terminal device 100 mentioned and demonstrated the
example which judges that it is a condition where it is hard to hear a sound using a pressure
sensor. The present invention is not limited to this. For example, the touch pressure on the touch
panel surface may be detected or the contact area may be detected using the touch panel
function of the liquid crystal display screen, and may be used for the determination.
[0116]
(4) In each embodiment, although judgment part 151 (251) and control change part 152 (252)
were explained as what was constituted separately, it may constitute as the same functional
block, and different control is carried out. It may be provided in the unit.
[0117]
(5) In each embodiment, an example in which the driving of the speaker 122 is stopped when
driving the vibrator 123a has been described.
For example, the control unit 150 (250) may drive both the vibrator 123a and the speaker 122
in a situation where the determination unit 151 determines that it is difficult to hear a sound.
[0118]
(6) In the first embodiment, an example in which the pressure sensor is disposed near the shaft
portion 130 has been described. Not limited to this, for example, it may be disposed near the
speaker 122.
[0119]
(7) In each embodiment, the example provided with the speaker 122 with the vibrator | oscillator
123a and the contact part 123 was mentioned and demonstrated. Not limited to this, for
example, the speaker 122 may be omitted, and sound may be transmitted only by the vibrator.
11-04-2019
32
[0120]
(8) In each embodiment, the example which changes the vibration amount (amplitude) of a
vibrator according to a pressure value or the sound pressure of environmental sound was
mentioned and described. Not limited to this, for example, processing of audio data itself may be
performed such as changing the frequency.
[0121]
In addition, although each embodiment and modification can also be used combining suitably,
detailed description is abbreviate | omitted.
[0122]
DESCRIPTION OF SYMBOLS 100 Mobile terminal device 110 1st housing | casing 111 Operation
key 112 Microphone 113 contact part 116, 126 pin 120 2nd housing | casing 121 main display
122 speaker 123 contact part 123a vibrator 124 sub display 125 pressure sensor part 130 axial
part 150 control unit 151 determination unit 152 control change unit 170 vibrator drive circuit
180 speaker drive circuit 200 portable terminal device 250 control unit 251 determination unit
252 control change unit 300 portable terminal device 330 shaft unit 331 shaft 332 angle sensor
unit 340 biasing member 340a, 340b arm 350 control unit 351 determination unit 352 control
change unit
11-04-2019
33
Документ
Категория
Без категории
Просмотров
0
Размер файла
48 Кб
Теги
description, jp2012249252
1/--страниц
Пожаловаться на содержимое документа