close

Вход

Забыли?

вход по аккаунту

?

DESCRIPTION JP2007087559

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2007087559
PROBLEM TO BE SOLVED: To provide a recording / reproducing apparatus, a control method for
the recording / reproducing apparatus, and a control program for the recording / reproducing
apparatus, for example, on the side to be photographed and recorded by applying to provision of
environmental sound instead of background music. Even when shooting or recording, without
being aware of the fact that it is being shot or recorded at all, it should not be seen or heard even
if the shooting or recording side is inconvenient. . According to the present invention, the amount
of effect is set to decrease as the elapsed time after recording becomes longer, and the recorded
audio data and image data are subjected to effect processing and output. [Selected figure] Figure
1
Recording and reproducing apparatus, control method for recording and reproducing apparatus,
and control program for recording and reproducing apparatus
[0001]
The present invention relates to a recording and reproducing apparatus, a control method for the
recording and reproducing apparatus, and a control program for the recording and reproducing
apparatus, and can be applied to provision of environmental sound instead of background music,
for example. The present invention sets the effect amount to decrease as the elapsed time after
recording becomes longer, and effects and processes the recorded audio data and image data,
thereby outputting the image data to the shooting and recording side. Even when shooting or
recording, without being aware of the fact that shooting or recording is done at all, it should be
possible to see or hear that there is nothing wrong with the side to be shot or recorded. .
10-04-2019
1
[0002]
Heretofore, various measures have been taken so that recording and reproducing apparatuses for
photographing and recording can be easily carried exclusively and can record imaging results
and recording results with high image quality and high sound quality. Also, some of these
recording and reproducing devices and editing devices can add effects to the imaging results and
the recording results, and conventionally, effects added to the imaging results and the recording
results by such devices are exclusively for the viewer's visual sense. It appealed to the listener's
hearing to improve the expressiveness of the imaging result and the recording result.
[0003]
On the other hand, in the case of voice, by combining with voice from other sources, the
expressive power may be improved and the sense of reality may be improved, as described in JPA-6-130979. With regard to speech to be synthesized, a method of generating sound effects such
as applause and a hand has been proposed.
[0004]
By the way, in photographing and recording using such a recording and reproducing apparatus
for photographing and recording, there are cases in which photographing and recording of a
person's natural appearance are attempted.
However, in the case of shooting using a conventional recording and reproducing apparatus, the
intended side of shooting and recording is intended and understood in most cases by the side of
shooting and recording, and in this case, a truly natural appearance is obtained. It does not mean
that you are shooting or recording.
[0005]
However, in recent years, this type of recording and reproducing apparatus has been further
miniaturized so that it is possible to take pictures without being conscious of the fact that it has
been taken and recorded on the side to be taken and recorded. Specifically, by wearing a small
camera and a recording device by Wearable Products, taking a picture, and living daily life in a
10-04-2019
2
state of recording, for example, recording the natural state of the usual child In such a record, it
will be a valuable record as a child grows.
[0006]
However, in the case where the shooting and recording are performed without making the
shooting and recording be totally aware of the fact that the shooting and recording are
performed in this way, it is possible to see the inconvenience to the shooting and recording side
as well. And there is a problem of being heard or heard. Japanese Patent Application Laid-Open
No. 6-130979
[0007]
The present invention has been made in consideration of the above points, and in the case of
taking and recording without making the taking and recording side aware of the fact that it has
been taken and recorded, the taking and recording Recording / reproducing apparatus, a control
method for the recording / reproducing apparatus, and a control program for the recording /
reproducing apparatus that can prevent the user from seeing or hearing the inconvenience of the
is there.
[0008]
In order to solve the problems, the invention of claim 1 is applied to a recording and reproducing
apparatus to record and hold audio data obtained from a microphone together with time
information, and reproduce the recorded and held audio data. Control means for controlling the
operation of the recording and reproducing unit, the effect processing unit for effecting the audio
data output from the recording and reproducing unit and outputting the output audio data, and
controlling the operations of the effect processing unit and the recording and reproducing unit
The control unit controls the effect processing unit such that the amount of effect in the effect
processing unit decreases as the elapsed time from the time of recording in the recording and
reproducing unit becomes longer.
[0009]
The invention of claim 7 is applied to a recording and reproducing apparatus to record and hold,
together with time information, image data of a moving image obtained from an imaging means,
and reproduce and output the image data which has been recorded and held. Recording and
reproducing unit; an effect processing unit for effect processing the image data output from the
recording and reproducing unit and outputting output image data; and a control unit for
10-04-2019
3
controlling operations of the effect processing unit and the recording and reproducing unit The
control unit controls the effect processing unit such that the amount of effect in the effect
processing unit decreases as the elapsed time from the time of recording in the recording and
reproducing unit becomes longer.
[0010]
The invention of claim 8 is applied to a control method of a recording and reproducing apparatus
which records audio data obtained from a microphone in a recording and reproducing unit and
reproduces and outputs the audio data recorded and held in the recording and reproducing unit.
And an elapsed time detecting step of detecting an elapsed time from when the audio data
reproduced by the recording and reproducing unit is recorded in the recording and reproducing
unit, and an effect amount decreases as the elapsed time becomes longer. The setting is made to
include the step of effect processing for effecting the audio data reproduced by the recording and
reproducing unit.
[0011]
The invention according to claim 9 records and holds image data of a moving image obtained by
the imaging means together with time information in the recording and reproducing unit, and
reproduces and outputs the image data recorded and held in the recording and reproducing unit.
Applying to the control method of the recording and reproducing apparatus, the step of detecting
the elapsed time from when the image data to be reproduced by the recording and reproducing
unit is recorded in the recording and reproducing unit, and detecting the elapsed time; The
amount of effect is set to decrease accordingly, and the image processing unit reproduces the
image data reproduced by the recording and reproducing unit so as to include an effect
processing step of effect processing.
[0012]
According to the invention of claim 10, the audio data obtained from the microphone is recorded
in the recording and reproducing unit and the audio data recorded and held in the recording and
reproducing unit by executing predetermined processing procedures by the arithmetic
processing means. Is applied to a control program of a recording and reproducing apparatus that
reproduces and outputs, and the predetermined processing procedure detects an elapsed time
from the time when the audio data to be reproduced by the recording and reproducing unit is
recorded in the recording and reproducing unit. A step of detecting an elapsed time, and a step of
effect processing for effect processing the audio data reproduced by the recording and
reproducing unit by setting the amount of effect to decrease as the elapsed time becomes longer .
10-04-2019
4
[0013]
Further, according to the invention of claim 11, by executing predetermined processing
procedures by the arithmetic processing means, the image data as a moving image obtained by
the imaging means is recorded and held together with time information in the recording and
reproducing portion, and the recording and reproducing portion Applied to a control program of
a recording / reproducing apparatus for reproducing and outputting the image data recorded
and held in the recording / reproducing unit of the image data reproduced by the recording /
reproducing unit by the predetermined processing procedure Step of detecting an elapsed time
from the time when the recording is performed, and setting the effect amount to decrease as the
elapsed time becomes longer, and effect processing the image data reproduced by the recording
and reproducing unit And processing steps.
[0014]
Even if it is inconvenient for the side to be photographed and recorded, such inconvenience is
eliminated when the time after photographing and recording elapses, and it becomes a valuable
recording.
Thus, according to the configuration of claim 1, the recording and reproducing apparatus is
applied to record and hold audio data obtained from the microphone together with time
information, and reproduce and output the recorded and held audio data. It comprises a
reproduction unit, an effect processing unit that effects processing of the audio data output from
the recording and reproduction unit and outputs output audio data, and a control unit that
controls operations of the effect processing unit and the recording and reproduction unit. The
control unit controls the effect processing unit so that the amount of effect added by the effect
processing unit decreases as the elapsed time from the time of recording in the recording and
reproducing unit becomes longer, the side to be recorded The content that is inconvenient for the
user can be reproduced as difficult to grasp, and the content can be made gradually graspable as
the inconvenience decreases with the passage of time. In the case where the recording is
performed without making the recording side be completely aware of the fact that it is recorded,
it will be valuable to ensure that the inconvenience of the recording side is not heard. Records
can be provided to the user.
[0015]
Thus, according to the configuration of claim 7, even in the case of taking a picture without
letting the side to be taken notice that it is taken at all, it is possible to see something
10-04-2019
5
inconvenient on the side to be taken or It is possible to do nothing.
[0016]
Further, according to the configurations of claim 8, claim 10, claim 10 and claim 11, when
photographing and recording are performed, the imaging and recording are performed without
any awareness that the photographing and recording are performed. Provided is a control
method of a recording and reproducing apparatus and a program of a control method of a
recording and reproducing apparatus which can prevent a user from seeing or hearing
something inconvenient even if it is taken or recorded. can do.
[0017]
According to the present invention, even when photographing and recording are performed
without the imaging and recording side being completely aware of the fact that the imaging and
recording are performed, even the inconvenience to the imaging and recording side can be
avoided. It can be made to be neither seen nor heard.
[0018]
Hereinafter, embodiments of the present invention will be described in detail with reference to
the drawings.
[0019]
(1) Configuration of the Embodiment FIG. 1 is a block diagram showing a recording and
reproducing apparatus according to an embodiment of the present invention.
The recording and reproducing apparatus 1 is installed in, for example, a living room of a general
home, and on the side to be recorded, a conversation or the like is recorded without being
conscious of the fact that it is recorded, and the recorded content is appropriately reproduced.
Provided to users.
[0020]
For this reason, in the recording / reproducing apparatus 1, the microphone 2 acquires and
10-04-2019
6
outputs an audio signal to be provided for the recording, and the input / output circuit 3 analogdigital converts the audio signal to generate audio data D1. The audio data D1 is output to the
main system 4.
The input / output circuit 3 performs digital-to-analog conversion processing on the audio data
D2 output from the main system 4 to generate an audio signal, and drives the speaker 5 with this
audio signal.
As a result, the recording and reproducing apparatus 1 records and holds the sound acquired by
the microphone 2, and reproduces the held sound as appropriate, and outputs it from the
speaker 5.
[0021]
The rotary operator 6 is a rotary encoder for inputting time information, and an LED (Light
Emitting Diode) 7 displays time information input by the rotary operator 6, time information
concerning audio data currently being reproduced, etc. Segment display means.
The recording / reproducing apparatus 1 switches the operation by the operation of the
operation element 8, receives the specification of the voice recorded in the past according to the
time information instructed by the operation of the rotation operation element 6, and provides it
to the user.
The display 9 is a display means for providing a monitor of the operation etc. related to the main
system 4, and the interface (I / F) 10 notifies the main system 4 of the operation of the rotary
operator 6 and the operator 8 The LED 7 and the display 9 are driven under the control of the
system 4.
[0022]
In this embodiment, the microphone 2, the speaker 5, the rotary operation 6, the LED 7, and the
operation 8 are integrated as one unit and connected to the main system 4 by wire or wireless.
[0023]
10-04-2019
7
On the other hand, the main system 4 is formed of an arithmetic processing unit that executes a
program related to the processing of the recording and reproducing device 1, a hard disk drive
related to the processing of the arithmetic processing unit, and peripheral components such as
various memories. The voice data D1 acquired via the hard disk drive is recorded on the hard
disk device to construct the database 12, and the recording of the database 12 is reproduced to
output the voice data D2.
In this embodiment, although the processing program according to the main system 4 is installed
in advance in the recording and reproducing apparatus 1 and provided, it is downloaded via a
network such as the Internet instead of such prior installation. Alternatively, it may be provided
by being recorded on various recording media such as an optical disk, a magnetic disk, a memory
card and the like.
[0024]
In the main system 4, functional blocks of the sound analysis unit 13 and the sound analysis unit
14 that analyze the sound data D 1 obtained from the microphone 2 are formed by the execution
of this program.
Further, the voice analysis unit 13 and the voice analysis unit 14 record the voice data D1 on the
hard disk device together with the analysis result by the voice analysis unit 14 to construct the
database 12, reproduce the recording of the database 12 and output it. The function block of the
sound manager 15 to control is comprised.
Further, functional blocks of the effect setting unit 16 for generating parameters relating to
effects under the control of the sound manager 15, audio data D2 for effect processing the audio
data reproduced from the database 12 by the parameters by the effect setting unit 16 and
providing it for output. Constitute a functional block of the sound creator 17.
Furthermore, a functional block of an interface manager (I / F manager) 18 that forms a user
interface via the interface 10 is configured.
10-04-2019
8
[0025]
FIG. 2 is a state transition diagram showing the operation of the main system 4 by the execution
of this program.
The main system 4 starts its operation in the standby state of step SP1 when the power is turned
on.
Here, when the user instructs to start the operation by operating the operating element 8 as
"active" in this step SP1, the process proceeds to step SP2 to reproduce the audio data recorded
in the database 12 in the passive mode. Start.
[0026]
Also, in this step SP2, as indicated by "click on", voice data obtained from the microphone 2 as
instructed by the user to start recording by operating the operating element 8, or as "input level:
large". If the input level by D1 is equal to or higher than a predetermined recording start level,
the process proceeds from step SP2 to step SP3, the reproduction of the audio data D1 in the
passive mode is stopped, and the audio data D1 obtained from the microphone 2 is recorded in
the database 12.
[0027]
Also, in step SP3, as indicated by "click off", when end of recording is instructed by the operation
of the operation element 8 by the user, or as "input level: small", audio data D1 obtained from the
microphone 2 When the input level according to the above becomes lower than a predetermined
recording start level, the process returns from step SP3 to step SP2 to stop the recording of the
audio data D1 and reproduce the audio data recorded in the database 12 in the passive mode.
[0028]
As a result, as shown in FIG. 3, when the audio data D1 obtained from the microphone 2 becomes
lower than a predetermined signal level, the main system 4 reproduces the audio data recorded
in the database 12 and provides it to the user. Thus, the environmental sound at the place where
the recording and reproducing apparatus 1 is installed is supplemented, and the continuity of the
sound field is maintained without being aware of the listener.
10-04-2019
9
[0029]
That is, in a place full of environmental sounds, for example, when the conversation is suddenly
interrupted, when the user suddenly becomes quiet, surrounding environmental sounds suddenly
enter the consciousness.
At this time, in the case where this environmental sound is a natural sound such as a bird cries or
a stream of a river, the listener is generally in a pleasant state.
However, if this environmental noise belongs to noise such as air conditioning and the noise of
the fan of the equipment, the listener becomes uncomfortable.
Also, even if there is no environmental sound, the listener will be anxious as well. Specifically,
when talking by a few people, if the topic is suddenly interrupted, if the air conditioning sound
etc. is not loud but gets into the consciousness, in this case it may fall into an awkward
atmosphere.
[0030]
As a result, in this embodiment, when the conversation is interrupted and the input level by the
microphone 2 is lowered, the environmental sound acquired from the microphone 2 becomes
almost the same as the original volume. Recording generates and plays environmental sounds,
thereby avoiding such unpleasant situations.
[0031]
That is, in FIG. 3, period A is a case where an environmental sound such as a conversation is
acquired at a sufficient sound volume by the microphone 2, and period B is an audio data D1
acquired by the microphone 2 due to the conversation being interrupted or the like. In this
period B, the main system 4 reproduces the recording of the database 12 and outputs it from the
speaker 5 to compensate for the lowered environmental sound.
The period C is a case where the signal level of the audio data D1 acquired by the microphone 2
increases due to the resumption of conversation, etc. In this case, the main system 4 cancels the
10-04-2019
10
complementing of the environmental sound by the audio data D2.
[0032]
In this embodiment, the main system 4 monitors such changes in environmental sound according
to the average level of the audio data D1 and reproduces it from the database 12 so as to
maintain the average level within a certain range. The volume of the audio data D2 to be output
is controlled by footback control.
[0033]
Here, the passive mode is an operation mode for reproducing the audio data recorded in the
database 12 by the selection of the main system 4.
The main system 4 proceeds to step SP4 when the user instructs the reproduction in the active
mode by the operation of the operating element 8 by the user, as indicated by "click on" in step
SP2 (FIG. 2). The operation mode is switched to the reproduction in the active mode for
reproducing the audio data recorded in the database 12. Further, in this case, the main system 4
causes the LED 7 to display the time information input by the operation of the rotary operator 6,
and reproduces the audio data D1 recorded in the database 12 specified by the time information
from the speaker 5 Output.
[0034]
Further, when the timer is turned on at the time set by the user in advance so that "timer is ON"
in step SP2 (FIG. 2) in step SP2, the main system 4 proceeds to step SP4, and in this case, is
active Play audio data specified by the user in advance by mode playback. Further, when the
reproduction of the audio data is completed, the process returns to step SP2 so as to indicate
"timer OFF".
[0035]
Furthermore, when the timer set in advance by the user is turned on by the operation of the
operating element 8 or if the timer related to the time signal is turned on, as indicated by “timer
on / off” in steps SP1, step SP3 and step SP4. At step SP5, an alarm and a time signal relating to
the setting of the timer are output from the speaker 5, and then the process returns to the
10-04-2019
11
original steps SP2, SP3 and SP4.
[0036]
Thus, the main system 4 records the audio data D1 obtained from the microphone 2 in the
database 12 after transitioning to step SP3 until transition to another step SP2 and step SP5.
After transitioning to step SP3, the main system 4 records audio data in the database 12 as one
audio file until transition to another step SP2 and step SP5. Further, based on analysis results
and the like obtained from the sound analysis unit 13 and the speech analysis unit 14, metadata
indicating the feature of the speech according to the speech data D 1 is recorded together in the
database 12.
[0037]
Here, FIG. 4 is a chart showing the relationship between the metadata and the file by the audio
data D1. The main system 4 records the voice data D1 sequentially in the database 12 while
analyzing the voice data D1 obtained from the microphone 2 by the sound analysis unit 13 and
the voice analysis unit 14, and creates a voice file F1. In this analysis processing, the main system
4 separates the voice according to the voice data D1 into the steady component and the nonsteady component by the functional block of the acoustic analysis unit 13, and performs input /
output according to the ratio of the non-steady component to the steady component. By the
control of the circuit 3, when the stationary component increases, the sampling frequency is
increased to acquire the audio data D1. Here, the steady component is a signal component that is
always included in the sound acquired by the microphone 2 and is, for example, a fan sound or
the like. On the other hand, the non-stationary component is a component which is not always
included in the sound acquired by the microphone 2 like conversation. The sound analysis unit
13 detects, for example, the signal level of the steady component by the moving average of the
voice data D1 sequentially input, and the signal level of the non-stationary component by the
difference value of the moving average value and the voice data D1 sequentially input. To detect
[0038]
As shown in FIG. 5D, the main system 4 adds the time change of the sampling frequency as
10-04-2019
12
information of the sampling frequency to the audio file F1 by the tag and records it. Further, the
main system 4 detects the dynamic range of the audio data D1 by the functional block of the
acoustic analysis unit 13, adds the time change of the dynamic range to the audio file F1 by the
tag, and records it. The dynamic range is detected, for example, by sample and hold of the peak
value and the bottom value of the audio data D1. Even if the audio data recorded in the audio file
F1 is information indicating that it is so-called RAW data which is not data-compressed at all, it is
added to the audio file F1 by the tag.
[0039]
Further, the main system 4 acquires time information of an audio file to be recorded in the
database 12 from a timer, and records the time information in the database 12 by the time
information file F2, as shown in FIG. 5 (A). Here, this time information file F2 is a file for
recording the time information of the corresponding audio file F1, and in this time information,
information of the recording start date and time of the corresponding audio file F1, and the
recording end time Information, information on the time from the recording start to the
recording end is applied.
[0040]
Further, as shown in FIG. 5B, the main system 4 creates the surround information file F3 based
on the detection result of the steady component and the non-steady component by the acoustic
analysis unit 13 and records the surround information file F3 in the database 12. Here, the
surround information file F3 is a file for recording information on the sound of the place
provided for obtaining the audio data D1, and the time change of the steady component in the
audio data D1 is recorded by the tag. Further, the reverberation coefficient of the voice data D1 is
obtained by the sound analysis unit 13, and the change of the reverberation coefficient is
recorded by the tag. In addition, when detection results by various sensors can be acquired,
sensing results by the sensors are recorded by the tag. Here, as this sensor, a sensor that detects
a change in the environment in which voice is acquired by the microphone 2 is applied, for
example, a sensor by infrared light or light that detects the presence or absence of a person, a
temperature sensor that detects temperature, and humidity that detects humidity A sensor or the
like is applied.
[0041]
10-04-2019
13
Further, as shown in FIG. 5E, the main system 4 creates an acoustic information file F 4 based on
the analysis result of the acoustic analysis unit 13 and records the acoustic information file F 4 in
the database 12. Here, the sound information file F4 is a file in which the sound engineering
features of the sound by the sound data D1 are recorded, and the change of the volume, the
change of the frequency spectrum, and the change of the rhythm factor are recorded by the tag.
Here, the rhythm factor is a coefficient indicating the rhythm due to the strength of the sound
appearing in the voice by the voice data D1, and it is generated so that it becomes a large value
in the conversation with rhythm feeling and the reproduction of music and the value decreases in
the conversation without intonation Be done.
[0042]
Further, as shown in FIG. 5 (F), the main system 4 creates a user information file F5 based on the
analysis result of the voice analysis unit 14 and records it in the database 12. Here, the user
information file F5 is information relating to the main voice of the voice data D1 acquired by the
microphone 2, and the distinction between men and women by analysis of voice, age estimated,
etc. are recorded by the tag as information of basic attributes Ru. Further, if it is determined that
the main body of the voice is the user registered in advance by matching with the voice
registered in advance, the information of the preference registered for the user is recorded by the
tag. Further, the information related to the operation of the recording and reproducing apparatus
1 is recorded by the tag as the information of the action.
[0043]
Further, as shown in FIG. 5C, the main system 4 creates an event news file F6 by the operation of
the operating element 8 and records it in the database 12. The recording and reproducing
apparatus 1 is provided with an operator 8 for an event, and when the operator 8 for this event
is operated, the operation of the operator 8 is recorded as user information by a tag. The
operator 8 of this event has a function of setting a mark in the audio file F1 recorded in this
manner. Also, as shown in FIG. 4, when the recording and reproducing apparatus 1 can be
connected to a network such as the Internet and can acquire news, weather forecast and the like,
the news, weather forecast and the like are recorded as global information by tags. Be done.
Further, information specifying the installation place of the recording / reproducing apparatus 1
is recorded as information of the system.
10-04-2019
14
[0044]
As shown in FIG. 6, in the main system 4 according to this embodiment, under the control of the
sound manager 15, the sound file F1 and the sound information file F4 among the files F1 to F6
related to one sound file F1. Are grouped into voice recordings, and the other files F2, F3, F5, and
F6 are grouped into property recordings, and further, the voice recordings and property
recordings are grouped into one master entry recording, and these allow the database 12 to be
hierarchically structured. It is recorded.
[0045]
Thus, in reproduction in the active mode, the main system 4 searches the time information file F2
of each master entry recording recorded in the database 12, and the audio file F1 recorded on
the date and time inputted by the operation of the rotation operator 6. And control the entire
operation to reproduce this audio file F1.
In this case, the effect processing as in the reproduction in the passive mode described later is
omitted.
[0046]
On the other hand, FIG. 7 is a block diagram for explaining the processing of the database 12 in
the passive mode reproduction. The main system 4 is a state of recording immediately before
transiting to the passive reproduction, and parameters (analysis values in real time) to be
recorded in the files F2 to F6 other than the audio file F1 obtained in a fixed period immediately
before ending the recording; The files F2 to F6 related to these parameters related to each audio
file F1 recorded in the database 12 are compared by the function of the sound manager 15, and
the audio file F1 to be reproduced in the passive mode is selected according to the comparison
result. As a result, using the metadata indicating the feature of the audio set in each audio file F1
as a key, the audio file F1 having a sound close to the sound obtained in the last predetermined
period is selected and set as the audio file F1 to be reproduced.
[0047]
Specifically, the main system 4 sequentially determines and quantifies the parameters recorded
10-04-2019
15
in the files F2 to F6 related to the metadata recorded in the database 12 according to the
parameters obtained in this fixed period. For each parameter, a score indicating a similar degree
is detected for sounds obtained in this fixed period. Further, the score for each parameter is
added up for each audio file to detect an overall score, and the audio file to be reproduced is
detected by comparing the overall score.
[0048]
In addition, in the detection of the overall score, by setting the weighting coefficient for the score
related to the specific parameter to a value relatively larger than the score related to the other
parameters, it is possible to set the last constant according to various determination criteria. It is
possible to select an audio file F1 of sound close to the sound obtained in the period. Specifically,
for example, by setting a relatively large weighting coefficient to the score obtained from the
parameter related to the time information file F2 as compared with the score obtained from other
parameters, and detecting the total score, It is possible to select files to be reproduced that are
similar in time to audio files that are similar in time to other audio files as similar audio files.
Incidentally, in this case, in the period indicated by period B in FIG. 3, the file to be reproduced is
an audio file relating to the sound environment on another day, another month, and another year
of the same period as the previous period A. It can be set to On the other hand, for example, by
setting a large weighting coefficient to the parameter related to the information recorded in the
user information file F5 and detecting the overall score, the file to be reproduced is selected on
the basis of the member of the place. be able to.
[0049]
Thus, when the audio file F1 to be reproduced is selected, the main system 4 uses the function
block of the sound manager 15 to record the time information file F2 related to the audio file F1
to be reproduced, the current date and time, and the time The comparison is made to calculate
the elapsed time after the audio file F1 to be reproduced is recorded. Also, the amount of effect to
be added by the sound creator 17 is calculated based on this elapsed time.
[0050]
That is, as in this embodiment, when the audio data D1 obtained from the microphone 2 is
sequentially recorded and recorded and reproduced by the audio file F1, there is a risk that the
10-04-2019
16
side to be recorded may be inconvenient. There is also a risk of violating privacy. In addition,
even if such inconveniences are not violated, it may be embarrassing when playing back and
watching the recorded content.
[0051]
However, such records become more valuable as memories the more time they have been
recorded. Specifically, the recording of his or her voice when he was a baby is a valuable record
for the adult. Thus, it can be said that the value of such a record as a memory increases with the
passage of time, as shown in FIG. 8, and hereinafter, the value of such a record as a memory is
called mind value.
[0052]
Therefore, when the mind value is increased in this way, inconveniences and privacy problems as
in the case of playing and listening immediately after recording are resolved, and furthermore,
the embarrassment is also eliminated. Conceivable.
[0053]
Thus, when effect processing is performed with the largest effect amount, the main system 4 is
set so that the content of the sound of the original sound data D1 can not be grasped, and as
shown in FIG. Thus, the parameter P1 relating to the setting of the effect amount is calculated so
that the effect amount decreases and approaches the original sound.
It should be noted that the setting of the effect amount with respect to the elapsed time is
reduced after the effect amount is held at the maximum value until, for example, the elapsed time
becomes a predetermined value or more instead of defining by the linear function as shown in
FIG. The point can be set by various characteristics such that the amount of effect decreases with
the passage of time.
[0054]
Thus, when the main system 4 calculates the parameter P1 related to the setting of the effect
amount in this way, the function block of the effect setting unit 16 calculates the parameter P2
related to the specific effect, and the sound creator is calculated by this parameter P2. At 17, the
10-04-2019
17
audio data D1 from the audio file F1 is subjected to effect processing to generate audio data D2.
[0055]
FIG. 9 is a table for explaining the effect processing according to the audio data D1.
In this embodiment, the audio data D1 to be processed is divided into blocks at predetermined
time intervals, and the blocks are arranged in a random order and output as audio data D2. In
FIG. 9, each block is numbered to indicate the order. Furthermore, as indicated by the musical
notation mark, the main system 4 temporarily raises the volume at certain time intervals, thereby
adding a sense of rhythm.
[0056]
In this embodiment, the time interval to be provided for the blocking and the volume to be raised
temporarily are set according to the amount of effect, and when the amount of effect is
maximized, the audio data is as if it were music. It is difficult to recognize that D1 is processed. In
addition, the reduction in the amount of effect lengthens the time interval for providing the
blocking and also reduces the temporary rise of the volume. In this embodiment, since the
sampling frequency of the audio data D1 is switched depending on the presence or absence of
the non-stationary component, it goes without saying that the generation process of the audio
data D2 is executed in consideration of the switching of the sampling frequency. There is not.
[0057]
In this case, in place of the arrangement in the random order of the blocks, blocks of similar
sounds may be selected and arranged. Further, as shown in FIG. 10 (A) in comparison with FIG. 9
(A), the temporary rise of the sound volume may be stopped, and as shown in FIG. 10 (B), in each
block. The order of audio data may be reversed, and the order of each block may be reversed.
Also, the same sound may be superimposed to make it overdrive to make it difficult to
understand the contents, or it may be possible to distort voice data to make it difficult to
understand the contents. Further, as shown in FIG. 10C, the audio data D1 may be added so as to
overlap adjacent blocks to make it difficult to understand the contents.
10-04-2019
18
[0058]
(2) Operation of Embodiment In the above configuration, in the recording / reproducing
apparatus 1 (FIG. 1), the audio signal acquired by the microphone 2 is converted into the audio
data D1 by the input / output circuit 3 and this audio data D1 is The database 12 is constructed
by being recorded on the hard disk drive together with the information. Further, the audio data
D1 is reproduced, subjected to effect processing by the functional block of the sound creator 17,
and output from the speaker 5 through the input / output circuit 3 as the audio data D2. In the
recording / reproducing apparatus 1, when reproducing the audio data D1, an elapsed time from
the time of recording is detected by the time information recorded together with the audio data
D1. The amount of effect in the sound creator 17 is set to be reduced (FIG. 7, FIG. 8).
[0059]
As a result, in the recording / reproducing apparatus 1, as the mind value increases, the audio
data is reproduced in such a way as to approach the original sound, and a embarrassing
recording immediately after recording by this, an inconvenient recording when heard by others
In this case, the effect is processed and played back with a large amount of effect, but the amount
of effect is reduced in a recording in which such embarrassment and inconvenience have been
eliminated after a sufficient time has elapsed. It is reproduced by the original voice. By this, in
this embodiment, even if the recording side is not conscious of the fact that it is being recorded
at all, even if it is in the case of recording, the side to be recorded may not be heard any
inconveniences. You can record and keep valuable recordings.
[0060]
More specifically, in the recording / reproducing apparatus 1, the maximum of the effect amount
related to the audio data reproduced in this way is set to the effect amount that makes it difficult
to grasp the content by the audio data, and thereby the recording is surely performed. It is set in
such a way that the intruders are not asked anything inconvenient.
[0061]
Thus, in the recording / reproducing apparatus 1 (FIGS. 2 and 3), the signal level of the audio
data D1 is monitored by the main system 4 and the audio data D1 is recorded in the database 12;
10-04-2019
19
When the value is less than the value, the reproduction of the audio data D2 is started.
Further, the volume of the audio data D2 output from the speaker 5 is feedback controlled so
that the volume of the audio data D1 acquired by the microphone 2 becomes a constant volume.
As a result, in the recording / reproducing apparatus 1, when the volume due to the audio data
D1 obtained from the microphone 2 decreases, the volume from the speaker 5 increases so as to
compensate for the reduction in volume. As a result, in the recording / reproducing apparatus 1,
the continuity of the environmental sound field can be maintained without being aware of the
listener, and for example, when a few people are talking, an awkward state such as when the
conversation suddenly stops Can be avoided.
[0062]
Further, in the recording / reproducing apparatus 1, when the signal level of the audio data
obtained from the microphone 2 is lowered in this way and the reproduction of the audio data
D2 is started, the recording of the audio data D1 is stopped. The termination of the recording
causes one audio file to be stored in the database 12 (FIG. 4). In the recording / reproducing
apparatus 1, while the audio data D 1 is recorded in this way by the functional blocks of the
audio analysis unit 13 and the audio analysis unit 14, the feature of the audio by the audio data
is detected, and the detected feature together with the time information Are also recorded in the
database 12 (FIG. 5). Further, the feature of the sound by the sound data D1 recorded in the
database 12 is determined, and the sound data to be started to be reproduced by the reduction of
the signal level of the sound data is selected by the selection of the sound file (FIG. 6, FIG. 7). .
[0063]
As a result, in the recording and reproducing apparatus 1, the environmental sound can be
compensated so that the supplementary environmental sound can be brought close to the
previous environmental sound. Therefore, the environment for the user of the place where the
recording and reproducing apparatus 1 is installed It is possible to effectively avoid the
discomfort due to the supplementation of the sound.
[0064]
(3) Effects of the Embodiment According to the above configuration, recording is performed by
setting the effect amount to decrease as the elapsed time after recording becomes long, and
effect-processing and outputting the recorded audio data. It is possible that, even if the recording
side is recorded without being aware of the fact that it has been recorded, the side to be recorded
10-04-2019
20
may not be heard inconvenient matters.
[0065]
Also, by ensuring that the maximum amount of effect in this effect processing is the amount of
effect that makes it difficult to grasp the contents of the audio data, it is ensured that the side to
be recorded is not heard inconveniently. Can.
[0066]
In addition, when the signal level by the audio data obtained from the microphone decreases, the
volume of the audio data reproduced from the speaker is increased to compensate for the
decrease in the signal level, and the environmental sound field continues without being aware of
the listener. Sex can be maintained, and for example, an awkward state can be avoided, such as
when several people are talking, or when the conversation suddenly stops.
[0067]
In addition, since the reproduction of the audio data is started by the reduction of the signal level
of the audio data obtained from the microphone, the audio data to be provided for the
reproduction is similar to the audio by the audio data obtained from the microphone immediately
before the signal level decreases. By setting it as the voice data by the voice, it is possible to
effectively avoid the discomfort due to the supplement of the environmental sound.
[0068]
FIG. 11 is a block diagram showing a recording and reproducing apparatus according to a second
embodiment of the present invention in comparison with FIG.
In the recording / reproducing apparatus 21, the same components as those of the recording /
reproducing apparatus 1 described above in the first embodiment are indicated by corresponding
reference numerals, and the redundant description will be omitted.
[0069]
The recording and reproducing device 21 records and reproduces image data obtained from the
10-04-2019
21
imaging device 22 in place of audio data.
Thereby, the recording / reproducing apparatus 21 records the image data obtained from the
imaging device 22 instead of the audio data, and constructs the database 32.
Also, the image data is constantly recorded, and the image data is divided at a constant time
interval and recorded in the database 32 by the image data file.
It should be noted that the image data may be recorded only when a person intrudes into the
area to be imaged by the imaging device 22 instead of always recording such image data, and
only when a change occurs in the image. Image data may be recorded for a predetermined time.
[0070]
In addition, the image data recorded in the database 32 is constantly displayed by the monitor
25, and the display of the monitor 25 is switched between the active mode and the passive mode
by the operation of the controller 8.
Thus, in this embodiment, the display on the monitor 25 provides an indoor and outdoor display.
[0071]
In the recording / reproducing apparatus 21, the main system 24 analyzes the image based on
the image data while recording the image data, and thereby detects the feature of the image.
Further, the image analysis result is recorded in the database 32 in the same manner as the other
files F2 to F6 described above in the first embodiment. Further, the image data file to be
displayed on the monitor 25 is selected and reproduced according to the feature of the image
recorded in the database 32.
[0072]
10-04-2019
22
Further, the image data to be reproduced in this way is subjected to effect processing by setting
the effect amount so that the effect amount decreases as the elapsed time after recording
becomes longer. Therefore, in this embodiment, since the reproduction target to be provided to
the user is image data, it is difficult to specify at least a person, a vehicle, and the like appearing
in an imaging result by the image data when the effect amount is maximized. The effect amount
is set to such an extent. Further, for example, in the case of reducing the gradation of the image
data, or in the case of extremely changing the hue, various effect processing applied to the image
data is applied.
[0073]
According to this embodiment, the effect amount is set to decrease as the elapsed time after
recording becomes long, and the recorded image data is subjected to the effect processing and
output, and the image is taken on the side to be photographed. Even in the case of shooting, it is
possible to prevent the user from seeing something inconvenient even when shooting.
[0074]
By the way, depending on the user, there is a case where it is resistant to supplement
environmental sound only with collected voice data.
Thus, in this embodiment, the environmental sound is compensated by the effect processing by
combining the audio data by the music content and the audio data collected by the microphone.
[0075]
That is, FIG. 12 is a block diagram showing a recording and reproducing apparatus according to
the third embodiment in comparison with FIG. In the recording / reproducing apparatus 41, the
main system 44 collects voice data obtained from the microphone 2 for a certain period of time
by the pressing operation of the pressing operation element 48 and records the same in the
database 42. Thus, the recording and reproducing apparatus acquires and records audio data
from the microphone by an intentional operation by the user. The main system 44 registers voice
data of this fixed time in the database 42 as one voice file. In this embodiment, this fixed time is
set to an extremely short time, which is several tens of seconds, as compared to the playing time
of one music piece by music content described later. In the following, a sound obtained by
reproducing the sound file registered in this way by the speaker 5 is called a private sound. The
10-04-2019
23
voice file is not limited to a length of about several tens of seconds, may be shorter than several
tens of seconds, or may be several minutes or several hours instead. Good.
[0076]
At this time, the main system 44 creates a time information file for each audio file and registers it
in the database 42 in the same manner as described above for the first embodiment.
[0077]
Furthermore, the main system 44 acquires music content by downloading via a network such as
the Internet, and further via various recording media such as an optical disk, and records and
holds the acquired music content in the database 42.
The main system 44 further records in the database 42 time information such as the year in
which each music was created, the year recorded, and the year recorded in the database 42 for
each music by the music content recorded in the database 42. Hold. As a result, in the recording
/ reproducing apparatus 41, the music content and the audio file can be associated by the time
information, and the music content and the music file are recorded and held in the database 42.
[0078]
The main system 44 selects and reproduces the music content and the audio data file recorded in
the database 42 in response to the operation of the operating element 46 by the association
based on the time information, and the audio data and the audio data according to the
reproduction result. The voice data is subjected to effect processing by synthesis and output from
the speaker 5.
[0079]
Here, the operating element 46 is, for example, a pointing device which can move vertically and
horizontally, such as joystick, and can input two-dimensional coordinates, and the main system
44 is music to be reproduced by moving the operating element 46 in the horizontal direction.
Accept a selection of content, audio file age.
10-04-2019
24
Specifically, the main system 44 divides the audio file and the music content into a plurality of
generations according to the time information file of the audio file and the time information of
the music content. This category is, for example, a category with an older age, a slightly older
age, a newer age, etc.
[0080]
In this case, when the user operates the operating element 46 to the left, the main system 44 sets
the section having the old generation age as the reproduction target section, whereas the user
operates the operating element 46 to the right. Sets the new age category as the category to be
regenerated. Also, when the user does not move the operating element 46 to the left or right, a
section having a slightly older generation is set as a target to be reproduced. Here, in place of
such division by relative age, for example, audio data such as 1980's, 1990's, 2000's, etc. are
divided by a period of time according to time information of audio files and music contents. Files
and music contents may be divided.
[0081]
As described above, when the input of the reproduction target division is received, the main
system 44 starts reproduction of the music content and the audio file divided into the
reproduction target. At this time, as indicated by reference symbols A1 to C1 in FIG. 13, the main
system 44 controls the operation of the reproduction system to provide only the music content at
random or in a programmed order immediately after the start of reproduction. Also, when
reproduction is started and the reproduction time becomes equal to or longer than a
predetermined time, the operation of the reproduction system is controlled so as to be
reproduced by inserting an audio file between music contents as indicated by reference symbols
A2 to B2. Furthermore, as indicated by symbols A3 to C3, as the playback time becomes longer,
the frequency of inserting an audio file between music contents is increased, and as indicated by
symbols A4 to C4, only the audio file is finally provided. In this case, in place of the insertion of
files between music contents, an audio file may be inserted in the middle of one music piece of
music contents. Further, as indicated by reference symbols A3A to C3A in comparison with
reference symbols A3 to C3, the music content and the audio file are simultaneously played back
so that the audio content is covered with the music content, and the playback time is the
playback time It may be made variable.
[0082]
10-04-2019
25
That is, in the case where music content is viewed for a long time, the user may get bored and
switch to radio broadcasting or the like on the way to switch the mood. As a result, as shown in
FIG. 14, in the recording / reproducing apparatus 41, the length of the audio file to be
synthesized with the music content is increased as the reproduction time becomes longer, and
the part is kept from getting tired.
[0083]
In this way, the main system 44 combines the audio file with the music content, and the audio
file is divided into new sections as indicated by the reference symbols B2 to B4 and the reference
symbols C2 to C4 in comparison with the reference symbols A2 to A4, respectively. As far as it
belongs, audio data of a plurality of audio files are synthesized and synthesized with music
content. As a result, as shown in FIG. 15, the main system 44 sets the effect amount to decrease
as the elapsed time after recording becomes longer, and effects processed and outputs the
recorded audio data.
[0084]
According to this embodiment, the process of combining audio data and music content is applied
to the effect process, and the effect amount is set to decrease as the elapsed time after recording
becomes longer. Similar effects can be obtained. In addition, in this embodiment, privacy-aware
reproduction is enabled without arbitrarily selecting a sound, and unlike in the case of merely
reproducing music content, music is connected to music, making the user aware of the gap,
music It enables rough playback that enhances the value of both content and audio files.
[0085]
More specifically, by increasing the number of audio files to be provided for synthesis as the
elapsed time after recording becomes shorter, by setting the effect amount to decrease as the
elapsed time after recording becomes longer, The same effect as that of the first embodiment can
be obtained.
[0086]
In the above-described first embodiment, the case where the effect processing is performed only
10-04-2019
26
in the case of reproducing audio data and image data in the passive mode has been described,
but the present invention is not limited thereto. Effect processing may also be performed when
playing back.
[0087]
Further, in the above-described first embodiment, recording of audio data is stopped due to a
decrease in signal level of an audio signal obtained by the microphone, and audio data recorded
and held is provided in the third embodiment. Although the case has been described where audio
data is recorded for a certain period of time by the operation of the operator by the user, the
present invention is not limited to this, and audio data may always be recorded and reproduced.
[0088]
In the above-described third embodiment, although the case of starting the reproduction and
gradually increasing the ratio of the audio file to be provided to the user has been described, the
present invention is not limited to this and this ratio may be waved by the reproduction time or
the like The ratio may be maintained at a constant value, or the ratio may be changed in response
to an operation by the user.
[0089]
In the third embodiment described above, the audio file is divided and the music content is
divided to correspond to the division. However, the present invention is not limited to this, and it
is possible to divide the music file into such divisions. The division of the corresponding music
content may be omitted.
[0090]
Further, in the above-described third embodiment, the amount of effect decreases as the elapsed
time after recording becomes longer by increasing the elapsed time after recording as the
number of audio files to be combined with the music content becomes shorter. However, the
present invention is not limited thereto, and music files to be combined with music contents are
variously processed and recorded in the same manner as described in the first embodiment. The
effect amount may be set to decrease as the elapsed time becomes longer.
[0091]
In the above embodiment, although the case of recording and reproducing the audio data and the
10-04-2019
27
image data has been described, the present invention is not limited to this, and is applied to the
case of recording and reproducing the audio data and the image data together. Can.
In this case, the image data and the audio data to be provided to the user may be individually
reproduced and processed, and the unrelated image data and the audio data may be provided as
a set to the user. Audio data and image data may be provided to the user as a set.
Also, immediately after recording, irrelevant image data and audio data are provided to the user,
and the image data and audio data are combined so that the correspondence relationship
becomes clear as the elapsed time becomes longer. You may do so.
However, in this case, it is possible to easily grasp the comprehensive contents grasped by the
image data and the voice data as it becomes difficult to grasp immediately after the recording as
the elapsed time becomes longer.
[0092]
In the above-described first and second embodiments, the case where various features are
detected from audio data and image data to select a reproduction target has been described, but
the present invention is not limited to this, and audio data and image data are described. In the
detection of the features from the above, various parameters can be applied without being
limited to those applied to the above-described embodiment.
[0093]
Although the scope of the present invention is not included in the present application, in the case
where audio data is merely reproduced and provided in place of background music, and in order
to provide a display, reduction of the effect amount is omitted due to elapsed time. The audio
data and the image data may be subjected to effect processing and provided to the user with a
certain amount of effect that makes it difficult to grasp the contents.
[0094]
The present invention relates to a recording and reproducing apparatus, a control method for the
recording and reproducing apparatus, and a control program for the recording and reproducing
apparatus, and can be applied to provision of environmental sound instead of background music,
for example.
10-04-2019
28
[0095]
FIG. 1 is a block diagram showing a recording and reproducing apparatus according to a first
embodiment of the present invention.
It is a state transition diagram which shows the transition of operation | movement of the
recording and reproducing apparatus of FIG.
5 is a time chart provided to explain reproduction of audio data.
It is a graph which shows the relationship between the file by audio data, and the file in
metadata.
It is a chart for explaining the metadata set in each file.
It is a block diagram for explaining the management in the database of each file.
FIG. 10 is a block diagram serving to explain processing of a database in passive mode
reproduction. FIG. 6 is a characteristic curve diagram showing the relationship between mind
value and effect amount. It is a chart used for explanation of the effect processing of sound data.
FIG. 7 is a table for describing another example of the effect processing of audio data. FIG. It is a
block diagram which shows the recording / reproducing apparatus based on Example 2 of this
invention. It is a block diagram which shows the recording / reproducing apparatus based on
Example 3 of this invention. FIG. 13 is a table for describing processing of effects in the
recording and reproducing apparatus of FIG. 12; FIG. FIG. 13 is a characteristic curve diagram
showing a relationship between reproduction time and reproduction frequency of an audio file in
the recording and reproduction apparatus of FIG. 12; FIG. 13 is a characteristic curve diagram
showing the relationship between the elapsed time from the time of recording and the processing
of an audio file in the recording and reproducing apparatus of FIG. 12;
Explanation of sign
10-04-2019
29
[0096]
1, 21, 41 ...... recording / reproducing device, 2 ...... microphone, 4, 24, 44 ...... main system, 5 ......
speaker 6, 6 回 転 rotary operator, 7 LED LED 8, 8, 46, 48 ...... Operator, 12, 32, 42 ... database,
13 ... acoustic analysis unit, 14 ... voice analysis unit, 15 ... sound manager, 17 ... sound creator
10-04-2019
30
Документ
Категория
Без категории
Просмотров
0
Размер файла
47 Кб
Теги
description, jp2007087559
1/--страниц
Пожаловаться на содержимое документа