close

Вход

Забыли?

вход по аккаунту

?

JP2017169066

код для вставкиСкачать
Patent Translate
Powered by EPO and Google
Notice
This translation is machine-generated. It cannot be guaranteed that it is intelligible, accurate,
complete, reliable or fit for specific purposes. Critical decisions, such as commercially relevant or
financial decisions, should not be based on machine-translation output.
DESCRIPTION JP2017169066
Abstract: To solve at least one problem that occurs when connection with part of a plurality of
other communication devices can not be established. According to one embodiment, a content
transmission apparatus includes a communication unit that receives an instruction for content
reproduction using a plurality of other communication devices, and a communication connection
with a part of the plurality of other communication devices. In accordance with the determination
by the determining unit that determines that the communication connection could not be
established, and the determination unit that the communication connection with a part of the
plurality of other communication devices can not be established, And means for notifying the
user of [Selected figure] Figure 5
Transmission apparatus and control method thereof
[0001]
The present invention relates to a transmitter that communicates with a plurality of other
communication devices and a control method thereof.
[0002]
2. Description of the Related Art In recent years, a technology has been widely used in which a
screen of a small terminal such as a smartphone is encoded as a video and transmitted to a
receiving terminal provided with a large screen, and mirroring of display of the small terminal is
displayed on the large screen.
01-05-2019
1
As such technology, there is Wi-Fi (registered trademark) CERTIFIED Display (WFD). WFD can
also transmit audio as well as video. This WFD technology can be used to transmit audio or video
from one source (transmitter) device to multiple sink (receiver) devices, or from multiple source
devices to one sink device (Patent Document 1). . Using such a technology, it is possible to create
a wireless speaker system using a plurality of sink devices (speaker groups).
[0003]
International Publication No. 2011/122456
[0004]
However, in a wireless speaker system using a plurality of sink devices (speaker groups), there
may be a case where wireless connection with a part of the speaker groups is not established.
[0005]
The present invention has been made in view of the above problems, and has the following
objects.
That is, it is an object of the present invention to solve at least one problem that occurs when a
transmitting device can not connect to a part of a plurality of other communication devices when
reproducing content using a plurality of other communication devices. I assume.
[0006]
In order to solve the above-mentioned problems, the communication apparatus according to the
present invention has the following configuration.
That is, in the content transmission apparatus, communication connection is established between
the reception unit for receiving an instruction for content reproduction using a plurality of other
communication devices, and part of the other communication devices among the plurality of
other communication devices. In response to determining that the communication connection
with a part of the plurality of other communication devices can not be established by the
01-05-2019
2
determination means for determining that the failure could not be made, and the determination
means And notification means for giving a predetermined notification to the user.
[0007]
According to the present invention, at least one problem caused when a transmitting device can
not connect to a part of a plurality of other communication devices when reproducing content
using a plurality of other communication devices is solved. can do.
[0008]
FIG. 1 illustrates an exemplary configuration of a system that performs 1-to-N and M-to-1
communications.
It is a figure which shows the hardware constitutions of a source device and a sink device. It is a
figure which shows the sequence at the time of the normality in 1 to 1 connection. It is a figure
showing composition of a speaker in 7.1ch audio reproduction system. FIG. 7 is a diagram
showing a sequence in an operation example 1; FIG. 18 is a diagram illustrating a sequence in
operation example 2; FIG. 18 is a diagram illustrating a sequence in operation example 3; FIG. 20
is a diagram illustrating a sequence in operation example 4; 10 is an operation flowchart in an
operation example 1 and an operation example 3; 10 is an operation flowchart in an operation
example 2; 15 is an operation flowchart in an operation example 4;
[0009]
Hereinafter, preferred embodiments of the present invention will be described in detail with
reference to the drawings. The following embodiment is merely an example and is not intended
to limit the scope of the present invention.
[0010]
First Embodiment As a first embodiment of the communication device according to the present
invention, an audio video (AV) system including a source device and a sink device will be
described as an example.
01-05-2019
3
[0011]
<System Configuration> FIG. 1 is a diagram showing an exemplary configuration of a system that
performs 1-to-N and M-to-1 wireless communications.
Here, M and N are both integers of 1 or more. This system includes M source devices 101A to
101M (hereinafter also referred to simply as source devices 101) and N sink devices 102A to
102N (hereinafter also referred to simply as sink devices 102).
[0012]
The source device 101 is a device on the transmission side of audio or video, and is configured to
be communicable with N sink devices 102. For example, it is an imaging device such as a camera
or a video camera, an image input device such as a scanner, or a storage device such as a hard
disk device or a memory device. Of course, it may be an information processing apparatus such
as a personal computer (PC) or a smartphone.
[0013]
The sink device 102 is a device on the audio or video receiving side, and is configured to be
communicably connectable to M source devices 101. For example, it is an audio output device
such as a television, a display, a video output device such as a projector, and a speaker.
[0014]
In the following description, it is assumed that the source device 101 and the sink device 102
perform wireless communication conforming to the IEEE 802.11 series. However, wireless
communication conforming to the standards such as Bluetooth (registered trademark), UWB,
ZigBee, and MBOA may be used. In addition, wired communication such as wired LAN may be
used.
[0015]
01-05-2019
4
In addition to direct communication between the source device 101 and the sink device 102,
communication may be performed via a relay device (not shown) such as an access point. MBOA
is an abbreviation for Multi Band OFDM Alliance. Also, UWB includes wireless USB, wireless
1394, WINET and the like.
[0016]
FIG. 2 is a diagram showing a hardware configuration of the communication device 200
operating as the source device 101 or the sink device 102. As shown in FIG.
[0017]
The storage unit 201 is configured by a memory such as a ROM or a RAM, and stores programs
for performing various operations described later, and various information such as
communication parameters for wireless communication.
Note that, as the storage unit 201, storage media such as a flexible disk, a hard disk, an optical
disk (CD, DVD), a magneto-optical disk, a magnetic tape, a non-volatile memory card and the like
may be used other than memory such as ROM and RAM. In addition, the storage unit 201 may
include a plurality of memories.
[0018]
The control unit 202 is configured by a processor such as a CPU or an MPU, and controls the
entire communication device 200 by executing a program stored in the storage unit 201. Note
that the control unit 202 may control the entire communication apparatus 200 by cooperation of
a program stored in the storage unit 201 and an OS (Operating System). In addition, the control
unit 202 may include a plurality of processors such as a multi-core processor, and control the
entire communication apparatus 200 by the plurality of processors. The control unit 202 also
controls a function unit 203 described later to execute predetermined processing such as
imaging, printing, and projection.
[0019]
01-05-2019
5
The functional unit 203 is hardware for executing a predetermined process. For example, when
the communication apparatus 200 operates as the source apparatus 101, the functional unit 203
has an imaging function such as a camera and an image coding function. When the
communication device 200 operates as the sink device 102, the functional unit 203 has an image
decoding function and a display function like a display. Furthermore, the data processed by the
functional unit 203 may be data stored in the storage unit 201, or may be data communicated
with another communication apparatus via a communication unit 206 described later.
[0020]
The input unit 204 receives various operations from the user. The output unit 205 performs
various outputs to the user. Here, the output by the output unit 205 includes at least one of
display on a screen, audio output by a speaker, vibration output, and the like. Note that both the
input unit 204 and the output unit 205 may be realized by a single module as in the case of a
touch panel.
[0021]
The communication unit 206 controls wireless communication conforming to the IEEE 802.11
series, and controls IP communication. Further, the communication unit 206 controls the
antenna 207 to transmit and receive a wireless signal for wireless communication. The source
device 101 transmits content such as image data, document data, audio / video data to the sink
device 102 via the communication unit 206.
[0022]
<Basic Operation of Communication Device 200> Basic Sequence of Source Device and Sink
Device FIG. 3 is a diagram showing a normal sequence between the source device and the sink
device in one-to-one connection. Specifically, it shows an operation from device search to service
execution between one source device and one sink device implemented by separate
communication devices 200, respectively. Here, an example of a sequence in an apparatus
conforming to the WFD standard is shown.
01-05-2019
6
[0023]
In S301, the source device 101 transmits a search packet for device search. The search packet
may be a broadcast packet or a unicast packet. In S302, the sink device 102 receives the search
packet, and transmits a response packet for the search packet. Here, the response packet
includes the device name of the sink device 102 itself, the link address of the device, the device
type, and the like.
[0024]
Here, the device type is any of “Source (source)”, “Primary Sink (primary sink)”,
“Secondary Sink (secondary sink)”, and “dual role (both source and sink)”.
[0025]
In S303, the source device 101 transmits a search packet for service search.
In S304, the sink device 102 receives the search packet, and transmits a response packet to the
search packet. At this time, the sink device 102 includes service information that can be provided
in the response packet.
[0026]
Here, the service information may be “Send” for file transfer, “Print” for printing, “Play”
for audio / video streaming, “Display” for mirroring, or “Other”. It is.
[0027]
According to the procedure up to this point, the “service” and the “role” in the service are
determined between the two devices.
The role will be described later.
01-05-2019
7
[0028]
In S305, the source device 101 and the sink device 102 connect the link layer. This is a
procedure such as authentication, association, and Wi-Fi Direct Group Owner (GO) negotiation of
the IEEE 802.11 standard.
[0029]
In S306, the source device 101 and the sink device 102 perform connection of the IP layer
(Internet Protocol). Here, when connected by Wi-Fi Direct, the one who has become GO operates
the DHCP server function and assigns the IP address of the opposite client device.
[0030]
In step S307, the source device 101 transmits, to the sink device 102, a capability inquiry packet
regarding service execution of the sink device 102.
[0031]
In S308, the sink device 102 transmits a response packet to the capability inquiry.
Here, the response packet includes detailed information on services that can be provided by the
sink device 102. This detailed information is the decoding capability, resolution, and the like
when the sink device 102 is a display or a projector and the service that can be provided is
“Display”. On the other hand, when the sink device 102 is a speaker, it is a role and a position.
Here, the roles are “Front (front)”, “SubWoofer (subwoofer)”, “Center (center)”,
“Surround (surround or rear)”, “Surround. "Back (surround back)" and the like. Also, the
positions are "right" and "left". In addition, the sink device 102 has “Surround” and
“Surround. A plurality of pieces of information can be replied as “Back”.
[0032]
01-05-2019
8
In S309, the source device 101 transmits capability designation for designating the capability of
the sink device 102. In S310, the sink device 102 responds to the received capability
designation. Note that this procedure can also be performed at any timing. このことにより、いっ
たん、たとえば、「Surround. It is also possible to operate the sink device operated as
“Back” as “Surround”.
[0033]
In S311, the source device 101 transmits parameter settings for the RTSP procedure. In S312,
the sink device 102 returns a response to the received parameter setting. In S313, the source
device 101 transmits a setup (setup) of the RTSP procedure. In S314, the sink device 102 returns
a response to the received SETUP.
[0034]
At S315, the source device 101 makes a reproduction request for the RTSP procedure. In S312,
the sink device 102 returns a response to the reproduction request. At this point, the sink device
102 is ready to play the audio or video streaming data from the source device 101.
[0035]
In the following description, the procedure performed between communication devices after
connection by the link layer may be expressed as a session.
[0036]
FIG. 4A is a view showing the configuration of a speaker in a 7.1-ch audio reproduction system
by wireless communication.
This corresponds to the case of N = 8 in the 1-to-N network 111 of FIG.
[0037]
01-05-2019
9
The source device 101 has content such as music. The sink device 102A is a Front / L (front left)
speaker, and the sink device 102B is a front / R (front right) speaker, and these two reproduce
the forward sound. Hereinafter, similarly, the sink device 102C is a subwoofer (subwoofer), and
the sink device 102D is a speaker of a center (center). Further, the sink device 102E is a speaker
of Surround / L (surround left), and the sink device 102F is a speaker of Surround / R (surround
right). The sink device 102G is Surround. Back / L (surround back left), the sink device 102H is
Surround. It is a speaker of Back / R (surround back right).
[0038]
FIG. 4B shows a configuration table 401 showing the necessary configuration of the audio
reproduction system. The configuration table 401 defines a plurality of combinations of speakers
required for audio reproduction. Here, a combination of speakers required for playback of 7.1 ch,
5.1 ch, 3.1 ch, 2.1 ch and 2.0 ch is defined. Here, a combination of one line or a plurality of lines
is referred to as service configuration information or service profile. Further, the configuration
table 401 is held in the storage unit 201. Also, the user of the source device 101 can change the
service configuration information via the input unit 204.
[0039]
<Operation Example> Hereinafter, an operation example in the above-described configuration
will be described. In particular, in the operation examples 1 to 3, the setting change operation of
the audio reproduction configuration when the session establishment with a part of the plurality
of sink devices is not completed will be described. Further, in the operation example 4, a
connection setting change operation in a multiplayer game in which the number of source
devices connected to one sink device changes in the middle will be described.
[0040]
・ Operation example 1: When the connection procedure with some speakers is not completed
As operation example 1, when instructing playback by 7.1 channels by 8 speakers, connection
with one speaker can not be established. Control will be described. Specifically, an example of
performing 5.1 channel reproduction that can be configured by seven speakers with established
connection will be described. The system configuration is assumed to be the 7.1ch audio
01-05-2019
10
reproduction (content reproduction) system shown in FIG.
[0041]
FIG. 5 is a diagram showing a sequence in the first operation example. From the left, UI (user
interface) for receiving an operation from the user, a source device which is a communication
device, and a sink device group (eight speakers) which is a plurality of external communication
devices are shown, showing control among the devices ing.
[0042]
In S501, the source device 101 displays a GUI for receiving an operation from the user. Here, the
user designates "7.1ch" as "service configuration information (profile)". For example, the user
selects a button displayed as a GUI by pressing it. Note that instead of specifying the service
configuration information (profile), the number of sink devices may simply be specified. In S502,
the source device 101 detects that “7.1 ch” has been designated. In S503, the source device
101 displays “configure 7.1 ch” on the output unit 205.
[0043]
In S504, the source device 101 performs the procedure from S301 to S312 in FIG. 3 with the
sink device 102A (Front / L). In the following description, performing this series of procedures
will be referred to as "to parameter setting". Thereafter, similarly, in S505 to S510, from Front /
R to Surround. The procedure of “to parameter setting” is completed for five speakers up to
Back / L.
[0044]
In S511, the source device 101 transmits the sink device 102H (surround. Try the procedure of
"To parameter setting" with Back / R). However, here, RTSP parameter settings have not been
completed. In S512, the source apparatus 101 detects a timeout of RTSP parameter setting, and
determines that the procedure of “to parameter setting” has failed. It should be noted that the
determination of the procedure failure of “to the parameter setting” may be made not only by
01-05-2019
11
the timeout but also by the occurrence of a protocol error such as an incorrect value response or
an incorrect procedure.
[0045]
In S513, the source device 101 sets the sink device 102H (surround. “Surround back right can
not be connected” is displayed on the output unit 205, indicating that the procedures of “Back
/ R” and “to parameter setting” can not be performed. That is, error notification is given to
the user. In S514, the source device 101 performs display for allowing the user to select control
in this state. Here, the user is presented with "(A) Reproduction with other configuration", "(B)
Continue as it is", and "(C) end" as options.
[0046]
Here, although the option (A) will be described in detail later, using the seven sink devices for
which the procedure up to the parameter setting has been completed, other options (such as
“5.1 ch”) are used. It means to carry out regeneration. The option (B) means that the
reproduction procedure as originally specified is advanced using the seven sink devices for which
the procedure up to the parameter setting has been completed. That is, in this case, “right” is
not reproduced with respect to surround back, and only “left” is reproduced.
[0047]
Further, option (C) means to cancel and finish the procedure with the sink device so far. For
example, Teardown of the RTSP procedure, disconnection of the IP layer, or disconnection of the
link layer can be used for termination. In addition, PAPE (temporary stop) of RSTP may be
performed before these disconnections.
[0048]
In S515, the source device 101 receives a selection (operation instruction) of any option from the
user. Here, it is assumed that the user selects option (A). In S516, the source device 101
recognizes that the option (A) is selected as a result of the user inquiry.
01-05-2019
12
[0049]
Therefore, the source device 101 determines a configuration to replace “7.1 ch” that was
originally instructed by the user. In this determination, for example, the configuration is
automatically selected in accordance with the configuration registered in the configuration table
401 and the connection state with the current sink device. More specifically, a configuration
which can be normally reproduced is selected by a combination of currently connected sink
devices.
[0050]
For example, referring to the configuration table 401, the configurations that can be reproduced
normally using the seven speakers described above are “2.0 ch”, “2.1 ch”, “3.1 ch” and
“5.1 ch”. Therefore, the user selects "5.1 ch" which can be reproduced closest to the "7.1 ch"
specified by the user. Note that other configurations may be selected automatically, or may be
configured to receive a selection from the user. Hereinafter, the case where the “5.1 ch”
configuration is selected will be described.
[0051]
In S517 to S522, the RTSP reproduction procedure is executed on six of the seven speakers (sink
devices 102A to 102F) connected wirelessly. On the other hand, in S523, the source device 101
executes RTSP PAUSE (temporary stop) procedure for one of the seven speakers (the sink device
102G) wirelessly connected. That is, while continuing the communication connection with seven
(N) sink devices with which communication connection has been established among a total of
eight (M) sink devices, six (L) fewer than seven Control is performed to perform content
reproduction by a configuration using the sink device. And control of temporary stop is
performed to one (N-L) sink devices.
[0052]
In S524, the source device 101 transmits the audio stream of each role (channel) to each of the
01-05-2019
13
corresponding sink devices 102A to 102F. In S525, the source device 101 displays
“reproducing on 5.1 ch” on the output unit 205.
[0053]
Note that, in S524, the audio stream of each role (channel) may be multiplexed and transmitted
by, for example, MPEG-TS. That is, the same data (multiplexed stream) may be transmitted to all
the sink devices, and each sink device may extract and reproduce data of its own role (channel).
At this time, in S523, the reproduction procedure may be performed with the sink device 102G,
and data to the sink device 102G may not be multiplexed.
[0054]
In any case, the sound is not reproduced from the sink device 102G, and the reproduction with
5.1 channels by six speakers (sink devices 102A to 102F) is performed. By performing control in
this manner, for example, it is possible to prevent audio reproduction in an unbalanced state in
which a sound is emitted from only one of the left and right paired speakers.
[0055]
Note that the selection of the service configuration information according to the situation is not
limited to simply excluding “only the pair of speakers” from the reproduction targets. For
example, if the procedure of “to parameter setting” is not completed with SubWoofer,
“Center”, “Surround” and “Surround. It is good also as composition of "2.0ch" except for
"Back" from reproduction object. In any case, the configuration may be selected in accordance
with the wirelessly connected speaker and the set of speakers used in each configuration defined
in the configuration table 401.
[0056]
According to this selection method, when “to parameter setting” is not completed between
“Center”, two “2.0 ch” and “2.1 ch” configurations (that is, a plurality exist) are
candidates . In this case, the configuration of “2.1 ch” closer to “7.1 ch”, which is the initial
01-05-2019
14
request by the user, may be preferentially selected.
[0057]
As described above, according to the operation example 1, even when connection is not made
with a part of a plurality of sink devices used in the configuration designated by the user, it is
possible to perform reproduction with less discomfort. . That is, with less operation and control
procedures by the user, balanced reproduction can be realized with a configuration close to the
configuration intended by the user. Also, since the session with the already established speaker is
diverted, the user is not forced to wait.
[0058]
Operation Example 2: As a subsequent control operation example 2 during reproduction after the
operation example 1, the operation following the operation example 1, specifically, switching to
reproduction with 7.1 ch during reproduction with 5.1 ch The operation of the case will be
described. FIG. 6 is a diagram showing a sequence in the operation example 2.
[0059]
In S601, the source device 101 sets “Surround. Do you want the output unit 205 to search for
other speakers in order to ask the user whether to perform control for Back / R search? Or “Do
you want to try 7.1ch connection? Display “”. In S602, the source device 101 receives an
operation from the user. Here, it is assumed that the user performs an operation of selecting
“Yes”. In S603, the source device 101 detects an operation by the user, and starts searching
for a sink device. Here, it is assumed that the new sink device 102X can operate as a speaker.
[0060]
In S604, the source device 101 completes the “to parameter setting” procedure with the sink
device 102X. The procedure "to parameter setting" is a process in which the procedures from
S301 to S312 in FIG. 3 are summarized as described above.
01-05-2019
15
[0061]
In S605, is the source device 101 “7.1ch? Display "and ask the user. In S606, the source device
101 receives an operation from the user. Here, it is assumed that the user performs an operation
of selecting “Yes”. In S607, the source device 101 detects an operation by the user. It should
be noted that, after completion of S604, it may be configured to determine again whether or not
the connection with the eight sink devices used in 7.1 ch reproduction is established.
[0062]
In S608, the source device 101 executes the RTSP reproduction procedure with the sink device
102G. In S609, the source device 101 executes the RTSP reproduction procedure with the sink
device 102X. In S610, the source device 101 transmits an audio stream (Surround. 2) to the sink
device 102G and the sink device 102X. Back / L and Surround. Transmit Back / R) anew. In
S611, the source device 101 displays “playing with 7.1 ch” on the output unit 205.
[0063]
If the sink device 102H is detected in the search in S603, the sink device 102H may be
connected instead of the sink device 102X. Furthermore, when disconnection with an arbitrary
sink device is detected during reproduction, it is also possible to perform control of “searching
for a device”.
[0064]
As described above, according to the operation example 2, it is possible to change to
reproduction with another configuration while performing reproduction with a certain
configuration with less operation and control procedure by the user. In particular, in order to
divert the session with the already established speaker, it is possible to quickly change to a new
configuration.
[0065]
01-05-2019
16
Operation Example 3 Changing the Role of Speakers As the operation example 3, the control in
the case where connection with one speaker is not established when reproduction on 7.1 ch by 8
speakers is instructed will be described. However, unlike the operation example 1, an operation
in the case where a connection with the sink device 102F ("Surround / R" speaker) is not
established is shown.
[0066]
FIG. 7 is a diagram showing a sequence in the operation example 3. Steps S501 to S512 are
substantially the same as those in FIG. However, as described above, it differs from the operation
example 1 in that the procedure of “to the parameter setting” is not completed with the sink
device 102F (the speaker of “Surround / R”) as described above.
[0067]
That is, the timeout in S512 is a timeout in the procedure with the sink device 102F. Such a state
occurs because the source device 101 performs the procedure with each sink device in parallel.
[0068]
Furthermore, in the operation example 3, the source device 101 has confirmed that the sink
device 102G and the sink device 102H have two roles as capabilities. Specifically, the sink device
102G has “Surround / L” and “Surround. It can operate in one of two roles, Back / L ". The
sink device 102H has "Surround / R" and "Surround. It can operate in one of two roles, Back / R
′ ′. That is, the source device 101 knows that the roles of the sink device 102G and the sink
device 102H can be changed.
[0069]
In S701, the source device 101 displays, on the output unit 205, the sink device 102H that is
“Surround / R” and “can not connect to surround right” indicating that the procedure “to
01-05-2019
17
parameter setting” can not be completed. In S702, the source device 101 performs display for
allowing the user to select control in this state. The options are "(A) Reproduction with other
configuration", "(B) Continue as it is", and "(C) End".
[0070]
In S703, the source device 101 receives the selection of the above option from the user, and
detects that the option (A) is selected here.
[0071]
However, since “Surround / R” is not connected yet and can not be used here, the
configuration “3.1 ch” is selected based on the configuration table 401 when the same control
as in the operation example 1 is performed. become.
In that case, the connection is complete “Surround. The two speakers of “Back” are not used
and are wasted. Therefore, in the operation example 3, “Surround. Change the roles of the two
speakers connected as Back to "Surround" and play "5.1 ch".
[0072]
Therefore, in S704, the source device 101 executes RTSP PAUSE (temporary stop) procedure for
the sink device 102E. On the other hand, in S705, the source device 101 performs the procedure
of capability setting for the sink device 102G. In this case, the original "Surround. Specify
"Surround / L" instead of Back / L ". Similarly, in S706, the source device 101 performs a
procedure of capability setting for the sink device 102H. In this case, the original "Surround.
Specify “Surround / R” instead of Back / R ”.
[0073]
In S707, the source device 101 transmits the audio stream of each role (channel) to each of the
corresponding sink devices 102A to 102D, 102G, and 102H. In step S708, the source device 101
displays, on the output unit 205, "changing the speaker and playing on 5.1 ch".
01-05-2019
18
[0074]
In addition, the change of the role of a speaker is "Surround. It is not limited to the change from
“Back” to “Surround”. That is, various changes are possible depending on the configuration
table 401 and the possible roles and positions of the speakers.
[0075]
As described above, according to the operation example 3, even when connection is not made
with a part of a plurality of sink devices used in the configuration designated by the user, it is
possible to perform reproduction with less discomfort. . In particular, it is possible to perform
more realistic reproduction by fully utilizing the connection with the already established speaker.
[0076]
Operation Example 4 Operation in Multiplayer Game FIG. 8 is a diagram showing a sequence in
the operation example 4. Here, a multiplayer game is assumed in which screens of a plurality of
source devices (tablet terminals) are displayed on one sink device (large display). From the left, a
UI (user interface) for receiving an operation from a user, a sink device, and a source device
group (four units) are shown, and control between devices is shown.
[0077]
That is, this corresponds to the case of M = 4 in the M to 1 network 112 of FIG. However, it is
assumed that there is no predetermined connection configuration as in the operation examples 1
to 3, and the number of devices constituting the game is arbitrary.
[0078]
In S801, the sink device 102 displays a GUI for starting participation acceptance of a game, and
01-05-2019
19
accepts an operation from the user. In S802, the sink device 102 detects an operation to start
accepting a game.
[0079]
In S803, the sink device 102 displays “Waiting for Player”. At the same time, it waits for
device search from the source device and / or notifies that the game service is being activated.
For example, a beacon signal indicating that the device type is a sink (sink) is transmitted, or an
advertise packet indicating that the Display service is executable is transmitted.
[0080]
In S804, the sink device 102 performs “to parameter setting” with the source device 101A.
Then, in S805, the sink device 102 displays “Connected to Player 1”. However, since the
number of game participants is one at this time, the sink device 102 continues to stand by for
acceptance of game participation.
[0081]
In S806, the sink device 102 performs “to parameter setting” with the source device 101B.
Then, at S 807, the sink device 102 “connected to Player 2. Do you want to start the game?
Display “”. That is, the number of game participants is two or more, and the sink device 102
notifies the user of acceptance of the game start. Similarly, in S808, the sink device 102 performs
“to parameter setting” with the source device 101C. Then, in S809, the sink device 102
displays “Connected with Player 3”.
[0082]
In S810, the sink device 102 displays a GUI for instructing a game start, and receives an
operation from the user. In S811, the sink device 102 detects a game start operation.
Accordingly, in S812 to S814, the sink device 102 executes the reproduction procedure with the
source devices 101A to 101C.
01-05-2019
20
[0083]
In S815 to S817, each of the source devices 101A to 101C transmits audio or video to the sink
device 102. In S818, the sink device 102 reproduces the audio or video received from the source
devices 101A to 101C. That is, the output unit 205 performs audio reproduction or screen
display.
[0084]
In S819, the source device 101D searches for a service for the game in accordance with the
game start operation by the user (Player 4) of the source device 101D. In S820, does the sink
device 102 connect “Player 4 to output unit 205? Display “”.
[0085]
As described above, according to the operation example 4, in the multiplayer game, it is possible
to advance the procedure to the reproduction without designating the number of opposing
communication partners in advance, and the operability is improved.
[0086]
In the operation examples 1 to 4 described above, the description has been made assuming
communication (DHCP control and RTSP control) in the IP layer based on the Wi-Fi Direct
standard.
However, control may be performed for communication in the link layer.
[0087]
<Operation Flowchart of Communication Device 200> FIG. 9 is an operation flowchart in the case
where the communication device 200 operates as a source device. It corresponds to what
describes the operation of the source device in the operation example 1 and the operation
01-05-2019
21
example 3 described above. That is, the operation of the source device described in FIG. 5 and
FIG. 7 is described in a flowchart form. This shows the flowchart of the flow of processing
realized by the control unit 202 reading out the program stored in the storage unit 201 and
executing it in the communication device 200.
[0088]
At S900, the communication device 200 is in the initial state. Here, it is shown that the
communication device 200 is in the “dual role”, that is, in the state of being provided with the
functions of both the source device and the sink device. For example, it is an apparatus capable
of performing both transmission and reception of audio or video, such as a laptop computer and
a tablet terminal.
[0089]
In S901, the communication apparatus 200 determines whether the user has performed an
operation to start an operation as a source apparatus of an audio or video (AV) service. If it is
determined that the operation to start the operation as the source device has been performed,
the process advances to step S902; otherwise, the process advances to the flowchart in FIG. 11
described later.
[0090]
In step S902, when the communication apparatus 200 operates as a source apparatus, the
communication apparatus 200 determines service configuration information of the sink
apparatus group, and sets the service configuration information as “first configuration
information of service”.
[0091]
In S903, the communication apparatus 200 starts a timer of the service procedure.
Here, the service procedure is a procedure determined independently between the source device
and the sink device, in addition to the standard procedure such as RTSP, DHCP, Wi-Fi Direct. In
01-05-2019
22
S904, the communication apparatus 200 starts a series of processes of “to parameter setting”
described above.
[0092]
In S905, the communication apparatus 200 confirms whether the service procedure started in
S903 has timed out. If a timeout has occurred, the communication apparatus 200 registers the
occurrence of a timeout event in the storage unit 201 in S906.
[0093]
In S907, the communication apparatus 200 determines whether the procedure of “to the
parameter setting” with all the sink apparatuses included in the service configuration
information is completed. Here, the end of the procedure of “up to parameter setting” means
that the procedure up to step S312 is completed or a timeout has occurred with each sink device.
If the procedure with all the sink devices is not completed, the process returns to S903, and if
completed, the process proceeds to S908.
[0094]
In S908, the communication apparatus 200 confirms whether a timeout event has occurred. If a
timeout has not occurred, then all sink devices have been successfully connected, and progress is
made to audio or video playback. This state is referred to as "during reproduction with the first
configuration of the source" (S950). On the other hand, if a timeout has occurred, the process
advances to step S909.
[0095]
In S909, the communication device 200 displays “impossible to reproduce in the first
configuration”. This corresponds to S513 and S701. In S910, the communication device 200
receives a selection from the user. That is, an operation is accepted from the user as "(A)
Reproduction with other configuration", "(B) Continue as it is", or "(C) End". This corresponds to
S514 and S702.
01-05-2019
23
[0096]
When the selection of “(A) Reproduction with other configuration” is detected, in S911, the
communication apparatus 200 does not complete “To parameter setting” in the sink device
group for which “To parameter setting” is completed It is determined whether there is a sink
device to replace the device. If it exists, the process proceeds to step S912, and if it does not
exist, the process proceeds to step S913.
[0097]
In S912, the communication device 200 changes the capability of the alternative sink device.
This corresponds to S705 and S706. On the other hand, in step S913, the communication
apparatus 200 proceeds to the reproduction procedure without changing the apparatus
capability. This corresponds to S517 to S523.
[0098]
After S 912 and S 913, the process proceeds to the state of “reproduction in second
configuration of source” (S 1000).
[0099]
If the selection of "(B) Continue" is detected in S910, conventional reproduction processing (data
transmission processing) in the source device is performed in S914.
If the selection of "(C) end" is detected in S910, the reproduction process in the source device is
ended.
[0100]
FIG. 10 is an operation flowchart when the communication device 200 operates as a source
01-05-2019
24
device. It corresponds to what describes the operation of the source device in the operation
example 2 described above. That is, the operation of the source device described in FIG. 6 is
described in the form of a flowchart.
[0101]
In S1000, the communication apparatus 200 is in the state of "reproducing under the second
configuration of the source". Here, the “second configuration” does not mean the configuration
initially designated by the user (“7.1 ch” in the above example), but means other configuration
such as “5.1 ch”.
[0102]
In S1001, the communication apparatus 200 displays “during reproduction with the second
configuration”. This corresponds to S525 and S708. In S1002, the communication apparatus
200 detects an operation of the search start of another apparatus by the user. When a search
start operation is detected, in S1003, the communication device 200 starts a search for another
device. In S1004, the communication apparatus 200 determines whether another apparatus has
been detected, and proceeds to S1005 when another apparatus has been detected. If not
detected, the process returns to S1000.
[0103]
In S1005, the communication device 200 performs the processing of “up to capability inquiry”
with respect to the detected sink device. The processing of “until capability inquiry” is the
procedure up to S308 in FIG. In S1006, the communication device 200 determines whether the
first configuration is possible. For example, in the operation example 1, a detected speaker is
required to realize the first configuration “Surround. It is a process to check if it has the Back /
R "ability. If the detected speaker has that capability, the process advances to step S1007;
otherwise, the process returns to step S1004.
[0104]
In S1007, the communication apparatus 200 executes reproduction according to the first
configuration, and shifts to the state of "reproducing in first configuration of source" (S950).
01-05-2019
25
[0105]
FIG. 11 is an operation flowchart when the communication device 200 operates as a sink device.
It corresponds to what describes the operation of the sink device in the above-mentioned
operation example 4. That is, the operation of the sink device described with reference to FIG. 8
is described in a flowchart form.
[0106]
In step S1101, the communication apparatus 200 determines whether the user has performed an
operation to start an operation as a sink apparatus for audio or video (AV) service. If it is
determined that the operation to start the operation as the sink device has been performed, the
process proceeds to S1102, and if not, the process proceeds to the initial state (S900) of FIG. 9
described above.
[0107]
In S1102, the communication device 200 displays that “standby from the source device is
possible”. In S1103, the communication apparatus 200 performs an operation of detecting
whether there is a connection request from the source apparatus. If it is detected, the process
proceeds to step S1104. If it is not detected, the process returns to step S1102.
[0108]
In S1104, the communication apparatus 200 displays that "connection requested". In S1105, the
communication apparatus 200 determines whether an operation for receiving the detected
connection request has been performed by the user. If an operation has been performed, the
process advances to step S1106; otherwise, the process returns to step S1104.
01-05-2019
26
[0109]
In S1106, the communication apparatus 200 performs the process of “up to parameter
setting” with the source apparatus that has made the connection request. In S1107, the
communication apparatus 200 determines whether an operation to start a service (for example,
display of an image transmitted from a source apparatus) has been performed. If an operation
has been performed, the process advances to step S1108; otherwise, the process returns to step
S1102.
[0110]
In S1108, the communication device 200 reproduces the audio or video transmitted and received
from the source device. In S1109, the communication apparatus 200 further receives from the
user a selection as to whether or not to await a connection request from another source
apparatus. When waiting, the process returns to S1103. In the above-described S1103, S1105,
S1107, and S1109, it is possible to return to the initial state.
[0111]
As described above, according to the first embodiment, it is possible to provide a better
reproduction environment for the user in an audio video (AV) system using one-to-many
communication connection. For example, even when connection with some devices is not
possible, it is possible to perform reproduction with less discomfort. In addition, by diverting the
session with the already established device, the user is not forced to wait unnecessarily.
[0112]
Other Embodiments The present invention supplies a program that implements one or more
functions of the above-described embodiments to a system or apparatus via a network or storage
medium, and one or more of the computer of the system or apparatus are provided. It can also be
realized by a process in which a processor reads and executes a program. It can also be
implemented by a circuit (eg, an ASIC) that implements one or more functions.
01-05-2019
27
[0113]
101 source device; 102 sink device; 200 communication device; 202 control unit; 203 function
unit; 206 communication unit
01-05-2019
28
Документ
Категория
Без категории
Просмотров
0
Размер файла
41 Кб
Теги
jp2017169066
1/--страниц
Пожаловаться на содержимое документа