Barco v. Sahara Presentation - Complaint

Case 1:19-cv-01071-UNA Document 1 Filed 06/10/19 Page 1 of 18 PageID #: 1
UNITED STATES DISTRICT COURT FOR THE

DISTRICT OF DELAWARE
BARCO NV and BARCO, INC.
Plaintiffs, No. _____
v. JURY TRIAL DEMANDED
SAHARA PRESENTATION SYSTEMS,

INC. AND SAHARA PRESENTATION
SYSTEMS PLC,
Defendants.
ORIGINAL COMPLAINT FOR PATENT INFRINGEMENT
Plaintiffs Barco NV and Barco, Inc., collectively doing business as Barco (“Plaintiffs” or
“Barco”) by and through their undersigned counsel, file this Original Complaint for Patent
Infringement against Defendants Sahara Presentation Systems, Inc. and Sahara Presentation
Systems PLC and allege on knowledge as to their actions, and upon knowledge and information
and belief as to the actions of others, as follows:
NATURE OF THE ACTION
1. This action arises under the patent laws of the United States, 35 U.S.C. §§ 1, et
seq., from Defendants’ infringement of U.S. Patent No. 8,756,348; U.S. Patent No. 9,083,769,
and U.S. Patent No. D699,241 (collectively, the “Patents-in-Suit”)
2. Barco seeks injunctive relief as well as damages.
THE PARTIES
3. Plaintiff Barco NV is a foreign company incorporated under the laws of Belgium
with its principal operating business located at Beneluxpark 21, BE-8500 Kortrijk, Belgium.
4. Plaintiff Barco, Inc. is a company incorporated under the laws of Delaware, and
has a principal place of business at 421 McCarthy Blvd, Milpitas, CA 95035.
5. Defendant Sahara Presentation Systems, Inc. is a company incorporated under the
laws of Delaware, and has a principal place of business at 4405 Woodstock Drive, Georgetown,
TX 78633. Sahara Presentation Systems, Inc. can be served through its registered agent for
service of process in Delaware, The Corporation Trust Company, Corporation Trust Center,
1209 Orange Street, Wilmington DE 19801.
6. On information and belief, Defendant Sahara Presentation Systems PLC (“Sahara
PLC”) is a public limited company organized under the laws of the United Kingdom, with its
registered office for business at Europa House Littlebrook Dc1, Shield Road, Dartford, Kent,
England, DA1 5UR. Sahara PLC can be served with process pursuant to the Delaware Long
Arm Statute, 10 Del. C. § 3104.
7. Defendants collectively manufacture, import, offer for sale, and sell wireless
presentation tools to resellers, distributors, and consumers throughout the United States,
including in this District.
JURISDICTION AND VENUE
8. Subject matter jurisdiction is proper in this Court under 28 U.S.C. §§ 1331 and
1338(a) because the claims arise under the patent laws of the United States, 35 U.S.C. § 1 et seq.
9. This Court has personal jurisdiction over Sahara Presentation Systems, Inc.
insofar as it is incorporated in this District.
10. As to Sahara Presentation Systems, Inc., venue is proper in this Judicial District
under 28 U.S.C. § 1400(b) because Sahara Presentation Systems, Inc. is incorporated in this
District.
2
11. This Court has personal jurisdiction over Sahara PLC because, directly or through
intermediaries, it has committed acts in this District that give rise to this action, or otherwise has
established minimum contacts with this District such that the exercise of personal jurisdiction
over Sahara would not offend traditional notions of fair play and justice.
12. For example, Sahara PLC has placed and is continuing to place the accused
infringing products into the stream of commerce via established distribution channels, with the
knowledge and understanding that such products are being and will continue to be sold in the
United States, including in this District. See Exhibit “8.”
13. Venue is proper in this District as to Sahara PLC pursuant to 28 U.S.C. § 1391(b)
and (c) and 28 U.S.C. § 1400 because: (i) Sahara PLC does business in this District, directly or
through intermediaries, including Sahara Presentation Systems, Inc.; (ii) at least a portion of the
acts of infringement described herein occurred in this District; (iii) Sahara regularly solicits
business, engages in other persistent courses of conduct, or derives revenue from goods and
services provided to individuals in this District.
BARCO AND ITS INNOVATIONS
14. Barco is a leading global technology company known for its high-quality
presentation tools, screens, monitors, video walls, projectors, LED screens and streaming
devices.
15. Barco develops networked visualization solutions for the entertainment, enterprise
and healthcare markets. Barco’s solutions help people to enjoy compelling entertainment
experiences; its products foster knowledge sharing and smart decision-making in organizations.
16. Barco has expended tremendous resources developing wireless presentation
technology. Barco’s ClickShare product is a revolutionary wireless presentation and
3
collaboration tool that enables meeting participants to easily display and share the information on
their laptop on a main presentation screen in a meeting room or conference center, without
cables, set-up, or delay.
17. As a result of its innovative wireless technology, seamless operation, and smart
design, Barco’s ClickShare product has become the top choice for organizations seeking to share
ideas and build knowledge bases.
18. The ClickShare tool has won numerous industry awards, received consistently
favorable press, and enjoyed considerable commercial success.
19. A strong portfolio of patents, which includes each of the Patents-in-Suit, protect
Barco’s investment in its innovative wireless presentation tools.
THE PATENTS-IN-SUIT
20. On June 17, 2014, the U.S. Patent and Trademark Office issued U.S. Patent No.
8,756,348 (“the ’348 Patent”), titled “Electronic Tool and Methods for Meetings,” and with a
claimed priority date of September 14, 2011. A true and correct copy of the ’348 Patent is
attached at Exhibit “1.”
21. The ’348 Patent is presumed valid under 35 U.S.C. § 282(a).
22. Barco NV is the owner and assignee of all substantial rights, title, and interest in
the ’348 Patent.
23. On July 14, 2015, the U.S. Patent and Trademark Office issued U.S. Patent No.
9,083,769 (“the ’769 Patent”), titled “Electronic Tool and Methods for Meetings,” and with a
claimed priority date of September 14, 2011. A true and correct copy of the ’769 Patent is
attached at Exhibit “2.”
24. The ’769 Patent is presumed valid under 35 U.S.C. § 282(a).
4
the ’769 Patent.
26. On February 9, 2018, an anonymous third party requested reexamination of the
’348 Patent and the ’769 Patent by the U.S. Patent Office.
27. On March 15, 2019, the U.S. Patent Office issued a Reexamination Certificate
with respect to the ’769 Patent, confirming that Claim 1 and 7 were as patentable as amended
over the prior art. See Exhibit “3.” Claims 2-6, 8-10, and 13-22, dependent on an amended
claim, were also determined to be patentable. Id. Additionally, new claims 23-25 were added
and determined to be patentable. Id.
28. On May 24, 2019, the U.S. Patent Office issued a Reexamination Certificate with
respect to the ’348 Patent, confirming that Claims 1, 2, 4, 5, and 10-20 were as patentable as
amended over the prior art. See Exhibit “4.” Additionally, new claims 21-26 were added and
determined to be patentable. Id.
29. The ’769 Patent and the ’348 Patent share a common specification. The ’769
Patent and the ’348 Patent claim and disclose an electronic meeting tool and method for
communicating arbitrary media content from users at a meeting. The invention comprises a node
configuration means that receives user selected arbitrary media content adapted to control and
operate the display of the user selected arbitrary media content via a display node coupled to a
display.
30. The ’769 Patent and the ’348 Patent describe the explosion of electronic
communication tools designed to assist groups of persons to communicate with each other to
collaborate, problem-solve, negotiate, teach, and learn at the time of the invention. (See, e.g.,
’769 Patent at 1:25-39).
5
31. However, those electronic communications tools were often poorly designed or
cumbersome, not least because of the complexity of the networking infrastructure, and firewalls
and other security measures that restricted the use of peripheral devices communicating across a
network. (See, e.g., ’769 Patent at 4:38-59). Thus, even though inexperienced users necessarily
needed to utilize the technology, the tools themselves demanded a high level of technical
expertise. Id. In turn, that led to lower productivity, lack of participation, and delay. Id.
32. The ’769 Patent and the ’348 Patent disclose an invention that overcomes these
problems. One aspect of the invention describes an electronic meeting tool for communicating
arbitrary media content from users at a meeting comprising: a node configuration means adapted
to operate a display node of a communications network, the display node being coupled to a first
display, the node configuration means being adapted to receive user selected arbitrary media
content and to control display of the user selected arbitrary media content on the first display;
and at least one peripheral device adapted to communicate the user selected arbitrary media
content via the communications network, wherein the peripheral device is a connection unit
comprising: (a) a connector adapted to couple to a port of a processing device having a second
display, a memory and an operating system: and (b) a transmitter for communicating with the
communications network, a program adapted to be loaded onto the processing device and to run
on the operating system of the processing device, said program being adapted to obtain user
selected arbitrary media content, said program leaving a zero footprint on termination, and an
input device to allow the user to carry out a user action that triggers transfer of said user selected
arbitrary media content to said transmitter through said port. (See ’769 Patent at 5:3-27).
6
33. The following shows one version of the Barco ClickShare tool, which is an
embodiment of a peripheral device in accordance with the invention of the ’769 Patent and the
’348 Patent:
See, e.g., ’769 Patent, Fig. 10; see also id. 14:1-2 and 17:6-7.
34. On February 11, 2014, the U.S. Patent and Trademark Office issued design patent
U.S. Patent No. D699,241 titled “Peripheral Device for Computers” (“the D’241 Patent”). A
true and correct copy of the D’241 Patent is attached at Exhibit “5.”
35. The D’241 Patent is presumed valid under 35 U.S.C. § 282(a).
the D’241 Patent.
37. The D’241 Patent claims an ornamental design for peripheral device for
computers, and includes exemplary Figure 6 as shown below:
7
See, e.g., D’241 Patent, Fig. 6.
DEFENDANTS’ INFRINGING ACTIVITY
38. Defendants have entered the wireless presentation tool market, including the
market for wireless presentation tools in the United States.
39. However, rather than develop their own technology, Defendants have copied
Barco’s patented technology, and have incorporated Barco’s patented technology into
Defendants’ wireless presentation tools. Defendants thus unfairly compete with Barco in the
marketplace by offering for sale and selling these infringing products throughout the United
States.
40. Defendants have also participated in many of the same industry events and trade
shows as Barco, demonstrating and marketing their infringing products alongside Barco’s
ClickShare and other wireless presentation products.
41. As a result of these infringing activities, Defendants have caused direct injury to
Barco throughout the United States.
THE ACCUSED PRODUCT
42. Defendants make, use (including by testing), sell, offer for sale within the United
States, and import into the United States, a variety of wireless presentation tools.
8
43. One wireless presentation tool that Defendants make, use (including by testing),
sell, offer for sale within the United States, and import into the United States, is the Clevershare
(the “Accused Product”).
44. The Accused Product is described as follows: “With the Clevershare wireless
device you can control the Clevertouch from anywhere in the room, without the need for any
wires. Simply plug the Clevershare into your laptop’s USB port and you can show and edit your
laptop’s content on the Clevertouch screen. You can instantly display your desktop and control
from your computer or Clevertouch – your pen or finger becomes your mouse.” (See, e.g.,
http://www.rapid.co.uk/pdf/clevertouch/pro/Clevertouch-Collaboration-and-Control.pdf).
45. An image of the Clevershare is below:
See id.(rotated from original).
46. In February 2019, Barco communicated to Sahara PLC its belief that Sahara
PLC’s wireless presentation products infringed Barco’s intellectual property in Europe. Sahara
PLC has had exposure to Barco’s wireless presentation technology during 2017, 2018 and 2019
9
through both parties’ continued market presence and participation in industry events and trade
shows worldwide.
47. By way of letters sent on or about April 10, 2019 and May 6, 2019, Barco also
communicated directly with Defendants about Barco’s concerns surrounding the potential
infringing activity, including the introduction of the Accused Product into the United States.
Despite Barco’s efforts, Defendants have refused to cease infringing activity, including
infringement of the Patents-in-Suit.
48. Defendants are well aware of Barco and Barco’s intellectual property rights
embodied in the ClickShare technology. Barco NV has already been forced to seek relief from a
Dutch court in The Hague, Netherlands, in connection with Sahara PLC’s infringing acts in
offering for sale and selling the Accused Product without license or authorization in Europe. In
February 2019, a Dutch court authorized the seizure of Sahara PLC’s infringing products at the
Integrated Systems Expo in Amsterdam. (See, e.g., https://www.barco.com/en/News/Press-
releases/Dutch-court-authorizes-Barco-again-to-seize-ClickShare-copy-at-ISE.aspx).
49. Faced with Defendants’ refusal to cease their infringing activities in the United
States, Barco has been forced to file this suit to seek this Court’s protection of its valuable
intellectual property rights.
COUNT I: DEFENDANTS’ INFRINGEMENT OF THE ’348 PATENT
50. Barco incorporates by reference each of its allegations in the foregoing
paragraphs as though set forth fully herein.
51. As shown in Exhibit “6”, by making, using (at least by testing), selling, offering
for sale, or importing the Accused Product in this Judicial District and throughout the United
States without license or authorization, Defendants are now and have been directly infringing at
10
least claim 1 of the ’348 Patent, either literally or under the doctrine of equivalents, as proscribed
by 35 U.S.C. § 271, et seq.
52. Exhibit 6 is intended solely to satisfy the notice requirements of Federal Rule of
Civil Procedure 8(a)(2), and does not represent Barco’s preliminary or final infringement
contentions or preliminary or final claim construction positions. Barco reserves the right to
modify its infringement theories reflected in Exhibit 6 as discovery progresses in this case,
including through contentions disclosures and claim construction in accordance with the Patent
Local Rules in this District.
53. As a direct and proximate result of Defendants’ direct infringement of the ’348
Patent, Barco has been and continues to be damaged. Defendants’ infringing activities will
continue unless enjoined by this Court or until the patent expires, whichever is sooner.
54. Since at least the filing date of this complaint, Defendants have known that the
Accused Products directly infringe one or more claims of the ’348 Patent.
55. Defendants have additionally indirectly infringed and continue to indirectly
infringe at least claim 1 of the ’348 Patent by actively inducing their customers and users of the
Accused Product or functionally equivalent products by, among other things, providing the
Accused Products to users along with instructions on how to use the Accused Product in a
manner that Defendants know would directly infringe each element of at least claim 1 of the ’348
Patent.
56. Defendants have engaged and will continue to engage in such inducement having
actual knowledge of the ’348 Patent since at least the filing date of this Complaint. Furthermore,
Defendants knew or should have known that their actions would and will continue to induce
direct infringement by the users of the Accused Products or functionally equivalent products, and
11
have intended and will continue to intend that their actions would induce direct infringement by
such users.
57. As a direct and proximate result of Defendants’ indirect infringement by
inducement of the ’348 Patent, Barco has been and continues to be damaged. Defendants’
infringing activities will continue unless enjoined by this Court or until the patent expires,
whichever is sooner.
58. By engaging in the conduct described herein, Defendants have injured Barco and
are thus liable for infringement of the ’348 Patent, pursuant to 35 U.S.C. § 271.
59. Defendants have committed these acts of infringement without license or
authorization.
60. Defendants have committed these acts of infringement with actual knowledge of
the ’348 Patent since at least the filing date of this Complaint, and have acted recklessly and
willfully with regard to Barco’s rights in the ’348 Patent since that date.
61. As a result of Defendants’ willful infringement of the ’348 Patent, Barco has
suffered monetary damages and is entitled to a monetary judgment in an amount at least
adequate to compensate for Defendants’ infringement.
62. Barco will continue to suffer damages in the future unless this Court enjoins
Defendants’ infringing activities or the patent expires, whichever is sooner. As such, Barco is
entitled to compensation for any continuing and/or future infringement up until the date that
Defendants are finally and permanently enjoined from further infringement or the patent expires,
12
COUNT II: SAHARA’S INFRINGEMENT OF THE ’769 PATENT
64. As shown in Exhibit “7”, by making, using (at least by testing), selling, offering
for sale, or importing the Accused Product in this Judicial District and throughout the United
States without license or authorization, Defendants are now and have been directly infringing at
least claim 1 of the ’769 Patent, either literally or under the doctrine of equivalents, as proscribed
by 35 U.S.C. § 271, et seq.
65. Exhibit 7 is intended solely to satisfy the notice requirements of Federal Rule of
Civil Procedure 8(a)(2), and does not represent Barco’s preliminary or final infringement
contentions or preliminary or final claim construction positions. Barco reserves the right to
modify its infringement theories reflected in Exhibit 7 as discovery progresses in this case,
including through contentions disclosures and claim construction in accordance with the Patent
Local Rules in this District.
66. As a direct and proximate result of Defendants’ direct infringement of the ’769
Patent, Barco has been and continues to be damaged. Defendants’ infringing activities will
continue unless enjoined by this Court or until the patent expires, whichever is sooner.
67. Since at least April 10, 2019, Defendants have known that the Accused Products
directly infringe one or more claims of the ’769 Patent.
68. Defendants have additionally indirectly infringed and continue to indirectly
infringe at least claim 1 of the ’769 Patent by actively inducing their customers and users of the
Accused Product or functionally equivalent products by, among other things, providing the
Accused Products to users along with instructions on how to use the Accused Product in a
13
manner that Defendants know would directly infringe each element of at least claim 1 of the ’769
Patent.
69. Defendants have engaged and will continue to engage in such inducement having
actual knowledge of the ’769 Patent since at least April 10, 2019. Furthermore, Defendants
knew or should have known that their actions would and will continue to induce direct
infringement by the users of the Accused Products or functionally equivalent products, and have
intended and will continue to intend that their actions would induce direct infringement by such
users.
70. As a direct and proximate result of Defendants’ indirect infringement by
inducement of the ’769 Patent, Barco has been and continues to be damaged. Defendants’
infringing activities will continue unless enjoined by this Court or until the patent expires,
71. By engaging in the conduct described herein, Defendants have injured Barco and
are thus liable for infringement of the ’769 Patent, pursuant to 35 U.S.C. § 271.
72. Defendants have committed these acts of infringement without license or
authorization.
73. Defendants have committed these acts of infringement with actual knowledge of
the ’769 Patent since at least April 10, 2019, and have acted recklessly and willfully with regard
to Barco’s rights in the ’769 Patent since that date.
74. As a result of Defendants’ willful infringement of the ’769 Patent, Barco has
adequate to compensate for Defendants’ infringement.
14
COUNT III: SAHARA’S INFRINGEMENT OF THE D’241 PATENT
77. By selling, offering for sale, distributing, and advertising the Accused Product in
this Judicial District and throughout the United States without license or authorization,
Defendants are now and have been directly infringing the D’241 Patent, either literally or under
the doctrine of equivalents.
78. A side-by-side comparison, shown below, demonstrates how the Accused Product
(left) misappropriates Barco’s patented design (right):
Accused Product Barco D’241 Patented Design
15
79. The images above are demonstrative of the similarities between the Accused
Product and Barco’s protected design. Both feature a solid button body with an elongated USB
cable. The body has rounded contours, and the USB cable is affixed by a rounded connection
point to the body. The body features a single large clicker button, which takes up the
predominant surface of the body. The entire apparatus in both instances is designed to fit in the
palm of a user and be operated single-handedly.
80. The design of the Accused Product is substantially the same as the design
embodied in the D’241 Patent such as to deceive and induce an ordinary observer to purchase the
Accused Product supposing the same to be Barco’s innovative ClickShare product.
81. Defendants conduct in selling, offering for sale, distributing and advertising the
Infringing Products directly infringes the D’241 Patent, and Defendants have committed these
acts of infringement without license or authorization.
82. Defendants are thus liable for infringement of the D’241 Patent, pursuant to 35
U.S.C. § 271.
83. As a direct and proximate result of infringement of the D’241 Patent, Barco has
adequate to compensate for Defendants’ infringement, as well as Defendants’ total profits under
35 U.S.C. § 2819.
16
DEMAND FOR JURY TRIAL
85. Pursuant to Fed. R. Civ. P. 38(b), Barco demands trial by jury on all issues so
triable.
PRAYER FOR RELIEF
WHEREFORE, Barco prays for the following relief:
A. Defendants be adjudged to have infringed the Patents-in-Suit directly and by way of
induced infringement, either literally or under the doctrine of equivalents;
B. That Defendants, and each of their respective officers, directors, agents, servants,
employees, attorneys, affiliates, divisions, branches, parents, subsidiaries, and those
persons in active concert or participation with any of them, be preliminarily and
permanently restrained and enjoined from directly or indirectly infringing the Patents-in-
Suit;
C. An award of damages pursuant to 35 U.S.C. § 284 sufficient to compensate Barco for
Defendants’ past infringement and any continuing or future infringement up until the date
that Defendants are finally and permanently enjoined from further infringement or the
patents expire, whichever is sooner, including compensatory damages;
D. An additional award of total profits pursuant to 35 U.S.C. § 289 for Defendants’ past
infringement and any continuing or future infringement of the D’241 Patent, up until the
date that Defendants are finally and permanently enjoined from further infringement or
the patents expire, whichever is sooner,
E. An assessment of pre-judgment and post-judgment interest and costs against Defendants,
together with an award of such interest and costs, in accordance with 35 U.S.C. § 284;
17
F. That Defendants be directed to pay enhanced damages under 35 U.S.C. § 284 and
Barco’s attorneys’ fees incurred in connection with this lawsuit pursuant to 35 U.S.C. §
285; and
G. Such other and further relief as this Court may deem just and proper.
Dated: June 10, 2019 K&L GATES LLP
/s/ Steven L. Caponi .

Steven L. Caponi (#3484)
Matthew B. Goeller (#6283)
600 N. King St., Suite 901
Wilmington, DE 19801
Phone: 302.416.7000
steven.caponi@klgates.com
matthew.goeller@klgates.com
Counsel for Plaintiffs Barco NV and

Barco, Inc.
18
Case 1:19-cv-01071-UNA Document 1-1 Filed 06/10/19 Page 1 of 97 PageID #: 19
Exhibit 1
USOO8756348B2
(12) United States Patent (10) Patent No.: US 8,756,348 B2

Beel et al. (45) Date of Patent: Jun. 17, 2014
(54) ELECTRONICTOOL AND METHODS FOR 2005.0036509 A1 2/2005 Acharya et al.
MEETINGS 2006, OO31779 A1 2/2006 Theurer et al.
2006/00953.76 A1 5, 2006 Mitchell et al.
2007/OOO5809 A1 1/2007 Kobayashi et al.
(75) Inventors: Koen Simon Herman Beel, Lochristi 2007/0244970 A1 10/2007 Watanabe et al.
(BE); Yoav Nir, Rekkem (BE): Filip 2009 OO46139 A1 2/2009 Cutler et al.
Josephine Johan Louwet, Knesselare 2009, O198839 A1 8/2009 Banerjee et al.
(BE); Guy Coen, Aalst (BE) 2010, 0087139 A1 4/2010 Glass
(Continued)
(73) Assignee: Barco N.V., Belgie (BE)
FOREIGN PATENT DOCUMENTS
(*) Notice: Subject to any disclaimer, the term of this
patent is extended or adjusted under 35 EP 1 187480 A1 3, 2002
U.S.C. 154(b) by 92 days. EP 1246 395 A1 10, 2002
WO OO,52887 A1 9, 2000
(21) Appl. No.: 13/270,659 OTHER PUBLICATIONS
(22) Filed: Oct. 11, 2011 Examination Report of German Patent and Trademark Office regard
ing related German Patent Application 10 2011 055 443.2, May 30,
(65) Prior Publication Data 2012.
US 2013/OO67121 A1 Mar. 14, 2013 (Continued)
Related U.S. Application Data Primary Examiner — Scott Sun
(60) Provisional application No. 61/534,592, filed on Sep. (74) Attorney, Agent, or Firm — Bacon & Thomas, PLLC
14, 2011.
(57) ABSTRACT
(51) Int. Cl. An electronic meeting tool for communicating arbitrary
G06F I3/38 (2006.01) media content from users at a meeting includes a node con
G06F 3/00 (2006.01) figuration operating a display node of a communications net
(52) U.S. Cl. work that is coupled to a display. The node configuration
USPC ............ 710/20, 710/2; 710/5: 710/8; 710/11; receives user selected arbitrary media content and controls
710/15 display of the user selected arbitrary media content on the
(58) Field of Classification Search display. At least one peripheral device communicates the user
None selected arbitrary media content via the communications net
See application file for complete search history. work. The peripheral device is a connection unit including a
connector that couples to a port of a processing device having
(56) References Cited a second display, a memory and an operating system; and a
U.S. PATENT DOCUMENTS
transmitter communicating with the communications net
work. A program is provided to run on the operating system of
6,966,035 B1 11/2005 Suess et al. the processing device and obtains user selected arbitrary
8,316,138 B2 11/2012 Chang media content, while leaving a Zero footprint on termination.
2002/0196378 A1 12/2002 Slobodin et al.
2004/0263636 A1 12/2004 Cutler et al. 20 Claims, 5 Drawing Sheets
64
6O
:
Portable
application
: Base node
Program
31 N. Client Display f
:: Processing
Devi
Collector
Ut
1 a Base Node Projector
: ye
Visual
Endicator
US 8,756,348 B2
Page 2
(56) References Cited International Search Report in PCT/EP2012/068167, Mar. 19, 2013.
International Search Report in PCT/EP2012/068168, Mar. 4, 2013.
U.S. PATENT DOCUMENTS International Search Report in PCT/EP2012/068169, Jan. 28, 2013.
2010/0302130 A1 12/2010 Kikuchi et al. Search Report in GB1206841.7. Aug. 28, 2012.
2011 0115689 A1 5/2011 Sugiyama et al. Proc. 3rd International Conference on Ubiquitious Intelligence and
2012/0331509 A1* 12/2012 Laksono ......................... 725/56 Computing, Sep. 2006, pp. 688-697, Wenbing Jiang, et al., “Free
2013/005O254 A1 2/2013 Tran et al. ..................... 345,629 Speech: a novel wireless approach for conference projecting and
OTHER PUBLICATIONS cooperating”.
International Search Report in PCT/EP2012/068166, Mar. 6,
2013. * cited by examiner
U.S. Patent Jun. 17, 2014 Sheet 1 of 5 US 8,756,348 B2
30
Cannera
Audio
Equipment
31
Lapel Meeting Table

Microphone
A N.) of
43 Fig. 1 a
60
Base roce
application Program
3. Client Connector Display

Processing receive Base Node Projector
Device
Visual
ridicator
Fig. b
ic: ::::::::::
as 6.
Base 3 tie
Sit 3E &
r y iteface
USB orge
intesiace ....
P:f3 is ... E.
28 aggligatig ( ):
3) LED (10 :
8.
Fig. 4
Computer
Rur-time execution ,
3:text dieti Software
Fig. 5
; , Rutine execut 3: ,
. . I context diet software (2. agglicatigs
R&83 25)
---
Fig. 9
- interna WiFi antenna's

transceiver
B uttO Actuator and

input device
Visual internal mass storage

indicator
device Storing portable
application
- Flexible connection for data

Signals and power
USB device interface

US 8,756,348 B2
1. 2
ELECTRONICTOOLAND METHODS FOR line by which they can pace and measure their productivity
MEETINGS and that of their colleagues. Unfortunately, for many infor
mation managers, being in perpetual meetings has reduced
RELATED APPLICATIONS their ability to prepare adequately for the next meeting, per
petuating a vicious and negative cycle.
This benefit of provisional patent application No. 61/534, However, Marc Al-Hames et al. report in “Audio-Visual
592 filed Sep. 14, 2011 is claimed and said application is Processing in Meetings: Seven Questions and Current AMI
incorporated herein by reference. Answers', that although large parts of working days are con
FIELD 10
Sumed by meetings and conferences, unfortunately a lot of
them are neither efficient, nor especially successful. They
report a study in which people were asked to select emotion
The present invention relates to electronic tools for meet terms that they thought would be frequently experienced in a
ings including methods or devices for providing connection meeting. The top answer—mentioned from more than two
to a communications network, to networks or methods of third of the participants—was “boring’; furthermore nearly
operating the network, methods or devices for use in display 15
one third mentioned “annoyed as a frequently perceived
ing media content as well as Software for performing any of emotion.
these methods.
The conclusion is that despite the plethora of electronic
TECHNICAL BACKGROUND aids to meetings, fundamental problems in handling meetings
have not been solved. In fact organising and conducting meet
Tools for Collaboration ings in a business context involves a large number of factors.
Participation
Allowing ad hoc groups of persons to communicate with A lack of efficiency of meetings is addressed in the article
each other is one of the fundamental aspects of collaboration, “Mood indicators on electronic meeting tools IBM, IP.com
problem solving, negotiation, teaching and education, etc. To 25 number: IPCOMO00011711D, Publication Date: Mar. 12,
assist in communication, there has been an explosion of elec 2003. This article addresses the issue that the lack of direct
tronic communication tools such as electronic conferencing feedback makes meetings clumsy, inefficient and often
tools, e.g. Synchronous and asynchronous conferencing, unproductive. It proposes a “mood indicator as well as an “I
online chat, Instant Messaging, audio conferencing, video want to ask a question' indicator which allow the presenter to
conferencing, data conferencing, application sharing, remote 30 choose an appropriate moment to pause, change track or field
desktop sharing, electronic meeting systems, collaborative a question. It is argued that interrupting a presenterinfull flow
management (coordination) tools, project management sys can be awkward; however, sometimes it is difficult to get an
tems, knowledge management systems, and Social Software opportunity to ask a question or make a comment when many
systems. different people are trying to make their voices heard. In a
One classic approach is the lecture or seminar often involv 35 similar vein, U.S. Pat. No. 6.966,035 suggests displaying a
ing a presentation using presentation Software. To a large “murmur frame' for a participant to express a view. To
extent the traditional single person presentation or lecture has increase user participation, US 2010/0087139 discloses a
been maintained with the audience being in a rather passive system for sending a selection to another computer, and US
mode as far as determining, constructing, augmenting or 2006/0095376 discloses a system for secure voting. Com
modifying the information to be presented is concerned. 40 menting. Voting or selecting requires that a central authority
As with other business processes, meetings are going digi provides the information that is to be selected or commented
tal. Increasingly, people are using computer technology alone or voted on. Hence, these proposals still leave a central figure
and in conjunction with broadband networks to Support their Such as the presenter in a dominating position and the other
meeting objectives prior to and during an actual meeting. For members of the meeting are largely an audience with limited
example, e-mail is used to pass around files for people to read 45 selection or Voting or participation rights.
prior to a meeting. A further problem with meetings is that someone is usually
Collaborative workspaces incorporate networks and on the late or has to leave early. With the person arriving late one has
Internet offer geographically distributed collaborators a vir to decide if the meeting is interrupted and a Summary of the
tual repository for documents related to a project or a meet proceedings So far is given. For the person leaving early (often
ing. Electronic meeting Support systems, such as interactive 50 a senior person), Subsequent discussions can go missing. If
network-connect white boards and videoconferencing appli there is a notes taker, this provides a personal Summary of the
ances, are available for the benefit of those who share the meeting but not an objective one.
same room as well as those who are in remote locations. Presents systems do not provide an optimal Solution.
The AMIDA Final Public Report describes the overall Legal and Security Issues
methodology behind the development of meeting Support 55 A legal requirement of a meeting is that presentations,
technologies. It reports that numerous studies confirm that comments and Submissions need to be completely reproduc
meetings dominate the way people work. Namely, according ible in Some circumstances, e.g. in a shareholders’ meet
to a study conducted by MCI Worldcom in 2003 a business ing, the events in the meeting should be subject to total recall.
person participates in 60 meetings per month. People meet in Computer-supported collaborative work technologies, par
groups for a multitude of reasons. They interact in numerous 60 ticularly those which capture human verbal and non-verbal
predictable and unpredictable ways and the results of their communications (audio and video interaction) in addition to
interactions are as varied as the people who participate and text and graphics generated during a meeting, promise to have
the projects on which they are collaborating or communicat along term impact on how people will prepare for and behave
ing. Studies of business processes also reveal that approxi during and following meetings. In addition, connecting to a
mately 80% of the “workload' associated with a project or 65 network brings the danger of virus, malware or spyware trans
process happens in preparation for a meeting. In other words, fer in either direction, and there is danger of copying of
many people view the “live' meeting as a milestone or dead confidential information.
US 8,756,348 B2
4
Practical Difficulties play content of the computer. US 2009/0198839 discloses
Scalability and Ease of Use such a pluggable cable arrangement. US 2011/0115689 dis
There are even more fundamental problems with using closes a similar USB solution for wireless connection to a
electronic tools in meetings. If two persons want to make two projector. Accordingly connecting a projector to a computer
presentations then usually either both presentations must be using the standard USB port might become commonplace
placed on one machine or there is a need to Swap between the with time. However, this usually requires special drivers and
presenters machines. To bring the display content of a com even special hardware. Connecting a projector to a computer
puter to a projector, the most common ways are to use a cable using the standard USB port hence might become common
that connects the display adapter of the graphics card to the place—but even when that happens there will be a mix of new
video input of the projector method 1 or to use a software 10 and legacy machines for several years.
Firewalls
that captures the display contents and sends it over a wired or Additional problems can occur with firewalls. Typically a
wireless network to a remote base unit connected to the pro visitor to a meeting will bring a computer Such as a laptop that
jector method 2. This is often called “remote desktop' and is setup for a different corporate networking environment and
is mostly used for remote administration or remote IT assis hence has different or incompatible networking settings. The
tance purposes. 15 setting up of a firewall can be complicated and if this is not
Less common but also practiced methods are to use a done correctly, telecommunication Software that has to pass
special device connected to the display adapter of the graph through a firewall may be blocked. In order to solve problems
ics card that captures, encodes and streams the display con associated with firewalls it may be necessary to open ports or
tent over a wired or wireless network method 3. identify or even add programs in an exception list. If, besides
Method 1 has several practical problems and disadvan a network (hardware) firewall and an operating system fire
tages. In meetings where people want to contribute content wall, there is any software based third-party firewall like
from their own computers, e.g. to project images on a display, Zonealarm, Norton Systemworks, CA Internet Security Suite
typically a video cable such as a VGA cable is used to connect or McAfee Firewall, then it is necessary to follow that soft
each PC one at a time to the projector. This is not only not ware developer's documentation to place programs on a safe
Scalable but also can be and often is quite a cumbersome 25 list or adding exceptions to the firewall rules. Such activity is
process that typically wastes valuable meeting time and takes beyond the usual user. Fussing with computer settings, or
the dynamism out of the meeting. Connection can be made having to call for IT Support wastes valuable meeting time and
more difficult and time consuming for example if the com takes the dynamism out of the meeting.
puter has to be rebooted for it to detect the projector or when Conclusion
the format of the PC differs from the format of the projector. 30 The following problems remain for holding a face-to-face
In addition changing format can leave the computer with a meeting using advanced electronic tools at the present time:
new format that is not compatible with its own screen so that Complexity of the networking infrastructure.
on reboot of the PC alone, nothing is displayed on the com High demands on technical expertise of users in current
puter Screen. Without a visible screen image the necessary systems that are Supposed to be designed to Support
re-configuration can be difficult. These issues are aggravated 35 everyday use by the non-expert user.
by a number of elements: Barriers to the use of complicated technology in meetings.
The use of many different video adapters, such as VGA, Great variety of possible collaborative software solu
DVI, DP, HDMI,.... tions—none of which seems to solve the fundamental
Reach depends on cable length: too long leaves a tangled problems of holding Successful meetings.
cable "salad' in the meeting room, too short reduces 40 Meetings being boring or annoying for members of the
flexibility, often necessitating people to move around in meeting.
the meeting room when they want to present something. Complexity of firewalls and other security measures
Cable connection is either point to point or requires tedious employed in corporate networks.
and extensive cabling and the use of complex and expen Lack of, or restriction of participation by members of a
sive video switches. 45 meeting.
It is often difficult and time consuming to find the right Time taken to prepare presentations for meetings.
display resolution and refresh rate that both the com Need to record events in the propertime sequence at meet
puter and the display or projector Support. ings without burdening a meeting more than necessary.
Method 2 also has many drawbacks. If the connection is Although some tools solve some of these problems effec
made to a corporate LAN there is a danger of virus, malware 50 tively, no electronic meeting tool solves all of them.
or spyware transfer in either direction, there is danger of
copying of confidential information, and there is the difficulty SUMMARY OF THE INVENTION
of making the connection, e.g. entry of a user code and pass
word, as well the administration of Such passwords and user An object of the present invention is to provide network
codes. 55 Solutions including electronic tools for meetings including
The advantage of method 3 is that the computer does not devices for providing connection to a communications net
need to use its own processing power to bring the display work, to methods of operating the network, methods of dis
content in a form that is easily transported over a network. playing media content as well as Software for performing any
This advantage becomes less relevant as computers grow in of these methods or for implementing Such systems.
processing power. A drawback of method 3 is that the same 60 In an aspect the present invention provides an electronic
problems often encountered with method 1 of connecting to meeting tool for communicating arbitrary media content from
the display adapter remain. Another drawback is that the users at a meeting comprising: a node configuration means
special device referred to requires significant processing adapted to operate a display node of a communications net
power, which means that this device will consume much work, the display node being coupled to a first display, the
power, be relatively big and certainly be relatively expensive. 65 node configuration means being adapted to receive user
An alternative method in the making today is to use the well selected arbitrary media content and to control display of the
known USB interface of the computer for extracting the dis user selected arbitrary media content on the first display; and
US 8,756,348 B2
5 6
at least one peripheral device adapted to communicate the dard class of peripheral devices, the peripheral device com
user selected arbitrary media content via the communications prising a memory in which executable software code is stored
network, wherein the peripheral device is a connection unit for execution on the processing device, said executable soft
comprising: ware code comprising:
(a) a connector adapted to couple to a port of a processing a first Software code portion for setting up, by means of the
device having a second display, a memory and an oper pre-installed generic driver of the operating system, a
ating System; and means for communication between the peripheral device
(b) a transmitter for communicating with the communica and the processing device;
tions network, a second Software code portion for connecting the processing
a program adapted to be loaded onto the processing device 10
device to a communications network via the peripheral
and to run on the operating system of the processing device, device, the peripheral device having a transceiver,
said program being adapted to obtain user selected arbitrary a third Software codeportion for screen scraping data from the
media content, said program leaving a Zero footprint on ter processing device; and
mination, and an input device to allow the user to carry out a
user action that triggerStransfer of said user selected arbitrary 15 a fourth Software code for routing screen scraped data
media content to said transmitter through said port. between the processing device and the communications
The program can be stored on the peripheral device. The network over the means for communication; wherein the
transmitter can be a wireless transmitter or transceiver. The first Software code portion is adapted to use the generic
peripheral device can be a plug-and-play device. The program communication protocol for transferring the screen
cane adapted to screen scrape content of the second display. scraped data between the processing device and the periph
The input device can be physical actuator coupled to the eral device.
peripheral device. The physical actuator preferably has a The first software code portion can be adapted to present
surface area of between 100 and 14,400 square mm. Alterna the peripheral device to the processing device as a human
tively, the input device can be a key displayed on the second interface device and wherein the pre-installed generic driver
display. The key displayed on the second display can be one 25 is a human interface device driver. The first software code
not screen scraped by the program. portion can be adapted to present the peripheral device to the
In another aspect the present invention provides a method processing device as a mass storage device and wherein the
for connecting a processing device to a communications net pre-installed generic driver is a mass storage device driver.
work, the processing device having a memory, a display and The first software code portion can be adapted to present the
an operating system with at least one pre-installed generic 30
peripheral device to the processing device as a composite
driver providing a generic communications protocol for com device and wherein pre-installed generic drivers drive differ
munication between processing device and a standard class of ent device interfaces independently.
peripheral devices, the method comprising the steps of
a) coupling a peripheral device to the processing device, the The executable software code can comprise fifth code for
peripheral device having a transceiver; 35 providing a means for connecting to the communications
b) setting up, by means of the pre-installed generic driver of network including a base node. The executable software code
the operating system, a means for communication between can comprise sixth code for providing means for capturing
the peripheral device and the processing device; video frame buffers of the processing device.
c) coupling the processing device to a communications net The executable software code can comprise seventh code
work via the peripheral device; 40 for providing a means for encoding, compressing and option
d) routing screen scraped data between the processing device ally encrypting the screen scraped data and sending the screen
and the communication network via the means for com scraped data the communication network. The executable
munication, wherein the generic communication protocol Software code can comprise eighth code for providing a
is used for transferring the screen scraped data between the means for handling the peripheral device. The executable
processing device and the peripheral device. 45 Software code can comprise ninth code for providing means
Step b) can comprise presenting the peripheral device to for initiating connection to the base node. The executable
the processing device as a human interface device and Software code can comprise tenth code for receiving inputs
wherein the pre-installed generic driver is a human interface from an input device on the peripheral device. The executable
device driver. Software code can comprise eleventh code for providing a
Alternatively step b) can comprise presenting the periph 50 means for sending state changes to the visual indicator on the
eral device to the processing device as a mass storage device peripheral device. The executable software code can com
and wherein the pre-installed generic driver is a mass storage prise twelfth code for providing a means for presenting to the
device driver. user a GUI. The executable software code can comprise thir
Alternatively, step b) comprises presenting the peripheral teenth code for presenting a GUI for administration of the said
device to the processing device as a composite device and 55 executable Software code when executed as a portable appli
wherein pre-installed generic drivers drive different device cation. The executable software code can comprise four
interfaces independently. teenth code for providing a means for displaying and activat
A client application can be stored on the peripheral device ing a key on the display of the client processing device for
which when run on the processing device obtains the Screen allowing a user to input the start the transfer of data from the
scraped data. Such a client application can be a portable 60 processing device to the base node.
application. In another aspect the present invention provides a periph
In another aspect the present invention provides a periph eral device for providing communication connectivity to a
eral device for providing communication connectivity to a processing device which is provided with memory, a display
processing device which is provided with memory, a display and an operating system with at least one pre-installed
and an operating system with at least one pre-installed 65 generic driver providing a generic communication protocol
generic driver providing a generic communication protocol for communication between the processing device and a stan
for communication between the processing device and a stan dard class of peripheral devices, the peripheral device com
US 8,756,348 B2
7 8
prising a memory in which executable Software code is stored a memory in which executable software code is stored for
for execution on the processing device, said executable soft execution on the processing device, said executable Software
ware code comprising: code comprising:
a first software code portion for setting up, by means of the a first Software code portion for setting up, by means of the
pre-installed generic driver of the operating system, a pre-installed generic driver of the operating system, a
means for communication between the peripheral device means for communication between the peripheral device
and the processing device; and the processing device;
a second Software code portion for connecting the processing a second Software code portion for connecting the processing
device to a communications network via the peripheral device to a communications network via the peripheral
device, the peripheral device having a transceiver, and 10 device, the peripheral device having a transceiver,
a third processing Software code for routing data between the a third software code portion for receiving media content
processing device and the communications network over from the network and for displaying the media content on
the means for communication; wherein the first software the display in accordance with a set of rules; wherein the
code portion is adapted to use the generic communication first Software code portion is adapted to use the generic
protocol for transferring the data between the processing 15 communication protocol for transferring the media content
device and the peripheral device, and an input device between the peripheral device and the processing device.
coupled to the peripheral device, the input device being The executable software code can comprise fourth code for
adapted to react to a user action to trigger the transfer of the providing a means for correctly configuring a receiver as an
data from the processing device to the peripheral device. access point. The executable Software code can comprise fifth
The first software code portion can be adapted to present code for providing a means for listening for output of con
the peripheral device to the processing device as a human nection units trying to connect on a specific port. The execut
interface device and wherein the pre-installed generic driver able software code can comprise sixth code for providing a
is a human interface device driver. The first software code means for a GUI for administration purposes. The executable
portion can be adapted to present the peripheral device to the Software code can comprise seventh code for providing a
processing device as a mass storage device and wherein the 25 means for publishing its presence over the network using the
pre-installed generic driver is a mass storage device driver. Zeroconf protocol. The executable software code can com
The first software code portion can be adapted to present the prise eighth code for providing a means for accepting and
peripheral device to the processing device as a composite installing Software updates. The executable Software code can
device and wherein pre-installed generic drivers drive differ comprise ninth code for providing a means for providing
ent device interfaces independently. 30 facilities for pairing of connection units to the processing
The input device is preferably a physical actuator coupled device. The executable software code can comprise tenth
to the peripheral device. The physical actuator preferably has code for providing a means for auto-composing of different
a surface area of between 100 and 14,400 square mm. The incoming arbitrary media streams and rendering of compos
input device can be for example a key for display on the ited image on display. The executable software code can
display. The executable software code can comprise fourth 35 comprise eleventh code for providing a means for receiving,
code for providing a means for connecting to the communi decrypting and decoding incoming arbitrary media content.
cations network including a base node. The executable soft The executable software code can comprise twelfth code for
ware code can comprise fifth code for providing a means for Scaling of incoming arbitrary media streams. The executable
capturing video frame buffers of the processing device. The Software code can comprise thirteenth code for providing a
executable Software code can comprise sixth code for provid 40 means for displaying incoming arbitrary media content in
ing a means for encoding, compressing and optionally accordance with a set of rules.
encrypting the video frames and sending them over a secure The present invention also provides a method for commu
link to the base node. The executable software code can nicating arbitrary media content from users at a meeting
comprise seventh code for providing a means for handling the comprising:
peripheral device. The executable software code can com 45 operating a display node of a communications network, the
prise eighth code for providing a means for initiating connec display node being coupled to a first display, to receive user
tion to the base node. The executable software code can selected arbitrary media content and to control display of
comprises ninth code for receive inputs from an input device the user selected arbitrary media content on the first dis
on the peripheral device. The executable software code can play; and connecting a peripheral device to a port of a
comprise tenth code for providing a means for sending state 50 processing device and communicating the user selected
changes to the visual indicator on the peripheral device. The arbitrary media content via the communications network,
executable software code can comprise eleventh code for loading a program onto the processing device and running the
providing a means for presenting the user a GUI. The execut program on the operating system of the processing device
able software code can comprise twelfth code for presenting to obtain user selected arbitrary media content, said pro
GUI for administration of the executable software code when 55 gram leaving a Zero footprint on termination, and
executed as a portable application. The executable software triggering transfer of said user selected arbitrary media con
code can comprise thirteenth code for providing a means for tent to said transmitter through said port after a user action
displaying and activating a key on the display of the process on an input device.
ing device for allowing a user input to start the transfer of data The present invention also provides a peripheral device
from the processing device to the base node. 60 comprising:
In another aspect of the invention a peripheral device is a base
provided for providing communication connectivity to a pro a connector for connection to a plug and play port of a host
cessing device which is provided with memory, a display and processing device,
an operating system with at least one pre-installed generic a flexible connection between the base and the connector for
driver providing a generic communication protocol for com 65 transferring data signals and power,
munication between the processing device and a standard an actuator on the base for actuating a signal and for trans
class of peripheral devices, the peripheral device comprising ferring the signal to the connector for transfer to the port,
US 8,756,348 B2
10
wherein the base has electronics comprising permanent to run without installation on the target machine. This type of
storage for storing a portable application, a processing application is stored on a removable storage device such as a
engine, a transceiver and a visual indicator. CD, USB flash drive, flash card, or floppy disk storing its
The present invention also provides a method for providing program files, configuration information and data on the Stor
communication connectivity from a processing device, age medium alone. It is a program that can be stored on an
setting up a communications network between a base node of electronic device such as a USB flash drive, iPod, memory
the communications network and a peripheral device card, portable hard drive or other portable electronic device
coupled to the processing device; and runs on a computer or other processing device coupled to
transferring media content between the processing device and the electronic device without making permanent configura
the peripheral device, 10
tion changes to the host computer. All Such programs have a
transmitting the media content from the peripheral device to Zero-footprint, meaning all temporary files, registry entries,
the communications network, and any other changes to the machine exist only while the
receiving media content from the communications network at program is running.
the base node and displaying the media content on a display To be considered a portable application, for purpose of this
in accordance with a set of rules. 15
With any of the above embodiments using pairing of the invention, a Software program must:
peripheral device, the only user actions required to connect Not require any kind of formal installation onto a computers
the processing device to the communications network and permanent storage device to be executed, and can be stored on
hence to the first or central display are plug in the peripheral a removable storage device such as USB flash drive, iPod,
device into the processing device, optionally press the button memory card, portable hard drive or other portable electronic
on the peripheral device. This method allows for an automatic storage device thus enabling it to be used on multiple com
connection of the peripheral device to the display node with puters.
out any user interaction or configuration Settings are stored with, and can be preferably carried around
Embodiments of the present invention also include any of with, the software (i.e., they are written to the electronic
the above software code being stored on a non-transitory 25 device such as a USB drive). Settings are not stored to the
storage medium. registry or any other central system database of the computer.
Definitions Leaves a Zero (or near-zero) “footprint’ on any PC it is run
“Plug and play” is a term used to describe the characteristic on after being used. i.e., all temporary files/registry settings
of a computer bus, or device specification, which facilitates should be either avoided or at least removed once the program
the discovery of a hardware component in a system, without 30
has exited, and files created by the user can be saved directly
the need for physical device configuration, or user interven to the same removable media as the application is stored on.
tion in resolving resource conflicts. Plug and play devices can A portable application does not leave its files or settings on
be added to a bus of a computing system (while running or the host computer on which it runs. For example, the appli
when shut down), and the newly added device and possibly
the rest of the computing system is automatically configured 35 cation does not write to the Windows registry or store its
to make the newly added device work, both from hardware configuration files (such as an INI file) in the user's profile;
and from Software perspective. instead, it stores its configuration files in the program’s direc
Plug and play interfaces include for example (not an tory. Another requirement, since file paths will often differ on
exhaustive list): Firewire (IEEE-1394), PCI, Mini PCI, PCI changing computers due to variation in Windows drive letter
Express, Mini PCI Express, PCMCIA, PC Card, Universal 40 assignments, is the need for applications to store them in a
Serial Bus (USB), SDIO cards. relative format. Preferably, such a program does not require a
'Auto-configuration' is the automatic configuration of launcher program to copy necessary settings and files to the
devices without manual intervention, without setting any host computer when the application starts and move them
Switches or jumpers, and without any need for Software con back to the application's directory when it closes as this may
figuration. An example of auto-configuring devices: USB 45 leave a residue on the hard drive in case of power failure.
devices. Examples of auto-configuring protocols: DHCP. “Electronic meeting systems' (EMS) need to be distin
Zeroconf. Bonjour. guished on the one hand from classic groupware, on the other
A plug and play device has auto-configuration Software by from web conferencing systems. In reality, there is some
default to make it plug and play. Example: USB devices are overlap between minor features of products of the named
made to be plug and play by including the correct auto 50 categories. The main difference from groupware is the inten
configuration Software (e.g. host driver, host stack, applica sity of collaboration. EMS should be distinguished from sys
tion Software). Autoconfiguration can also refer to a Software tems with which it is possible to show the contents of an
alone and is not restricted to a physical device. individual computer screen on a remote display with multiple
“Hot Swapping and hot plugging” are terms used to users at the same time.
describe the functions of replacing computer system compo 55 “Groupware' supports collaboration within groups where
nents without shutting down the system. More specifically, the individual contributions remain identifiable. In contrast,
hot Swapping describes replacing components without sig EMS enables the group to cooperatively produce a result for
nificant interruption to the system, while hot plugging which the group is responsible as a whole. In a business
describes the addition of components that would expand the process, groupware and electronic meeting systems comple
system without significant interruption to the operation of the 60 ment each other: Groupware Supports teams when research
system. A well-known example of this functionality is the ing and creating documents in the run up to an EMS session
Universal Serial Bus (USB) that allows users to add or or when implementing the results of Such a session.
remove peripheral components such as a mouse, keyboard, or “Web conferencing systems’” and “electronic meeting sys
printer. Other examples are eSATA, PCIe, FireWire, for tems’ complement each other in the online meeting or work
example. 65 shop: EMS extends the web conferencing system by provid
A portable application' (portable app), sometimes also ing interactive tools for producing and documenting group
called Standalone, is a computer Software program designed results. On the other hand, “web conferencing systems’
US 8,756,348 B2
11 12
complement EMS with the screen sharing and voice confer ing mass storage, a CD-ROM, a keyboard etc. or combina
encing functionality required in Synchronous online meetings tions of these. Such devices can be readable and writable
and not present in EMS. computer peripheral memory devices such as USB memory
"Data conferencing refers to a communication session Sticks, flash memories, external hard drives, or more.
among two or more participants sharing computer data in real
time. Interaction and presentation devices such as a screen, BRIEF DESCRIPTIONS OF THE DRAWINGS
keyboard, mouse, camera, etc. can be shared. It is a term used
to distinguish from video conferencing and audio conferenc FIG. 1a shows a meeting room that can be used with
ing. The data can include Screen, documents, graphics, draw embodiments of the present invention. FIG.1b shows a com
ings and applications that can be seen by the participants of 10 bination of a client processing device, a connection unit, a
the meeting. base node and a display inaccordance with an embodiment of
Application sharing is an element of remote access, fall the present invention.
ing under the collaborative software umbrella, that enables FIG. 2 shows a screen display in accordance with an
two or more users to access a shared application or document embodiment of the present invention.
from their respective computers simultaneously in real time. 15 FIGS. 3 to 5 show a base node and a peripheral device and
Generally, the shared application or document will be running a client processing device in accordance with embodiments of
on a host computer, and remote access to the shared content the present invention.
will be provided to other users by the host user. Application FIG. 6 shows a display in accordance with an embodiment
sharing should be distinguished from systems in which col of the present invention.
laboration on the applications between different users is not FIG. 7 shows a peripheral device in accordance with an
possible but the contents of individual computer screens can embodiment of the present invention.
be projected onto a remote display with multiple users at the FIG. 8 shows a client processing device in accordance with
same time. an embodiment of the present invention.
The term “arbitrary media content” refers to the fact that a FIG. 9 shows a further client processing device in accor
user may generate, create or select any media content that is 25 dance with an embodiment of the present invention.
appropriate to display. This differs from client voting on, or FIG. 10 shows an embodiment of a peripheral device in
selecting of media content that is displayed by another in a accordance with an embodiment of the present invention.
meeting or presentation. This term refers to client oriented,
distributed rights and privileges for the display of content DETAILED DESCRIPTION OF THE
rather than a central presenter providing content which is 30 EMBODIMENTS OF THE PRESENT
presented to the members of the meeting. INVENTION
"Screen scraping in our sense refers to reading the video
frame buffers and processing them, rather than just rendering The present invention will be described with respect to
them on a display. Screen scraping for presentations is particular embodiments and with reference to certain draw
described in US2002/0196378 to Slobodin et all which is 35 ings but the invention is not limited thereto but only by the
included herein by reference. claims. The drawings described are only schematic and are
Auto composition” or “auto layout” refers to the auto non-limiting.
matic nature in which multiple graphics/video sources are Furthermore, the terms first, second, third and the like in
rendered on a central display, without user intervention and in the description and in the claims, are used for distinguishing
a way that a user would intuitively expect it to happen. 40 between similar elements and not necessarily for describing a
“Wireless” and “wireless communication network' can be sequential or chronological order. The terms are interchange
any network that does not use cable links between nodes, e.g. able under appropriate circumstances and the embodiments
uses RF, optical or InfraRed for communication purposes, of the invention can operate in other sequences than described
such as IrDA, diffuse infra-red, WLAN, WiMax, WiFi, WiFi or illustrated herein.
Direct, Bluetooth or any other wireless communication net 45 Moreover, the terms top, bottom, over, under and the like in
work known to the person skilled in the art. the description and the claims are used for descriptive pur
"Computer generally refers to a processing device, i.e. poses and not necessarily for describing relative positions.
having a processing engine capable of various types of digital The terms so used are interchangeable under appropriate
processing, such as rendering graphics images for display. A circumstances and the embodiments of the invention
computer can be in the form of a work station, a personal 50 described herein can operate in other orientations than
computer, a lap-top, a palmtop, a PDA, a Smartphone, a tablet described or illustrated herein.
etc. Generally a computer has memory such as volatile RAM. The term “comprising”, used in the claims, should not be
Non-volatile memory Such as a hard disc, optical disk or Solid interpreted as being restricted to the means listed thereafter; it
state memory can be included in the computer or can be a does not exclude other elements or steps. It needs to be
peripheral device. Currently most computers are electronic 55 interpreted as specifying the presence of the stated features,
but the term “computer also includes optics based comput integers, steps or components as referred to, but does not
ing devices. preclude the presence or addition of one or more other fea
The term “pre-installed generic driver' is intended to mean tures, integers, steps or components, or groups thereof. Thus,
a driver which is installed on a processing device Such as a the scope of the expression "a device comprising means A and
computer as a standard driver, e.g. is installed with the instal 60 B” should not be limited to devices consisting only of com
lation of the operating system. Such a driver is standard for ponents A and B. It means that with respect to the present
the operating system and can drive a standard class of periph invention, the only relevant components of the device are A
eral devices coupled to or connected to the processing device. and B.
The installation of a specific driver for such a peripheral Similarly, it is to be noticed that the term “coupled, also
device is not required. Such a generic driver can be a human 65 used in the description or claims, should not be interpreted as
interface driver (HID) or a mass storage device driver, which being restricted to direct connections only. Thus, the scope of
has predetermined software components configured for driv the expression “a device A coupled to a device B should not
US 8,756,348 B2
13 14
be limited to devices or systems wherein an output of device network 50 is the base or display node 36. This node 36 may
A is directly connected to an input of device B. It means that optionally be a wireless access point. The base node 36 may
there exists a path between an output of A and an input of B also be a processing device or host computer and may be
which may be a path including other devices or means. coupled to a second connection unit 49 that provides access to
Elements or parts of the described devices may comprise the network 50 thus linking all of the processing devices 31,
logic encoded in media for performing any kind of informa 36 together. The connection unit may have an input device as
tion processing. Logic may comprise Software encoded in a described above. Alternatively, network connections installed
disk or other computer-readable medium and/or instructions on the base node 36 can be used. Audio equipment 46 may be
encoded in an application specific integrated circuit (ASIC), provided, e.g. a telephone that allows other members of the
field programmable gate array (FPGA), or other processor or 10 meeting to call in from remote destinations.
hardware. The display node 36 is coupled to and adapted to allow
References to software can encompass any type of pro display of media on Some kind of display 44. The display
grams in any language executable directly or indirectly by a node is in embodiments of the present invention a base node
processor. of the communications network 50. The display 44 may be a
References to logic, hardware, processor or circuitry can 15 projector and Screen, the projector being coupled to the base
encompass any kind of logic or analog circuitry, integrated to node 36. A whiteboard 45 can optionally be provided that can
any degree, and not limited to general purpose processors, be optionally coupled to the display 44 and/or the base node
digital signal processors, ASICs, FPGAs, discrete compo 36, e.g. when the whiteboard can record electronically what is
nents or transistor logic gates and so on. written on it. Optionally, a camera 35 may be provided to
Embodiments of the present invention provide solutions to record the entries on the whiteboard 45. The camera 35 may
three major problems with meetings: have a third connection unit 52 for connecting the camera 52
a) the time taken to prepare for a meeting. This is mainly to the network 50 so that the data from the whiteboard can be
achieved by allowing “on-the-fly” presentation of any dis recorded and stored or transmitted to other networks via
playable information. This information does not have to be router 42. The connection unit 52 may have an input device as
linked into any particular presentation software, nor to be 25 described above.
compatible with any Such presentation software, Optional equipment can be cameras 39, 40, 41 for record
b) the time taken to conduct the meeting using electronic ing the progress of the meeting. These cameras can be linked
meeting tools. This is achieved by reducing the time to by a network 51, e.g. a cable network to the router 42 and/or
connect computers to the display or projection system. the base node 36. Another optional item is a microphone or
c) the time taken to reflect and review and document the 30 microphones 38 that can be used to transfer audio, e.g. to the
meeting afterwards. This is achieved by providing the pos processing devices 31 and to loud speakers (not shown)
sibility of recording the course of the meeting in the same attached to the base node 36 or part of the display 44.
time sequence that it was carried out as well as be able to Any or all of the outputs of the processing devices 31, the
store all data presented and who presented it. cameras, the whiteboard, etc. can be recorded and stored
FIG. 1a is a schematic representation of a generic meeting 35 digitally, e.g. in node 36 or elsewhere to provide a complete
room 30 with a meeting table that can be used with embodi record with correct time sequence.
ments of the present invention. Participants 37 have some Summarizing the above, the present invention provides an
form of processing device 31 such as a laptop computer, a electronic meeting tool for communicating arbitrary media
tablet, a PDA etc. Each of the processing devices 31 can be a content between different users 37 (with their own processing
host device and has a first connection unit 47 to which it is 40 devices 31, e.g. PC, mobile phone, or tablet) and one display
coupled. The first connection unit 47 provides access to a or projector or multiple displays or projectors 44 in the meet
network 50 which in this case is a wireless network, but could ing room 50.
be a wired network. Each connection unit 47 may be coupled Referring to FIGS. 1a and 1b embodiments of the present
to an input device 48 which will be described in more detail invention comprise a base or display node 36 being a process
later. A user37 will typically at a distance from the processing 45 ing device, e.g. a host computer adapted to receive user
device 37 which is ergonomically satisfactory. This ergo selected arbitrary media content, the base node 36 being
nomic boundary is typically an area of about 1000 sq cm to coupled to a central display 44 which can be a fixed format
4000 sq cm. This ergonomic boundary will typically have the display or a projector or similar. The arbitrary media content
user as one side of the boundary and the comfortable reach of can be provided from any of the user processing devices 31.
the arms will determine an area on the left and right of the 50 The base node 36 can be adapted to display the received user
processing device which falls within the ergonomic boundary selected arbitrary media content in accordance with a set of
and the far edge of the boundary of the processing device rules, e.g. FIFO. automatically, on request or approval, forced
(normally delimited by a display screen) will determine the to display, in accordance with a priority etc. Optionally the
other side of the ergonomic boundary. The area defined by the base node 36 is adapted to force display of the received user
ergonomic boundary will overlap or include the processing 55 selected arbitrary media content, i.e. to allow participation in
device 31 itself. The processing device will also have an outer the meeting by an individual user displaying own selected
physical boundary. The input device 48 is preferably arranged content on display 44 independently of the person who is
to operate outside the boundary of the processing device 31 nominally responsible for giving a presentation or chairing
but within the ergonomic boundary. Preferably the input the meeting. Forcing the display can also be considered as a
device is arranged to function when it is flat on the table. The 60 rule. The meeting tool can also be adapted to allow a priority
input device preferably has an size of activation area of setting. This means that a user can set a priority setting for the
between 1 and 144 square cm. media to be displayed. A priority of “1” for example can be
Preferably the network 50 is a local area network, i.e. interpreted by the base node as a forced display, a priority “2
preferably local to the meeting room for security reasons but can be interpreted by the base node as display as soon as
the network 50 may have access to other local or wide area 65 possible, priority '3” can be interpreted by the base node as
networks such as 51 or to a larger corporate network or the place in queue and display as the time comes etc. Setting and
internet 43, for example via a router 42. Another node of the using priorities for display are also considered to be working
US 8,756,348 B2
15 16
to rules. To execute the rules, the base node 36 may have a receiver is preferably a transceiver. Optionally the transmit
decision module. The base node 36 may be a host computer ter/receiver can be a wireless transmitter/receiver.
having a processing engine Such as a microprocessor and a The input device 48 allows a user interaction with the
memory. Preferably, the base node 36 is adapted to treat connection unit 47. Preferably the input device 48 is physical
media content passed to the base node 36 from any or all of the actuator coupled to the connection unit 47. The user action
connection units 47 in an equal manner. The base node 36 applied to the input device 48 generates a signal that can
may be adapted to auto compose the media content on the trigger transfer of data from the processing device 31 (to
central display 44 connected to it, e.g. from one or more which the connection unit 47 is coupled) to the network 50.
processing devices 31. Preferably the input device 48 has an activating surface that is
An independent aspect of the present invention is at least 10 between 100 and 14,400 square mm. Optionally, the input
one connection unit 47, (optionally 49 for receiving) adapted device 48 can be a key displayed on the client display 1 of a
to communicate the user selected arbitrary media content to client processing device 31. This key can be activated, e.g. by
said base node 36. Preferably the connection units 47 and/or use of a pointing device Such as a mouse trigger transfer of
optionally 49 are physical plug-and-play devices. An data from the processing device 31 to the network 50.
example of a connection unit is shown schematically in FIG. 15 The connection unit 47 is preferably provided with a visual
10. indicator 61, e.g. for allowing user feedback from the con
The connection unit 47 may integrated into a user process nection unit 47 of the status of any activity.
ing device 31, e.g. as an internal peripheral device or may The system also can include a server program 64 adapted to
preferably be an external peripheral device comprising a con be loaded onto the base node 36, said program 64 being
nector adapted to couple to a port of a user processing device adapted to receive arbitrary media content from one or a
31. The processing device 31 may have a client display, a plurality of client processing devices 31 through said connec
processing engine Such as a microprocessor, a memory and an tion units 47, (optionally 49), and to show this plurality of
operating system. The optional connection unit 49 may inte arbitrary media content streams on one or a plurality of dis
grated into the base node 36, e.g. as an internal peripheral plays 44. The server program 64 may be adapted to allow
device or may be an external peripheral device comprising a 25 display in accordance with one or more rules, e.g. FIFO,
connector adapted to couple to a port of the base node 36. The automatically, on request, forced, in accordance with a prior
connection unit 49 may be fully integrated into the base node ity etc. To execute the rules, the server program 64 may have
36, e.g. is an internal network interface of the base node 36. a decision module.
The base node 36 may have a processing engine Such as a Preferably, the server program 64 is adapted to treat media
microprocessor, a memory and an operating system. 30 content passed to it from any or all of the connection units 47
The user processing devices 31, the connection units 47. in an equal manner. The server program 64 may be adapted to
(optionally 49) and the base node 36 co-operate to form a auto compose the media content on the central display 44.
communication network50 for linking between at least one of The server program 64 may be a portable application
the plurality of processing devices 31, 36 and the central adapted to be loaded onto the base node 36 and to be run on
display device 44. The communication network 50 is adapted 35 the operating system of the base node 36. The portable appli
to receive arbitrary media content from at least one of the cation 64 runs a process on the base node 36 that is adapted to
plurality of processing devices 31 and to transmit the arbitrary display an arbitrary media content received from the client
media content of at least one of the plurality of processing processing device 31 via the communication network 50, the
devices to the central display device 44. process leaving a Zero footprint on termination. Optionally
An independent aspect of the present invention is a por 40 the portable application 64 is stored on each connection unit
table application 60 adapted to be loaded onto a client pro 49 and optionally 7 and can be installed therefrom.
cessing device 31 and to be run on the operating system of the The system may also include a central display device 44
client processing device 31. The portable application 60 runs and optionally a whiteboard 45 or other display means such as
as a process on the client processing device 31 that is adapted a printer. The display 44 being adapted to receive user
to deliver an arbitrary media content from the client process 45 selected arbitrary media content, and may be adapted to allow
ing device 31 to the communication network 50 in response to display of the received user selected arbitrary media content
a useraction applied to an input device 48, the process leaving in accordance with one or more rules, e.g. FIFO, automatic,
a Zero footprint on termination. Optionally the portable appli forced, on request or approval, in accordance with a priority
cation 60 is stored on each connection unit 47 and optionally etc.
49. Preferably the portable application 60 is adapted to 50 Optionally, one of the connection units 47 can be adapted
“screen scrape' content of the client display of the client to be a master connection unit. Such a master connection unit
processing device 31. Optionally the portable application 60 may be adapted to instruct the base node when media content
when run on a processing device 31 is adapted to 'screen from a client processing device 31 may be displayed or which
scrape' content of the client display of this client processing of the processing devices may be allowed to send content for
device 31 and to transmit it via a connection unit 47. Option 55 display.
ally the portable application 60 when run on the processing In embodiments of the present invention, at least one por
device is adapted to "screen scrape' content of the client table application is used, e.g. for the client Software on a client
display of the client processing device 31 and to transmit it via procesing device 31 or optionzlly on the base node 36. In
a network interface of the processing device 31, for example these embodiments, one of the pre-installed generic drivers of
if the connection unit 47 has no transmitter. 60 the operating system on the relevant computer device 31, 36
The connection unit 47 for communicating with said base is exploited for setting up communication from the computer
node 36 has a network interface e.g. comprising a transmitter device 31, 36 to the network 50 via the connection unit 47,
62. The transmitter 62 is preferably a transceiver. Optionally (optionally 49). The generic driver is used in connection with
the transmitter/receiver can be a wireless transmitter/receiver. the connection unit 47, (optionally 49) operating as a periph
The base node 36 for communicating with the connection 65 eral device but the use can go beyond that of the standard class
unit 47 has a receiver 63 which can be included in the con of peripheral devices for which the generic driver is intended.
nection unit 49 or integrated into the base node 36. The In some embodiments the connection unit 47, (optionally 49)
US 8,756,348 B2
17 18
operated as a peripheral device communicates with the rel The visual indicator 61 on the connection unit 47 indicates
evant processing device 31, 36 by using a generic communi to the user and to other participants in the meeting that media
cation protocol provided by the pre-installed generic driver. content is being sent by that connection unit 47 to the base
Pre-installed USB drivers are examples. Preferably the set node 36 for display.
ting up of the communication of network 50 using connection Repeating the second user interaction on the input device
unit 47, (optionally 49) does not alter or affect the networking 48 of a connection unit 47 decouples the media content from
capability of the relevant processing device 31, 36. For that connection unit 47 from the base node 36. The base node
example, if a browser is started on the client processing 36 removes that media content from the composed image on
device 31, this browser can use the standard network inter the central display and recomposes the remaining content on
faces on the processing device 31. This means that transfer of 10 the central display.
data via the connection unit 47 (optionally 49) is independent The content on the central display/projector is auto
of transfer of data over the network interfaces of processing arranged as shown in FIG. 2. When user 1 adds content,
device 31 or 36. This has the advantage that each user can his/her display will be scaled to fill the available central
carry out processing Such as searching on the internet to display canvas as much as possible, but without affecting the
gather data independently of the transfer of data to be 15 aspect ratio. When user 2 adds in, his content is added to the
diplayed during a meeting, or receive emails etc. side of the first image. When user 3 adds his content, the
The use of a portable application has the advantage that any arrangement is triangle wise. Adding user 4, the image
modification to settings in the register or generally in the becomes a 2 by 2 tiling, which is the maximum available.
operating system can be avoided, so that upon any form of When an additional user attempts to add content, he will be
termination, e.g. disconnecting the electronic device, system blocked. When a user initiates action to remove his/her con
crash, no trace is left. This is generally termed “Zero foot tent, his/her media content is removed from the central dis
print. play and one moves backward in the composition sequence
The present invention has the advantage of scalability. It shown in FIG. 2.
can provide a display system for use by a plurality of users in Base Node Software
meetings. Every user in the meeting thus can have a client 25 The base node software has one or more of the following
processing device 31 for coupling to a connection unit 47. A features:
first useraction connects the client processing device 31 to the First code for providing a means or a method step for
base node 36, e.g. by inserting a connection unit 47 into the correctly configuring the receiver of the base node as an
relevant interface connector on the processing device 31, e.g. access point.
a USB interface. A second user action comprising activating 30 Second code for providing a means or a method step for
abutton or key on the input device (e.g. by depressing it) then listening for output of connection units trying to connect
starts the process of transmitting arbitrary media content from on a specific port.
the client processing device 31 to the base node 36. This Optionally, third code for providing a means or a method
process preferably includes screen scraping data from the step for a GUI for administration purposes, offered for
processing device. Using screen scraping avoids special pro 35 example over a web interface.
grams being installed on the base node 36 to carry out graphi Optionally, fourth code for providing a means or a method
cal commands sent from the processing device 31. When the step for publishing its presence over the network using
base node 36 receives the plurality of arbitrary media content, the Zeroconf protocol.
it can allow auto composition of this media content on the Optionally, fifth code for providing a means or a method
central display connected to it. 40 step for accepting and installing Software updates of the
The present invention will now be described further with base node as well as for the portable application software
reference to certain more specific embodiments. for the connection units.
With reference to FIG. 2, the base node software (6) run Sixth code for providing a means or a method step for
ning on a base node 36 can be adapted to display on the central providing facilities for pairing of connection units to the
display a splash screen (21) showing its readiness to receive 45 base node.
arbitrary media content over its receiver. This splash screen Seventh code for providing a means or a method step for
(21) can also show instructions on how to use the system, as auto-composing of different incoming arbitrary media
well as the configuration parameters (see later) to reach the streams and rendering of composited image on display
base node 36. These configuration parameters are also shown or projector Screen.
in a transparent canvas at the bottom of the central display 50 Eighth code for providing a means or a method step for
(22). receiving, decrypting and decoding incoming arbitrary
A client processing device 31 that wants to have its arbi media content.
trary media content displayed on the central display con Optionally ninth code for providing a means or a method
nected to the base node 36 is connected to a connection unit step for scaling of incoming arbitrary media streams
47. The portable application 60 will be executed on the client 55 Optionally tenth code for providing a means for displaying
processing device 31 as a host device. A first user interaction incoming arbitrary media content in accordance with a
creates a connection between the portable application 60 and set of one or more rules.
the base node 36 using the transmitter in the connection unit Any of the above code may be stored on a non-transitory
47 and the receiver in the base node 36. A second user inter machine readable storage medium Such as an optical disk, a
action, this time on the input device 48, activates Screen 60 magnetic disk, magnetic tape, Solid state memory etc.
scraping by the portable application of the arbitrary media Portable Application for the Client Processing Device
content from the client processing device display, which is The portable application comprises an algorithm for Screen
then sent over the connector unit 47 to the base node. scraping. Screen scraping algorithms include VNC and RDP
The base node 36 receives the plurality of arbitrary media or similar. The algorithm may include a combination of algo
content coming from one or more connection units 47, and 65 rithms such as VNC and RDP that are optimized for different
auto composes this media content for rendering on the central content, e.g. static text or video. The portable application has
display. one or more of the following features:
US 8,756,348 B2
19 20
Eleventh code for providing a means or a method step for Program updates of portable application and server pro
connecting to a network including the base node. gram can be performed locally
Twelfth code for providing a means or a method step for Portable applications are used, no installation, multi-plat
capturing video frame buffers of the client processing form, no vendor specifics
device, i.e. computer (C), also called screen scraping. 5 Particular implementation of screen scraping done by por
Thirteenth code for providing a means or a method step for table application avoids vendor specific graphics
encoding, compressing and optionally encrypting these devices
Video frames and sending them over a secure link to the Standard drivers are used
base node. Only changed areas such as rectangles or No configuration changes on the client processing devices
triangles of the screen need to be transferred, and differ 10 Zero footprint applications on client processing devices—
ent types of rectangles or triangles are encoded in dif nothing to clear up or adjust or reset
ferent ways (e.g. RLE, JPEG, . . . ) to optimise perfor Own networking facilities of client processing devices not
aCC. blocked
Fourteenth code for providing a means or a method step for No configuration changes on the user computers
handling the connection unit. 15 Low virus, malware and spyware risk
Fifteenth code for providing a means or a method step for The portable application may be stored on a non-transitory
initiating connection to base node. machine readable storage medium Such as an optical disk, a
Sixteenth code for receive inputs from the input device on magnetic disk, magnetic tape, Solid state memory etc.
the connection unit. Second Embodiment
Seventeenth code for providing a means or a method step In the second embodiment, referring to FIGS. 2 to 5, the
for sending state changes to the visual indicator on the base node is a separate physical processing device called base
connection unit. unit (B), comprising permanent storage, memory, a process
Optionally, eighteenth code for providing a means or a ing engine, a wireless access point (4), a plug and play inter
method step for presenting the user a GUI (18). face Such as a USB port (11), a graphics display output
Optionally, nineteenth code for presenting GUI for admin 25 adapter (5) like VGA/DP/DVI/HDMI, and optionally an
istration of the portable application. audio output adapter (27). An input device having an actuator
Optionally, twentieth code for providing a means or a Such as a button 13 and a visual indicator 14 are optional.
method step for displaying and activating a key on the The connection unit is a physical device in the form of an
display of the client processing device for allowing a external peripheral device (shown in the drawings as a
user input to start the transfer of data from the client 30 "dongle' D) comprising permanent storage storing the por
device to the base node. table application (7) and configuration parameters (12),
Any of the above code may be stored on a non-transitory memory, a processing engine (e.g. CPU, FPGA), a wireless
machine readable storage medium Such as an optical disk, a transmitter Such as WiFi (3), a plug and play interface such as
magnetic disk, magnetic tape, Solid state memory etc. a USB interface (2), a button as input device (9), an LED ring
In this embodiment the portable application stored on the 35 as visual indicator (10). The portable application is stored on
connection unit, and is executed in an execution context on the peripheral device (7).
the client processing device. The portable application does The client processing device is host device, for example a
not need to be copied to or installed on the computer. It can be computer or laptop comprising a display, a plug and play
executed directly from the connection unit. It will only be interface Such as a USB port (2), memory, and a processing
copied temporarily into an execution context on the client 40 engine Such as a microprocessor.
processing device. There are also no changes in configuration The system thus comprises
or settings in the client processing device. This means that an external peripheral device (D) that has a plug and play
nothing will remain on the client processing device when the interface such as a USB interface (2) on one end and a
connection unit is removed. It also implies that the portable communications interface Such as a wireless interface
application will run on client processing devices where the 45 configured as client (3) on the other end.
user does not have the necessary access rights to install soft a base unit (B) that has a communications interface Such as
Wa. a wireless interface configured as access point on one
The portable application is designed in Such a way that end (4) and a video card adapter (5) like VGA, DVI, DP
No specific drivers need to be installed on the client pro or HDMI on the other end.
cessing device. 50 a portable application (7) stored on the peripheral device
Pre-installed drivers are used, e.g. for classes of peripheral (D) but executed on the client processing device (C)
devices. a base node software (6) stored and executed on the base
It is independent from Vendor specific graphics hardware. unit (B)
It runs on at least one and preferably on a variety of differ The external peripheral device (D) also preferably has any
ent client processing devices, including Windows, Mac 55 one or any combination of:
OS/X, Linux, Android, iOS and many others. a large button as actuator for the input device (9) allowing
Advantages user interaction with the peripheral device. The button
The present application has one or more of the following preferably has an actuation surface area of between 100
advantages: and 14.400 square mm.
No need for a master role in the meeting 60 visual indication such as a LED (10) allowing user feed
Standard plug and play connectivity of connection units to back from the peripheral device
base node An advantage of embodiments of the present invention is to
Simple and well known user actions are employed provide data transfer to the peripheral device via a peripheral
Own networking facilities of client processing devices not interface Such as a USB interface on any processing device
blocked 65 Such as a computer in a manner that is largely operating
No configuration changes on the client processing device system independent and without leaving a footprint (Zero
Input devices are easily accessible; e.g. large size Footprint). Installation of drivers and/or applications onto
US 8,756,348 B2
21 22
Such a processing device as a computer is not necessary channel from the peripheral device to the base unit. The
wherever pre-installed generic drivers are present. Adminis content is not shown yet. The LED (10) on the peripheral
trator rights on the processing device Such as a computer are device now turns white to give a visual indication of this new
preferably not necessary. To avoid the need for administrator State.
rights, embodiments of the present invention use other When the user at the computer (C) wants to show her
peripheral device pre-installed drivers such as USB class content, she presses the button (9). When the button was
drivers supported without any extra installation. Embodi previously in state “connected' (see FIG. 6), it will check the
ments of the present invention route at least screen scraped state of the base unit (P). If the base unit is not in state “full',
data presented by client software running on the processing the peripheral device will send the screen scraped arbitrary
device for transfer to a communications network via a periph 10 media content to the base unit (B), which will add the media
eral device such as a USB device. This bypasses any network content to the composition on the central display. The periph
interface of the processing device (and hence many firewalls) eral device LED (10) now turns red to indicate “showing
but only for the specific client software. Other applications state (FIG. 6).
are not affected and can make use of the standard network The button (9) acts as a toggle. When the user presses the
interfaces, i.e. packets from/to the TCP/IP stack are trans 15 button again, that computer displays content will be removed
ferred to a network device as normal. The client software is from the projector. The LED (10) goes back to white.
launched from the peripheral device such as a USB composite Use of the auto-run feature is optional if possible and
device or storage device as a portable application, which can enabled on the computer (C) to start the client software (7) as
avoid that any traces are left on the host OS. soon as the peripheral device is plugged in. On Windows for
Basic Usage Scenario of the Second Embodiment example, this means mounting the peripheral device as a mass
The base node software (6) displays on the projector a storage device and using the autorun.inf file stored on the
splash screen (21) in FIG. 5 showing its readiness to peripheral device.
receive arbitrary media content over its receiver (4). This In many cases however, this auto-run feature will be dis
Splash screen (21) also shows instructions on how to use the abled for security reasons. In that case, we will, if possible and
system, as well as the configuration parameters (see later) to 25 enabled on the computer (C), use the auto-play feature to
reach the base node. These configuration parameters are also show the logo of the connected peripheral device on the
shown in a transparent canvas at the bottom of the central desktop of the computer. The user then needs to double click
display (22). on that logo to start the client software. If the auto-play feature
To avoid user interaction for the configuration of the con as described above is also not possible or enabled, the user
nection between peripheral device and base unit, a pairing 30 must browse to the file system of the connected peripheral
process is used. This pairing process provides the peripheral device and start the application manually. This means double
device, i.e. the connection unit with networks parameters clicking the client.exe file on Windows, client.app on Mac
needed to set up the local network. As an example, the periph OS/X or tapping the appropriate application icon on a tablet
eral device can be briefly plugged into the USB port (11) of or any mobile device with touch screen.
the base unit (B). The base unit then optionally does a soft 35 Third Embodiment: Portable Application Stored on Standard
ware validity check, optionally does a software update of the Solid State Memory Such as a USB Stick
portable application stored on the peripheral device, and In the third embodiment, the portable application is stored
writes the connection parameters on the peripheral device (D) on a solid state memory such as a regular USB memory stick
required for the peripheral device and base unit to find each (FIG. 7).
other to the permanent storage (8). For example, when using 40 With a solid state memory such as a regular USB memory
WiFi, this would be the SSID, WEP/WPA2 and IP address of Stick, there is no input device, visual indicator or transmitter
the base units receiver, as well as the port number used by the of the kinds described above for the connection unit. This
base node software. means that the system needs to:
A client processing device that wants to have its arbitrary Use the transmitter/receiver from the client processing
media content displayed on the central display connected to 45 device.
the base node (5) connects a peripheral device (D) to its USB Use as input device a key or button on the client processing
port via (2). The peripheral device presents itself to the com device like a physical key on the keyboard, a special
puter over interface (2) as a composite device comprising a mouse press, a button area on a touch screen, a button
mass storage device and a keypad. This has the major advan displayed on the screen to be clicked on with a mouse
tage that no specific driver is required, since all these devices 50 pointer.
are natively Supported in every personal computer system that Present the visual indicator on the client processing
has a USB port. If autorun is enabled, then the computer will device's display.
automatically execute the client software (7) stored in mass The client processing device then looks like FIG. 8.
storage (8) on the peripheral device. The first user interaction This embodiment provides a peripheral interface such as
mentioned in the general case is then just the connection of 55 the USB interface on any processing device acting as a host
the peripheral device to the USB port. If security measures device such as a computer in a manner that is largely operat
disabled auto-run, the user needs to explore the mass storage ing system independent. Installation of drivers and/or appli
on the mass storage of the peripheral device and start the cations onto Such a processing device as a computer is not
portable application manually. necessary wherever pre-installed generic drivers are present.
The portable application will use the wireless, e.g. wifi 60 Administrator rights on the processing device Such as a com
interface of the peripheral device (3) to connect to the correct puter are preferably not necessary. To avoid the need for
base node. To know the right base unit to connect to, the administrator rights, this embodiment uses other peripheral
configuration parameters needed to make this connection are device pre-installed drivers such as USB class drivers Sup
stored in the database (12) on the mass storage device (8) ported without any extra installation. This embodiment of the
during the pairing process described earlier. 65 present invention routes at least Screen scraped data presented
Once the connection is made, the peripheral device goes by client Software running on the processing device for trans
into connected mode. This means that there is now at least one ferto a communications network via a network connection of
US 8,756,348 B2
23 24
the processing device. The client software is launched from there is often no USB port available
the peripheral device such as the USB device as a portable application distribution is easy and widely accepted
application. through application stores
The first user operation then comprises: Fifth Embodiment: Base Node Software OEMed to Projec
plugging in the Solid state device Such as a USB memory tor or Display Equipment
Stick, In this embodiment, the base node is not realized as a
starting the portable application (if autorun is disabled) separate physical box, but integrated into the processing unit
configuring the transmitter on the client processing device inside a display or projector. All other details areas previously
described.
to connect to the correct base node, using the configu 10 Sixth Embodiment
ration parameters (22) shown on the central display In this embodiment, the base node is not realized as a
triggering the connection of the portable application with separate physical box, but integrated into the codec of a video
the base node, for example by interacting with an ele conferencing equipment. All other details are as previously
ment on the GUI (18) of the portable application pre described.
sented on the display of the client processing device. 15 Seventh Embodiment: Remote Meeting Participant
Presenting visual feedback on user actions is in this In this embodiment, one or multiple client operating
embodiment also done using elements in the GUI of the devices are not in the direct vicinity of the base node but on a
display of the client operating device. remote location.
In this embodiment, the advantage of Zero footprint is To accommodate this case, the following adaptations are
partly realized by the portable application in the sense that no needed:
Software is installed on or copied to the client operating further compression and or scaling of the arbitrary media
device, but there is a configuration change needed to connect content to allow use of low bandwidth connection
the transmitter of the client operating device with the base possibility to communicate connection parameters of the
node, which needs to be undone afterwards. base node to a remote user
Optionally, the portable application can make the configu 25 connectivity of the base node to the WAN network to which
ration changes to the transmitter for the user. the remote user is connected
Advantages Lost in this Embodiment All other details are as previously described.
Partial loss of Zero footprint nature of portable application Eighth Embodiment: Multiple Base Nodes
More complex first user interaction In this embodiment, multiple base nodes are used. This can
More expertise required from user 30 be done for different purposes:
GUI needed on client operating device display, which is connectivity of multiple central displays
possibly also shown on central display extension of real estate of central display
Need to find free key on client operating device when using connectivity of base nodes in different remote locations
Thi provides the advantage that one can present on multiple
physical key for second user action 35 base units from a single peripheral device. This is usefull for
Network interface is blocked from other uses by portable a number of cases:
application personal peripheral device: user can have a personal
Optionally, the last point can be avoided by using the base peripheral device that is paired with multiple meeting
unit as a gateway to the network that the client operating rooms that he regularly uses
device wanted to connect to through its own interface. 40 use in meeting room with multiple base units each control
Advantages are: ling a different display in the same meeting room
tight control of user connectivity to corporate network The proposal uses a special variant of the peripheral device
through settings on the base unit called a multi base peripheral device. The multi base periph
keep network connectivity intact even when transmitter is eral device is equiped with a rotating wheel around the circu
now also used for display purposes 45 lar central "show me' button. This could be a mechanical
Disadvantage is a higher Vulnerability of the system rotating multi-position Switch or something like the touch
because the display connection is now possible a doorway wheel on the iPod classic.
into the corporate network. The pairing of this multi-base variant of the peripheral
What remains as advantages are device:
the availability of a physical medium to distribute the por 50 the rotation wheel is put in the position of the correspond
table application to users ing base unit.
no need to install or copy software to client operating the peripheral device is paired to the base node in the
device regular way
easy way to maintain software updates on the connection the configuration parameters are stored in a permanent
units (here: memory sticks) via the base unit 55 storage location; every position of the rotating wheel has
possibility to write configuration data on the connection a corresponding set of connection parameters (e.g. dif
unit by the base unit, for example in the form of a ferent rows in a table) each corresponding with a par
configuration profile that can be read and used by the ticular base
client operating device The connection of the peripheral device is as follows:
Fourth Embodiment: Software Only Client Installed on the 60 multi-base peripheral device X is plugged into a PC
Client Processing Device rotation wheel on peripheral device X is put in position A
This embodiment is similar to the third embodiment, with peripheral device X reads configuration parameters in
as only difference that the software is copied on the client position A of its internal memory
operating device (FIG. 9). In this case, no plug and play port peripheral device X connects to base node A
Such as a USB port is required on the client operating device. 65 base node A indicates connection of multi-base peripheral
This embodiment will typically be used for tablet PCs and device X on central display Screen
mobile devices. In that case rotation wheel on peripheral device X is put in position B
US 8,756,348 B2
25 26
peripheral device X reads configuration parameters in Alternative Embodiments
position B of its internal memory In the above embodiments, once the connection is made
peripheral device X connects to base node B between the connection device and a host computer, the
base node B indicates connection of multi-base peripheral peripheral device goes into connected mode. This means that
device X on screen 5 there is at least one channel from the peripheral device to the
continue until correct base is selected with rotation wheel base node. In accordance with any of the embodiments of the
click the peripheral device input device e.g. button to show present invention a plurality of channels can be set up
content on central display of base node between the connection device and the base node. These
rotating the wheel always first clicks away content from the channels may be logical channels.
base of the last position 10 Some examples for Such a multichannel arrangement may
Ninth Embodiment include the first and one or more of the additional channels:
FIG.10 shows a peripheral device 47 in accordance with an First channel is for the Scraped image stream (XDS)
independent embodiment of the present invention including Second channel is for GPU commands (OpenGL, DirectX)
an input device. This embodiment can be used with any of the Third channel is for Mouse pointer coordinates (absolute,
embodiments described above. 15 relative)
The peripheral device is configured as a connection unit Fourth channel is for Mouse pointer icons
and is a physical device in the form of a connector for a plug Fifth channel is for Image data files (JPEG, PNG,
and play interface of a user processing device as a host com GIF, ...)
puter such as a USB connection, a flexible data and power Sixth channel is for Multimedia data files or streams
connection connected to the connector and a base, the base (MPEG2, MPEG4, OGG, H.26x, ...)
having an actuator, e.g. a button configured to be an input Seventh channel is for Audio data files or streams (MP3,
device with the functions as described above. MP4, AAC, WMA, ...)
The base and/or the actuator is preferably large in size, e.g. Eighth channel is for text or Document data files (DOC,
having a surface area between 100 and 14,400 square mm. DOCX, PPT, PPTX, ODT, ODS, PDF, ...)
The base can be square, rectangular, round, hexagonal, oval, 25 Ninth channel is for transmission of a priority value 1, 2,
polygonal in shape or any other ergonomically Suitable shape. 3 ... as described above.
The actuator is preferably round but can be square, rectangu In the above embodiments, a particular method of pairing
lar, hexagonal, oval, polygonal in shape etc. there can be more the peripheral device with the base node has been described.
than one actuator on one base. Any of the embodiments of the present invention may include
The length of the flexible data and power connection, e.g. 30 other pairing mechanisms of which some examples are given
cable is preferably adapted to place the peripheral device below.
(when in its connected in its operating position), especially Some examples for pairing
the base and the actuator, in the region between the boundary Plug in the peripheral device, to a generic peripheral
of the connected user processing device and the ergonomic device port such as a USB port of the base node or
boundary as defined above. In addition the flexible data and 35 other USB enabled device. Pairing info is transmitted
power connection should be adapted so that the base lies flat over the generic peripheral interface such as USB.
on the meeting table independent of the orientation of the The Signal strength of the wireless channel to the base
connector needed to insert the connector into the plug and node is used to identify which base nod is to be used
play interface. The flexible data and power connection can be The Signal strength of the wireless channel or any other
a cable that is firmly fixed to and integrated into the base. 40 channel. Example is an NFC/RFID transmitter can be
Alternatively the flexible data and power connection can be a provided underneath the meeting room table. Putting
separate cable that connectors to a suitable connector in the the user processing device Such as a laptop and the
base, e.g. a USB connector. peripheral device plugged in on this table automati
The base preferably includes electronics such as having cally pairs the peripheral device with the base of this
permanent storage for storing the portable application and the 45 meeting room
network configuration parameters, memory, a processing Manual pairing (e.g. by entering IP address, hostname,
engine (e.g. CPU, FPGA), a wireless transmitter/receiver wireless ID (like SSID on WiFi))
such as for WiFi, a plug and play interface such as a USB What is claimed is:
interface, a LED ring as visual indicator. The portable appli 1. An electronic meeting tool for communicating arbitrary
cation can be stored on the peripheral device, i.e. in the base. 50 media content from users at a meeting comprising:
The visual indicator is for allowing user feedback from the a node configuration arranged to operate a display node of
connection unit of the status of any activity. a communications network, the display node being
Some examples for activation of the actuator which can be coupled to a first display, the node configuration further
used with any of the embodiments of the present inven being arranged to receive user selected arbitrary media
tion: 55 content and to control display of the user selected arbi
Sound activated (handclap, Voice recognition, computer trary media content on the first display;
Sound, music. . . . ) at least one peripheral device configured to communicate
Remote controlled via wireless connected device (IR, the user selected arbitrary media content via the com
Bluetooth, WiFi, ...) munications network, wherein the peripheral device is a
Light activated 60 connection unit comprising:
Pressure activated, e.g. depression with a finger or hand. (a) a connector arranged to couple to a port of a process
Touch activated ing device having a second display, a memory and an
Proximity (near-touch on the actuator or bringing the operating system; and
actuator close to Some object (b) a transmitter arranged to communicate with the com
Biometric reader Such as Fingerprint reader, Iris Scan 65 munications network,
ner, DNA analyser a program configured to be loaded onto the processing
Keypad, e.g. for entering Keycode e.g. a password device and to run on the operating system of the process
US 8,756,348 B2
27 28
ing device, said program being arranged to obtain user 12. A method for communicating arbitrary media content
Selected arbitrary media content, said program leaving a from users at a meeting comprising:
Zero footprint on termination, and operating a display node of a communications network, the
an input device enabling the user to carry out a user action display node being coupled to a first display, to receive
that triggers transfer of said user selected arbitrary 5 user selected arbitrary media content and to control dis
media content to said transmitter through said port. play of the user selected arbitrary media content on the
first display; and
2. The electronic meeting tool of claim 1, wherein the connecting a peripheral device to a port of a processing
program is stored on the peripheral device. device and communicating the user selected arbitrary
3. The electronic meeting tool of claim 1, wherein the 10 media content via the communications network,
transmitter is a wireless transmitter or transceiver. loading a program onto the processing device and running
4. The electronic meeting tool of claim 1, wherein the the program on the operating system of the processing
peripheral device is a plug-and-play device. device to obtain user selected arbitrary media content,
5. The electronic meeting tool of claim 1, wherein the said program leaving a zero footprint on termination,
program is arranged to screen scrape content of the second and
15
display. triggering transfer of said user selected arbitrary media
6. The electronic meeting tool claim 1, wherein the input content to said transmitter through said port after a user
device is physical actuator coupled to the peripheral device. action on an input device.
7. The electronic meeting tool of claim 6, wherein the 13. The method of claim 12, further comprising configur
physical actuator has a surface area of between 100 and ing the peripheral device to connect to the communications
14,400 square mm. network by pairing the peripheral device with the display
node.
8. The electronic meeting tool of claim 1, wherein the input 14. The method of claim 13, wherein the pairing is per
device is a key displayed on the second display. formed by plugging the peripheral device into the display
9. The electronic meeting tool of claim 8, wherein the key node.
displayed on the second display is not screen scraped by the 25
15. The method of claim 12, further comprising setting up
program.
10. The electronic meeting tool of claim 1, wherein the by means of a pre-installed generic driver of the operating
peripheral device comprises a memory in which executable System, a means for communication between the peripheral
Software code is stored for execution on the processing device and the processing device.
device, said executable software code comprising: 30
16. The method of claim 12, wherein a pre-installed
a first Software code portion for setting up, by means of a generic driver is selected from a human interface device
pre-installed generic driver of the operating system, a driver and a mass storage device driver.
means for communication between the peripheral 17. The method of claim 12, further comprising one of:
device and the processing device; presenting the peripheral device to the processing device as
a second software code portion for connecting the process 35
a human interface device,
ing device to the communications network via the presenting the peripheral device to the processing device as
peripheral device, the peripheral device having a trans a mass storage device; and
ceiver; presenting the peripheral device to the processing device as
a third software code portion for screen scraping data from a composite device.
the processing device; and 40
18. The method of claim 12, wherein the program is stored
a fourth software code for routing screen scraped data on the peripheral device, and which obtains screen scraped
between the processing device and the communications data when run on the processing device.
network over the means for communication; wherein the 19. The method of claim 17, wherein a generic communi
first software code portion is adapted to use a generic cation protocol is used for transferring screen scraped data
communication protocol for transferring the screen 45
between the processing device and the peripheral device.
scraped data between the processing device and the 20. The method of claim 12 further comprising displaying
peripheral device. the user selected arbitrary media content on the first display in
11. A non-transitory storage medium storing the first to accordance with a set of rules.
fourth software code portion of claim 10. ck ck ck ck ck
Exhibit 2
US009083769B2
(12) United States Patent (10) Patent No.: US 9,083,769 B2

Beel et al. (45) Date of Patent: Jul. 14, 2015
(54) ELECTRONICTOOL AND METHODS FOR (58) Field of Classification Search
MEETINGS None
See application file for complete search history.
(71) Applicant: BARCO N.V., Kortrijk (BE)
(56) References Cited
(72) Inventors: Koen Simon Herman Beel, Eke (BE):
Yoav Nir, Komen (BE); Filip Josephine U.S. PATENT DOCUMENTS
Johan Louwet, Knesselare (BE); Guy 11/2005 Suess et al.
Coen, Aalst (BE) 6,966,035 B1
8,316,138 B2 11/2012 Chang
(73) Assignee: BARCO N.V., Kortrijk (BE) (Continued)
(*) Notice: Subject to any disclaimer, the term of this FOREIGN PATENT DOCUMENTS
patent is extended or adjusted under 35 EP 1187480 A1 3, 2002
U.S.C. 154(b) by 0 days. EP 1246395 A1 10, 2002
WO OO,52887 A1 9, 2000
(21) Appl. No.: 14/212,170
OTHER PUBLICATIONS
(22) Filed: Mar 14, 2014
Martin Trautschold, iPhone 4 Made Simple, 2010, Apress, pp. 1-819.
(65) Prior Publication Data (Continued)
US 2014/02O1400 A1 Jul. 17, 2014
Primary Examiner — Scott Sun
Related U.S. Application Data (74) Attorney, Agent, or Firm — Bacon & Thomas, PLLC
(63) Continuation-in-part of application No. 13/270,659,
filed on Oct. 11, 2011, now Pat. No. 8,756,348, and a (57) ABSTRACT
continuation-in-part of application No. An electronic meeting tool and method for communicating
PCT/EP2012/068166, filed on Sep. 14, 2012, and a arbitrary media content from users at a meeting comprises a
(Continued) node configuration means adapted to operate a display node
of a communications network, the display node being
(51) Int. Cl. coupled to a first display. The node configuration means is
G06F 3/06 (2006.01) adapted to receive user selected arbitrary media content and
H04L 29/06 (2006.01) to control display of the user selected arbitrary media content
G06F I3/38 (2006.01) on the first display. A peripheral device adapted to commu
(Continued) nicate the user selected arbitrary media content via the com
munications network is a connection unit comprising a con
(52) U.S. Cl. nector adapted to couple to a port of a processing device
CPC ................ H04L 65/403 (2013.01); G06F 9/00 having a second display, a memory and an operating system,
(2013.01); G06F 13/14 (2013.01); G06F and a transmitter. A program is adapted to obtain user selected
I3/385 (2013.01); H04L 12/1813 (2013.01); arbitrary media content, said program leaving a Zero footprint
H04L 51/00 (2013.01); H04L 65/00 (2013.01); on termination. The user may trigger a transfer of said user
H04L 65/4023 (2013.01); H04L 65/4038 selected arbitrary media content to said transmitter.
(2013.01); H04M 3/567 (2013.01); H04N5/00
(2013.01) 22 Claims, 5 Drawing Sheets
Enternal WiFi antenna's

transceiver
Base --> Actuator and
ButtOn input device
Visual internal mass storage

indicator
device storing portable
application
-- Flexible connection for data
signals and power

US 9,083,769 B2
Page 2
Related U.S. Application Data 2009, O198839 A1 8/2009 Banerjee et al.

2010, 0087139 A1 4/2010 Glass
continuation of application No. 13/270,659, filed on 2010/0302130 A1 12/2010 Kikuchi et al.
Oct. 11, 2011, now Pat. No. 8,756,348. 2011 0115689 A1 5/2011 Sugiyama et al.
2012/0331509 A1* 12/2012 Laksono ......................... 725/56
(60) Provisional application No. 61/534,592, filed on Sep. 2013,005O254 A1 2/2013 Tran et al.
14, 2011, provisional application No. 61/235.219, 2013, OO67121 A1 3/2013 Beel et al.
filed on Apr. 18, 2012, provisional application No. OTHER PUBLICATIONS
61/534,592, filed on Sep. 14, 2011.
International Search Report (ISR) dated Mar. 6, 2013, for PCT/
EP2012/068166.
(2006.01) International Search Report (ISR) dated Mar. 19, 2013, for PCT/
(2006.01) EP2012,068167.
(2006.01) International Search Report (ISR) dated Mar. 4, 2013, for PCT/
EP2012,068.168.
(2006.01) International Search Report (ISR) dated Jan. 28, 2013, for PCT/
(2006.01) EP2012,068169.
(2011.01) British Search Report dated Aug. 28, 2012, for GB 1206841.7.
(2006.01) German Search Report dated Nov. 17, 2011, for DE 10201 1055443.
(2006.01) 2.
Jiang et al., “Free Speech: A Novel Wireless Approach for Confer
(56) References Cited ence Projecting and Cooperating'. Lecture Notes in Computer Sci
U.S. PATENT DOCUMENTS
ence, vol. 4159, pp. 688-697, 2006. (cited in GB 1206841.7 Search
Report).
2002/0196378 A1 12, 2002 Slobodin et al.
International Preliminary Report on Patentability (IPRP) dated Mar.
2004/0263636 A1 12, 2004 Cutler et al. 27, 2014, for PCT/EP2012/068166.
2005.0036509 A1 2, 2005 Acharya et al. International Preliminary Report on Patentability (IPRP) dated Mar.
2006, OO31779 A1 2, 2006 Theurer et al. 27, 2014, for PCT/EP2012/068167.
2006/00953.76 A1 5, 2006 Mitchell et al. International Preliminary Report on Patentability (IPRP) dated Mar.
2007/OOO5809 A1 1/2007 Kobayashi et al. 27, 2014, for PCT/EP2012/068.168.
2007/0244970 A1 10, 2007 Watanabe et al.
2009 OO46139 A1 2, 2009 Cutler et al. * cited by examiner
U.S. Patent Jul. 14, 2015 Sheet 1 of 5 US 9,083,769 B2
30
Camera
51
Participant o Audio
39
Equipment
- - -
s &
31 48 31
38
Lapel Meeting Table
: 42 Microphone
L ((so \\ 44 45 52 35
Whiteboard
43 Fig. 1 a
64
60
Portable Base node
application Program
31 N. Client Connector Display

Processing Unit Receiver Base Node
Projector
Device
Visual
Indicator 63 36 44
Fig. 1b
assissing
is is
for this system.
Fig. 2
Base node
Software
USB Dongle WF
interface
interface
sotOrage (8) Butto (g)
Portable
application 7.
DE
Fig. 4
Computer
Run-time execution
text it Sift --
(RAM) (25)
---
Fig. 5
sess shig
strict is
for thesister
Storage -
Portable
application
Fig.7
Rur-time execution,
Otxt list Software (25
RAM - - - - 25)
Fig. 8
Rur-time execution , irra

Context diet Software (25 Portable
application
(RAM) 25)
---
Fig. 9
Internal WiFi antenna's

transceiver
B UttOn Actuator and

input device
Visual internal mass Storage

indicator
device storing portable
application
1- Flexible connection for data
Signals and power
Fig. 10
US 9,083,769 B2
1. 2
ELECTRONICTOOLAND METHODS FOR the projects on which they are collaborating or communicat
MEETINGS ing. Studies of business processes also reveal that approxi
mately 80% of the “workload' associated with a project or
CROSS REFERENCE process happens in preparation for a meeting. In other words,
many people view the “live' meeting as a milestone or dead
This application is a continuation-in-part application line by which they can pace and measure their productivity
claiming the benefit of U.S. patent application Ser. No. and that of their colleagues. Unfortunately, for many infor
13/270,659, filed Oct. 11, 2011, which claims the benefit of mation managers, being in perpetual meetings has reduced
U.S. provisional application 61/534,592, filed Sep. 14, 2011, their ability to prepare adequately for the next meeting, per
and this application is a continuation-in-part application 10 petuating a vicious and negative cycle.
claiming the benefit of PCT application PCT/EP2012/ However, Marc Al-Hames et al. report in “Audio-Visual
068166, filed Sep. 14, 2012, which claims the benefit of U.S. Processing in Meetings: Seven Questions and Current AMI
provisional application 61/534,592, filed Sep. 14, 2011, U.S. Answers', that although large parts of working days are con
patent application Ser. No. 13/270,659, filed Oct. 11, 2011, Sumed by meetings and conferences, unfortunately a lot of
and U.S. provisional application 61/635.219, filed Apr. 18, 15 them are neither efficient, nor especially successful. They
2012, the entirety of said applications being incorporated report a study in which people were asked to select emotion
herein by reference. terms that they thought would be frequently experienced in a
The present invention relates to electronic tools for meet meeting. The top answer—mentioned from more than two
ings including methods or devices for providing connection third of the participants—was “boring’; furthermore nearly
to a communications network, to networks or methods of one third mentioned “annoyed as a frequently perceived
operating the network, methods or devices for use in display emotion.
ing media content as well as Software for performing any of The conclusion is that despite the plethora of electronic
these methods. aids to meetings, fundamental problems in handling meetings
have not been solved. In fact organising and conducting meet
TECHNICAL BACKGROUND 25 ings in a business context involves a large number of factors.
Participation
Tools for Collaboration A lack of efficiency of meetings is addressed in the article
Allowing ad hoc groups of persons to communicate with “Mood indicators on electronic meeting tools IBM, IP.com
each other is one of the fundamental aspects of collaboration, number: IPCOMOOOOI 171 ID, Publication Date: Mar. 12,
problem solving, negotiation, teaching and education, etc. To 30 2003. This article addresses the issue that the lack of direct
assist in communication, there has been an explosion of elec feedback makes meetings clumsy, inefficient and often
tronic communication tools such as electronic conferencing unproductive. It proposes a “mood indicator” as well as an "I
tools, e.g. Synchronous and asynchronous conferencing, want to ask a question' indicator which allow the presenter to
online chat, Instant Messaging, audio conferencing, video choose an appropriate moment to pause, change track or field
conferencing, data conferencing, application sharing, remote 35 a question. It is argued that interrupting a presenterinfull flow
desktop sharing, electronic meeting systems, collaborative can be awkward; however, sometimes it is difficult to get an
management (coordination) tools, project management sys opportunity to ask a question or make a comment when many
tems, knowledge management systems, and Social Software different people are trying to make their voices heard. In a
systems. similar vein, U.S. Pat. No. 6.966,035 suggests displaying a
One classic approach is the lecture or seminar often involv 40 “murmur frame' for a participant to express a view. To
ing a presentation using presentation Software. To a large increase user participation, US 2010/0087139 discloses a
extent the traditional single person presentation or lecture has system for sending a selection to another computer, and US
been maintained with the audience being in a rather passive 2006/0095376 discloses a system for secure voting.
mode as far as determining, constructing, augmenting or Commenting, voting or selecting requires that a central
modifying the information to be presented is concerned. 45 authority provides the information that is to be selected or
As with other business processes, meetings are going digi commented or voted on. Hence, these proposals still leave a
tal. Increasingly, people are using computer technology alone central figure Such as the presenter in a dominating position
and in conjunction with broadband networks to Support their and the other members of the meeting are largely an audience
meeting objectives prior to and during an actual meeting. For with limited selection or Voting or participation rights.
example, e-mail is used to pass around files for people to read 50 A further problem with meetings is that someone is usually
prior to a meeting. late or has to leave early. With the person arriving late one has
Collaborative workspaces incorporate networks and on the to decide if the meeting is interrupted and a Summary of the
Internet offer geographically distributed collaborators a vir proceedings So far is given. For the person leaving early (often
tual repository for documents related to a project or a meet a senior person), Subsequent discussions can go missing. If
ing. Electronic meeting Support systems, such as interactive 55 there is a notes taker, this provides a personal Summary of the
network-connected white boards and videoconferencing meeting but not an objective one.
appliances, are available for the benefit of those who share the Presents systems do not provide an optimal solution.
same room as well as those who are in remote locations. Legal and Security Issues
The AMIDA Final Public Report describes the overall A legal requirement of a meeting is that presentations,
methodology behind the development of meeting Support 60 comments and Submissions need to be completely reproduc
technologies. It reports that numerous studies confirm that ible in Some circumstances, e.g. in a shareholders’ meet
meetings dominate the way people work. Namely, according ing, the events in the meeting should be subject to total recall.
to a study conducted by MCI Worldcom in 2003 a business Computer-supported collaborative work technologies, par
person participates in 60 meetings per month. People meet in ticularly those which capture human verbal and non-verbal
groups for a multitude of reasons. They interact in numerous 65 communications (audio and video interaction) in addition to
predictable and unpredictable ways and the results of their text and graphics generated during a meeting, promise to have
interactions are as varied as the people who participate and along term impact on how people will prepare for and behave
US 9,083,769 B2
3 4
during and following meetings. In addition, connecting to a cated and if this is not done correctly, telecommunication
network brings the danger of virus, malware or spyware trans software that has to pass through a firewall may be blocked. In
fer in either direction, and there is danger of copying of order to solve problems associated with firewalls it may be
confidential information. necessary to open ports oridentify or even add programs in an
Practical Difficulties exception list. If, besides a network (hardware) firewall and
Scalability and Ease of Use an operating system firewall, there is any software based
There are even more fundamental problems with using third-party firewall like Zonealarm, CA Internet Security
electronic tools in meetings. If two persons want to make two Suite or McAfee Firewall, then it is necessary to follow that
presentations then usually either both presentations must be Software developer's documentation to place programs on a
placed on one machine or there is a need to Swap between the 10 safe list or adding exceptions to the firewall rules. Such activ
presenters machines. To bring the display content of a com ity is beyond the usual user. Fussing with computer settings,
puter to a projector, the most common ways are to use a cable or having to call for IT Support wastes valuable meeting time
that connects the display adapter of the graphics card to the and takes the dynamism out of the meeting.
video input of the projector method 1 or to use a software The advantage of method 3 is that the computer does not
that captures the display contents and sends it over a wired or 15 need to use its own processing power to bring the display
wireless network to a remote base unit connected to the pro content in a form that is easily transported over a network.
jector method 2. This is often called “remote desktop' and This advantage becomes less relevant as computers grow in
is mostly used for remote administration or remote IT assis processing power. A drawback of method 3 is that the same
tance purposes. problems often encountered with method 1 of connecting to
Less common but also practiced methods are to use a special the display adapter remain. Another drawback is that the
device connected to the display adapter of the graphics card, special device referred to requires significant processing
that captures, encodes and streams the display content over a power, which means that this device will consume much
wired or wireless network method 3. Method 1 has several power and will require a separate power Supply, be relatively
practical problems and disadvantages. In meetings where big and certainly be relatively expensive.
people want to contribute content from their own computers, 25 An alternative method in the making today is to use the
e.g. to project images on a display, typically a video cable well-known USB interface of the computer for extracting the
such as a VGA cable is used to connect each PC one at a time display content of the computer. US 2009/0198839 discloses
to the projector. This is not only not scalable but also can be such a pluggable cable arrangement. US 2011/0115689 dis
and often is quite a cumbersome process that typically wastes closes a similar USB solution for wireless connection to a
valuable meeting time and takes the dynamism out of the 30 projector. Accordingly connecting a projector to a computer
meeting. Connection can be made more difficult and time using the standard USB port might become commonplace
consuming for example if the computer has to be rebooted for with time. However, this usually requires special drivers and
it to detect the projector or when the format of the PC differs even special hardware in the computer. Connecting a projec
from the format of the projector. In addition changing format tor to a computer using the standard USB port hence might
can leave the computer with a new format that is not compat 35 become commonplace—but even when that happens there
ible with its own screen so that on reboot of the PC alone, will be a mix of new and legacy machines for several years.
nothing is displayed on the computer screen. Without a vis Conclusion
ible screen image the necessary re-configuration can be dif The following problems remain for holding a face-to-face
ficult. These issues are aggravated by a number of elements: meeting using advanced electronic tools at the present time:
The use of many different video adapters, such as VGA, 40 Complexity of the networking infrastructure.
DVI-A, DVI-D, DVI-I. DP, HDMI, thunderbolt, ... High demands on technical expertise of users in current
Reach depends on cable length: too long leaves a tangled systems that are Supposed to be designed to Support
cable "salad' in the meeting room, too short reduces everyday use by the non-expert user.
flexibility, often necessitating people to move around in Barriers to the use of complicated technology in meetings.
the meeting room when they want to present something. 45 Great variety of possible collaborative software solu
Cable connection is either point to point or requires tedious tions—none of which seems to solve the fundamental
and extensive cabling and the use of complex and expen problems of holding Successful meetings.
sive video switches. Meetings being boring or annoying for members of the
It is often difficult and time consuming to find the right meeting.
display resolution and refresh rate that both the com 50 Complexity of firewalls and other security measures
puter and the display or projector Support. employed in corporate networks.
Known technical solutions are expensive and not 100% Lack of, or restriction of participation by members of a
reliable. Method 2 also has many drawbacks. If the connec meeting.
tion is made to a corporate LAN there is a danger of virus, Time taken to prepare presentations for meetings.
malware or spyware transfer in either direction, there is dan 55 Need to record events in the propertime sequence at meet
ger of copying of confidential information, and there is the ings without burdening a meeting more than necessary.
difficulty of making the connection, e.g. entry of a user code Although some tools solve some of these problems effec
and password, as well the administration of Such passwords tively, no electronic meeting tool solves all of them.
and user codes. In business contexts, visitors to meeting
rooms typically do find technical difficulty with such means 60 SUMMARY OF THE INVENTION
to connect to a central projector or display in the meeting
OO. An object of the present invention is to provide network
Additional problems can occur with firewalls and proxies. Solutions including electronic tools for meetings as well as
Typically a visitor to a meeting will bring a computer Such as devices for providing connection to a communications net
a laptop that is set up for a different corporate networking 65 work, to methods of operating the network, methods of dis
environment and hence has different or incompatible net playing media content as well as Software for performing any
working settings. The setting up of a firewall can be compli of these methods or for implementing such systems. There is
US 9,083,769 B2
5 6
also a need to capture what is actually shown or said in a e.g. an LED ring, for streaming the screen scraped video
meeting and not merely what might have been shown or said. content to the network and hence to a base unit and a
An aspect the present invention provides an electronic display,
meeting tool for communicating arbitrary media content from A mass storage device used to store the application,
users at a meeting comprising: a node configuration means 5 An audio device that acts as a virtual Sound card to a client
adapted to operate a display node of a communications net PC over USB, using a generic driver such as a UAC1 or
work, the display node being coupled to a first display, the UAC2 device driver.
node configuration means being adapted to receive user Embodiments of the present invention are not limited to
selected arbitrary media content and to control display of the application sharing but make use of screen scraping which is
user selected arbitrary media content on the first display; and 10 able to capture all material in a neutral manner rather than
at least one peripheral device adapted to communicate the being limited by proprietary applications. Further the Screen
scraper application is Zero footprint on termination rather
user selected arbitrary media content via the communications than being fully installed on the processing device. Embodi
network, wherein the peripheral device is a connection unit ments of the present invention can provide arbitrary “full
comprising: 15 content to the meeting room and participants can display in
(a) a connector adapted to couple to a port of a processing real-time,
device having a second display, a memory and an oper The real-time content is shown on a central display rather
ating system: and than being broadcast to individual participants or archived.
(b) a transmitter for communicating with the communica Embodiments of the present invention “auto compose'
tions network, a program adapted to be loaded onto the arbitrary user data on a central display or screen so that full
processing device and to run on the operating system of real-time content that is provided by multiple meeting par
the processing device, said program being adapted to ticipants who intentionally share this content in order to make
obtain user selected arbitrary media content, said pro the meeting more effective and efficient,
gram leaving a Zero footprint on termination, and an Embodiments of the present invention implement a prin
input device to allow the user to carry out a user action 25 ciple of “democratic screen sharing, in which the meeting
that triggers transfer of said user selected arbitrary participants decide themselves on a peer-to-peer basis which
media content to said transmitter through said port. content to share when and where. In particular in some
Obtaining user selected arbitrary media content is prefer embodiments a participant can obtain unilateral access to the
ably not obtained by application sharing but by the process of display device, i.e. without agreement of other participants.
screen scrapping. Although software packages that provide 30 Peer-to-peer data sharing differs from systems in which the
screen scraping require installation on the target device, or at content to be displayed is determined by a presenter or meet
least require the installation of dedicated and/or custom driv ing director. The user determines where his content is routed
ers, embodiments of the present invention use software stored to, and can do so without any Software configuration on the
on the peripheral device which allows screen scraping when user processing device.
run on the processing device but leaves a Zero footprint when 35 Another aspect the present invention provides a method for
terminated. Embodiments of the present invention can screen connecting a processing device to a communications net
scrape full HD videos at 20 fps without requiring any instal work, the processing device having a memory, a display and
lation of a program on the processing device nor requiring an operating system with at least one pre-installed generic
configuring the processing device Such as a PC that they run driver providing a generic communications protocol for com
on for the connectivity to the network hence meeting “Zero 40 munication between processing device and a standard class of
footprint requirements. peripheral devices, the method comprising the steps of
The program adapted to be loaded onto the processing a) coupling a peripheral device to the processing device, the
device and to run on the operating system of the processing peripheral device having a transceiver;
device and being adapted to obtain user selected arbitrary b) setting up, by means of the pre-installed generic driver of
media content can be stored on the peripheral device. The 45 the operating system, a means for communication between
transmitter can be a wireless transmitter or transceiver. The the peripheral device and the processing device;
peripheral device can be a plug-and-play device. The program c) coupling the processing device to a communications net
can be adapted to screen scrape content of the second display. work via the peripheral device;
The input device can be physical actuator coupled to the d) routing screen scraped data between the processing device
peripheral device. The physical actuator preferably has a 50 and the communication network via the means for com
surface area of between 100 and 14,400 square mm. Alterna munication, wherein the generic communication protocol
tively, the input device can be a key displayed on the second is used for transferring the screen scraped data between the
display. The key displayed on the second display can be one processing device and the peripheral device.
not screen scraped by the program. The routing of the screen scraped data can be to a defined
On the peripheral device a mass storage device is provided 55 network node such as a display node without user entry of
that stores the Software to be run on the processing device. configuration details. Thus the routing can be dedicated to a
The mass storage device can be logically closed once the specific network node such as a display node, base station etc.
software has been read and loaded and is running from RAM This is achieved by pairing of the peripheral device to the
in the processing device. Also provided on the peripheral relevant node before the communication starts.
device is a further device such as an HID (human interface 60 In accordance with embodiments of the present invention
device) to capture user input and provide user feedback. In users start an application from the peripheral device such as a
embodiments of the present invention, the peripheral device USB dongle, thus making the connection in a 3 step process:
contains multiple internal logical devices that are combined: (1) connect, e.g. plug in the peripheral device to the process
An HID (human interface device) used for capturing user ing device, (2) start the screen scraping application, (3) per
input (e.g. following a user action Such as pressing or 65 form a user action Such as click on a button on the peripheral
activating a button) and providing user feedback, e.g. by device to go allow content to be displayed on the central
an optical indicator Such as a light ring around the button screen or display. To achieve step 2 Autorun or AutoPlay can
US 9,083,769 B2
7 8
be used with some Windows operating systems, but there are interface device and wherein the pre-installed generic driver
many different variants based on the OS version and which is a human interface device driver. The first software code
patches have been installed. Furthermore, this mechanism is portion can be adapted to present the peripheral device to the
generally considered a security hazard, which is why most IT processing device as a mass storage device and wherein the
departments will disable Autorun/Autoplay. Other OS pro pre-installed generic driver is a mass storage device driver.
viders have disabled this function, e.g. Apple removed a simi The first software code portion can be adapted to present the
lar functionality entirely from its OS/X since Snow Leopard. peripheral device to the processing device as a composite
In an embodiment of the present invention a very Small ser device and wherein pre-installed generic drivers drive differ
Vice-also called daemon on Some OSS is provided that ent device interfaces independently.
requires installation on the processing device Such as a laptop. 10 The executable software code can comprise fifth code for
This service is pre-installed on the processing device. The providing a means for connecting to the communications
installation is required only once on every processing device network including a base node. The third code can be for
Such as a laptop. The role of this is to provide a permanently providing means for capturing video frame buffers of the
running service that continuously monitors if a peripheral processing device.
device according to the present invention has been offered up 15 The executable software code can comprise sixth code for
for connection to the processing device. When Such a periph providing a means for encoding, compressing and optionally
eral device is connected, the service will detect this and start encrypting the screen scraped data and sending the screen
the client application Software residing in the mass storage scraped data the communication network. The executable
area of the peripheral device. Once the service is installed, Software code can comprise seventh code for providing a
connectivity with the peripheral device becomes a 2 step means for handling the peripheral device. The executable
process: connect, e.g. plug in the peripheral device to the Software code can comprise eighth code for providing means
processing device, and (2) perform a user action Such as click for initiating connection to the base node. The executable
on a button on the peripheral device to allow content to be Software code can comprise ninth code for receiving inputs
displayed on the central Screen or display. The application from an input device on the peripheral device. The executable
loaded from the processing device still leaves a Zero footprint 25 Software code can comprise tenth code for providing a means
on termination for sending state changes to the visual indicator on the periph
Step b) can comprise presenting the peripheral device to eral device. The executable software code can comprise elev
the processing device as a human interface device and enth code for providing a means for sending state changes to
wherein the pre-installed generic driver is a human interface the visual indicator on the peripheral device. The executable
device driver. Alternatively or additionally step b) can com 30 Software code can comprise twelfth code for providing a
prise presenting the peripheral device to the processing means for presenting to the user a GUI. The executable soft
device as a mass storage device and wherein the pre-installed ware code can comprise thirteenth code for presenting a GUI
generic driver is a mass storage device driver. for administration of the said executable software code when
Alternatively, or additionally step b) comprises presenting executed as a portable application. The executable software
the peripheral device to the processing device as a composite 35 code can comprise fourteenth code for providing a means for
device and wherein pre-installed generic drivers drive differ displaying and activating a key on the display of the client
ent device interfaces independently. processing device for allowing a user to input the start the
A client application can be stored on the peripheral device transfer of data from the processing device to the base node.
which when run on the processing device obtains the Screen In another aspect the present invention provides a periph
scraped data. Such a client application can be a portable 40 eral device for providing communication connectivity to a
application and can leave a Zero footprint on termination. processing device which is provided with memory, a display
In another aspect the present invention provides a periph and an operating system with at least one pre-installed
eral device for providing communication connectivity to a generic driver providing a generic communication protocol
processing device which is provided with memory, a display for communication between the processing device and a stan
and an operating system with at least one pre-installed 45 dard class of peripheral devices, the peripheral device com
generic driver providing a generic communication protocol prising a memory in which executable software code is stored
for communication between the processing device and a stan for execution on the processing device, said executable soft
dard class of peripheral devices, the peripheral device com ware code comprising:
prising a memory in which executable Software code is stored a first Software code portion for setting up, by means of the
for execution on the processing device, said executable soft 50 pre-installed generic driver of the operating system, a
ware code comprising: a first Software code portion for setting means for communication between the peripheral device
up, by means of the pre-installed generic driver of the oper and the processing device;
ating system, a means for communication between the a second Software code portion for connecting the processing
peripheral device and the processing device; device to a communications network via the peripheral
a second Software code portion for connecting the processing 55 device, the peripheral device having a transceiver, and
device to a communications network via the peripheral a third processing Software code for routing data between the
device, the peripheral device having a transceiver, processing device and the communications network over
a third Software codeportion for screen scraping data from the the means for communication; wherein the first software
processing device; and a fourth Software code for routing code portion is adapted to use the generic communication
Screen scraped data between the processing device and the 60 protocol for transferring the data between the processing
communications network over the means for communica device and the peripheral device, and an input device
tion; wherein the first software code portion is adapted to coupled to the peripheral device, the input device being
use the generic communication protocol for transferring adapted to react to a user action to trigger the transfer of the
the screen scraped data between the processing device and data from the processing device to the peripheral device.
the peripheral device. 65 The first software code portion can be adapted to present
The first software code portion can be adapted to present the peripheral device to the processing device as a human
the peripheral device to the processing device as a human interface device and wherein the pre-installed generic driver
US 9,083,769 B2
10
is a human interface device driver. The first software code means for a GUI for administration purposes. The executable
portion can be adapted to present the peripheral device to the Software code can comprise seventh code for providing a
processing device as a mass storage device and wherein the means for publishing its presence over the network using the
pre-installed generic driver is a mass storage device driver. Zeroconf protocol. The executable software code can com
The first software code portion can be adapted to present the prise eighth code for providing a means for accepting and
peripheral device to the processing device as a composite installing Software updates. The executable Software code can
device and wherein pre-installed generic drivers drive differ comprise ninth code for providing a means for providing
ent device interfaces independently. facilities for pairing of connection units to the processing
The input device is preferably a physical actuator coupled device. The executable software code can comprise tenth
to the peripheral device. The physical actuator preferably has 10 code for providing a means for auto-composing of different
a surface area of between 100 and 14,400 square mm. The incoming arbitrary media streams and rendering of compos
input device can be for example a key for display on the ited image on display. The executable software code can
display. The executable software code can comprise fourth comprise eleventh code for providing a means for receiving,
code for providing a means for connecting to the communi decrypting and decoding incoming arbitrary media content.
cations network including a base node. The executable soft 15 The executable software code can comprise twelfth code for
ware code can comprise fifth code for providing a means for Scaling of incoming arbitrary media streams. The executable
capturing video frame buffers of the processing device. The Software code can comprise thirteenth code for providing a
executable Software code can comprise sixth code for provid means for displaying incoming arbitrary media content in
ing a means for encoding, compressing and optionally accordance with a set of rules.
encrypting the video frames and sending them over a secure The present invention also provides a method for commu
link to the base node. The executable software code can nicating arbitrary media content from users at a meeting
comprise seventh code for providing a means for handling the comprising:
peripheral device. The executable software code can com operating a display node of a communications network, the
prise eighth code for providing a means for initiating connec display node being coupled to a first display, to receive user
tion to the base node. The executable software code can 25 selected arbitrary media content and to control display of
comprises ninth code for receive inputs from an input device the user selected arbitrary media content on the first dis
on the peripheral device. The executable software code can play; and connecting a peripheral device to a port of a
comprise tenth code for providing a means for sending state processing device and communicating the user selected
changes to the visual indicator on the peripheral device. The arbitrary media content via the communications network,
executable software code can comprise eleventh code for 30 loading a program onto the processing device and running the
providing a means for presenting the user a GUI. The execut program on the operating system of the processing device
able software code can comprise twelfth code for presenting to obtain user selected arbitrary media content, said pro
GUI for administration of the executable software code when gram leaving a Zero footprint on termination, and trigger
executed as a portable application. The executable software ing transfer of said user selected arbitrary media content to
code can comprise thirteenth code for providing a means for 35 said transmitter through said port after a user action on an
displaying and activating a key on the display of the process input device. The present invention also provides a periph
ing device for allowing a user input to start the transfer of data eral device comprising:
from the processing device to the base node. abase
In another aspect of the invention a peripheral device is a connector for connection to a plug and play port of a host
provided for providing communication connectivity to a pro 40 processing device,
cessing device which is provided with memory, a display and a flexible connection between the base and the connector for
an operating system with at least one pre-installed generic transferring data signals and power,
driver providing a generic communication protocol for com an actuator on the base for actuating a signal and for trans
munication between the processing device and a standard ferring the signal to the connector for transfer to the port,
class of peripheral devices, the peripheral device comprising 45 wherein the base has electronics comprising permanent
a memory in which executable software code is stored for storage for storing a portable application, a processing
execution on the processing device, said executable Software engine, a transceiver and a visual indicator. The present
code comprising: invention also provides a method for providing communi
a first software code portion for setting up, by means of the cation connectivity from a processing device,
pre-installed generic driver of the operating system, a 50 setting up a communications network between a base node of
means for communication between the peripheral device the communications network and a peripheral device
and the processing device; coupled to the processing device;
a second Software code portion for connecting the processing transferring media content between the processing device and
device to a communications network via the peripheral the peripheral device, transmitting the media content from
device, the peripheral device having a transceiver, 55 the peripheral device to the communications network,
a third software code portion for receiving media content receiving media content from the communications network at
from the network and for displaying the media content on the base node and displaying the media content on a display
the display in accordance with a set of rules; wherein the in accordance with a set of rules. Any of the above software
first software code portion is adapted to use the generic code stored on a non-transitory storage medium.
communication protocol for transferring the media content 60 Definitions
between the peripheral device and the processing device. The term “unilateral electronic access to the display
The executable software code can comprise fourth code for device' by a participant, means that the displaying process is
providing a means for correctly configuring a receiver as an obtained by the action of only one participant involved in the
access point. The executable software code can comprise fifth meeting, without requiring the agreement of another or the
code for providing a means for listening for output of con 65 others. The term “unilateral' implies that the data for display
nection units trying to connect on a specific port. The execut is allowed to override or replace any data displayed on the
able software code can comprise sixth code for providing a screen by the same or another participant of the meeting.
US 9,083,769 B2
11 12
“Plug and play” is a term used to describe the characteristic the program has exited, and files created by the user can
of a computer bus, or device specification, which facilitates be saved directly to the same removable media as the
the discovery of a hardware component in a system, without application is stored on. A portable application does not
the need for physical device configuration, or user interven leave its files or settings on the host computer on which
tion in resolving resource conflicts. Plug and play devices can it runs. For example, the application does not write to the
be added to a bus of a computing system (while running or Windows registry or store its configuration files (such as
when shut down), and the newly added device and possibly an INI file) in the user's profile; instead, it stores its
the rest of the computing system is automatically configured configuration files in the program’s directory. Another
to make the newly added device work, both from hardware requirement, since file paths will often differ on chang
and from Software perspective. Plug and play interfaces 10 ing computers due to variation in Windows drive letter
include for example (not an exhaustive list): Firewire (IEEE assignments, is the need for applications to store them in
1394), PCI, Mini PCI, PCI Express, Mini PCI Express, PCM a relative format. Preferably, Such a program does not
CIA, PC Card, Universal Serial Bus (USB), SDIO cards. require a launcher program to copy necessary settings
'Auto-configuration' is the automatic configuration of and files to the host computer when the application starts
devices without manual intervention, without setting any 15 and move them back to the application's directory when
Switches or jumpers, and without any need for Software con it closes as this may leave a residue on the hard drive in
figuration. An example of auto-configuring devices: USB case of power failure.
devices. Examples of auto-configuring protocols: DHCP. “Electronic meeting systems' (EMS) need to be distin
Zeroconf. Bonjour. guished on the one hand from classic groupware, on the other
A plug and play device has auto-configuration Software by from web conferencing systems. In reality, there is some
default to make it plug and play. Example: USB devices are overlap between minor features of products of the named
made to be plug and play by including the correct auto categories. The main difference from groupware is the inten
configuration Software (e.g. host driver, host stack, applica sity of collaboration. EMS should be distinguished from sys
tion software). tems with which it is possible to show the contents of an
Autoconfiguration can also refer to a Software alone and is 25 individual computer screen on a remote display with multiple
not restricted to a physical device. "Hot Swapping and hot users at the same time.
plugging are terms used to describe the functions of replac “Groupware' supports collaboration within groups where
ing computer system components without shutting down the the individual contributions remain identifiable. In contrast,
system. More specifically, hot Swapping describes replacing EMS enable the group to cooperatively produce a result for
components without significant interruption to the system, 30 which the group is responsible as a whole. In a business
while hot plugging describes the addition of components that process, groupware and electronic meeting systems comple
would expand the system without significant interruption to ment each other: Groupware supports teams when research
the operation of the system. A well-known example of this ing and creating documents in the run up to an EMS session
functionality is the Universal Serial Bus (USB) that allows or when implementing the results of such a session. “Web
users to add or remove peripheral components such as a 35 conferencing systems’” and "electronic meeting systems’
mouse, keyboard, or printer. Other examples are eSATA, complement each other in the online meeting or workshop:
PCIe, FireWire, for example. EMS extends the web conferencing system by providing
A portable application' (portable app), sometimes also interactive tools for producing and documenting group
called Standalone, is a computer Software program designed results. On the other hand, “web conferencing systems’
to run without installation on the target machine. This type of 40 complement EMS with the screen sharing and voice confer
application is stored on a removable storage device such as a encing functionality required in Synchronous online meetings
CD. USB flash drive, flash card, or floppy disk storing its and not present in EMS.
program files, configuration information and data on the Stor "Data conferencing refers to a communication session
age medium alone. It is a program that can be stored on an among two or more participants sharing computer data in real
electronic device such as a USB flash drive, iPod, memory 45 time. Interaction and presentation devices such as a screen,
card, portable hard drive or other portable electronic device keyboard, mouse, camera, etc. can be shared. It is a term used
and runs on a computer or other processing device coupled to to distinguish from video conferencing and audio conferenc
the electronic device without making permanent configura ing. The data can include screen, documents, graphics, draw
tion changes to the host computer. All Such programs have a ings and applications that can be seen by the participants of
Zero-footprint, meaning all temporary files, registry entries, 50 the meeting.
and any other changes to the machine exist only while the Application sharing is an element of remote access, fall
program is running. To be considered a portable application, ing under the collaborative software umbrella, that enables
for purpose of this invention, a Software program must: two or more users to access a shared application or document
Not require any kind of formal installation onto a comput from their respective computers simultaneously in real time.
er's permanent storage device to be executed, and can be 55 Generally, the shared application or document will be running
stored on a removable storage device such as USB flash on a host computer, and remote access to the shared content
drive, iPod, memory card, portable hard drive or other will be provided to other users by the host user. Application
portable electronic storage device thus enabling it to be sharing should be distinguished from systems in which col
used on multiple computers. laboration on the applications between different users is not
Settings are stored with, and can be preferably carried 60 possible but the contents of individual computer screens can
around with, the software (i.e., they are written to the be projected onto a remote display with multiple users at the
electronic device such as a USB drive). Settings are not same time.
stored to the registry or any other central system data The term “arbitrary media content” refers to the fact that a
base of the computer. user may generate, create or select any media content that is
Leaves a Zero (or near-zero) “footprint’ on any PC it is run 65 appropriate to display, i.e. on an ad hoc basis. This differs
on after being used, i.e., all temporary files/registry set from client Voting on, or selecting of media content that is
tings should be either avoided or at least removed once displayed by another in a meeting or presentation. This term
US 9,083,769 B2
13 14
refers to client oriented, distributed rights and privileges for FIG. 10 shows an embodiment of a peripheral device in
the display of content rather thana central presenterproviding accordance with an embodiment of the present invention.
content which is presented to the members of the meeting.
"Screen scraping in our sense refers to reading the video DETAILED DESCRIPTION OF THE
frame buffers and processing them, rather than just rendering EMBODIMENTS OF THE PRESENT
them on a display. Screen scraping for presentations is INVENTION
described in US2002/0196378 to Slobodin et all which is
included herein by reference. The present invention will be described with respect to
Auto composition” or “auto layout” refers to the auto 10
particular embodiments and with reference to certain draw
matic nature in which multiple graphics/video sources are ings but the invention is not limited thereto but only by the
rendered on a central display, without user intervention and in claims. The drawings described are only schematic and are
a way that a user would intuitively expect it to happen. non-limiting.
“Wireless” and “wireless communication network' can be Furthermore, the terms first, second, third and the like in
any network that does not use cable links between nodes, e.g. 15
the description and in the claims, are used for distinguishing
uses RF, optical or InfraRed for communication purposes, between similar elements and not necessarily for describing a
such as IrDA, diffuse infra-red, WLAN, WiMax, WiFi, WiFi sequential or chronological order. The terms are interchange
Direct, Bluetooth or any other wireless communication net able under appropriate circumstances and the embodiments
work known to the person skilled in the art such as optical of the invention can operate in other sequences than described
networks like LiFi. or illustrated herein. Moreover, the terms top, bottom, over,
"Computer generally refers to a processing device, i.e. under and the like in the description and the claims are used
having a processing engine capable of various types of digital for descriptive purposes and not necessarily for describing
processing, such as rendering graphics images for display. A relative positions. The terms so used are interchangeable
computer can be in the form of a work station, a personal under appropriate circumstances and the embodiments of the
computer, a laptop, a palmtop, a PDA, a Smartphone, a tablet 25 invention described herein can operate in other orientations
etc. Generally a computer has memory such as volatile RAM. than described or illustrated herein. The term “comprising,
Non-volatile memory Such as a hard disc, optical disk or Solid used in the claims, should not be interpreted as being
state memory can be included in the computer or can be a restricted to the means listed thereafter; it does not exclude
peripheral device. Currently most computers are electronic other elements or steps. It needs to be interpreted as specify
30 ing the presence of the stated features, integers, steps or
but the term “computer also includes optics based comput
ing devices. components as referred to, but does not preclude the presence
The term “pre-installed generic driver' is intended to mean or addition of one or more other features, integers, steps or
a driver which is installed on a processing device Such as a components, or groups thereof. Thus, the scope of the expres
computer as a standard driver, e.g. is installed with the instal 35
sion “a device comprising means A and B should not be
lation of the operating system. Such a driver is standard for limited to devices consisting only of components A and B. It
the operating system and can drive a standard class of periph means that with respect to the present invention, the only
eral devices coupled to or connected to the processing device. relevant components of the device are A and B. Similarly, it is
The installation of a specific driver for such a peripheral to be noticed that the term “coupled, also used in the descrip
device is not required. Such a generic driver can be a human 40 tion or claims, should not be interpreted as being restricted to
interface driver (HID) or a mass storage device driver, which direct connections only. Thus, the scope of the expression “a
has predetermined software components configured for driv device A coupled to a device B should not be limited to
ing mass storage, a CD-ROM, a keyboard etc. or combina devices or systems wherein an output of device A is directly
tions of these. Such devices can be readable and writable connected to an input of device B. It means that there exists a
computer peripheral memory devices such as USB memory 45 path between an output of A and an input of B which may be
Sticks, flash memories, external hard drives, or more. a path including other devices or means.
Elements or parts of the described devices may comprise
BRIEF DESCRIPTIONS OF THE DRAWINGS logic encoded in media for performing any kind of informa
tion processing. Logic may comprise Software encoded in a
FIG. 1a shows a meeting room that can be used with 50 disk or other computer-readable medium and/or instructions
embodiments of the present invention. FIG.1b shows a com encoded in an application specific integrated circuit (ASIC),
bination of a client processing device, a connection unit, a field programmable gate array (FPGA), or other processor or
base node and a display inaccordance with an embodiment of hardware. References to Software can encompass any type of
the present invention. programs in any language executable directly or indirectly by
FIG. 2 shows a screen display in accordance with an 55 a processor.
embodiment of the present invention. References to logic, hardware, processor or circuitry can
FIGS. 3 to 5 show a base node and a peripheral device and encompass any kind of logic or analog circuitry, integrated to
a client processing device in accordance with embodiments of any degree, and not limited to general purpose processors,
the present invention. digital signal processors, ASICs, FPGAs, discrete compo
FIG. 6 shows a display in accordance with an embodiment 60 nents or transistor logic gates and so on.
of the present invention. Embodiments of the present invention provide solutions to
FIG. 7 shows a peripheral device in accordance with an three major problems with meetings: a) the time taken to
embodiment of the present invention. prepare for a meeting. This is mainly achieved by allowing
FIG. 8 shows a client processing device in accordance with “on-the-fly” presentation of any displayable information.
an embodiment of the present invention. 65 This information does not have to be linked into any particular
FIG. 9 shows a further client processing device in accor presentation Software, nor to be compatible with any Such
dance with an embodiment of the present invention. presentation software,
US 9,083,769 B2
15 16
b) the time taken to conduct the meeting using electronic base node 36. A whiteboard 45 can optionally be provided
meeting tools. This is achieved by reducing the time to that can be optionally coupled to the display 44 and/or the
connect computers to the display or projection system. base node 36, e.g. when the whiteboard can record electroni
c) the time taken to reflect and review and document the cally what is written on it. Optionally, a camera 35 may be
meeting afterwards. This is achieved by providing the pos provided to record the entries on the whiteboard 45. The
sibility of recording the course of the meeting in the same camera 35 may have a third connection unit 52 for connecting
time sequence that it was carried out as well as be able to the camera 35 to the network 50 so that the data from the
store all data presented and who presented it. whiteboard can be recorded and stored or transmitted to other
First Embodiment networks via router 42. The connection unit 52 may have an
FIG. 1a is a schematic representation of a generic meeting 10 input device 53 as described above for the connection unit 47.
room 30 with a meeting table that can be used with embodi Optional equipment can be cameras 39, 40, 41 for record
ments of the present invention. Participants 37 having some ing the progress of the meeting. These cameras can be linked
form of processing device 31 such as a laptop computer, a by a network 51, e.g. a cable network to the router 42 and/or
tablet, a PDA etc. Each of the processing devices 31 can be a the base node 36. Another optional item is a microphone or
host device and has a first connection unit 47 to which it is 15 microphones 38 that can be used to transfer audio, e.g. to the
coupled. The first connection unit 47 provides access to a processing devices 31 and to loud speakers (not shown)
network 50 which in this case is a wireless network, but could attached to the base node 36 or part of the display 44.
be a wired network. The network can be a shared resource Any or all of the outputs of the processing devices 31, the
network. Each connection unit 47 may be coupled to an input cameras, the whiteboard, etc. can be recorded and stored
device 48 which will be described in more detail later. A user digitally, e.g. in node 36 or elsewhere to provide a complete
37 will typically at a distance from the processing device 37 record with correct time sequence. Summarising the above,
which is ergonomically satisfactory. This ergonomic bound the present invention provides an electronic meeting tool for
ary is typically an area of about 1000 sq cm to 4000 sq cm. communicating arbitrary media content between different
This ergonomic boundary will typically have the user as one users 37 (with their own processing devices 31, e.g. PC,
side of the boundary and the comfortable reach of the arms 25 mobile phone, or tablet) and one display or projector or mul
will determine an area on the left and right of the processing tiple displays or projectors 44 in the meeting room 30.
device which falls within the ergonomic boundary and the far Referring to FIGS. 1a and 1b embodiments of the present
edge of the boundary of the processing device (normally invention comprise a base or display node 36 being a process
delimited by a display screen) will determine the other side of ing device, e.g. a host computer adapted to receive user
the ergonomic boundary. The area defined by the ergonomic 30 selected arbitrary media content, the base node 36 being
boundary will overlap or include the processing device 31 coupled to a central display 44 which can be a fixed format
itself. The processing device will also have an outer physical display and/or a projector or similar. The arbitrary media
boundary. The input device 48 is preferably arranged to oper content can be provided from any of the user processing
ate outside the boundary of the processing device 31 but devices 31. The base node 36 can be adapted to display the
within the ergonomic boundary. Preferably the input device is 35 received user selected arbitrary media content in accordance
arranged to function when it is flat on the table. The input with a set of rules, e.g. FIFO, automatically, on request or
device preferably has an size of activation area of between 1 approval, forced to display, in accordance with a priority etc.
and 144 square cm. In other embodiments of the present Optionally the base node 36 is adapted to force display of the
invention a wireless memory card can be provided to enable received user selected arbitrary media content, i.e. to allow
a second Wi-Fi link on a processing device such as a laptop or 40 participation in the meeting by an individual user displaying
tablet. The wireless memory card stores data and media and own selected content on display 44 independently of the
fits into the laptop just like a regular SDHC card. The wireless person who is nominally responsible for giving a presentation
memory card preferably has built-in Wi-Fi that effortlessly or chairing the meeting. Forcing the display can also be con
transferS data, photos and videos to another device or com sidered as a rule. The phrase “unilateral electronic access to
puter. For instance an Eye-Ficard (www.eye.fi) can be used to 45 the display device' defines this kind of rule as “unilateral
enable the latter, means that the displaying process is obtained by the action of
Preferably the network 50 is a local area network, (e.g. a only one participant involved in the meeting, without requir
shared resources network) i.e. preferably local to the meeting ing the agreement o another or the others. The term “unilat
room for security reasons but the network 50 may have access eral implies that the data for display is allowed to override or
to other local or wide area networks such as 51 or to a larger 50 replace any data displayed on the screen by the same or
corporate network or the internet 43, for example via a router another participant of the meeting. The meeting tool can also
42. Another node of the network 50 is the base or display node be adapted to allow a priority setting. This means that a user
36. This node 36 may optionally be a wireless access point. can set a priority setting for the media to be displayed. A
The base node 36 may also be a processing device or host priority of “1” for example can be interpreted by the base
computer and may be coupled to a second connection unit 49 55 node as a forced display, a priority “2 can be interpreted by
that provides access to the network 50 thus linking all of the the base node as display as soon as possible, priority '3” can
processing devices 31, 36 together. The connection unit may be interpreted by the base node as place in queue and display
have an input device as described above. Alternatively, net as the time comes etc. Setting and using priorities for display
work connections installed on the base node 36 can be used. are also considered to be working to rules. To execute the
Audio equipment 46 may be provided, e.g. a telephone that 60 rules, the base node 36 may have a decision module. The base
allows other members of the meeting to call in from remote node 36 may be a host computer having a processing engine
destinations. Such as a microprocessor and a memory. Preferably, the base
The display node 36 is coupled to and adapted to allow node 36 is adapted to treat media content passed to the base
display of media on Some kind of display 44. The display node 36 from any or all of the connection units 47 in an equal
node is in embodiments of the present invention a base node 65 manner. The base node 36 may be adapted to auto compose
of the communications network 50. The display 44 may be a the media content on the central display 44 connected to it,
projector and/or screen, the projector being coupled to the e.g. from one or more processing devices 31.
US 9,083,769 B2
17 18
An independent aspect of the present invention is at least the portable application 60 is stored on each connection unit
one connection unit 47, (optionally 49 for receiving or camera 47 and optionally 49. Preferably the portable application 60 is
connection unit 52) adapted to communicate the user selected adapted to “screen scrape' content of the client display of the
arbitrary media content to said base node 36. Preferably the client processing device 31. Optionally the portable applica
connection units 47 and/or optionally 49 are physical plug tion 60 when run on a processing device 31 is adapted to
and-play devices. An example of a connection unit is shown “screen scrape' content of the client display of this client
schematically in FIG. 10. processing device 31 and to transmit it via a connection unit
The connection unit 47 (or optionally connection unit 52) 47. Optionally the portable application 60 when run on the
may be integrated into a user processing device 31 e.g. as an processing device is adapted to 'screen scrape' content of the
internal peripheral device or may preferably be an external 10
client display of the client processing device 31 and to trans
peripheral device comprising a connector adapted to couple mit it via a network interface of the processing device 31, for
to a port of a userprocessing device 31. The processing device
31 may have a client display, a processing engine Such as a example if the connection unit 47 has no transmitter or it is not
microprocessor, a memory and an operating system. The functioning.
optional connection unit 49 may integrated into the base node 15 The connection unit 47 for communicating with said base
36, e.g. as an internal peripheral device or may be an external node 36 has a network interface e.g. comprising a transmitter
peripheral device comprising a connector adapted to couple 62. The transmitter 62 is preferably a transceiver. Optionally
to a port of the base node 36. The connection unit 49 may be the transmitter/receiver can be a wireless transmitter/receiver.
fully integrated into the base node 36, e.g. is an internal The base node 36 for communicating with the connection
network interface of the base node 36. The base node 36 may unit 47 has a receiver 63 which can be included in the con
have a processing engine Such as a microprocessor, a memory nection unit 49 or integrated into the base node 36. The
and an operating system. receiver is preferably a transceiver. Optionally the transmit
In alternative embodiments of the present invention, the ter/receiver can be a wireless transmitter/receiver.
peripheral device can be coupled wirelessly to the processing The input device 48 allows a user interaction with the
device, and paired with the processing device such as a tablet 25 connection unit 47. Preferably the input device 48 is physical
or laptop through Near-Field Communication (NFC). In other actuator coupled to the connection unit 47. The user action
embodiments of the present invention, the pairing of the applied to the input device 48 generates a signal that can
peripheral device can be performed additionally by providing trigger transfer of data from the processing device 31 (to
means for receiving biometric data Such as a microphone which the connection unit 47 is coupled) to the network 50.
(voice) or a camera (face or iris) or a finger Swipe (fingerprint) 30 Preferably the input device 48 has an activating surface that is
to the peripheral device. Then the peripheral device can be between 100 and 14,400 square mm. Optionally the input
personalized, or paired, by means of voice or face recogni device 48 can be a key displayed on the client display 1 of a
tion, respectively. The term Voice recognition refers to finding client processing device 31. This key can be activated, e.g. by
the identity of “who is speaking, rather than what they are use of a pointing device Such as a mouse trigger transfer of
saying. Recognizing the speaker by Voice recognition can 35 data from the processing device 31 to the network 50.
simplify the task of translating speech in Systems that have The connection unit 47 is preferably provided with a visual
been trained on specific person’s Voices or it can be used to indicator 61, e.g. for allowing user feedback from the con
authenticate or verify the identity of a speaker as part of a nection unit 47 of the status of any activity. The system also
security process. “Voice recognition” means “recognizing by can include a server program 64 adapted to be loaded onto the
Voice'. Something humans do all the time over the phone. As 40 base node 36, said program 64 being adapted to receive arbi
Soon as someone familiar says "hello' the listener can iden trary media content from one or a plurality of client process
tify them by the sound of their voice alone. ing devices 31 through said connection units 47. (optionally
The user processing devices 31, the connection units 47. 49), and to show this plurality of arbitrary media content
(optionally 49,52) and the base node 36 co-operate to form a streams on one or a plurality of displays 44. The server pro
communication network50 for linking between at least one of 45 gram 64 may be adapted to allow display in accordance with
the plurality of processing devices 31, 36, 35 and the central one or more rules, e.g. FIFO, automatically, on request,
display device 44. The communication network 50 is adapted forced, in accordance with a priority etc. The forcing rule can
to receive arbitrary media content from at least one of the be described as “unilateral electronic access to the display
plurality of processing devices 31 and to transmit the arbitrary device' as “unilateral” means that the displaying process is
media content of at least one of the plurality of processing 50 obtained by the action of only one participant involved in the
devices to the central display device 44. meeting, without requiring the agreement of another or the
In some embodiments the storage means of the peripheral others. The term “unilateral' implies that the data for display
device can be adapted to record or share information. For is allowed to override or replace any data displayed on the
instance, the peripheral device can be adapted to further com screen by the same or another participant of the meeting. To
prise a private communication channel (e.g. to enable chat 55 execute the rules, the server program 64 may have a decision
ting), which can communication with a private communica module. Preferably, the server program 64 is adapted to treat
tion channel of another participant of the meeting. media content passed to it from any or all of the connection
An independent aspect of the present invention is a por units 47, 52 in an equal manner. The server program 64 may
table application 60 adapted to be loaded onto a client pro be adapted to auto compose the media content on the central
cessing device 31 and to be run on the operating system of the 60 display 44.
client processing device 31. The portable application 60 runs The server program 64 may be a portable application
as a process on the client processing device 31 that is adapted adapted to be loaded onto the base node 36 and to be run on
to deliver an arbitrary media content from the client process the operating system of the base node 36. The portable appli
ing device 31 to the communication network 50 in response to cation 64 runs a process on the base node 36 that is adapted to
a useraction applied to an input device 48, the process leaving 65 display an arbitrary media content received from the client
a Zero footprint on the processing device 31 on termination. processing device 31 via the communication network 50, the
The network 50 can be a shared resource network. Optionally process leaving a Zero footprint on the base node 36 on
US 9,083,769 B2
19 20
termination. Optionally the portable application 64 is stored termination, e.g. disconnecting the electronic device, system
on each connection unit 49 and optionally 47 and can be crash, no trace is left. This is generally termed “Zero foot
installed therefrom. print.
Meetings in which visual information is presented on a The present invention has the advantage of scalability. It
display or projector commonly suffer from a monopoly can provide a display system for use by a plurality of users in
effect: one single presenter determines the display contents meetings. Every user in the meeting thus can have a client
and thereby has a disproportionate power to influence the processing device 31 for coupling to a connection unit 47. A
meeting dynamics and thereby its outcome. Embodiments of first useraction connects the client processing device 31 to the
the present invention solve this problem by allowing multiple base node 36, e.g. by inserting a connection unit 47 into the
individuals to simultaneously show their information. The 10 relevant interface connector on the processing device 31, e.g.
present invention provides according to some embodiments a a USB interface. A second user action comprising activating
method to override all currently displayed material. In a sense abutton or key on the input device (e.g. by depressing it) then
the method of the present invention transforms visual com starts the process of transmitting arbitrary media content from
munication into something akin to talking, i.e. full-duplex the client processing device 31 to the base node 36. This
and with the option to shout and interrupt. 15 process preferably includes screen scraping data from the
The system may also include a central display device 44 processing device. Using screen scraping avoids special pro
and optionally a whiteboard 45 or other display means such as grams being installed on the base node 36 to carry out graphi
a printer. The display 44 being adapted to receive user cal commands sent from the processing device 31. When the
selected arbitrary media content, and may be adapted to allow base node 36 receives the plurality of arbitrary media content,
display of the received user selected arbitrary media content it can allow auto composition of this media content on the
in accordance with one or more rules, e.g. FIFO, automatic, central display connected to it.
forced, on request or approval, in accordance with a priority In some embodiments, the button or key can be virtual
etc. The forcing rule can be described as “unilateral electronic button which is displayed on the screen instead of a button or
access to the display device' as “unilateral means that the key on the input device, which for instance can be the periph
displaying process is obtained by the action of only one 25 eral device. Preferably, when the process of transmitting arbi
participant involved in the meeting, without requiring the trary media content has been activated, the screen scraping
agreement of another or the others. The term “unilateral data from the processing device does not scrape the virtual
implies that the data for display is allowed to override or button. The latter can be enable for instance by positioning the
replace any data displayed on the screen by the same or virtual button on a second layer which is not scraped.
another participant of the meeting. 30 The present invention will now be described further with
Optionally, one of the connection units 47 can be adapted reference to certain more specific embodiments.
to be a master connection unit. Such a master connection unit The present invention in some embodiments provides a
may be adapted to instruct the base node when media content system and/or a method to which in one aspect can override
from a client processing device 31 may be displayed or which all currently displayed material when arbitrary material is
of the processing devices may be allowed to send content for 35 presented on a display device from more than one source
display. processing devices such as a laptop, PDA, Smartphone, com
In embodiments of the present invention, at least one por puter, tablet etc. The present invention in one aspect controls
table application is used, e.g. for the client Software on a client the display of visual communication and information by a
processing device 31 or optionally on the base node 36. In method akin to talking, i.e. full-duplex and with the option to
these embodiments, one of the pre-installed generic drivers of 40 interrupt or to obtain unilateral electronic access to a display
the operating system on the relevant computer device 31, 36 device.
is exploited for setting up communication from the computer One embodiment the present invention can be imple
device 31, 36 to the network 50 via the connection unit 47, mented through a connectable peripheral device e.g. a USB
(optionally 49). The generic driver is used in connection with compatible device, such that when the peripheral device is
the connection unit 47, (optionally 49) operating as a periph 45 connected to a processing device that is used to provide arbi
eral device but the use can go beyond that of the standard class trary information Such as text, video, pictures etc., each indi
of peripheral devices for which the generic driver is intended. vidual user with a processing device can to gain access to the
In some embodiments the connection unit 47, (optionally 49) display, e.g. Screen. By being present at the meeting a user can
operated as a peripheral device communicates with the rel pair the peripheral device to a processing device by inserting
evant processing device 31, 36 by using a generic communi 50 the peripheral device. The user can also pair the peripheral
cation protocol provided by the pre-installed generic driver. device to a base node or base unit that controls the display in
Pre-installed USB drivers are examples. the meeting room and which is connectable to the peripheral
Preferably the setting up of the communication of network device via a communications network Such as a wired or
50 using connection unit 47, (optionally 49) does not alter or wireless communications network. The network is a shared
affect the networking capability of the relevant processing 55 resources communications network as different devices and
device 31,36. For example, if a browser is started on the client participants can transmit data over the network. To achieve
processing device 31, this browser can use the standard net this, the peripheral device has a transceiver capable of trans
work interfaces on the processing device 31. This means that mitting the arbitrary data from the processing device to the
transfer of data via the connection unit 47 (optionally 49) is display via the base node. In one option the information
independent of transfer of data over the network interfaces of 60 displayed on the local display of the processing device is
processing device 31 or 36. This has the advantage that each screen scraped and transmitted. To allow this the peripheral
user can carry out processing such as searching on the internet device can include a portable application that is able to
to gather data independently of the transfer of data to be execute on the processing device leaving a Zero-footprint on
displayed during a meeting, or receive emails etc. termination. Although a physically connectable peripheral
The use of a portable application has the advantage that any 65 device is convenient, the peripheral device could also be
modification to settings in the register or generally in the coupled to the processing device via a wireless connection,
operating system can be avoided, so that upon any form of e.g. via the Bluetooth protocol. For meetings with remote
US 9,083,769 B2
21 22
participants it is not possible to rely on the same hardware The base node 36 receives the plurality of arbitrary media
connectable peripheral device to provide access from a content coming from one or more connection units 47, and
remote location to the display in the meeting room directly. auto composes this media content for rendering on the central
Typically, at home or in a hotel, the participant only has a display.
phone and internet access on a laptop or some other kind of 5 The visual indicator 61 on the connection unit 47 indicates
portable computing device. Remote participants lack context to the user and to other participants in the meeting that media
(e.g. non-verbal communications) and have less than ideal content is being sent by that connection unit 47 to the base
audio/video connections and consequently suffer from a node 36 for display. Repeating the second user interaction on
power-asymmetry. Typically, remote participants also have the input device 48 of a connection unit 47 decouples the
no way of pushing their contents on screen, since the meet 10 media content from that connection unit 47 from the base
node 36. The base node 36 removes that media content from
ing is controlled by a meeting organiser or director who the composed image on the central display and recomposes
orchestrates the sequence of presentations. One of the key the remaining content on the central display. The content on
advantages of the present invention is to provide remote col the central display/projector is auto arranged as shown in
laboration while maintaining a kind of situational aware 15 FIG. 2. When user 1 adds content, his/her display will be
ness. This means that what you see has a straightforward scaled to fill the available central display canvas as much as
relationship with your internal mental map. This allows keep possible, but without affecting the aspect ratio. When user 2
ing track of multiple information flows and being able to adds in, his content is added to the side of the first image.
correlate that quickly with any other information, e.g. with a When user 3 adds his content, the arrangement is a suitable
search carried out on the local computing device. one such as triangle wise. Adding user 4, the image becomes
In another aspect of the present invention confusion and a 2 by 2 tiling, which is the maximum available. When an
frustration is avoided by: additional user attempts to add content, he will be blocked.
1. retaining aspect ratio of any image that is sent from any Whenauser initiates action to remove his/her content, his/her
location to the display in the meeting room or displays in media content is removed from the central display and one
meeting rooms (e.g. a long thing remains a long thing) 25 moves backward in the composition sequence shown in FIG.
2. not overlapping images and/or windows on any of the 2.
display devices in the meeting rooms (e.g. you never have Base Node Software
to guess or remember what’s hidden) The base node software has one or more of the following
3. showing the same arrangement of images on each screen features:
(everyone sees the same things and can refer to them), this 30 First code for providing a means or a method step for
means that the topological arrangement of images on each correctly configuring the receiver of the base node.
screen of multiple screens is the same, Second code for providing a means or a method step for
4. maximizing the use of Screen real-estate (e.g. the images listening for output of connection units trying to connect
presented do not have borders containing no useful infor on a specific port.
mation), while preferably no allowing overlapping of the 35 Optionally, third code for providing a means or a method
images step for a GU for administration purposes, offered for
5. allowing local manipulation of Zoom and pan but allowing example over a web interface.
to return to the default layout of item 3 above Optionally, fourth code for providing a means or a method
6. arranging the images on each display taking into account step for publishing its presence over the network using
the local display characteristics, such as any of resolution, 40 the Zeroconf protocol.
pixel density, aspect ratio, Optionally, fifth code for providing a means or a method
7. optionally also allowing an ongoing audio connection to be step for accepting and installing Software updates of the
heard by all participants, e.g. that Verbal communications base node as well as for the portable application software
will be used to alter the contents of the screen. for the connection units.
With reference to FIG. 2, the base node software (6) run 45 Sixth code for providing a means or a method step for
ning on a base node 36 can be adapted to display on the central providing facilities for pairing of connection units to the
display a splash screen (21) showing its readiness to receive base node.
arbitrary media content over its receiver. This splash screen Seventh code for providing a means or a method step for
(21) can also show instructions on how to use the system, as auto-composing of different incoming arbitrary media
well as the configuration parameters (see later) to reach the 50 streams and rendering of composited image on display
base node 36. These configuration parameters are also shown or projector Screen.
in a transparent canvas at the bottom of the central display Eighth code for providing a means or a method step for
(22). receiving, decrypting and decoding incoming arbitrary
A client processing device 31 that wants to have its arbi media content.
trary media content displayed on the central display con 55 Optionally ninth code for providing a means or a method
nected to the base node 36 is connected to a connection unit step for Scaling of incoming arbitrary media streams
47. The portable application 60 will be executed on the client Optionally tenth code for providing a means for display
processing device 31 as a host device. A first user interaction ing incoming arbitrary media contentinaccordance with
creates a connection between the portable application 60 and a set of one or more rules.
the base node 36 using the transmitter in the connection unit 60 Any of the above code may be stored on a non-transitory
47 and the receiver in the base node 36. This user action can machine readable storage medium Such as an optical disk, a
be a connection of the connection unit 47 to the processing magnetic disk, magnetic tape, Solid state memory, USB mass
device 31. A second user interaction, this time on the input storage device etc.
device 48, activates Screen scraping by the portable applica Portable Application for the Client Processing Device
tion of the arbitrary media content from the client processing 65 The portable application comprises an algorithm for Screen
device display, which is then sent over the connector unit 47 scraping. Screen scraping algorithms include VNC and RDP
to the base node. or similar. The algorithm may include a combination of algo
US 9,083,769 B2
23 24
rithms such as VNC and RDP that are optimized for different device when the connection unit is removed. It also implies
content, e.g. static text or video. The portable application has that the portable application will run on client processing
one or more of the following features: devices where the user does not have the necessary access
Eleventh code for providing a means or a method step for rights to install Software.
connecting to a network including the base node. 5 The portable application is designed in Such a way that
Twelfth code for providing a means or a method step for No specific drivers need to be installed on the client pro
capturing video frame buffers of the client processing cessing device.
device, i.e. computer (C), also called screen scraping. Pre-installed drivers are used, e.g. for classes of peripheral
Thirteenth code for providing a means or a method step for devices.
encoding, compressing and optionally encrypting these 10
It is independent from Vendor specific graphics hardware.
Video frames and sending them over a secure link to the It runs on at least one and preferably on a variety of differ
base node. Only changed areas such as rectangles or ent client processing devices, including Windows, Mac
triangles of the screen (or any other Suitable geometrical
shape) need to be transferred, and different types of OS/X, Linux, Android, iOS and many others.
rectangles or triangles are encoded in different ways 15 Advantages
(e.g. RLE, JPEG, ...) to optimise performance. The present application has one or more of the following
Fourteenth code for providing a means or a method step for advantages:
handling the connection unit. No need for a master role in the meeting
Fifteenth code for providing a means or a method step for Standard plug and play connectivity of connection units to
initiating connection to base node. base node
Sixteenth code for receive inputs from the input device on Simple and well known user actions are employed
the connection unit. Own networking facilities of client processing devices not
Seventeenth code for providing a means or a method step blocked
for sending state changes to the visual indicator on the No configuration changes on the client processing device
connection unit. 25 Input devices are easily accessible; e.g. large size
Optionally, eighteenth code for providing a means or a Program updates of portable application and server pro
method step for presenting the user a GUI (18). gram can be performed locally
Optionally, nineteenth code for presenting GUI for admin Portable applications are used, no installation, multi-plat
istration of the portable application. form, no vendor specifics
Optionally, twentieth code for providing a means or a 30
Particular implementation of screen scraping done by por
method step for displaying and activating a key on the table application avoids vendor specific graphics
display of the client processing device for allowing a devices
user input to start the transfer of data from the client Standard drivers are used so no need to install extra drivers
device to the base node.
Embodiments of the present invention provide a frame 35 No configuration changes on the client processing devices
grabber. A frame grabber, known in the prior art, is an elec Zero footprint applications on client processing devices—
tronic device that captures individual, digital still frames from nothing to clear up or adjust or reset
an analog video signal or a digital video stream. It is usually Own networking facilities of client processing devices not
employed as a component of a computer vision system, in blocked—No configuration changes on the user com
which video frames are captured in digital form and then 40 puters
displayed, stored or transmitted in raw or compressed digital Low virus, malware and spyware risk
form. In recent years, connections via USB, Ethernet and The portable application may be stored on a non-transitory
IEEE 1394 (“FireWire') interfaces have become prevalent. machine readable storage medium Such as an optical disk, a
The frame grabber of the present invention, enables HDMI or magnetic disk, magnetic tape, Solid state memory, nand Flash
Display Port capture instead via USB. The frame grabber 45 etc.
preferably functions as follows: Second Embodiment
Connect to the base unit using a TCP/IP socket interface. In the second embodiment, referring to FIGS. 2 to 5, the
Capture the video frame buffers of the computer, base node is a separate physical processing device called base
Encode, compress and encrypt these video frames and unit (B), comprising permanent storage, memory, a process
stream them over a secure link to the base unit. Only 50 ing engine, a wireless access point (4), a plug and play inter
changed rectangles of the screen are transferred, and face Such as a USB port (11), a graphics display output
different types of rectangles are encoded in different adapter (5) like VGA/DP/DVI/HDMI, and optionally an
ways (e.g. RLE, JPEG, ...) audio output adapter (27). An input device having an actuator
Present the user a GUI Such as a button 13 and a visual indicator 14 are optional.
Any of the above code may be stored on a non-transitory 55 The connection unit is a physical device in the form of an
machine readable storage medium Such as an optical disk, a external peripheral device (shown in the drawings as a
magnetic disk, magnetic tape, Solid state memory, NAND "dongle' D) comprising permanent storage storing the por
Flash, etc. table application (7) and configuration parameters (12),
In this embodiment the portable application stored on the memory, a processing engine (e.g. CPU, FPGA), a wireless
connection unit, and is executed in an execution context on 60 transmitter such as WiFi (3) or other wireless transmitters
the client processing device. The portable application does Such as LiFi, a plug and play interface Such as a USB interface
not need to be copied to or installed on the computer. It can be (2), a button as input device (9), an LED ring as visual indi
executed directly from the connection unit. It will only be cator (10). The portable application is stored on the peripheral
copied temporarily into an execution context on the client device (7). The client processing device is host device, for
processing device. There are also no changes in configuration 65 example a computer or laptop comprising a display, a plug
required or settings in the client processing device. This and play interface Such as a USB port (2), memory, and a
means that nothing will remain on the client processing processing engine such as a microprocessor.
US 9,083,769 B2
25 26
The system thus comprises: other to the permanent storage (8). For example, when using
an external peripheral device (D) that has a plug and play WiFi, this could be the SSID, WEP/WPA2 keys and IP
interface such as a USB interface (2) on one end and a address and port number of the base units receiver, as well as
communications interface Such as a wireless interface the port number used by the base node software, but not all of
configured as client (3) on the other end. these are necessarily needed to be exchanged.
a base unit (B) that has a communications interface Such as A client processing device that wants to have its arbitrary
a wireless interface configured as access point on one media content displayed on the central display connected to
end (4) and a video card adapter (5) like VGA, DVI, DP
or HDMI on the other end. the base node (5) connects a peripheral device (D) to its USB
a portable application (7) stored on the peripheral device 10 port via (2). The peripheral device presents itself to the com
(D) but executed on the client processing device (C) puter over interface (2) as a composite device comprising a
a base node software (6) stored and executed on the base mass storage device and a keypad. This has the major advan
unit (B) tage that no specific driver is required, since all these devices
The external peripheral device (D) also preferably has any are natively supported in every personal computer system that
one or any combination of: 15 has a USB port. If autorun is enabled, then the computer will
a large button as actuator for the input device (9) allowing automatically execute the client software (7) stored in mass
user interaction with the peripheral device. The button storage (8) on the peripheral device. The first user interaction
preferably has an actuation surface area of between 100 mentioned in the general case is then just the connection of
and 14.400 square mm. the peripheral device to the USB port. If security measures
visual indication such as a LED (10) allowing user feed disabled auto-run, the user needs to explore the mass storage
back from the peripheral device. The user feedback can on the mass storage of the peripheral device and start the
be in the form of a light ring. portable application manually.
An advantage of embodiments of the present invention is to
provide data transfer to the peripheral device via a peripheral The portable application will use the wireless, e.g. WiFi or
interface Such as a USB interface on any processing device 25 LiFi interface of the peripheral device (3) to connect to the
Such as a computer in a manner that is largely operating correct base node. To know the right base unit to connect to,
system independent and without leaving a footprint (Zero the configuration parameters needed to make this connection
Footprint). Installation of drivers and/or applications onto are stored in the database (12) on the mass storage device (8)
Such a processing device as a computer is not necessary during the pairing process described earlier.
wherever pre-installed generic drivers are present. Adminis 30
Once the connection is made, the peripheral device goes
trator rights on the processing device Such as a computer are into connected mode. This means that there is now at least one
preferably not necessary. To avoid the need for administrator channel from the peripheral device to the base unit. The
rights, embodiments of the present invention use other content is not shown yet. The LED (10) on the peripheral
peripheral device pre-installed drivers such as USB class device now turns white to give a visual indication of this new
drivers supported without any extra installation. Embodi 35
State.
ments of the present invention route at least screen scraped
data presented by client software running on the processing When the user at the computer (C) wants to show her
device for transfer to a communications network via a periph content, she presses the button (9). When the button was
eral device such as a USB device. This bypasses any network previously in state “connected' (see FIG. 6), it will check the
interface of the processing device C (and hence many fire 40 state of the base unit (P). If the base unit is not in state “full',
walls) but only for the specific client software. Other appli the peripheral device will send the screen scraped arbitrary
cations are not affected and can make use of the standard media content to the base unit (B), which will add the media
network interfaces, i.e. packets from/to the TCP/IP stack are content to the composition on the central display. The periph
transferred to a network device as normal. The client software eral device LED (10) now turns red to indicate “showing
is launched from the peripheral device such as a USB com 45 state (FIG. 6).
posite device or storage device as a portable application, The button (9) acts as a toggle. When the user presses the
which can avoid that any traces are left on the host OS. button again, that computer displays content will be removed
Basic Usage Scenario of the Second Embodiment from the projector. The LED (10) goes back to white.
The base node software (6) displays on the projector a
splash screen (21) in FIG. 5 showing its readiness to 50 Use of the auto-run feature is optional if possible and
receive arbitrary media content over its receiver (4). This enabled on the computer (C) to start the client software (7) as
Splash screen (21) also shows instructions on how to use the soon as the peripheral device is plugged in. On Windows for
system, as well as the configuration parameters (see later) to example, this means mounting the peripheral device as a mass
reach the base node. These configuration parameters can also storage device and using the autorun.inf file stored on the
be shown in a transparent canvas at the bottom of the central 55 peripheral device.
display (22). In many cases however, this auto-run feature will be dis
To avoid user interaction for the configuration of the con abled for security reasons. In that case, we will, if possible and
nection between peripheral device and base unit, a pairing enabled on the computer (C), use the auto-play feature to
process is used. This pairing process provides the peripheral show the logo of the connected peripheral device on the
device, i.e. the connection unit with networks parameters 60 desktop of the computer. The user then needs to double click
needed to set up the local network. As an example, the periph on that logo to start the client software. If the auto-play feature
eral device can be briefly plugged into the USB port (11) of as described above is also not possible or enabled, the user
the base unit (B). The base unit then optionally does a soft must browse to the file system of the connected peripheral
ware validity check, optionally does a software update of the device and start the application manually. This means double
portable application stored on the peripheral device, and 65 clicking the client.exe file on Windows, client, app on Mac
writes the connection parameters on the peripheral device (D) OS/X or tapping the appropriate application icon on a tablet
required for the peripheral device and base unit to find each or any mobile device with touch screen.
US 9,083,769 B2
27 28
Third Embodiment: Portable Application Stored on Standard Need to find free key on client operating device when using
Solid State Memory Such as a USB Stick. physical key for second user action
In the third embodiment, the portable application is stored Network interface is blocked from other uses by portable
on a solid state memory such as a regular USB memory stick application Optionally, the last point can be avoided by
5 using the base unit as a gateway to the network that the
(FIG. 7).
With a solid state memory such as a regular USB memory client operating device wanted to connect to through its
Stick, there is no input device, visual indicator or transmitter own interface.
of the kinds described above for the connection unit. This Advantages are:
means that the system needs to: 10
tight control of user connectivity to corporate network
Use the transmitter/receiver from the client processing through settings on the base unit
device. keep network connectivity intact even when transmitter is
Use as input device a key or button on the client processing now also used for display purposes
device like a physical key on the keyboard, a special Disadvantage is a higher Vulnerability of the system
mouse press, a button area on a touch screen, a button 15 because the display connection is now possible a doorway
displayed on the screen to be clicked on with a mouse into the corporate network.
pointer. What remains as advantages are
Present the visual indicator on the client processing the availability of a physical medium to distribute the por
device's display. table application to users—no need to install or copy
The client processing device then looks like FIG. 8. Software to client operating device
This embodiment provides a peripheral interface such as easy way to maintain software updates on the connection
the USB interface on any processing device acting as a host units (here: memory sticks) via the base unit
device Such as a computer in a manner that is largely operat possibility to write configuration data on the connection
ing system independent. Installation of drivers and/or appli unit by the base unit, for example in the form of a
cations onto Such a processing device as a computer is not 25 configuration profile that can be read and used by the
necessary wherever pre-installed generic drivers are present. client operating device
Administrator rights on the processing device Such as a com Fourth Embodiment: Software Only Client Installed on the
puter are preferably not necessary. To avoid the need for Client Processing Device.
administrator rights, this embodiment uses other peripheral This embodiment is similar to the third embodiment, with
device pre-installed drivers such as USB class drivers sup 30
as only difference that the software is copied on the client
ported without any extra installation. This embodiment of the operating device (FIG. 9). In this case, no plug and play port
present invention routes at least screen scraped data presented Such as a USB port is required on the client operating device.
by client Software running on the processing device for trans This embodiment will typically be used for tablet PCs and
ferto a communications network via a network connection of
mobile devices. In that case
the processing device. The client software is launched from 35
the peripheral device such as the USB device as a portable there is often no USB port available
application. application distribution is easy and widely accepted
The first user operation then comprises: through application stores
plugging in the Solid state device Such as a USB memory Fifth Embodiment: Base Node Software OEMed to Projec
Stick, starting the portable application (if autorun is dis 40 tor or Display Equipment
abled) In this embodiment, the base node is not realized as a
configuring the transmitter, Such as the wired or wireless separate physical box, but integrated into the processing unit
network interface, on the client processing device to inside a display or projector. All other details areas previously
connect to the correct base node, using the configuration described.
parameters (22) shown on the central display 45 Sixth Embodiment
triggering the connection of the portable application with In this embodiment, the base node is not realized as a
the base node, for example by interacting with an ele separate physical box, but integrated into the codec of a video
ment on the GUI (18) of the portable application pre conferencing equipment. All other details are as previously
sented on the display of the client processing device. described.
Presenting visual feedback on user actions is in this 50 Seventh Embodiment: Remote Meeting Participant
embodiment also done using elements in the GUI of the In this embodiment, one or multiple client operating
display of the client operating device. devices are not in the direct vicinity of the base node but on a
In this embodiment, the advantage of Zero footprint is remote location. To accommodate this case, the following
partly realized by the portable application in the sense that no adaptations are needed:
Software is installed on or copied to the client operating 55 further compression and or scaling of the arbitrary media
device, but there is a configuration change needed to connect content to allow use of low bandwidth connection
the transmitter of the client operating device with the base possibility to communicate connection parameters of the
node, which needs to be undone afterwards. base node to a remote user
Optionally, the portable application can make the configu connectivity of the base node to the WAN network to which
ration changes to the transmitter for the user in the back 60 the remote user is connected
ground. All other details are as previously described.
Advantages lost in this embodiment Eighth Embodiment: Multiple Base Nodes
Partial loss of Zero footprint nature of portable application In this embodiment, multiple base nodes are used. This can
More complex first user interaction be done for different purposes:
More expertise required from user 65 connectivity of multiple central displays
GUI needed on client operating device display, which is extension of real estate of central display
possibly also shown on central display connectivity of base nodes in different remote locations
US 9,083,769 B2
29 30
This provides the advantage that one can present on mul of the connected user processing device and the ergonomic
tiple base units from a single peripheral device. This is useful boundary as defined above. In addition the flexible data and
for a number of cases: power connection should be adapted so that the base lies flat
personal peripheral device: user can have a personal on the meeting table independent of the orientation of the
peripheral device that is paired with multiple meeting connector needed to insert the connector into the plug and
rooms that he regularly uses play interface.
use in meeting room with multiple base units each control The base preferably includes electronics such as having
ling a different display in the same meeting room permanent storage for storing the portable application and the
The proposal uses a special variant of the peripheral device network configuration parameters, memory, a processing
called a multi base peripheral device. The multi base periph 10
engine (e.g. CPU, FPGA), a wireless transmitter/receiver
eral device is equipped with a rotating wheel around the such as for WiFi or LiFi, a plug and play interface such as a
circular central “show me' button. This could be a mechani
cal rotating multi-position Switch or something like the touch USB interface, a LED ring as visual indicator. The visual
wheel on the iPod classic. indicator can be used for the LiFi interface. The portable
The pairing of this multi-base variant of the peripheral 15 application can be stored on the peripheral device, i.e. in the
device: base. The visual indicator is for allowing user feedback from
the rotation wheel is put in the position of the correspond the connection unit of the status of any activity.
ing base unit. Some examples for activation of the actuator which can be
the peripheral device is paired to the base node in the used with any of the embodiments of the present invention:
regular way Sound activated (hand clap, Voice recognition, computer
the configuration parameters are stored in a permanent Sound, music. . . . )
storage location; every position of the rotating wheel has Remote controlled via wireless connected device (IR,
a corresponding set of connection parameters (e.g. dif Bluetooth, WiFi,...)
ferent rows in a table) each corresponding with a par Light activated
ticular base 25 Pressure activated, e.g. depression with a finger or hand,
The connection of the peripheral device is as follows: Touch activated
multi-base peripheral device X is plugged into a PC Proximity (near-touch on the actuator or bringing the
rotation wheel on peripheral device X is put in position A actuator close to some object
peripheral device X reads configuration parameters in Biometric reader Such as Fingerprint reader, Iris Scanner,
position A of its internal memory 30 DNA analyser
peripheral device X connects to base node A Keypad, e.g. for entering Keycode e.g. a password
base node A indicates connection of multi-base peripheral Alternative Embodiments
device X on central display Screen In the above embodiments, once the connection is made
rotation wheel on peripheral device X is put in position B between the connection device and a host computer, the
peripheral device X reads configuration parameters in 35 peripheral device goes into connected mode. This means that
position B of its internal memory there is at least one channel from the peripheral device to the
peripheral device X connects to base node B base node. In accordance with any of the embodiments of the
base node B indicates connection of multi-base peripheral present invention a plurality of channels can be set up
device X on screen between the connection device and the base node. These
continue until correct base is selected with rotation wheel 40 channels may be logical channels.
click the peripheral device input device e.g. button to show Some examples for Such a multichannel arrangement may
content on central display of base node include the first and one or more of the additional channels:
rotating the wheel always first clicks away content from the First channel is for the Scraped image stream (XDS)
base of the last position Second channel is for GPU commands (OpenGL, DirectX)
Ninth Embodiment 45 Third channel is for Mouse pointer coordinates (absolute,
FIG.10 shows a peripheral device 47 in accordance with an relative)
independent embodiment of the present invention including Fourth channel is for Mouse pointer icons
an input device. This embodiment can be used with any of the Fifth channel is for Image data files (JPEG, PNG,
embodiments described above. The peripheral device is con GIF, ...)
figured as a connection unit and is a physical device in the 50 Sixth channel is for Multimedia data files or streams
form of a connector for a plug and play interface of a user (MPEG2, MPEG4, OGG, H.26x, ...)
processing device as a host computer Such as a USB connec Seventh channel is for Audio data files or streams (MP3,
tion, a flexible data and power connection connected to the MP4, AAC, WMA, ...)
connector and a base, the base having an actuator, e.g. a Eighth channel is for text or Document data files (DOC,
button configured to be an input device with the functions as 55 DOCX, PPT, PPTX, ODT, ODS, PDF, ...)
described above. Ninth channel is for transmission of a priority value 1, 2,
The base and/or the actuator is preferably large in size, e.g. 3 ... as described above.
having a surface area between 100 and 14,400 square mm. In the above embodiments, a particular method of pairing
The base can be square, rectangular, round, hexagonal, oval, the peripheral device with the base node has been described.
polygonal in shape or any other ergonomically Suitable shape. 60 Any of the embodiments of the present invention may include
The actuator is preferably round but can be square, rectangu other pairing mechanisms of which some examples are given
lar, hexagonal, oval, polygonal in shape etc. there can be more below.
than one actuator on one base. Some examples for pairing
The length of the flexible data and power connection, e.g. Plug in the peripheral device, to a generic peripheral
cable is preferably adapted to place the peripheral device 65 device port such as a USB port of the base node or
(when in its connected in its operating position), especially other USB enabled device. Pairing info is transmitted
the base and the actuator, in the region between the boundary over the generic peripheral interface such as USB.
US 9,083,769 B2
31 32
The Signal strength of the wireless channel to the base a third processing software code for routing data between
node is used to identify which base nod is to be used the processing device and the communications network
The Signal strength of the wireless channel or any other over the means for communication;
channel. Example is an NFC/RFID transmitter can be wherein the first software code portion is adapted to use the
provided underneath the meeting room table. Putting generic communication protocol for transferring the
the user processing device Such as a laptop and the data between the processing device and the peripheral
peripheral device plugged in on this table automati device, and
cally pairs the peripheral device with the base of this an input device coupled to the peripheral device, the input
meeting room device being adapted to react to a user action to trigger
Manual pairing (e.g. by entering IP address, hostname, 10
the transfer of the data from the processing device to the
wireless ID (like SSID on WiFi)). peripheral device.
We claim: 8. The peripheral device of claim 7, wherein the first soft
1. A method for connecting a processing device to a com ware code portion is adapted to present the peripheral device
munications network, the processing device having a to the processing device as a human interface device and
memory, a display and an operating system with at least one wherein the pre-installed generic driver is a human interface
pre-installed generic driver providing a generic communica 15 device driver.
tions protocol for communication between processing device 9. The peripheral device of claim 7, wherein the first soft
and a standard class of peripheral devices, the method com ware code portion is adapted to present the peripheral device
prising the steps of: to the processing device as a mass storage device and wherein
a) coupling a peripheral device to the processing device, the pre-installed generic driver is a mass storage device driver.
the peripheral device having a transceiver, 10. The peripheral device of claim 7, wherein the first
b) setting up, by means of the pre-installed generic driver of Software code portion is adapted to present the peripheral
the operating system, a means for communication device to the processing device as a composite device and
between the peripheral device and the processing wherein pre-installed generic drivers drive different device
device; interfaces independently.
c) coupling the processing device to a communications 25 11. The peripheral device of claim 7 wherein the input
network via the peripheral device; device is physical actuator coupled to the peripheral device.
d) routing screen scraped data between the processing 12. The peripheral device of claim 7 wherein the input
device and the communication network via the means device is a key for display on the display.
for communication, wherein the generic communication 13. The peripheral device of claim 7 wherein said execut
protocol is used for transferring the screen scraped data 30
able software code comprises fourth code for providing a
between the processing device and the peripheral means for connecting to the communications network includ
device. ing a base node.
2. The method of claim 1 wherein Step b) comprises pre 14. The peripheral device of claim 7 wherein said execut
senting the peripheral device to the processing device as a able software code comprises fifth code for providing a means
human interface device and wherein the pre-installed generic for capturing video frame buffers of the processing device.
driver is a human interface device driver. 35 15. The peripheral device of claim 14 wherein said execut
3. The method of claim 1 wherein Step b) comprises pre able software code comprises sixth code for providing a
senting the peripheral device to the processing device as a means for encoding, compressing and optionally encrypting
mass storage device and wherein the pre-installed generic the video frames and sending them over a secure link to the
base node.
driver is a mass storage device driver. 40 16. The peripheral device of claim 7 wherein said execut
4. The method of claim 1 wherein Step b) comprises pre able software code comprises seventh code for providing a
senting the peripheral device to the processing device as a means for handling the peripheral device.
composite device and wherein pre-installed generic drivers
drive different device interfaces independently. 17. The peripheral device of claim 15 wherein said execut
5. The method of any of claims 1 to 4 wherein a client able Software code comprises eighth code for providing a
application is stored on the peripheral device which when run 45 means for initiating connection to the base node.
on the processing device obtains the screen scraped data. 18. The peripheral device of claim 7 wherein said execut
6. The method of claim 5 wherein the client application is able software code comprises ninth code for receive inputs
a portable application. from an input device on the peripheral device.
7. A peripheral device for providing communication con 19. The peripheral device of claim 7 wherein said execut
nectivity to a processing device which is provided with 50
able software code comprises tenth code for providing a
memory, a display and an operating system with at least one means for sending state changes to the visual indicator on the
pre-installed generic driver providing a generic communica peripheral device.
tion protocol for communication between the processing 20. The peripheral device of claim 7 wherein said execut
device and a standard class of peripheral devices, the periph able Software code comprises eleventh code for providing a
eral device comprising a memory in which executable soft means for presenting the user a GUI.
ware code is stored for execution on the processing device, 55 21. The peripheral device of claim 7 wherein said execut
said executable software code comprising: able software code comprises twelfth code for presenting
a first Software code portion for setting up, by means of the GUI for administration of the executable software code when
pre-installed generic driver of the operating system, a executed as a portable application.
means for communication between the peripheral 22. The peripheral device of claim 13 wherein said execut
device and the processing device; 60 able software code comprises thirteenth code for providing a
a second Software code portion for connecting the process means for displaying and activating a key on the display of the
ing device to a communications network via the periph processing device for allowing a user input to start the transfer
eral device, the peripheral device having a transceiver; of data from the processing device to the base node.
and k k k k k
UNITED STATES PATENT AND TRADEMARK OFFICE

CERTIFICATE OF CORRECTION
PATENT NO. : 9,083,769 B2 Page 1 of 1
APPLICATIONNO. : 14/212170
DATED : July 14, 2015
INVENTOR(S) : Koen Simon Herman Beel et al.
It is certified that error appears in the above-identified patent and that said Letters Patent is hereby corrected as shown below:
On the title page:

In the Related U.S. Application Data item (60) for provisional application No. 61/235.219, please
delete “61/235.219 and replace with --61/635.219.--
Signed and Sealed this

Fifth Day of January, 2016
74-4-04- 2% 4 Michelle K. Lee
Director of the United States Patent and Trademark Office
Exhibit 3
Exhibit 4
Exhibit 5
USOOD6992.41 S
(12) United States Design Patent (10) Patent No.: US D699,241 S

M00rs et al. 45) Date of Patent: Feb. 11,9 2014
(54) PERIPHERAL DEVICE FOR COMPUTERS D368,097 S * 3/1996 Heberling et al. ........... D14/242
D369,355 S * 4/1996 Li ...................... D14,188
D379,993 S * 6/1997 Devitt et al. D14/240
(75) Inventors: Bert Moors, Kortrijk (BE); Steven D384,057 S * 9/1997 Lee et al. ....... D14f135
Vindevogel, Zwevegem (BE); Tom D394.266 S * 5/1998 Hogenbirk .. D14/240
Dewaele, Kapellen (BE); Simon De D407,076 S * 3/1999 Renk ....... D14,301
D412,160 S * 7/1999 Nelson ... D14.f435
Set Shich (BE); Timothy Macken, D412.940 S * 8/1999 Kato et al. ... . . D21,324
iest (BE) D413,021 S * 8/1999 Wheatley et al. ............ D14/240
D420,362 S * 2/2000 Pedraza et al. ..... D14/242
(73) Assignee: Barco NV, Kortrijk (BE) D429,244 S * 8/2000 Hu ..................... D14,348
D446,209 S * 8/2001 Hickford et al. D14,357
(**) Term: 14 Years D453,019 S * 1/2002 Oba ............... D14,348
D464,958 S * 10/2002 Coker et al. ....... D14/240
D469,026 S * 1/2003 Hoofnagle et al. ... D1078
(21) Appl. No. 29/421,093 D486,819 S * 2/2004 Wilson ......................... D14/240
(22) Filed: May 21, 2012 (Continued)
(30) Foreign Application Priority Data OTHER PUBLICATIONS
GadgetBB News Blog >> 2008 >> August > 27, online Aug. 27.
Nov. 21, 2011 (EP) .......................... OO 1303101-OOO1 2008 retrieved on Nov. 25, 2008. Retrieved from the Internet
Nov. 21, 2011 (EP) .......................... OO 1303101-OOO2 <URL: http://www.gadgetbb.com/2008/08/27/page/2/>.*
Nov. 21, 2011 (EP) .......................... OO 1303101-0003
Nov. 21, 2011 (EP) - - - - - - - - - - - - - - - - - - - - - - - - - - OO 1303101-0004 Primary Examiner — Karen E Kearney
Nov. 21, 2011 (EP) .......................... OO 1303101-0005 (74) Attorney, Agent, or Firm — Bacon & Thomas, PLLC
Nov. 21, 2011 (EP) .......................... OO 1303101-OOO6
Nov. 21, 2011 (EP) .......................... OO 1303101-OOO7 (57) CLAM
(51) LOC (10) Cl. ................................................ 14-02 The ornamental design for a peripheral device for computers,
(52) U.S. Cl. as shown and described.
USPC ......................................................... D14/356 DESCRIPTION
(58) Field of Classification Search
USPC ........ D14/300-302,314, 348-370, 383-385, FIG. 1 is an upper perspective view of a first embodiment of
D14/435, 496, 125, 135, 155, 240-242, our design;
D14/299; D3/273; D9/432: D10/65, 75, 78; FIG. 2 is a rear elevation view thereof;
D13/103, 119, 162, 184, 199: FIG. 3 is a bottom plan view thereof;
361/679.31-67945; 312/223.2 FIG. 4 is a front elevation view thereof;
See application file for complete search history. FIG. 5 is a left side elevational view of the body of the device,
(56) References Cited the right side being a mirror image thereof; the left elevational
view of the cable is shown, the right side elevational view is a
U.S. PATENT DOCUMENTS mirror image of the left side; and,
FIG. 6 is top plan view thereof.
D274.048 S * 5/1984 Wong et al. ............... D10/106.1
D307,274 S * 4, 1990 Sasaki et al. ................. D14,243 1 Claim, 6 Drawing Sheets
US D699,241 S
Page 2
(56) References Cited D537,445 S * 2/2007 Bousfield ..................... D14,383

D544,881 S * 6/2007 Yang et al. ...... ... D14.f496
U.S. PATENT DOCUMENTS 7,298,583 B2 * 1 1/2007 Miyazaki et al. 360,99.23
7,441,256 B2 * 10/2008 Choi et al. .................... T20,648
D487,430 S * 3/2004 D13, 182 D579,871 S * 1 1/2008 Hsiau. ........................... D13,133
D487,460 S * 3/2004 ... D14,368 D580,932 S * 1 1/2008 Tzou et al. ... D14,356
D491953 S * 6/2004 Arakaki et al. .............. D14/453 D585,060 S * 1/2009 Han ............. ... D14,358
D512,061 S * 1 1/2005 Sato et al. .................... D14,363 D597.535 S * 8/2009 Brennwald ... D14/240
D514,564 S * 2/2006 Sato et al. ... D14,363 D598.436 S * 8/2009 Tseng .......................... D14/240
D514,570 S * 2/2006 Ohta ........... ... D14,384
D530,325 S * 10/2006 Kerila et al. ................. D14,356 * cited by examiner
U.S. Patent Feb. 11, 2014 Sheet 1 of 6 US D699,241 S
FIG. 1
FIG 2

FIG. 4


Exhibit 6
U.S. Patent No. 8,756,348
Accused Product: Clevershare
Representative Claim 1 Exemplary Evidence of Infringement

1[pre] An electronic meeting The Accused Product comprises an electronic meeting tool for communicating arbitrary media
tool for communicating arbitrary content from users at a meeting.
media content from users at a
meeting comprising See, e.g.:
http://www.interactiveconcepts.be/upload/attach-image/clevertouchpro-1.pdf
-1-
U.S. Patent No. 8,756,348 || Accused Product: Clevershare

And see:
https://archive.clevertouch.com/accessories/clevershare
1[a] a node configuration The Accused Product comprises a node configuration arranged to operate a display node of a
arranged to operate a display communications network, the display node being coupled to a first display, the node configuration
node of a communications further being arranged to receive user selected arbitrary media content and to control display of
network, the display node being the user selected arbitrary media content on the first display.
coupled to a first display, the
node configuration further being A node configuration arranged to operate a display node of a communications network, the display
arranged to receive user selected node being coupled to a first display:
arbitrary media content and to
control display of the user See, e.g.:
selected arbitrary media content
on the first display
-2-

And see:
And see:
https://support.clevertouch.com/Support/Guide%20to%20using%20Clevershare.pdf
-3-

[…] the node configuration further being arranged to receive user selected arbitrary media content
and to control display of the user selected arbitrary media content on the first display:
See, e.g.,
https://support.clevertouch.com/Support/Clevershare%20user%20guide.pdf
And see:
-4-

1[b] at least one peripheral The Accused Product comprises at least one peripheral device configured to communicate the
device configured to user selected arbitrary media content via the communications network, wherein the peripheral
communicate the user selected device is a connection unit comprising a connector arranged to couple to a port of a processing
arbitrary media content via the device having a second display, a memory and an operating system.
communications network,
wherein the peripheral device is At least one peripheral device configured to communicate the user selected arbitrary media
a connection unit comprising: content via the communications network:
(a) a connector arranged to
couple to a port of a See, e.g.,
processing device having
a second display, a
memory and an operating
system;
(b) a wireless transmitter
arranged to communicate
with the communications
network;
(c) an actuator on the
peripheral device,
wherein said actuator is
arranged in a way to
enable the user to carry
out a user action by
actuating the actuator to
trigger the processing
device to transfer said
user selected arbitrary
media content to said
wireless transmitter
through said port to
transmit said user https://support.clevertouch.com/Support/Guide%20to%20using%20Clevershare.pdf
selected arbitrary media
-5-

content to the node And see:
configuration via the
communications network
And see:
https://fccid.io/2AFG6-SM01/1
1
On information and belief, Guangzhou Shirui Electronics Co., Ltd is the OEM of Clevershare products, manufacturing the same
under the direction and control of Sahara Presentation Systems PLC
-6-

wherein the peripheral device is a connection unit comprising a connector arranged to couple to a
port of a processing device having a second display, a memory and an operating system
See, e.g.,
And see:
-7-

And see:
https://support.clevertouch.com/Support/Clevershare%20user%20guide.pdf2
[…] wherein the peripheral device is a connection unit comprising […] a wireless transmitter
arranged to communicate with the communications network:
See, e.g.,
2
By way of example, the Windows 7 operating system requires at least 1GB RAM (memory). See https://support.microsoft.com/en-
us/help/10737/windows-7-system-requirements
-8-

And see:
-9-

And see:
https://fccid.io/2AFG6-SM01/
[…] wherein the peripheral device is a connection unit comprising […] an actuator on the
peripheral device, wherein said actuator is arranged in a way to enable the user to carry out a user
action by actuating the actuator to trigger the processing device to transfer said user selected
arbitrary media content to said wireless transmitter through said port to transmit said user selected
arbitrary media content to the node configuration via the communications network.
See, e.g.,
- 10 -

And see:
1[d] a program configured to be The Accused Product comprises a program configured to be loaded onto the processing device
loaded onto the processing and to run on the operating system of the processing device, said program being arranged to obtain
device and to run on the user selected arbitrary media content, said program leaving a zero footprint on termination.
operating system of the
processing device, said program Program configured to be loaded onto the processing device and to run on the operating system
being arranged to obtain user of the processing device, said program being arranged to obtain user selected arbitrary media
selected arbitrary media content, content:
said program leaving a zero
footprint on termination. See, e.g.,
- 11 -
And see:
- 12 -

And see:
[…] said program leaves a zero footprint on termination.
Upon information and belief, the Accused Product comprises a program configured to be loaded
onto the processing device and to run on the operating system of the processing device, said
program leaving a zero footprint on termination.
See, e.g.,
In other cases, when the user wishes, the monitor can function as a tablet to control your laptop
(Windows or Mac). We discover a new way of working thanks to the large format display and multi-
touch capability; you only need to connect your computer to the screen by HDMI or VGA and
USB, or use the transmitter CleverShare, without installing any software. Today, almost all
programs incorporate touch functions, and even drawing and annotation tools, such as the Office
pack.
https://www.charmex.net/en/articulo/clevertouch-charmex-and-make-available-to-the-monitors-
companies-high-performance-multi-touch
- 13 -

And see:
On the other hand, Clevertouch has incorporated new features to its Pro and Plus Lux Dual Slot
lines to offer a better digital experience. Among these is Clevershare with mirror functions for file
sharing, remote control and touch function transmission (two touch points without PC). The
Clevershare Dongle is integrated by a USB / WiFi transmitter / receiver with video, audio and
10 touch points without software installation.
https://www.charmex.net/en/articulo/charmex-bets-on-interactivity-for-the-educational-
environment-with-the-clevertouch-monitors
- 14 -
Exhibit 7
US Patent No. 9,083,769
Accused Product: Clevershare

1[pre] A method for connecting a The Accused Product comprises a method for connecting a processing device to a
processing device to a communications network, the processing device having a memory, a display and an operating
communications network, the system with at least one pre-installed generic driver providing a generic communications
processing device having a memory, protocol for communication between processing device and a standard class of peripheral
a display and an operating system devices.
with at least one pre-installed
generic driver providing a generic Connecting a processing device to a communications network:
communications protocol for
communication between processing See, e.g.,
device and a standard class of
peripheral devices, the method
comprising the steps of:
And see:
- 1-
US Patent No. 9,083,769 || Accused Product: Clevershare

And see:
The processing device having a memory:
See e.g.,
1
By way of example, the Windows 7 operating system requires at least 1GB RAM (memory). See https://support.microsoft.com/en-
us/help/10737/windows-7-system-requirements
- 2-

The processing device having a […] display:
The processing device having […] an operating system:
See, e.g.,
- 3-

[…] with at least one pre-installed generic driver providing a generic communications protocol
for communication between processing device and a standard class of peripheral devices:
See e.g.,
And see:
2
By way of example, “Windows operating systems include native support for USB host controllers, hubs, and devices and systems
that comply with the official USB specification.” See https://docs.microsoft.com/en-us/windows-hardware/drivers/usbcon/ (emphasis
added).
- 4-

 1[a] coupling a peripheral device to The Accused Product comprises coupling a peripheral device to the processing device, the
the processing device, the peripheral peripheral device having a wireless transceiver and an actuator on the peripheral device.
device having a wireless transceiver
and an actuator on the peripheral Coupling a peripheral device to the processing device:
device;
See, e.g.,
- 5-

[…] the peripheral device having a wireless transceiver […] on the peripheral device:
See, e.g.,
And see:
- 6-

And see:
https://fccid.io/2AFG6-SM01/3
[…] the peripheral device having […] an actuator on the peripheral device:
See, e.g.,
3
On information and belief, Guangzhou Shirui Electronics Co., Ltd is the OEM of Clevershare products, manufacturing the same
under the direction and control of Sahara Presentation Systems PLC
- 7-

And see:
- 8-

1[b] setting up, by means of the pre- The Accused Product comprises setting up, by means of the pre-installed generic driver of the
installed generic driver of the operating system, a means for communication between the peripheral device and the processing
operating system, a means for device.
communication between the
peripheral device and the processing See, e.g.,
device;
And see:
4
added).
- 9-

1[c] coupling the processing device The Accused Product comprises coupling the processing device to a communications network
to a communications network via via the peripheral device.
the peripheral device;
See, e.g.,
“Connecting to receiver”
“Ready for sharing”
- 10-

And see:
And see:
1[d] routing screen scraped data on The Accused Product comprises routing screen scraped data on the processing device between
the processing device between the the processing device and the communications network via the means for communication,
processing device and the wherein the generic communication protocol is used for transferring the screen scraped data
communications network via the from the processing device to the peripheral device by applying a user action by actuating the
means for communication, wherein actuator to trigger the processing device to transfer the screen scraped data from the processing
the generic communication protocol device to the wireless transceiver of the peripheral device so that the screen scraped data is
is used for transferring the screen transmitted to the communications network via the wireless transceiver.
scraped data from the processing
device to the peripheral device by Routing screen scraped data on the processing device between the processing device and the
applying a user action by actuating communications network via the means for communication:
the actuator to trigger the processing
device to transfer the screen scraped See, e.g.:
data from the processing device to
the wireless transceiver of the
- 11-

peripheral device so that the screen
scraped data is transmitted to the
communications network via the
wireless transceiver.
And see:
And see:
- 12-

[…] wherein the generic communication protocol is used for transferring the screen scraped
data from the processing device to the peripheral device:
See, e.g.,
And see:
5
added).
- 13-

And see:
[…] by applying a user action by actuating the actuator to trigger the processing device to
transfer the screen scraped data from the processing device to the wireless transceiver of the
peripheral device so that the screen scraped data is transmitted to the communications network
via the wireless transceiver.
See, e.g.,
- 14-

And see:
- 15-
EXHIBIT 8
K&L Gates
BY EMAIL to: eric.rusnak@klgates.com

16 April 2019
Our ref: EJW/SA50026.000036
Your ref: Eric C Rusnak
Dear Sirs
Barco NV and Barco Inc.s United States Intellectual Property Rights
Thank you for your letter of 10 April 2019 addressed to Sahara Presentation Systems Inc.
We represent Sahara Presentation Systems Plc.
Sahara Presentation Systems Inc was incorporated in April 2018 and provides an
administration function to Sahara Presentation Systems Plc. Sahara Presentation Systems Inc
does not sell to customers in the United States and the only customer it has is Sahara
Presentation Systems Plc. All sales to customers in the United States are fulfilled by and
invoiced by Sahara Presentation Systems Plc in the UK.
Yours faithfully
Cripps LLP
Cripps LLP is a limited liability partnership registered in England and Wales (number
D +44 (0)1892 506 196 OC311169). Registered office: Number 22, Mount Ephraim, Tunbridge Wells, Kent TN4
T +44 (0)1892 515 121 8AS. Authorised and regulated by the Solicitors Regulation Authority. We use the term
F +44 (0)1892 544 878 ‘partner’ to refer to a member of the LLP or an employee or consultant who is a solicitor
with equivalent standing. A list of the partners and their standing is available on our
E edward.weeks@crippspg.co.uk website or on request. Cripps LLP, a Member Firm of the Marcalliance, AISBL, for Global
DX 3954 Tunbridge Wells Law and Tax Practices. 19899364.1
JS 44 (Rev. 06/17) CIVIL COVER SHEET
The JS 44 civil cover sheet and the information contained herein neither replace nor supplement the filing and service of pleadings or other papers as required by law, except as
provided by local rules of court. This form, approved by the Judicial Conference of the United States in September 1974, is required for the use of the Clerk of Court for the
purpose of initiating the civil docket sheet. (SEE INSTRUCTIONS ON NEXT PAGE OF THIS FORM.)
I. (a) PLAINTIFFS DEFENDANTS

Barco NV and Barco, Inc. Sahara Presentation Systems, Inc. and Sahara Presentation Systems
PLC
(b) County of Residence of First Listed Plaintiff Belgium County of Residence of First Listed Defendant
(EXCEPT IN U.S. PLAINTIFF CASES) (IN U.S. PLAINTIFF CASES ONLY)
NOTE: IN LAND CONDEMNATION CASES, USE THE LOCATION OF
THE TRACT OF LAND INVOLVED.
(c) Attorneys (Firm Name, Address, and Telephone Number) Attorneys (If Known)
K&L Gates LLP
600 N King Street, Suite 901, Wilmington DE 19801
(302) 416-7000
II. BASIS OF JURISDICTION (Place an “X” in One Box Only) III. CITIZENSHIP OF PRINCIPAL PARTIES (Place an “X” in One Box for Plaintiff
(For Diversity Cases Only) and One Box for Defendant)
’ 1 U.S. Government ’ 3 Federal Question PTF DEF PTF DEF
Plaintiff (U.S. Government Not a Party) Citizen of This State ’ 1 ’ 1 Incorporated or Principal Place ’ 4 ’ 4
of Business In This State
’ 2 U.S. Government ’ 4 Diversity Citizen of Another State ’ 2 ’ 2 Incorporated and Principal Place ’ 5 ’ 5
Defendant (Indicate Citizenship of Parties in Item III) of Business In Another State
Citizen or Subject of a ’ 3 ’ 3 Foreign Nation ’ 6 ’ 6

Foreign Country
IV. NATURE OF SUIT (Place an “X” in One Box Only) Click here for: Nature of Suit Code Descriptions.
CONTRACT TORTS FORFEITURE/PENALTY BANKRUPTCY OTHER STATUTES
’ 110 Insurance PERSONAL INJURY PERSONAL INJURY ’ 625 Drug Related Seizure ’ 422 Appeal 28 USC 158 ’ 375 False Claims Act
’ 120 Marine ’ 310 Airplane ’ 365 Personal Injury - of Property 21 USC 881 ’ 423 Withdrawal ’ 376 Qui Tam (31 USC
’ 130 Miller Act ’ 315 Airplane Product Product Liability ’ 690 Other 28 USC 157 3729(a))
’ 140 Negotiable Instrument Liability ’ 367 Health Care/ ’ 400 State Reapportionment
’ 150 Recovery of Overpayment ’ 320 Assault, Libel & Pharmaceutical PROPERTY RIGHTS ’ 410 Antitrust
& Enforcement of Judgment Slander Personal Injury ’ 820 Copyrights ’ 430 Banks and Banking
’ 151 Medicare Act ’ 330 Federal Employers’ Product Liability ’ 830 Patent ’ 450 Commerce
’ 152 Recovery of Defaulted Liability ’ 368 Asbestos Personal ’ 835 Patent - Abbreviated ’ 460 Deportation
Student Loans ’ 340 Marine Injury Product New Drug Application ’ 470 Racketeer Influenced and
(Excludes Veterans) ’ 345 Marine Product Liability ’ 840 Trademark Corrupt Organizations
’ 153 Recovery of Overpayment Liability PERSONAL PROPERTY LABOR SOCIAL SECURITY ’ 480 Consumer Credit
of Veteran’s Benefits ’ 350 Motor Vehicle ’ 370 Other Fraud ’ 710 Fair Labor Standards ’ 861 HIA (1395ff) ’ 490 Cable/Sat TV
’ 160 Stockholders’ Suits ’ 355 Motor Vehicle ’ 371 Truth in Lending Act ’ 862 Black Lung (923) ’ 850 Securities/Commodities/
’ 190 Other Contract Product Liability ’ 380 Other Personal ’ 720 Labor/Management ’ 863 DIWC/DIWW (405(g)) Exchange
’ 195 Contract Product Liability ’ 360 Other Personal Property Damage Relations ’ 864 SSID Title XVI ’ 890 Other Statutory Actions
’ 196 Franchise Injury ’ 385 Property Damage ’ 740 Railway Labor Act ’ 865 RSI (405(g)) ’ 891 Agricultural Acts
’ 362 Personal Injury - Product Liability ’ 751 Family and Medical ’ 893 Environmental Matters
Medical Malpractice Leave Act ’ 895 Freedom of Information
REAL PROPERTY CIVIL RIGHTS PRISONER PETITIONS ’ 790 Other Labor Litigation FEDERAL TAX SUITS Act
’ 210 Land Condemnation ’ 440 Other Civil Rights Habeas Corpus: ’ 791 Employee Retirement ’ 870 Taxes (U.S. Plaintiff ’ 896 Arbitration
’ 220 Foreclosure ’ 441 Voting ’ 463 Alien Detainee Income Security Act or Defendant) ’ 899 Administrative Procedure
’ 230 Rent Lease & Ejectment ’ 442 Employment ’ 510 Motions to Vacate ’ 871 IRS—Third Party Act/Review or Appeal of
’ 240 Torts to Land ’ 443 Housing/ Sentence 26 USC 7609 Agency Decision
’ 245 Tort Product Liability Accommodations ’ 530 General ’ 950 Constitutionality of
’ 290 All Other Real Property ’ 445 Amer. w/Disabilities - ’ 535 Death Penalty IMMIGRATION State Statutes
Employment Other: ’ 462 Naturalization Application
’ 446 Amer. w/Disabilities - ’ 540 Mandamus & Other ’ 465 Other Immigration
Other ’ 550 Civil Rights Actions
’ 448 Education ’ 555 Prison Condition
’ 560 Civil Detainee -
Conditions of
Confinement
V. ORIGIN (Place an “X” in One Box Only)
’ 1 Original ’ 2 Removed from ’ 3 Remanded from ’ 4 Reinstated or ’ 5 Transferred from ’ 6 Multidistrict ’ 8 Multidistrict
Proceeding State Court Appellate Court Reopened Another District Litigation - Litigation -
(specify) Transfer Direct File
Cite the U.S. Civil Statute under which you are filing (Do not cite jurisdictional statutes unless diversity):
35 U.S.C. § 271 et seq.
VI. CAUSE OF ACTION Brief description of cause:
Original Complaint for Patent Infringement
VII. REQUESTED IN ’ CHECK IF THIS IS A CLASS ACTION DEMAND $ CHECK YES only if demanded in complaint:
COMPLAINT: UNDER RULE 23, F.R.Cv.P. JURY DEMAND: ’ Yes ’ No
VIII. RELATED CASE(S)
(See instructions):
IF ANY JUDGE DOCKET NUMBER
DATE SIGNATURE OF ATTORNEY OF RECORD
06/10/2019 /s/ Steven L. Caponi (No. 3484)
FOR OFFICE USE ONLY
RECEIPT # AMOUNT APPLYING IFP JUDGE MAG. JUDGE
Print Save As... Reset

Barco v. Sahara Presentation - Complaint

Hochgeladen von

Dokumentinformationen

Copyright

Verfügbare Formate

Dieses Dokument teilen

Dokument teilen oder einbetten

Freigabeoptionen

Stufen Sie dieses Dokument als nützlich ein?

Sind diese Inhalte unangemessen?

Copyright:

Verfügbare Formate

Barco v. Sahara Presentation - Complaint

Hochgeladen von

Copyright:

Verfügbare Formate

Case 1:19-cv-01071-UNA Document 1 Filed 06/10/19 Page 1 of 18 PageID #: 1

UNITED STATES DISTRICT COURT FOR THE

BARCO NV and BARCO, INC.

Plaintiffs, No. _____

v. JURY TRIAL DEMANDED

SAHARA PRESENTATION SYSTEMS,

ORIGINAL COMPLAINT FOR PATENT INFRINGEMENT

and belief as to the actions of others, as follows:

NATURE OF THE ACTION

and U.S. Patent No. D699,241 (collectively, the “Patents-in-Suit”)

2. Barco seeks injunctive relief as well as damages.

3. Plaintiff Barco NV is a foreign company incorporated under the laws of Belgium

has a principal place of business at 421 McCarthy Blvd, Milpitas, CA 95035.

5. Defendant Sahara Presentation Systems, Inc. is a company incorporated under the

1209 Orange Street, Wilmington DE 19801.

6. On information and belief, Defendant Sahara Presentation Systems PLC (“Sahara

Arm Statute, 10 Del. C. § 3104.

including in this District.

JURISDICTION AND VENUE

insofar as it is incorporated in this District.

United States, including in this District. See Exhibit “8.”

services provided to individuals in this District.

BARCO AND ITS INNOVATIONS

16. Barco has expended tremendous resources developing wireless presentation

technology. Barco’s ClickShare product is a revolutionary wireless presentation and

cables, set-up, or delay.

ideas and build knowledge bases.

favorable press, and enjoyed considerable commercial success.

Barco’s investment in its innovative wireless presentation tools.

attached at Exhibit “1.”

21. The ’348 Patent is presumed valid under 35 U.S.C. § 282(a).

the ’348 Patent.

attached at Exhibit “2.”

24. The ’769 Patent is presumed valid under 35 U.S.C. § 282(a).

the ’769 Patent.

26. On February 9, 2018, an anonymous third party requested reexamination of the

and determined to be patentable. Id.

determined to be patentable. Id.

’769 Patent at 1:25-39).

35. The D’241 Patent is presumed valid under 35 U.S.C. § 282(a).

the D’241 Patent.

computers, and includes exemplary Figure 6 as shown below:

See, e.g., D’241 Patent, Fig. 6.

DEFENDANTS’ INFRINGING ACTIVITY

market for wireless presentation tools in the United States.

ClickShare and other wireless presentation products.

Barco throughout the United States.

THE ACCUSED PRODUCT

(the “Accused Product”).

45. An image of the Clevershare is below:

See id.(rotated from original).

infringement of the Patents-in-Suit.

Integrated Systems Expo in Amsterdam. (See, e.g., https://www.barco.com/en/News/Press-

intellectual property rights.

COUNT I: DEFENDANTS’ INFRINGEMENT OF THE ’348 PATENT

50. Barco incorporates by reference each of its allegations in the foregoing

paragraphs as though set forth fully herein.

by 35 U.S.C. § 271, et seq.

Local Rules in this District.

55. Defendants have additionally indirectly infringed and continue to indirectly

57. As a direct and proximate result of Defendants’ indirect infringement by

59. Defendants have committed these acts of infringement without license or

suffered monetary damages and is entitled to a monetary judgment in an amount at least

adequate to compensate for Defendants’ infringement.