US008527882B2

(12) Ulllted States Patent

Swartz
(54) SYSTEM AND METHOD FOR ICONIC
SOFTWARE ENVIRONMENT MANAGEMENT
.

(10) Patent N0.:

(45) Date of Patent:
5,581,760 A
5,586,237 A

US 8,527,882 B2
Sep. 3, 2013

12/1996 Atkinson et 31.

12/ 1996 Baecker 6t 31

5,657,049 A

8/1997 Ludolph

(75)

Inventor.
.

Gregory J. SWartz, Anthem, AZ (US)

5,671,380 A

5,657,434 A

9/1997 Hidaka
10/1997

8/1997 Yamamoto

(73) Assignees. Gregory J. SWartz, Carmel, IN (US),

5,675,752 A

5,682,536 A

M997 Atkinson et a1
2/1998 Orton et a1.

Scott et a1.

gatalle SW29", Carmel, IN (Us), Legal

epresentatlve

5,689,703 A
5,701,385 A
5,717,877 A

11/1997 Atkinson et a1.

12/ 1997 Katsuyama

(*)

Notice:

Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U_S_C_ 154(1)) by 1020 days'

5,727 ,139 A 5,731,813 A 5,751,286 A

5,761,655 A *

3/1998 Owen 3/1998 oRourke 5/1998 Barber et a1.

6/1998 Hoffman ............................. .. 1/1

(21) App1_ NO; 12/077,106

5,767,860 A
5,821,927 A

6/1998 Zimmer
10/1998 Gong

(22) Filed:
(65)

Mar_ 17,2008
Prior Publication Data

5,894,310 A
5,911,139 A

4/1999 Arisenault
6/1999 Jam et a1.

5,917,499 A
5,973,692 A
5,995,978 A *

6/1999 Jancke
10/1999 Knowlton et al.
11/1999 Cullen et a1. ........................ .. 1/1

US 2008/0201307 A1

Aug. 21, 2008

6,002,401 A
Related U.S.Application Data
6,012,069 A *

12/1999 Baker
715/205
1/2000 Sh'b ak' ........................... .. 1/1

6,009,442 A * 12/1999 Chen et a1. ..

(63)

Continuation-in-part of application No. 09/878,009,

1 a2 1

?led on Jun. 8, 2001, now Pat. No. 7,346,850, which is a continuation of application No. 09/097,283, ?led on
Jun- 12> 1998 HOW abandoned

(Con?rmed)
Primary Examiner * Tadeese Hailu

(51)

Int CL

(74) Attorney, Agent, or Firm * Lesavich High-Tech Law

G06F 3/00
(52) G06F 17/30 US. Cl.
_ _
"" "_ """" "

(200601)
(2006.01)

Group, P.C.; Stephen Lesavich

(57) ABSTRACT

USPC ......... .. 715/738; 715/200; 715/760; 715/764;

_
_

707/706

A system and method for iconic software environment man

(58) glggicof Classl?cat?1n5/s7e3a8rcg00 760 764' 707/706

See apphcanon ?le for Complete Search hlstory'

agement. The system andmethodprovide storing, navigating

and accessing ?les within an operating system on a stand

alone device or on a networked device with internal ?les and

(56)

References Cited
US. PATENT DOCUMENTS 5,375,200 A 12/1994 Dugan et a1.
5,479,599 A 5,479,602 A
5,517,605 A *

external ?les (e.g., from web-sites, etc.) through the use of graphical thumbnail icons representing a graphical display of
a substantial portion of information obtained from within an electronic document.

12/1995 Rockwell et a1. 12/1995 Baecker

5/1996 Wolf ................................... .. 1/1

15 Claims, 24 Drawing Sheets

1700

AN ELEcTRoNIc sEARcH ENGINE QUERY Is sENT To ONE DR MDRE ELECYRONIG sEARcH ENGINES VIA AN APPLIcATIoN DN A NETWORK DEvIcE vIA

coMMuNIcA'noNs NETWORKv wHEREIN THE

sEARcI-I QIIERv INcLuDEs oNE OR MORE 1702

ELEcTRoNIc INFDRMATIDN INCLUDING SEARCH ENGINE quERv REsuLTs Is OBTAINED INCLUDING PLURAL ELEcTRDNIc LINKS TO '\
PLURAL ELEcTRoNIc FILEs ON DNE OR MDRE 1704

SERVERS ON THE DoMMuNIcATIoNs NErwoRK

ONE OR MDRE ELECTRONIC FILE ARE ACCESSED VIA AN ELECTRONIC LINK INCLUDED

IN THE sEARcH ENGINE auERv RESULTS

",5

A eRAPI-IIcAL THUMDNAIL IcoN Is CREATED FoR EAcH OF AccEssED ELEcTRDNIc FILEs, THE sRAPHIcAL THUMENAII. ICON suEsTANTIALLv DEFICTING AT LEAST A PORTION OF THE
coLLEcTED INFORMATION FRDM THE AccEssED 11!

ELEcTRoNIc FILE

THE aRAPHIcAL THuMaNAIL IcoNs ARE DIsPLAvED IN A GRAPHIOAL wINDow ON A

GRAPHICAL U5ER INTERFACE. WI-IEREIN SELECTING THE GRAPHIDAL THUMBNAIL ICON ALLows CONTENT8 OF AN ELEKrrRoNIc FILE TO "1
BE DETERMINED wITHouT RE-AccEssING THE ELEcTRcNIc FILE VIA THE coMNIuNIcATIoNs

US 8,527,882 B2
Page 2

(56)
6,012,072 6,020,920 6,026,433 6,035,323 6,052,750 6,097,389 6,097,390 6,133,914 6,154,755 6,154,771 6,243,724 6,275,829 6,314,406 7,086,011 7,254,772 D550,683 7,324,071 7,346,850
A
A *

References Cited U.S. PATENT DOCUMENTS

1/2000 Lucas
2/ 2000 Anderson ............ ..

A *
A *

2/2000 DArlach et al.

3/2000
8/2000

348/2221 709/217

2006/0212561 2007/0273550 2008/0046369 2008/0046437 2008/0046471 2008/0052162 2008/0052343

A1 A1 A1 A1 A1 A1 A1

Narayen et al. ...... .. """ " 709/201

Morris et al. ........ .. """ " 715/804

2008/0062126 A1

A
A *

4/2000 Lea

2008/0098301 A1
2008/0108456 A1

A
A *

8/2000 Marks
10/2000 Rogers et al. ......... ..

2008/0114480 A1

A *
A *

11/2000
11/2000

Dellert et al. ..

312%;

2008/0114664 A1
2008/0126178 A1

Rangan et al. ........ .. H 709/217

B1
B1 *

6/2001 Mander
8/2001 Angiulo et al. ....... .. ............ ,, 1/1

2008/0177994 A1
2008/0194928 A1

B1 B2
B2

11/2001 OHagan 8/2006 Budrys

8/2007 Penke

S B2

9/2007 Wang 1/2008 Carpinelli

3/2008 Swartz 10/ 2001 Martin

2008/0195664 2008/0198925 2008/0200154 2008/0201225 2008/0201386

A1 A1 A1 A1 A1

9/2006 11/2007 2/2008 2/2008 2/2008 2/2008 2/2008 3/2008 4/2008 5/2008 5/2008 5/2008 5/2008 7/2008 8/2008 8/2008 8/2008 8/2008 8/2008 8/2008

Feng
Price et al. Wood Wood Moore et al. Wood Wood

Algreatly
Black et al. Bonito Harb Harb Moore

Mayer
Bandic

Maharajh et al.

Sayre
Maharajh et al. Maharajh et al. Maharajh et al.

B2 2001/0033639 A1

* cited by examiner

US. Patent

Sep. 3, 2013

Sheet 1 0f 24

US 8,527,882 B2

FIG. 1

m2

US. Patent

Sep. 3, 2013

Sheet 2 0f 24

US 8,527,882 B2

w;

1.

US. Patent

Sep. 3, 2013

Sheet 3 0f 24

US 8,527,882 B2

FIG. 3
3%

393

Mum

US. Patent

Sep. 3, 2013

Sheet 4 0f 24

US 8,527,882 B2

FIG. 4
40!

& Processor Word

00w
Occument Path,
Downent Handle

02

Application Path, App?cation Handle

Document Path. Document Handle

Application Path.
Application Handie
I

\ Database Program
FIHA

'
I

Documenl Path,
\ Document Handle Application Path,
App?caiion Handte
402

Drawing ) Program
I

\ Spreadsheet Program

US. Patent

Sep. 3, 2013

Sheet 5 0f 24

US 8,527,882 B2

FIG. 5
\ Word
Processor
Transfer Screen

Capture Image

406
0

\ Document Handle
Application Path,

Document Path,

Application Handle
Document Path.

Document Handle

Appticatlon Path,
App?catian Handle

Document Path,
Document Handle

Application Path, Application Handte

US. Patent

Sep. 3, 2013

Sheet 6 0f 24

US 8,527,882 B2

FIG. 6
p
301 [113C]

401 \ Processor "In?d

us 8"

o3 \
Undaae Lag PM
Document Path,
Dccument Handle

App?cation Path,
Application Handle
Dbwment Path. Document Handle

App?cation Path.
Appi'zcation Handle

Document Path, Document Handle

App?cation Path, Application Handle

US. Patent

Sep. 3, 2013

Sheet 7 0f 24

US 8,527,882 B2

FIG. 7

?cblvouge gomlwmo

y/ 7000

i
F iie Access Tracking Moduie begins f 7001
to track aii information on

opened, saved or closed ?les

l
User cpens a ?ie or saves a / newly created ?le in any program v

7002

7003

User presses keyboard but key /

to activate the capture sequence

i
Screen capture of the currently active
?ie is copied onto the topmost position of the Snapshot Navigator Menu

f 7004

1
User retrieves files by placing 7005

the mouse cursor over the screen

capture image(on the Snapshot Navigator

Menu) of the file they wish to access

l
User presses the mouse buttc? and f 7 the retrieve sequence is activated

User saves File Snapshot List. At! the File Snapshots f 7007
and the information on their associated application path and filename path are saved to disk.

US. Patent

Sep. 3, 2013

Sheet 8 0f 24

US 8,527,882 B2

FIG. 8A
Qser Presses Capture Hot-W $009
7

Get Application handle to the f 8001

current active applica'xion
v

Get the application ?lename

that corresponds to xhe current

f80D2

active app?cation handle

l
is this handle the
same handle as the interface ~ the present inventi v

8004

Determine if this ac?ve applicalion f

has an ac?ve chiid qocument

Can Screen Capture routine to

capture the ciieni area of the active

windaw (MD!) or the application itself, if no MD! support and Store in Memory

' ass Application

have a. Muitiple Document

interface?

US. Patent

Sep. 3, 2013

Sheet 9 0f 24

US 8,527,882 B2

FIG. 8B

Set search position at f

top of Snapshot List
Yes
Is it at the bottom of the
. apshot Li

8007

8008

Search ?le access tracking log file for the f 6009

first instance of current document handle, increment and save array position
B010
' cos the handle

correspond to the
- . ument filena -

Y Yes

801 1
I oes the application

handle for this array position

. orrespond to the applicatio

If we did not fnd tho application handle or application

8013

?lename on the running list then Add the application f handle and application ?lename to the
Snapshot Navigator Menu as a new File Snapshot
V

8014

Update File Snapshot information

US. Patent

Sep. 3, 2013

Sheet 10 0f 24

US 8,527,882 B2

FIG. 8C

Set search position at f 8015 top of snapshot list

8016

Search ?le tracking access lcg ?le

for ?rst instance of current active

I 8017

application handle, increment

and save array position
8018 No

Does the handle

correspond tn the
licaticn ?lenama

Does document

lfwe did not ?nd the application handle or application tilename on the running list then add the application handle and application tilename to the Snapshnt
Navigator Menu as a new File Snapshot
4

> Update File Snapshot information

US. Patent

Sep. 3, 2013

Sheet 11 0124

US 8,527,882 B2

FIG. 9A

I a /w Retrieve File
r
User clicks on ?le snapshul

f 9CO1

l
Retrieve array position of slide list
Is this an Yes

f 9002
I 9003

MD! ?le

US. Patent

Sep. 3, 2013

Sheet 12 0f 24

US 8,527,882 B2

FIG. 9B

ls ?lename active in
t 8 access tracking 1 -

9005

is application
handta va?d

9006

Does application
handle eon'aspcnd to
lication Fllenam

+f 9007
_ _

Launch Appltcatton
+, 900a

9011
7 f
Make the application associated with
this ?le in the log active

Update application handle I

in the File Snapshot

Launch Oocument

Update document handle f

in the File Snapshot

90 2

Update slide list with current f

File Snapshot at the top
V

9013

Return

US. Patent

Sep. 3, 2013

Sheet 13 or 24

US 8,527,882 B2

FIG. 9C

9014

ls application
handio valid

Yes

Search active windows for

running application ?lenamc

Get its appiica?on ham?e and update File Snapshot Information

Make application active

Application

Sit idle until the application f 9023 has completely apened

Update Application 8
document information

in His Snapshot

US. Patent

Sep. 3, 2013

Sheet 14 0f 24

US 8,527,882 B2

FIG. 9D

15 Document
hanrile valid

Make document f 9027

handle active

Does dccumem

handie correspond to
- ocument ?lenam

Make document active

4
Update document
handle for File Snapshot

f 9039

Q7

US. Patent

Sep. 3, 2013

Sheet 15 0f 24

US 8,527,882 B2

FIG. 9E

Search monitor log for f 9032

active document ?lename

was document ?lename found in tile

ccess tracking I . -

Get its document handle / 9034

and update Fiie Snapshot

4
Make document active /

9635

Update document handle f 9065

for ?le Snapshot

US. Patent

Sep. 3, 2013

Sheet 16 0f 24

US 8,527,882 B2

FIG. 9F

Yes

Is domeru ?te open in any

other appdication

Launch Document

N0 r9911
9040 Store app?calicn Handle. Filename,
document handle. document ?lename

Update dowmem handle for File Snapshot

, 1;______

into ?le access tracking Log

Ignore attempt
to launch document

Hr 9042

Update slide list with current

dowment a! the top

f9043

US. Patent

Sep. 3, 2013

Sheet 17 0f 24

US 8,527,882 B2

FIG. 10
Sit Idle until File gets opened and
noti?cation is sent from Fife system H Y
7

-/a 00
'
1 0001

{ 615573524 Hawk. 'ra'hseq' Neath/Program M

Get the Appfication Hand's to the f 1COD2 prcgrarn that accessed the me

$ Get the Application Fttename associated

with the program handle that messed the ?le

/ 10603
10004

apptication Filename match

resent lnven ?

Does the

No

Get the dowment ?lenatna tmm the f10OG5

Fita Systam Hack

+
Get the document handle through the patent application (if one exists) f 10035 assodated with the me that get opened

Check each entry in the log to seeitit has been f x08

subctassed and if nut we need 10 subclass it
Y

Subclass the appticaticn handta and document handle (it one exists - MD!) / 10009

(as thatwbenevet it is dosed out tt is mmcved from the list)

Y

If the applicattcn is a nun MOS. saarch the tog for any occurrence of bath f 10010 application Handle and application Fila?ame that era itientical to newly openedlsaved slide and desttoy that entry
v

Add the application handle, application Btename, document handle f11 I

(if one exists). document ?tertame to the tagging ?le on the hard dtive

4
Sit idle anti! :5 ?ie gets accessed or a handle

10012

(appticztien or document) that has been

subdassed has been 'dosed

US. Patent

Sep. 3, 2013

Sheet 18 0f 24

US 8,527,882 B2

FIG. 11
File access tracking
initiates this kernel

11001

when a handle is closed the handle f 003 value is passed to this function

Remove it from me subclass / 004

list since it is no longer valid

11005
Does this handle
- ve a parent hand =

Yes

f 110%

v N / 11 Remove the entire set of informa?on {or that me tncgudg?g

Remove from the HD the information 7 ONLY the dowmem inducing

Appnca?on Fnename' Applka?on Handle. Document File Name. and Document handle, from the H!) v

Document Fllename, and Document Handle. Leave the Application lnfo alone 1007 v f Search the entire list for any

Maggie, handlesand remove

them based on app?catlon handle only

. Seam the enl|re list for any

1 109

slraggler handles and remove .

them basadon?lenameonly

Check each epplicatlon handle 1010 to see if its valid in memot'y f1

and remove any invalid ones

Sit tdle until File gets accessed or a handle

on

(application or document) that has been subclassed has been closed