Beruflich Dokumente
Kultur Dokumente
ASDC3I
A Conceptual Framework
for
Network Centric Warfare
Workshop on Network Centric Warfare
and
Network Enabled Capabilities
December 17-19, 2002
Ongoing Research Sponsored by OFT and ASD(C3I)
RAND
EBR
OFT
ASDC3I
Agenda
Informing Transformation
The NCW Framework Initiative
The NCW Framework
Elements of the Force
NCW Measures, Attributes, and Metrics
Case Study: Air-to-Air Combat
Summary and Next Steps
RAND
8/3/2004 Slide 2
EBR
OFT
ASDC3I
Informing Transformation
8/3/2004 Slide 3
EBR
OFT
ASDC3I
RAND
8/3/2004 Slide 4
EBR
OFT
ASDC3I
NCW
Focused
Research
Methodology
Enterprise
Applications
NCW Theory
(Hypotheses)
NCW
Knowledge
Base
Conceptual
Framework
Analysis
Experiments
Exercises
Case Studies
T & E
Etc.
Metrics
Relationships
NCW
Focused
Experiments
Awareness
Education
Consulting
RAND
8/3/2004 Slide 5
EBR
OFT
ASDC3I
8/3/2004 Slide 6
EBR
OFT
ASDC3I
Process for
Exploiting
Awareness
Info structure
Sensor Netting
Data Fusion
Information Management
Information
Sources
Value Added
Services
Force
C2
Degree of Networking
Quality of Organic
Information
Virtual Collaboration
Virtual Organizations
Substitution of Info. for
People and Material
Self - Synchronization
Increased Tempo
Increased Responsiveness
Lower Risks
Lower Costs
Higher Profits
Centric Enterprise
Effectors
Physical Domain
Information Domain
Cognitive Domain
Social Domain
RAND
8/3/2004 Slide 7
EBR
OFT
ASDC3I
Information
Sources
Value Added
Services
Force
C2
Effectors
Degree of Networking
Quality of Organic
Information
EBR
OFT
ASDC3I
Information Domain
where information is created, manipulated and shared
Cognitive Domain
where perceptions, awareness, beliefs, and values reside
and where, as a result of sensemaking, decisions are made
Social Domain
where force entities interact
RAND
8/3/2004 Slide 9
EBR
OFT
ASDC3I
Information
Sources
Value Added
Services
Force
C2
Effectors
Degree of Networking
Quality of Organic
Information
Physical Domain
Information Domain
Operating Environments
Cognitive Domain
Social Domain
RAND
EBR
OFT
ASDC3I
Force
Key Elements: Nodes and Networks
Sensors
Command & Control
Networks
Effectors (Shooters)
People
RAND
8/3/2004 Slide 11
EBR
OFT
ASDC3I
Force
Measures for Key Elements
Mission
Capability
Packages
Elements
(Network,
Nodes)
Information
Sources
Measures
Phenomenology
Coverage
Persistence
Performance
Agility
RAND
Roles/
Functions
(Exogenous
to the NCW
framework)
8/3/2004 Slide 12
Value added
Services
Service
Capability
Capacity
Quality of Service
Agility
C2
Embedded in
the NCW
conceptual
framework
Effectors
Effects
Coverage
Persistence
Survivability
Agility
EBR
OFT
ASDC3I
Information Sources
C2
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
Effectors
Degree of Networking
Network
Reach
Capacity
Quality of Service
Connectivity
P&R Capability Support
Network Assurance
Collaboration Support
Network Agility
Node Assurance
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
RAND
8/3/2004 Slide 13
Degree of Information
Share-ability
Quantity of Posted Info
Quality
of
Interactions
EBR
OFT
ASDC3I
Degree of Networking:
Network
The extent to which force entities are interconnected
Attribute
Definition
Reach
Quality of Service
Network Assurance
Network Agility
RAND
8/3/2004 Slide 14
EBR
OFT
ASDC3I
Degree of Networking:
Network
The extent to which force entities are interconnected
Attribute
Metrics
Reach
Quality of Service
RAND
8/3/2004 Slide 15
EBR
OFT
ASDC3I
Degree of Networking:
Network Agility
Attribute
Metrics
Robustness
Innovativeness
Adaptiveness
RAND
8/3/2004 Slide 16
EBR
OFT
ASDC3I
Quality of Interactions
Depth
Quality of Individual Information
Fitness for Use
Objective Measures
Completeness
Correctness
Consistency
Currency
Precision
Accuracy
Relevance
Timeliness
Quantity
Quality
Breadth
Reach
Selectivity
Intensity
Continuity
Individual Characteristics
Risk Prop
Competence
Organizational Characteristics
Completeness
Risk Prop
Competence
Trust
Confidence
Size
Hardness
Diversity
Permanence
Autonomy
Structure
Accuracy
Consistency
Relevance
Currency
Timeliness
Precision
Uncertainty
8/3/2004 Slide 17
Interdepend
Organizational & Individual
Behavior
Cooperation
Efficiency
Synchronization
Engagement
Completeness
Correctness
Accuracy
Consistency
Relevance
Currency
Timeliness
Confidence
Quality
Precision
Trust
Org. Ident
RAND
Extent
Latency
Synchronicity
Mode
Agility
Robustness
Flexible
Response
Innovative
Adaptability
Objective Measures
T vs. T
Completeness
Consistency
Accuracy
Currency
Timeliness
Precision
Uncertainty
EBR
Quality of Interactions:
OFT
ASDC3I
Quality of Interactions
Depth
Breadth
Intensity
Agility
Individual
Characteristics
Risk Propensity
Competence
Trust
Organizational Identification
Confidence
RAND
8/3/2004 Slide 18
Organizational and
Individual Behaviors
Cooperation
Efficiency
Synchronization
Engagement
Team vs. Task Balance
Organizational
Characteristics
Risk Propensity
Competence
Trust
Confidence
More ..
EBR
Quality of Interactions
OFT
ASDC3I
Definition
Depth
Breadth
Selectivity
Intensity
Continuity
Synchronicity
Mode
Latency
RAND
The quality of information, awareness, understandings, and/or decisions that are the focus
of the interactions
Measures that describe the force entities that interact
Reach
Agility
The quantity of information, awareness, understandings, and/or decisions that are the
focus of interactions
8/3/2004 Slide 19
EBR
OFT
ASDC3I
RAND
8/3/2004 Slide 20
EBR
OFT
ASDC3I
Attribute
Definition
Objective Measures
Extent
Proportion of awareness in common across force entities, within and across communities
of interest (CoI)
Proportion of force entities that share a given awareness
RAND
8/3/2004 Slide 21
EBR
OFT
ASDC3I
Completeness
Correctness
Accuracy
Consistency
Relevance
Currency
Timeliness
Precision
Uncertainty
Completeness
Accuracy
Relevance
Timeliness
Robustness
Flexibility
Responsiveness
Innovativeness
Uncertainty
Mode of D. M.
RAND
Adaptability
Risk Propensity
8/3/2004 Slide 22
Quality of Interactions
Quantity
Quality
Depth
Breadth
Reach
Selectivity
Intensity
Continuity
Latency
Synchronicity
Mode
Agility
Robustness
Flexible
Response
Innovative
Adaptability
Completeness
Consistency
Accuracy
Currency
Timeliness
Precision
Uncertainty
Individual Characteristics
Risk Prop
Competence
Correctness
Trust
Consistency
Accuracy
Currency
Timeliness
Precision
Uncertainty
Org. Ident
Confidence
Organizational Characteristics
Risk Prop
Competence
Trust
Confidence
Size
Hardness
Diversity
Permanence
Autonomy
Structure
Interdepend
Organizational & Individual
Behavior
Cooperation
Efficiency
Synchronization
Engage
T vs. T
Completeness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
Uncertainty
Mode of D. M.
Robustness
Flexibility
Responsiveness
Innovativeness
Adaptability
Risk Propensity
EBR
OFT
ASDC3I
Attribute
Definition
Objective Measures
Extent to which decisions are in agreement across force entities, within and across CoI
Currency
Precision
Appropriateness
Extent to which decisions are consistent with existing shared understanding, command intent and shared team values
Completeness
Accuracy
Relevance
Proportion decisions that are important to the accomplishment of the task at hand
Timeliness
Uncertainty
Risk Propensity
RAND
Type of collaborative decision making structure utilized (authoritative decision making, consensus building, majority rule,
etc.)
8/3/2004 Slide 23
EBR
OFT
ASDC3I
Attribute
Definition
Agility
Robustness
Flexibility
Responsiveness
Innovativeness
Adaptability
RAND
8/3/2004 Slide 24
EBR
OFT
ASDC3I
Accuracy
Currency
Robustness
Extent
Consistency
Quality
of Interactions
Flexibility
Currency
Relevance
Precision
Responsiveness
Precision
Timeliness
Completeness
Accuracy
Relevance
Flexibility
Responsiveness
Timeliness
Innovativeness
Innovativeness
Uncertainty
Mode of D. M.
Robustness
Uncertainty
Risk Propensity
Adaptability
Mode of D. M.
Risk Propensity
Adaptability
Synchronized Entities
Operating Environments
RAND
8/3/2004 Slide 25
Agility
Timeliness
Efficiency
EBR
OFT
ASDC3I
RAND
8/3/2004 Slide 26
EBR
OFT
ASDC3I
Definition
Achievement of
Objectives
Agility
Time
Efficiency
RAND
8/3/2004 Slide 27
EBR
OFT
ASDC3I
Value Added
Services
Force
C2
Effectors
Degree of Networking
Quality of Organic
Information
Parts of framework
for which attributes
and metrics have
been developed
Parts of framework for
which attributes have
been developed
Operating Environments
RAND
EBR
OFT
ASDC3I
Survivability
Are vulnerability and potential degradation of networked forces adequately
accounted for in the framework?
Synchronization
Should this measure explicitly account for asynchronization?
Coherence
Should this be a separate measure? If so, how does it relate to
synchronization?
Force Cohesion
Is this an important indicator of mission success? How does it relate to
degree of interaction?
RAND
8/3/2004 Slide 29
EBR
OFT
ASDC3I
Integration
Should this be an explicit measure?
How does it relate to degree of interaction?
Agility
Is this measure adequately represented in the framework?
Should it be more systemic?
Operating Environment
Is its relationship to other measures proper?
What are the appropriate attributes?
RAND
8/3/2004 Slide 30
EBR
OFT
ASDC3I
Agenda
Informing Transformation
The NCW Framework Initiative
The NCW Framework
Elements of the Force
NCW Measures, Attributes and Metrics
Case Study: Air-to-Air Combat
Summary and Next Steps
RAND
8/3/2004 Slide 31
EBR
OFT
ASDC3I
8/3/2004 Slide 32
3.10
3.62
Voice + Link 16
8.11
9.40
EBR
OFT
ASDC3I
Blue11, 12
Red 3, 4
AWACS
Blue13, 14
RAND
8/3/2004 Slide 33
EBR
OFT
ASDC3I
Information
Sources
Value Added
Services
Force
C2
Effectors
Degree of Networking
Quality of Organic
Information
Parts of Framework
for which reasonable
data is available
Operating Environments
Parts of Framework
for which data is
currently unavailable
8/3/2004 Slide 34
EBR
OFT
ASDC3I
Mission
Capability
Packages
Elements
(Network,
Nodes)
Roles
Force
Voice Only
Voice + Link 16
(MCP #1)
(MCP #2)
AWACS
Information
Sources
Functions
Detect/
ID targets
Relevant
Attributes
Coverage
Persistence
Performance
RAND
8/3/2004 Slide 35
Voice Network
Data +Network
Value added
Services
C2
Fuse data
Assign aircraft to
ID info
targets
Distribute Info. Coordinate
engagements
Capability
Capacity
Quality of Service
Embedded in
the NCW
conceptual
framework
Air Craft
Effectors
Kill Targets
Target Destruction
EBR
OFT
ASDC3I
Information Sources
C2
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Effectors
Degree of Networking
Network
Reach
Quality of Service
Connectivity
Network Assurance
Timeliness
Collaboration Support
Network Agility
Node Assurance
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
RAND
8/3/2004 Slide 36
Degree of Information
Share-ability
Quality
of
Interactions
EBR
OFT
ASDC3I
AWACs
AMTI radar
IFFN
NCTR#1
Etc.
Exogenous variables
Environmental
conditions
Doctrine
Sensor coverage
- Field of regard
- Instantaneous field of view
- Area coverage rate
- Revisit rate
(e.g. AWACS 10 sec scan)
- Range
Probability of detection
-Fn of RCS
-Fn of doppler
Probability of false alarm
Probability of classification
Sighting location error
Sighting velocity error
Radar processor track precision
f()
RAND
8/3/2004 Slide 37
Blue12
Blue11
AMTI radar
IFFN
NCTR#1
Etc.
AMTI radar
IFFN
NCTR#1
Etc.
Blue14
Blue13
AMTI radar
IFFN
NCTR#1
Etc.
AMTI radar
IFFN
NCTR#1
Etc.
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
EBR
OFT
ASDC3I
Threat Tracks
Blue11, 12
0.75
0.5
0.25
0
Q 1T Q 2T Q 3T Q 4T
1
0.75
0.5
0.25
0.25
Q 1T Q 2T Q 3T Q 4T
Blue13, 14
0
Q 1T Q
Q 1T Completeness: Detection
Q
RAND
T
2
Correctness: ID
8/3/2004 Slide 38
T
2
Q 3T Q
T
4
T
3
Correctness: Location
T
4
Correctness: Velocity
EBR
OFT
ASDC3I
Degree of
Information
Share-ability
Degree of
Networking
0.28 *
Quality of
Organic Info
1.0
Kill Ratio
(Synchronization / Effectiveness)
* Voice
* Voice + Link 16
RAND
8/3/2004 Slide 39
Degree of Shared
Information
Quality of
Individual
Sensemaking
Quality of
Individual
Decisions
OFT
ASDC3I
Quality of Individual
Information
Degree of Shared
Information
0.91
1.0
0.4
Degree of 1.0
Networking
0.5
0.08
0.22
0.91
0.45
0.28
0.45
3.10:1
1.0
Quality of
Individual
Sensemaking
0.91
Quality of
8.11:1
Quality of
Individual
Organic Info
Decisions
Kill Ratio
(Synchronization / Effectiveness)
* Voice
* Voice + Link 16
RAND
8/3/2004 Slide 40
OFT
ASDC3I
Hypotheses:
Information sharing via Voice + Link 16 leads to less time necessary to gather critical
information, which results in more time available for flight lead to develop sensemaking
and make decisions
Information sharing via Voice + Link 16 leads to less time necessary for wingman to
gather and monitor critical information, which results in opportunities for wingman to
spend time sensemaking and making decisions
B11 (Flight lead)
Information
Voice Only
Link-16 +Voice
Awareness
Understanding
Decisions
Decisions
B12 (Wingman)
Information
Voice Only
Link-16 +Voice
RAND
Awareness
Decisions
Time
8/3/2004 Slide 41
EBR
OFT
ASDC3I
Time
RAND
8/3/2004 Slide 42
Wingman
EBR
OFT
ASDC3I
8/3/2004 Slide 43
EBR
OFT
ASDC3I
Agenda
Informing Transformation
The NCW Framework Initiative
The NCW Framework
Elements of the Force
NCW Measures, Attributes and Metrics
Case Study: Air-to-Air Combat
Summary and Next Steps
RAND
8/3/2004 Slide 44
EBR
OFT
ASDC3I
8/3/2004 Slide 45
EBR
OFT
ASDC3I
Closing Thoughts
RAND
8/3/2004 Slide 46
EBR
OFT
ASDC3I
Information Sources
C2
Effectors
Degree of Networking
Network
Reach
One military vocoder channel
Assumed to be 100% in a
benign environment
Exogenous variables:
Nodes: AWACS, F-15s
Types: 4 red tracks, 5 blue
tracks, etc.
CONOPS, coding schemes,
governing how to speak
track info
Red tracks have priorities,
but two strike packages
must know each others
positions
Track info expires after
ten seconds
RAND
8/3/2004 Slide 47
Quality of Service
Connectivity
Network Assurance
Network Agility
Node Assurance
Degree of Information
Share-ability
f()
!General
Link 16
EBR
OFT
ASDC3I
Information Sources
C2
Effectors
Degree of Networking
Network
Exogenous variables:
Nodes: AWACS, F-15s
Types: 4 red tracks, 5 blue
tracks, etc.
CONOPS, coding schemes,
governing how to speak
track info
Red tracks have priorities,
but two strike packages
must know each others
positions
Track info expires after
ten seconds
RAND
Reach
Quality of Service
Connectivity
Assumed to be 100% in a
benign environment
Network Assurance
8/3/2004 Slide 48
Collaboration Support
Network Agility
Node Assurance
Degree of Information
Share-ability
f()
EBR
OFT
ASDC3I
Exogenous variables:
Number of nodes
File sizes and number of
files
Variables impacting how
quickly nodes can transmit
pieces of information
(CONOPS, coding schemes,
etc.)
Policies determining
priority for posting
Expiration age for each
type of info objects
Maximum queue lengths
C2
Effectors
Degree of Networking
Network
Reach
Quality of Service
Connectivity
Network Assurance
Collaboration Support
Network Agility
Node Assurance
f(): Vector for number of info objects that can be posted, by object type
Phase 1. For each type of info object do:
If nodes can post object, do 2. Else, Num(type) = 0
Use QoS parameters, network agility parameters, and exo variables to
determine rate at which nodes can post info items of that type. Multiply this
rate by probability of correct transmission, yielding theoretical transmission
rate.
Phase 2.
Use theoretical rates for each info type plus priority policies to determine what
fractions of postings will be of each info type.
Multiply fractions of postings times theoretical rates times expiration age to
get Num(type) for each info type.
RAND
8/3/2004 Slide 49
!General
Degree of Information
Share-ability
Quantity of Posted Info
Quantity of Retrievable Info
Ease of Use
EBR
OFT
ASDC3I
Exogenous variables:
Nodes: AWACS, F-15s
Types: 4 red tracks, 5 blue
tracks, etc.
CONOPS, coding schemes,
governing how to speak
track info
Red tracks have priorities,
but two strike packages
must know each others
positions
Track info expires after
ten seconds
C2
Degree of Networking
Network
Reach
One military vocoder channel
Assumed to be 100% in a
benign environment
Quality of Service
Connectivity
Network Assurance
f(): Vector for number of info objects that can be posted, by object type
Phase 1. For each type of info object do:
AWACS, F-15s can post (do 2)
Using AF CONOPS and coding standards, AC can transmit three tracks every
ten seconds on a military coding voice channel. In this scenario, this rate is
unaffected by network assurance considerations.
Phase 2.
Using AF priority policies, on average each 10-sec interval has two red tracks
and one blue track.
Since each track lasts for ten seconds, at most an average of two red tracks
and one blue track can be posted at any time.
RAND
Effectors
8/3/2004 Slide 50
Collaboration Support
Vector for number of info objects that
Networkf():
Agility
can be retrieved, by object type
Node Assurance
70% of voice tracks are audible,
so metric
is 0.7*Quantity of Posted Info
!Voice
Degree of Information
Share-ability
Quantity of Posted Info
Quantity of Retrievable Info
Ease of Use
EBR
OFT
ASDC3I
Exogenous variables:
Nodes: AWACS, F-15s
Types: 4 red tracks, 5 blue
tracks, etc.
CONOPS, coding schemes,
governing how to speak
track info
Red tracks have priorities,
but two strike packages
must know each others
positions
Track info expires after
ten seconds
C2
Effectors
Degree of Networking
Network
Reach
Quality of Service
Connectivity
Assumed to be 100% in a
benign environment
Network Assurance
Collaboration Support
Network Agility
Node Assurance
F(): Vector for number of info objects that can be posted, by object type
Phase 1. For each type of info object, do:
All tracks can be posted at least every second, so no priority policies apply.
Info on all tracks can be updated every second, so info on all nine tracks can
be posted at any given time.
Degree of Information
Share-ability
Quantity of Posted Info
Quantity of Retrievable Info
Ease of Use
RAND
8/3/2004 Slide 51
!Link 16
EBR
OFT
ASDC3I
Exogenous variables:
Track, capability, intent
information, all in
standard formats
No fusion performed
Pilots will use organic
information in preference
to radio-reported
information
Pilots have sufficient
training to use radio
Correctness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
f()
Correctness
Completeness
Degree of Information
Share-ability
Accuracy
Consistency
Relevance
Currency
Timeliness
Ease of Use
Precision
RAND
8/3/2004 Slide 52
!General
Link 16
EBR
OFT
ASDC3I
Correctness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
f()
Correctness
Completeness
Degree of Information
Share-ability
Accuracy
Consistency
Relevance
Currency
Timeliness
Ease of Use
Precision
RAND
8/3/2004 Slide 53
!General
Voice
EBR
OFT
ASDC3I
Exogenous variables:
Types of information
Fusion performed on the
information, and quality
of this process
Training to use retrieve
and present information
Objective Measures
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
Quality of
Organic
Information
Degree of
Information
Share-ability
Ease of Use
F(): Correctness of information object
RAND
8/3/2004 Slide 54
Objective Measures
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
!General
Quality of
Individual
Information
EBR
OFT
ASDC3I
Exogenous variables:
Track, capability, intent
information, all in
standard formats
No fusion performed
Pilots will use organic
information in preference
to radio-reported
information
Pilots have sufficient
training to use radio
Objective Measures
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
RAND
8/3/2004 Slide 55
Quality of
Organic
Information
Degree of
Information
Share-ability
Ease of Use
Objective Measures
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
!Voice
Quality of
Individual
Information
EBR
OFT
ASDC3I
Exogenous variables:
Track, capability, intent
information, all in
standard formats
Fusion consolidates blue
tracks only
Pilots will use F-15 radar
information in preference
to AWACS information
Pilots have sufficient
training to use Link 16
display and radio
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
RAND
Objective Measures
8/3/2004 Slide 56
Quality of
Organic
Information
Degree of
Information
Share-ability
Ease of Use
Objective Measures
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
!Link 16
Quality of
Individual
Information
EBR
OFT
ASDC3I
Detailed Function
Quality of Interactions
Depth
Quantity
Quality
Breadth
Selectivity
Intensity
Continuity
Latency
Whether
sender can
communicate
info with
receiver
Whether
information can
be physically
shared across
network
Reach
Synchronicity
Mode
Agility
Robustness
Flexible
Response
Innovative
Adaptability
Whether sender
and receiver are
part of the same
collaborative
group
Quality
Individual Characteristics
Risk Prop
Competence
Trust
Org. Ident
Confidence
Organizational Characteristics
Risk Prop
Competence
Trust
Confidence
Size
Hardness
Diversity
Permanence
Autonomy
Structure
Number of communications
hops between sender and
receiver
Interdepend
Organizational & Ind. Behavior
Cooperation
Efficiency
Syn
Deg. Of Eng
RAND
f()
Correctness
Completeness
Consistency
Accuracy
Currency
Timeliness
Precision
Uncertainty
T vs. T
8/3/2004 Slide 57
!General
EBR
OFT
ASDC3I
Depth
Completeness
Correctness
Quantity
Breadth
Reach
Selectivity
Intensity
Continuity
Latency
Accuracy
Consistency
Relevance
Currency
Timeliness
Precision
Uncertainty
F():
Completeness
Robustness
Currency
Accuracy
Flexibility
Precision
Relevance
Responsiveness
Timeliness
Mode of D. M.
RAND
Uncertainty
Innovativeness
Adaptability
Risk Propensity
8/3/2004 Slide 58
Exogenous variables:
Synchronicity
Mode
training, experience, etc.
Agility
Robustness
Flexible
Response
Timeliness of Sensemaking / Decision Making
Innovative is shared
Adaptability
information
among all participants, less time is spent gathering
If
f()
and validating
information,
improving
the
timeliness
of sensemaking and
Individual Characteristics
Risk
Prop
Competence
decision making
Trust
Real time interactions
result in more efficient use of time, improving the
Whether the focus of
Org. Ident
Confidenceand decision making
timeliness
of sensemaking
interactions is on information
Flexible
command
structures allow force members to make decisions with
Organizational
Characteristics
gathering and validation or
fewerRisk
requirements,
shortening
decision-making
times
Prop
Competence
sensemaking/decision making
Whether all relevant members
Trust
Confidence
are participating
Size
Hardness
Whether the intensity of the
Diversity
Permanence
interactions matches the
Autonomy
Structure
requirements of the mission
Interdepend
Organizational & Ind. Behavior
Cooperation
Efficiency
Synchronization
T vs. T
Engagement
!General
EBR
OFT
ASDC3I
Depth
Completeness
Correctness
Quantity
Relevance
Currency
Timeliness
Precision
Uncertainty
Consistency
Completeness
Robustness
Currency
Accuracy
Flexibility
Precision
Relevance
Responsiveness
Mode of D. M.
RAND
Uncertainty
Innovativeness
Adaptability
Risk Propensity
8/3/2004 Slide 59
Ease of Use
Synchronicity
Mode
Agility
Robustness
Flexible
Response
F(): Timeliness of Sensemaking /
InnovativespendAdaptability
Participants
most of their time
Timeliness
Breadth
Reach
Selectivity
Intensity
Continuity
Latency
Accuracy
Consistency
Exogenous variables:
training, experience, etc.
Decision Making
Structure
Interdepend
Organizational & Ind. Behavior
Cooperation
Efficiency
Synchronization
T vs. T
Engagement
!General
EBR
OFT
ASDC3I
Depth
Completeness
Correctness
Quantity
Breadth
Reach
Selectivity
Intensity
Continuity
Latency
Accuracy
Consistency
Relevance
Currency
Timeliness
Precision
Uncertainty
Completeness
Robustness
Currency
Accuracy
Flexibility
Precision
Relevance
Responsiveness
RAND
Uncertainty
Innovativeness
Adaptability
Risk Propensity
8/3/2004 Slide 60
Ease of Use
f()
Consistency
Mode of D. M.
Exogenous variables:
Synchronicity
Mode
training, experience, etc.
Agility
Robustness
Flexible
Response
F(): Timeliness of Sensemaking / Decision Making
Innovativeautomatically
Adaptability
Participants
receive all relevant information available from
Timeliness
AWACS
and other
blue AC radars, so pilots incur no delays by
Individual
Characteristics
Risk
Prop
Competence
communicating this information verbally
Near-real timeTrust
visual information displays are much faster than voice
Whether the focus of
Org. Ident
Confidence
transmissions
interactions is on information
Flexible
command
structures allow pilots to engage targets, and support
Organizational
Characteristics
gathering and validation or
engaging
pilots,
directly.
(Commanders
only intervene when necessary.)
Risk Prop
Competence
sensemaking/decision making
The number of participants
Trust
Confidence
Whether the intensity of the
Size
Hardness
interactions matches the
Diversity
Permanence
requirements of the mission
Autonomy
Structure
Interdepend
Organizational & Ind. Behavior
Cooperation
Efficiency
Synchronization
T vs. T
Engagement
!General
EBR
OFT
ASDC3I
DEFINITIONS OF ATTRIBUTES
RAND
8/3/2004 Slide 61
EBR
OFT
ASDC3I
Metrics
(Click Here)
Attribute
Definition
Objective Measures
8/3/2004 Slide 62
EBR
OFT
ASDC3I
Metrics
(Click Here)
Attribute
Definition
Quantity of Posted
Information
Quantity of
Retrievable
Information
Ease of Use
RAND
8/3/2004 Slide 63
EBR
OFT
ASDC3I
Metrics
(Click Here)
Attribute
Definition
Objective Measures
8/3/2004 Slide 64
EBR
OFT
ASDC3I
RAND
8/3/2004 Slide 65
EBR
OFT
ASDC3I
Metrics
(Click Here)
Attribute
Definition
Objective Measures
8/3/2004 Slide 66
EBR
OFT
ASDC3I
Metrics
(Click Here)
Attribute
Definition
Objective Measures
Correctness
Consistency
Currency
Precision
Completeness
Accuracy
Relevance
Timeliness
Uncertainty
RAND
8/3/2004 Slide 67
EBR
OFT
ASDC3I
Attribute
Definition
Objective Measures
Consistency
Precision
Appropriateness
Completeness
Accuracy
Relevance
Timeliness
Uncertainty
Risk Propensity
Mode of Decision Making
RAND
Extent to which decisions are internally consistent with prior understanding and decisions
Currency
Attribute Summary
(Click Here)
8/3/2004 Slide 68
EBR
OFT
ASDC3I
Attribute
Definition
Attribute Summary
(Click Here)
Agility
Robustness
Flexibility
Responsiveness
RAND
Innovativeness
Degree to which decision reflects novel ways to perform known tasks and/or develops
new ways of doing novel tasks
Adaptability
Degree to which decision facilitates force entities ability to alter the decision, decision
making participants and/or decision making process and implement appropriate
modifications
8/3/2004 Slide 69
EBR
OFT
ASDC3I
Quality of Interactions:
Definitions and Explanations
Contributing attributes
Individual Characteristics: risk propensity, competence, trust, organizational
identification, confidence
Organizational Characteristics: risk propensity, competence, trust, confidence,
size, hardness, diversity, permanence, autonomy, structure, interdependence
Organizational & Individual Behaviors: cooperation, efficiency
synchronization, engagement, team vs. task balance
RAND
8/3/2004 Slide 70
EBR
OFT
ASDC3I
Quality of Interactions
Attributes
Definitions
Risk Propensity
Competence
Trust
Organizational
Identification
Confidence
RAND
8/3/2004 Slide 71
EBR
Quality of Interactions
OFT
ASDC3I
Attributes
Definitions
Risk Propensity
Competence
Trust
Confidence
Size
Hardness
Degree to which team members have interacted in the past on the same task
Diversity
Permanence
Autonomy
Structure
Interdependence
RAND
Extent to which members depend on one another for resources (materials, KSAAs,
etc.)
EBR
8/3/2004 Slide 72
OFT
ASDC3I
Quality of Interactions
Contributing Attributes:
Organizational and Individual Behaviors
Attribute Summary
(Click Here)
Attributes
Definitions
Cooperation
Efficiency
Synchronization
Engagement
Extent to which efforts are directed to organizational issues vs. relating to the
objective
RAND
8/3/2004 Slide 73
EBR
OFT
ASDC3I
Attribute
Definition
Objective Measures
Extent
Correctness
Consistency
Currency
Precision
Quality
RAND
Accuracy
Relevance
Timeliness
8/3/2004 Slide 74
EBR
OFT
ASDC3I
Attribute
Definition
Objective Measures
Extent
Correctness
Consistency
Currency
Precision
Quality
Relevance
Timeliness
Uncertainty
RAND
8/3/2004 Slide 75
EBR
OFT
ASDC3I
DEFINITION OF METRICS
RAND
8/3/2004 Slide 76
EBR
OFT
ASDC3I
Definitions
(Click Here)
Attribute
Metrics
Objective Measures
Correctness
Consistency
Currency
Age of information
Precision
Completeness
Accuracy
Relevance
Timeliness
RAND
Degree to which currency matches what is needed (0=no match, 10=high degree of
matching between currency level needed and available)
EBR
8/3/2004 Slide 77
OFT
ASDC3I
Definitions
(Click Here)
Attribute
Metrics
Quantity of Posted
Information
Quantity of
Retrievable
Information
Ease of Use
RAND
8/3/2004 Slide 78
EBR
OFT
ASDC3I
Definitions
(Click Here)
Attribute
Metrics
Objective Measures
Correctness
Consistency
Currency
Age of information
Precision
Completeness
Accuracy
RAND
Relevance
Timeliness
Degree to which currency matches what is needed (0=no match, 10=high degree of
matching between currency level needed and available)
8/3/2004 Slide 79
EBR
OFT
ASDC3I
Definitions
(Click Here)
Attribute
Metrics
Objective Measures
Correctness
Consistency
Currency
Precision
Completeness
Accuracy
Degree to which precision matches what is needed (0=no match, 10=high degree of
matching between precision level needed and available)
Relevance
Timeliness
Degree to which currency matches what is needed (0=no match, 10=high degree of
matching between currency level needed and available)
Uncertainty
RAND
Confidence level (0% =uncertain, 100%= certain) or confidence interval (95%, 90%, etc.)
of awareness
8/3/2004 Slide 80
EBR
OFT
ASDC3I
Definitions
(Click Here)
Attribute
Metrics
Objective Measures
Correctness
Consistency
Currency
Precision
Completeness
Accuracy
RAND
Relevance
Timeliness
Degree to which currency matches what is needed (0=no match, 10=high degree of
matching between currency level needed and available)
Uncertainty
Confidence level (0% =uncertain, 100%= certain) or confidence interval (95%, 90%,
etc.) of awareness
8/3/2004 Slide 81
EBR
OFT
ASDC3I
NCW
Focused
Research
Methodology
Enterprise
Applications
NCW Theory
(Hypotheses)
NCW
Knowledge
Base
Analysis
Experiments
Exercises
Case Studies
T & E
Etc.
Conceptual
Framework
Metrics
Relationships
NCW
Focused
Experiments
Awareness
Education
Consulting
RAND
8/3/2004 Slide 83
EBR
OFT
ASDC3I
8/3/2004 Slide 84
EBR
OFT
ASDC3I
Objectives
Gain insight into how NCW is a new source of power in
Air-to-Air combat
Illuminate contribution of enabling capabilities in the NCW
value chain
Identify areas where data is needed
Assess utility of framework and identify needed
improvements
Approach
Start with data from the JTIDS Operational Special Project
Apply NCW Framework to instantiate influence model
Capitalize on additional data and impute missing data
Identify sources of improved combat power
RAND
8/3/2004 Slide 85
EBR
OFT
ASDC3I
RAND
8/3/2004 Slide 86
EBR
OFT
ASDC3I
Information
Sources
Value Added
Services
Force
C2
Effectors
Degree of Networking
Quality of Organic
Information
8/3/2004 Slide 87
EBR
OFT
ASDC3I
Blue11, 12
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
Q 1B Q 2B Q 3B Q 4B
1
0.75
0.5
Q 1B Q 2B Q 3B Q 4B
RAND
Blue13, 14
0.25
0
Q 1B Q 2B Q 3B Q 4B
Q2B: Correctness: ID
8/3/2004 Slide 88
EBR
Influence of Networking on
Information Share-ability
OFT
ASDC3I
Force
Information. Sources
C2
Effectors
Degree of Networking
Objective Measures
Network
Correctness
Completeness
Reach
Accuracy
Quality of Service
Connectivity
Consistency
Currency
Relevance
Network Assurance
Precision
Timeliness
Network Agility
Capacity
Collaboration Support
Node Assurance
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
RAND
8/3/2004 Slide 89
Degree of Information
Share-ability
Quality
of
Interactions
EBR
OFT
ASDC3I
C2
Effectors
Degree of Networking
Network
Exogenous variables:
Number of nodes
Number and size of files
Variables that impact how
quickly nodes can transmit
(CONOPS, coding schemes,
etc.)
Policies determining
priority for posting
Expiration age for each
type of info objects
Maximum queue lengths
RAND
Reach
Quality of Service
Connectivity
Network Assurance
8/3/2004 Slide 90
Collaboration Support
Network Agility
Node Assurance
Degree of Information
Share-ability
f()
Voice Only
Link 16
EBR
OFT
ASDC3I
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
Q 1T Q 2T Q 3T Q 4T
Q 1T Q 2T Q 3T Q 4T
Q 1T Q 2T Q 3T Q 4T
RAND
Threat Tracks
Blue Tracks
Threat Tracks
1
0.75
0.5
0.25
0
Link 16 + Voice
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
AWACS
Q 1B Q 2B Q 3B Q 4B
Blue 11 & 12
Q 1B Q 2B Q 3B Q 4B
Blue 13 & 14
Q 1B Q 2B Q 3B Q 4B
Q 1 Completeness: Detection
Q 2 Correctness: ID
8/3/2004 Slide 91
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
Q 1T Q 2T Q 3T Q 4T
Q 1T Q 2T Q 3T Q 4T
Q 1T Q 2T Q 3T Q 4T
Q 3 Correctness: Location
Q 4 Correctness: Velocity
Blue Tracks
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
Q 1B Q 2B Q 3B Q 4B
Q 1B Q 2B Q 3B Q 4B
Q 1B Q 2B Q 3B Q 4B
EBR
OFT
ASDC3I
Quality of Individual
Information
Degree of Shared
Information
0.08
Degree of 1.0
Networking
Quality of
Individual
Sensemaking
0.5
0.28
Quality of
Organic Info
Quality of
Individual
Decisions
Kill Ratio
(Synchronization / Effectiveness)
* Voice
* Voice + Link 16
RAND
8/3/2004 Slide 92
OFT
ASDC3I
Objective Measures
Network
Correctness
Completeness
Reach
Accuracy
Quality of Service
Connectivity
Consistency
Currency
Relevance
Network Assurance
Precision
Timeliness
Network Agility
Capacity
Collaboration Support
Node Assurance
Correctness
Completeness
Consistency
Accuracy
Currency
Relevance
Precision
Timeliness
RAND
8/3/2004 Slide 93
Degree of Information
Share-ability
Quality
of
Interactions
EBR
OFT
ASDC3I
Correctness of organic
information
Correctness
Consistency
Accuracy
Currency
Relevance
Exogenous variables:
Fusion
Training
Precision
Timeliness
f()
Correctness
Completeness
Degree of Information
Share-ability
Accuracy
Consistency
Relevance
Currency
Timeliness
Ease of Use
Precision
RAND
8/3/2004 Slide 94
Voice Only
Link 16
EBR
OFT
ASDC3I
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
Q 1T Q 2T Q 3T Q 4T
Q 1T Q 2T Q 3T Q 4T
Q 1T Q 2T Q 3T Q 4T
RAND
Threat Tracks
Blue Tracks
Threat Tracks
1
0.75
0.5
0.25
0
Link 16 + Voice
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
AWACS
Q 1B Q 2B Q 3B Q 4B
Blue 11 & 12
Q 1B Q 2B Q 3B Q 4B
Blue 13 & 14
Q 1B Q 2B Q 3B Q 4B
Q 1 Completeness: Detection
Q 2 Correctness: ID
8/3/2004 Slide 95
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
Q 1T Q 2T Q 3T Q 4T
Q 1T Q 2T Q 3T Q 4T
Q 1T Q 2T Q 3T Q 4T
Q 3 Correctness: Location
Q 4 Correctness: Velocity
Blue Tracks
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
1
0.75
0.5
0.25
0
Q 1B Q 2B Q 3B Q 4B
Q 1B Q 2B Q 3B Q 4B
Q 1B Q 2B Q 3B Q 4B
EBR
OFT
ASDC3I
Degree of
Information
Share-ability 1.0
Quality of Individual
Information
0.91
Degree of Shared
Information
0.4
Degree of 1.0
Networking
0.5
0.08
0.28
Quality of
Individual
Sensemaking
Quality of
Quality of
Individual
Organic Info
Decisions
Kill Ratio
(Synchronization / Effectiveness)
* Voice
* Voice + Link 16
RAND
8/3/2004 Slide 96
OFT
ASDC3I
Quality of Interactions
Quality of Individual Information
Fitness for Use
Objective Measures
Completeness
Correctness
Consistency
Currency
Precision
Accuracy
Relevance
Timeliness
Objective Measures
Correctness
Consistency
Relevance
Currency
Timeliness
Precision
Uncertainty
RAND
8/3/2004 Slide 97
Depth
Quantity
Quality
Breadth
Selectivity
Intensity
Latency
Continuity
Reach
Mode
Synchroniety
Agility
Flexible
Robustness
Response
Adaptability
Innovative
Individual Characteristics
Risk Prop
Competence
Trust
Confidence
Org. Ident
Organizational Characteristics
Quality
Completeness
Correctness
Accuracy
Consistency
Relevance
Currency
Timeliness
Precision
Risk Prop
Competence
Extent
Trust
Confidence
Quality
Size
Hardness
Permanence
Diversity
Autonomy
Structure
Interdependence
Organizational & Ind. Behavior
Efficiency
Cooperation
Synchronization
T vs. T
Deg. Of Eng
Correctness
Completeness
Consistency
Accuracy
Currency
Timeliness
Precision
Uncertainty
EBR
OFT
ASDC3I
Quality of Interactions
Depth
Quantity
Quality
Breadth
Reach
Selectivity
Intensity
Continuity
Latency
Synchronicity
Mode
Agility
Robustness
Flexible
Response
Innovative
Adaptability
Whether
sender can
communicate
info with
receiver
Whether sender
and receiver are
part of the same
collaborative
group
Whether
information can
be physically
shared across
network
f()
Quality
Completeness
Individual Characteristics
Risk Prop
Competence
Correctness
Trust
Consistency
Org. Ident
Accuracy
Confidence
Organizational Characteristics
Risk Prop
Competence
Trust
Confidence
Size
Hardness
Diversity
Permanence
Autonomy
Structure
Number of communications
hops between sender and
receiver
Interdepend
Organizational &Individual
Behavior
Cooperation
Efficiency
Syn
Deg. Of Eng
RAND
Relevance
Currency
Timeliness
Precision
Correctness
Completeness
Consistency
Accuracy
Currency
Timeliness
Precision
Uncertainty
T vs. T
8/3/2004 Slide 98
EBR
OFT
ASDC3I
Voice + Link 16
Threat Tracks
Threat Tracks
0.75
0.75
0.5
0.5
0.25
0.25
Q 1T
Q 2T
Q 3T
Q 4T
Blue Tracks
1
0.75
0.75
0.5
0.5
0.25
0.25
Q 1T
Q 2T
Q 3T
Q 1 Completeness: Detection
Q 2 Correctness: ID
8/3/2004 Slide 99
Q 4T
Q 1T Q 2T Q 3T Q 4T
Blue Tracks
RAND
Voice Only
Q 1T Q 2T Q 3T Q 4T
Q 3 Correctness: Location
Q 4 Correctness: Velocity
EBR
OFT
ASDC3I
Quality of Individual
Information
Degree of Shared
Information
0.91
1.0
0.4
Degree of 1.0
Networking
Quality of
Organic Info
0.5
0.08
Quality of
Individual
Sensemaking
0.22
0.28
Quality of
Individual
Decisions
Kill Ratio
(Synchronization / Effectiveness)
* Voice
* Voice + Link 16
RAND
Q of Posted Info
Completeness
Accuracy
Relevance
Timeliness
Uncertainty
RAND
Quality of Interactions
Depth
Quantity
Quality
Breadth
Distance
Selectivity
Intensity
Continuity
Latency
Synchronicity
Mode
Agility
Robustness
Flexible
Response
Innovative
Adaptability
Q of Retrievable Info
Ease of Use
Completeness
Consistency
Accuracy
Currency
Timeliness
Precision
Uncertainty
Quality
Completeness
Individual Characteristics
Risk Prop
Competence
Consistency
Accuracy
Trust
Currency
Timeliness
Precision
Uncertainty
Org. Ident
Confidence
Organizational Characteristics
Risk Prop
Competence
Trust
Confidence
Size
Hardness
Extent
Diversity
Permanence
Consistency
Completeness
Autonomy
Structure
Currency
Accuracy
Interdepend
Organizational & Ind. Behavior
Cooperation
Efficiency
Precision
Relevance
Syn
Mode of D. M.
Deg. Of Eng
T vs. T
Timeliness
Uncertainty
Robustness
Flexibility
Responsiveness
Innovativeness
Adaptability
EBR
OFT
ASDC3I
Depth
Completeness
Correctness
Quantity
Relevance
Currency
Timeliness
Precision
Org. Ident
Robustness
Currency
Accuracy
Flexibility
Precision
Relevance
Responsiveness
RAND
Innovativeness
Adaptability
Confidence
Organizational Characteristics
Completeness
Risk Propensity
f()
f()
Trust
Consistency
Uncertainty
Exogenous variables:
training, experience, etc.
Individual Characteristics
Risk Prop
Competence
Mode of D. M.
Ease of Use
Synchronicity
Mode
Agility
Robustness
Flexible
Response
Innovative
Adaptability
Uncertainty
Timeliness
Breadth
Reach
Selectivity
Intensity
Continuity
Latency
Accuracy
Consistency
Risk Prop
Competence
Trust
Confidence
Size
Hardness
Diversity
Permanence
Autonomy
Structure
Interdepend
Organizational & Ind. Behavior
Cooperation
Efficiency
Synchronization
T vs. T
Engagement
Voice Only
Link 16
EBR
OFT
ASDC3I
Quality of Individual
Information
Degree of Shared
Information
0.91
1.0
0.4
Degree of 1.0
Networking
0.5
0.08
0.22
0.91
0.45
0.28
0.45
Quality of
Individual
Sensemaking
0.91
Quality of
Individual
Decisions
Kill Ratio
(Synchronization / Effectiveness)
Quality of
Organic Info
* Voice
* Voice + Link 16
RAND
OFT
ASDC3I
Consistency
Extent
Completeness
Currency
Consistency
Quality
of Interactions
Accuracy
Currency
Precision
Relevance
Precision
Timeliness
Mode of D. M.
Agility
Robustness
Completeness
Accuracy
Flexibility
Responsiveness
Relevance
Innovativeness
Timeliness
Uncertainty
Mode of D. M.
Uncertainty
Adaptability
Synchronized Entities
Operating Environments
RAND
Agility
Timeliness
Efficiency
EBR
OFT
ASDC3I
Information
Sources
Major Products
Value Added
Services
Force
C2
Effectors
Degree of Networking
Quality of Organic
Information
Physical Domain
Information Domain
Operating Environments
Cognitive Domain
Social Domain
Degree of
Information
Share-ability1.0
Quality of Individual
Information
Degree of Shared
Information
0.91
1.0
0.4
Degree of 1.0
Networking
0.5
0.08
0.22
0.91
0.45
0.28
0.45
3.10:1
1.0
Quality of
Individual
Sensemaking
0.91
Quality of
8.11:1
Quality of
Individual
Organic Info
Decisions
Kill Ratio
(Synchronization / Effectiveness)
RAND
EBR
OFT
ASDC3I
Accomplishments
Sensemaking
Social domain
Quantitative metrics
Operational application
RAND
EBR
Degree of Networking:
OFT
ASDC3I
Attribute
Definition
Capacity
Ability of the node to exchange and use data (incorporates data exchange rate,
CPU, memory, disk storage, etc.)
Connectivity
Posting and
Degree to which node has the ability to post and retrieve information in
Retrieving Capability desired formats and places
Support
Collaboration
Support
Node Assurance
RAND
EBR
Degree of Networking:
OFT
ASDC3I
Attribute
Metrics
Capacity
Largest bandwidth the node can access (56K bps, 1.5Mbps, etc.)
Connectivity
Posting and
Retrieving
Capability Support
Collaboration
Support
Node Assurance
RAND
EBR