Beruflich Dokumente
Kultur Dokumente
In The Brain
Do We Live in our Brain's
Simulation of the World?
By David Hawkins
introcouldhave
beentakenfromthebackofascifinovel.It
didn'tseemlikeacompatibletitlefora
respectedsciencepublication,butthenagain,
truthisoftenstrangerthanfiction.Thiswasn't
anextgenerationvirtualreality(VR)demoa
triponpsilocybin.Thiswas
real.
PierreMgevandandhiscolleaguesattheFeinsteinInstituteforMedicalResearchin
Manhasset,NewYork,wantedtopinpointtheareainthebrainwhichprocesseslocationsand
places.Theyscannedthebrainofavolunteerwhileshowingimagesofvariousobjectsand
scenes,thenrecordedthecorrespondingareasofthebrainthatlitup.Theyhadfoundtheir
itch,nowitwastimetoscratch.Theresearcherssimulatedthearea,andthat'swhena
complexvisualhallucinationtransportedthevolunteerbacktoworkatthepizzeria.
Stimulationofanearbyareasummonedthehallucinationofastaircaseandablueclosetin
hishome.Repeatedstimulationofthesameareasbroughtaboutthesamehallucinations.
Theseillusorysimulationsofthemindarehelpingscientiststoidentifythephysiologyofvisual
informationinthebrain,andonadeeperlevel,understandwhat
reality
reallyis.Naturehas
givenusourveryowninternalVRheadset,andithasitsowncoordinatesbetweentheears.
Wethinktheworldweexperienceisexternal,outside,
real
,butthesestudiessuggest
otherwise.Exceptionallyhere,manisplaying'God'manipulatingnormality.Complexvirtual
realityisbroughtaboutonlythroughtargetedstimulationofthebrain.Butitturnsoutthatthe
fencebetween
virtual
realityandrealityisnarrowerandmorericketythanwebelieve.
Inthebook,
Hallucinations,
neurologistOliverSackswalksusthroughmanysurrealcasesof
visualphenomenahe'shadwithpatients.InonecasewelearnofRosalie
,aresidentatone
ofthenursinghomesheworksat.Inhernineties,shehadrecentlystartedtosee"incredibly
realhallucinations",andSackshadbeencontactedtodeducetheemergency.More
surprisingly,however,shewas
completelyblind
.AsshestoodinfrontofDr.Sacksatthe
home,sheclaimedinfacttobehavinghallucinationsrightthen.
"Whatsortofthings?"Sacksasked.
"PeopleinEasterndress!"shebellowed.
Rosaliewasexperiencingwhat'sknownas
CharlesBonnetsyndrome
(CBS),acondition
originallyusedtodescribeanyhallucinationsrelatedtoeyediseaseorotherocularproblems,
butwhichhasnowcometoencompassneurologicalaspectsofhallucinationaswell.CBS
occursinpeoplewithimpairedvisiontheconsequenceofwhenasustainedlackoflight
passingthroughtheeyescausesthevisualcentresofthebraintoweighmoreheavilyon
visualmemory.
ThevastmajorityofpeoplewithCBS,including
Rosalie,areabletodisassociatereallifefrom
hallucination.Indeed,thegreatestreliefoften
comeswiththeabilitytoputalabelof
sanity
to
personalaccusationsof
insanity
.Wereitnotfor
thisawarenessasisthecaseinsomeCBS
patientsinternalprojectionswouldunnervingly
becomepartofthe
believed
externalrealityaline
beyondwhichmakesansweringthequestionof
whatrealityis,evenmoredifficult.Wewinduplike
thecharactersinChristopherNolan's2010film
Inception
,whoaren'tabletodistinguishbetween
dreamsandreality.
Butbeforeyoucountyourluckyblessings,ifyou'veeverthoughtyou'dseenaghostora
personyouknow,onlytolookandrealiseyouwerewrong,thenyouhavebeenatthe
receivingendofyourmind'sprojections.Theonlydifferencehere,isthatyou'reableto
reframetheerrorafterwards.Ineffect,youhaveatotemthatstopsspinning
.
Forthosewithpooreyesight,
having
hallucinationsturnsouttobetheruleratherthanthe
exception.Ifeyesightisevenmoderatelyblurry,onedoesnotneedtogetone'sbrain'zapped'
inordertoexperienceinternalprojections.Sackssharesanexperimentconductedin1999:
"RobertTeunisseandhiscolleagues,studyingapopulationofnearlysixhundredelderly
patientswithvisualproblemsinHolland,foundthatalmost15percentofthemhadcomplex
hallucinationsofpeople,animals,orscenesand
asmanyas80percenthadsimple
hallucinations
shapesandcolors,sometimespatterns,butnotformedimagesorscenes."
(Emphasismine.)
Withoutforcefulstimulation,you'renotlikelytofindyourselfatwork(Godforbid).But
simple
hallucinationsarefarmorecommonthanreportedinanyonewithlessthanperfectvision.You
andIarewiredtosee.Andinthecaseofhallucinations,whenourvisualsystemsarenot
adequatelystimulated,aportionorallofthevisualfieldbecomesconcoctedby[the]brain
ormind."
Lessapparenthere,isthathallucinationisalsoaconsequenceofsocialstigma,
helpingtoexplainitsperceivedscarcity.("Mum,IthinkGrannyhasfinallylosthermarbles.")
Although,asSacksdoesnote,there
are
manyculturesaroundtheworldwhocelebrate
hallucinationparticularlythoseofshamanicdescent
Theseexamplesdemonstratethatoursanity,whichI'lldefinehereastheabilitytoperceive
andliveinaunanimouslycoherentfashion,isapreciousstateofmindindeed.Awelltargeted
brainzap,theremovaloflighttotheeyeforanextendedperiodoftime,anditbecomesclear
thatexternalrealitydoesn'texist
only
externally.
WHAT IS REALITY?
Whatisreality?15seconds,apparently.
Moretothepointthe
previous
15secondsofthis
verymoment.It'santheorythatwascoinedinearly
2014asthe'continuityfield'thediscoverythatwe
seemtomergetogethersimilarschemataseen
withintheprevious15secondtimeframe.
VisionscientistandassociateprofessorofpsychologyatUCBerkeley,DavidWhitney,
explainsinaninterview:"Thecontinuityfieldsmootheswhatwouldotherwisebeajittery
perceptionofobjectfeaturesovertime."
Withoutavisualsystemtorecalibratethecurrent
sceneforwhatwealreadyknowandbelieve,dailylifewouldbemorelikeanoverwhelmingly,
"jarringacidtrip"
.(Aconcreteexampleofthisprocessinactionisourtendencytomiss
continuityerrorsinfilms
.)Morepertinently,it'salsohypothesizedthatthis15seconddelay
actually
shields
usfromhallucinogenicexperiencesbystabilisingtheincomingflowofvisual
information
,whichinvitesthequestionofwhetherhallucinogenicdrugsdisruptthisfunction
inparticular.
"Psychiatricpatientssometimeshavedelusivebeliefs,asiftheyareinanalternativereality,
andschizophrenicsmayalsoexperienceperceptualhallucinationsliterallyseeingthings
thatarenotthere,"saysKeisukeSuzukiinTheGuardian
.He'stheleadauthorofapaper
describing
TheSubstitutionalReality
system
(SR),developedbyresearchersattheRIKEN
BrainScienceInstitute'sLaboratoryforAdaptiveIntelligence.
"Ourmotivationistoexplorethecognitivemechanismsunderlyingourstrongconvictionin
reality.Howcanpeopletrustwhattheyperceive?"Suzukiasks.TheSRsystemhasbeen
developedtomanipulatehealthy"participants'perceptionofreality",andcouldbecomea
importanttoolinunderstandingthecapacitytodiscernbetweensimulationsofthebrainand
objectiverealityparticularlyinpsychiatricconditionssuchasschizophrenia.
Inanexperimentdesignedaroundthistechnology,aparticipantsatinaroomwearingaVR
headsetsimilartothe
OculusRift
.Theywerethenplayedalternatelyliveandrecorded
footageofasimilarsceneatdifferenttimestoseeiftheynoticedachange.Critically,the
majority
ofparticipantsfailedtodistinguishbetweenwhatwasreal(live)andwhatwasnot
(recorded).Perfectlynormal,healthyindividualswereunabletoreframetheerrorafterthe
fact.
Thistime,thetotemkeptonspinning
Tounderstandwhythisis,itwillhelpifwe
drawapictureofhowvisualinformationis
handledonceinsidethebrain.Inthe
illuminatingbook
PhantomsoftheBrain
,
neuroscientistV.S.Ramachandran
revealsthatwithinthebrain,thereare
overthirtydifferentmapsconcernedwith
visionalone.[Likewisefortactileor
somaticsensationstouch,jointand
musclesense]."
Itsthesemapswhich
simulate
thehumanbodyinaphysicalspace.Everypartofthebodyis
plottedinacorrespondingmapwithinthebrain,andcategorisedbypart.Thebodymapfor
handsliesnexttothebodymapforthefaceandupperarmgenetaliasitsnexttothefeet
.
Thefinitesizeofthesemaps(evenwiththeincreasedsurfaceareafrombeingscrunchedup
withintheskull)limittheamountofinformationwhichcanbeprocessedandstoredfromthe
outsideworld.
Youmightalmostimagineacollectionof
scrunchedup
worldmapsforeachbodypart,
juxtaposedtoeachotherinanarrowschoollocker.Withatouchonthebodyaforearm,
indexfinger,thelowerbackasmalllightisseenappearingatdifferentpointsonthemapsto
representthefiringofassociatedclustersofnervecells.(Inneuropathologies,suchasaftera
stroke,atouchofthefacecanbeexperiencedinthehandanorgasmcanbeexperiencedin
thefoot
.)Giventhebrain'scomparativelysmallsizeagainsttheinformationoverloadof
objectivereality,itmightbesaidthatevolutionhasmadeanextremelysmartcompromise
internally,sothatwecangoaboutourlivesinacoherentfashion.
,
concentratinglimitedresourcesonthenarrowwindowofobjectiverealitythatisthefocal
crosshairofourdirectgazethewordyou'relookingatrightnowthroughyourfoveaasmall
depressionintheretinaofyoureyewherevisualacuityishighest.Thismodestfeedisthen
heavilyaugmentedthoughmemorisedexperience,alathecontinuityfield.(Incidentally,this
necessary
augmentation
toourconsciouslivesmayexplainthemysteryofchildhood
amnesia,whichistheinabilitytorecallexperiencebeforetheageof3.Onlyimplicitmemories
canbeformedbeforethisperiod
.Afoundational,'continuityfield'maybeneededfor
experiencetobecoherentenoughtobecomeconscious.)
Significantly,however,this
peripheral
blur
hasnecessitatedanextrasensitive'dangertrigger',
ensuringthatanypossiblethreatisbroughtintofocuswithaturnofthehead,orashiftingof
theeyes
.Allthingsconsidered,itisaneffectiveadaptationformaximisingcoherenceand
survivabilityinauniverseincomprehensibletoa"threepoundmassofjelly"(as
Ramachandranhasbeenknowntocallit).
Historically,thisadaptationmighthaveproduceda,"couldthatbeasabretoothedtigerinthe
bush?"aswewalkdownthepath.Inthemodernworld,though,we'remorelikelytogetthe
chronic
dangertrigger:"Isthatwar6,000kmawayapossiblethreattome?"Worryingly,our
bestresponsetoremediatethisinflamedtriggertodayseemstobethroughapathy,
medicationorboth
.(Althoughsomemighthavereducedtheproblemsomewhatwitha
smart
lowinformation
diet
.)Apathyandmedicationaresurfacelevelresponses,however.
Lessapparentisanotherofnature'singeniousadaptationstoresolvingthecognitive
dissonanceofthisgreatuncertainty:givetheconsciousmindthe
impression
thatit
is
getting
thefullpicture
Theoverwhelmingblurinour
perceptuallivesis
filtered
forthe
consciousmindtobeasconcreteas
thewordyou'renowlookingat.This
adaptationhasassistedusincoping
withthechaoticuncertaintyweface
everyday.
Afascinatingpsychopathology,anosognosia,isanextremeexampleofthismechanicgone
wrong.Alsoin
PhantomsoftheBrain
:
Anosognosiaisanextraordinarysyndromeaboutwhichalmostnothingisknown.Thepatient
isobviouslysaneinmostrespectsyetclaimstoseeherlifelesslimbspringinginto
actionclappingortouchingmynoseandfailstorealizetheabsurdityofitall."
ConsiderthecaseofMrsDodds
,whohadbeenleftcompletelyparalyzedontheleftsideof
herbodyafterastroke:
Ramachandran:Mrs.Dodds,canyoutouchmynosewithyourrighthand?"
Shedidsowithnotrouble.
Ramachandran:"Canyoutouchmynosewithyourlefthand?"
Herhandlayparalyzedinfrontofher.
Ramachandran:"Mrs.Dodds,areyoutouchingmynose?"
MrsDodds:"Yes,ofcourseI'mtouchingyournose."
Thediscrepancybetweentheinternalmapsofrealityandtheexternalfeedofferarare
glimpseintothemind'scompulsiontocreatecoherenceintheworld.AsRamachandran
notes,theoddbehaviorofthesepatientscanhelpussolvethemysteryofhowvariousparts
ofthebraincreateausefulrepresentationoftheexternalworldandgeneratetheillusionofa
"self"thatenduresinspaceandtime."
Oflargerconsequenceperhaps,thisnaturallimitationhasledtoasystemicfalseconfidence,
producingcompletelyunreasonableeconomicgamblesinmodernsociety
.Arbitrarily,we've
beenmakingconfidentdecisionsontheassumptionthatwe'regetting100%ofthepicture,
butreallygettingjust10%ofthepicturewith90%peripheralblur.
Moreaccurately,formerchiefengineerforSunMicrosystemsMichaelDeeringpublished
researchin1998,findingthat,"acrosstheentirevisualfield,thehumanvisualsystemcan
perceiveapproximatelyonlyonefifteenththevisualdetailthatwouldbediscernibleiffoveal
resolutionswereavailablefortheentirefield."
Inhumans,thefovearepresentsahigh
resolutionbutverynarrowfieldofviewabout12degrees.Forthisreason,theeyesdart
aroundsimultaneouslyalasaccades,focusingonnovelandmemorydirectedstimuliof
interestwiththeeyesthroughthevestibuloocularreflex(VOR)andforminga
threedimensionalmapinthebrainwithanemphasisonthe
novel
and
interesting
.Again,this
istoconserveresources.Wefavourthecontextualgestaltoveraccurateminutiae.(To
demonstratethefallibilityofthissystemandtheroleofmemory,considerthemysterious
Spelunker'sillusionthe'confident'beliefthatonecan
see
theirownhandsincomplete
darkness,yetatthesametimenotthehandsofsomeoneelse.)
Byreconcilinguncertainty,naturehasallowedtheconsciousthinkertogetoutofbedinthe
morningwithoutcavingundertheimmenseconditionalityoflife,butit'snecessarilyturnedus
intodecisionmakingbuffoons.(Particularlywhenitinvolvespredictingtheinherently
un
predictablefuture.)
Tomakethingsevenworse,oncewe
have
madeadecision,weunwittinglyanchorourselves
toitthroughawholehostofheuristicsandbiases
whichservetofurtherincreaseour
perceivedsenseofselfimportance,righteousnessandcontrolintheworld.(Anadditional
layerofcoherence.)Tonamejustthreebiaseswhichfurtherpartusfromobjectivetruth:
.Thisstatementisnotjusta
shrewdphilosophy.Presentlyandinthefuture,therearetoomany'dots'tocomprehend.Our
brainunconsciouslyrearrangesandsimplifies
ourmemoriessothatwhenwelookback,we
canmakesenseofourlives.Thisgivesustheretrospectiveillusionthatwecanapply
(simplified)pastlessonstothe(incomprehensible)future.Weassumethe
dotdensity
never
changes.
attheother.Fantasiesthrive
onhavingfreedomagainsttheheavy
burdenofobjectivereality.Thisbiasis
constantlyrecalibratedthroughoutlife,
fromthestarryeyedkindergartnerall
thewaytothejadedairtraffic
controller.
thesafetywallsofNewtoniandeterminismfortherandomuniverseofHeisenberg's
uncertaintyprinciple.Weattempttostudythe
objective
brainthroughafundamentally
subjective
lensthebrain.Onthefringeofourworldlyunderstanding,webumpupagainst
thePandora'sboxofQuantumMechanicsthedoubleslitexperiment,aswellasother
unsolved,possiblyneurorelatedmysteriesinPhysics.
Thisratio,ifthereissuchathing,willfluctuatebetweenpeopleonanaxisofvarious
conditionssuchaswhatwe'veexploredinthispieceneuralstimulation,thedegreeof
pathology,selfawareness.Certainly,thescienceofhallucinationanditssurprisingubiquity
makesitclearthatrealityismoresubjectivethanmostofuswouldthink.Andthismakes
senseconsideringthatwhatweseeisdeterministically
outside
ofourselves.Sensibly,it's
reasonedtoderivefromthere.Butthatinsighttakesusbarelyclosertofindingasatisfying
scientificanswer.
Giventhatsubjectiveexperienceisdifferentforeveryone,agoodstartingplaceperhapsis
withtheintegrityofone'sopticalandneuralvisualsystems(eyesandbrain)againsttheflow
ofvisualinformationavailabletothesesystems.(Outsidelight/stimulation.)Withanyonecog
departingfromwhatcouldbeconsiderednormal,neuralartifactsbegintoappearveryquickly
andthe
brain
takesanincreasinglysizeablepieceoftheperceptualpie.Thiswaswitnessed
throughourvolunteerwhowasvividlytransportedbacktohisfamily'spizzeriathrough
brainstimulation,ormoreseverelythroughpsychiatricproblemslikeCharlesBonnet
syndromeandschizophrenia.
Weknowpeoplecanbedrawnintoamazecontrivedsolelyfromtheirownmindwhether
throughneuropathology(asHollywoodhasbountifulaccountsof),orinhealthybrainsthrough
dreaming.Buthowfardoestherabbitholegotheotherway?Isitepitomizedthroughan
overstimulatingacidtripwhentheneuralbarriersonobjectivityarecompromised?Orarewe
backtothebrainagain?
Disconcertingly,experimentslikethoseconductedthroughthe
SubstitutionalReality
system
(SR)revealthatevenfullyhealthyindividualsarenotexemptfromafailuretocalibrate
subjectiveandobjectivereality.Whetherwelikeitornot,theworldisblurrytousall.
Pinpointingthetransitionbetweenrecordedandliverealityseemsintractable,butitdoes
inviteoneconsiderationthatmaybeit'stimetostartlookingforour
own
totems.
Coding Consciousness
Manyofthebrightestmindstodayareattheforefrontofunderstandingourperceptual
relationshipwithtechnology,butfewareaspoisedtomakestunningbreakthroughsinthis
arenathanvirtualrealitycompanyOculus,nowownedbyFacebook.Theyhavedeeper
pocketsthanthemostIvyleagueofuniversityresearchdepartments,andhavethe
intellectualbruntofsomeoftheworld'ssmartestscientistswhenitcomestobridgingthe
digitalandbiologicaldivide.
Thatbridge,however,isstilldividedbyachasmofignorance.Westillbarelyhavea
frameworkforhowthehumanbrainworksforonething.Inearly2014,amousebrainwas
mappedforthefirsttime
amammothachievementinthefieldofconnectomics(thefieldof
brainmapping),involvingasingleconnectomeof75millionneurons.Butthecompletemapof
thehumanbrainisstillnowheretobeseen.Afeatthatwouldbringadegreeof
understandingthatwoulddoubtlesstranslateintoenhancingvirtualrealitytechnology.
Buttheleapfromonetotheotherissignificantnotunlikeahighschoolscienceteacher
drawingplanetsontheblackboard.Planetscanbeabstractedintocategoriesandisolatedfor
humanunderstanding,butit'sdifficulttocommunicatetheobjectivescalethatwe'redealing
withhere.Forinstance,evenamodestlydetailedconnectomeofamousebrainrepresents
morethan1.8petabytesofdata.(That's1.8milliongigabytes.)Thehumanbrain,bycontrast,
wouldlikelyrequire98,000petabytesofdata.
(ERROR.)
Andthat'sjustthebridgeproblem,atheoreticallyknowablepath.Thechasmproblem,
however,isfarlessclearitsdepthimpossibletoknow.Ononeend,thedigitalmechanicsof
VRstayrelativelylogicalanderrorfree.Ontheother,thehumanbrainprocessesinformation
onestimatedpatternrecognitionwithanerrorpronememory.We'redealingwith
fundamentallydifferentparadigmsoflearning.Andwhetherforgoodorbad,theseapparent
flawsandidiosyncrasiesinbiologymustbeheededto,anddesignedfor,whenreproducinga
convincingvirtualenvironmentforthehumanplayer.
Inthispiecewe'lllookatsomeofthesignificantchallengescurrentlyposedinVRboth
knownandunknownwhichmakethisbridgesolong,andthechasmsodeep.It'samightily
excitingareaofstudythatwe'reonlyjustbeginningtoexploreandunderstand,andit'sa
privilegetounearthjustafootnoteofanindustrythat'ssettoradicallychangethehuman
experience.
.Ifhuman
brainsseeingrey,thencomputersseeonlyinblackandwhite.Sitadogbehindafenceand
aska9yearoldtofillintheblank:
Behindthefenceistheheadofa_____.
Achildwillmostlikelytellyoufirst,thatit'sadog(whichwouldtaxeventhemostpowerfulof
computers,whichmightextrapolateanewspeciesoffencedog).Butevenmoredifficultfora
computer,thechildwouldunderstandimplicitlythatbeneaththehead(andbehindthefence)
wasabodywhichcompletesthedog.Whatcomesnaturallytouswhatdifferentiatesadog
fromsomethingelseisnotoriouslyhardforacomputer.Butthereisasimpleexplanationfor
whythisis:theyaretwoentirelydifferentparadigmsoflearning.
Giventhatwebarelyhaveaframeworkforthehumanbraintoday,we'renotquitesurewhat
paradigmthebrainusestotheextenttowhichwecanreplicateit.Thebestwecandotoday
istoeffectivelyincreasememorycapacity,butstillneverunderstandexactlywhatisbeing
seen.Acomputerwilllabeleverycolour,breedandorificeofadog,butitstillwouldn't
understand
whatadogwasifitenteredthesameroom,barkedalittle,andwaggeditstailfor
atreat.Caseinpoint,inorderforacomputertobeatahumanatageneralknowledgeshow,
itneedstofirstmemorise200millionpagesofcontent,includingthefulltextofWikipedia
.
Andeventhenit'lltellyouthatit
estimates(estimates!
)BarackObamatobethecurrent
presidentwithsub100%certainty.
Onewaytocontrastthesedifferencesisthroughtheideathatcomputersaren'tusingallof
the5sensesthataresecondnaturetohumanbrains.Asaresulttheyneedto
overcompensatebycontinuallyincreasingthecomputinghorsepowerthrownattasks,which
thebrainhappenstodoeffortlesslyasaresultofenvironmentoptimisationthroughevolution.
Ablindpersonmayfindthemselvestaxingtheirmemorytorememberthelayoutofabuilding,
forinstance,withouthavingtheabilitytoprocessitvisuallyandwithoutconsciouseffort.
Take16,000computerprocessorswithonebillionconnectionsandgiveitunlimitedaccessto
YouTubeto
recognise
thecontentofthemostcommonlyoccurringimagesandstill
technologyisoutwittedbya9yearold.In2012,Google'sstateoftheartartificialbrainwith
thisdigitalhorsepowerwasabletomuster81.7percentaccuracyindetectinghumanfaces,
76.7percentaccuracywhenidentifyinghumanbodypartsand74.8percentaccuracywhen
identifyingcats
.Suchpercentageswouldbeludicrousforachild.
Intryingtoreproducehumanbrainintelligence,weareusingafundamentallydifferent
paradigm.Theresultofthisisalotofunexplainedphenomenawe'vebodgedtogetherlabels
forwithequallyperplexingtermschangeblindness,continuityofexperience,thecontinuity
fieldwhichwetouchedonearlier,andpersistenceofvisionwhichwe'llrevisitlater.Theyare
problemsthatsomeoftheworld'sbrightestmindstodayaregrapplingwith.
,saysMichaelAbrash,ChiefscientistatOculus
VR.Byminiaturizingyourlivingroominfrontofyourfaceandswitchingoffthelights,the
brainisstill
aware
that
it's
watching
a3Dsimulationofa2Dprojection.Whatwereallywantis
a3Dsimulationofa3Dprojection,therebytrickingthebrainintothinkingit'stherealworld.
Thisisafarmoredifficultcharadetomaintain.
"Therearethreebroadfactorsthataffecthowrealorunrealvirtualscenesseemtous"
,
hesays.Thefirsttwohaveamoreobjectiveemphasisonthetechnologicalsidethey're
knownas
tracking
and
latency.
TheseareproblemsastaticTVsetupdoesn'tencounteras
muchwhentheeyesareequallystatic,andcanbeneareliminatedthroughincreasingrefresh
ratesandincreasingblurwhenthecameraisrotating.Everytimetheeyesreorient
themselvesspatially,however,astheydoinVRbutnotonastaticdisplay,therearea
panoplyofphysioandneurologicalprocessesactivewhilethebraincalibratestothenew
scene.
(Torepeatthepassagefromearlier:
Inhumans,thefovearepresentsahighresolutionbut
verynarrowfieldofviewabout12degrees.Forthisreason,theeyesdartaround
simultaneouslyalasaccades,focusingonnovelandmemorydirectedstimuliofinterestwith
theeyesthroughthevestibuloocularreflex(VOR)andformingathreedimensionalmapin
thebrainwithanemphasisonthenovelandinteresting.)
ThiswholecomplexsystemseemstogiverisetoahostofenduringproblemsinVR,suchas
judder"thefactthatduringeachframepixelsremainilluminatedforconsiderableperiodsof
time"
,saysAbrash.Withnormal
2D3D
youreyesandbrainknowthey'relookingata
picture,buttrulyconvincingimagesin
3D3D
is,"expectedtostaystablewithrespecttothe
realworldasyoumove"
,
saysAbrash.It'slikecomparingyourreactiontoabearonamovie
screen,andabearinreallife.In3D3D,thebrainnoticeseveryminuteinconsistencyinthe
world,becauseinstinctively,it'snowbelievedthatyourlifeisatstake.Yoursurvivaldepends
onyoubeingabletopickupsubtleinconsistenciesintheenvironment.Thisisjustonereason
whyVRissohard.It'slikehavingtheharshestfoodcriticswiththemostsensitiveoffood
palettesvisityourrestaurant.Theynoticeeverything.
Definingtrackingandlatencyinmoredepth,andotherproblematictermsisoutsidethereach
ofthispiece(andasAbrashwillattest,thereisstillmuchtobeunderstood),buttoexplain
simplyifyou'veevernoticedthesecondhandonaclockorwatchseemingtohangforlonger
thanasecondwhenyoufirstlook,youhavealreadyexperiencedthebriefperiodwherethe
brainseemstoidlebeforeresumingnormalfunction.Duringthispausethebrainisactually
reconstructing
thepresentthroughatenthofasecondwindow
whererecentinformationis
collectedandacoherentpictureisformed,aswesawwiththecontinuityfieldearlier.This
phenomenoninparticulariscalledthestoppedclockillusion,anexampleofchronostasis
whichitselfisaproductofsaccadicmasking,"wherethebrainselectivelyblocksvisual
processingduringeyemovementsinsuchawaythatneitherthemotionoftheeye[...]northe
gapinvisualperceptionisnoticeabletotheviewer."
Itgoessomewaytoexplainingwhy
imagesappeartojudderwitheyesthatconstantlymoveinVR,butnotthroughastaticdisplay
withequallystaticeyes.
ReconcilingthetemporalityofthenonstaticvisualsystemwithdigitaldisplaysinVR,liesat
theheartofcreatingavirtualrealityexperiencethatisindistinguishablefromreallife.(InVR,
thisproblemisknownaspersistencerelatedtopersistenceofvisionwhichwasintroduced
earlier.)It'sintuitiveforustothinkthatthebrainindiscriminatelypresentstheworldaroundus
atanygivenmoment,muchlikeadigitaldisplaywouldinan
absolute
fashion.This
fundamentaldifferenceof'absolutedigital'against'relativebiology'isanotherperspectiveon
whyit'ssodifficulttotranslatebiologyintodigital.Itdemandsthatwedesigninlinewiththe
sameseeminglyarbitrarycompromisesthatevolutionhasgivenus(arbitraryonlyuntilwe
havegreaterunderstandingthatis),ratherthantobuildatheoreticallysuperiorHMD
(headmounteddisplay)fromscratch.
ThethirdfactorfromAbrashismoresubjectiveandnotfocusedondigitaltechnologythe
visualsystemitselftheeyesandthebrainwhichwe'velookedatinsomedepth.Andthis
thirdfactorisreallythefocusofthispiece.Understandinghowexactlythebrainprocesses
virtualrealitybringsusbacktothecentralquestion:whatcanvirtualrealitytellusabouthow
thehumanbrainworks?Inansweringthequestionwecomebacktotryingtodrawtheline
betweenrealandvirtualasastartingpoint.Butoncemore,itturnsouttobeaharderproblem
thanwemightthink.
PsychologistanddirectoroftheresearchcenterforvirtualenvironmentsattheUniversityof
California,JimBlascovich,standsatthepodiumofWinnipeg'sfirstTEDxconference
.He
expressesgratitudetotheaudiencebeforeengagingthemwithacuriousquestion:"Where
willyoubeduringmytalk?".Theaudienceletsoutanervouslaugh,sensinganunintuitive
answercoming."Rightherelisteningtome?",heoffers."Notcompletely.Ifyou'relikethe
averageNorthAmerican,yourmindwilltakeyousomeplaceelse40timesinthe18minutesI
haveforthistalk."
I'llaskagain.Wheredowedrawthelinebetweenrealandvirtualreality?Whenyougo
elsewhereinyourheadisthatrealitystill?Orisitmoreaccuratetocallitbiologicalvirtual
reality,likeourmanatthepizzeriaatthebeginning?Acompellinganswer,perhaps,isthat
realityisrelative.Blascovichcontinues."Ourpositionisinherentinournotionofwhatwecall
psychologicalrelativity.Nowscientistshaveproventhatmotionisrelative.AsIstandhere
tonight,itdoesn'tlooklikeI'mmovingveryquicklyorveryfar.Butthatperceptionisonly
accuratefrompointsofviewinthisroom.Fromamuchmoredistantperspective,Iammoving
quitefarandquitefast,andsoareyou.InWinnipegatthislatitude,wearemovingatmore
than1500kmanhour,astheearthspinsonitsaxis."
It'saboutperspective.
When
youhearthefiringofagun,changesfundamentallybetween
whetheryou'restanding10metresaway,or500metresaway.Ittakestimeforsoundtotravel
throughspaceandintoyourear.Thegunshotdoesnotexistobjectively,onlyinagentswith
theapparatustoregisterandreacttothesound.Andinthecaseofhumans,perhaps:to
register,react
and
reflect.Theproverbialtreethatfallsinaforestwithnoonearounddoesit
makeanoise?Well,sciencesuggeststhatitdoesn't.Blascovichmakesitclearthattheline
betweenrealityandvirtualareveryblurredindeed,whichseemstohavebeenanunnerving
themewhileI'vebeenwritingthis.
Butifwetakeacloserlook,theremaybemoreofadifferencethanwethink.Infact,MRI
scansofthebrainshowthatthereisadifferencesoprofoundthatthedigitalworldmaynever
beabletoperfectlyreplicatetherealworldfromthebrain'sperspective.Thisdoesn'tmean
theconsciousmindcannotbetricked,butitmightmeanthatwehaveabiologicaltotem.
(A
factthatwouldbereassuringinthefutureifwecometohaveconsciousaccesstothat
informationatwill.)
Inordertocontinuenow,we'llassumethattrackingandlatencyaresolvedproblemsinVR,
andwe'llstartwithanimportantdistinctionbetweenhowtherealworldisperceivedfromhow
virtualrealityisperceivedthroughaHMD.Thatis,weassume,whenwelookleftinvirtual
reality,theworldmovesexactlythesameinrelationtoourheadmovement,asitdoesinreal
life.Thefirstprincipleisthis:thatwhatthevisualsystemperceives,iscausedbythe
correspondingclusterofphotonswhichexistoutside,hittingtheretina.Thisiswherethe
profounddifferenceexists.AsAbrashsays,"Theoverallwayinwhichdisplaygenerated
photonsarepresentedtotheretinahasnothingincommonwithrealworldphotons"
Andrecentresearchconfirmsthis.Inlate2014,Neurophysicistsfoundthat
spacemapping
neuronsinthebrainactuallyreactdifferentlybetweentherealworldagainstthedigitalworld
ofVR
.
It'swellknownintheneuroscientificcommunity,thatwhenapersonentersanew
environment,hippocampalneuronsaregioninthebrainassociatedwithmemoryformation
selectivelyactivatetoforma'cognitivemap'ofthatarea.Thehippocampuscalculates
distancesbetweennotablelandmarkssuchasmountainsandbuildings,andinformationfrom
allthesensesisinterpolatedtoformathreedimensionalmapoftheworld.Itwasthoughtthat
thebrainwouldreactthesameintherealworld,asitdoesinvirtualreality.
Researchersplacedaminiharnessaroundratsandplacedthemonatreadmillsurrounded
completelybyavirtualworld.Scientistscomparedbrainactivitybetweenthisenvironmentand
thatofarealroomdesignedtolookexactlythesameasthevirtualrealityenvironment.What
theyfoundsurprisedthem.Brainpatternscorrespondingtothetwoscenariosweredayand
night.Whileneuronalactivitywasorderlyandsensibleintherealworldinthevirtualworld,
neuronsseemedtoactivaterandomly.Theuncorrelatedactivitysuggestedtheratwas
completelybaffled,butitsbehaviourwasthesameinbothcases."The'map'disappeared
completely,"saidMehta,thestudy'sseniorauthor,beforeconcluding,"Weneedtofully
understandhowvirtualrealityaffectsthebrain."Aninsightofutmostimportance,nodoubt,as
theVRindustrybeginspickingupspeed.
MichaelAbrashbringsadeeperinsighthere."Realworldphotonsarecontinuouslyreflected
oremittedbyeverysurface,andvaryconstantly.Incontrast,displaysemitfixedstreamsof
photonsfromdiscretepixelareasfordiscreteperiodsoftime,sophotonemissionisquantized
bothspatiallyandtemporally."
WhatwehaveinVirtualReality,isarudimentaryversionof
realitywhichgoespartofthewaytofoolingtheconsciousmind,butnevertheunconscious.
Possiblyablessingindisguise.
,multiplemonitor
configurationswereusedtoformatheoreticalmodelofvisualsystemsaturation.Iquote:
"Assuminga60Hzstereodisplaywithadepthcomplexityof6,wemakethepredictionthata
renderingrateofapproximatelytenbilliontrianglespersecondissufficienttosaturatethe
humanvisualsystem."
Oncethispointisreached,Deeringnoted,theultimatelimitsofhumanvisualperception
wouldnowneedtobeincludedinhardwaretradeoffs.Infact,itappearsthatinsomesense
wehavealreadycrossedthispoint.Digitalmonitorsdon'tdiscriminatebetweenthedirect,
narrowgazeofthefoveaandourblurredperipherywhereanopportunityliesinconserving
resourcesthroughrelyingmoreheavilyonexperiencedmemoryinplaceofuncertainty.
Simply,displaysoutputthesamedetailwhetheryou'relookingatthetopleftofthedisplayor
thebottomright.ToquoteDeeringevenasfarbackas1998CRTsexceeded"the
maximumspatialfrequencydetectioncapabilityofthevisualsystem,inregionsawayfrom
wherethefoveaislooking."
Thereis,however,adigitalexampleofperipheralprocessingbeingdifferenttothatofthe
actionbeingdirectlyexperienced.Andit'sunderstoodthroughwhat'sknownasthe
NyquistShannonsamplingtheorem
.In2012
,theprogrammerandfounderofEpic
games,TimSweeney,gaveapresentationonthefutureofgaming,whereinheexplainedthe
theorem:"Thescreenresolutionlimitstheamountofgraphicsdataweneedtoprocess
beyondthislimit,anyextradataiswasted."Thisistosaythatonlytheimagesonscreenfor
anygivenresolutionneedtobesharp(thefovealequivalent).Actionoutsideofthescreen
viewcanbeonalowerpowersettingandconsumelessmemory.(Theperipheralblur
equivalent).ThisisknownastheNyquistlimit.
Forthisreason,SweeneysaystheultimatetruerealityHMDwouldhavearesolutionof8000
x4000pixels,witha90degreeFOV.Andwiththatsetup,wewouldneedsomewhereinthe
regionof2040billiontrianglesonthescreenpersecond.Sweeneypredictsthistechnology
tobejust23generationsaway.(ArelevantnotegiventheincreasedFOVinVR,another
challengeisintroduced.ThewiderFOVinaHMDmeansitnecessarilyhastopushmore
pixelsatanyonetime,whencomparedtoaconventionaldisplay.Fewgamerswouldbe
contenttoplaydecadeoldgamesalongsidetheirTVcounterpartsinordertoexperiencethe
samesmoothness.)
AddingtoourhypotheticalcomponentlistofthetruerealityHMDwhichhijackstheconscious
mind,Abrashhassaidthata"1000Hzdisplaywouldverylikelylookgreat,andwouldalso
almostcertainlyreduceoreliminateanumberofotherHMDproblems,possiblyincluding
motionsickness,becauseitwouldinteractwiththevisualsysteminawaythatmimicsreality
muchmorecloselythanexistingdisplays."
Butratherdisappointinglyhegoesontosay,"I
havenowayofknowinganyofthatforsure,though,sinceIveneverseena1000Hz
headmounteddisplaymyself,anddonteverexpectto."
Morerealistically,a120Hzdisplaywouldpromisenoticeableimprovements.Butwhile
technicallypossibletobuild,thereisnoreasontobuildthemtodayfromaneconomic
standpoint.CurrentRiftdevkitsaremadeusingphonedisplays,whichhavenousefor120Hz
panelsintheirprimarymarket.AsAbrashexplains,"Itscertainlypossibletodoso,and
likewiseforOLEDpanels,butunlessanduntiltheVRmarketgetsbigenoughtodrivepanel
designs,ortojustifytheenormousengineeringcostsforacustomdesign,itwonthappen."
ThereareexpertssuchasfuturistandinventorRayKurzweil
whotraceMoore'slaw(the
observationthecomputingpowerincreasesexponentiallyevery1218months)from1968to
trackandpredicttheadvancementoftechnology.Theyconcludethatcomputerswillsoon
surpasshumanintelligencewithinthenext20years.ButwhileMoore'slawcouldfairly
accuratelypredictartificialintelligencetechnologylikeDeepBluebeingabletobeatachess
grandmasterby1998,anticipatethedemiseoftheSovietUnionandevenGoogle'sself
drivingcar,itmaynotbeaparadigmwhichtranslatesintotheextremediversityofhuman
intelligencewhichhasevolvedovermillennia.
Ourmotorskillsalongsideouropposablethumbsincombinationwithpatternrecognitionand
problemsolvingminds,presentamammothchallengefortechnologywhichispredisposedto
specialisation.(Andisratherautisticinitsnature.)Taskbytask,computersbeatuswithout
dispute.Butintermsofadaptabilityandflexibility,andtheintuitionwhichcanarisefromthat
freedomwetakethecake.Computersblowourmindsatbeingthebestatagrowinglistof
systematictasksfollowinginstructionsbutthey'renotlikelytobecompetingforminimum
wageagainstthehousecleaneranytimesoon.Activitiespresentingahighdegreeof
uncertaintyand/ordemandingdextrousmotorcontrolarefarlessunderstoodbymachines
andit'sdifficulttoputatimelineontechnologythatcanreplaceusinthosetasks.Eventhe
incredibleselfdrivingcarsaremoreakintoatrainonexquisitelydetailedtracksthanatruly
liberatedcar.
Cruciallyhereisthechallengeofinnovation."Facebookcouldhavebeendeveloped10years
earlier[on1994technology]"saysSweeneyinhistalk.Sowhydidn'twehaveFacebook
then?Well,itjusthadn'tbeen
invented
thenbyahuman.Computersaren'tgreatatinvention.
Atleastnotyet.Innovationoftencomesfrombeingintherightplaceattherighttime,with
boththebrainsandbrawnofahumanbeing.
FortunatelyforexpertslikeMichaelAbrash,itseemshe'sinexactlytherightplacetoputthe
biggestdentintheuniversewithhisprodigiousknowledgeofVR.Tohelpusherin,onemight
imagine,aworldinwhichplayersarehandedtheirveryowntotembeforepluggingintothe
virtualeconomyspurringanewindustrywithinanewindustry,withinanewindustry.Avirtual
realityinthebrainthatindisputablyfoolstheconsciousmind,butgravelyneverthe
unconscious.
Lest,wegetlostforever.
CITATIONS
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
Thomson,Helen(2014)Inducedhallucinationturnsdoctorsintopizzachefs,
http://www.newscientist.com/article/dn25459inducedhallucinationturnsdoctorsintopizzachefs.html#.VHHgForfXCQ
Sacks,Oliver(2012)Hallucinations,SilentMultitudes:CharlesBonnetSyndrome,35
Gillette,Dan(n.d.)Canapersonbornblindstillexperiencevisualhallucinations?
https://www.healthtap.com/user_questions/340024canapersonbornblindstillexperiencevisualhallucinations
Wikia(2014)TotemsinInception,http://inception.wikia.com/wiki/Totem
Sacks,Oliver(2012)Hallucinations,SilentMultitudes:CharlesBonnetSyndrome,10
Sacks,Oliver(2012)Hallucinations,Introduction,ix
Sacks,Oliver(2012)Hallucinations,AlteredStates,92
Doolittle,Peter(2013)Howyour"workingmemory"makessenseoftheworld,
http://www.ted.com/talks/peter_doolittle_how_your_working_memory_makes_sense_of_the_world
Anwar,Yasmin(2014)Scientistspinpointhowwemisssubtlevisualchanges,andwhyitkeepsussane,
http://newscenter.berkeley.edu/2014/03/30/continuityfield/
Whitney,David(2014)Scientistspinpointhowwemisssubtlevisualchanges,andwhyitkeepsussane,
http://newscenter.berkeley.edu/2014/03/30/continuityfield/
Jacobs,Ryan(2014)WhyYouRarelyNoticeMajorMovieBloopers,
http://www.psmag.com/navigation/healthandbehavior/dontalwaysnoticemoviebloopers77804/
RT(2014)Brain15seconddelayshieldsusfromhallucinogenicexperienceresearch,
http://rt.com/news/brainneurosciencevisualinformation709/
Costandi,Mo(2012)Inceptionhelmetcreatesalternativereality,
http://www.theguardian.com/science/neurophilosophy/2012/aug/26/inceptionhelmetalternativereality?CMP=twt_gu
Suzuki,Keisukeetal.(2012)SubstitutionalRealitySystem:ANovelExperimentalPlatformforExperiencingAlternativeReality,
http://www.nature.com/srep/2012/120621/srep00459/full/srep00459.html?messageglobal=remove
Ramachandran,S.Vilayanuretal.(1999)PhantomsoftheBrain,"ChasingthePhantom",39
Ramachandran,S.Vilayanuretal.(1999)PhantomsoftheBrain,"KnowingWheretoScratch"
Whynotahandfetishoranosefetish?I
suggestthatthereasonisquitesimplythatinthebrainthefootliesrightnexttothegenitalia
,32
Ramachandran,S.Vilayanuretal.(1999)PhantomsoftheBrain,"KnowingWheretoScratch"
Doctor,everytimeIhavesexualintercourse,I
experiencesensationsinmyphantomfoot.Howdoyouexplainthat?Mydoctorsaiditdoesn'tmakesense."
"Look,"Isaid."Onepossibilityisthatthegenitalsarerightnexttothefootinthebody'sbrainmaps.Don'tworryaboutit.
,32
NeuroscienceNews(2014)HowtheBrainLeadsUstoBelieveWeHaveSharpVision,
http://neurosciencenews.com/visualperceptionsharperimagesneuroscience1451/
Rovee,C.andRovee,D.T.(1969)Conjugatereinforcementofinfantexploratorybehavior,JournalofExperimentalChildPsychology,3339,
viaHood,Bruce(2012)TheSelfIllusion:HowtheSocialBrainCreatesIdentity,OxfordUniversityPress.
Wikipedia(2014)Negativitybias,http://en.m.wikipedia.org/wiki/Negativity_bias
Kinderman,Peter(2014)WhyWeNeedtoAbandontheDiseaseModelofMentalHealthCare,
http://blogs.scientificamerican.com/mindguestblog/2014/11/17/whyweneedtoabandonthediseasemodelofmentalhealthcare/
Williams,Alex(2007)TooMuchInformation?IgnoreIt,http://www.nytimes.com/2007/11/11/fashion/11guru.html?pagewanted=all&_r=0
Wikipedia(2014)DefenseMechanisms,http://en.m.wikipedia.org/wiki/Defence_mechanisms
Ramachandran,S.Vilayanuretal.(1999)PhantomsoftheBrain,"TheSoundofOneHandClapping",95
Ramachandran,S.Vilayanuretal.(1999)PhantomsoftheBrain,"TheSoundofOneHandClapping",92
26.
27.
28.
29.
30.
31.
32.
33.
34.
35.
36.
37.
38.
39.
40.
41.
42.
43.
44.
45.
46.
47.
48.
49.
Ramachandran,S.Vilayanuretal.(1999)PhantomsoftheBrain,"ThePhantomWithin",15
Wikipedia,Financialcrisisof200708,http://en.m.wikipedia.org/wiki/Financial_crisis_of_200708
Deering,Michael(1998)TheLimitsofHumanVision,2
Kahneman,Danieletal.(1974)JudgmentUnderUncertainty:HeuristicsandBiases,
http://psiexp.ss.uci.edu/research/teaching/Tversky_Kahneman_1974.pdf
Jobs,Steve(2005)'You'vegottofindwhatyoulove,'Jobssays,http://news.stanford.edu/news/2005/june15/jobs061505.html
Wikipedia(2014)Elaborativeencoding,http://en.m.wikipedia.org/wiki/Encoding_(memory)
Plante,G.Thomas(2011)CouldLowerExpectationsResultinaHappierLife?
http://m.psychologytoday.com/blog/dotherightthing/201102/couldlowerexpectationsresultinhappierlife
Boseovski,J.Janet(2010)EvidenceforRoseColoredGlasses:AnExaminationofthePositivityBiasinYoungChildrensPersonality
Judgments,http://onlinelibrary.wiley.com/doi/10.1111/j.17508606.2010.00149.x/abstract
McGilchrist,Iain(2009)TheMasterandHisEmissary,
"InEricFromm'sstudyOnDisobedience,hedescribesmodernmanashomo
consumens:concernedwiththingsmorethanpeople,propertymorethanlife,capitalmorethanwork.Heseesthismanasobsessedwiththe
structuresofthings,andcallshimorganisationman,flourishing,ifthatistherightword,asmuchunderthebureaucracyofcommunismas
undercapitalism.Thereisacloserelationshipbetweenthementalitythatresultsinbureaucraticorganisationandthementalityofcapitalism.
Socialismandcapitalismarebothessentiallymaterialist,justdifferentwaysofapproachingthelifelessworldofmatteranddecidinghowtoshare
thespoils."
,759
Hongkui,Zengetal.(2014)Amesoscaleconnectomeofthemousebrain,
http://www.nature.com/nature/journal/v508/n7495/full/nature13186.html
Scott,Cameron(2014)Networkof75MillionNeuronsoftheMouseBrainMappedfortheFirstTime,
http://singularityhub.com/2014/04/14/networkof75millionneuronsofthemousebrainmappedforthefirsttime/
Hsu,Mingetal.(2005)NeuralSystemsRespondingtoDegreesofUncertaintyinHumanDecisionMaking,
http://www.citeulike.org/user/oamg/article/465989
Wikipedia(ND)http://en.m.wikipedia.org/wiki/Watson_(computer),
"Watsonhadaccessto200millionpagesofstructuredandunstructured
contentconsumingfourterabytesofdiskstorage[8]includingthefulltextofWikipedia,[9]butwasnotconnectedtotheInternetduringthe
game."
WiredUK(2012)GooglesArtificialBrainLearnstoFindCatVideos,http://www.wired.com/2012/06/googlexneuralnetwork/
Abrash,Michael(2013)Whyvirtualisntrealtoyourbrain,http://blogs.valvesoftware.com/abrash/whyvirtualisntrealtoyourbrain/
Abrash,Michael(2014)MySteamDevelopersDayTalk,http://blogs.valvesoftware.com/abrash/
Abrash,Michael(2012)LatencythesinequanonofARandVR,http://blogs.valvesoftware.com/abrash/latencythesinequanonofarandvr/
Eagleman,David(2014)BrainTime,
"Thisbriefwaitingperiodallowsthevisualsystemtodiscountthevariousdelaysimposedbytheearly
stageshowever,ithasthedisadvantageofpushingperceptionintothepast.Thereisadistinctsurvivaladvantagetooperatingasclosetothe
presentaspossibleananimaldoesnotwanttolivetoofarinthepast.Therefore,thetenthofasecondwindowmaybethesmallestdelaythat
allowshigherareasofthebraintoaccountforthedelayscreatedinthefirststagesofthesystemwhilestilloperatingneartheborderofthe
present.Thiswindowofdelaymeansthatawarenessispostdictive,incorporatingdatafromawindowoftimeafteraneventanddeliveringa
retrospectiveinterpretationofwhathappened.",
http://eagleman.com/blog/item/6braintime
Wikipedia(ND)SaccadicMasking,
"Saccadicmasking,alsoknownas(visual)saccadicsuppression,isthephenomenoninvisualperception
wherethebrainselectivelyblocksvisualprocessingduringeyemovementsinsuchawaythatneitherthemotionoftheeye(andsubsequent
motionbluroftheimage)northegapinvisualperceptionisnoticeabletotheviewer.",
http://en.m.wikipedia.org/wiki/Saccadic_masking
Blascovich,Jim(2011)Digitalfreedom:Virtualreality,avatars,andmultipleidentities,http://m.youtube.com/watch?v=bgEA4iM8CHc
Aghajan,MZahraetal.(2014)Howdoesthebrainreacttovirtualreality?Completelydifferentpatternofactivityinbrain,
http://www.sciencedaily.com/releases/2014/11/141124162926.htm
Wikipedia(ND)NyquistShannonsamplingtheorem,http://en.m.wikipedia.org/wiki/NyquistShannon_sampling_theorem
Sweeney,Tim(2012)TheFutureofGamingTimSweeney(Epic)DICE2012Session,http://m.youtube.com/watch?v=XiQweemn2_A
Kurzweil,Ray(2005)Theacceleratingpoweroftechnology,
http://www.ted.com/talks/ray_kurzweil_on_how_technology_will_transform_us/transcript?language=en