1/18/12 Tensor product - Wikipedia, the free encyclopedia

1/6 en.wikipedia.org/wiki/Tensor_product
Tensor product
FromWikipedia,thefreeencyclopedia
Inmathematics,thetensor product,denotedby,maybeappliedindifferentcontextstovectors,matrices,tensors,vectorspaces,
algebras,topologicalvectorspaces,andmodules,amongmanyotherstructuresorobjects.Ineachcasethesignificanceofthesymbolis
thesame:themostgeneralbilinearoperation.Insomecontexts,thisproductisalsoreferredtoasouter product.Theterm"tensor
product"isalsousedinrelationtomonoidalcategories.
Contents
1Tensorproductofvectorspaces
1.1Characterizationbyauniversalproperty
1.2Asafunctor
1.3Morethantwovectorspaces
1.4Tensorpowersandbraiding
2Tensorproductoftwotensors
2.1Example
2.2Kroneckerproductoftwomatrices
2.3Tensorproductofmultilinearmaps
3Relationwiththedualspace
4Typesoftensors
5Overmoregeneralrings
6Tensorproductforcomputerprogrammers
6.1Arrayprogramminglanguages
7Seealso
8Notes
9References
Tensor product of vector spaces
ThetensorproductVWoftwovectorspacesVandWoverafieldKcanbedefinedbythemethodofgeneratorsandrelations.
ToconstructVW,onebeginswiththesetoforderedpairsintheCartesianproductVW.Forthepurposesofthisconstruction,
regardthisCartesianproductasasetratherthanavectorspace.ThefreevectorspaceFonVWisdefinedbytakingthevectorspace
inwhichtheelementsofVWareabasis.Insetbuildernotation,
wherewehaveusedthesymbole
(v,w)
toemphasizethatthesearetakentobelinearlyindependentbdefinitionfor
distinct(v,w)VW.
ThetensorproductarisesbydefiningthefollowingfourequivalencerelationsinF(VW):
wherev
1
,v
2
,andw
1
,w
2
arevectorsfromVandW(respectively),andcisfromtheunderlyingfieldK.DenotingbyRthespace
generatedbythesefourequivalencerelations,thetensor product of the two vector spacesVandWisthenthequotientspace
Itisalsocalledthetensor product spaceofVandWandisavectorspace(whichcanbeverifiedbydirectlycheckingthevectorspace
axioms).Thetensor product of two elementsvandwistheequivalenceclass(e
(v,w)
+R)ofe
(v,w)
inVW,denotedvw.This
notationcansomewhatobscurethefactthattensorsarealwayscosets:manipulationsperformedviatherepresentatives(v,w)mustalways
becheckedthattheydonotdependontheparticularchoiceofrepresentative.
1/18/12 Tensor product - Wikipedia, the free encyclopedia
2/6 en.wikipedia.org/wiki/Tensor_product
ThespaceRismappedtozeroinVW,sothattheabovethreeequivalencerelationsbecomeequalitiesinthetensorproductspace:
Givenbases{
i
}and{
i
}forVandWrespectively,thetensors{
i

j
}formabasisforVW(generallyorderedsothat
i

j+1
comesbefore
i+1

j
).Thedimensionofthetensorproductthereforeistheproductofdimensionsoftheoriginalspacesforinstance
R
m
R
n
willhavedimensionmn.
ElementsofVWaresometimesreferredtoastensors,althoughthistermreferstomanyotherrelatedconceptsaswell.
[1]
Anelement
ofVWoftheformiscalledapureorsimpletensor.Ingeneral,anelementofthetensorproductspaceisnotapuretensor,but
ratherafinitelinearcombinationofpuretensors.Thatistosay,if
1
and
2
arelinearlyindependent,and
1
and
2
arealsolinearly
independent,then
1

1
+
2

2
cannotbewrittenasapuretensor.Thenumberofsimpletensorsrequiredtoexpressanelementof
atensorproductiscalledthetensorrank,(nottobeconfusedwithtensororder,whichisthenumberofspacesonehastakenthe
productof,inthiscase2innotation,thenumberofindices)andforlinearoperatorsormatrices,thoughtofas(1,1)tensors(elementsof
thespaceVV*),itagreeswithmatrixrank.
Characteriationbauniversalpropert
ThetensorproductofVandWcanbedefined(uptoisomorphism)byanypair(L,),withLavectorspaceonKand
abilinearmapsuchthat
foranyKvectorspaceZandanybilinearmap ,thereexistsauniquelinearmap verifying
Inthissense,isthemostgeneralbilinearmapthatcanbebuiltfromVxW.
Itiseasytocheckthat satisfiesthisuniversalproperty.
Asafunctor
Thetensorproductalsooperatesonlinearmapsbetweenvectorspaces.Specifically,giventwolinearmapsS:VXandT:WY
betweenvectorspaces,thetensorproductofthetwolinearmapsSandTisalinearmap
definedby
Inthisway,thetensorproductbecomesabifunctorfromthecategoryofvectorspacestoitself,covariantinbotharguments.
[2]
TheKroneckerproductoftwomatricesisthematrixofthetensorproductofthetwocorrespondinglinearmapsunderastandardchoice
ofbasesofthetensorproducts(seethearticleonKroneckerproducts).
Morethantwovectorspaces
Theconstructionandtheuniversalpropertyofthetensorproductcanbeextendedtoallowformorethantwovectorspaces.For
example,supposethatV
1
,V
2
,andV
3
arethreevectorspaces.ThetensorproductV
1
V
2
V
3
isdefinedalongwithatrilinear
mappingfromthedirectproduct
sothat,anytrilinearmapFfromthedirectproducttoavectorspaceW
factorsuniquelyas
1/18/12 Tensor product - Wikipedia, the free encyclopedia
3/6 en.wikipedia.org/wiki/Tensor_product
whereLisalinearmap.Thetensorproductisuniquelycharacterizedbythisproperty,uptoauniqueisomorphism.
Thisconstructionisrelatedtorepeatedtensorproductsoftwospaces.Forexample,ifV
1
,V
2
,andV
3
arethreevectorspaces,thenthere
are(natural)isomorphisms
Moregenerally,thetensorproductofanarbitraryindexedfamilyV
i
,iI,isdefinedtobeuniversalwithrespecttomultilinearmappings
ofthedirectproduct
Tensorpoersandbraiding
Letnbeanonnegativeinteger.ThenthtensorpoerofthevectorspaceVisthenfoldtensorproductofVwithitself.Thatis
Apermutationoftheset{1,2,...,n}determinesamappingofthenthCartesianpowerofV
definedby
Let
bethenaturalmultilinearembeddingoftheCartesianpowerofVintothetensorpowerofV.Then,bytheuniversalproperty,thereisa
uniquemorphism
suchthat
Themorphism

iscalledthebraidingmapassociatedtothepermutation.
Tensorproductoftotensors
AtensoronVisanelementofavectorspaceoftheform
fornonnegativeintegersand.Thereisageneralformulaforthecomponentsofa(tensor)productoftwo(ormore)tensors.For
example,ifFandGaretwocovarianttensorsofrankmandn(respectively)(i.e.FT
m
0
,andGT
n
0
),thenthecomponentsoftheir
tensorproductaregivenby
[3]
Inthisexample,itisassumedthatthereisachosenbasisBofthevectorspaceV,andthebasisonanytensorspaceT
s
r
istacitlyassumed
tobethestandardone(thisbasisisdescribedinthearticleonKroneckerproducts).Thus,thecomponentsofthetensorproductoftwo
tensorsaretheordinaryproductofthecomponentsofeachtensor.
Notethatinthetensorproduct,thefactorFconsumesthefirstrank(F)indices,andthefactorGconsumesthenextrank(G)indices,so
Thetensor maybenaturallyviewedasamodulefortheLiealgebra bymeansofthediagonalaction:forsimplicityletus
assume ,then,foreach ,
1/18/12 Tensor product - Wikipedia, the free encclopedia
4/6 en.wikipedia.org/wiki/Tensor_product
where is the transpose oI , that is, in terms oI the obvious pairing on ,
.
There is a canonical isomorphism given by
Under this isomorphism, every may be Iirst viewed as an endomorphism oI and then viewed as an endomorphism oI
. In Iact it is the adjoint representation oI End(V).
Eample
Seealso:Classicaltreatmentoftensors
Let U be a tensor oI type (1,1) with components U

, and let V be a tensor oI type (1,0) with components V

. Then
and
The tensor product inherits all the indices oI its Iactors.
Kroneckerproductoftomatrices
Mainarticle:Kroneckerproduct
With matrices this operation is usually called the Kroneckerproduct, a term used to make clear that the result has a particular block
structure imposed upon it, in which each element oI the Iirst matrix is replaced by the second matrix, scaled by that element. For matrices
and this is:
For example, the tensor product oI two two-dimensional square matrices:
The resultant rank is at most 4, and the resultant dimension 16. Here rank denotes the tensor rank (number oI requisite indices), while the
matrix rank counts the number oI degrees oI Ireedom in the resulting array.
A representative case is the Kronecker product oI any two rectangular arrays, considered as matrices. A dyadic product is the special
case oI the tensor product between two vectors oI the same dimension.
Tensorproductofmultilinearmaps
Given multilinear maps and their tensor product is the multilinear Iunction
1/18/12 Tensor product - Wikipedia, the free encyclopedia
5/6 en.wikipedia.org/wiki/Tensor_product
Relationwiththedualspace
In the discussion on the universal property, replacing X by the underlying scalar Iield oI V and W yields that the space (the dual
space oI , containing all linear Iunctionals on that space) is naturally identiIied with the space oI all bilinear Iunctionals on . In
other words, every bilinear Iunctional is a Iunctional on the tensor product, and vice versa.
Whenever and are Iinite dimensional, there is a natural isomorphism between and , whereas Ior vector spaces oI
arbitrary dimension we only have an inclusion . So, the tensors oI the linear Iunctionals are bilinear Iunctionals. This
gives us a new way to look at the space oI bilinear Iunctionals, as a tensor product itselI.
Tpesoftensors
Linear subspaces oI the bilinear operators (or in general, multilinear operators) determine natural quotient spaces oI the tensor space,
which are Irequently useIul. See wedge product Ior the Iirst major example. Another would be the treatment oI algebraic Iorms as
symmetric tensors.
Overmoregeneralrings
The notation
R
reIers to a tensor product oI modules over a ring R.
Tensorproductforcomputerprogrammers
Arraprogramminglanguages
Array programming languages may have this pattern built in. For example, in APL the tensor product is expressed as (Ior example
or ). In J the tensor product is the dyadic Iorm oI */ (Ior example a*/b or a*/b*/c).
Note that J's treatment also allows the representation oI some tensor Iields, as a and b may be Iunctions instead oI constants. This product
oI two Iunctions is a derived Iunction, and iI a and b are diIIerentiable, then a*/b is diIIerentiable.
However, these kinds oI notation are not universally present in array languages. Other array languages may require explicit treatment oI
indices (Ior example, MATLAB), and/or may not support higher-order Iunctions such as the Jacobian derivative (Ior example,
Fortran/APL).
Seealso
Extension oI scalars
Tensor product oI R-algebras
Tensor product oI Iields
Tensor product oI graphs
Tensor product oI Hilbert spaces
Tensor product oI line bundles
Tensor product oI modules
Tensor product oI quadratic Iorms
Topological tensor product
Dyadic product
Tensor contraction
Notes
1. ^ See tensor or tensor (intrinsic deIinition).
2. ^ Hazewinkel, et. al. (2004), p. 100 (http://books.google.com.br/books?idAibpdVNkFDYC&pgPA95) .
3. ^ Analogous Iormulas also hold Ior contravariant tensors, as well as tensors oI mixed variance. Although in many cases such as when there is an
inner product deIined, the distinction is irrelevant.
References
Bourbaki, Nicolas (1989), Elementsofmathematics,AlgebraI, Springer-Verlag, ISBN 3-540-64243-9.
Halmos, Paul (1974), Finitedimensionalectorspaces, Springer, ISBN 0387900934.
Lang, Serge (2002), Algebra, Graduate Texts in Mathematics, 211 (Revised third ed.), New York: Springer-Verlag,
1/18/12 Tensor product - Wikipedia, the free encclopedia
6/6 en.wikipedia.org/wiki/Tensor_product
ISBN9780387953854,MR1878556(http://www.ams.org/mathscinetgetitem?mr=1878556)
MacLane,S.Birkhoff,G.(1999),Algebra,AMSChelsea,ISBN0821816462.
Hazewinkel,MichielGubareni,NadezhdaMikhalovnaGubareni,NadiyaKirichenko,VladimirV.(2004),Algebras,rings
andmodles,Springer,ISBN9781402026904.
Retrievedfrom"http://en.wikipedia.org/w/index.php?title=Tensor_product&oldid=469766144"
Categories: Abstractalgebra Binaryoperations Bilinearoperators Multilinearalgebra
Thispagewaslastmodifiedon5January2012at19:14.
TextisavailableundertheCreativeCommonsAttributionShareAlikeLicenseadditionaltermsmayapply.SeeTermsofusefor
details.
WikipediaisaregisteredtrademarkoftheWikimediaFoundation,Inc.,anonprofitorganization.