Beruflich Dokumente
Kultur Dokumente
www.elsevier.com/locate/physd
Received 8 February 2006; received in revised form 14 September 2006; accepted 25 September 2006
Available online 17 November 2006
Communicated by R. Roy
Abstract
The investigation of synchronization phenomena on measured experimental data such as biological time series has recently become an
increasing focus of interest. Different approaches for measuring synchronization have been proposed that rely on certain characteristic features
of the dynamical system under investigation. For experimental data the underlying dynamics are usually not completely known, therefore it is
difficult to decide a priori which synchronization measure is most suitable for an analysis. In this study we use three different coupled model
systems to create a ‘controlled’ setting for a comparison of six different measures of synchronization. All measures are compared to each other
with respect to their ability to distinguish between different levels of coupling and their robustness against noise. Results show that the measure
to be applied to a certain task can not be chosen according to a fixed criterion but rather pragmatically as the measure which most reliably yields
plausible information in test applications, although certain dynamical features of a system under investigation (e.g., power spectra, dimension)
may render certain measures more suitable than others.
c 2006 Elsevier B.V. All rights reserved.
have been proposed. The simplest case of complete synchro- on phase synchronization include Refs. [15–18,29,30], while
nization can be attained if identical systems are coupled suf- approaches to characterize generalized synchronization have
ficiently strongly so that their states coincide after transients been studied in Refs. [10,20,21,24,31,32]. A comprehensive
have died out [2,3]. Phase synchronization, first described for comparison of different approaches applied to different coupled
chaotic oscillators [7–9], is defined as the global entrainment of model systems in a ‘controlled’ setting is still missing and is
phases, whereas the exact phase differences and the amplitudes thus the aim of the present study. Note that it is beyond the
remain chaotic and, in general, weakly correlated. The concept scope of this study to give a comprehensive characterization of
of generalized synchronization, introduced for uni-directionally the coupled model system in terms of their dynamic regimes
coupled systems [4,10,11], denotes the presence of some func- of synchronization or their bifurcations and transitions. Rather
tional relation between the states of responder and driver. Since we are aiming to use their controlled setting (due to the given
this function does not have to be the identity, generalized syn- equations of motion we are able to calculate the dependence
chronization is already a rather weak criterion, but it is still sur- of the largest Lyapunov exponent on the coupling strength)
passed by the notion of interdependence [12] where the map- as a validation for judging the performance of the different
ping of local neighborhoods in the first system onto local neigh- measures.
borhoods in the second system is exploited as the quantifying In our analysis six measures of synchronization are applied
criterion. Various methods exist for the detection of the different to time series (length N = 4096) of three coupled model
types of synchronization. Complete synchronization can be rec- systems with different individual properties (e.g., power
ognized by plotting a component of the driver versus the respec- spectra, dimension). However, all show a rather monotonic
tive component of the responder while phase synchronization dependence of the Lyapunov exponent on the coupling strength.
can be identified by a vanishing mean frequency difference [7]. Note that this is not necessarily the case for other systems but
To verify the existence of generalized synchronization in unidi- we deliberately chose systems with such monotonic behavior
rectionally driven systems, the negativeness of the largest Lya- in order to provide a controlled setting. Model systems
punov exponent of the responder is usually employed [5]. comprise coupled Hénon maps as well as coupled Rössler
Corresponding to this variety of concepts and complement- and coupled Lorenz systems. Applied measures are composed
ing the respective methods of synchronization detection many of symmetric ones like the maximum linear cross correlation
different approaches have been proposed aiming at a quantifi- Cmax , the mutual information I , and two different indices of
cation of the degree of synchronization between two systems on phase synchronization γ H ∗ and γ W ∗ (where the phase of the
a continuous scale. These approaches comprise linear ones like time series is extracted by using the Hilbert or the wavelet
the cross correlation or the coherence function as well as es- transform, respectively) as well as symmetrized variants of
sentially non-linear measures like mutual information [13] and
the asymmetric measures non-linear interdependence S and
transfer entropy [14]. Furthermore, different indices of phase
event synchronization Q ∗ . Using the coupling strength as the
synchronization have been introduced [15–18]. Here the in-
first control parameter, it is tested to what extent the different
stantaneous phases are extracted from the time series by us-
measures are able to distinguish different degrees of coupling.
ing e.g. the Hilbert transform [7] or the wavelet transform [19].
This is essential in many field applications since rarely is the
Topological approaches to quantify generalized synchroniza-
absolute value of synchronization of interest, but rather the
tion include the method of mutual false nearest neighbors [10]
change of synchronization between different states, times, or
and the index based on non-linear mutual predictions [20] as
recording sites. The signal-to-noise ratio is used as a second
well as the non-linear interdependencies [12], the synchroniza-
parameter to investigate whether the results of the different
tion likelihood [21] and the predictability improvement [22]. Fi-
measures are robust against contaminations with noise. This
nally, event synchronization [23] quantifies the overall level of
is another important aspect for choosing the most suitable
synchronicity from the number of quasi-simultaneous appear-
measure for an application to field data (e.g. of medical
ances of certain predefined events. While most of these mea-
origin). Finally, to assess the perspective of a combined use
sures are designed to estimate only the degree of synchroniza-
tion between two systems, some of these measures are intended of different approaches to quantify synchronization, the degree
to also reveal possible directionalities between them and thus to of redundance between the different measures is evaluated by
detect driver–responder relationships. This aspect of direction- means of a correlation analysis.
ality has already been addressed in Refs. [14,24–27], a com- The remainder of the paper is organized as follows: The
parison of different directionality approaches is not part of the statistical evaluation designed to compare these measures is
present study, but can be found in Ref. [28]. described in Section 2.1, the methodology for the correlation
Investigations on model systems are typically carried out analysis is outlined in Section 2.2. Results on the measures’
by analyzing long and noise-free time series (typically of capability to reflect the strength of coupling, their robustness
the order of 105 data points or more). Only rarely has the against noise and their mutual correlations are presented in
dependence between coupled model systems been evaluated by Sections 3.1, 3.2, 3.3, respectively. Conclusions are drawn in
applying bivariate measures to short time series (of the order of Section 4. Finally, in Appendix A the coupling schemes and the
103 data points) that are typically found in field applications. underlying model systems are introduced, while the measures
If at all, almost exclusively a single approach to measure of synchronization and their implementation are described in
synchronization has been used. Examples of investigations Appendix B.
T. Kreuz et al. / Physica D 225 (2007) 29–42 31
Fig. 1. Dependence on the coupling strength for six measures of Fig. 3. Same as Fig. 1, but this time for the coupled Lorenz systems.
synchronization applied to coupled Hénon systems without noise: Cross
correlation Cmax , mutual information I , Hilbert phase circular variance γ H ∗ ,
wavelet phase circular variance γ W ∗ , nonlinear interdependence S, event
synchronization Q ∗ . The maximum Lyapunov exponent of the responder
system is depicted by the thick black line. Dotted vertical lines mark its zero
crossings.
Fig. 5. Coupled Hénon systems: Color-coded dependence on the coupling strength and the noise-to-signal ratio for Gaussian white noise: (a) cross correlation
Cmax , (b) mutual information I , (c) Hilbert phase circular variance γ H ∗ , (d) wavelet phase circular variance γ W ∗ , (e) nonlinear interdependence S, (f) event
synchronization Q ∗ . For each measure the case of noise-free systems (R = 0) is plotted beyond the smallest noise-to-signal ratio R = 0.01.
Fig. 6. Same as Fig. 5, but this time for the coupled Rössler systems.
which allow a better tracing of the synchronization. This effect only difference being that here also the higher fluctuations that
is reminiscent of the phenomenon of stochastic resonance [35] can be observed in the dependence on the coupling strength (cf.
where the optimal signal detection is achieved for intermediate Fig. 3) disappear for higher noise-to-signal ratios.
noise levels. Apart from this effect, the behavior obtained for In order to compare the different measures quantitatively,
the coupled Lorenz systems (Fig. 7) is very similar with the again the degree of monotonicity M is used. This allows one
34 T. Kreuz et al. / Physica D 225 (2007) 29–42
Fig. 7. Same as Fig. 5, but this time for the coupled Lorenz systems.
Fig. 10. Over-all comparison for model systems contaminated with iso-spectral
noise: Critical noise level RC for each measure and every system. If the
threshold Mn∗ is not crossed, RC is set to a value beyond the maximum noise-
to-signal ratio.
Fig. 11. Same as Fig. 5, but this time for the coupled Lorenz systems and iso-spectral noise.
36 T. Kreuz et al. / Physica D 225 (2007) 29–42
measures of phase synchronization is rather low. This can be is the interpretation of a low value of M indicating a non-
explained by the different frequency sensitivity for the broad- monotonic course. Is such a value due to a failure of the
banded Hénon system. For both of the much more narrow- measure to distinguish between different levels of coupling, or
banded Rössler and Lorenz systems this combination of mea- does the measure correctly reflect certain peculiarities in the
sures actually yielded the maximum correlation coefficient (re- systems’ transition to synchronization? Most of all, such a value
sults not shown here). should encourage a more careful investigation of the system’s
dependence on the coupling strength.
4. Discussion Despite the caveats in the first part of this study, the
application of the degree of monotonicity in the second part
The aim of this study was to perform a comparison of remained unaffected. Given the monotonicity without noise,
different measures of synchronization on model systems to M served as an appropriate means to track the changing of
help to decide which measure may be most suitable for an this monotonicity due to the additive noise. Using a threshold
application to field data. To this end we compared different criterion designed to quantify the robustness against noise, first
measures regarding their capability to reflect different degrees the influence of Gaussian white noise was evaluated. Again
of coupling between two model systems both in the presence robustness was dependent on the system under investigation.
and absence of noise. The dependence on the coupling strength The least robust results were obtained for systems with high
was evaluated using the degree of monotonicity M. monotonicity in the absence of noise. As for the comparison of
It should be noted that there are some caveats in this the different measures, all measures proved to be rather robust
evaluation since this approach is built on some simplifying against white noise. Slight advantages were observed for the
assumptions. One fundamental assumption is that an increase linear cross correlation.
of coupling necessarily leads to an increase of synchronization. Concerning iso-spectral noise, for some model systems
However, the different systems investigated in this study exhibit and some measures a (spurious) synchronization between
very different behaviors in their transition to synchronization the contaminating noise signals could be observed. This can
with increasing coupling strength and the Lyapunov exponent be explained by the narrowness of the power spectrum of
is not always strictly monotonic (cf. Figs. 1–3). But since the respective systems, which is maintained in the added
the adjustable parameter is the coupling strength and not the noise signals by construction. In the case of strong coupling,
Lyapunov exponent, the alternative possibility to test whether the peaks in the power spectrum of the coupled systems
the measures of synchronization reflect the course of the (and thus those of the noise signals as well) align at the
Lyapunov exponent (instead of the coupling strength) is not same frequency [36]. For low levels of noise, this causes
pragmatic. Furthermore, this difficulty is also reminiscent of the synchronization of the coupled signals, for high levels of noise
case of field data where the true effects of coupling are rarely (spurious) synchronization between the noise signals can be
known. detected. In the coupling regimes investigated here this was
A second assumption is that this relation should hold for most prominently observed for the nonlinear interdependence.
all types of synchronization no matter which model systems The comparison of the different measures for phase
are investigated and which coupling schemes are employed. synchronization based on either the Hilbert transform or the
It is possible to construct examples in which only one wavelet transform, respectively, shows that both methods seem
type of synchronization takes place while the other types to be more or less equally suitable for the characterization of
do not occur at all (see also the discussion on generalized narrow-band systems like the Rössler and the Lorenz system.
synchronization versus phase synchronization [28,36,37]). In However, for broad-band systems like the Hénon system
such cases measures designed to detect different types of Hilbert phase based synchronization measures appear superior.
synchronization are expected to behave differently. Thus this This is remarkable since it has been argued that the Hilbert
second assumption does not hold in general. phase measures should be applied only to systems with a
Due to these peculiarities in the analysis of model systems narrow-band power spectrum or after band-pass filtering [38].
it seems that the notion of a ‘controlled’ setting is valid only to To summarize, the question which measure is best suited for
the extent to which these peculiarities do not affect the course an application to field data (e.g., of medical origin) can not be
of the maximum Lyapunov exponent. Although in general answered in general. Regarding the capability to distinguish
the coupling strength was reflected by the different measures different coupling strengths, due to the individual properties
(as tracked by the degree of monotonicity M), a careful and peculiarities of every system, an obvious and objective
examination of the underlying processes of interaction seems to criterion to judge different measures exists only for some
be mandatory when analyzing field data. Thus for such data the special cases (e.g., wavelet phase is not very suitable for a
question of which measure is best suited to distinguish different system with a broadband spectrum). However, the robustness
levels of synchronization cannot be answered in general. This against noise is not the same for all measures. Thus the measure
is in agreement with the results reported in Ref. [28]. should be chosen according to the quality and type of data.
But even if the underlying assumptions do not hold On the other hand, in most cases the measure to be applied
rigorously, the quantity M still proves useful as a means to to a certain task can be chosen rather pragmatically as the
reduce information since it compresses the dependence on measure which most reliably yields valuable information (e.g.,
the coupling strength into a single value. The crucial point information useful for diagnostic purposes) in test applications.
T. Kreuz et al. / Physica D 225 (2007) 29–42 37
In many cases even a combination of different appropriately parameter mismatch between the two systems was introduced
chosen measures might be reasonable, since, as reflected by by setting ωx = 0.95 and ω y = 1.05. The coupling strength
the correlation analysis, different measures capture different C was varied from 0 to 2 in steps of 0.025. In Fig. 14 a
aspects of the dynamics. clear tendency towards the identity of the two attractors can
be observed (although complete synchronization will never be
Acknowledgments reached due to the parameter mismatch).
Many thanks to R. Quian Quiroga for useful discussions. A.3. Coupled Lorenz systems
T.K. acknowledges support from the EU Marie Curie Human
Resources and Mobility Activity, R.G.A. from the Alexander For the two Lorenz systems the same diffusive coupling
von Humboldt Foundation, F.M. intramural funding from scheme as for the Rössler systems was used. The equations of
BONFOR. T.K., F.M., K.L. and P.G. acknowledge support from motion of this coupling scheme read:
the Deutsche Forschungsgemeinschaft [SFB TR3].
x˙1 = 10(x2 − x1 )
Appendix A. Coupling schemes x˙2 = x1 (28 − x3 ) − x2
8
For the Hénon and the Rössler model system the x˙3 = x1 x2 − x3
3
synchronization between the first components (i.e., x1 and y1 ) y˙1 = 10(y2 − y1 )
was analyzed, only for the Lorenz system were the third
y˙2 = y1 (28.001 − y3 ) − y2
components used.
8
y˙3 = y1 y2 − y3 + C(x3 − y3 ). (A.3)
A.1. Coupled Hénon systems 3
The equations were integrated using Runge–Kutta 4th order
The first coupling scheme consists of two unidirectionally
with a step size of 0.001 and a sampling interval of 0.01.
coupled Hénon maps and was proposed in Ref. [20] and later
Note the small parameter mismatch introduced in the second
also analyzed in Refs. [21,24,39]. The equations of motion for
component. The coupling strength C was varied from 0 to 2 in
the driver and the responder read
steps of 0.025. For the Lorenz systems the transition towards a
2 synchronized state takes place for C around 1.35 (Fig. 15).
x1,n+1 = 1.4 − x1,n + bx x2,n
x2,n+1 = x1,n ,
Appendix B. Measures of synchronization
y1,n+1 = 1.4 − (C x1,n y1,n + (1 − C)y1,n
2
) + b y y2,n
y2,n+1 = y1,n . (A.1) In the following xn and yn (n = 1, . . . , N ) will denote two
simultaneously measured discrete time series of length N from
The parameters were set to bx = b y = 0.3 to yield identical two different systems X and Y , while xn and yn will denote
systems. The coupling strength C was varied from 0 to 0.8 in state vectors obtained by delay embedding. In order to avoid
steps of 0.01. edge effects for the measures of phase synchronization, phases
The attractor of the responder looks the same for C = 0 were calculated from time series of length 8192. Then both
and C = 0.8 (Fig. 13, top), but while for C = 0 driver and for the phases and the time series the first and the last quarter
responder are completely independent (the apparent structure were discarded leaving N = 4096 data points in the middle for
in the lower plot is due to the non-uniform densities of the the analysis. Furthermore, all time series were normalized to
individual systems), identical synchronization between driver zero mean and unit variance, and all formulas were simplified
and responder can be observed for C = 0.8 (Fig. 13, bottom). accordingly.
In between a rather sharp transition around C = 0.7 takes place. The system-dependent parameters and their respective
values are listed in Table 1. If possible, parameter values were
A.2. Coupled Rössler systems
chosen according to earlier studies (e.g., Refs. [24,26]). As
an additional measure of reference the conditional Lyapunov
For the two Rössler systems a unidirectional diffusive
exponents [5,40] were calculated.
coupling was employed [18,28,29,37]:
x˙1 = −ωx x2 − x3 B.1. Linear cross correlation
x˙2 = ωx x1 + 0.15x2
The simplest and most commonly used measure of
x˙3 = 0.2 + x3 (x1 − 10) synchronization is the cross correlation defined in the time
y˙1 = −ω y y2 − y3 + C(x1 − y1 ) domain as a function of the time lag τ = −(N − 1),
y˙2 = ω y y1 + 0.15y2 . . . , 0, . . . , N − 1:
= 0.2 + y3 (y1 − 10).
y˙3 (A.2) N −τ
1 X
xn+τ yn τ ≥ 0
The equations were integrated using Runge–Kutta 4th order C X Y (τ ) = N − τ (B.1)
n=1
CY X (−τ ) τ < 0.
with a step size of 0.05 and a sampling interval of 0.3. A
38 T. Kreuz et al. / Physica D 225 (2007) 29–42
Fig. 13. Coupled identical Hénon maps for different coupling strengths C: (a) 0.0, (b) 0.6, (c) 0.7, (d) 0.8. For each coupling strength the attractor of the responder
is depicted at the top, whereas below the first component of the driver is plotted versus the first component of the responder.
Fig. 14. Coupled Rössler systems for different coupling strengths C: (a) 0.0, (b) 0.5, (c) 1.0, (d) 2.0. For each coupling strength the attractor of the responder
(projection on the first and the second component) is depicted at the top, whereas below the first component of the driver is plotted versus the first component of the
responder.
Fig. 15. Coupled Lorenz systems for different coupling strengths C: (a) 0.0, (b) 1.16, (c) 1.35, (d) 2.0. For each coupling strength the attractor of the responder
(projection on the first and the third component) is depicted at the top, whereas below the first component of the driver is plotted versus the first component of the
responder.
The cross correlation is obtained by normalizing the cross synchronization) to one (in-phase synchronization), while
covariance and thus ranges from minus one (anti-phase values close to zero are attained for linearly independent
T. Kreuz et al. / Physica D 225 (2007) 29–42 39
(here p.v. denotes the Cauchy principal value). This gives the synonymously. The index of phase synchronization applied in
Hilbert phase: this study is the index based on circular variance (qualitatively
similar results were obtained with two indices introduced in
x̃(t)
φxH (t) = arctan . (B.9) Ref. [16]. For the sake of brevity these are not shown here):
x(t)
1 X N
Analogously, φ yH is defined from y(t). γ = ei[φx (t j )−φ y (t j )] = 1 − CV. (B.14)
To calculate the discrete Hilbert transform we take N j=1
advantage of its easier form in the frequency domain where the
Here CV denotes the circular variance [54] of an angular
Hilbert transform creates an artificial imaginary part for the real
distribution obtained by transforming the phase differences
time series by performing a phase shift of the original signal by
π onto the unit circle in the complex plane. In the literature γ
2 while leaving the power spectrum unchanged. This can be is also known as phase locking value [15], as mean phase
seen by applying the convolution theorem
coherence [29], and as the intensity of the first Fourier mode
x̃(t) = −i · FT−1 [FT[x(t)]sign(ω)], (B.10) of the phase distribution [55].
The lower limit can only be obtained for a uniform
where FT denotes the Fourier transform and FT−1
its inverse. distribution of phase differences. However, since in general the
The second method used in this study to extract the phases individual phase distributions are not uniform, the distribution
is based on the wavelet transform [19,53]. In this approach the of phase differences is not uniform either. This results in
phase is determined by the convolution of the respective signal a systematic overestimation of phase synchronization, since
with a modified complex Morlet wavelet [26] even in the case of completely uncorrelated phases, non-zero
values of phase synchronization can be obtained due to non-
Ψ (t) = (eiωc t − e−ωc σ
2 2 /2 2 /2σ 2
) · e−t , (B.11) uniformities in the individual phase distributions.
where ωc is the center frequency of the wavelet and σ denotes To account for this bias, the index of phase synchronization
its rate of decay. This is proportional to the number of cycles n c is compared to the index obtained for the maximum possible
and related to the frequency span by the uncertainty principle. uniformity of the phase difference distribution given the indi-
The convolution of x(t) with Ψ (t) yields a complex time vidual phase distributions. This value can easily be estimated
series of wavelet coefficients by using a surrogate method in which the phases of one sig-
Z nal are shuffled before the calculation of the synchronization
Wx (t) = (Ψ ◦ x)(t) = Ψ (t 0 )x(t − t 0 ) dt 0 index [19]. To yield a reliable statistics, 10 different “phase sur-
rogates” are generated, and the average over the resulting in-
W (t) dices is used as the limit value for uncorrelated phases.
x (t) · e ,
iφx
= AW (B.12)
A corrected and normalized index of phase synchronization
from which the phases can be defined as is thus obtained using the following definition:
Im W (t) if γ < γ S
φxW (t) = arctan . (B.13) 0
Re W (t) γ = γ −γ
∗ S (B.15)
else
1−γS
In the same way W y (t) and φ yW (t) are defined from y(t).
Although based on very different approaches, these two with γ S denoting the mean value for the surrogates. Instead
different definitions of phase are closely related [26]. The of randomizing the phases, also a ranking of the individual
wavelet phase φxW (t) is approximately equal to the Hilbert phase distributions could be used to yield homogenous phase
phase φxH (t) obtained after band pass filtering the time series by distributions.
convolution with W . This correspondence would even become In this study only the standard case of 1:1 phase
exact if W were analytic. Therefore, in the wavelet approach synchronization is investigated, although this index could
the center frequency ωc and the frequency width σ of the easily be adapted to the more general case of n:m
wavelet can serve as parameters to adjust the frequency range synchronization [29]. The index of phase synchronization
of interest. In this study the center frequency ωc was chosen as is confined to the interval [0,1]. Values close to zero
the maximum frequency component of the system (cf. Table 1). are attained for uncorrelated phase differences (no phase
In contrast to this, the Hilbert transform is free of parameters, synchronization) while the maximum value corresponds to
and the Hilbert phase retains information from the entire power Dirac-like distributions (perfect phase synchronization). The
spectrum. most important feature of these indices is that they are only
In principle, one should measure phase synchronization by sensitive to phases, irrespective of the amplitude of the two
observing whether the phase difference φx (t) − φ y (t) stays signals (cf. Ref. [7]).
bounded or not. Due to unavoidable glitches (fake jumps
by ±2π) this is practically impossible, and one has to use B.4. Non-linear interdependencies
statistical measures which, in a strict sense, measure coherence
instead of synchronization. In the following, however, we will As measures for generalized synchronization between two
follow common practice in the literature and use both terms time series x and y, we used the non-linear interdependence
T. Kreuz et al. / Physica D 225 (2007) 29–42 41
S (qualitatively similar results were obtained with the non- based on the relative timings of certain ‘events’ in the time
linear interdependence H ) proposed in Ref. [12]. It is related to series and quantifies the over-all level of synchronicity from the
earlier attempts to detect generalized synchronization like the number of quasi-simultaneous appearances of these events. For
method of mutual false nearest neighbors [10] and the mutual each application a different choice of events is possible, thus
cross predictability introduced in Ref. [20]. In contrast to these enabling one to focus attention on the pattern of interest and
measures, the non-linear interdependence S does not assume reducing the disturbance by irrelevant structures.
a strict functional relationship between the dynamics of the Events can be characteristic patterns in the time series such
underlying systems X and Y . as spikes but also rather common features like local maxima
For state space reconstruction, delay vectors xn = and/or minima. In a first step both time series x and y are
(xn , . . . , xn−(m−1)d ) and yn = (yn , . . . , yn−(m−1)d ) with scanned for these events and the times of their occurrence
y
embedding dimension m and time lag d (cf. Table 1) are are marked as tix and t j (i = 1, . . . , m x ; j = 1, . . . , m y )
obtained. Subsequently, it is checked whether closeness in the with m x and m y denoting the respective number of events.
state space of Y implies closeness in the state space of X for Thus, the original time series are replaced by new series of
equal time partners, and the same is done for the other direction event times (a procedure similar to the method of symbolic
just by exchanging X and Y . dynamics) whose synchronicity is then measured in the second
Denoting the time indices of the k = 10 nearest neighbors step. This reduction of information is a crucial step since event
of xn with rn, j and those of yn with sn, j , j = 1, . . . , k, for synchronization does not measure the synchronization between
each xn the squared mean Euclidean distance to its k neighbors the two time series as a whole, but rather the synchronicity
(after using a Theiler-correction T = 50 to exclude temporally between the defined events. Thus different values are attained
related neighbors [56]) is defined as for different choices of events. Positively speaking event
synchronization is very adaptive, negatively speaking it might
k
1X not be robust.
Rn(k) (X ) =
2
xn − xrn, j . (B.16)
k j=1 In this paper for all coupled model systems an appropriate
representation of the original time series and a suitable statistics
Then, by replacing the nearest neighbors by the equal time was achieved by defining events as local maxima and minima,
partners of the closest neighbors of yn , the y-conditioned i.e., for a maximum the condition x(ti ) > x(ti±1 ) was
squared mean Euclidean distance is given as: employed. Only coincidences of the same type of event were
k
taken into account. To measure the synchronicity of such
1X
Rn(k) (X |Y ) = events, a maximum time lag l was defined up to which two
2
xn − xsn, j . (B.17)
k j=1 events are still considered to be synchronous. Double counting
was avoided by choosing l = 0 smaller than half the minimum
(k)
If the systems are strongly synchronized, then Rn (X |Y ) ≈ inter-event distance.
(k)
Rn (X ) is very small compared to the average squared distance Using
PN (N −1) (k)
R(X ) = N1 n=1 Rn (X ) of {xn }, while Rn (X |Y ) ≈ y
if 0 < tix − t j ≤ l
(N −1) (k) 1
Rn (X ) Rn (X ) holds for independent systems. Jilj = 1/2 if tix = t j
y
(B.20)
Accordingly, the non-linear interdependence measure is defined
0 else
as
N (k)
to quantify the relative timing of all events, the number of times
1 X Rn (X ) an event appears in x shortly after it appears in y is counted by
S(X |Y ) = . (B.18)
N n=1 Rn(k) (X |Y )
my
mx X
X
(k) (k) c(x|y) = Jilj . (B.21)
Since Rn (X |Y ) ≥ Rn (X ) by construction, a proper
i=1 j=1
normalization 0 < S(X |Y ) ≤ 1 is achieved with low
values suggesting independence between X and Y and high With the opposite value c(y|x) defined accordingly, we
values indicating interdependence. Exchanging systems X and obtain the measure [23]
Y yields the opposite interdependence S(Y |X ) defined in
c(y|x) + c(x|y)
complete analogy. In order to obtain a measure quantifying the Q= √ . (B.22)
over-all degree of synchronization we used the symmetrized mx m y
variant This measure is designed to quantify the synchronization of
S(X |Y ) + S(Y |X ) the time events. It is normalized to 0 ≤ Q ≤ 1 with Q = 1 if
S= . (B.19) and only if all events of the signals are synchronous.
2
In analogy to the indices of phase synchronization we
B.5. Event synchronization used a renormalization which accounts for simultaneous events
expected just due to chance: Depending on the choice of events
The last concept is the so-called event synchronization and the number of events in the single time series, even for
proposed in Ref. [23] and later used in Refs. [57,58]. It is independent time series a considerable number of simultaneous
42 T. Kreuz et al. / Physica D 225 (2007) 29–42
events is to be expected. Again this value is estimated by using [21] C.J. Stam, B.W. van Dijk, Physica D 163 (2002) 236.
a surrogate method in which now the events of one individual [22] U. Feldmann, J. Bhattacharya, Internat. J. Bifur. Chaos 14 (2) (2004) 505.
[23] R.Q. Quiroga, T. Kreuz, P. Grassberger, Phys. Rev. E 66 (2002) 041904.
signal are shuffled. To yield a reliable statistics, 10 different
[24] R.Q. Quiroga, J. Arnhold, P. Grassberger, Phys. Rev. E 61 (2000) 5142.
“event surrogates” are generated and the average Q S over the [25] M.G. Rosenblum, A.S. Pikovsky, Phys. Rev. E 64 (2001) 045202(R).
resulting Q-values is used as the new value of reference: [26] R.Q. Quiroga, A. Kraskov, T. Kreuz, P. Grassberger, Phys. Rev. E 65
(2002) 041903.
S
Q − Q
if Q > Q S
[27] D.A. Smirnov, B.P. Bezruchko, Phys. Rev. E 68 (2003) 046209.
S [28] D.A. Smirnov, R.G. Andrzejak, Phys. Rev. E 71 (2005) 036207.
∗
Q = 1 − Q (B.23)
Q − QS [29] F. Mormann, K. Lehnertz, P. David, C.E. Elger, Physica D 144 (2000)
< S
.
if Q Q 358.
QS [30] A. Bruns, J. Neurosci. Meth. 137 (2004) 321.
[31] R.G. Andrzejak, A. Kraskov, H. Stögbauer, F. Mormann, T. Kreuz, Phys.
Using this renormalization, positive (negative) values of Q ∗
Rev. E 68 (2003) 066202.
are attained if more (less) simultaneous events are found than [32] M.A. Kramer, E. Edwards, M. Soltani, M.S. Berger, R.T. Knight,
would be expected if x and y were uncorrelated. The limit A.J. Szeri, Phys. Rev. E 70 (2004) 011914.
values are Q ∗ = 1 for complete event synchronization and [33] H.E. Daniels, M.G. Kendall, Biometrika 34 (1947) 197.
Q ∗ = −1 for complete event anti-synchronization. A similar [34] J. Devore, R. Peck, Statistics: The Exploration and Analysis of Data,
Duxbury Press, Belmont, CA, 2005.
procedure was later used in Ref. [57].
[35] B. Lindner, J. Garcia-Ojalvo, A. Neiman, L. Schimansky-Geier, Phys.
Rep. 392 (2004) 321.
References [36] U. Parlitz, L. Junge, W. Lauterborn, L. Kocarev, Phys. Rev. E 54 (1996)
2115.
[1] C. Huygens, Horoloquium Oscilatorium, Paris, 1673. [37] Z. Zheng, G. Hu, Phys. Rev. E 62 (2000) 7882.
[2] H. Fujisaka, T. Yamada, Progr. Theoret. Phys. 69 (1983) 32. [38] M. Le Van Quyen, J. Foucher, J. Lachaux, E. Rodriguez, A. Lutz,
[3] A.S. Pikovsky, Z. Phys. B: Condens. Matter 55 (1984) 149. J. Martinerie, F.J. Varela, J. Neurosci. Meth. 111 (2001) 83.
[4] V.S. Afraimovich, N.N. Verichev, M.I. Rabinovich, Radiophys. Quantum [39] M. Palus, V. Komárec, Z. Hrncı́r, K. Strebová, Phys. Rev. E 63 (2001)
Electron. 29 (1986) 795. 046211.
[5] L.M. Pecora, T.L. Carroll, Phys. Rev. Lett. 64 (1990) 821. [40] J.-P. Eckmann, D. Ruelle, Rev. Modern Phys. 57 (1985) 617.
[6] A.S. Pikovsky, M.G. Rosenblum, J. Kurths, Synchronization. A Universal [41] T.M. Cover, J.A. Thomas, Elements of Information Theory, John Wiley
Concept in Nonlinear Sciences, Cambridge Univ. Press, Cambridge, UK, and Sons, New York, 1991.
2001. [42] A.M. Fraser, H.L. Swinney, Phys. Rev. A 33 (1986) 1134.
[7] M.G. Rosenblum, A.S. Pikovsky, J. Kurths, Phys. Rev. Lett. 76 (1996) [43] G.A. Darbellay, I. Vajda, IEEE Trans. Inform. Theory 45 (1999) 1315.
1804. [44] P. Grassberger, arXiv:physics/0307138, 2003.
[8] A.S. Pikovsky, M.G. Rosenblum, J. Kurths, Europhys. Lett. 34 (1996) [45] M. Schürmann, J. Phys. A 37 (2004) 295.
165. [46] A. Kraskov, H. Stögbauer, P. Grassberger, Phys. Rev. E 69 (2004) 066138.
[9] G.V. Osipov, A.S. Pikovsky, M.G. Rosenblum, J. Kurths, Phys. Rev. E 55 [47] R.Q. Quiroga, A. Kraskov, T. Kreuz, P. Grassberger, Phys. Rev. E 67
(1997) 2353. (2003) 063902.
[10] N.F. Rulkov, M.M. Sushchik, L.S. Tsimring, H.D.I. Abarbanel, Phys. Rev. [48] M.G. Rosenblum, A.S. Pikovsky, J. Kurths, Phys. Rev. E 63 (2001)
E 51 (1995) 980. 058201.
[11] H.D.I. Abarbanel, N.F. Rulkov, M.M. Sushchik, Phys. Rev. E 53 (1996) [49] L. Callenbach, P. Hänggi, S.J. Linz, J.A. Freund, L. Schimansky-Geier,
4528. Phys. Rev. E 65 (2002) 051110.
[12] J. Arnhold, K. Lehnertz, P. Grassberger, C.E. Elger, Physica D 134 (1999) [50] A.G. Rossberg, K. Bartholome, J. Timmer, Phys. Rev. E 69 (2004)
419. 016216.
[13] R. Gray, Entropy and Information Theory, Springer Verlag, New York, [51] D. Gabor, Proc. IEEE London 93 (1946) 429.
1990. [52] P. Panter, Modulation, Noise, and Spectral Analysis, McGraw-Hill, New
[14] T. Schreiber, Phys. Rev. Lett. 85 (2000) 461. York, 1965.
[15] C.D.C. Tallon-Baudry, O. Bertrand, J. Pernier, J. Neurosci. 16 (1996) [53] J.P. Lachaux, E. Rodriguez, M. Le Van Quyen, A. Lutz, J. Martinerie,
4240. F.J. Varela, Internat. J. Bifur. Chaos Appl. Sci. Eng. 10 (2000) 2429.
[16] P. Tass, M.G. Rosenblum, J. Weule, J. Kurths, A. Pikovsky, J. Volkmann, [54] K.V. Mardia, Probability and Mathematical Statistics: Statistics of
A. Schnitzler, H.J. Freund, Phys. Rev. Lett. 81 (1998) 3291. Directional data, Academy Press, London, 1972.
[17] A. Shabunin, V. Demidov, V. Astakhov, V. Anishchenko, Phys. Rev. E 65 [55] M.G. Rosenblum, A.S. Pikovsky, J. Kurths, C. Schaefer, P.A. Tass,
(2002) 056215. in: F. Moss, S. Gielen (Eds.), Handbook of Biological Physics, Elsevier
[18] M. Palus, A. Stefanovska, Phys. Rev. E 67 (2003) 055201(R). Science, Amsterdam, 2001, p. 297.
[19] J.P. Lachaux, E. Rodriguez, J. Martinerie, F.J. Varela, Hum. Brain Mapp. [56] J. Theiler, Phys. Rev. A 34 (1986) 2427.
8 (1999) 194. [57] R.H.R. Hahnloser, A.A. Kozhevnikov, M.S. Fee, Nature 419 (2002) 65.
[20] S.J. Schiff, P. So, T. Chang, R.E. Burke, T. Sauer, Phys. Rev. E 54 (1996) [58] T. Kreuz, R.G. Andrzejak, F. Mormann, A. Kraskov, H. Stögbauer,
6708. C.E. Elger, K. Lehnertz, P. Grassberger, Phys. Rev. E 69 (2004) 061915.