22email: [email protected]
https://www.binnlabs-goa.in/
Quantifying Synchronization in a Biologically Inspired Neural Network
Abstract
We present a collated set of algorithms to obtain objective measures of synchronisation in brain time-series data. The algorithms are implemented in MATLAB; we refer to our collated set of ‘tools’ as SyncBox. Our motivation for SyncBox is to understand the underlying dynamics in an existing population neural network, commonly referred to as neural mass models, that mimic Local Field Potentials of the visual thalamic tissue. Specifically, we aim to measure the phase synchronisation objectively in the model response to periodic stimuli; this is to mimic the condition of Steady-state-visually-evoked-potentials (SSVEP), which are scalp Electroencephalograph (EEG) corresponding to periodic stimuli. We showcase the use of SyncBox on our existing neural mass model of the visual thalamus. Following our successful testing of SyncBox, it is currently being used for further research on understanding the underlying dynamics in enhanced neural networks of the visual pathway.
Keywords:
Phase Synchronization Steady State Visually Evoked Potentials Phase Locking Value Arnold Tongue Neural Mass Models.1 Introduction
Phase-locking behaviour in neural populations is hypothesised as the basis of efficient information processing in the visual cortex [12]. Phase synchronisation is defined as “the synchronisation between chaotic systems taking only phase-locking into account, with no restriction on amplitudes” [17]. Periodicity and synchrony are ubiquitous in the nervous system both in health (eg. sleep [6]) and disease (eg. Parkinsonian tremor [19]). Thus, neuronal dynamics underlying rhythmic periodicity has been the subject of several research [3, 10, 2, 19]. Of particular interest is the neuronal dynamics corresponding to Steady-state-visually-evoked-potentials (SSVEP), that refer to Electroencephalogram (EEG) recorded from humans and animals when subjected to rhythmic visual stimuli. For a review on the usefulness of SSVEPs in understanding visual information processing and transmission, as well as its application to Brain-Computer Interface, readers may refer to [15, 21, 7]. A proof-of-concept study have validated biologically inspired neural population networks, commonly referred to as neural mass models, to underpin causality in the visual brain circuit corresponding to SSVEP [8]. However, these studies rely on a qualitative evaluation of model response. Indeed, what is desirable in these studies is a set of robust methods that provide an objective measure of phase synchronisation between neural populations in response to periodic input. In this work, we have collated a set of tools implemented on MATLAB to serve this purpose. We refer to our set of tools as SyncBox.
SyncBox implements the following synchronisation measures: Phase Locking Value (PLV), Normalized Shannon Entropy (NSE), Mutual Information, Lambda Synchronization Index (LSI), Spectral Coherence and Phase slip. We have also added Phase histogram plots wrapped on the cyclic degree scale for easy visualisation of synchronisation in noisy time-series data. PLVs are used to explore under what conditions synchronisation take place in a system and is often used to inspect an Arnold Tongue formation of a system response [9].
Spectral coherence has been widely used for measuring synchronisation between two signals and gives a fair idea of relevant coherent frequencies in data, [11], however, PLV is thought to be a more true indicator of synchrony [5] [11]. Normalised Shannon Entropy and the Lambda Measure have been identified as useful n:m synchronisation indices for the statistical analysis of the phase difference between interacting oscillators [17]. Phase slips and polar histogram plots provide a clear way to visualise the phase difference behaviour and put the above measures into perspective [16].
We test our toolbox on an existing neural mass model of the visual thalamus Lateral Geniculate Nucleus (LGN) [1]. We present the model with periodic input at varied frequency and at varying input strength. Applying the various tools in SyncBox allows an objective understanding of the phase synchrony and phase locking in connected neuronal populations, as well as the causality with varying connectivity strengths. Upon successful validation, we are currently implementing this toolbox for further research.
The layout of our paper is thus: In Section 2, we provide a brief overview of the various measures implemented in SyncBox as well as of the LGN network. The simulation methods used in this work are also presented. In Section 3, we present and discuss the results of testing SyncBox on the LGN network response. We conclude the paper in Section 4.
2 Materials and Methods
2.1 Phase Locking Value
The phase relation (i.e. the generalized phase difference) between two coupled system is defined as follows,
(1) |
And the condition for phase locking is as follows,
(2) |
where, represents time and is some average phase shift (a constant value) and is the instantaneous phase relation between the coupled systems [17]. In cases of perfect phase locking, the phase relation , but in realistic conditions of phase synchronization, is nearly constant and observes a dirac-delta like distribution or a "peaky" distribution, where might oscillate (bounded by some constant value as shown in 2)[17]. represents the mode of phase locking . They also represent frequency ratios in which coupled systems can satisfy the condition of phase locking despite different frequencies and as differentiating equation 1, gives us which is the frequency entrainment condition. For example, the modes of phase locking could be 1:1, 1:2, 2:1, 2:3 etc. PLV takes a value from 0 to 1; zero signifying no phase synchrony and one signifying complete phase synchrony.
To compute the PLV between two-time series and , the instantaneous phases of the signals at each time step are extracted using Hilbert transform. Instantaneous linear (unwrapped) phases are converted to wrapped phases which take values from to . Then the phase relation at each time step is represented as a Phasor diagram. Mean vector length of all the phase relations at different time steps is computed as the PLV [17] (See Fig. 1 for a schematic representation).

It is useful to obtain a global map of synchronization regions to analyze the synchronization in population models in response to periodic external stimuli. Synchronization between spiking time-series output of different neuronal populations or between the spike trains and an external input depends on both amplitude and frequency of the input. Thus, one can obtain regions of phase-locking on an amplitude-frequency plane, and these are commonly referred to as Arnold Tongue, due to the tongue like shape chalked out by the high synchrony regions [2].
2.2 Normalised Shannon Entropy
The Shannon Entropy (SE) of a distribution indicates the amount of uncertainty in the value of the variable [18]. For the distribution given by the difference in the phase angles between two signals, SE will indicate the number of different values the phase difference takes. This value can be normalised as described below to obtain the Normalised Shannon Entropy (NSE), , as a measure of the synchronization between the two signals [17].
To give a qualitative description, the phase difference for perfectly synchronised signals, as we know, gives a Dirac-like distribution which has a low Shannon entropy. For independent signals with no synchronisation, the phase difference is free to take any value between to , giving a uniform distribution with high Shannon entropy [17]. The Shannon entropy is normalised to reflect synchronization.
We have used the implementation given by Notbohm et. al. [16]. We take the Hilbert transform of both the signals and calculate the unwrapped phase difference between the angles of the transform. The phase difference is then wrapped between and , and binned as a histogram with bins, where gives the probability of the th bin. The Shannon entropy, of this distribution is calculated and normalised to using the following equations,
(3) |
(4) |
where is the maximum possible Shannon entropy given by . is closer to one for synchronized signals and closer to zero for independent unsynchronized signals.
2.3 Lambda Synchronisation Index
The Lambda Synchronisation Index (LSI) is an implementation of the synchronisation measure described in Rosenblum et al [17]. The phase relation between two oscillating signals is quantified thus: the phase of the second oscillating signal, , is observed at instants of time when the phase of the first oscillating signal, , attains a certain fixed value . phase locking is accounted for by wrapping the phases in intervals of and respectively. The observed phase of the second signal is represented by .
(5) |
The magnitude of the sum of the unit complex vectors given by the observed phase angles of the second signal is used as a measure of synchronisation. For perfectly synchronised signals where the phase difference is constant, would take up the same value for all instances. The sum of the unit complex vectors would be concentrated in one direction. On the other hand, for independent signals, would be free to take up all values between and . In this case, the unit complex vectors would cancel each other out. Let the phase of the first signal have possible values. For the th value of the first phase, let the phase of the second signal have values. The averaged sum for each is given by,
(6) |
Finally, we take the addition of the magnitude of all values of . Thus, the LSI is given by,
(7) |
Since can take infinitely many values, for the purpose of calculation the values of are binned into bins. For our implementation, we have calculated the optimal number of bins using the following formula as described in Rosenblum et al [17],
(8) |
where M is the total number of samples to be binned.
2.4 Spectral Coherence
Spectral coherence measures the normalized correlation between two power spectra.
(9) |
where is the power spectral density (PSD) estimate of signal , is the PSD of signal and is the cross-spectral density (CSD) estimate of signals and [5][11]. CSD is calculated as the Fourier transform of cross-correlation of the signals and . One may think of the CSD as measuring hidden periodicities in the cross-correlation, just like the PSD measures periodicities in the autocorrelation. If the cross-correlation has harmonic content at some frequency , one can interpret as the signals being correlated at that frequency. Thus, this is useful in the quantitative comparison of power spectra of different signals. It is important to note spectral coherence measure assumes stationary processes.
Spectral coherence is calculated between trials of two time series and . We use the following modified formula for spectral coherence, as mentioned in [11] which minimizes the effect of amplitude correlation.
(10) |
2.5 Mutual Information
Mutual information is an information-theoretic measure that can quantify non-linear dependencies between systems, unlike linear cross-correlation. It quantifies the amount of information about one system obtained by knowing about the other system [5] [20]. Kullback-Leibler divergence (KLD) is a measure of the non-symmetric difference between two probability distributions and . Mutual information is defined as KLD between joint probability distribution of two random variables and product of their marginal distribution [5] [20], as follows,
(11) |
where represents the probabilities of the -th state in space and denotes the number of states etc.
Classical approaches for estimating mutual information includes finite-sized binning or bins with adjustable sizes. Alternatively, Kernel Density Estimate (KDE) approach is a non-parametric method for probability densities, and is said to be better than histogram or binning approaches; for example it has a better mean-squared error rate of convergence of the estimate to the underlying distribution (see [14] for details). In SyncBox, we have used the KDE approch to calculate Mutual Information.
2.6 Phase Slip and Polar Histogram
In addition to the above measures, Phase Slip between the responses of neural population is a good visual indicator of their phase relations [16, 17]. Using the phase relations data extracted using the Hilbert Transform for the afore-mentioned measures, the unwrapped phase values are plotted against time. A plateau in the phase slip plots indicates phase synchrony, while a ramp indicates out-of-phase where the degree of mismatch is indicated by the slope of the ramp.
Synchrony in the phase relations of two signals are also well visualised by Polar Histograms [16]. A tight cluster indicates high phase locking, while a noisy relation is indicated by uniformly distributed bins.
2.7 The biologically inspired population neural network

The existing model of the visual thalamus, referred to as the Lateral Geniculate Nucleus (LGN), has three neuronal populations viz. Relay cells (TCR), Reticular Nucleus (TRN) and Interneurons (IN). In an earlier study, we have observed that removing the IN feed-forward connectivity in the network allows for synchrony to set in between the relay cell (excitatory) and reticular neucleus (inhibitory)populations. The synchrony between these two LGN populations have been studied since long in context to understanding their coupled dynamics in neurological disorders. (For details on the LGN model and its dynamics, reader may please refer to [1]). We have tested SyncBox under the presence and absence of IN. The phase locking behaviour indicated in the network conforms to that observed in our previous studies on the model.
2.8 Simulation Methods
All algorithms presented in SyncBox are simulated in MATLAB[13]. Test signals are model responses simulated at 1 msec resolution, filtered with Butterworth bandpass filter between 1 and 200 Hz. Sampling frequency for frequency domain computations was 1000 Hz. The model was simulated for a total of 40 seconds, and the outputs were then extracted between 1 and 30 seconds. The impulse input frequencies are varied from 1 to 30 Hz; all inputs are mixed with uniform noise at a mean -65 mV and a standard deviation of 2 mV.
3 Results and Discussion




At first, we have tested our implementation of the SyncBox on simple coupled oscillators as indicated in [11]. Next, we apply SyncBox on the LGN network response, and our observations are presented in this section.
In Fig. 3, we present a comparative study of synchronization in the model with a high and a low signal-to-noise ratio (amplitude of the input impulse as 5 and 10 respectively). As observed in [1], we note that PLVs between TCR and TRN time-series responses are high between frequencies 5 – 20. The NSE and LSI also confirm this observation. However, the Spectral coherence plots are jittery. Interestingly, Lowet et al [11] showed that within a large parameter range, the spectral coherence measure deviated substantially from the expected phase locking. They showed that spectral coherence did not converge to the expected value with increasing Signal-to-Noise-Ratio (SNR) and failed particularly when synchronization was partial or intermittent, which is expected to be the most likely state for neural synchronization. One of the reasons is that spectral coherence measure assumes the stationarity in the signals whereas PLV do not rely on the stationarity of the signals and are therefore much more accurate, reliable and broadly applicable. Overall, our results showing Spectral Coherence to be a less reliable measure of phase synchrony agrees with those of Lowet et al. [11].


As indicated in Sec. 2.1, the mean of the PLVs between two neural populations, corresponding to varying input frequency and amplitude, can be plotted as a 2-D grid. The degree of synchrony often increases with increasing input amplitude and can be observed as an Arnold Tongue formation. Figure 4 shows the Arnold Tongue formation between the TCR and TRN population responses with input impulse train frequencies varied over 1 to 100 Hz, and with impulse amplitude varied over 1 to 15 mV. The line plots in Fig. 3(a) also conform to the Arnold Tongue formation in the circuit. The 2-D plot gives a global map of regions of phase synchronization in the population network for different input amplitudes and input frequencies.
Another visualisation technique to understand phase synchrony between neural populations is to drive them at ‘detuned’ frequency with reference to a base frequency, and observing the PLV. The degree of synchronisation between two coupled system under study will depend on the difference between their intrinsic frequencies referred to as detuning (), and their coupling strength . The phase-locking behaviour can be observed by simultaneously varying and . In Fig. 5, we have shown the PLV over shorter durations (2 second intervals) between the output timeseries of TCR populations the LGN network at base input frequency ( Hz) and a detuned input frequency ( Hz). We vary the amplitude of input signal which thereby increases SNR, thus has a similar effect to that of varying the coupling strength between two oscillators . The input impulse frequency to one TCR population is maintained at 10 Hz and is noise free, while the input impulse frequency of the second TCR population is varied as (Hz), (Hz) and is noisy. This is done for varying input amplitudes . As expected, with higher , the PLV is higher. However, the width of the ‘inverted tongue’ is the same irrespective of . Readers may note that we have only used PLV measure in this study; a full exploration of the space may show further interesting dynamics and is left as future work. For longer durations of 30 seconds, we observe no sustained synchronization in this set up. Future work can include a study of synchronization when the two LGN models are coupled with biologically inspired connections in the differential equation based model, where one can vary these coupling strengths directly instead of varying the SNR and we can expect to see sustained phase-locking in such scenarios, as seen in simpler Izhikevich based coupled networks [11].


<<
Lastly, we demonstrate phase relation between TCR and TRN populations using Phase slip plots (Fig. 6(b)) and Polar Histogram (Figures 6(b), 6(a)). As indicated in Sec. 2.7, the LGN model is simulated as full circuit, and then with the IN removed, and the phase relation between the TCR and TRN is captured. Narrow clustered formation in Fig. 6(a) indicate high phase synchrony when model is simulated with IN disconnected and high SNR —impulse input at 10 Hz and at an amplitude of 10 mV. In contrast, with IN connected in the circuit, and with a low SNR, impulse input at 2 Hz and at an amplitude of 5 mV, the synchrony between TCR and TRN is lower and the Polar Histogram has a wider spread of the bins as shown in Fig. 6(a). The phase slip plots in Fig. LABEL:fig:Phase_slips confirm this observation— plot is flat for the high SNR, high synchrony case, and is a ramp for low SNR, low synchrony.
4 Conclusion and Future work
We have been working on understanding phase-locking, and phase synchronisation in an existing biologically inspired population neural network, commonly referred to as a neural mass model, of the visual thalamus. Towards this, we have collated a set of tools implemented on Matlab, SyncBox. The algorithmic implementation in SyncBox are informed by those in [5] (Mutual Information), [4] (Phase Locking Value, Spectral Coherence), [16] [17] (Normalised Shannon Entropy, Lambda Synchronisation Index). We have also added visualising phase synchrony using Arnold Tongue plot, Phase slip plot and Polar Histogram as indicated in [16]. We have tested the SyncBox on our model, under two known parameterised condition as presented in [1]. The observed synchronisation measures agree with those observed qualitatively in time-series plots.
Encouraged by our positive test results above, we are now in the process of using the SyncBox measures in an enhanced neural mass model of the visual pathway. However, we understand that we could not include other useful measures of phase synchronisation (e.g. phase transfer entropy) in the toolbox due to time constraints. Furthermore, and although a part of our toolbox, we have not shown the Mutual Information plots as our study on this measure is still in progress; we intend to demonstrate this in upcoming publications. As future work, we endeavour to improve upon the currently available repertoire of tools in SyncBox, which will also be made freely availables for use by the larger scientific community.
References
- [1] Bhattacharya, B.S., Durrant, S.J.: A neural mass computational framework to study synaptic mechanisms underlying alpha and theta rhythms. In: Computational Neurology and Psychiatry, pp. 405–427. Springer (2017)
- [2] Farokhniaee, A., Large, E.W.: Mode-locking behavior of izhikevich neurons under periodic external forcing. Physical Review E 95(6), 062414 (2017)
- [3] Glass, L.: Synchronization and rhythmic processes in physiology. Nature 410(6825), 277–284 (2001)
- [4] Kraskov, A., Stögbauer, H., Grassberger, P.: Estimating mutual information. Physical Review E - Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics 69(6), 16 (2004)
- [5] Kreuz, T.: Synchronization measures. Principles of Neural Coding pp. 97–120 (2013)
- [6] Krueger, J.M., Huang, Y.H., Rector, D.M., Buysse, D.J.: Sleep: a synchrony of cell activity-driven small network states. European Journal of Neuroscience 38(2), 2199–2209 (May 2013). https://doi.org/10.1111/ejn.12238, https://doi.org/10.1111/ejn.12238
- [7] Kuś, R., Duszyk, A., Milanowski, P., Łabęcki, M., Bierzyńska, M., Radzikowska, Z., Michalska, M., Żygierewicz, J., Suffczyński, P., Durka, P.J.: On the quantification of SSVEP frequency responses in human EEG in realistic BCI conditions. PLoS ONE 8(10), e77536 (Oct 2013). https://doi.org/10.1371/journal.pone.0077536, https://doi.org/10.1371/journal.pone.0077536
- [8] Labecki, M., Kus, R., Brzozowska, A., Stacewicz, T., Bhattacharya, B.S., Suffczynski, P.: Nonlinear origin of ssvep spectra—a combined experimental and modeling study. Frontiers in Computational Neuroscience 10, 129 (2016). https://doi.org/10.3389/fncom.2016.00129, https://www.frontiersin.org/article/10.3389/fncom.2016.00129
- [9] Lachaux, J.P., Rodriguez, E., Martinerie, J., Varela, F.J.: Measuring phase synchrony in brain signals. Human brain mapping 8(4), 194–208 (1999)
- [10] Longtin, A., Bulsara, A., Pierson, D., Moss, F.: Bistability and the dynamics of periodically forced sensory neurons. Biological cybernetics 70(6), 569–578 (1994)
- [11] Lowet, E., Roberts, M.J., Bonizzi, P., Karel, J., De Weerd, P.: Quantifying neural oscillatory synchronization: A comparison between spectral coherence and phase-locking value approaches. PLoS ONE 11(1) (2016)
- [12] Martin, K.A., Schröder, S.: Phase locking of multiple single neurons to the local field potential in cat v1. Journal of Neuroscience 36(8), 2494–2502 (2016)
- [13] The Mathworks, Inc., Natick, Massachusetts: MATLAB version 9.9.0.1462360 (R2020b) (2020)
- [14] Moon, Y.I., Rajagopalan, B., Lall, U.: Estimation of mutual information using kernel density estimators. Physical Review E 52(3), 2318 (1995)
- [15] Norcia, A.M., Appelbaum, L.G., Ales, J.M., Cottereau, B.R., Rossion, B.: The steady-state visual evoked potential in vision research: A review. Journal of vision 15(6), 4–4 (2015)
- [16] Notbohm, A., Kurths, J., Herrmann, C.S.: Modification of brain oscillations via rhythmic light stimulation provides evidence for entrainment but not for superposition of event-related responses. Frontiers in Human Neuroscience 10, 10 (2016). https://doi.org/10.3389/fnhum.2016.00010, https://www.frontiersin.org/article/10.3389/fnhum.2016.00010
- [17] Rosenblum, M., Pikovsky, A., Kurths, J., Schafer, C., Tass, P.: Chapter 9 phase synchronization: From theory to data analysis. In: Neuro-Informatics and Neural Modelling, pp. 279–321. Elsevier (2001). https://doi.org/10.1016/s1383-8121(01)80012-9, https://doi.org/10.1016/s1383-8121(01)80012-9
- [18] Shannon, C.E.: A mathematical theory of communication. The Bell system technical journal 27(3), 379–423 (1948)
- [19] Tass, P., Rosenblum, M.G., Weule, J., Kurths, J., Pikovsky, A., Volkmann, J., Schnitzler, A., Freund, H.J.: Detection of phase locking from noisy data: Application to magnetoencephalography. Phys. Rev. Lett. 81, 3291–3294 (Oct 1998). https://doi.org/10.1103/PhysRevLett.81.3291, https://link.aps.org/doi/10.1103/PhysRevLett.81.3291
- [20] Tzannes, N.S., Noonan, J.P.: The mutual information principle and applications. Information and Control 22(1), 1–12 (1973)
- [21] Vialatte, F.B., Maurice, M., Dauwels, J., Cichocki, A.: Steady-state visually evoked potentials: Focus on essential paradigms and future perspectives. Progress in Neurobiology 90(4), 418–438 (Apr 2010). https://doi.org/10.1016/j.pneurobio.2009.11.005, https://doi.org/10.1016/j.pneurobio.2009.11.005