Research Article

in

EMDR for Depression: A Meta-Analysis and Systematic Review

Advertisement
Focus
  PreviousNext  

Abstract

The literature on the efficacy of eye movement desensitization and reprocessing (EMDR) for treating depression is heterogeneous due to research design, quality issues, and trials methodology. The current meta-analysis seeks to examine EMDR for depression with the aim of answering the aforementioned limitations. Thirty-nine studies were included for analysis after a review of the relevant literature. Univariate meta-regressions were run to examine dose-response and the effect of moderating variables. Subanalysis for primary and secondary depression showed a large, significant, and heterogeneous effect-size estimates, where EMDR significantly improved symptoms of depression in contrast to all control types. At post hoc, data were reexamined and a significant and large, yet heterogeneous, effect-size estimate emerged between the EMDR and control arm after the removal of two outliers [Hedges' g = 0.70, 95% CI =0.50–0.89, p-value < .01, I2 = 70%, K = 37]. This is the first meta-analysis examining for the effect of EMDR comparing to various control modalities on depression with dose-response. We found (a) that studies were balanced at onset in terms of depression severity, and (b) a large and significant effect of EMDR on depression at the end of trials. Additionally, the significance of the aggregate effect-size estimate at the end of trials was unchanged by the intake of psychotropic medications, reported demographic variables, or EMDR methodology.

Eye movement desensitization and reprocessing (EMDR) therapy was developed in 1989 by the late Francine Shapiro (Shapiro, 1989) and aimed to treat traumatic memories and associated symptoms. This psychotherapeutic approach involves a standard eight-phase protocol that consists of bilateral stimulation to reprocess and integrate traumatic memories (Landin-Romero et al., 2018; Shapiro, 2018). The treatment targets memories of adverse life experiences, which produce negative symptoms when activated by sensory cues. Following EMDR treatment, neurobiological research has found recovery of brain structural organization, with successful processing of traumatic memories and related symptom reduction (Bossini et al., 2017; Boukezzi et al., 2017). Evidence emerging from several meta-analyses (Benish et al., 2008; Bradley et al., 2005; Chen et al., 2015; Chen et al., 2014; Davidson & Parker, 2001; Jonas et al., 2013; Seidler & Wagner, 2006; Van Etten & Taylor, 1998) shows that EMDR is an evidence-based treatment for posttraumatic stress disorder (PTSD).

Literature Review

Depression may be triggered and sustained by stressful life events and traumatic experiences, and research has indicated that chronic and acute stressors can trigger depressive episodes (Heim & Nemeroff, 2001; McFarlane, 2010). Risch et al. (2009) found that “stressful life events are the only risk factor to be significantly correlated with the onset of depression” (p. 2). Several studies have shown how events like physical and emotional abuse are significant psychosocial risk factors for the development of major depressive disorder, and have been linked with a poorer response and remission outcome for standard antidepressant treatment and higher severity of symptoms (Bahk et al., 2017; Dias de Mattos Souza et al., 2016; Tunnard et al., 2014; Vitriol et al., 2017; Wiersma et al., 2009; Williams et al., 2016). Therefore, it seems reasonable that a therapy that has been very successful in treating trauma can also help treat depression (if the patient has experienced any traumatic events over their lifetime).

Several studies have tested EMDR therapy as either the main treatment or adjunctive treatment for primary depression and depressive symptoms, and have garnered favorable, yet heterogeneous, results. For example, a systematic review of EMDR studies for the treatment of PTSD or pain (Wood & Ricketts, 2013), which considered depression as a comorbid diagnosis, concluded that comorbid depression along with PTSD symptoms could be significantly reduced with EMDR therapy. Carletto et al. (2017) later updated the systematic review by Wood and Ricketts (2013) and focused on controlled studies that examined the efficacy of EMDR therapy for primary depression and reported benefits of EMDR in treating depression. The authors concluded that the body of research is still in its infancy and that further studies are needed to support the validity of EMDR in being considered as an effective intervention in depression.

Some studies with limited neurobiological basis have posited that EMDR can be a viable alternative treatment approach, or a second option to failed primary treatment for depression (Minelli et al., 2019; Ostacoli et al., 2018). Ostacoli et al. (2018) recently published a quantitative Randomized Controlled Trial (RCT), which compared the efficacy of EMDR and cognitive behavioral therapy (CBT) as adjunctive treatments (to antidepressants) in patients with recurrent depressive disorder. EMDR therapy treatment was shown as effective as CBT in the reduction of depressive symptoms, both at the end of treatment and 6 months later. Minelli et al. (2019) conducted an RCT to compare the efficacy of EMDR and trauma-focused CBT in treatment-resistant depression (TRD). The findings indicated a decrease in depression symptoms in both treatment groups, with EMDR treatment showing greater efficacy. At the follow-up assessment, only EMDR maintained clinical improvements. These studies are encouraging in their application of these two interventions in different populations and settings, yet they come with design heterogeneity that encompasses various EMDR trial durations and assessment approaches. Similarly, other studies, for instance, differently examined this effect via an EMDR Integrative Group Protocol with a crossover research design (Passoni et al., 2018).

A recent quantitative meta-analysis of RCTs that examined EMDR versus CBT in patients with PTSD to compare the efficacy of both in alleviating PTSD-related symptoms, anxiety, and depression was conducted by Khan et al. (2018). The results of the meta-analysis showed no significant difference between the two treatment modalities in reducing depression; however, EMDR was better than CBT in reducing anxiety and PTSD symptoms (Khan et al., 2018).

The review of the literature on the efficacy of EMDR in treating depression has shown very promising results. However, there have been several limitations, mainly consisting of methodological variations (e.g., using different depression rating scales), which render generalizability of results difficult. Additionally, the effect of psychotropic medication and other factors, such as study designs (randomized or not), primary versus secondary depression, or that comorbid depression was accompanying a psychiatric or medical condition (e.g., PTSD vs. cancer), has not been taken into consideration.

Aim of the Current Meta-Analysis

The literature on the efficacy of EMDR in treating depression is heterogeneous due to research design and quality, and treatment methodology. Thus, we intend meta-analytically to examine the effect of EMDR on depression with the aim of answering some of the underscored limitations.

Method

Search and Coding Strategy

Initial search of the electronic literature (PsycINFO & PubMed) was carried on April 15, 2019. Two assessors (KL and AAS) individually examined the retrieved studies by a priori set selection criteria. Search terms were as follows. For PubMed: ((“depressive disorder“[MeSH Terms] OR (“depressive“[All Fields] AND “disorder“[All Fields]) OR “depressive disorder“[All Fields] OR “depression“[All Fields] OR “depression“[MeSH Terms]) OR (“consciousness disorders“[MeSH Terms] OR (“consciousness“[All Fields] AND “disorders“[All Fields]) OR “consciousness disorders“[All Fields] OR “depressed“[All Fields]) OR depressive[All Fields] OR (“affect“[MeSH Terms] OR “affect“[All Fields] OR “mood“[All Fields]) OR (“affect“[MeSH Terms] OR “affect“[All Fields])) AND (“eye movement desensitization reprocessing“[Mesh] OR “EMDR“[All Fields]). For PsycINFO: Boolean/Phrase [depressive disorder* OR Depressive OR depression OR depressed OR consciousness disorder* OR affect OR mood] AND [eye movement desensitization reprocessing OR EMDR].

Studies were included if they were (a) providing either cross-sectional or observational data on studies of EMDR versus other treatment, (b) adult patients, (c) assessed primary or secondary depression, and (d) English language abstracts. See e-supplement 1 for the list of included studies with demographic presentation.

Studies were excluded if: (a) literature review, letter to editor, conference abstract, thesis/dissertation abstract, meta-analysis (pooled data studies, individual patient meta-analysis), single case experimental design, case report, case series (<5 person), book chapters, and reporting study protocol; (b) non-English language papers; (c) no data on depression assessment endpoint was reported; and (d) hybrid psychotherapy treatment as a treatment arm was also excluded. Also, we have excluded studies if their validity was questionable, as confirmed with the original publishing journal. See e-supplement 2 for the list of excluded studies.

The PRISMA flow diagram (Moher et al., 2009) was used to exhibit our data selection process (see Figure 1). We examined for study quality and statistical heterogeneity, and source of bias as necessary. Univariate meta-regression analyses, with method of moments, were run to examine dose-response and the effect of moderating variables [e.g., demographics (age, sex, country of data), depression variables (assessment scales, depression type, medication/psychotropic intake, medical-psychiatric comorbidity), EMDR-related variables (duration of trials, duration, and number of sessions), and study level variables (randomized, type of control group)]. Forest plot was used to present the estimated results per studies and an aggregate result. The study was submitted to PROSPERO for transparency (registration identification number: CRD42019138815). We used the STROBE checklist (Vandenbroucke et al., 2007) for the quality assessment of the studies to keep a consistent quantitative scoring across studies, and given the lack of consensus among authors on quality assessment (Moskalewicz & Oremus, 2020). Subsequently, we have also examined the quality of the studies with well-recognized qualitative tools including version 2 of the Cochrane risk-of-bias (ROB 2) tool for randomized trials (Sterne et al., 2019) and the Newcastle-Ottawa Scale (NOS) for observational studies (Wells et al., 2019). See e-supplement 3, e-supplement 4, and e-supplement 5, for quality assessment tables.

Data Analysis Strategy

We retrieved mean, standard deviation (SD), and the sample size for each arm of each study comparing EMDR to controls. In the absence of SD, we used the reported standard error values (SD = SE × SQRT N), the 95% confidence interval (CI) [SD = SQRT N × (CI upper level − CI lower level)/3.92; where 3.92 is 2 × 1.96] to estimate the SD values needed for analysis, or used the reported p-values and effect-size in the absence of all other data. Additionally, we retrieved categorical and continuous-type data specific to moderating factors as needed.

We calculated an effect-size estimate under the random effect model, with associated 95% CI for each study, and subsequently run an aggregate effect-size estimate (Hedges' g) using the mean, SD, and the sample size for each arm of the studies (both at baseline and end point). We have used the random effect model at onset, since the result of the in-house feasibility assessment of a dozen papers was heterogeneous in terms of the mean difference between the EMDR and control arms of the studies.

We referred to the Cochran Q and I2 tests in the evaluation of heterogeneity, where a significant Q test indicates that the variation among studies may be attributed to heterogeneity rather than chance, and larger I2 values indicate increasing heterogeneity (Babikian et al., 1990). For the assessment of publication bias, we referred to both graphical examination of data via a funnel plot and statistical evaluations using Begg and Mazumdar's (1994) rank correlation (the Kendall's tau with continuity correlation), Egger's regression intercept (Egger et al., 1997), and Duval and Tweedie's trim and fill (Duval & Tweedie, 2000). Additionally, we used the classical fail-safe N (Orwin, 1983) to examine the robustness of our findings.

Univariate meta-regressions, method of moments, were carried for examination of the effects of moderating factors on the effect-size estimates as appropriate.

A kappa coefficient for the inter-rater reliability of study coding was calculated using the standard approach via a Microsoft Excel sheet. For all data analysis, we set the alpha level to .05 and used the Comprehensive Meta-Analysis software (Ver. 2.0) (Borenstein et al., 2005).

Figure 1.
PRISMA-style flow diagram showing study selection for meta-analysis on EMDR for depression literature.
sgremdr_15_1_5

Results

Study Selection/Demographics

A total of 539 abstracts were retrieved, with an added 17 studies that we had collected during a feasibility assessment for meta-analysis. After duplicates were removed, we screened 488 abstracts and excluded 425 based on a priori set selection criteria. Sixty-three remained to be examined at the article level and, after review, 23 did not meet selection criteria, resulting in 40 studies. After further examination with the librarian of the authenticity of published manuscripts, and contact with a journal, we had to eliminate another study, leaving 39 studies for meta-analysis with total N of 1,738 (899 control and 839 EMDR). See Figure 1 for PRISMA flow diagram.

The kappa rate of agreement between study coders (AAS and KL) was 88%, and in the event of a discrepancy, the conflict was resolved by discussion between the coders.

Studies Included

A total of 39 studies provided cross-sectional data [RCTs (K = 30), quasi-experimental/observational studies (K = 9)] met selection criteria that were published between 1994 and 2019. The included studies had single to multiple comparison arms (e.g., treatment as usual, wait-list, various psychotherapies) with various follow-up durations. Average age distribution of the patients in the EMDR arm ranged between 27.6 and 63, and the sex average distribution was ranging between 0% and 100% [mean of 60% (SD = 35)] female. These studies, emerging from the Americas, Asia, Australia, and Europe, included patients currently treated with and without psychotropic medications, with some studies not specifying. The EMDR treatment duration of trials ranged between <1 and 24 weeks. In these studies, depression was either primary (K = 6) or secondary (K = 33) to a medical or neuropsychiatric condition. Depression status was measured either via full scales (Beck Depression Inventory I or II, Center for Epidemiologic Studies Depression Scale, Hamilton Rating Scale for Depression, Montgomery–Åsberg Depression Rating Scale, and Patient Health Questionnaire-9) or subscales (Hospital Anxiety and Depression Scale-depression, Hopkins Symptom Checklist-depression, Depression Anxiety Stress Scale-21-depression, Problem Report Form-depression, and Symptom Checklist-90R-depression). Three of the 39 studies did not provide baseline data. See e-supplement 6 for description of included studies.

Results of Data Analysis

Depression

At baseline, using the random effect model on all studies (including both primary and secondary depression), either no significant or very small differences emerged between the EMDR arm and the control arms, without significant heterogeneity [Hedges' g (g) = −0.02, 95% CI = −0.16–0.12,p-value = 0.80, I2 = 43%, K = 36], suggesting that the groups were balanced at onset regarding depression symptoms severity.

At the end of trials, a significant and large, yet heterogeneous, effect-size estimate emerged between treatment and control arms [Hedges' g = 0.89, 95% CI = 0.62–1.17, p-value < .01, I2 = 84%, K = 39].

Subanalysis for studies examining depression as a primary outcome showed a large, significant, and heterogeneous effect-size estimate [Hedges' g = 1.36, 95% CI = 0.27–2.45, p-value = .01, I2 = 92%,K = 6], and for depression as a secondary condition/comorbidity, the effect-size estimate was also large, significant, yet heterogeneous [Hedges' g = 0.78, 95% CI = 0.52–1.04, p-value < .01, I2 = 81%, K = 33]. Examining for the effect of assessment scales (full scale vs. subscale) on EMDR to all control comparisons, the effect-sizes for studies using full scales was large and heterogeneous [Hedges' g = 0.81, 95% CI = 0.57–1.04, p-value < .01, I2 = 84%, K = 48), as well as those using subscales [Hedges' g = 0.73, 95% CI = 0.31–1.15,p-value < .01, I2 = 81%, K = 12]. See Figure 2.

EMDR

EMDR significantly improved symptoms of depression in contrast to all control types. All effect-size estimates ranged between medium to large size, and were heterogeneous. See Table 1 for analysis results.

Dose-Response

The effect-size estimates for studies reporting exact and approximate number of EMDR sessions were large and significant, yet heterogeneous (approximate: Hedges' g = 1.099, 95% CI = 0.52–1.68, p-value < .01, I2 = 83%, K = 7; exact: Hedges'g = 0.82, 95% CI = 0.51–1.13, p-value < .01, I2 = 85%,K = 32). The univariate meta-regression analysis examining the effect of number of sessions, where the exact average value was reported by the studies (K = 32), the EMDR treatment response for depression was nonsignificant (slope = −0.0293, SE = 0.0297, p-value = .3244).

The effect-size estimates for studies reporting exact and approximate duration of EMDR trials (in weeks) were large in magnitude and significant, yet heterogeneous [approximate: Hedges' g = 1.30, 95% CI = 0.53–2.07, p-value < .01, I2 = 92%, K = 10; exact: Hedges'g = 0.70, 95% CI = 0.46–0.93, p-value < .01, I2 = 71%,K = 29]. The univariate meta-regression analysis, examining for the effect of duration of trials where the exact value was reported by the studies (K = 29) on the EMDR treatment response for depression, yielded a nonsignificant effect (slope = −0.0123, SE = 0.0189, p-value = .5155).

The effect-size estimates for studies reporting EMDR session times were significant in favor of EMDR treatment, and medium to large in magnitude, yet heterogeneous (approximate: Hedges' g = 1.05, 95% CI = 0.55–1.54, p-value < .01, I2 = 91%,K = 18; exact: Hedges' g = 0.67, 95% CI = 0.44–0.90,p-value < .01, I2 = 56%, K = 21). The univariate meta-regression analysis, examining for the effect of sessions time where the exact value was reported by the studies (K = 21) on the EMDR treatment response for depression, yielded a nonsignificant effect (slope = −0.0004, SE = 0.0073, p-value = .9577]. See Table 1.

Univariate meta-regressions of EMDR average age and percent female showed nonsignificant effect of these moderating factors on the effect-size estimate (age: K = 27, slope = −0.0003, SE = 0.0214,p-value = .9886; percentage of female participants:K = 31, slope = 0.003, SE = 0.0047, p-value = .5312). Similarly, the effect of publication year and quality of studies by STROBE were nonsignificant (publication year: K = 60, slope = 0.0040, SE = 0.0125, p-value = 0.7495; quality: K = 60, Slope = 0.0059; SE = 0.0158; P-value = 0.7085). This trend was consistent for the six studies specifically examining primary depression (mean age: slope = −0.0324, SE = 0.0860,p-value = .7067; percentage of female participants: Slope = 0.0144, SE = 0.0206, p-value = .4853; publication year: slope = −0.0216, SE = 0.3528,p-value = .9512; quality: slope = −0.1137, SE = 0.1677, p-value = .4978]. Additionally, no significant variation existed on study quality among nonobservational studies (Z = 0, SD = 0) when the Cochrane ROB 2 tool was implemented, and for observational studies [Slope: 0.0918; SE: 0.1341;p-value: .4937] when the NOS was implemented. See e-supplement 7 for graphical representation of meta-regressions.

Figure 2.
Forest plot showing studies (K = 39) with omnibus effect-size estimate at the endpoint (follow-up not included).
sgremdr_15_1_7
TABLE 1.
Effect-Sizes Estimates (Random Effect Model)
Effect Size and 95% Confidence IntervalTest of Null (Two-Tail)Heterogeneity
GroupsKEffect-size (Hedges' g)Lower limitUpper limitz-valuep-valueQ-valuedf (Q)p-valueI2(%)
Baseline36−0.0172−0.24610.8056−0.2461.805661.638035.003643
END390.87020.60491.13566.4276.0000236.780238084
Control-Arm Type
 Pharmacotherapy30.88780.04211.73342.0576.039613.55082.001185
 Therapy290.44440.19660.69223.5155.0004131.184828.000079
 Treatment as usual101.11570.45931.77213.3314.000972.10519.000088
 Wait-list181.15460.83191.47737.0135.000062.099017.000073
Depression type
 Primary61.35710.26822.44602.4427.014658.91025.000092
 Secondary330.78190.52391.03995.9396.0000165.404032.000081
Scale type
 Full480.80660.57341.03986.7786.0000289.198947.000084
 Sub120.73060.31301.14823.4292.000655.275811.000080
Scales
 BDI340.83390.51691.15095.1557.0000240.419333.000086
 CES-D21.1741−0.52622.87441.3534.17597.49421.006287
 HADS Depression60.74540.17571.31502.5646.010327.25345.000182
 HAM-D10.90080.02751.77412.0217.04320.000001.00000
 HDRS31.07310.56461.58154.1366.00001.98592.37050
 HSCL-Depression11.70591.16262.24936.1535.00000.000001.00000
 MADRS30.7219−0.13831.58201.6449.100010.21532.006180
 PHQ-940.23010.04980.41052.5007.01242.74923.43190
 PRF-Depression30.2503−0.76471.26530.4833.62899.58842.008379
 SCL-90R depression Subscale30.92840.44681.41013.7779.00022.64552.266424
Continents
 Americas90.63160.27540.98793.4750.000516.16098.040150
 Asia41.7242−0.06263.51101.8913.058645.27193.000093
 Asia-Europe31.0759−0.13542.28731.7408.081727.50042.000093
 Australia30.56200.10361.02042.4029.01631.18932.55180
 Europe200.80630.46211.15064.5905.0000118.865919.000084
Medication allowed
 No101.28530.58511.98553.5978.000388.62929.000090
 NS130.69800.37031.02574.1746.000029.987512.002860
 Yes160.73000.34261.11743.6929.000296.702315.000084
EMDR-trial duration (weeks)
 Approx and NR101.29800.52942.06663.3101.0009117.76589.000092
 Exact290.69900.46460.93335.8467.000097.987928.000071
EMDR-session time (min)
 Approx and NR181.04490.54981.54014.1360.0000187.095117.000091
 Exact210.66900.43540.90275.6127.000045.394720.001056
EMDR-sessions (#)
 Approx and NR71.09870.52051.67693.7242.000234.80166.000083
 Exact320.82120.51041.13205.1785.0000201.845431.000085
Follow-up (Yes/No)
 No170.69790.41650.97944.8608.000060.617216.000074
 Yes221.01750.56261.47254.3837.0000170.808221.000088
Randomized/observational
 No90.64380.24231.04523.1431.001732.70928.000175
 Yes300.94480.60991.27975.5296.0000197.067829.000085
Number of control arms
 1271.04100.67431.40775.5638.0000191.457026.000086
 2110.48130.20970.75293.4737.000521.323010.019053
 310.2507-0.57521.07660.5949.55190.000001.00000
EMDR-Sex-reported
 No80.63900.28460.99343.5339.000412.48227.085844
 Yes310.92240.60491.23995.6935.0000223.942630.000087
EMDR-Age-reported
 No110.99250.42101.56403.4036.000765.506310.000085
 Yes280.82430.52171.12685.3401.0000167.394727.000084
Original condition
 Addiction1−0.1466−0.75500.4617−0.4724.63660.000001.00000
 Cancer-PTSD10.5850−0.25591.42591.3635.17270.000001.00000
 Cardiac-PTSD10.64980.04031.25932.0897.03660.000001.00000
 Depression61.35710.26822.44602.4427.014658.91025.000092
 Glioblastoma11.71620.97412.45834.5325.00000.000001.00000
 MI13.89533.03784.75278.9039.00000.000001.00000
 MS-PTSD10.1190−0.47560.71370.3923.69480.000001.00000
 PTS20.3951−0.20100.99111.2990.19400.74301.38870
 PTSD200.57570.33440.81704.6765.000060.764619.000069
 PTSD-Domestic violence11.19910.32032.07782.6744.00750.000001.00000
 PTSD-symptom11.74940.65502.84373.1330.00170.000001.00000
 Sexual abuse10.6598−0.48041.80001.1341.25670.000001.00000
 Somatic symptom disorder11.76981.18782.35175.9603.00000.000001.00000
 Subsyndromal Bipolar11.75450.66442.84463.1546.00160.000001.00000
Medical-Psychiatric Comorbidity
 Medical22.79470.65944.93002.5652.010314.18431.000293
 Mixed40.56860.14730.98982.6456.00824.22133.238529
 Psychiatric330.78170.51881.04465.8270.0000169.026332.000081

Note. HDRS = Hamilton Depression Rating Scale; MADRS = Montgomery-Asberg Depression Rating Scale; PHQ-9 = Patient Health Questionnaire; PTSD = posttraumatic stress disorder; PTS = posttraumatic stress.

Heterogeneity/Publication Bias

Publication bias was observed on the funnel plot at the end of trials, but not at the baseline (see Figure 3). Also, evidence of publication bias at the end of studies was observed on statistical analysis (Begg and Mazumdar rank correlation, and Egger's regression intercept). For the Begg and Mazumdar rank correlation, the Kendall's tau with continuity correlation was significant [p-value (two-tail) = .004], and for Egger's regression intercept, regression was significant [p-value (two-tail) = .006]. This trend was supported by the Duval and Tweedie's trim and fill approach, which asks how the effect-size would shift if the apparent bias were to be removed; we found seven studies to be at the right of the mean within the random effect model, which needed to be adjusted. After the adjustment, the aggregate effect-size estimate increased to 0.93, 95% CI: 0.83–1.02. The aggregate observation from the funnel plot and statistical approaches confirmed the presence of possible publication bias.

Sensitivity Analysis

The classical fail-safe N analysis, with alpha .05, at two-tail, with the empirical z-value of 1.96 and observed z-value of 14.40, and 39 included studies, showed that we would need 2,067 similar studies to raise the p-value above the significant alpha level for the obtained effect-size estimate. Thus, it can be concluded that the entire observed effect is not an artifact of bias.

Post Hoc

Examining for the effect of three studies (Kohler et al., 2017; Ostacoli et al., 2018; Silver et al., 1995) that did not provide baseline data, we have obtained a large and significant, yet heterogeneous, effect-size estimate in favor of EMDR [Hedges' g = 0.80, 95% CI = 0.55–1.05, p-value < .01, I2 = 80%,K = 36].

When reviewing for heterogeneity, we removed the studies by Ostacoli et al. (2018) and Moghadam et al. (2015), given their appearance on the Forest plot, which clearly indicated them as outliers, with the lower end of the confidence interval of both of these studies showing an effect size greater than the best performing of nearly all the other studies. The removal of outliers is a common practice in meta-analysis. After the removal of these outliers, heterogeneity was reexamined and there was a significant and large, yet heterogeneous, effect-size estimate emerged between EMDR and control arm [Hedges' g = 0.70, 95% CI = 0.50–0.89, p-value < .01, I2 = 70%, K = 37]. However, it is noteworthy to mention that the heterogeneity declined from the original all-inclusive studies of 84%–70%.

Categorical analysis for the effect of follow-up, whether studies included follow-up or not, we found medium to large effect-size estimates, yet heterogeneous, and in favor of EMDR treatment [no follow-up: Hedges' g = 0.70, 95% CI = 0.42–0.97, p-value < .01, I2= 74%, K = 17; follow-up was present: Hedges' g = 1.02, 95% CI = 0.56–1.47, p-value < .01, I2 = 88%, K = 22].

Primary conditions (medical vs. psychiatric vs. mixed) did not seem to have an effect on the efficacy of EMDR; however, the magnitude of the effect-size estimates for medical conditions (i.e., myocardial infarction or cancer) appears to be larger in individual studies (see Table 1 for effect sizes), indicating that EMDR has higher efficacy for these patient groups. Noteworthy is the low number of studies for the subgroup analysis in this category, which warrants caution in the interpretation of results. See Table 1 for details.

The possible unique role of the studies' relative (random) weight (<3.0 vs. >3.0), sample size (<50 vs. >50, in the EMDR arm), and variance (>0.3) on heterogeneity did not greatly change the magnitude of heterogeneity (relative weight <3.0: I2 = 83.41, K = 38; sample size < 50: I2 = 83.8%, K = 37; variance < 0.3: I2 = 84.67, K = 35).

Discussion

This is the first meta-analysis (K = 39) specifically examining for the effect of EMDR treatment on depression [primary depressive symptoms (K = 6) or secondary symptoms (K = 33)] when compared to various treatment modalities. We found that the studies were balanced at onset in terms of depression severity, and had a large (Hedges' g: 0.86) and significant (<0.001) effect-size estimate in favor of treatment with EMDR at the end of trials, in contrast to most control modalities [treatment as usual, wait-list, and any therapy (e.g., talk therapy, biofeedback)]. This outcome was irrespective of depression subtype or scale-types (<0.05), or when possible for depression scales (N > 3). The magnitude of the aggregate effect-size estimate was retained when we controlled for various trial methodology, including randomization, number of control arms, trial duration (weeks), and presence of follow-up (N > 3). Additionally, the significance of the aggregate effect-size estimate at the end of trials was not altered by the intake of psychotropic medications, reported demographic variables (age and sex), or EMDR methodology (number and duration of sessions).

Although we have evidence to support the presence of publication bias (see Figure 3) in the studies we have included, elimination or adjustment for the effect of bias shows higher effect-size estimate.

An additional observation was the large magnitude of the effect size estimate for medical-psychiatric primary comorbid conditions when using EMDR. Given the low number of studies in this aggregate analysis, this finding should be interpreted with caution.

Consistent with the evidence emerging from another meta-analysis (Chen et al., 2015), we have also shown that EMDR benefits adult patients with depression more than controls, irrespective of depression or PTSD.

Limitations

Our meta-analysis is not without limitations, and here we present a few. One major limitation of our meta-analysis is that we have had a large and significant heterogeneity that we could not fully explain by methodological variation. One explanation for this is that the heterogeneity may have emerged as a result of the studies' sample distribution, as a few studies did not directly report mean, SD, and sample size, therefore, we had to transform the available data presented in these articles (e.g., confidence intervals, standard error, reported effect-size, and p-values) for independent group analysis in order to calculate an effect-size estimate. Another is that the studies did not describe depression subtypes. Relationship-based depression (also described as anaclitic, or dependency-based) is different from depression focused on self-definition (also described as introjective, or self-critical) (Blatt, 2015; Lingiardi & McWilliams, 2017). Blatt (2015) describes the former as anaclitic and the latter as introjective, and noted that these psychodynamic subtypes have also been identified by cognitive-behavioral and interpersonal researchers. Relevant to the current study, he noted depression focused on relatedness has been found to be more responsive to the supportive or interpersonal elements of psychotherapy, while depression focused on self-definition has been found to be more responsive to interpretative or explorative aspects of psychotherapy. Thus, another explanation for the posttreatment heterogeneity is that one group responded more favorably to EMDR than the other. An additional explanation can be due to the confidence interval of the studies by Ostacoli et al. (2018) and Moghadam et al. (2015), showing an effect size greater than the best performing of the other studies. This discrepancy accounted for the high heterogeneity of the global analysis, as we have shown at post hoc analysis. Future research should test this hypothesis by separating patients into depression subtype. Finally, we could also speculate that heterogeneity was due to factors such as, by including the lower heterogeneity magnitude for scale types, data merging from various continents and types of comorbidity, or when the number of studies included in the analysis was above three, that we could not control for together.

Figure 3.
Random effect model funnel plot presenting publication bias at study end.

Note. The open circles represent observed individual studies, and the filled circles represent imputed values for studies. The empty diamond shows the aggregate effect-size, and the filled diamond represent the adjusted aggregate effect-size.

sgremdr_15_1_11

Another shortcoming of our study is that we did not examine for the effect of either duration or outcome of the follow-up phases in the efficacy of EMDR treatment on depression. We did not do this analysis given the yielded aggregate large magnitude effect-size estimate for the end of trials, the robustness of our results based on fail-safe N, observation of the similar magnitude of effect across all other analyses, and the unaltered effect due to moderating continuous variables

A further limitation of the current meta-analysis is that only published, peer-reviewed, English-language studies were considered for inclusion. Additionally, file drawer studies, including unpublished dissertations, were also not included. Similarly, another limitation is the use of select databases, including PubMed/Medline and PsycINFO, since we did not have access to other databases, such as Embase or Cochrane, via our institution. However, this should not have affected our results given the high number of studies needed to inverse the significant effect-size estimate we have obtained (see fail safe-N, sensitivity analysis above). Similarly, we did not investigate the effect of clinicians' experience in conducting EMDR or adherence to EMDR, which could have brought methodological heterogeneity given the variation in background of the clinicians. Thus, future studies are needed to examine for this factor in light of the treatment of effect and reason for heterogeneity, and should include a metric of treatment adherence (Purgato, Gastaldon, et al., 2018).

Another possible limitation is that we did not examine, either categorically or otherwise, for the effect of depression severity (e.g., treatment resistant), or personality factors related to depression (e.g., self-critical or socially focused depression). By the same token, we did not examine, per se, for clinical depression, as by scales' cut-off scores, or determine how many individuals out of those treated with EMDR actually improved versus those that did not. Furthermore, future studies are needed to link the EMDR treatment response to neurobiological underpinning.

Conclusions and Future Recommendations

In summary, the current meta-analysis aimed to better understand the effectiveness of EMDR for the treatment of adult depression. Within the sample of studies that were meta-analytically examined, we found that EMDR is an effective treatment for adult depression, irrespective of age or sex. This trend was also irrespective of depression subtype (primary, secondary) or scale-types, or trial methodology, including randomization, number of control arms, trial duration (weeks), and presence of follow-up. Furthermore, the significance of the treatment effect was not altered by the intake of psychotropic medications. To this end, we can make practical recommendations for future studies; it is not clear from the current literature whether EMDR is useful for depression accompanying neurodegenerative conditions such as Alzheimer's disease, which warrants future studies. Additionally, the monitoring of EMDR trials for quality and standardization to keep heterogeneity to a minimum across sites is warranted.

References

  1. Acarturk, C., Konuk, E., Cetinkaya, M., Senay, I., Sijbrandij, M., Gulen, B., & Cuijpers, P. (2016). The efficacy of eye movement desensitization and reprocessing for post-traumatic stress disorder and depression among Syrian refugees: Results of a randomized controlled trial. Psychology Medicine, 46(12), 2583–2593. https://doi.org/10.1017/S0033291716001070
  2. Arabia, E., Manca, M. L., & Solomon, R. M. (2011). EMDR for survivors of life-threatening cardiac events: Results of a pilot study. Journal of EMDR Practice & Research, 5(1), 2–13. https://doi.org/10.1891/1933-3196.5.1.2
  3. Asayesh, A., & Narimani, M. (2016). Effects of rapid eye movement desensitization and reprocessing therapy on depression, anxiety and stress among patients receiving methadone maintenance treatment in Astara, Iran. Social Behavior and Personality, 5(1), 256–264.
  4. Babikian, V. L., Wolfe, N., Linn, R., Knoefel, J. E., & Albert, M. L. (1990). Cognitive changes in patients with multiple cerebral infarcts. Stroke, 21(7), 1013–1018. https://doi.org/10.1161/01.STR.21.7.1013
  5. Bahk, Y. C., Jang, S. K., Choi, K. H., & Lee, S. H. (2017). The relationship between childhood trauma and suicidal ideation: Role of maltreatment and potential mediators. Psychiatry Investigation, 14, 37–43. https://doi.org/10.4306/pi.2017.14.1.37
  6. Banerjee, S., & Argaez, C. (2017). Eye movement desensitization and reprocessing for depression, anxiety, and post-traumatic stress disorder: a review of clinical effectiveness. Canadian Agency for Drugs and Technologies in Health (CADTH). https://www.cadth.ca/sites/default/files/pdf/htis/2017/RC0907%20EMDRDepression%20Final.pdf
  7. Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088–1101. http://www.ncbi.nlm.nih.gov/pubmed/7786990
  8. Benish, S. G., Imel, Z. E., & Wampold, B. E. (2008). The relative efficacy of bona fide psychotherapies for treating post-traumatic stress disorder: A meta-analysis of direct comparisons. Clinical Psychology Review, 28(5), 766–775. https://doi.org/10.1016/j.cpr.2007.10.005
  9. Benor, D., Rossiter-Thornton, J., & Toussaint, L. (2017). A randomized, controlled trial of wholistic hybrid derived from eye movement desensitization and reprocessing and emotional freedom technique (WHEE) for self-treatment of pain, depression, and anxiety in chronic pain patients. Evidence-Based Complementary & Alternative Medicine, 22(2), 268–277. https://doi.org/10.1177/2156587216659400
  10. Blatt, S. J. (2015). Depression. In P. Luyten, L. Mayes, P. Fonagy, M. Target, & S. J. Blatt (Eds.), Handbook of psychodynamic approaches to psychopathology (pp. 131–151). The Guilford Press.
  11. Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2005). Comprehensive meta-analysis: Version 2. Biostat.
  12. Bossini, L., Santarnecchi, E., Casolaro, I., Koukouna, D., Caterini, C., Cecchini, F., Fortini, V., Marino, D., Fernandez, I., & Rossi, A. (2017). Morphovolumetric changes after EMDR treatment in drug-naive PTSD patients. Rivista di Psichiatria, 52, 24–31. https://doi.org/10.1708/2631.27051
  13. Boukezzi, S., El Khoury-Malhame, M., Auzias, G., Reynaud, E., Rousseau, E. F., Richard, E., Zendjidjian, X., Roques, J., Castelli, N., Correard, N., Guyon, V., Gellato, C., Samuelian, J. C., Cancel, A., Comte, M., Latinus, M., Guedj, E., & Khalfa, S. (2017). Grey matter density changes of structures involved in posttraumatic stress disorder (PTSD) after recovery following eye movement desensitization and reprocessing (EMDR) therapy. Psychiatry Research, 266, 146–152. https://doi.org/10.1016/j.pscychresns.2017.06.009
  14. Bradley, R., Greene, J., Russ, E., Dutra, L., & Westen, D. (2005). A multidimensional meta-analysis of psychotherapy for PTSD. American Journal of Psychiatry, 162(2), 214–227. https://doi.org/10.1176/appi.ajp.162.2.214
  15. Brewin, C. R., Fuchkan, N., Huntley, Z., Robertson, M., Thompson, M., Scragg, P., d'Ardenne, P., & Ehlers, A. (2010). Outreach and screening following the 2005 London bombings: Usage and outcomes. Psychological Medicine, 40(12), 2049–2057. https://doi.org/10.1017/S0033291710000206
  16. Capezzani, L., Ostacoli, L., Cavallo, M., Carletto, S., Fernandez, I., Solomon, R., Cantelmi, T., & Pagani, M. (2013). EMDR and CBT for cancer patients: Comparative study of effects on PTSD, anxiety, and depression. Journal of EMDR Practice & Research, 7(3), 134–143. https://doi.org/10.1891/1933-3196.7.3.134
  17. Carletto, S., Borghi, M., Bertino, G., Oliva, F., Cavallo, M., Hofmann, A., Malucchi, S., Ostacoli, L., & Zennaro, A. (2016). Treating post-traumatic stress disorder in patients with multiple sclerosis: A randomized controlled trial comparing the efficacy of eye movement desensitization and reprocessing and relaxation therapy. Frontiers in Psychology, 7, 526. https://doi.org/10.3389/fpsyg.2016.00526
  18. Carletto, S., Oliva, F., Barnato, M., Antonelli, T., Cardia, A., Mazzaferro, P., Ostacoli, L., Fernandez, I., Pagani, M., & Raho, C. (2018). EMDR as add-on treatment for psychiatric and traumatic symptoms in patients with substance use disorder. Frontiers in Psychology, 8, 2333. https://doi.org/10.3389/fpsyg.2017.02333
  19. Carletto, S., Ostacoli, L., Colombi, N., Calorio, L., Oliva, F., Fernandez, I., & Hofmann, A. (2017). EMDR for depression: A systematic review of controlled studies. Clinical Neuropsychiatry, 14(5), 306–312. https://www.emdr-es.org/Content/PDF/EMDR-for-depression.pdf
  20. Carlson, J. G., Chemtob, C. M., Rusnak, K., Hedlund, N. L., & Muraoka, M. Y. (1998). Eye movement desensitization and reprocessing (EMDR) treatment for combat-related posttraumatic stress disorder. Journal of Traumatic Stress, 11(1), 3–24. https://doi.org/10.1023/A:1024448814268
  21. Chen, Y. R., Hung, K. W., Tsai, J. C., Chu, H., Chung, M. H., Chen, S. R., Ou, K. L., Chang, Y. C., Chou, K. R., & Liao, Y. M. (2014). Efficacy of eye-movement desensitization and reprocessing for patients with posttraumatic-stress disorder: A meta-analysis of randomized controlled trials. PLOS ONE, 9(8), e103676. https://doi.org/10.1371/journal.pone.0103676
  22. Chen, L., Zhang, G., Hu, M., & Liang, X. (2015). Eye movement desensitization and reprocessing versus cognitive-behavioral therapy for adult posttraumatic stress disorder: Systematic review and meta-analysis. Journal of Nervous and Mental Disease, 203(6), 443–451. https://doi.org/10.1097/NMD.0000000000000306
  23. Davidson, P. R., & Parker, K. C. (2001). Eye movement desensitization and reprocessing (EMDR): A meta-analysis. Journal of Consulting and Clinical Psychology, 69(2), 305–316. https://doi.org/10.1037//0022-006x.69.2.305
  24. De Bond, P. A., Van den Berg, D. P., Van der Vleugel, B. M., De Roos, C., De Jongh, A., Van der Gaag, M., & Van Minnen, A. M. (2016). Prolonged exposure and EMDR for PTSD v. A PTSD waiting-list condition: Effects on symptoms of psychosis, depression and social functioning in patients with chronic psychotic disorders. Psychology Medicine, 46(11), 2411–2421. https://doi.org/10.1017/S0033291716001094
  25. Deisenhofer, A. K., Delgadillo, J., Rubel, J. A., Bohnke, J. R., Zimmermann, D., Schwartz, B., & Lutz, W. (2018). Individual treatment selection for patients with posttraumatic stress disorder. Depression and Anxiety, 35(6), 541–550. https://doi.org/10.1002/da.22755
  26. Demirci, O. O., Sağaltici, E., Yildirim, A., & Boysan, M. (2017). Comparison of eye movement desensitization and reprocessing (EMDR) and duloxetine treatment outcomes in women patients with somatic symptom disorder. Sleep and Hyponosis: A Journal of Clinical Neuroscience and Psychopathology, 19(3), 70–77. https://doi.org/10.5350/Sleep.Hypn.2017.19.0146
  27. Devilly, G. J., Spence, S. H., & Rapee, R. M. (1998). Statistical and reliable change with eye movement desensitization and reprocessing: Treating trauma within a veteran population. Behavior Therapy, 29(3), 435–455. https://doi.org/10.1016/S0005-7894(98)80042-7
  28. Dias de Mattos Souza, L., Lopez Molina, M., Azevedo da Silva, R., & Jansen, K. (2016). History of childhood trauma as risk factors to suicide risk in major depression. Psychiatry Research, 246, 612–616. https://doi.org/10.1016/j.psychres.2016.11.002
  29. Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. https://doi.org/10.1111/j.0006-341X.2000.00455.x
  30. Edmond, T., & Rubin, A. (2004). Assessing the long-term effects of EMDR: Results from an 18-month follow-up study with adult female survivors of CSA. Journal of Child Sexual Abuse, 13(1), 69–86. https://doi.org/10.1300/J070v13n01_04
  31. Egger, M., Davey Smith, G., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315, 629–634. https://doi.org/10.1136/bmj.315.7109.629
  32. Forbes, D., Creamer, M., & Rycroft, P. (1994). Eye movement desensitization and reprocessing in posttraumatic stress disorder: A pilot study using assessment measures. Journal of Behavior Therapy and Experimental Psychiatry, 25(2), 113–120. https://doi.org/10.1016/0005-7916(94)90003-5
  33. Gauhar, Y. W. M. (2016). The efficacy of EMDR in the treatment of depression. Journal of EMDR Practice & Research, 10(2), 59–69. https://doi.org/10.1891/1933-3196.10.2.59
  34. Gerardi, M., Rothbaum, B. O., Astin, M. C., & Kelley, M. (2010). Cortisol response following exposure treatment for PTSD in rape victims. Journal of Aggression, Maltreatment & Trauma, 19(4), 349–356. https://doi.org/10.1080/10926771003781297
  35. Graca, J. J., Palmer, G. A., & Occhietti, K. E. (2014). Psychotherapeutic interventions for symptom reduction in veterans with PTSD: An observational study in a residential clinical setting. Journal of Loss and Trauma, 19(6), 558–567. https://doi.org/10.1080/15325024.2013.810441
  36. Haagen, J. F., Ter Heide, F. J., Mooren, T. M., Knipscheer, J. W., & Kleber, R. J. (2016). Predicting post-traumatic stress disorder treatment response in refugees: Multilevel analysis. The British Journal of Clinical Psychology, 56(1), 69–83. https://doi.org/10.1111/bjc.12121
  37. Hase, M., Balmaceda, U. M., Hase, A., Lehnung, M., Tumani, V., Huchzermeier, C., & Hofmann, A. (2015). Eye movement desensitization and reprocessing (EMDR) therapy in the treatment of depression: A matched pairs study in an inpatient setting. Brain and Behavior, 5(6), e00342. https://doi.org/10.1002/brb3.342
  38. Hase, M., Plagge, J., Hase, A., Braas, R., Ostacoli, L., Hofmann, A., & Huchzermeier, C. (2018). Eye movement desensitization and reprocessing versus treatment as usual in the treatment of depression: A randomized-controlled trial. Frontiers in Psychology, 9, 1384. https://doi.org/10.3389/fpsyg.2018.01384
  39. Heim, C., & Nemeroff, C. B. (2001). The role of childhood trauma in the neurobiology of mood and anxiety disorders: Preclinical and clinical studies. Biological Psychiatry, 49, 1023–1039. https://doi.org/10.1016/S0006-3223(01)01157-X
  40. Hofmann, A., Hilgers, A., Lehnung, M., Liebermann, P., Ostacoli, L., Schneider, W., & Hase, M. (2014). Eye movement desensitization and reprocessing as an adjunctive treatment of unipolar depression: A controlled study. Journal of EMDR Practice and Research, 8(3), 103–112. https://doi.org/10.1891/1933-3196.8.3.103
  41. Hogberg, G., Pagani, M., Sundin, O., Soares, J., Aberg-Wistedt, A., Tarnell, B., & Hallstrom, T. (2007). On treatment with eye movement desensitization and reprocessing of chronic post-traumatic stress disorder in public transportation workers—a randomized controlled trial. Nordic Journal of Psychiatry, 61(1), 54–61. https://doi.org/10.1080/08039480601129408
  42. Ironson, G., Freund, B., Strauss, J. L., & Williams, J. (2002). Comparison of two treatments for traumatic stress: A community-based study of EMDR and prolonged exposure. Journal of Clinical Psychology, 58(1), 113–128. https://doi.org/10.1002/jclp.1132
  43. Jayawickreme, N., Cahill, S. P., Riggs, D. S., Rauch, S. A., Resick, P. A., Rothbaum, B. O., & Foa, E. B. (2014). Primum non nocere (first do no harm): Symptom worsening and improvement in female assault victims after prolonged exposure for PTSD. Depression and Anxiety, 31(5), 412–419. https://doi.org/10.1002/da.22225
  44. Jonas, D. E., Cusack, K., Forneris, C. A., Wilkins, T. M., Sonis, J., Middleton, J. C., Meredith, D., Cavanaugh, J., Brownley, K. A., Olmsted, K. R., Greenblatt, A., Weil, A., & Feltner, C. (2013). Psychological and pharmacological treatments for adults with posttraumatic stress disorder (PTSD). [Internet]. Agency for Healthcare Research and Quality (US). https://www.ncbi.nlm.nih.gov/books/NBK137702/
  45. Karatzias, T., Power, K., Brown, K., McGoldrick, T., Begum, M., Young, J., Chouliara, Z., Adams, S., & Loughran, P. (2011). A controlled comparison of the effectiveness and efficiency of two psychological therapies for posttraumatic stress disorder: Eye movement desensitization and reprocessing vs. emotional freedom techniques. The Journal of Nervous and Mental Disease, 199(6), 372–378. https://doi.org/10.1097/NMD.0b013e31821cd262
  46. Khan, A. M., Dar, S., Ahmed, R., Bachu, R., Adnan, M., & Kotapati, V. P. (2018). Cognitive behavioral therapy versus eye movement desensitization and reprocessing in patients with post-traumatic stress disorder: Systematic review and meta-analysis of randomized clinical trials. Cureus Journal of Medical Science, 10(9), e3250. https://doi.org/10.7759/cureus.3250
  47. Kohler, K., Eggert, P., Lorenz, S., Herr, K., Willmund, G., Zimmermann, P., & Alliger-Horn, C. (2017). Effectiveness of eye movement desensitization and reprocessing in German armed forces soldiers with post-traumatic stress disorder under routine inpatient care conditions. Military Medicine, 182(5), e1672–e1680. https://doi.org/10.7205/MILMED-D-16-00307
  48. Landin-Romero, R., Moreno-Alcazar, A., Pagani, M., & Amann, B. L. (2018). How does eye movement desensitization and reprocessing therapy work? A systematic review on suggested mechanisms of action. Frontiers in Psychology, 9, 1395. https://doi.org/10.3389/fpsyg.2018.01395
  49. Lee, C., Gavriel, H., Drummond, P., Richards, J., & Greenwald, R. (2002). Treatment of PTSD: Stress inoculation training with prolonged exposure compared to EMDR. Journal of Clinical Psychology, 58(9), 1071–1089. https://doi.org/10.1002/jclp.10039
  50. Lehnung, M., Shapiro, E., Schreiber, M., & Hofmann, A. (2017). Evaluating the EMDR group traumatic episode protocol with refugees: A field study. Journal of EMDR Practice and Research, 11(3), 129–138. https://doi.org/10.1891/1933-3196.11.3.129
  51. Lingiardi, V., & McWilliams, N. (2017). Psychodynamic diagnostic manual: PDM-2 (2nd ed.). The Guilford Press.
  52. Marcus, S. V., Marquis, P., & Sakai, C. (1997). Controlled study of treatment of PTSD using EMDR in an HMO setting. Psychotherapy: Theory, Research, Practice, Training, 34(3), 307–315. https://doi.org/10.1037/h0087791
  53. Marcus, S., Marquis, P., & Sakai, C. (2004). Three- and 6-month follow-up of EMDR treatment of PTSD in an HMO setting. International Journal of Stress Management, 11(3), 195–208. http://doi.org/10.1037/1072-5245.11.3.195
  54. Mazzola, A., Calcagno, M. L., Goicochea, M. T., Pueyrredòn, H., Leston, J., & Salvat, F. (2009). EMDR in the treatment of chronic pain. Journal of EMDR Practice and Research, 3(2). https://doi.org/10.1891/1933-3196.3.2.66
  55. McFarlane, A. C. (2010). The long-term costs of traumatic stress: Intertwined physical and psychological consequences. World Psychiatry, 9, 3–10. https://doi.org/10.1002/j.2051-5545.2010.tb00254.x
  56. Minelli, A., Zampieri, E., Sacco, C., Bazzanella, R., Mezzetti, N., Tessari, E., Bortolomasi, M., & Barlati, S. (2019). Clinical efficacy of trauma-focused psychotherapies in treatment-resistant depression (TRD) in-patients: A randomized, controlled pilot-study. Psychiatry Research, 273, 567–574. https://doi.org/10.1016/j.psychres.2019.01.070
  57. Moghadam, M. B., Moghadam, A. B., & Salehian, T. (2015). Efficacy of eye movement desensitization and reprocessing (EMDR) on depression in patients with Myocardial Infarction (MI) in a 12-month follow up. Iranian Journal of Critical Care Nursing, 8(1), 221–226.
  58. Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Group, P. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med, 6(7), e1000097. https://doi.org/10.1371/journal.pmed.1000097
  59. Moskalewicz, A., & Oremus, M. (2020). No clear choice between Newcastle-Ottawa Scale and appraisal tool for cross-sectional studies to assess methodological quality in cross-sectional studies of health-related quality of life and breast cancer. Journal of Clinical Epidemiology, 120, 94–103. https://doi.org/10.1016/j.jclinepi.2019.12.013
  60. Nijdam, M. J., Gersons, B. P., Reitsma, J. B., de Jongh, A., & Olff, M. (2012). Brief eclectic psychotherapy v. eye movement desensitisation and reprocessing therapy for post-traumatic stress disorder: randomised controlled trial. The British Journal of Psychiatry, 200(3), 224–231. https://doi.org/10.1192/bjp.bp.111.099234
  61. Novo, P., Landin-Romero, R., Radua, J., Vicens, V., Fernandez, I., Garcia, F., McKenna, P. J., Shapiro, F., Amann, B. L., & Pomarol-Clotet, E. (2014). Eye movement desensitization and reprocessing therapy in subsyndromal bipolar patients with a history of traumatic events: A randomized, controlled pilot-study. Psychiatry Research, 219(1), 122–128. https://doi.org/10.1016/j.psychres.2014.05.012
  62. Orwin, R. (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8(2), 157–159. https://doi.org/10.2307/1164923
  63. Ostacoli, L., Carletto, S., Cavallo, M., Baldomir-Gago, P., Di Lorenzo, G., Fernandez, L., Justo-Alonso, A., Lehnung, M., Migliaretti, G., Oliva, F., Pagani. M., Recarey-Eiris, S., Torta, R., Tumani, V., Gonzalez-Vazquez, A. I. & Hase, M. (2018). Comparison of eye movement desensitization reprocessing and cognitive behavioral therapy as adjunctive treatments for recurrent eepression: The European Depression EMDR Network (EDEN) randomized controlled trial. Frontiers in Psychology, 9, 74. https://doi.org/10.3389/fpsyg.2018.00074
  64. Power, K., McGoldrick, T., Brown, K., Buchanan, R., Sharp, D., Swanson, V., & Karatzias, A. (2002). A controlled comparison of eye movement desensitization and reprocessing versus exposure plus cognitive restructuring versus waiting list in the treatment of post-traumatic stress disorder. Clinical Psychology & Psychotherapy, 9(5), 299–318. https://doi.org/10.1002/cpp.341
  65. Purgato, M., Gastaldon, C., Papola, D., Van Ommeren, M., Barbui, C., & Tol, W. A. (2018). Psychological therapies for the treatment of mental disorders in low- and middle-income countries affected by humanitarian crises. Cochrane Database of Systematic Reviews, 7, CD011849. https://doi.org/10.1002/14651858.CD011849.pub2
  66. Purgato, M., Gross, A. L., Betancourt, T., Bolton, P., Bonetto, C., Gastaldon, C., Gastaldon, C., Gordon, J., O'Callaghan, P., Papola, D., Peltonen, K., Punamaki, R. L., Richards, J., Staples, J. K., Unterhitzenberger, J., Van Ommeren, M., de Jong, J., Jordans, M. J. D., Tol, W. A., & Barbui, C. (2018). Focused psychosocial interventions for children in low-resource humanitarian settings: A systematic review and individual participant data meta-analysis. The Lancet Global Health, 6(4), e390–e400. https://doi.org/10.1016/S2214-109X(18)30046-9
  67. Raboni, M. R., Alonso, F. F., Tufik, S., & Suchecki, D. (2014). Improvement of mood and sleep alterations in posttraumatic stress disorder patients by eye movement desensitization and reprocessing. Frontiers in Behavioral Neuroscience, 8, 209. https://doi.org/10.3389/fnbeh.2014.00209
  68. Renner, W., Bänninger-Huber, E., & Peltzer, K. (2011). Culture-Sensitive and Resource Oriented Peer (CROP)-Groups as a community based intervention for trauma survivors: A randomized controlled pilot study with refugees and asylum seekers from Chechnya. Australasian Journal of Disaster and Trauma Studies, 2011(1), 1–13. http://trauma.massey.ac.nz/issues/2011-1/renner.htm
  69. Risch, N., Herrell, R., Lehner, T., Liang, K. Y., Eaves, L., Hoh, J., Kovacs, M., Ott, J., Merikangas, K. R., & Griem, A. (2009). Interaction between the serotonin transporter gene (5-HTTLPR), stressful life events, and risk of depression: A meta-analysis. JAMA, 301(23), 2462–2471. https://doi.org/10.1001/jama.2009.878
  70. Rost, C., Hofmann, A., & Wheeler, K. (2009). EMDR treatment of workplace trauma: A case series. Journal of EMDR Practice and Research, 3, 80–90.
  71. Rothbaum, B. O. (1997). A controlled study of eye movement desensitization and reprocessing in the treatment of posttraumatic stress disordered sexual assault victims. Bulletin of the Menninger Clinic, 61(3), 317–334. https://www.ncbi.nlm.nih.gov/pubmed/9260344
  72. Rothbaum, B. O., Astin, M. C., & Marsteller, F. (2005). Prolonged exposure versus eye movement desensitization and reprocessing (EMDR) for PTSD rape victims. Journal of Traumatic Stress, 18(6), 607–616. https://doi.org/10.1002/jts.20069
  73. Scheck, M. M., Schaeffer, J. A., & Gillette, C. (1998). Brief psychological intervention with traumatized young women: The efficacy of eye movement desensitization and reprocessing. Journal of Traumatic Stress, 11(1), 25–44. https://doi.org/10.1023/a:1024400931106
  74. Schneider, J., Hofmann, A., Rost, C., & Shapiro, F. (2008). EMDR in the treatment of chronic phantom limb pain. Pain Medicine, 9(1), 76–82. https://doi.org/10.1111/j.1526-4637.2007.00299.x
  75. Schubert, S. J., Lee, C. W., de Araujo, G., Butler, S. R., Taylor, G., & Drummond, P. D. (2016). The effectiveness of eye movement desensitization and reprocessing therapy to treat symptoms following trauma in Timor Leste. Journal of Traumatic Stress, 29(2), 141–148. https://doi.org/10.1002/jts.22084
  76. Seidler, G. H., & Wagner, F. E. (2006). Comparing the efficacy of EMDR and trauma-focused cognitive-behavioral therapy in the treatment of PTSD: A meta-analytic study. Psychological Medicine, 36(11), 1515–1522. https://doi.org/10.1017/S0033291706007963
  77. Shapiro, F. (1989). Eye movement desensitization: A new treatment for post-traumatic stress disorder. Journal of Behavior Therapy and Experimental Psychiatry, 20(3), 211–217. https://doi.org/10.1016/0005-7916(89)90025-6
  78. Shapiro, F. (2018). Eye movement desensitization and reprocessing (EMDR) therapy: Basic principles, protocols, and procedures (3rd ed.). The Guilford Press.
  79. Shapiro, E., & Laub, B. (2015). Early EMDR intervention following a community critical incident: A randomized clinical trial. Journal of EMDR Practice and Research, 9(1), 17–27. https://doi.org/10.1891/1933-3196.9.1.17
  80. Shapiro, E., Laub, B., & Rosenblat, O. (2018). Early EMDR intervention following intense rocket attacks on a town: A randomised clinical trial. Clinical Neuropsychiatry, 15(3), 194–205. https://www.clinicalneuropsychiatry.org/download/early-emdr-intervention-following-intense-rocket-attacks-on-a-town-a-randomised-clinical-trial/
  81. Silver, S. M., Brooks, A., & Obenchain, J. (1995). Treatment of Vietnam war veterans with PTSD: A comparison of eye movement desensitization and reprocessing, biofeedback, and relaxation training. Journal of Traumatic Stress, 8(2), 337–342. https://doi.org/10.1002/jts.2490080212
  82. Silver, S. M., Rogers, S., Knipe, J., & Colelli, G. (2005). EMDR therapy following the 9/11 terrorist attacks: A community-based intervention project in New York City. International Journal of Stress Management, 12(1), 29–42. https://doi.org/10.1037/1072-5245.12.1.29
  83. Staring, A. B., Van den Berg, D. P., Cath, D. C., Schoorl, M., Engelhard, I. M., & Korrelboom, C. W. (2016). Self-esteem treatment in anxiety: A randomized controlled crossover trial of eye movement desensitization and reprocessing (EMDR) versus competitive memory training (COMET) in patients with anxiety disorders. Behaviour Research and Therapy, 82, 11–20. https://doi.org/10.1016/j.brat.2016.04.002
  84. Steinert, C., Bumke, P. J., Hollekamp, R. L., Larisch, A., Leichsenring, F., Mattheß, H., Sek, S., Sodemann, U., Stingl, M., Ret, T., Vojtová, H., Wöller, W., & Kruse, J. (2017). Resource activation for treating post-traumatic stress disorder, co-morbid symptoms and impaired functioning: a randomized controlled trial in Cambodia. Psychological Medicine, 47(3), 553–564. https://doi.org/10.1017/S0033291716002592
  85. Sterne, J. A. C., Savovic, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H. Y., Corbett, M. S., Eldridge, S. M., Emberson, J. R., Hernan, M. A., Hopewell, S., Hrobjartsson, A., Junqueira, D. R., Juni, P., Kirkham, J. J., Lasserson, T., Li, T., & Higgins, J. P. T. (2019). RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ, 366, l4898. https://doi.org/10.1136/bmj.l4898
  86. Szpringer, M., Oledzka, M., & Amann, B. L. (2018). A non-randomized controlled trial of EMDR on affective symptoms in patients with glioblastoma multiforme. Frontiers in Psychology, 9, 785. https://doi.org/10.3389/fpsyg.2018.00785
  87. Tapia, G., Perez-Dandieu, B., Lenoir, H., Othily, E., Gray, M., & Delile, J. M. (2018). Treating addiction with schema therapy and EMDR in women with co-occurring SUD and PTSD: A pilot study. Journal of Substance Use, 23(2), 199–205. https://doi.org/10.1080/14659891.2017.1378743
  88. Tarquinio, C., Brennstuhl, M., Rydberg, J. A., Schmitt, A., Mouda, F., Lourel, M., & Tarquinio, P. (2012). Eye movement desensitization and reprocessing (EMDR) therapy in the treatment of victims of domestic violence: A pilot study. Eye movement desensitization and reprocessing (EMDR) therapy dans le traitement des victimes de violences conjugales: Étude pilote. Revue européenne de psychologie appliquée, 62, 205–212. https://doi.org/10.1016/j.erap.2012.08.006
  89. Tarquinio, C., Schmitt, A., Tarquinio, P., Rydberg, J. A., & Spitz, E. (2012). Benefits of “eye movement desensitization and reprocessing” psychotherapy in the treatment of female victims of intimate partner rape. Sexologies, 21(2), 60–67. https://doi.org/10.1016/j.sexol.2011.05.002
  90. Tunnard, C., Rane, L. J., Wooderson, S. C., Markopoulou, K., Poon, L., Fekadu, A., Cleare, A. J., & Juruena, M. (2014). The impact of childhood adversity on suicidality and clinical course in treatment-resistant depression. Journal of Affective Disorders, 152–154, 122–130. https://doi.org/10.1016/j.jad.2013.06.037
  91. Van den Berg, D., De Bont, P., Van der Vleugel, B. M., De Roos, C., De Jongh, A., Van Minnen, A., & Van der Gaag, M. (2018). Long-term outcomes of trauma-focused treatment in psychosis. The British Journal of Psychiatry, 212(3), 180–182. https://doi.org/10.1192/bjp.2017.30
  92. Van der Kolk, A. B., Spinazzola, J., Blaustein, M. E., Hopper, J. W., Hopper, E. K., Korn, D. L., & Simpson, W. B. (2007). A randomized clinical trial of eye movement desensitization and reprocessing (EMDR), fluoxetine, and pill placebo in the treatment of posttraumatic stress disorder: Treatment effects and long-term maintenance. Journal of Clinical Psychiatry, 68(1), 37–46. https://doi.org/10.4088/jcp.v68n0105
  93. Van Etten, M. L., & Taylor, S. (1998). Comparative efficacy of treatments for post-traumatic stress disorder: a meta-analysis. Clinical Psychology & Psychotherapy, 5(3), 126–144.
  94. Vandenbroucke, J. P., von Elm, E., Altman, D. G, Gotzsche, P. C., Mulrow, C. D., Pocock, S. J., Schlesselman, J. J., Egger, M., Poole, C., & STROBE Initiative. (2007). Strengthening the reporting of observational studies in Epidemiology (STROBE): Explanation and elaboration. PLoS Med, 4(10), e297. https://doi.org/10.1371/journal.pmed.0040297
  95. Vaughan, K., Armstrong, M. S., Gold, R., O'Connor, N., Jenneke, W., & Tarrier, N. (1994). A trial of eye movement desensitization compared to image habituation training and applied muscle relaxation in post-traumatic stress disorder. Journal of Behavior Therapy and Experimental Psychiatry, 25(4), 283–291. https://doi.org/10.1016/0005-7916(94)90036-1
  96. Vitriol, V., Cancino, A., Leiva-Bianchi, M., Serrano, C., Ballesteros, S., Asenjo, A., Caceres, C., Potthoff, S., Salgado, S., Orellana, F., & Ormazabal, M. (2017). Childhood trauma and psychiatric comorbidities in patients with depressive disorder in primary care in Chile. Journal of Trauma Dissociation, 18(2), 189–205. https://doi.org/10.1080/15299732.2016.1212449
  97. Wells, G. S. B., O'Connell, D., Peterson, J., Welch, V., Losos, M., & Tugwell, P. (2019). The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomized studies in meta-analysis. Ottawa Hospital Research Institute. http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp
  98. Wiersma, J. E., Hovens, J. G., van Oppen, P., Giltay, E. J., Van Schaik, D. J., Beekman, A. T., & Penninx, B. W. (2009). The importance of childhood trauma and childhood life events for chronicity of depression in adults. Journal of Clinical Psychiatry, 70(7), 983–989. https://doi.org/10.4088/jcp.08m04521
  99. Williams, L. M., Debattista, C., Duchemin, A. M., Schatzberg, A. F., & Nemeroff, C. B. (2016). Childhood trauma predicts antidepressant response in adults with major depression: data from the randomized international study to predict optimized treatment for depression. Translational Psychiatry, 6(5), e799. https://doi.org/10.1038/tp.2016.61
  100. Wood, E., & Ricketts, T. (2013). Is EMDR an evidenced-based treatment for depression? A review of the literature. Journal of EMDR Practice & Research, 7(4), 225–236. https://doi.org/10.1891/1933-3196.7.4.225
  101. Yurtsever, A., Konuk, E., Akyuz, T., Zat, Z., Tukel, F., Cetinkaya, M., Shapiro, E., & Savran, C. (2018). An eye movement desensitization and reprocessing (EMDR) group intervention for Syrian refugees with post-traumatic stress symptoms: Results of a randomized controlled trial. Frontiers in Psychology, 9, 493. https://doi.org/10.3389/fpsyg.2018.00493

Disclosure

The authors have no relevant financial interest or affiliations with any commercial interests related to the subjects discussed within this article.

Acknowledgment

The authors wish to thank Angela Doyle, the Adler University librarian, for helping with key-term generation and search of the literature. The authors wish to recognize the contribution made by Dr. Steven Marcus in sharing and clarifying data pertaining to a manuscript. This project is registered with PROSPERO: International Prospective Register of Systematic Reviews (CRD42019138815).

Funding

The authors received no specific grant or financial support for the research, authorship, and/or publication of this article.

Figures

Figure 1.
PRISMA-style flow diagram showing study selection for meta-analysis on EMDR for depression literature.
sgremdr_15_1_5View in Context
Figure 2.
Forest plot showing studies (K = 39) with omnibus effect-size estimate at the endpoint (follow-up not included).
sgremdr_15_1_7View in Context
Figure 3.
Random effect model funnel plot presenting publication bias at study end.

Note. The open circles represent observed individual studies, and the filled circles represent imputed values for studies. The empty diamond shows the aggregate effect-size, and the filled diamond represent the adjusted aggregate effect-size.

sgremdr_15_1_11View in Context

Tables

TABLE 1.
Effect-Sizes Estimates (Random Effect Model)
Effect Size and 95% Confidence IntervalTest of Null (Two-Tail)Heterogeneity
GroupsKEffect-size (Hedges' g)Lower limitUpper limitz-valuep-valueQ-valuedf (Q)p-valueI2(%)
Baseline36−0.0172−0.24610.8056−0.2461.805661.638035.003643
END390.87020.60491.13566.4276.0000236.780238084
Control-Arm Type
 Pharmacotherapy30.88780.04211.73342.0576.039613.55082.001185
 Therapy290.44440.19660.69223.5155.0004131.184828.000079
 Treatment as usual101.11570.45931.77213.3314.000972.10519.000088
 Wait-list181.15460.83191.47737.0135.000062.099017.000073
Depression type
 Primary61.35710.26822.44602.4427.014658.91025.000092
 Secondary330.78190.52391.03995.9396.0000165.404032.000081
Scale type
 Full480.80660.57341.03986.7786.0000289.198947.000084
 Sub120.73060.31301.14823.4292.000655.275811.000080
Scales
 BDI340.83390.51691.15095.1557.0000240.419333.000086
 CES-D21.1741−0.52622.87441.3534.17597.49421.006287
 HADS Depression60.74540.17571.31502.5646.010327.25345.000182
 HAM-D10.90080.02751.77412.0217.04320.000001.00000
 HDRS31.07310.56461.58154.1366.00001.98592.37050
 HSCL-Depression11.70591.16262.24936.1535.00000.000001.00000
 MADRS30.7219−0.13831.58201.6449.100010.21532.006180
 PHQ-940.23010.04980.41052.5007.01242.74923.43190
 PRF-Depression30.2503−0.76471.26530.4833.62899.58842.008379
 SCL-90R depression Subscale30.92840.44681.41013.7779.00022.64552.266424
Continents
 Americas90.63160.27540.98793.4750.000516.16098.040150
 Asia41.7242−0.06263.51101.8913.058645.27193.000093
 Asia-Europe31.0759−0.13542.28731.7408.081727.50042.000093
 Australia30.56200.10361.02042.4029.01631.18932.55180
 Europe200.80630.46211.15064.5905.0000118.865919.000084
Medication allowed
 No101.28530.58511.98553.5978.000388.62929.000090
 NS130.69800.37031.02574.1746.000029.987512.002860
 Yes160.73000.34261.11743.6929.000296.702315.000084
EMDR-trial duration (weeks)
 Approx and NR101.29800.52942.06663.3101.0009117.76589.000092
 Exact290.69900.46460.93335.8467.000097.987928.000071
EMDR-session time (min)
 Approx and NR181.04490.54981.54014.1360.0000187.095117.000091
 Exact210.66900.43540.90275.6127.000045.394720.001056
EMDR-sessions (#)
 Approx and NR71.09870.52051.67693.7242.000234.80166.000083
 Exact320.82120.51041.13205.1785.0000201.845431.000085
Follow-up (Yes/No)
 No170.69790.41650.97944.8608.000060.617216.000074
 Yes221.01750.56261.47254.3837.0000170.808221.000088
Randomized/observational
 No90.64380.24231.04523.1431.001732.70928.000175
 Yes300.94480.60991.27975.5296.0000197.067829.000085
Number of control arms
 1271.04100.67431.40775.5638.0000191.457026.000086
 2110.48130.20970.75293.4737.000521.323010.019053
 310.2507-0.57521.07660.5949.55190.000001.00000
EMDR-Sex-reported
 No80.63900.28460.99343.5339.000412.48227.085844
 Yes310.92240.60491.23995.6935.0000223.942630.000087
EMDR-Age-reported
 No110.99250.42101.56403.4036.000765.506310.000085
 Yes280.82430.52171.12685.3401.0000167.394727.000084
Original condition
 Addiction1−0.1466−0.75500.4617−0.4724.63660.000001.00000
 Cancer-PTSD10.5850−0.25591.42591.3635.17270.000001.00000
 Cardiac-PTSD10.64980.04031.25932.0897.03660.000001.00000
 Depression61.35710.26822.44602.4427.014658.91025.000092
 Glioblastoma11.71620.97412.45834.5325.00000.000001.00000
 MI13.89533.03784.75278.9039.00000.000001.00000
 MS-PTSD10.1190−0.47560.71370.3923.69480.000001.00000
 PTS20.3951−0.20100.99111.2990.19400.74301.38870
 PTSD200.57570.33440.81704.6765.000060.764619.000069
 PTSD-Domestic violence11.19910.32032.07782.6744.00750.000001.00000
 PTSD-symptom11.74940.65502.84373.1330.00170.000001.00000
 Sexual abuse10.6598−0.48041.80001.1341.25670.000001.00000
 Somatic symptom disorder11.76981.18782.35175.9603.00000.000001.00000
 Subsyndromal Bipolar11.75450.66442.84463.1546.00160.000001.00000
Medical-Psychiatric Comorbidity
 Medical22.79470.65944.93002.5652.010314.18431.000293
 Mixed40.56860.14730.98982.6456.00824.22133.238529
 Psychiatric330.78170.51881.04465.8270.0000169.026332.000081

Note. HDRS = Hamilton Depression Rating Scale; MADRS = Montgomery-Asberg Depression Rating Scale; PHQ-9 = Patient Health Questionnaire; PTSD = posttraumatic stress disorder; PTS = posttraumatic stress.

View in Context
Article usage
Article Usage
Period Abstract Full PDF Total
Apr 2024 94 57 34 185
Mar 2024 134 39 42 215
Feb 2024 121 60 40 221
Jan 2024 83 32 27 142
Dec 2023 105 24 26 155
Nov 2023 99 37 38 174
Oct 2023 59 23 12 94
Sep 2023 84 18 19 121
Aug 2023 61 16 21 98
Jul 2023 58 25 13 96
Jun 2023 64 31 21 116
May 2023 68 26 24 118
Apr 2023 71 54 29 154
Mar 2023 92 55 25 172
Feb 2023 69 52 24 145
Jan 2023 102 61 22 185
Dec 2022 102 45 27 174
Nov 2022 119 77 36 232
Oct 2022 105 75 30 210
Sep 2022 81 65 35 181
Aug 2022 59 123 27 209
Jul 2022 62 42 23 127
Jun 2022 77 37 27 141
May 2022 86 7 8 101
Apr 2022 148 6 2 156
Mar 2022 305 4 5 314
Feb 2022 112 4 5 121
Jan 2022 113 4 5 122
Dec 2021 66 1 5 72
Nov 2021 156 2 5 163
Oct 2021 129 3 3 135
Sep 2021 81 0 2 83
Aug 2021 92 3 5 100
Jul 2021 106 12 10 128
Jun 2021 489 12 13 514
May 2021 1971 54 68 2093
Apr 2021 2452 73 90 2615
Mar 2021 2112 98 83 2293
Feb 2021 0 2 0 2
Focus
  PreviousNext