European Headache Federation recommendations for placebo and nocebo terminology
The Journal of Headache and Pain volume 21, Article number: 117 (2020)
Background and aim
Despite recent publications, practitioners remain unfamiliar with the current terminology related to the placebo and nocebo phenomena observed in clinical trials and practice, nor with the factors that modulate them. To cover the gap, the European Headache Federation appointed a panel of experts to clarify the terms associated with the use of placebo in clinical trials.
The working group identified relevant questions and agreed upon recommendations. Because no data were required to answer the questions, the GRADE approach was not applicable, and thus only expert opinion was provided according to an amended Delphi method. The initial 12 topics for discussion were revised in the opinion of the majority of the panelists, and after a total of 6 rounds of negotiations, the final agreement is presented.
Two primary and mechanism-based recommendations are provided for the results of clinical trials:  to distinguish the placebo or nocebo response from the placebo or nocebo effect; and  for any favorable outcome observed after placebo administration, the term “placebo response” should be used, and for any unfavorable outcome recorded after placebo administration, the term “nocebo response” should be used (12 out of 17 panelists agreed, 70.6% agreement). The placebo or nocebo responses are attributed to a set of factors including those that are related to the medical condition (e.g. natural history, random comorbidities, etc.), along with idiosyncratic ones, in which the placebo or nocebo effects are attributed to idiosyncratic, or nonspecific mechanisms, exclusively (e.g. expectation, conditioning, observational learning etc.). To help investigators and practitioners, the panel summarized a list of environmental factors and idiosyncratic dynamics modulating placebo and nocebo effects. Some of them are modifiable, and investigators or physicians need to know about them in order to modify these factors appropriately to improve treatment. One secondary recommendation addresses the use of the terms “placebo” and “nocebo” (“placebos” and “nocebos” in plural), which refer to the triggers of the placebo/nocebo effects or responses, respectively, and which are inert agents or interventions that should not be confused with the placebo/nocebo responses or effects themselves (all panelists agreed, 100% agreement).
The working group recommends distinguishing the term response from effect to describe health changes from before to after placebo application and to distinguish the terms placebo(s) or nocebo(s) from the health consequences that they cause (placebo/nocebo responses or effects).
The terminology surrounding placebo and nocebo research is not yet familiar to practitioners and trialists. In addition, researchers in the field are using the related terms in a different way. Besides the recent consensus on the clinical implications of placebo and nocebo effects for clinical practice , there are still unanswered questions related to placebo and nocebo response and effect, as well as to the exact meaning of the term “placebo” and “nocebo”. For example, it is not yet clear whether the adverse events (AEs) recorded in the placebo-treated arm of a clinical trial, should be called nocebo response or nocebo effect. Others introduced the term “drucebo” (a combination of DRUg and plaCEBO or noCEBO) to relate to a favorable or unfavorable outcome which results from the patients’ expectation exclusively and is not pharmacologically caused by the medication . Introducing new terms may generate more confusion, however. To address this issue, the European Headache Federation appointed a panel of experts by recruiting researchers in the field of placebo, clinicians and pharmacologists to further clarify the terms related to the placebo administration in clinical science.
Twenty investigators were approached and 18 agreed to participate in the working group (90% participation rate). The composition of the task force was based on the following criteria: researchers focused on placebo or nocebo research (17 approached, two declined to participate), clinicians with relevant work (two members, DDM and PPS) and a member of the Executive Board of the EHF (AMB). Because no data were required to answer the questions, the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach was not applicable, and thus only expert opinion was provided. The agreement process was performed according to the Delphi method . The co-chairs (DDM and FB) arranged 12 relevant topics for discussion (Table 1) shared by email with the members of the working group. In each email round, panelists were instructed not to discuss among themselves and to send their feedback only to the facilitator (DDM). The facilitator collected all the answers and issued for each round a report with comments together with the co-chairman (FB). Six consecutive drafts of the recommendation manuscript were prepared and reviewed by all authors. Based on their comments and suggestions drafts 1 and 5 were edited (rounds 2 and 6). The final manuscript (round 7) drafted by the chairs of the panel (DDM and FB) and was reviewed by all members of the panel for final approval.
RESULTS and RECOMMENDATIONS
The 12 initial topics for discussion with the relevant decisions and proportion of agreement are presented in Table 1. All panelists agreed with the final recommendation, except for distinguishing the terms placebo/nocebo response from placebo/nocebo effect (70.5% agreement). One panelist left the panel due to disagreement over the definition of placebo response and placebo effect. The working group agreed upon the following definitions.
Placebo (placebos, plural)
Substances and interventions are considered placebos when they lead to a beneficial outcome after administration or application, although their active ingredients lack this potential. Active ingredients include pharmacologically active compounds, properties, psychological interventions, physical manipulations and other (e.g. sham surgery, sham stimulation, etc.).
Placebo is a substance or an intervention and should be distinguished from the placebo response that includes any health change from before to after the placebo administration or application, as well as the placebo effect which includes health changes related to the placebo mechanisms exclusively (see below).
A placebo is not only the inert treatment, or the intervention per se, but also any signal from the surrounding context that accompanies the therapeutic ritual/act. Stimuli from the environment that have been shown to modify the consequences of the placebo administration and/or application are listed in appendix.
Placebos (or placebo agents/interventions) are administered in research and clinical settings either to create a positive expectancy and subsequent health improvement or to validate a new treatment/intervention in clinical trials.
Any health change occurring in a placebo treated group of participants in the context of a clinical trial, also occurs in the active treatment group, in addition to the potential effect of the active ingredient. Therefore, placebos should always be indistinguishable by both the investigator and the trial participant in clinical trials (notwithstanding that this aim may sometimes not be achieved).
A scientifically supported treatment could be a placebo when given for an unrelated condition (e.g. an antibiotic prescribed for a viral illness), thus placebos are relative to a particular patient and a particular disorder.
Any substance or intervention that is offered to a patient or a volunteer by informing him/her that a potential beneficial treatment is being delivered serves as placebo as well, in addition to any other biological effect related to the pharmacological properties of the substance or the physical manipulations. This explains why placebos are present in clinical practice, when a physician recommends a treatment.
Positive information from media may also serve as a placebo.
The placebo response refers to any beneficial consequence of a therapeutic act (e.g., differences in symptoms from before to after treatment), which is made up of any cue in the surrounding context, and informing the patient or the volunteer that a potential beneficial treatment is being delivered. The placebo response consists of any favorable health change occurring from before to after a placebo administration or application (i.e., differences in symptoms from before to after treatment), thus including the natural history of the medical condition investigated, the regression of the medical condition to the mean along with those changes that are attributed to the placebo mechanisms exclusively (see below).
Placebo responses are recorded in research and clinical settings to either investigate the phenomenon or to validate a new treatment/intervention.
In clinical trials the beneficial outcomes seen after administration of a placebo, should be called placebo response, which also includes the placebo effect.
A placebo effect refers to those particular beneficial health changes that are observed after a placebo administration or application, which are attributed to the placebo mechanisms exclusively, e.g. expectation, conditioning, observational learning.
The placebo effect is better studied in human studies, although animal studies may help elucidate some of the mechanisms, for example conditioning, particularly pharmacological conditioning.
The placebo effect is calculated as the difference between a placebo or nocebo treated group/condition and a no-treated group/condition as this is the basis for deriving mechanisms.
Nocebo (nocebos, plural)
Substances and interventions are considering nocebos when they lead to a negative outcomes after administration or application, although their active ingredients lack this potential. Active ingredients include pharmacological properties, psychological effects or physical manipulations.
Nocebos are purposefully applied only for research to create a negative expectancy and outcome in order to investigate the origin of nocebo phenomenon. However, nocebos can also be found in clinical research and routine medical practice. For example, the safety information delivered by the investigators to the participants of a clinical trial or the AEs listed in the leaflet of drug packages, may induce negative expectations serving as nocebos.
Like placebo, nocebo is characterized by the surrounding context that consists of any stimulus or information from the environment (appendix).
The nocebo response refers to any unfavorable consequence of a therapeutic act (e.g., differences in symptoms from before to after treatment), which is made up of any cue in the surrounding context, and informing the patient or the volunteer that a negative outcome may occur. Thus, nocebo response includes the natural history of the medical condition in question, spontaneous worsening of the symptoms, as well as random comorbidities, among several other components that are attributed to the nocebo effect.
To investigate or observe a nocebo response the administration of a nocebo is required. A nocebo response may occur unintentionally as well.
Assessing the AEs, or any unfavorable outcome, in patients who are treated with placebo, monitors the nocebo response in clinical trials.
Nocebo response is associated with lower adherence to the therapeutic intervention and higher rates of treatment withdrawal .
The nocebo effect refers to those particular unfavorable health changes that are observed after a nocebo administration or application which are attributed to the nocebo mechanisms exclusively, e.g. expectation, conditioning, observational learning.
The effect - response controversy
Not all panel members agree on the terminology suggested. One researcher (IK) use the terms “placebo/nocebo response” and “placebo/nocebo effect” in the opposite way . In a recent position paper from the European Academy of Allergy and Clinical Immunology, the term “placebo effect” was defined as “the psychological and physiological benefits of seeking advice and receiving treatment for a medical problem, independently of the prescribed treatment’s pharmacological effects per se” . Historical and traditional reasons may explain the differences. Here, the vast majority of panelists agreed on the recommended terminology, and, eventually, this is an area that needs to be ironed out in future research.
Should we distinguish the placebo or nocebo response from the placebo or nocebo effect in clinical trials and why?
Most panelists declare there is a significant difference between the two terms, but not all agree. There is no agreement for the rationale as well. Defenders say that the distinction is important for the same reason that it is important to distinguish between a drug response and a drug effect, with the drug effect as the difference between the drug response and the placebo response. “A drug response is the change that occurs after administration of the drug. The effect of the drug is that portion of the response that is due to the drug’s chemical composition; it is the difference between the drug response and the response to placebo.” . However, in clinical trials both treatment response and treatment effect are collectively used as treatment efficacy reflecting the expected effect size of the treatment in practice. In analyses of clinical trials another metric is used, the “therapeutic gain” representing the difference of the outcome between active and placebo-treated groups . Another metric is the absolute difference between active drug and placebo-treated arms, known as number-needed to treat  and the relative efficacy of the treatment, or the relative risk reduction as measures of treatment effect size , or both . The terms “treatment response” and “treatment effect” have very limited use in the literature currently, at least in the field of neurology and headache. Therefore, distinguishing placebo response from placebo effect remains controversial for clinical science. On the other hand, all panelists considered it necessary to distinguish placebo/nocebo responses from placebo/nocebo effect in order to investigate underlying potential mechanisms. Thus, the final recommendation is mechanism-based.
We recommend distinguishing the two terms (response from effect) because their mechanisms are different. This distinction is crucial for the research (experimental human studies), but may also help practitioners to better interpret the trial results and to modify their practice in order to limit the modifiable nocebo factors listed in appendix.
What should we call the efficacy and the adverse events recorded in the placebo arms of a clinical trial?
A systematic review of clinical trials concluded that the median prevalence of AEs in placebo groups was 49.1% (IQR 25.7–64.4%), and the median rate of dropouts due to AEs was 5% (IQR 2.28–8.4%) . There is therefore a question of terminology regarding the AEs recorded in placebo arms. Most panelists agree that the term “response” better describes the favorable and unfavorable outcomes observed after placebo administration in clinical trials.
According to the terminology of placebo response, the beneficial outcomes seen in a placebo-treated arm of a clinical trial should be called placebo response. In the same way, any unfavorable outcome seen in the placebo-treated arms of clinical trials should be called nocebo response.
Environmental stimuli influencing placebo and nocebo responses in clinical trials and practice
The surrounding context that potentially modifies placebo and nocebo responses in clinical science and practice consists of any stimulus or information from the environment (e.g. media, internet, health setting); the treating medical and paramedical personnel or researcher (including the symbols, rituals, and verbal and nonverbal expressions and communications they employ); the patient’s medical condition, or the rationale for the experiment; and the expectations and prior experiences of the patient or volunteer that may vary over time or by education; and the price of a medication or the label on the box, etc. In a clinical trial these factors are, presumably, essentially the same for both the control and verum conditions. And, of course, these same factors are also operative in ordinary clinical practice. In Appendix, a list of these stimuli is presented, divided into modifiable and non-modifiable ones.
Treatment outcomes are not exclusively attributable to the biological or physical mechanisms of action of the therapeutic interventions per se, but additional environmental, random or idiosyncratic variables are also components of the final result. To better understand and investigate this impact a mechanism-based approach is needed. Therefore, to measure the effect size of a treatment that can be attributed exclusively to the mechanism of action of the treatment in question, testing in parallel with an inert treatment is essential. This inert treatment whether it is an agent, a manipulation, a sham stimulation or an inert intervention, should be called placebo. To interpret the consequences of placebo administration or application in clinical trials two terms have been in use, the placebo response and the placebo effect. However, these terms have different meanings, refer to different elements and are powered by different mechanisms. This panel of experts, on behalf of the European Headache Federation, aiming to clarify these terms in order to help clinicians and trialists to better interpret the trials’ results, recommends distinguishing the term response from effect, using the term placebo response to describe any favorable outcome observed from before to after placebo administration, and nocebo response to describe any unfavorable outcome observed from before to after placebo administration. Several random variables, such as accidental deterioration or improvement in the condition, or accidental involvement with another condition along with idiosyncratic variables that are linked to placebo or nocebo mechanisms are components of the placebo or nocebo responses, while the placebo and nocebo effects refer to those favorable or unfavorable outcomes observed from before to after a placebo application that are powered by the patient mind entirely, e.g. conditioning, expectations, observational learning, etc.
In human experimental studies, to induce negative outcomes and investigate their underlying mechanisms, inert interventions are administered to participants. These inert agents or interventions that cause unfavorable outcomes although their active ingredients lack this potential, are called nocebos. Like placebos, nocebo responses should be distinguished from nocebo effects. In clinical trials there is no direct nocebo application, yet the safety information delivered by the investigators may serve as a nocebo in both arms and may induce AEs that cannot be separated from the drug-related ones. To limit nocebo effects, appropriate modification of the informed consents currently used may be required.
In clinical practice, placebos and nocebos are rarely explicitly administered. However, environmental information, including any stimuli from the entire therapeutic encounter may serve as placebo or nocebo, e.g. the drug or device packaging, color, price, the setting of the medical unit, the patient-doctor relationship and clinician communication style, etc. Physicians should be aware of these variables in order to devise strategies for each individual patient that limit nocebo and increase placebo effects to improve treatment outcomes for the patient.
Availability of data and materials
There are no original data.
Evers AWM, Colloca L, Blease C, Annoni M, Atlas LY, Benedetti F et al (2018) Implications of placebo and Nocebo effects for clinical practice: expert consensus. Psychother Psychosom 87:204–210
Penson PE, Mancini GBJ, Toth PP, Martin SS, Watts GF, Sahebkar A, Mikhailidis DP, Banach M (2018) Lipid and Blood Pressure Meta-Analysis Collaboration (LBPMC) Group & International Lipid Expert Panel (ILEP). Introducing the 'Drucebo' effect in statin therapy: a systematic review of studies comparing reported rates of statin-associated muscle symptoms, under blinded and open-label conditions. J Cachexia Sarcopenia Muscle 9:1023–1033
Dalkey NC, Helmer-Hirschberg O (1962) An experimental application of the delphi method to the use of experts. Rand Corp, Santa Monica, Calif
Krüger K, Leppkes N, Gehrke-Beck S, Herrmann W, Algharably EA, Kreutz R, Heintze C, Filler I (2018) Improving long-term adherence to statin therapy: a qualitative study of GPs' experiences in primary care. Br J Gen Pract 68:e401–e407
Schedlowski M, Enck P, Rief W, Bingel U (2015) Neuro-bio-behavioral mechanisms of placebo and Nocebo responses: implications for clinical trials and clinical practice. Pharmacol Rev 67:697–730
Pfaar O, Agache I, Bergmann KC, Bindslev-Jensen C, Bousquet J, Creticos PS, Devillier P, Durham SR, Hellings P, Kaul S, Kleine-Tebbe J, Klimek L, Jacobsen L, Jutel M, Muraro A, Papadopoulos NG, Rief W, Scadding GK, Schedlowski M, Shamji MH, Sturm G, van Ree R, Vidal C, Vieths S, Wedi B, Gerth van Wijk R, Frew AJ (2020) Placebo effects in allergen immunotherapy - an EAACI Task Force Position Paper. Allergy. https://doi.org/10.1111/all.14331
Fisher S, Lipman RS, Uhlenhuth EH, Rickels K, Park LW (1965) Drug effects and initial severity of symptomatology. Psychopharmacologia 7:57–60
Tfelt-Hansen P, Messlinger K (2019) Why is the therapeutic effect of acute antimigraine drugs delayed? A review of controlled trials and hypotheses about the delay of effect. Br J Clin Pharmacol 85:2487–2498
Citrome L, Ketter TA (2013) When does a difference make a difference? Interpretation of number needed to treat, number needed to harm, and likelihood to be helped or harmed. Int J Clin Pract 67:407–411
Lui KJ (2019) Estimation of the relative difference (or relative risk reduction) under the sequential parallel comparison design. Stat Methods Med Res 28:2125–2136
Mitsikostas DD, Goodin DS (2017) Comparing the efficacy of disease-modifying therapies in multiple sclerosis. Mult Scler Relat Disord 18:109–116
Benedetti F, Pollo A, Lopiano L, Lanotte M, Vighetti S, Rainero I (2003) Conscious expectation and unconscious conditioning in analgesic, motor, and hormonal placebo/nocebo responses. J Neurosci 23:4315–4323
Howick J, Webster R, Kirby N, Hood K (2018) Rapid overview of systematic reviews of nocebo effects reported by patients taking placebos in clinical trials. Trials. 19:674
Bartels DJP, van Laarhoven AIM, Heijmans N, Hermans D, Debeer E, van de Kerkhof PCM, Evers AWM (2017) Cognitive Schemas in Placebo and Nocebo Responding: Role of Autobiographical Memories and Expectations. Clin Ther 39:502–512 e1
Daniali H, Flaten MA (2019) A qualitative systematic review of effects of provider characteristics and nonverbal behavior on pain, and placebo and Nocebo effects. Front Psychiatry 10:242
Benedetti F, Lanotte M, Lopiano L, Colloca L (2007) When words are painful: unraveling the mechanisms of the nocebo effect. Neuroscience. 147(2):260–271. Epub 2007 Mar 26 Review
Kern A, Kramm C, Witt CM, Barth J (2019) The influence of personality traits on the placebo/nocebo response: A systematic review. J Psychosom Res 128:109866
Giovannelli F, Zaccara G, Cincotta M, Loiacono G, Verrotti A (2015) Characterization of the adverse events profile of placebo-treated patients in randomized controlled trials on drug-resistant focal epilepsies. J Neurol 262:v1401–v1406
Enck P, Klosterhalfen S, Weimer K (2017) Unsolved, Forgotten, and Ignored Features of the Placebo Response in Medicine. Clin Ther 39(3):458–468. https://doi.org/10.1016/j.clinthera.2016.11.016 Epub 2016 Dec 2
Ventriglio A, Magnifico G, Borraccino L, Rinaldi A, Bellomo A (2018) Placebo and Cultural Responses. Nord J Psychiatry 72(sup1):S33–S35. https://doi.org/10.1080/08039488.2018.1525637
Pedro-Botet J, Climent E, Benaiges D (2019) Muscle and statins: from toxicity to the nocebo effect. Expert Opin Drug Saf 18(7):573–579. https://doi.org/10.1080/14740338.2019.1615053 Epub 2019 May 9
Bizzi F, Voltolini S, Fiaschi MD, Cavanna D (2019) Assessing clinical and psychological features: who are patients showing a nocebo reaction during the drug challenge test? Eur Ann Allergy Clin Immunol 51:258–265
Blasini M, Peiris N, Wright CL (2018) The Role of Patient–Practitioner Relationships in Placebo and Nocebo Phenomena. Int Rev Neurobiol 139:211–231. https://doi.org/10.1016/bs.irn.2018.07.033 Author manuscript; available in PMC 2018 Oct 9. Published in final edited form as: Int Rev Neurobiol. Published online 2018 Aug 9
Crum AJ, Phillips DJ, Goyer JP, Akinola M, Higgins ET (2016) Transforming Water: Social Influence Moderates Psychological, Physiological, and Functional Response to a Placebo Product. PLoS One 11(11):e0167121. Published online 2016 Nov 22. https://doi.org/10.1371/journal.pone.0167121
Enck P, Klosterhalfen S (2019) Does sex/gender play a role in placebo and Nocebo effects? Conflicting Evidence From Clinical Trials and Experimental Studies. Front Neurosci 13:160
Skvortsova A, Veldhuijzen DS, van Middendorp H, Colloca L, Evers AWM (2019) Effects of Oxytocin on Placebo and Nocebo Effects in a Pain Conditioning Paradigm: A Randomized Controlled Trial. J Pain. https://doi.org/10.1016/j.jpain.2019.08.010 [Epub ahead of print]
Desai RJ, Sarpatwari A, Dejene S, Khan NF, Lii J, Rogers JR, Dutcher SK, Raofi S, Bohn J, Connolly JG, Fischer MA, Kesselheim AS, Gagne JJ (2019) Comparative effectiveness of generic and brand-name medication use: A database study of US health insurance claims. PLoS Med 16:e1002763
Spanou I, Mavridis T, Mitsikostas DD (2019) Nocebo in Biosimilars and Generics in Neurology: A Systematic Review. Front Pharmacol 10:809
Hall KT, Loscalzo K, Kaptchuk TJ (2015) Genetics and the Placebo Effect: the Placebome. Trends Mol Med 21(5):285–294. https://doi.org/10.1016/j.molmed.2015.02.009 Author manuscript; available in PMC 2016 May 1. Published in final edited form as: Trends Mol Med. Published online 2015 Apr 14
Lee YS, Jung WM, Bingel U, Chae Y (2019) The context of values in pain control: understanding the price effect in placebo analgesia. J Pain
Świder K, Bąbel P (2016) The Effect of the Type and Colour of Placebo Stimuli on Placebo Effects Induced by Observational Learning. PLoS One 11(6):e0158363. https://doi.org/10.1371/journal.pone.0158363 Published online 2016 Jun 30
Meissner K, Fässler M, Rücker G, Kleijnen J, Hróbjartsson A, Schneider A, Antes G, Linde K (2013) Differential effectiveness of placebo treatments: a systematic review of migraine prophylaxis. JAMA Intern Med 173(21):1941–1951. https://doi.org/10.1001/jamainternmed.2013.10391
There was no founding for this work.
Ethics approval and consent to participate
Ethics approval and consent to participate was not needed for this position article.
Consent for publication
All authors have reviewed the final version and gave their approval for publication.
Authors, Financial disclosure (consulting, speaking fees, travel grants, research support).
Dimos D. Mitsikostas: Allergan, Amgen, Bayer, Biogen, Cefaly, Electrocore, Genesis Pharma, Eli Lily, Merck-Serono, Merz, Sanofi-Genzyme, Roche, Specifar, Teva.
Charlotte Blease reports no competing interests.
Elisa Carlino reports no competing interests.
Luana Colloca reports no competing interests.
Andrew L. Geers reports no competing interests.
Jeremy Howick reports no competing interests.
Andrea WM Evers reports no competing interests.
Magne A. Flaten reports no competing interests.
John M. Kelley reports no competing interests.
Irving Kirsch reports no competing interests.
Regine Klinger reports no competing interests.
Antoinette Maassen van den Brink: Allergan, Amgen/Novartis, Lilly, Teva.
Daniel E. Moerman reports no competing interests.
Petros P. Sfikakis reports no competing interests.
Lene Vase reports no competing interests.
Tor D. Wager reports no competing interests.
Fabrizio Benedetti reports no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Mitsikostas, D.D., Blease, C., Carlino, E. et al. European Headache Federation recommendations for placebo and nocebo terminology. J Headache Pain 21, 117 (2020). https://doi.org/10.1186/s10194-020-01178-3