- Review Article
- Open Access
Quality in the provision of headache care. 1: systematic review of the literature and commentary
The Journal of Headache and Pain volume 13, pages437–447(2012)
Widely accepted quality indicators for headache care would provide a basis not only for assessment of care but also, and more importantly, for its improvement. The objective of the study was to identify and summarize existing information on such indicators: specifically, did indicators exist, how had they been developed, what aspects of headache care did they relate to and how and with what utility were they being used? A systematic review of the medical literature was performed. A total of 32 articles met criteria for inclusion. We identified 55 existing headache quality indicators of which 37 evaluated processes of headache care. Most were relevant only to specific populations of patients and to care delivered in high-resource settings. Indicators had been used to describe overall quality of headache care at a national level, but not systematically applied to the evaluation and improvement of headache services in other settings. Some studies had evaluated the use of existing disability and quality of life instruments, but their findings had not been incorporated into quality indicators. Existing headache care quality indicators are incomplete and inadequate for purpose. They emphasize processes of care rather than structure or outcomes, and are not widely applicable to different levels and locations of headache care. Furthermore, they do not fully incorporate accepted evidence regarding optimal methods of care. There is a clear need for consensus-based indicators that fully reflect patients’ and public-health priorities. Ideally, these will be valid across cultures and health-care settings.
Despite the high prevalence of recurrent headache disorders—principally migraine and tension-type headache—and the substantial burden of public ill-health they generate [1, 2], there are considerable variations worldwide in the nature, scope, organization, quantity and quality of medical care provided for these illnesses. At the same time, there is good evidence that optimal care is rarely achieved. There are multiple clinical, social and political barriers to both provision of and access to effective headache care, a recent publication by the World Health Organization stated: “The facts and figures presented … illuminate the worldwide neglect of a major cause of public ill-health and reveal the inadequacies of responses to it in countries throughout the world” . In addition, and standing as a barrier to improvement, it is not certain that there is a universal view of what optimal headache services should look like, or, indeed, of the meaning in this context of “optimal”.
It is axiomatic that health-care systems should aspire to high quality of care, but progress toward this requires that quality can be assessed. Before this is possible, “quality” must first be defined. Donabedian , in a view now widely endorsed, suggested that quality of care should be considered in each of three domains: “structure” (the attributes of the settings in which care occurs); “process” (the giving and receiving of care); and “outcome” (the effects that care has on health status). Donabedian  also described seven attributes that in his view collectively defined health-care quality: efficacy, effectiveness, efficiency, optimality, acceptability, legitimacy and equity. A definition of quality of health care offered by the US Institute of Medicine (IOM) put the emphasis on outcomes: the degree to which health-care services for individuals and populations increase the likelihood of desired health outcomes and are consistent with current professional knowledge . The IOM specified six attributes of quality, differing somewhat from Donabedian’s seven: safety, timeliness, effectiveness, efficiency, equity and patient/family-centerdness.
What are needed for services delivering headache care are agreed and widely accepted quality measures. Their application to existing services might, by establishing standards of care, providing benchmarks and revealing deficiencies, motivate and guide improvements. Their employment will bring clarity of purpose to initiatives aimed at developing services where none exist. As a project within the Global Campaign against Headache [6, 7], which seeks both to develop and improve services, we performed a systematic literature review with the aim of identifying and summarizing existing information on quality indicators for headache care. Specifically, our questions were: did indicators exist, how had they been developed, what aspects of headache care did they relate to and how and with what utility were they being used?
During 2009 we searched Medline, EMBASE and CINAHL without language restrictions for relevant articles using the search terms “headache disorders” and “health care quality” for both title and text words. We combined the individual search results using the Boolean operator “AND”. We extended the search to articles containing text words “headache care*.tw” or “headache service*.tw” in order to ensure identification of all relevant articles. The thesaurus terms and text words used for these searches are shown in Table 1. The search was limited to articles from 1988 onwards, this being the year in which universally accepted definitions of headache disorders were first published . We updated the search in February 2012 and found no new articles specifically related to the definition of quality or to quality indicators in the context of headache care. All identified articles were transferred to Reference Manager®, a bibliographic software program.
Inclusion and exclusion criteria
Two of the authors (SP and MP) screened titles and abstracts for relevance using predefined inclusion and exclusion criteria. Studies were included if they reported the development or application of quality indicators for headache care or evaluated other aspects of service provision for headache disorders. Articles unrelated to primary headache disorders, review articles, drug treatment studies, case reports, letters and comments, and papers that were not written in English were excluded. We obtained full-text versions of papers selected for further review, and again evaluated these against our inclusion and exclusion criteria. Any disagreements were resolved by consensus. Figure 1 shows the flow of studies through the review.
Data extraction and analysis
A data extraction form was developed to summarize the relevant results of the studies selected. Formal statistical analysis was not possible because of the heterogeneity of evidence and measures in the selected articles, so a narrative synthesis of the findings was prepared.
A total of 32 studies met criteria for inclusion in the review. Four [9–12] reported development of quality indicators for use in headache-service delivery; 28 [13–40] (listed in Table 2) evaluated aspects of headache care quality in a variety of settings, but did not employ formal quality measures to do so.
Development of quality indicators
Tables 3 and 4 list the characteristics and results of the four studies that reported on the development of a total of 55 quality indicators. These indicators are categorized according to domain of application: structure, process or outcome of headache care. Within these domains are sub-domains into which they are further categorized. In fact, none of the studies developed indicators of quality of structural aspects of headache care. All, however, selected indicators of process, and 36 of the 37 process measures evaluated diagnostic or treatment procedures (for example, the use of specific diagnostic procedures when certain features were present in history or physical examination, or the prescription of specific medications for certain types of headache). Such process indicators commonly use “if–then” statements, and therefore do not apply to all patients evaluated for headache. Only two studies developed indicators of outcome of headache care: a total of 18 indicators, focusing on frequency and severity of headaches or on uptake of care. None of these outcome indicators evaluated disability, quality of life or patients’ satisfaction with care.
All four studies were conducted in developed western countries, but they varied in their goals and in their methods of indicator development. Two [9, 10] aimed to evaluate overall quality of care provided at a national level for a number of common conditions, headache among them. They employed elaborate consensus methods for the development of indicators focused on process, since the scope of the projects made it unfeasible to collect outcome information. The other two studies [11, 12] had the more specific goal of evaluating migraine care, either within health plans or within a specialty clinic. They employed less extensive, more practical methods to develop quality indicators, but concentrated on treatment outcomes. These four studies are the key, and we describe them below in more detail.
McGlynn et al.  developed quality indicators for 30 acute and chronic conditions; the purpose was to assess overall quality of medical care provided to adults in the United States (US). Marshall et al.  developed quality indicators for 18 diseases in a project to assess quality of health care delivered to adults in primary care in the United Kingdom (UK). In both studies, the process of developing quality indicators began with a literature review. McGlynn et al.  then used a modified Delphi method to develop a final set of indicators. US experts in each disease area rated putative quality indicators on a 9-point scale from 1 (“not valid”) to 9 (“very valid”). Only those with a median composite score of ≥7 were selected. Similar methods were employed by Marshall et al. . UK primary-care experts rated putative indicators on a 9-point validity scale, and also rated the necessity of including such information in patient records. Only those that achieved mean scores of ≥8 for validity and ≥6 for necessity scale were selected.
Leas et al.  developed a set of 20 quality of care measures specific to migraine—the only set of indicators to include both process and outcome measures. Existing measures were identified through a literature review and other candidate measures through telephone interviews with leaders in migraine care, health-care purchasing and managed care. An advisory board of experts then discussed all putative measures and, by consensus, selected a final set of indicators for testing. In contrast to those developed by McGlynn and by Marshall, this set of quality indicators included a number that evaluated the costs and outcomes of treatment.
Ferrari et al.  developed a set of quality indicators for headache care in conjunction with the staff of a specialist headache center and a quality assurance office. The goal of these indicators was to ensure the provision of consistent, high-quality care within a specialized headache treatment center. This set of indicators did not include any measures of headache care structure or process but instead focused exclusively on specific aspects of treatment outcome.
Evaluation of specific aspects of headache care
Table 2 lists the 28 studies [13–40] that assessed specific components of headache care associated with quality, without employing formal quality indicators. It also indicates the domains of quality (and sub-domains) addressed by each. All these studies were conducted in highly resourced locations, but evaluated strategies and aspects of care delivered in a range of settings by different practitioners. Four studies [18, 23, 28, 30] were conducted in primary care, three [14, 36, 37] in intermediate care, where treatment was provided by general practitioners with a special interest in headache, and one  in a setting where specialist nurses provided care. Six studies [21, 22, 31, 38–40] were conducted in specialty headache clinics, one  in an inpatient treatment setting, and five [13, 15, 17, 32, 33] evaluated headache care in emergency departments. Four studies [17, 19, 28, 39] assessed diagnostic accuracy, while eight [16, 18, 23, 26, 27, 31, 34, 35] evaluated the effects of specific strategies of headache management. Only two of the studies [31, 34] included a control group; one of these  was a randomized clinical trial. Some of the studies evaluated outcomes using existing general or headache-specific disability or quality of life instruments. Table 5 (available on-line) documents the study characteristics in detail.
We found no studies that reported on the reliability, validity, practicality or implementation of any of the 55 indicators.
While many quality indicators have been developed to evaluate headache care, evidence regarding their reliability, validity and practicality is lacking. They emphasize processes of care rather than outcomes, and ignore structure. Most cover areas of routine assessment, but do not clearly specify the tool or process to be used in evaluation. Others describe desirable treatment in broad terms, including diagnosis, management or administration of particular tests or drugs. None of the identified measures report inter-rater reliability or other psychometric properties. They are not clearly applicable to different levels and locations of headache care. There is no evidence that any of them have been used for quality improvement, although this is presumably the purpose for which they were developed.
The process of developing quality indicators was not, in any of the studies, begun with, or therefore informed by, an agreed definition of “quality”. What is surprising is that neither did these studies attempt to construct a definition, in the specific context of headache care, as a prerequisite for developing indicators of it. While quality is important in health care for any condition, and may to that extent have a general definition, there are aspects of it that are specific to or of particular importance in headache care. Furthermore, it is not clear that a universally accepted general definition of quality of care does exist; even its attributes are not wholly agreed . At issue here is whose perspectives matter in the meaning and assessment of health-care quality: patients’, health-care providers’ or payers’? Assuming they all do to an extent, and they are not perfectly aligned, which have priority? Quality is not necessarily coupled to financing: there is no direct relationship between better outcomes and the amount spent on health care . Improving the quality of care for headache disorders goes beyond better diagnosis and good treatment, since large numbers of people with headache do not consult doctors and hence will not benefit from improvements in care processes. There is clear evidence of high barriers to care , and the need to dismantle them is high on the agenda for headache-service quality improvement. Sorting out these issues appears to be a prerequisite for developing quality indicators for headache services, but it has not been done.
Our study has strengths: the systematic nature of the literature search and review and the incorporation of information from studies that provided indirect evidence relevant to the development of quality indicators. Its main limitation was that we were able to search only for publicly available quality indicators and implementation studies: it is possible that insurance companies or other health management organizations have developed, validated and implemented proprietary quality indicators that have not been published. Of course, if such indicators exist, it might be asked whose perspective(s) they reflect.
In conclusion, we identified a number of studies providing evidence of the value of specific types, strategies and measures of headache treatment, but much further work is needed to incorporate these findings into the development of valid and practical quality indicators. There is no agreed definition of “quality” of headache care, and no considered view on how the non-aligned perspectives of different stakeholders in headache care should be placed in order of priority. Consensus on these issues is urgently required if health care for headache—clearly suboptimal throughout the world—is to be improved. This is a priority for patients and for public health.
Stovner L, Hagen K, Jensen R, Katsarava Z, Lipton R, Scher A, Steiner T, Zwart JA (2007) The global burden of headache: a documentation of headache prevalence and disability worldwide. Cephalalgia 27(3):193–210, 17381554, 10.1111/j.1468-2982.2007.01288.x
World Health Organization and Lifting The Burden (2011) Atlas of headache disorders and resources in the world 2011. Switzerland, Geneva
Donabedian A (1988) The quality of care. How can it be assessed? JAMA 260(12):1743–1748, 3045356, 10.1001/jama.1988.03410120089033, 1:STN:280:DyaL1czhslajsA%3D%3D
Donabedian A (1990) The seven pillars of quality. Arch Pathol Lab Med 114(11):1115–1118, 2241519, 1:STN:280:DyaK3M%2FltlKrsQ%3D%3D
Institute of Medicine, Committee to Design a Strategy for Quality Review and Assurance in Medicare (1990) Medicare: a strategy for quality assurance, vol 1. National Academies Press, Washington DC
Steiner TJ (2004) Lifting the burden: the global campaign against headache. Lancet Neurol 3(4):204–205, 15039030, 10.1016/S1474-4422(04)00703-3, 1:STN:280:DC%2BD2c7nvFCmtQ%3D%3D
Steiner TJ, Birbeck GL, Jensen R, Katsarava Z, Martelletti P, Stovner LJ (2010) Lifting The Burden: the first 7 years. J Headache Pain 11(6):451–455, 21080023, 10.1007/s10194-010-0264-6
International Headache Society (1988) Classification and diagnostic criteria for headache disorders, cranial neuralgias and facial pain. Headache Classification Committee of the International Headache Society. Cephalalgia 8(Suppl 7):1–96
Marshall M, Campbell S, Hacker J, Roland M (eds) (2002) Quality indicators for general practice. A guide for health professionals and managers, 1st edn. Royal Society of Medicine Press Ltd., London
McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA (2003) The quality of health care delivered to adults in the United States. N Engl J Med 348(26):2635–2645, 12826639, 10.1056/NEJMsa022615
Ferrari A, Baraghini GF, Sternieri E, Cavazzuti L, Roli L (2000) Quality assurance system using ISO 9000 series standards to improve the effectiveness and efficacy of the Headache Centre. Funct Neurol 15(Suppl 3):230–236, 11200797
Leas BF, Gagne JJ, Goldfarb NI, Rupnow MF, Silberstein S (2008) Assessing quality of care for migraineurs: a model health plan measurement set. Popul Health Manag 11(4):203–208, 18942925, 10.1089/pop.2007.0020
Agostoni E, Santoro P, Frigerio R, Frigo M, Beghi E, Ferrarese C (2004) Management of headache in emergency room. Neurol Sci 25(Suppl 3):S187–S189, 15549533, 10.1007/s10072-004-0282-8
Belam J, Harris G, Kernick D, Kline F, Lindley K, McWatt J, Mitchell A, Reinhold D (2005) A qualitative study of migraine involving patient researchers. Br J Gen Pract 55:87–93, 15720928
Bigal M, Bordini CA, Speciali JG (2000) Headache in an emergency room in Brazil. Sao Paulo Med J 118(3):58–62, 10810329, 10.1590/S1516-31802000000300002, 1:STN:280:DC%2BD3cvhtFalsg%3D%3D
Blumenfeld A, Tischio M (2003) Center of excellence for headache care: group model at Kaiser Permanente. Headache 43(5):431–440, 12752747, 10.1046/j.1526-4610.2003.03087.x
Blumenthal HJ, Weisz MA, Kelly KM, Mayer RL, Blonsky J (2003) Treatment of primary headache in the emergency department. Headache 43(10):1026–1031, 14629236, 10.1046/j.1526-4610.2003.03202.x
Campinha-Bacote DL, Kendle JB, Jones C, Callicoat D, Webert A, Stoukides CA, Kaul AF (2005) Impact of a migraine management program on improving health outcomes. Dis Manag 8(6):382–391, 16351556, 10.1089/dis.2005.8.382
Clarke CE, Edwards J, Nicholl DJ, Sivaguru A, Davies P, Wiskin C (2005) Ability of a nurse specialist to diagnose simple headache disorders compared with consultant neurologists. J Neurol Neurosurg Psychiatry 76(8):1170–1172, 16024902, 10.1136/jnnp.2004.057968, 1:STN:280:DC%2BD2Mzms1yluw%3D%3D
Clarke CE, Edwards J, Nicholl DJ, Sivaguru A, Furmston A, Davies P (2008) Prospective evaluation of a nurse-led headache service in a sub-regional neurology unit. Br J Neurosci Nurs 4(2):74–78
Davies PTG, Glynn CJ, Kadry MA (2003) Expectations of patients attending a combined headache clinic. J Headache Pain 4:79–82, 10.1007/s10194-003-0035-8
Dowson AJ (2003) Analysis of the patients attending a specialist UK headache clinic over a 3-year period. Headache 43(1):14–18, 12864753, 10.1046/j.1526-4610.2003.03003.x
Elsner F, Sonntag B, Radbruch L, Sabatowski R (2004) Improvement of health care for headache patients with a regional pain management network. The Pain Clinic 16(4):417–420, 10.1163/1568569042664558
Gahir KK, Larner AJ (2004) What role do community pharmacists currently play in the management of headache? A hospital-based perspective. Int J Clin Pract 58(3):257–259, 15117092, 10.1111/j.1368-5031.2004.00026.x, 1:STN:280:DC%2BD2c3hvVyqtg%3D%3D
Gahir KK, Larner AJ (2006) Primary headache disorder in the emergency department: perspective from a general neurology outpatient clinic. Emerg Med J 23(2):135–136, 16439744, 10.1136/emj.2004.023010, 1:STN:280:DC%2BD28%2FlsVyltg%3D%3D
Harpole LH, Samsa GP, Jurgelski AE, Shipley JL, Bernstein A, Matchar DB (2003) Headache management program improves outcome for chronic headache. Headache 43(7):715–724, 12890125, 10.1046/j.1526-4610.2003.03128.x
Harpole LH, Samsa GP, Matchar DB, Silberstein SD, Blumenfeld A, Jurgelski AE (2005) Burden of illness and satisfaction with care among patients with headache seen in a primary care setting. Headache 45(8):1048–1055, 16109119, 10.1111/j.1526-4610.2005.05186.x
Karli C, Zarifoglu M, Erer S, Pala K, Akis N (2006) The impact of education on the diagnostic accuray of tension-type headache and migraine: a prospective study. Cephalalgia 27:41–45, 10.1111/j.1468-2982.2006.01245.x
Larner AJ (2005) Guidelines for the management of headache in primary care: are they being used? J Headache Pain 6(5):420–421, 16362717, 10.1007/s10194-005-0232-8
Latinovic R, Gulliford M, Ridsdale L (2006) Headache and migraine in primary care: consultation, prescription, and referral rates in a large population. J Neurol Neurosurg Psychiatry 77(3):385–387, 16484650, 10.1136/jnnp.2005.073221, 1:STN:280:DC%2BD287isFSitw%3D%3D
Magnusson JE, Riess CM, Becker WJ (2004) Effectiveness of a multidisciplinary treatment program for chronic daily headache. Can J Neurol Sci 31(1):72–79, 15038474
Maizels M (2001) Headache evaluation and treatment by primary care physicians in an emergency department in the era of triptans. Arch Intern Med 161(16):1969–1973, 11525699, 10.1001/archinte.161.16.1969, 1:STN:280:DC%2BD3Mrit1ylsg%3D%3D
Maizels M, Saenz V, Wirjo J (2003) Impact of a group-based model of disease management for headache. Headache 43(6):621–627, 12786921, 10.1046/j.1526-4610.2003.03104.x
Matchar DB, Harpole L, Samsa GP, Jurgelski A, Lipton RB, Silberstein SD, Young W, Kori S, Blumenfeld A (2008) The headache management trial: a randomized study of coordinated care. Headache 48(9):1294–1310, 18547268, 10.1111/j.1526-4610.2007.01148.x
Melchart D, Wessel A, Brand R, Hager S, Weidenhammer W (2008) Profiling quality of care for patients with chronic headache in three different German hospitals - a case study. BMC Health Serv Res 8:13, 18199321, 10.1186/1472-6963-8-13
Offredy M, Cleary M, Bland A, Donovan A, Kelshiker A (2008) Improving health and care for patients by redesigning services: the development and implementation of a clinical assessment service in Harrow Primary Care Trust. Qual Prim Care 16(2):95–102, 18700086
Ridsdale L, Doherty J, McCrone P, Seed P (2008) A new GP with special interest headache service: observational study. Br J Gen Pract 58(552):478–483, 18611313, 10.3399/bjgp08X319440
Soon YY, Siow HC, Tan CY (2005) Assessment of migraineurs referred to a specialist headache clinic in Singapore: diagnosis, treatment strategies, outcomes, knowledge of migraine treatments and satisfaction. Cephalalgia 25(12):1122–1132, 16305601, 10.1111/j.1468-2982.2005.00969.x, 1:STN:280:DC%2BD2MnisFarsw%3D%3D
Vincent MB, de Carvalho JJ (1999) Primary headache care delivery by nonspecialists in Brazil. Brazilian Headache Care Cooperative Group. Cephalalgia 19(5):520–524, 10403068, 10.1046/j.1468-2982.1999.019005520.x, 1:STN:280:DyaK1MzjtFGjsg%3D%3D
Zeeberg P, Olesen J, Jensen R (2005) Efficacy of multidisciplinary treatment in a tertiary referral headache centre. Cephalalgia 25(12):1159–1167, 16305604, 10.1111/j.1468-2982.2005.00980.x, 1:STN:280:DC%2BD2MnisFartg%3D%3D
McGlynn EA (2004) There is no perfect health system. Health Aff (Millwood) 23(3):100–102, 10.1377/hlthaff.23.3.100
We would like to thank Lifting The Burden, the International Headache Society and the European Headache Federation for financially supporting this work.
Conflict of interest
This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.
Electronic supplementary material
Below is the link to the electronic supplementary material.
About this article
Cite this article
Peters, M., Perera, S., Loder, E. et al. Quality in the provision of headache care. 1: systematic review of the literature and commentary. J Headache Pain 13, 437–447 (2012). https://doi.org/10.1007/s10194-012-0466-1
- Quality of care
- Quality indicators
- Systematic review
- Global Campaign against Headache