Skip to main content

The headache under-response to treatment (HURT) questionnaire, an outcome measure to guide follow-up in primary care: development, psychometric evaluation and assessment of utility

Abstract

Background

Headache disorders are both common and burdensome but, given the many people affected, provision of health care to all is challenging. Structured headache services based in primary care are the most efficient, equitable and cost-effective solution but place responsibility for managing most patients on health-care providers with limited training in headache care. The development of practical management aids for primary care is therefore a purpose of the Global Campaign against Headache. This manuscript presents an outcome measure, the Headache Under-Response to Treatment (HURT) questionnaire, describing its purpose, development, psychometric evaluation and assessment for clinical utility. The objective was a simple-to-use instrument that would both assess outcome and provide guidance to improving outcome, having utility across the range of headache disorders, across clinical settings and across countries and cultures.

Methods

After literature review, an expert consensus group drawn from all six world regions formulated HURT through item development and item reduction using item-response theory. Using the American Migraine Prevalence and Prevention Study’s general-population respondent panel, two mailed surveys assessed the psychometric properties of HURT, comparing it with other instruments as external validators. Reliability was assessed in patients in two culturally-contrasting clinical settings: headache specialist centres in Europe (n = 159) and primary-care centres in Saudi Arabia (n = 40). Clinical utility was assessed in similar settings (Europe n = 201; Saudi Arabia n = 342).

Results

The final instrument, an 8-item self-administered questionnaire, addressed headache frequency, disability, medication use and effect, patients’ perceptions of headache “control” and their understanding of their diagnoses. Psychometric evaluation revealed a two-factor model (headache frequency, disability and medication use; and medication efficacy and headache control), with scale properties apparently stable across disorders and correlating well and in the expected directions with external validators. The literature review found few instruments linking assessment to clinical advice or suggested actions: HURT appeared to fill this gap. In European specialist care, it showed utility as an outcome measure across headache disorders. In Saudi Arabian primary care, HURT (translated into Arabic) was reliable and responsive to clinical change.

Conclusions

With demonstrated validity and clinical utility across disorders, cultures and settings, HURT is available for clinical and research purposes.

Background

Headache disorders are very common, affecting half or more of all adults and many children worldwide [1], and they are highly burdensome [2,3,4,5,6,7,8]. The World Health Organization (WHO) recognised them nearly 20 years ago as a global public-health priority [9]. Among them, migraine and tension-type headache (TTH) are often lifelong illnesses. Medication-overuse headache (MOH), usually a complication of migraine or TTH caused by mistreatment of one or the other, is highly frequent, often present daily or almost so. These three headache disorders are the substantial contributors to public ill health, although there are many others [10]. They cause pain, hinder work, damage family and social relationships and impoverish quality of life (QoL).

Headache disorders are largely treatable [11], and they demand treatment not only because it is inhumane to ignore these burdens of ill health. The high levels of disability associated with headache [2,3,4,5,6,7,8] lead to very large productivity losses, so that these disorders are very costly in a financial sense [12, 13]. Although the economic consequences of improving headache care are not well studied empirically [14], health services that make the effective remedies more widely available would very probably be cost saving in most economies [12, 15]. Treatment of headache is therefore demanded also because it is economically sensible.

Nevertheless, given the very large numbers of people affected, adequate provision of health care to everyone for whom self-care is insufficient – perhaps 50% of those with a headache disorder [16] – is highly challenging.

Structured headache services, with their basis in primary care and supported by educational initiatives, are the most efficient, equitable and cost-effective solution [12]. Such services place responsibility for managing most people with headache on health-care providers who lack special expertise in headache management [16]. This is not in itself problematic: medical management of headache disorders, for the great majority of people affected by them, requires no specialist expertise or investigations but only the diagnostic and management skills that are available to all physicians and many other health-care providers in primary care [12, 16]. On the other hand, non-specialists throughout the world may have received limited training in the application of these basic skills to headache diagnosis and treatment [12].

The development of practical management aids for primary care therefore became an early objective of the Global Campaign against Headache [17,18,19], a programme of action for the benefit of people with headache conducted by the UK-registered non-governmental organization Lifting The Burden (LTB) in official relations with WHO [20]. This manuscript presents one such aid, the Headache Under-Response to Treatment (HURT) questionnaire; it describes its purpose and its development, and summarises the studies undertaking its psychometric evaluation and assessment for clinical utility.

Objective

We believed that a simple outcome measure was insufficient. Whenever treatment of a patient is started, or changed, follow-up should either ensure that treatment is optimal or recognise that it is not and identify the change(s) in treatment needed. Evaluation of outcome should therefore be coupled with guidance to improve outcome. While this was the instrument’s perceived purpose, it is not so simple a purpose – resources, services and expectations vary greatly between countries and cultures – and no other treatment-assessment instrument met it [21]. No previously described instrument had been shown to function for all important headache disorders or across cultures, and no single instrument covered the range of assessment and decision-making necessary for successful headache management [21]. Few made the key link between assessment and clinical advice, essential because, even in optimal circumstances, outcomes are rarely perfect. Judgement may be needed as to whether the outcome achieved in an individual patient is the best that the patient can reasonably expect. For the non-specialist in particular, one question sometimes arising is: “What further effort, in hope of a better outcome, is justified?” A second question, which may follow, is “What is it that needs changing?”

The objective, therefore, was an instrument that would both assess outcome and provide answers to these two questions, offering guidance on appropriate actions towards treatment optimisation. More specifically, we aimed to create a short, simple-to-use management aid, versatile yet reliable and sensitive, which met the purpose described and three utility requirements:

  1. 1.

    in both primary and specialist care;

  2. 2.

    across the range of headache disorders of public-health importance;

  3. 3.

    across countries and cultures, despite wide variation in resources, services and expectations.

This objective would be reached through a development process invoking expert consensus followed by psychometric and clinical evaluations involving professional and lay representatives of all world regions.

Methods

Development was a multi-stage process including item development, item reduction using item-response theory (IRT), psychometric testing and external validation, and assessment of clinical utility.

For item development, LTB brought together an international expert consensus group (Table 1), with the technical support of WHO. The members, from all six world regions, included headache specialist health-care professionals, primary-care physicians, lay patient advocates and experts in health economics, psychometrics and qualitative research. The group met first in April 2006 at WHO headquarters in Geneva and agreed the domains that the instrument should address. After a literature review of existing instruments with related purposes, a large item pool within these domains was developed. In further discussions within the group, and through consensus, initial item selection was followed by a process of item reduction, refining the selection and limiting the number of items to those considered most apt (relevant and informative). These candidate items were formulated into simple questions, with response options based on the group’s expert knowledge and clinical experience, and included in the emerging instrument. A scoring system was constructed around them, with guidance on interpretation. Accompanying clinical advice, according to responses, was developed through reference to authoritative treatment guidelines from multiple countries coupled again with the group’s expert input. A design process then built a first version (“HURT-v1”) of the end-product as a 2-page document.

Table 1 Development group

The Geneva group’s final task was to name the instrument.

Psychometric evaluation (see below) was carried out on HURT-v1. Informed by the results, a smaller group met in New York City in October 2007 (Table 1), making changes as necessary, again through consensus, and generating the final version (“HURT-final”). Clinical evaluations were performed on HURT-final.

Evaluation

Two groups were involved in evaluation of HURT, one in psychometric testing and the other in clinical assessments (Table 2).

Table 2 Evaluation groups

Psychometric testing and validation

The American Migraine Prevalence and Prevention (AMPP) Study [22] recruited from a panel constructed and maintained by the survey company NFO, Inc. (Ames, IA, USA) [23] to match the US population, according to the national census, by age, gender, socioeconomic status and region of the country. The AMPP screening survey identified participants describing themselves as affected by “severe headache”, a term intended preferentially to capture those with migraine and/or with unmet needs for headache treatment. We included HURT-v1 in two surveys mailed to samples of these AMPP Study participants.

Ethics approval

The AMPP Study, with inclusion of HURT, was approved by the Albert Einstein College of Medicine Institutional Review Board. The mailings included explanations of the study, and voluntary participation in the surveys implied consent.

Sociodemographic variables

Recorded in these surveys were age, gender, weight and height, all self-reported. Body-mass index (BMI) was calculated from height and weight using the WHO standard formula. Data were also collected on average annual household income, race and geographic region.

US mailing #1: Psychometric testing

HURT-v1, including all candidate items and response options, was posted to a first sample (N = 2500) in summer, 2006. Enclosed in the mailing were question sets on the sociodemographic variables and on headache frequency, severity, associated symptoms and treatment.

The headache-related data were used to diagnose participants with migraine, using the American Migraine Study (AMS)/AMPP Study diagnostic module (demonstrated to have 100% sensitivity and 82% specificity for this diagnosis) [24]. Case-definition criteria for migraine accorded with ICHD-II [25], except that a lifetime history of ≥5 attacks could not be ascertained from the cross-sectional data. No significant changes have occurred between ICHD-II [25] and ICHD-3-beta [10] with regard to these criteria. Only participants with headache on ≤14 days/month were included as migraine cases (ie, episodic migraine) in this analysis.

Item analysis

Responses from these participants to HURT items 1–6 were included in a graded item-response model applied to assess scale properties using SAS NLMIXED and to identify an underlying latent variable. However, the HURT metrics for items 1–6 varied: four were count items (with two based on 1 month’s recall and two based on 3 months’ recall) and two were polytomous response items. To simplify item analysis, we harmonized item responses, placing all on an identical metric. Count items were converted to five-category polytomous items, with severity values in the range 0–4 as follows:

  1. 1.

    0 (very mild): 0 days in 1 month or 0 days in 3 months;

  2. 2.

    1 (mild): 1–2 days in 1 month or 1–5 days in 3 months;

  3. 3.

    2 (moderate): 3–5 days in 1 month or 6–10 days in 3 months;

  4. 4.

    3 (severe): 6–15 days in 1 month or 11–20 days in 3 months;

  5. 5.

    4 (very severe): ≥16 days in 1 month or ≥21 days in 3 months.

The original two polytomous response items were harmonized so that higher-ordered response options were also indicative of greater severity. Consequently, the medication efficacy item was reverse-coded (0–4) to reflect increasing inefficacy, and the headache-control item was reverse-coded (0–4) to reflect increasing lack of control. Total and factor-specific scores could then be computed as simple sums of the scale items.

An item-response model was fitted to these item scores using a multinomial response-distribution. Item parameters were estimated for the five response categories offered for each item. A confirmatory factor analysis model was also employed where the original count items loaded on the first factor and the original polytomous items loaded on the second. The correlation between the two factors was freely estimated.

Performance across headache types

In the second mailing sample (described below), we attempted to contrast HURT factor scores across headache types to assess relative performance.

US mailing #2: External validity

HURT-v1 was posted, in autumn 2006, to a different sample (N = 2250), along with similar sociodemographic and headache question sets. Included in this mailing were multiple external validators: other instruments used in headache management and themselves well-validated as measures of headache-attributed impact, treatment optimization, health-related QoL (HRQOL) or comorbid depression. These are described in Table 3. For purposes of correlation with these external validators, we used the total HURT scores derived during item analysis (see above). Comparisons employed Spearman correlations.

Table 3 Instruments used as external validators

Reliability

Two studies were undertaken to assess reliability, in very different cultural and clinical settings. Both have been published previously [26, 27], and are therefore only summarised here.

HURT-final was completed twice by 159 consecutive patients seeking non-urgent care in headache specialist centres in Denmark and United Kingdom (UK) [26]. The instrument was first mailed to patients as they joined the clinic waiting lists, before their initial visits, and then given to them at these initial visits, which were expected usually to take place about 1 month later.

For testing in Arabic-speaking patients in Saudi Arabia, HURT was translated according to LTB’s translation protocol for hybrid documents [28]. Test-retest reliability was assessed in 40 consecutive patients of four primary-care centres, who completed HURT at two visits 4–6 weeks apart while receiving usual care [27].

Ethics approval

In Denmark and UK, evaluation of HURT as an outcome measure was considered a service-improvement project, falling outside the scope of research ethics review [26]. Ethics approval was requested in Saudi Arabia, and granted by the Institutional Review Board of National Guard Health Affairs [27]. In both studies, information was provided and all participants gave consent.

Clinical testing

The first assessment of clinical utility, to demonstrate that HURT was responsive to change induced by effective management, was conducted in headache specialist centres in three European countries [26]. In Denmark and UK, HURT was administered on a third occasion to the same 159 consecutive patients when, in each case, the treating specialist judged that the best possible outcome had been achieved. In Italy, HURT was answered by 42 patients at initial and final visits [26].

Clinical testing

The second assessment evaluated the Arabic version of HURT in primary care in Saudi Arabia. The general practitioners (GPs) in four centres were trained in headache management, and the centres then randomized in pairs to control (standard care) or intervention (care guided by implementation of HURT). Responsiveness of HURT to clinical change was assessed by comparing base-line responses to HURT questions 1–6 with those at follow up. Clinical utility was assessed by comparing outcomes between control and intervention pairs after 3 months, using locally-developed 5-point verbal-rating scales: patient-satisfaction scale (PSS) and doctor-satisfaction scale (DSS) [27].

Ethics approval

In Denmark and UK, these studies again fell outside the scope of research ethics review [26]. Ethics approvals were obtained in Italy from the ethics review committee of C Mondino Foundation, University of Pavia [26], and in Saudi Arabia from the Institutional Review Board of the King Abdullah International Medical Research Center (KAIMRC) [27]. In both studies, information was provided and all participants gave consent.

Results

The Geneva meeting identified the following as essential domains: headache frequency, disability, medication use and effect, patients’ perceptions of headache “control” and their understanding of their diagnoses. The group developed an 8-item self-administered questionnaire addressing these. Responses were either numerated in days over a one- or three-month recall-period or selected from Likert options. In either case, responses were graded into an area of “no concern” or one of three flagged areas indicating increasingly important treatment deficiencies; clinical advice was provided for each of the latter.

The design process constructed the questionnaire, with responses, interpretation and advice, into the form shown (Additional file 1).

After the psychometric evaluations, and informed by them, the New York meeting made only minimal changes to generate HURT-final.

Psychometric evaluation

Psychometric testing

In the assessment of scale properties, valid returns came from 1691 (68%) respondents to the first US mailing. A large majority (1362; 81%) met ICHD-II criteria for migraine [25]. IRT revealed a two-factor model: 1) headache frequency, disability and medication use; and 2) medication efficacy and headache control items. Total and sub-factor scores correlated strongly (Spearman coefficient r = 0.49–0.86).

Performance across headache types

In the second US mailing sample, which, like the first, were self-selecting for “severe” headache, sub-sample sizes for headache types other than episodic migraine were very low (≤100): 73 cases met criteria for episodic TTH (ETTH); 100 had headache on ≥15 days/month, with ten of these diagnosed as chronic migraine. Several simplifying modifications were attempted in order to contrast other headache types with episodic migraine, but all models failed in the face of these small samples and insufficient information. Furthermore, respondents with headache on ≥15 days/month inevitably reported a constant (maximal) value on HURT item 1 (headache days/month). As a last resort, fitting the item-response model separately to the episodic migraine sub-sample and the headache on ≥15 days/month sub-sample (the only other for which the model contrast was estimable), we compared the estimated factor scores for these two groups in an ANOVA (Table 4). No significant differences were observed in factor scores for the two factors, suggesting no meaningful difference in the performance of HURT between these headache types.

Table 4 Estimated factor scores for episodic migraine sub-sample versus headache on ≥15 days/month sub-sample

External validity

Valid returns to the second mailing were received from 1734 (69%) respondents, of whom 1391 (80%) met ICHD-II criteria for migraine [25]. Summed HURT scores correlated in the expected directions with the other measures. Correlations were positive with both the MIDAS questionnaire (r = 0.69) and HIT-6 (r = 0.49), instruments that are strongly influenced by disability [29, 30], and with PHQ-9 (r = 0.34), a measure of depression [31]. Correlations were negative with MSQ version 2.1, a migraine-specific QoL instrument [32], so that higher HURT scores were associated with poorer QoL (restrictive subscale: r = − 0.53; preventative subscale: r = − 0.58; emotional subscale: r = − 0.51). HURT scores correlated most strongly, and positively, with MPQ (r = 0.86), an instrument indicating need for preventative pharmacological treatment of migraine [33]. These correlations suggested that, while the instruments shared some variance, they nonetheless captured unique constructs.

Reliability

Test-retest reliability in specialist care in Denmark and UK was fair to low (κ = 0.38–0.62; r = 0.49–0.76) [26]. It should be noted that, while the interval between first and second applications of HURT was intended in the study design to be about 1 month, subsequent review of the Danish records revealed a range between 1 day and 9 months (median 1.7 months). The longer-than-planned intervals were caused in part by the centre’s extending waiting time but also in part by patients who changed appointment dates – sometimes introducing long delays. Internal consistency reliability on the other hand was very good (Cronbach’s α = 0.85) [26]. In Saudi Arabian primary care, intra-class correlation coefficients were 0.66–0.78 (all p ≤ 0.001) for questions 1–4 and 0.90–0.93 for questions 5–7 (all p < 0.0001) [27]. For the dichotomous response to question 8, κ = 1 (p < 0.0001). Internal consistency reliability was good (Cronbach’s α = 0.74) [27].

Clinical evaluation

In specialist-care utility evaluation in 201 patients in Europe, with HURT administered at the start and end of treatment, good outcomes were judged to have been achieved in 155 (77%) [26]. HURT reflected these in significant differences between recorded responses at base line and post-intervention (p < 0.01), indicating responsiveness of the instrument to change. Analyses of paired responses (before and after treatment) found seven of the eight HURT items indicating improvements (p < 0.001). No evident improvement in patients’ concerns about side-effects of medication was indicated by item 7 (p = 0.18) [26].

In 342 patients in Saudi Arabian primary care, HURT signalled clinical improvement over 3 months through statistically significant reductions (p < 0.0001) in responses to each of questions 1–6 [27]. HURT also distinguished clearly between patients with good or poor outcomes, with questions 1–4 each (p < 0.0001) indicating improvement in those reporting satisfaction (positive PSS scores) and worsening (or no improvement) in those reporting dissatisfaction (negative PSS scores) [27]. There was a trend (p = 0.06) towards greater patient-satisfaction among those treated with guidance from HURT (n = 207) than among controls (n = 135). There was a slight opposite trend in doctor-satisfaction [27].

Discussion

HURT is a consensus-developed 8-item self-administered questionnaire addressing headache frequency, disability, medication use and effect, patients’ perceptions of headache “control” and their understanding of their diagnoses. Its scope is unique among outcome measures.

In the evaluations, HURT proved to be a psychometrically sound instrument for monitoring headache treatment, with, importantly, scale properties apparently stable across headache disorders. While test-retest reliability in specialist care was assessed as fair to low, this was, very probably, because headache in this setting, and prior to start of management, was unstable over time. Although this was not intended, intervals of up to 9 months between the two applications of HURT allowed the possibility of real change in many patients. In the very different setting of Saudi Arabian primary care, reliability was good for questions 5 to 7, to which responses expressed beliefs or perceptions at the time of testing. It was less good for questions 1 to 4, which required recall of past events over 1 to 3 months and which, again, were subject to real changes in the frequencies of events potentially occurring over the test-retest period. It should be noted also that, unlike in Europe, patients in Saudi Arabia did receive an intervention (albeit only standard care) between the two administrations of HURT. The two settings were, therefore, not comparable for testing reliability (it was not intended that they should be). In USA, summed scores correlated well and in the expected directions with external validation measures.

The literature search yielded a multiplicity of psychometrically robust instruments available to support the several key steps in comprehensive care of headache disorders [21]. These instruments can be used to aid the diagnosis of primary headache disorders; the exclusion of secondary headaches; the assessment of headache symptoms and their severity, headache-attributed disability, burden and impact (both ictal and interictal); the recognition and assessment of comorbidities, and of psychological factors shown to predict adherence to treatment and outcomes; outcome measurement including patients’ satisfaction; and treatment planning, monitoring and optimization for both acute and preventative pharmacological therapies. Many have particular strengths. MIDAS in particular, although it measures headache-attributed lost time rather than disability [34], is scored in meaningful units, is easy to use, has demonstrated reliability and validity, predicts treatment needs, has been extensively used in clinical practice in many countries and is sensitive to change, at least in severely-affected patients. However, no single instrument other than HURT combines so many of these aspects of care, and, especially, few instruments link assessment to clinical advice or suggested actions [21]. Thus, they do not serve non-headache experts well, especially health-care providers in primary care.

The HURT questionnaire was created to fill this gap and it appears to have the capability of doing so.

In Europe, HURT showed utility in specialist care as an outcome measure across headache disorders. In this setting, where many patients are partially or wholly refractory even to best care, HURT can be used to define and explain treatment goals. In addition, it can promote self-efficacy and knowledge about headache. In Saudi Arabian primary care, where no other Arabic instruments were available as standards for comparison, HURT was reliable and responsive to clinical change and therefore it has clinical utility in Arabic-speaking patients. One explanation of the apparent discord between doctors’ and patients’ satisfaction in Saudi Arabia is that the instrument worked as it should – improving care (perceived by patients) while revealing deficiencies in care and need for improvement to the physicians.

Conclusions

The HURT questionnaire has demonstrated validity and clinical utility, and is currently available for clinical use and research purposes in English and Arabic. Some other translations are known to exist, and future work may include use and evaluation in other countries and cultures.

Abbreviations

AMPP:

American Migraine Prevalence and Prevention Study

ANOVA:

analysis of variance

DSS:

doctor-satisfaction scale

GP:

general practitioner

HIT-6:

Headache Impact Test

HURT:

Headache Under-Response to Treatment

ICHD:

International Classification of Headache Disorders

IRT:

item-response theory

LTB:

Lifting The Burden

MIDAS:

Migraine Disability Assessment scale

MOH:

medication-overuse headache

MPQ:

Migraine Prevention Questionnaire

MSQ:

Migraine Specific Quality of Life questionnaire

PHQ:

PRIME-MD Patient Health Questionnaire

PSS:

patient-satisfaction scale

QoL:

quality of life

TTH:

tension-type headache

UK:

United Kindom

USA:

United States of America

WHO:

World Health Organization

References

  1. Stovner LJ, Hagen K, Jensen R, Katsarava Z, Lipton RB, Scher AI, Steiner TJ, Zwart J-A (2007) The global burden of headache: a documentation of headache prevalence and disability worldwide. Cephalalgia 27:193–210

    Article  PubMed  Google Scholar 

  2. Vos T, Flaxman AD, Naghavi M, Lozano R, Michaud C, Ezzati M et al (2012) Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990-2010: a systematic analysis for the global burden of disease study 2010. Lancet 380:2163–2196

    Article  PubMed  Google Scholar 

  3. Steiner TJ, Stovner LJ, Birbeck GL (2013) Migraine: the seventh disabler. J Headache Pain 14:1

    Article  PubMed  PubMed Central  Google Scholar 

  4. Vos T, Barber RM, Bell B, Bertozzi-Villa A, Biryukov S, Bolliger I et al (2015) Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the global burden of disease study 2013. Lancet 386:743–800

    Article  Google Scholar 

  5. Vos T, Allen C, Arora M, Barber RM, Bhutta ZA, Brown A et al (2016) Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990-2015: a systematic analysis for the global burden of disease study 2015. Lancet 388:1545–1602

    Article  Google Scholar 

  6. Steiner TJ, Stovner LJ, Vos T (2016) GBD 2015: migraine is the third cause of disability in under 50s. J Headache Pain 17:104

    Article  PubMed  PubMed Central  Google Scholar 

  7. Feigin VL, Abajobir AA, Abate KH, Abd-Allah F, Abdulle AM, Abera SF et al (2017) Global, regional, and national burden of neurological disorders during 1990–2015: a systematic analysis for the global burden of disease study 2015. Lancet-Neurol 16:877–897

    Article  Google Scholar 

  8. Vos T, Abajobir AA, Abbafati C, Abbas KM, Abate KH, Abd-Allah F et al (2017) Global, regional, and national incidence, prevalence, and years lived with disability for 328 diseases and injuries for 195 countries, 1990-2016: a systematic analysis for the global burden of disease study 2016. Lancet 390:1211–1259

    Article  Google Scholar 

  9. World Health Organization (2000) Headache disorders and public health. WHO, Geneva

    Google Scholar 

  10. Headache Classification Committee of the International Headache Society (2013) The international classification of headache disorders, 3rd edition (beta version). Cephalalgia 33:629–808

    Article  Google Scholar 

  11. Steiner TJ, Paemeleire K, Jensen R, Valade D, Savi L, Lainez MJA, Diener H-C, Martelletti P, Couturier EGM on behalf of the European Headache Federation and Lifting The Burden: The Global Campaign to Reduce the Burden of Headache Worldwide (2007) European principles of management of common headache disorders in primary care. J Headache Pain 8(Suppl 1):S3–S21

    Google Scholar 

  12. World Health Organization, Lifting The Burden (2011) Atlas of headache disorders and resources in the world 2011. WHO, Geneva

    Google Scholar 

  13. Linde M, Gustavsson A, Stovner LJ, Steiner TJ, Barré J, Katsarava Z, Lainez JM, Lampl C, Lantéri-Minet M, Rastenyte D, Ruiz de la Torre E, Tassorelli C, Andrée C (2012) The cost of headache disorders in Europe: the Eurolight project. Eur J Neurol 19:703–711

    Article  CAS  PubMed  Google Scholar 

  14. Mennini FS, Gitto L, Martelletti P (2008) Improving care through health economics analyses: cost of illness and headache. J Headache Pain 9:199–206

    Article  PubMed  PubMed Central  Google Scholar 

  15. Linde M, Steiner TJ, Chisholm D (2015) Cost-effectiveness analysis of interventions for migraine in four low- and middle-income countries. J Headache Pain 16:15

    Article  PubMed  PubMed Central  Google Scholar 

  16. Steiner TJ, Antonaci F, Jensen R, Lainez JMA, Lantéri-Minet M, Valade D, on behalf of the European Headache Federation and Lifting The Burden: the Global Campaign against Headache (2011) Recommendations for headache service organisation and delivery in Europe. J Headache Pain 12:419–426

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Steiner TJ (2004) Lifting the burden: the global campaign against headache. Lancet-Neurol 3:204–205

    Article  PubMed  Google Scholar 

  18. Steiner TJ (2005) Lifting The Burden: the global campaign to reduce the burden of headache worldwide. J Headache Pain 6:373–377

    Article  PubMed  PubMed Central  Google Scholar 

  19. Steiner TJ, Birbeck GL, Jensen R, Katsarava Z, Martelletti P, Stovner LJ (2010) Lifting The Burden: the first 7 years. J Headache Pain 11:451–455

    Article  PubMed  PubMed Central  Google Scholar 

  20. Steiner TJ, Birbeck GL, Jensen R, Katsarava Z, Martelletti P, Stovner LJ (2011) The global campaign, World Health Organization and Lifting The Burden: collaboration in action. J Headache Pain 12:273–274

    Article  PubMed  PubMed Central  Google Scholar 

  21. Buse DC, Sollars CM, Steiner TJ, Jensen RH, Al Jumah MA, Lipton RB (2012) Why HURT? A review of clinical instruments for headache management. Curr Pain Headache Rep 16:237–254

    Article  PubMed  Google Scholar 

  22. Lipton RB, Bigal ME, Diamond M, Freitag F, Reed ML, Stewart WF (2007) Migraine prevalence, disease burden, and the need for preventive therapy. Neurology 68:343–349

    Article  CAS  PubMed  Google Scholar 

  23. https://www.bloomberg.com/profiles/companies/9276602Z:US-nfo-inc (accessed 23 December 2017)

  24. Lipton RB, Diamond S, Reed M, Diamond ML, Stewart WF (2001) Migraine diagnosis and treatment: results from the American migraine study II. Headache 41:638–645

    Article  CAS  PubMed  Google Scholar 

  25. International Headache Society Classification Subcommittee (2004) The international classification of headache disorders. 2nd edition. Cephalalgia 24(Suppl 1):1–160

    Google Scholar 

  26. Westergaard ML, Steiner TJ, MacGregor AE, Antonaci F, Tassorelli C, Buse DC, Lipton RB, Jensen RH (2013) The headache under-response to treatment (HURT) questionnaire: assessment of utility in headache specialist care. Cephalalgia 33:245–255

    Article  PubMed  Google Scholar 

  27. Al Jumah M, Al Khathaami A, Tamim H, Al Owayed A, Kojan S, Jawhary A, Lipton R, Buse D, Jensen R, Steiner T (2013) HURT (headache under-response to treatment) questionnaire in the management of primary headache disorders: reliability, validity and clinical utility of the Arabic version. J Headache Pain 14:6

    Article  Google Scholar 

  28. Peters M, Bertolote JM, Houchin C, Kandoura T, Steiner TJ (2007) Translation protocol for lay documents. J Headache Pain 8(Suppl 1):S43–S44

    Google Scholar 

  29. Stewart WF, Lipton RB, Kolodner KB, Sawyer J, Lee C, Liberman JN (2000) Validity of the migraine disability assessment (MIDAS) score in comparison to a diary-based measure in a population sample of migraine sufferers. Pain 88:41–52

    Article  CAS  PubMed  Google Scholar 

  30. Kosinski M, Bayliss MS, Bjorner JB, Ware JE Jr, Garber WH, Batenhorst A, Cady R, Dahlöf CG, Dowson A, Tepper S (2003) A six-item short-form survey for measuring headache impact: the HIT-6. Qual Life Res 12:963–974

    Article  CAS  PubMed  Google Scholar 

  31. Kroenke K, Spitzer RL, Williams JBW (2001) The PHQ-9. Validity of a brief depression severity measure. Gen. Intern Med 16:606–613

    CAS  Google Scholar 

  32. Martin BC, Pathak DS, Sharfman MI, Adelman JU, Taylor F, Kwong WK, Jhingran P (2000) Validity and reliability of the migraine-specific quality of life questionnaire (MSQ version 2.1). Headache 40:204–215

    Article  CAS  PubMed  Google Scholar 

  33. Lipton RB, Serrano D, Buse DC, Rupnow MFT, Reed ML, Bigal ME (2007) The migraine prevention questionnaire (MPQ): development and validation. Headache 47:770–771

    Article  Google Scholar 

  34. Stovner LJ, Al Jumah M, Birbeck GL, Gururaj G, Jensen R, Katsarava Z, Queiroz LP, Scher AI, Tekle-Haimanot R, Wang SJ, Steiner TJ (2014) The methodology of population surveys of headache prevalence, burden and cost: principles and recommendations from the global campaign against headache. J Headache Pain 15:5

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We are grateful to Susan Broner (USA), Beth Eggleston (Australia), Lorenzo Gardella (Argentina), Hilkka Kettinen (Finland), Michele Peters (UK), Daniel Serrano (USA), Neeha Sharma (India), C Mark Sollars (USA), Walter Stewart (USA), Alain Tehindrazanarivelo (Madagascar/France), Dominique Valade (France) and Michael Von Korff (USA) for intellectual input at various stages of development of the HURT questionnaire.

Funding

Financial support for the consensus meetings in Geneva and New York was provided by Lifting The Burden. The AMPP study was funded originally by a grant from Ortho-McNeil Pharmaceuticals to the National Headache Foundation (USA), and later supported by several pharmaceutical companies collectively. While the AMPP included our mailings, these received no specific support. There was no other external funding for the studies or analyses reported here. Lifting The Burden determined the purpose and objectives of the HURT questionnaire as a product of the Global Campaign against Headache, but there were no other influences upon these studies from funding sources.

Availability of data and materials

Not applicable.

Author information

Authors and Affiliations

Author notes

  1. L. Prilipko is deceased. This paper is dedicated to his memory.

    • L. Prilipko
Authors

Consortia

Contributions

TJS, DCB, MAJ, RHJ, MLR LP, FSM, MJAL, KR, FS, SYY, MF and RBL were contributors to the consensus meetings in Geneva and/or New York. MAJ, AAK, DCB, RHJ, RBL, EAM, MLR, TJS and MLW contributed to design, implementation and/or analysis of the psychometric evaluation studies. MAJ, AAK, FA, DCB, RHJ, RBL, EAM, TJS, CT and MLW contributed to design, implementation and/or analysis of the clinical evaluation studies. TJS and DCB drafted the manuscript. All authors contributed to revision of the manuscript and approved the final version.

Corresponding author

Correspondence to T. J. Steiner.

Ethics declarations

Ethical approval and consent to participate

Stated in text.

Consent for publication

Not applicable.

Competing interests

TJ Steiner and RH Jensen are Directors and Trustees of Lifting The Burden. RB Lipton, DC Buse and ML Reed are collaborators in the American Migraine Prevalence and Prevention Study (AMPP) study. None of the authors otherwise declares competing interests in relation to the content of this manuscript.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

HURT questionnaire. (PDF 105 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Steiner, T.J., Buse, D.C., Al Jumah, M. et al. The headache under-response to treatment (HURT) questionnaire, an outcome measure to guide follow-up in primary care: development, psychometric evaluation and assessment of utility. J Headache Pain 19, 15 (2018). https://doi.org/10.1186/s10194-018-0842-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s10194-018-0842-6

Keywords