0
We're unable to sign you in at this time. Please try again in a few minutes.
Retry
We were able to sign you in, but your subscription(s) could not be found. Please try again in a few minutes.
Retry
There may be a problem with your account. Please contact the AMA Service Center to resolve this issue.
Contact the AMA Service Center:
Telephone: 1 (800) 262-2350 or 1 (312) 670-7827  *   Email: subscriptions@jamanetwork.com
Error Message ......
Original Contribution |

Specificity of Barkhof Criteria in Predicting Conversion to Multiple Sclerosis When Applied to Clinically Isolated Brainstem Syndromes FREE

Jaume Sastre-Garriga, MD; Mar Tintoré, MD, PhD; Alex Rovira, MD, PhD; Carlos Nos, MD; Jordi Río, MD, PhD; Alan J. Thompson, MD; Xavier Montalban, MD, PhD
[+] Author Affiliations

From the Unitats de Neuroimmunologia Clínica (Drs Sastre-Garriga, Tintoré, Nos, Río, and Montalban) and Ressonància Magnètica (Dr Rovira), Hospital Universitari Vall d'Hebron, Barcelona, Spain; Institute of Neurology, London, England (Dr Thompson).


Arch Neurol. 2004;61(2):222-224. doi:10.1001/archneur.61.2.222.
Text Size: A A A
Published online

Background  Barkhof criteria have been adopted to demonstrate dissemination in space in the new multiple sclerosis diagnostic criteria because of their high specificity for predicting conversion to multiple sclerosis. One of the 4 Barkhof criteria is the presence of an infratentorial lesion. In clinically isolated syndromes (CIS) of the brainstem (CISB), the infratentorial criterion does not demonstrate dissemination in space, raising the possibility that the criteria may be less specific in CISB, as compared with specificity in other CIS, in which all 4 criteria demonstrate dissemination in space.

Objective  To compare the validity indices of Barkhof criteria in CISB with those in other CIS.

Design  Inception cohort with median follow-up of 34 months for CISB and 40 months for other CIS.

Setting  Institutional ambulatory referral center.

Patients  A sample of 51 patients with CISB and 102 patients with other CIS (46 with myelitis and 56 with optic neuritis) was analyzed. Barkhof criteria, with a cutoff of 3 of 4, were applied to magnetic resonance imaging performed at baseline. Four combinations each containing 3 parameters were also applied, with a cutoff of 2 of 3.

Main Outcome Measure  Specificity of unmodified Barkhof criteria and of the 4 combinations to predict conversion to clinically definite multiple sclerosis.

Results  The specificity of the criteria in CISB was 61% against 73% in other CIS. The combinations that retained the infratentorial lesion parameter had lower specificities in the CISB group; in analysis of the group with other CIS, no such differences were found.

Conclusion  The infratentorial lesion criterion is responsible for the lower specificity of Barkhof criteria in CISB.

After they have clinically isolated syndromes (CIS) suggestive of multiple sclerosis (MS), patients at higher risk of second attacks can be identified by performing cranial magnetic resonance imaging (MRI).1,2 In the past 2 decades, the validity of cranial MRI in assessing the risk of conversion to MS has been increased by the development of MRI diagnostic criteria for MS.35 The most recent of these, the Barkhof MRI criteria,5 have been chosen to demonstrate dissemination in space in the new diagnostic criteria6 because of their high specificity when a cutoff for positivity of 3 of 4 is used.7 The criteria include (a) at least 1 gadolinium-enhancing lesion or at least 9 lesions on T2-weighted images, (b) at least 3 periventricular lesions, (c) at least 1 juxtacortical lesion, and (d) at least 1 infratentorial lesion.

Barkhof criteria have been tested for specificity and sensitivity in mixed groups of CIS.5,7 However, patients with brainstem syndromes are likely to have lesions in that area and thus to fulfill 1 of the 4 parameters of Barkhof criteria. We have recently shown that the criteria are less accurate when applied to CIS of the brainstem (CISB) and have suggested that this lower accuracy could be because of reduced specificity.8 Therefore, our aim was to compare the validity indices of Barkhof criteria, focusing on specificity, in a previously studied cohort of patients with CISB with the indices found for patients with other CIS (optic neuritis and myelitis) and, if specificity was reduced, to determine whether the infratentorial lesion criterion was responsible.

Patients were recruited prospectively at our unit (Unitat de Neuroimmunologia Clínica, Hospital Universitari Vall d'Hebron, Barcelona, Spain) from January 1995 through March 2001 and are part of the population with CIS previously described.7 Inclusion criteria were as follows: patients with an episode of brainstem, optic nerve, or spinal cord clinical dysfunction suggestive of inflammatory demyelination; patients aged 14 through 50 years; follow-up of 12 months or more; and clinical assessment within 3 months after symptom onset. Exclusion criteria were other possible diagnoses not adequately excluded and patients lost to follow-up.

FOLLOW-UP AND CLINICAL ASSESSMENT

Patients were asked on the first and all follow-up visits (every 3 to 6 months) about previous history of neurological disturbances. Conversion to MS was defined as the occurrence of a new clinical episode at least 1 month after remission of the initial event. A clinical attack was defined, as in the Poser criteria, as the occurrence of a symptom or symptoms of neurological dysfunction lasting more than 24 hours.9

MRI ASSESSMENT

The MRI was performed with either a 1.0-T or 1.5-T imager with a standard head coil and included the following pulse sequences: transverse proton density–weighted and T2-weighted conventional spin-echo (repetition time, 2200 milliseconds; echo time, 20-90 milliseconds; 1 signal acquired) or fast spin-echo (repetition time, 3000 milliseconds; echo time, 14-85 milliseconds; 2 signals acquired) and T1-weighted spin-echo (repetition time, 600 milliseconds; echo time, 15 milliseconds; 2 signals acquired). This last sequence was repeated after injection of 0.1 mmol of gadopentetate dimeglumine per kilogram of body weight, with an imaging delay of 5 minutes. We used a section thickness of 5 mm, a pixel size of approximately 1 × 1 mm, and an interleaved imaging mode with an intersection gap of 1.5 mm. Additional sequences, such as sagittal T2-weighted fast spin-echo (repetition time, 3550-5000 milliseconds; echo time, 90 milliseconds; 2 signals acquired) or transverse T2-weighted fast fluid-attenuated inversion-recovery (repetition time, 9000 milliseconds; echo time, 110-150 milliseconds; inversion time, 2200-2500 milliseconds; 11 signals acquired) were also performed in most patients.

One neuroradiologist (A.R.) who had expertise in MS and was blinded to all clinical details recorded the number and site of any abnormalities. The 4-parameter model proposed by Barkhof et al5 was then applied to each MRI study and was considered to be fullfiled when 3 of 4 of the dichotomized parameters were met. To investigate the specific performance of each criterion, we analyzed 4 subsets of criteria, each including 3 parameters, and set the positivity at 2 of 3.

STATISTICAL ANALYSIS

Statistical analysis was performed with a microcomputer version of the Statistical Package for Social Sciences (SPSS Inc, Chicago, Ill). To study the association between variables, we used the χ2 test. Statistical significance was set at P<.05 (2-tailed). The value of Barkhof criteria with regard to clinical follow-up was expressed as sensitivity, specificity, and accuracy. Accuracy was defined as follows: accuracy = (true-positive findings + true-negative findings) / (true-positive findings + true-negative findings + false-positive findings + false-negative findings). True positivity was defined as fulfilling Barkhof criteria and conversion to MS. False positivity was defined as fulfilling the criteria but not converting to MS, true negativity as not fulfilling Barkhof criteria and not converting to MS, and false negativity as not fulfilling the criteria but converting to MS.

Fifty-one patients with CISB, 46 with myelitis, and 56 with optic neuritis were included. Demographic and clinical variables are presented in Table 1. Eighteen (35%) of 51 patients in the CISB group and 23 (22%) of 102 patients in the myelitis and optic neuritis group had a second neurological episode suggestive of inflammatory demyelination in median follow-up periods of 34 and 40 months, respectively, thus converting to clinically definite MS. The conversion data per group were as follows: 13 (28%) of 46 in the myelitis group and 10 (18%) of 56 in the optic neuritis group.

Table Graphic Jump LocationTable 1. Demographic and Clinical Features of Patients in Both Groups of CIS

Fulfilling the Barkhof criteria was associated with a high risk of conversion in CISB (P = .02) and in other CIS (P = .02). Validity indices of the Barkhof criteria in CISB, myelitis, and optic neuritis are shown in Table 2. We analyzed the fulfilling of 4 subsets, each including only 3 parameters, with the positivity set to 2 of 3. The subsets that retained the infratentorial lesion parameter had lower specificities in the CISB group; the subset not including the infratentorial lesion parameter showed the same values as when 4 parameters were used (Table 3). In analysis of the group with myelitis and optic neuritis, no such differences were found, and all 4 subsets of Barkhof criteria performed similarly.

Table Graphic Jump LocationTable 2. Validity Indices of Barkhof Criteria per Group*
Table Graphic Jump LocationTable 3. Validity Indices for Modified Subsets of Barkhof Criteria in CISB and Other CIS*

The Barkhof criteria are the most specific MRI criteria available for assessing the risk of conversion to MS after CIS7 and have been incorporated into the new MS diagnostic criteria.6 However, they were assessed initially for mixed groups of CIS,5 and little is known about their performance in CISB. This lack is particularly relevant because many patients with CISB have an infratentorial lesion,10 which in this situation will not provide evidence of dissemination in space. As an example, in a patient with CISB in whom the cranial MRI study shows a gadolinium-enhancing brainstem lesion, an additional juxtacortical lesion is enough to demonstrate dissemination in space; a patient with optic neuritis attains 3 of 4 parameters less often.

The present study results show that the specificity for the Barkhof criteria in CISB, although higher than that of Paty et al3 or Fazekas et al,4,8 is less (61%) than that found in the cohort of other CIS (73%). The present data provide further evidence that the Barkhof criteria are less specific in CISB when compared with specificity in other CIS. The fact that this reduced specificity relates to the criterion specifying the presence of an infratentorial lesion is supported by examining subsets of Barkhof criteria with only 3 parameters and assuming as positive those patients fulfilling 2 of 3 criteria. Those subsets including the infratentorial lesion parameter were the least specific. No change in specificity was found for the cohort of other CIS; this value remained constant across all 4 subsets. Although longer follow-up periods than that of the present study (median of 3 years) could alter the present results, the focus here is on early conversion.

In summary, the Barkhof MRI criteria are not as specific in predicting conversion to MS in patients with CISB as when they are applied to other CIS, which is mainly because of the presence of the infratentorial lesion parameter. It might be instructive to assess the performance of modified Barkhof criteria in CISB, in which the infratentorial lesion parameter could be substituted by another criterion, such as the presence of callosal or subcallosal lesions.5

Corresponding author: Jaume Sastre-Garriga, MD, Unitat de Neuroimmunologia Clínica, Hospital Universitari Vall d'Hebron, EUI, 2a planta, Passeig de la Vall d'Hebron 119-129, 08035 Barcelona, Spain (e-mail: jsastre@hg.vhebron.es).

Accepted for publication October 17, 2003.

Author contributions: Study concept and design (Drs Sastre-Garriga, Tintoré, Rovira, Nos, Thompson, and Montalban); acquisition of data (Drs Tintoré, Rovira, Río, and Montalban); analysis and interpretation of data (Drs Sastre-Garriga, Tintoré, Rovira, Nos, Thompson, and Montalban); drafting of the manuscript (Drs Sastre-Garriga and Tintoré); critical revision of the manuscript for important intellectual content (Drs Sastre-Garriga, Tintoré, Rovira, Nos, Río, Thompson, and Montalban); statistical expertise (Drs Sastre-Garriga, Tintoré, and Río); obtained funding (Dr Montalban); administrative, technical, and material support (Dr Montalban); study supervision (Drs Tintoré, Rovira, Nos, Thompson, and Montalban).

Brex  PACiccarelli  OO'Riordan  JISailer  MThompson  AJMiller  DH A longitudinal study of abnormalities on MRI and disability from multiple sclerosis. N Engl J Med.2002;346:158-164.
PubMed
Miller  DHOrmerod  IERudge  PKendall  BEMoseley  IFMcDonald  WI The early risk of multiple sclerosis following isolated acute syndromes of the brainstem and spinal cord. Ann Neurol.1989;26:635-639.
PubMed
Paty  DWOger  JJKastrukoff  LF  et al MRI in the diagnosis of MS: a prospective study with comparison of clinical evaluation, evoked potentials, oligoclonal banding, and CT. Neurology.1988;38:180-185.
PubMed
Fazekas  FOffenbacher  HFuchs  S  et al Criteria for an increased specificity of MRI interpretation in elderly subjects with suspected multiple sclerosis. Neurology.1988;38:1822-1825.
PubMed
Barkhof  FFilippi  MMiller  DH  et al Comparison of MRI criteria at first presentation to predict conversion to clinically definite multiple sclerosis. Brain.1997;120:2059-2069.
PubMed
McDonald  WICompston  DASEdan  G  et al Recommended diagnostic criteria for MS. Ann Neurol.2001;50:121-127.
PubMed
Tintoré  MRovira  AMartínez  MJ  et al Isolated demyelinating syndromes: comparison of different MR imaging criteria to predict conversion to clinically definite multiple sclerosis. Am J Neuroradiol.2000;21:702-706.
PubMed
Sastre-Garriga  JTintoré  MRovira  A  et al Conversion to multiple sclerosis after a clinically isolated syndrome of the brainstem: cranial magnetic resonance imaging, cerebrospinal fluid and neurophysiological findings. Mult Scler.2003;9:39-43.
PubMed
Poser  CMPaty  DWScheinberg  L  et al New diagnostic criteria for multiple sclerosis: guidelines for research protocols. Ann Neurol.1983;13:227-231.
PubMed
CHAMPS Study Group Baseline MRI characteristics of patients at high risk for multiple sclerosis: results from the CHAMPS trial: Controlled High-Risk Subjects Avonex Multiple Sclerosis Prevention Study. Mult Scler.2002;8:330-338.
PubMed

Figures

Tables

Table Graphic Jump LocationTable 1. Demographic and Clinical Features of Patients in Both Groups of CIS
Table Graphic Jump LocationTable 2. Validity Indices of Barkhof Criteria per Group*
Table Graphic Jump LocationTable 3. Validity Indices for Modified Subsets of Barkhof Criteria in CISB and Other CIS*

References

Brex  PACiccarelli  OO'Riordan  JISailer  MThompson  AJMiller  DH A longitudinal study of abnormalities on MRI and disability from multiple sclerosis. N Engl J Med.2002;346:158-164.
PubMed
Miller  DHOrmerod  IERudge  PKendall  BEMoseley  IFMcDonald  WI The early risk of multiple sclerosis following isolated acute syndromes of the brainstem and spinal cord. Ann Neurol.1989;26:635-639.
PubMed
Paty  DWOger  JJKastrukoff  LF  et al MRI in the diagnosis of MS: a prospective study with comparison of clinical evaluation, evoked potentials, oligoclonal banding, and CT. Neurology.1988;38:180-185.
PubMed
Fazekas  FOffenbacher  HFuchs  S  et al Criteria for an increased specificity of MRI interpretation in elderly subjects with suspected multiple sclerosis. Neurology.1988;38:1822-1825.
PubMed
Barkhof  FFilippi  MMiller  DH  et al Comparison of MRI criteria at first presentation to predict conversion to clinically definite multiple sclerosis. Brain.1997;120:2059-2069.
PubMed
McDonald  WICompston  DASEdan  G  et al Recommended diagnostic criteria for MS. Ann Neurol.2001;50:121-127.
PubMed
Tintoré  MRovira  AMartínez  MJ  et al Isolated demyelinating syndromes: comparison of different MR imaging criteria to predict conversion to clinically definite multiple sclerosis. Am J Neuroradiol.2000;21:702-706.
PubMed
Sastre-Garriga  JTintoré  MRovira  A  et al Conversion to multiple sclerosis after a clinically isolated syndrome of the brainstem: cranial magnetic resonance imaging, cerebrospinal fluid and neurophysiological findings. Mult Scler.2003;9:39-43.
PubMed
Poser  CMPaty  DWScheinberg  L  et al New diagnostic criteria for multiple sclerosis: guidelines for research protocols. Ann Neurol.1983;13:227-231.
PubMed
CHAMPS Study Group Baseline MRI characteristics of patients at high risk for multiple sclerosis: results from the CHAMPS trial: Controlled High-Risk Subjects Avonex Multiple Sclerosis Prevention Study. Mult Scler.2002;8:330-338.
PubMed

Correspondence

CME
Meets CME requirements for:
Browse CME for all U.S. States
Accreditation Information
The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians. The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
Commitment to Change (optional):
Indicate what change(s) you will implement in your practice, if any, based on this CME course.
Your quiz results:
The filled radio buttons indicate your responses. The preferred responses are highlighted
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.
Submit a Comment

Multimedia

Some tools below are only available to our subscribers or users with an online account.

Web of Science® Times Cited: 13

Related Content

Customize your page view by dragging & repositioning the boxes below.

Articles Related By Topic
Related Collections
PubMed Articles
Evoked potentials in multiple sclerosis. Phys Med Rehabil Clin N Am 2013;24(4):717-20.