Skip to main content
  • Clinical trial protocol
  • Open access
  • Published:

Prospective study validating a multidimensional treatment decision score predicting the 24-month outcome in untreated patients with clinically isolated syndrome and early relapsing–remitting multiple sclerosis, the ProVal-MS study

Abstract

Introduction

In Multiple Sclerosis (MS), patients´ characteristics and (bio)markers that reliably predict the individual disease prognosis at disease onset are lacking. Cohort studies allow a close follow-up of MS histories and a thorough phenotyping of patients. Therefore, a multicenter cohort study was initiated to implement a wide spectrum of data and (bio)markers in newly diagnosed patients.

Methods

ProVal-MS (Prospective study to validate a multidimensional decision score that predicts treatment outcome at 24 months in untreated patients with clinically isolated syndrome or early Relapsing–Remitting-MS) is a prospective cohort study in patients with clinically isolated syndrome (CIS) or Relapsing–Remitting (RR)-MS (McDonald 2017 criteria), diagnosed within the last two years, conducted at five academic centers in Southern Germany. The collection of clinical, laboratory, imaging, and paraclinical data as well as biosamples is harmonized across centers. The primary goal is to validate (discrimination and calibration) the previously published DIFUTURE MS-Treatment Decision score (MS-TDS). The score supports clinical decision-making regarding the options of early (within 6 months after study baseline) platform medication (Interferon beta, glatiramer acetate, dimethyl/diroximel fumarate, teriflunomide), or no immediate treatment (> 6 months after baseline) of patients with early RR-MS and CIS by predicting the probability of new or enlarging lesions in cerebral magnetic resonance images (MRIs) between 6 and 24 months. Further objectives are refining the MS-TDS score and providing data to identify new markers reflecting disease course and severity. The project also provides a technical evaluation of the ProVal-MS cohort within the IT-infrastructure of the DIFUTURE consortium (Data Integration for Future Medicine) and assesses the efficacy of the data sharing techniques developed.

Perspective

Clinical cohorts provide the infrastructure to discover and to validate relevant disease-specific findings. A successful validation of the MS-TDS will add a new clinical decision tool to the armamentarium of practicing MS neurologists from which newly diagnosed MS patients may take advantage.

Trial registration ProVal-MS has been registered in the German Clinical Trials Register, `Deutsches Register Klinischer Studien` (DRKS)—ID: DRKS00014034, date of registration: 21 December 2018; https://drks.de/search/en/trial/DRKS00014034

Background

Multiple Sclerosis (MS) is a chronic inflammatory disease of the central nervous system (CNS) with considerable impact on individual health, but also socioeconomic factors [24]. An estimation of the most likely disease course is not possible with certainty at initial diagnosis, as the clinical course of MS can vary from benign to highly aggressive. This is also reflected by heterogeneity in clinical and imaging phenotypes. [8, 9] In recent years, enormous progress has been made in understanding the immunopathogenesis and its relationship with genetic and environmental factors, which can influence disease risk and possibly also disease progression [6, 14].

Increasingly, disease modifying therapies (DMTs) are available, which differ in mode of action, therapeutic efficacy, risk profile, route of administration, and treatment burden/monitoring requirements. Highly effective drugs may be associated with potentially severe risks. Therefore, therapy selection remains individualized based on the patient's disease status, presumed prognosis, and risk tolerance.

Differences in efficacy, monitoring requirements, and safety of DMTs have led to diverging therapeutic strategies: the so-called escalation approach compared to the "hit hard and early" approach. While the first approach may result in insufficient therapy, the latter may lead to overtreatment in patients not having a highly active disease course. The “wait and see” approach may also be considered as an option for a newly diagnosed patient. Prognostic research addresses this issue by establishing predictive markers of MS disease activity and progression being as simple, reproducible, and reliable as possible. This may help in establishing more targeted treatment strategies without unwarranted risk to the patient [5, 7, 18, 22]. Prognostic markers have already been identified at the group level. However, in summary, results to date indicate that a combination of potential prognostic markers provides a more accurate prognostic estimate than a single factor alone [19, 22]. This, however, requires models to estimate the individual risk and to consider the interaction between patient features and specific treatment options. Accordingly, these prediction tools are empirical models that quantify the effects of the combination of two or more predictive factors and attempt to estimate the likelihood of clinical disease activity or progression individually over a given time [21, 22]. However, it is important that these prognostic models are valid, warranting strict requirements for prognosis research, and that they are developed and validated using large, high-quality datasets with subjects who are representative of the population to which the model is later to be applied [22]. Deeply characterized cohorts are needed for prognosis research.

The aim of ProVal-MS is to contribute to the discovery and validation of novel predictive markers from routine university care for stratification of patients with respect to progression and response to treatment using a federated technical and organizational approach that stands for innovative data-driven medical research. Here we present the protocol of the ongoing ProVal-MS study.

Methods

Aim of the trial

The primary and secondary objective of ProVal-MS (German Clinical Trials Register-ID: DRKS00014034) is to validate discrimination and calibration of the Data Integration for Future Medicine MS-treatment decision score (DIFUTURE-TDS) on the 24 months outcome in early relapsing–remitting multiple sclerosis (RR-MS) and clinically isolated syndrome (CIS) patients, diagnosed within the last two years, using the area under the curve (AUC) of the receiver operating characteristics curve (ROC) and the calibration curve. The score supports clinical decision-making regarding the options of early (within 6 months after study baseline) platform medication (Interferon beta, glatiramer acetate, dimethyl/diroximel fumarate, teriflunomide), or no immediate treatment (> 6 months after baseline) of patients with early RR-MS and CIS by predicting the probability of new or enlarging lesions in cerebral magnetic resonance images (MRIs) between 6 and 24 months.

Patients starting on high efficacy drugs may not be included in the validation of the MS-TDS but are considered for secondary and exploratory endpoint analyses.

The MS-TDS has been created and internally validated by integration of retrospective routine clinical, imaging and laboratory data from 65 predictors (Additional file 1: Table S1) collected for deeply characterized 475 MS patients at the “Klinikum rechts der Isar, Technical University of Munich” [4]. To create the MS-TDS, a predictive random forest (RFs) model was implemented through transformation forests based on fully parameterized Cox proportional hazards models to deal with the interval-censored outcome [11, 15]. A benchmark study was performed for hyperparameter tuning and to choose the best performing model. In order to identify informative predictor variables, likelihood-based permutation variable importance measures (VIMPs) of this final model were used.[3, 12]. The five most important predictor variables with VIMP exceeding the VIMP of a random noise variable in the final model were, in descending order, treatment, periventricular lesions, total MRI lesions, CSF-specific oligoclonal bands, and relapses, item `any other symptom` [4].

The MS-TDS predicts the probability of new or enlarging lesions in cerebral magnetic resonance images (MRIs) between 6 and 24 months after the first MRI. Its cross-validated area under the curve (AUC) was 0.624 [4].

Further objectives are refining the MS-TDS score and providing data to identify new markers reflecting disease course and severity. The project also provides a technical evaluation of the ProVal-MS cohort within the IT-infrastructure of the DIFUTURE consortium (Data Integration for Future Medicine, www.difuture.de) and assesses efficacy of the data sharing techniques developed.

Study description and study design

ProVal-MS (German Clinical Trials Register-ID: DRKS00014034) is a prospective, multi-center, non-interventional, diagnostic phase II cohort study in, at study inclusion, untreated patients with early RR-MS or CIS.

Eligibility criteria

Patients aged 18–60 years and diagnosed with CIS (meeting the requirements of dissemination in space but not in time) or RR-MS according to the McDonald 2017 [23] diagnostic criteria at the time of diagnosis and before the initiation of any immunotherapy (except corticosteroids if the last treatment was more than 4 weeks before inclusion) are eligible to participate. Inclusion and exclusion criteria are summarized in Table 1.

Table 1 Inclusion and exclusion criteria for ProVal-MS

Sample size consideration for the minimal cohort size

At study start, a total of 250 patients were planned to be included to reach (e.g., after dropouts or protocol violations) at least 188 patients with available DIFUTURE-MS-TDS, which ensures sufficient power for validation. Its minimal sample size was determined by the requirement to reject the null-hypothesis (AUC ≤ 0.7) given the desired alternative (AUC = 0.8) on a 5% alpha level with power of at least 80%.

Arms and interventions

Due to the non-interventional study design, treatment allocation or procedures, starting after written informed consent and recording of baseline data, is not part of the study and follows current clinical routine practice. ProVal-MS is a non-interventional study, study results are derived from the whole patient cohort without stratifying them to different observation groups. The cohort structure allows the definition of and comparison between subgroups.

Outcome measures

The primary outcome of ProVal-MS is defined as achieving no new or enlarging T2-lesions (an area of hyperintensity on a T2-weighted MRI scan that is at least 3 mm in long axis) in cranial MRI between study month 6 and 24 (Yes, No).

MRI at month 6, is considered as `rebaseline` MRI after DMT initiation and is equally performed in untreated study participants. The MRI schedule is equal for all centres, according to the study protocol, essentially based on standard clinical practice in the participating centres. According to the study protocol, there is no MRI scheduled between month 6 and 24. Performing an MRI in case of a relapse is upon the decision of the treating physician. Patients reaching the primary endpoint already before the month 6 MRI, will be included in the analysis as patients without MRI activity in this period. The same applies for patients initiating a treatment or switching to another treatment between month 6 and 24. Any relapses occurring after the baseline and before the month 6 MRI will be considered for analysis in line with the MS-TDS, such as within 3 months from baseline, for validation purposes. The AUC is calculated by comparing the individual binary primary outcome with the individual DIFUTURE-MS-TDS score that considers the patient’s features at baseline and the therapy given. Calibration curves investigate the alignment of the 24-months success predicted from the DIFUTURE-MS-TDS with the 24-months outcome actually observed. The Brier Score summarizes the predictive quality of DIFUTURE-MS-TDS. Explorative analyses on the association between primary outcome, specific biomarkers, e.g. serum levels of Glial Fibrillary Acidic Protein (GFAP), neurofilament light chain (NfL), and others to be determined, not used for creating the MS-TDS [4], and treatments given are of further relevance.

Study procedures are undertaken with the understanding and after written consent of each subject, the study conforms with the World Medical Association Declaration of Helsinki. The study was approved by the local ethical review committees [University Hospital Augsburg (UKA), Ludwig-Maximilians-Universität (LMU) Hospital Munich, 18-0484; Klinikum rechts der Isar, Technical University of Munich (TUM), 323/18 S; Eberhard Karl University, Tübingen (UKT), 553/2018B02; Ulm University Medical Center (UKU), 238/19].

Data collection and sharing

All ProVal-MS sites collect data under a common data model which follows current international documentation standards in MS. The sites use the local clinical data capture systems. The local medical Data Integration Centers (meDICs) transfer the data into the local study databases (local DIS, the open-source software Data Integration System [16]: https://www.bitcare.de/). DIS also captures data outside of the clinical routine (different questionnaires: GEMS, COVID-19, see Additional file 2: Table S2). It also includes a secure identity management component. All local data are stored and managed in the meDICs of each study site.

Inspite the federated datastructure, patients also gave consent to pool their data across sites. For the primary analysis, pooled data as well as a federated strategy will be used and compared. The principle technical goal of the study is to establish and validate the federated analysis strategy by DataSHIELD. DataSHIELD [26] provides a framework for distributed analysis that preserves privacy between the different centres (individual patient features will not be recognizable outside the center where the patient is treated). Figure 1 shows the cohort’s multi-centric federated study infrastructure.

Fig. 1
figure 1

The multi-centric study infrastructure of ProVal-MS established at each study center. The routine clinical data is imported, and the study specific data is entered into the Data Integration System (DIS). The study data is made available in the DataSHIELD Opal server and accessible by the ProVal-MS study analyst to perform privacy preserving analysis using the R Client or Webclient (R, free software environment for statistical computing and graphics)

Clinical and paraclinical assessments

Within the consented data model (clinical and paraclinical data and metadata), a mandatory core dataset and an extended dataset were defined. All clinical data were collected in a harmonized and standardized manner. All predictors of the MS-TDS (Additional file 1: Table S1) are obligatory in the ProVal-MS study except CSF. Since patients included must have been diagnosed within the last two years and CSF is routinely taken for diagnosis, if patients consent, we expect to have CSF parameters in more than 95% of study participants for TDS-MS validation.

Patients have four mandatory study visits: Screening, baseline, visit at month 6, and at month 24. Visit at month 12 is not mandatory. Furthermore, for long-term follow-up of the cohort until year 5 after baseline, annual visits (month 36, 48, and 60) were implemented, after obtaining informed consent (study protocol amendment approved by the local ethical review committees).

Each mandatory visit collects the following core clinical parameters: Relapse activity and outcome, standard neurological examination, Expanded Disability Status Scale (EDSS; Version 04/10.2, https://www.nationalmssociety.org/NationalMSSociety/media/MSNationalFiles/Brochures/10-2-3-29-EDSS_Form.pdf), 9-hole-peg test, 25-foot walk test, low contrast visual acuity (2.5% sloan charts), oral Symbol Digit Modality Test (SDMT), questionnaires for depression (Beck depression inventory II, BDI-II), the GEM Environmental Questionnaire (at least once in the study period), fatigue (Fatigue Scale for Motor and Cognitive Functions, FSMC). A quality-of-life questionnaire (short form 36, SF36) and the Paced Auditory Serial Addition Test (PASAT) was optional at each visit.

In terms of paraclinical parameters, obligatory tests are cerebral and spinal MRI, routine laboratory data (see Additional file 3: Table S3; depending on the DMT, additional parameters may be analyzed at the discretion of the treating physician), and for secondary and exploratory analyses a collection of biosamples used for multi-OMICs analyses and biomarker assays, e.g., GFAP, NfL, and others to be determined, at baseline, months 6 and 24 drawn as part of the routine diagnostic procedure. Optical coherence tomography (OCT), laboratory analyses of cerebrospinal fluid, evoked potentials (visual, somatosensory, motor evoked potentials, VEP, SEP, MEP) are optional.

The prescription of disease modifying therapies (DMTs) or the option of not to treat is entirely the responsibility of the treating physician (investigator) following the standard of care. Treatments, started after baseline visit, and concomitant medication are recorded.

Paper-based source documents (including narratives) are used for monitoring. Parameters are collected during study visits which are scheduled for baseline, month 6 (−4/ + 8 week-interval) and month 24 (± 8 week-interval), performed according to the standard clinical practice with additional blood sampling. An additional visit after 12 months (± 8 weeks) is non-mandatory. Additional file 2: Table S2 provides the overall time schedule and study procedures. By study protocol amendments, month 6-visit is scheduled 6 months after treatment initiation, if started within 6 months after baseline, extending the study period in select patients up to 30 months. No additional invasive procedures that are not part of the routine practice are performed.

Magnetic resonance imaging

Imaging protocols for cerebral and spinal MRI were highly standardized across all participating centres with the prerequisite to use the same scanner, at least from month 6 (visit 2) on. Both cerebral follow-up scans (month 6 and 24) have to be performed at the same 3.0 Tesla (T) scanner with the same coils and protocols to ensure longitudinal comparability. Spinal follow up MRIs can be performed at 1.5T or 3.0T but must also be obtained at one single scanner. Baseline cerebral and spinal MRI may be performed at any 1.5T or 3.0T scanner; however, if possible, it is recommended to use the same scanner as for follow-up scans. Pulse sequence protocols are shown in Table 2. In each centre, responsibilities to evaluate MRI scans have been assigned to neuroradiologists involved in the study. Cranial and spinal MRI scans are analyzed manually at each study centre. Structured reporting software (mintLesion™, LMU, UKT) and longitudinal subtraction to assess new brain lesions by commercially available software (Philips Longitudinal Brain Imaging, LoBi, or Siemens Healthineers syngo.via, UKA, TUM) is used in the study centres according to local practise. Additionally, pseudonymized cranial MRI scans are analysed centrally (TUM; J.S.K) by an in-house developed longitudinal subtraction algorithm [2] and an automated lesion segmentation software (lesion segmentation tool–artificial intelligence) [25] and results are compared with the results obtained by manual analysis. Discrepancies between these methods, if existing, are resolved centrally by personal comparison, to reach a final consensus in each patient. The consented final data are used as endpoints for the study.

Table 2 MRI protocol for cranial and spinal MRI

Optical coherence tomography

A standardized OCT protocol was agreed upon and established across sites. The following 3 parameters are measured: (1) The thickness of the peripapillary retinal nerve fiber layer (pRNFL) in µm. (2) The thickness (µm) or (3) volume (mm3) of the different retinal layers around the fovea. OCT data will be reported according to the APOSTEL [1] and OSCAR-IB [20] recommendations.

Biosamples

Blood samples for DNA, RNA/plasma, serum (all mandatory) and peripheral blood mononuclear cells (optional) are collected at all mandatory visits. A central biosample management facility is provided by Technical University of Munich responsible for processing, analysis, and long-term storage to ensure consistent data quality. Sampling is performed with pre-labeled, barcoded tubes in sampling kits. The pseudonym on each sampling kit will be linked to the patient pseudonym in the local study database. Thus, all biosample-related data will be protected by two-step pseudonymization at all sites, ensuring data privacy. Sampling follows the same procedure as established in the Horizon 2020 EU Project Multiple MS cohort [10]. By study protocol amendment, a COVID-19 patient questionnaire and analysis of biosamples regarding COVID-19 immunoreactivity were implemented.

Data evaluation/statistics

DataSHIELD also allows to perform data quality checks over the distributed data. This process is similar to query process in clinical studies: A quality assessment script is distributed over the centers, each center creates its own data quality report and learns on data items which do not comply with the quality criteria established for a project. The curated data can be used to perform local research projects as well as projects over all five centers. Descriptive statistics can also be implemented under a distributed privacy-protecting strategy. Within the Medical Informatics Initiative (MII), there is an active development of algorithms applicable within DataSHIELD and allowing privacy protected distributed machine learning (privateaim.de).

In order to assess the primary endpoints, the ROC as well as AUC are calculated using distributed as well as centralized approaches. Calibration curves investigate the alignment of the 24-months success predicted from the DIFUTURE-MS-TDS with the 24-months outcome actually observed. The Brier Score summarizes the predictive quality of DIFUTURE-MS-TDS. Explorative analyses on the association between primary outcome, specific biomarkers, e.g. serum levels of GFAP, NfL, and others to be determined, not used for creating the MS-TDS [4] and treatments given are of further relevance.

Contacts for sponsors and collaborators, investigators

The ProVal-MS study reported here was established within the audited use case of the DIFUTURE (www.difuture.de) consortium as part of the German MII. MII is establishing meDICs at many German university hospitals. The following study centers participate together with their meDICs: Department of Neurology and Clinical Neurophysiology, University Hospital Augsburg (UKA; Prof. Dr. Antonios Bayas, Prof. Dr. Markus Naumann); Department of Neurology, Klinikum rechts der Isar, Technical University of Munich (TUM; Prof. Dr. Bernhard Hemmer); Institute of Clinical Neuroimmunology, LMU Hospital, Ludwig-Maximilians-Universität Munich (LMU; Prof. Dr. Martin Kerschensteiner; PD Dr. Joachim Havla); Department of Neurology and Hertie Institute for Clinical Brain Research, Eberhard Karl University, Tübingen (UKT; Prof. Dr. Ulf Ziemann; PD Dr. Markus C. Kowarik), Department of Neurology, Ulm University Medical Center (UKU; Prof. Dr. Hayrettin Tumani, PD Dr. Makbule Senel)) within and associated with the DIFUTURE consortium.

Responsibilities have been deputed as follows: coordinating investigator: Prof. Dr. Bernhard Hemmer; Biometrician: Prof. Dr. Ulrich Mansmann; IT coordinator: Prof. Dr. Oliver Kohlbacher; central quality assurance: Marlien Hagedorn.

To ensure compliance with the rules of good clinical practice, this study is being monitored by a steering committee (Prof. Dr. Bernhard Hemmer, Prof. Dr. Martin Kerschensteiner, Prof. Dr. Ulf Ziemann, Prof. Dr. Antonios Bayas, Prof. Dr. Ulrich Mansmann, Prof. Dr. Oliver Kohlbacher, Prof. Dr. Klaus A. Kuhn). Additional investigators and collaborators can be found in the authors and study group list.

This work as part of the DIFUTURE project has been funded by the German Ministry of Education and Research (Bundesministerium für Bildung und Forschung, BMBF), Grant 01ZZ1804[A-I].

Perspective

The highly variable and apparently unpredictable MS disease course makes the assessment of the individual prognosis difficult or rather impossible. According to the treat-to-target algorithm, the use of DMTs is dependent on individual disease activity, supported by disease prognosis markers based on findings in larger MS cohorts [13]. Having reliable predictive markers would enable the clinician to tailor treatment according to the individual prognosis avoiding under- and overtreatment with the danger of accumulating disability or avoidable hazard to the patient.

As the study was initiated as use case within the MII, ProVal-MS has several objectives; one is to show that it is feasible to use data collected in the routinely used clinical data capture systems for building clinical cohorts with high relevance for clinical research. Usually, data for clinical studies is collected within (electronic) case report forms (eCRFs) requiring clinicians or study nurses to collect relevant data twice, once in the standard patient record and once in the eCRF. However, for many studies there are large intersections between the data collected in the clinical IT systems and the data needed for research purposes. Entering those into two separate systems is time- and resource-consuming and prone to discrepancies resulting in data entry errors. Thus, for ProVal-MS routinely collected data is collected with high quality (changing processes within the clinic as well as the clinical IT) and exported directly from the source systems. The local practice changes were driven by a common MS core dataset that harmonized data structures at the participating sites. Local changes included adaption or programming of local entry formats or mapping the source information into the core dataset. This enabled an easy transfer of high-quality routine data to the study database where it was enriched with study-specific data captured outside of the clinical routine. This effort also increased the local standard of routine documentation supporting future research based on structured routine data. As in our study, to allow for timely results while complying with data protection regulations, methods of distributed analysis can be applied using e.g. DataSHIELD [26] as a framework for privacy-preserving distributed analysis of sensitive data like routine data of MS patients, which may be analyzed locally but not shared between sites. This concept will be applied and validated during the analysis in ProVal-MS. While the preparatory work needed to harmonize data, making them available from routine IT systems is considerable, the resulting datasets enable the full potential of routine data for high-quality clinical research. The concepts for data structure and integration developed within DIFUTURE are universal and can be applied to more sites therefore providing an easier introduction into providing data for research.

In a recent Cochrane Review, all multivariable prognostic model developments and validations published to date for quantifying the risk of clinical disease progression, worsening, and activity in MS were identified and summarized. Only 2 of 75 models were shown to be validated in external cohorts multiple times, which, however, is formally the most stringent quality standard of prognostic research. Also, the studies reviewed differed in terms of clinical characteristics of the patient cohorts, definition of predictors, and outcome parameters, which made comparability difficult [17]. Overcoming this, ProVal-MS is a validation study for the DIFUTURE-MS-TDS emerging from a combined analysis of existing data in a separately conducted retrospective cohort study, thus validating a predictive model in a different prospective cohort using clinical routine data.

Besides the overall strategy of data standardization across centers, local data integration and decentralized data analysis via distributed computing, ProVal-MS has several unique features compared to other prospective cohorts. The study uses high-resolution standardized 3T imaging of the brain and the entire spinal cord (1.5 or 3T) at months 6 and months 24 to detect inflammatory disease activity. Besides the large number of clinical parameters, paraclinical parameters such as evoked potentials and OCT are recorded at diagnosis and during the disease course.

In conclusion, ProVal-MS as a prospective multi-center cohort study will add important in-depth data for MS prognosis research. Furthermore, it should prove that with the appropriate IT infrastructure and data harmonization, it is feasible to use data collected in the routinely used clinical data capture systems for clinical research. Data resulting from this may in turn support clinicians in patient counseling and treatment.

Availability of data and materials

All data and materials reported are available from the corresponding author upon reasonable request.

Abbreviations

AUC:

Area under curve

BDI-II:

Beck depression inventory II

CIS:

Clinically isolated syndrome

CNS:

Central nervous system

DIFUTURE:

Data integration for future medicine

DIS:

Data integration system

DMTs:

Disease modifying therapies

eCRFs:

Electronic case report forms

EDSS:

Expanded disability status scale

FSMC:

Fatigue scale for motor and cognitive functions

IT:

Information technology

meDIC:

Medical data integration centers

MEP:

Motor evoked potentials

MII:

Medical informatics initiative

MRI:

Magnetic resonance imaging

MS:

Multiple sclerosis

OCT:

Optical coherence tomography

PASAT:

Paced auditory serial addition

pRNFL:

Peripapillary retinal nerve fiber layer

ProVal-MS:

Prospective study to validate a multidimensional decision score to predict treatment outcome at 24 months in untreated patients with clinically isolated syndrome or early RR-MS

ROC:

Receiver operating characteristics

RR:

Relapsing–remitting

RR-MS:

Relapsing–remitting multiple sclerosis

SDMT:

Symbol digit modality test

SEP:

Somatosensory evoked potentials

SF36:

Short form 36

T:

Tesla

TDS:

Treatment decision score

VEP:

Visual evoked potential

References

  1. Aytulun, A., Cruz-Herranz, A., Aktas, O., Balcer, L. J., Balk, L., Barboni, P., Blanco, A. A., Calabresi, P. A., Costello, F., Sanchez-Dalmau, B., DeBuc, D. C., Feltgen, N., Finger, R. P., Frederiksen, J. L., Frohman, E., Frohman, T., Garway-Heath, D., Gabilondo, I., Graves, J. S., & Albrecht, P. (2021). APOSTEL 2.0 recommendations for reporting quantitative optical coherence tomography studies. Neurology, 97(2), 68–79.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Eichinger, P., Schon, S., Pongratz, V., Wiestler, H., Zhang, H., Bussas, M., Hoshi, M. M., Kirschke, J., Berthele, A., Zimmer, C., Hemmer, B., Muhlau, M., & Wiestler, B. (2019). Accuracy of unenhanced MRI in the detection of new brain lesions in multiple sclerosis. Radiology, 291(2), 429–435. https://doi.org/10.1148/radiol.2019181568

    Article  PubMed  Google Scholar 

  3. Hapfelmeier, A., Hornung, R., & Haller, B. (2023). Efficient permutation testing of variable importance measures by the example of random forests. Computational Statistics & Data Analysis, 181, 107689.

    Article  Google Scholar 

  4. Hapfelmeier, A., On, B. I., Muhlau, M., Kirschke, J. S., Berthele, A., Gasperi, C., Mansmann, U., Wuschek, A., Bussas, M., Boeker, M., Bayas, A., Senel, M., Havla, J., Kowarik, M. C., Kuhn, K., Gatz, I., Spengler, H., Wiestler, B., Grundl, L., & Hemmer, B. (2023). Retrospective cohort study to devise a treatment decision score predicting adverse 24-month radiological activity in early multiple sclerosis. Therapeutic Advances in Neurological Disorders, 16, 17562864231161892. https://doi.org/10.1177/17562864231161892

    Article  PubMed  PubMed Central  Google Scholar 

  5. Hemingway, H., Croft, P., Perel, P., Hayden, J. A., Abrams, K., Timmis, A., Briggs, A., Udumyan, R., Moons, K. G., Steyerberg, E. W., Roberts, I., Schroter, S., Altman, D. G., Riley, R. D., & Group, P. (2013). Prognosis research strategy (PROGRESS) 1: a framework for researching clinical outcomes. BMJ, 346, e5595. https://doi.org/10.1136/bmj.e5595

    Article  PubMed  PubMed Central  Google Scholar 

  6. Hempel, S., Graham, G. D., Fu, N., Estrada, E., Chen, A. Y., Miake-Lye, I., Miles, J. N., Shanman, R., Shekelle, P. G., Beroes, J. M., & Wallin, M. T. (2017). A systematic review of modifiable risk factors in the progression of multiple sclerosis. Multiple Sclerosis, 23(4), 525–533. https://doi.org/10.1177/1352458517690270

    Article  PubMed  Google Scholar 

  7. Hingorani, A. D., Windt, D. A., Riley, R. D., Abrams, K., Moons, K. G., Steyerberg, E. W., Schroter, S., Sauerbrei, W., Altman, D. G., Hemingway, H., & Group, P. (2013). Prognosis research strategy (PROGRESS) 4: Stratified medicine research. BMJ, 346, e5793. https://doi.org/10.1136/bmj.e5793

    Article  PubMed  PubMed Central  Google Scholar 

  8. Hohlfeld, R., Dornmair, K., Meinl, E., & Wekerle, H. (2016). The search for the target antigens of multiple sclerosis, part 1: Autoreactive CD4+ T lymphocytes as pathogenic effectors and therapeutic targets. Lancet Neurology, 15(2), 198–209. https://doi.org/10.1016/S1474-4422(15)00334-8

    Article  CAS  PubMed  Google Scholar 

  9. Hohlfeld, R., Dornmair, K., Meinl, E., & Wekerle, H. (2016). The search for the target antigens of multiple sclerosis, part 2: CD8+ T cells, B cells, and antibodies in the focus of reverse-translational research. Lancet Neurology, 15(3), 317–331. https://doi.org/10.1016/S1474-4422(15)00313-0

    Article  CAS  PubMed  Google Scholar 

  10. Horizon 2020 Framework Programme for Research and Innovation. Reterived 15 Aug 2023 from https://www.multiplems.eu

  11. Hothorn, T., Möst, L., & Bühlmann, P. (2018). Most likely transformations. Scandinavian Journal of Statistics, 45(1), 110–134.

    Article  Google Scholar 

  12. Hothorn, T., & Zeileis, A. (2021). Predictive distribution modeling using transformation forests. Journal of Computational and Graphical Statistics, 30, 1181–1196.

    Article  Google Scholar 

  13. Iacobaeus, E., Arrambide, G., Amato, M. P., Derfuss, T., Vukusic, S., Hemmer, B., Tintore, M., Brundin, L., & Group, E. F. W. (2020). Aggressive multiple sclerosis (1): Towards a definition of the phenotype. Multiple Sclerosis. https://doi.org/10.1177/1352458520925369

    Article  PubMed  Google Scholar 

  14. Kim, W., & Patsopoulos, N. A. (2022). Genetics and functional genomics of multiple sclerosis. Seminar Immunopathology, 44(1), 63–79. https://doi.org/10.1007/s00281-021-00907-3

    Article  CAS  Google Scholar 

  15. Korepanova, N., Seibold, H., Steffen, V., & Hothorn, T. (2020). Survival forests under test: Impact of the proportional hazards assumption on prognostic and predictive forests for amyotrophic lateral sclerosis survival. Statistical Methods in Medical Research, 29(5), 1403–1419. https://doi.org/10.1177/0962280219862586

    Article  PubMed  Google Scholar 

  16. Prasser, F., Kohlbacher, O., Mansmann, U., Bauer, B., & Kuhn, K. A. (2018). Data integration for future medicine (DIFUTURE). Methods of Information in Medicine, 57(S01), e57–e65. https://doi.org/10.3414/ME17-02-0022

    Article  PubMed  PubMed Central  Google Scholar 

  17. Reeve, K., On, B. I., Havla, J., Burns, J., Gosteli-Peter, M. A., Alabsawi, A., Alayash, Z., Gotschi, A., Seibold, H., Mansmann, U., & Held, U. (2023). Prognostic models for predicting clinical disease progression, worsening and activity in people with multiple sclerosis. Cochrane Database Systematic Review, 9(9), CD013606. https://doi.org/10.1002/14651858.CD013606.pub2

    Article  Google Scholar 

  18. Riley, R. D., Hayden, J. A., Steyerberg, E. W., Moons, K. G., Abrams, K., Kyzas, P. A., Malats, N., Briggs, A., Schroter, S., Altman, D. G., Hemingway, H., & Group, P. (2013). Prognosis Research Strategy (PROGRESS) 2: prognostic factor research. PLoS Medicine, 10(2), e1001380. https://doi.org/10.1371/journal.pmed.1001380

    Article  PubMed  PubMed Central  Google Scholar 

  19. Rotstein, D., & Montalban, X. (2019). Reaching an evidence-based prognosis for personalized treatment of multiple sclerosis. Nature Reviews. Neurology, 15(5), 287–300. https://doi.org/10.1038/s41582-019-0170-8

    Article  PubMed  Google Scholar 

  20. Schippling, S., Balk, L. J., Costello, F., Albrecht, P., Balcer, L., Calabresi, P. A., Frederiksen, J. L., Frohman, E., Green, A. J., Klistorner, A., Outteryck, O., Paul, F., Plant, G. T., Traber, G., Vermersch, P., Villoslada, P., Wolf, S., & Petzold, A. (2015). Quality control for retinal OCT in multiple sclerosis: Validation of the OSCAR-IB criteria. Multiple Sclerosis, 21(2), 163–170. https://doi.org/10.1177/1352458514538110

    Article  CAS  PubMed  Google Scholar 

  21. Steyerberg, E. W. (2019.). Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating. (2nd edition ed.).

  22. Steyerberg, E. W., Moons, K. G., van der Windt, D. A., Hayden, J. A., Perel, P., Schroter, S., Riley, R. D., Hemingway, H., Altman, D. G., & Group, P. (2013). Prognosis Research Strategy (PROGRESS) 3: prognostic model research. PLoS Medicine, 10(2), e1001381. https://doi.org/10.1371/journal.pmed.1001381

    Article  PubMed  PubMed Central  Google Scholar 

  23. Thompson, A. J., Banwell, B. L., Barkhof, F., Carroll, W. M., Coetzee, T., Comi, G., Correale, J., Fazekas, F., Filippi, M., Freedman, M. S., Fujihara, K., Galetta, S. L., Hartung, H. P., Kappos, L., Lublin, F. D., Marrie, R. A., Miller, A. E., Miller, D. H., Montalban, X., & Cohen, J. A. (2018). Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria. Lancet Neurology, 17(2), 162–173. https://doi.org/10.1016/S1474-4422(17)30470-2

    Article  PubMed  Google Scholar 

  24. Thompson, A. J., Baranzini, S. E., Geurts, J., Hemmer, B., & Ciccarelli, O. (2018). Multiple sclerosis. Lancet, 391(10130), 1622–1636. https://doi.org/10.1016/S0140-6736(18)30481-1

    Article  PubMed  Google Scholar 

  25. Wiltgen, T., McGinnis, J., Schlaeger, S., Voon, C., Berthele, A., Bischl, D., Grundl, L., Will, N., Metz, M., Schinz, D., Sepp, D., Prucker, P., Schmitz-Koep, B., Zimmer, C., Menze, B., Rueckert, D., Hemmer, B., Kirschke, J., Muhlau, M., & Wiestler, B. (2023). LST-AI: a Deep Learning Ensemble for Accurate MS Lesion Segmentation. medRxiv. https://doi.org/10.1101/2023.11.23.23298966

  26. Wolfson, M., Wallace, S. E., Masca, N., Rowe, G., Sheehan, N. A., Ferretti, V., LaFlamme, P., Tobin, M. D., Macleod, J., Little, J., Fortier, I., Knoppers, B. M., & Burton, P. R. (2010). DataSHIELD: Resolving a conflict in contemporary bioscience–performing a pooled analysis of individual-level data without sharing the data. International Journal of Epidemiology, 39(5), 1372–1382. https://doi.org/10.1093/ije/dyq111

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank all patients for participating in this observational study.

The ProVal-MS study group

Ansgar Berlis, Benedikt Wiestler, Tania Kümpfel, Klaus Seelos, Jutta Dünschede, Roswitha Kemmner, Meinrad Beer, Jennifer Dietrich, Jonas Schaller.

Funding

Open Access funding enabled and organized by Projekt DEAL. This work is part of the DIFUTURE project funded by the German Ministry of Education and Research (Bundesministerium für Bildung und Forschung, BMBF), Grant 01ZZ1804[A-I].

Author information

Authors and Affiliations

Authors

Consortia

Contributions

AnB, UM, JoH, BH wrote the main manuscript, text and tables. FA prepared Fig. 1. AnB, UM, BIÖ, VSH, AcB, MM, MCK, MK, MS, VS, MKe, MN, JuH, EO, CR, UZ, HT, IV, FA, FK, ISR, HS, GM, HAK, OK, MH, MB, KK, SB, JSK, FKo, LB, HZ, BB, NS, JoH, BH provided substantial contributions to the conception and design of the work, All authors reviewed the manuscript for intellectual content.

Corresponding author

Correspondence to Antonios Bayas.

Ethics declarations

Ethical approval and consent to participate

The study was approved by the local ethical review committees (Department of Neurology and Clinical Neurophysiology, University Hospital Augsburg; Institute of Clinical Neuroimmunology, LMU Hospital, Ludwig-Maximilians-Universität Munich, 18-0484; Department of Neurology, Klinikum rechts der Isar, Technical University of Munich, 323/18 S; Department of Neurology and Hertie Institute for Clinical Brain Research, Eberhard Karl University, Tübingen, 553/2018B02; Department of Neurology, Ulm University Medical Center, 238/19). All participants gave their informed consent prior to their inclusion in the study. Study procedures are undertaken with the understanding and after written consent of each subject, the study conforms with the World Medical Association Declaration of Helsinki.

Consent for publication

All participants gave their written consent to publish data.

Competing interests

A. Bayas: personal compensation from Merck Serono, Biogen, Novartis, TEVA, Roche, Sanofi/Genzyme, Celgene/Bristol Myers Squibb, Janssen, Sandoz/HEXAL, Horizon, Alexion, Argenx; grants for congress travel and participation from Biogen, TEVA, Novartis, Sanofi/Genzyme, Merck Serono, Celgene, Janssen. None related to this report. U. Mansmann: no competing interests to declare that are relevant to the content of this article. B.I. Ön: no competing interests to declare that are relevant to the content of this article. V.S. Hoffmann: partially funded by the German Federal Ministry of Education and Research ((DIFUTURE), Grant Numbers 01ZZ1603[A-D] and 01ZZ1804[A-H]). A. Berthele: received consulting and/or speaker fees from Alexion, Bayer Healthcare, Biogen, Celgene, Novartis, Roche and Sandoz/Hexal, and his institution has received compensation for clinical trials from Alexion, Biogen, Merck, Novartis, Roche, and Sanofi Genzyme; all outside the submitted work. M. Mühlau: funding from German Research Foundation (PP2177, 428223038), the National Institutes of Health (1R01NS112161); Bavarian State Ministry for Science and Art (Program Bavaria—Québec: F.4-V0134.K5.1/86/34); German Federal Ministry of Education and Research (BMBF), DIFUTURE 01ZZ1603[A-D] and 01ZZ1804[A-I]. M.C. Kowarik: advisory boards and received speaker fees/travel grants from Merck, Sanofi-Genzyme, Novartis, Biogen, Jansen, Alexion, Celgene/Bristol-Myers Squibb and Roche. He also received research grants from Merck, Sanofi-Genzyme and Celgene/Bristol-Myers Squibb, Roche, Janssen. None related to this work. M. Krumbholz: research grants from Merck and Novartis; travel support and personal fees from BMS, Merck, Novartis and Roche; all unrelated to this manuscript. M. Senel: consulting and/or speaker honoraria from Alexion, Bayer, Biogen, Bristol-Myers-Squibb, Horizon, Merck, Roche, and Sanofi Genzyme. She has received travel support from Celgene, and TEVA. She has received research funding from the Hertha-Nathorff-Program. None of this related to the current study. V. Steuerwald: partially funded by the German Federal Ministry of Education and Research (DIFUTURE). M. Naumann: no competing interests to declare that are relevant to the content of this article. J. Hartberger: no competing interests to declare that are relevant to the content of this article. M. Kerschensteiner: no competing interests to declare that are relevant to the content of this article. E. Oswald: no competing interests to declare that are relevant to the content of this article. C. Ruschil: supported by fortüne/PATE (no. 2536-0-0/1) from the medical faculty Eberhard-Karls University of Tübingen; not related to this project. U. Ziemann: no competing interests to declare that are relevant to the content of this article. H. Tumani: funding for research projects, lectures, and travel from Alexion, Bayer, Biogen, Celgene/Bristol-Myers-Squibb, GlaxoSmithKline, Janssen, Merck Serono, Novartis, Roche, Sanofi/Genzyme, Siemens and Teva, and received research support from Chemische Fabrik Karl Bucher GmbH, German Multiple Sclerosis Society (DMSG), and the German Ministry for Education and Research (BMBF). I. Vardakas: no competing interests to declare that are relevant to the content of this article. F. Albashiti is partially funded by the German Federal Ministry of Education and Research {(DIFUTURE), Grant Numbers 01ZZ1603[A-D] and 01ZZ1804[A-H]}. F. Kramer: no competing interests to declare that are relevant to the content of this article. I. Soto-Rey: no competing interests to declare that are relevant to the content of this article. Helmut Spengler: funded by the German Federal Ministry of Education and Research ((DIFUTURE), Grant Numbers 01ZZ1603[A-D] and 01ZZ1804[A-I]). G. Mayer: funded by the Digital Europe program of the European Commission (EDITH project no. 101083771). H.A. Kestler: partially funded by the German Federal Ministry of Education and Research ((DIFUTURE), Grant Numbers 01ZZ1804I). O. Kohlbacher: no competing interests to declare that are relevant to the content of this article. M. Hagedorn: no competing interests to declare that are relevant to the content of this article. M. Boeker: no competing interests to declare that are relevant to the content of this article. K. Kuhn: no competing interests to declare that are relevant to the content of this article. S. Buchka: no competing interests to declare that are relevant to the content of this article. F. Kohlmayer: funding for providing and maintaining of the study software, DIS from Bitcare GmbH. J. Kirschke: Co-Founder of Bonescreen GmbH. Speaker fees from Novartis. L. Behrens: no competing interests to declare that are relevant to the content of this article. H. Zimmermann: no competing interests to declare that are relevant to the content of this article. B. Bender: Co-Founder and CTO of AIRAmed GmbH, Tübingen. N. Sollmann: no competing interests to declare that are relevant to the content of this article. J. Havla: reports grants from the Friedrich-Baur-Stiftung, Merck and Horizon, personal fees and non-financial support from Alexion, Horizon, Roche, Merck, Novartis, Biogen, BMS and Janssen, and non-financial support from the Guthy-Jackson Charitable Foundation and The Sumaira Foundation. JH was partially funded by the German Federal Ministry of Education and Research ((DIFUTURE), Grant Numbers 01ZZ1603[A-D] and 01ZZ1804[A-H]). B. Hemmer: funding from the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy within the framework of the Munich Cluster for Systems Neurology [EXC 2145 SyNergy – ID 390857198] and the European commission (MultipleMS). He has served on scientific advisory boards for Novartis and Sandoz; he has served as DMSC member for AllergyCare, Sandoz, Polpharma, Biocon and TG therapeutics; his institution received research grants from Roche for multiple sclerosis research. He has received honoraria for counseling (Gerson Lehrmann Group). He holds part of two patents; one for the detection of antibodies against KIR4.1 in a subpopulation of patients with multiple sclerosis and one for genetic determinants of neutralizing antibodies to interferon. All conflicts are not relevant to the topic of the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1.

Predictors of the MS-treatment decision score.

Additional file 2: Table S2.

Study procedure overview.

Additional file 3: Table S3.

Routine laboratory parameters.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bayas, A., Mansmann, U., Ön, B.I. et al. Prospective study validating a multidimensional treatment decision score predicting the 24-month outcome in untreated patients with clinically isolated syndrome and early relapsing–remitting multiple sclerosis, the ProVal-MS study. Neurol. Res. Pract. 6, 15 (2024). https://doi.org/10.1186/s42466-024-00310-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s42466-024-00310-x

Keywords