Skip to article content
Rebuilt preprint

A reproducible benchmark of resting-state fMRI denoising strategies using fMRIPrep and Nilearn

Back to Article
OHBM 2022 abstract - submitted text
Download Notebook

OHBM 2022 abstract - submitted text

Source
import warnings
warnings.filterwarnings("ignore")
from fmriprep_denoise.visualization import figures, utils
from myst_nb import glue


path_root = utils.repo2data_path() / "denoise-metrics"
# Load metric data
dataset = "ds000228"
fmriprep_version = "fmriprep-20.2.1lts"
atlas_name = "schaefer7networks"
dimension = 400
Output

OHBM 2022 abstract - submitted text

The preliminary results will be presented at OHBM 2022 as a poster. Please find poster number WTh570.

Find the presenter at the virtual poster session on Wednesday, June 8, 2022, 8:30 PM GMT + 1.

At Glasgow, please contact the presenter on Twitter to schedule a time to chat, or come to see the presenter on Wednesday, June 22, 2022, 12:45 PM at the poster hall.

poster

1Impact of confound removal strategies on functional connectivity generated from fMRIPrep outputs

H-T Wang[1], S L Meisler[2][3], H Shamarke, F Paugam[1][4], N Gensollen[5], B Thirion[5], C Markiewicz[6], P Bellec[1][7]

1.1Introduction

Selecting an optimal denoising strategy is a key issue when processing fMRI data. The popular software fMRIPrep Esteban et al., 2018 aims to standardize fMRI preprocessing, but users are still offered a wide range of confound regressors to choose from to denoise data. Without a good understanding of the literature or the fMRIPrep documentation, users can select suboptimal strategies. Current work aims to provide a useful reference for fMRIPrep users by systematically evaluating the impact of different confound regression strategies, and by contrasting the results with past literature based on alternative preprocessing software.

1.2Methods

We selected dataset ds000228 Richardson et al., 2018 on OpenNeuro, which we preprocessed with fMRIPrep LTS20.2.1 using option --use-aroma. Time series were extracted using the Schaefer 7 network atlas with 400 ROIs Schaefer et al., 2017. We applied the denoising strategies listed in the table below using fMRIPrep-generated confounds. Subjects with less than 80% of remaining volumes after scrubbing with a 0.5 mm threshold were excluded from all analysis. We also calculated the connectome from high-pass filtered time series as a comparison baseline.

strategyimagehigh_passmotionwm_csfglobal_signalscrubfd_threshcompcorn_compcorica_aromademean
baselinedesc-preproc_boldTrueN/AN/AN/AN/AN/AN/AN/AN/ATrue
simpledesc-preproc_boldTruefullbasicN/AN/AN/AN/AN/AN/ATrue
simple+gsrdesc-preproc_boldTruefullbasicbasicN/AN/AN/AN/AN/ATrue
scrubbingdesc-preproc_boldTruefullfullN/A50.5N/AN/AN/ATrue
scrubbing+gsrdesc-preproc_boldTruefullfullbasic50.5N/AN/AN/ATrue
compcordesc-preproc_boldTruefullN/AN/AN/AN/Aanat_combinedallN/ATrue
compcor6desc-preproc_boldTruefullN/AN/AN/AN/Aanat_combined6N/ATrue
aromadesc-smoothAROMAnonaggr_boldTrueN/AbasicN/AN/AN/AN/AN/AfullTrue
aroma+gsrdesc-smoothAROMAnonaggr_boldTrueN/AbasicbasicN/AN/AN/AN/AfullTrue

We used three metrics Ciric et al., 2017, Parkes et al., 2018 to evaluate the denoising results:

  1. Quality control / functional connectivity (QCFC Power et al., 2015): partial correlation between motion and connectivity with age and sex as covariates. We control for multiple comparisons with false positive rate correction.

  2. Distance-dependent effects of motion on connectivity Power et al., 2012: correlation between node-wise Euclidean distance and QC-FC.

  3. Network modularity Satterthwaite et al., 2012: graph community detection based on Louvain method, implemented in the Brain Connectome Toolbox.

1.3Results

1.3.1QC-FC and distance-dependent effect

No denoise strategy removed the correlation with motion captured by mean framewise displacement. aroma, compcor6, and simple reduced the correlation between connectivity edges and mean framewise displacement. scrubbing and scrubbing+gsr performed the best, as seen in previous work Power et al., 2015. compcor, which applies compcor-based regressors covering 50% of the variance, performs worse than the connectome baseline created with high-pass filtered time series. Surprisingly, all strategies with global signal regression underperform, contradicting the existing literature Ciric et al., 2017 Parkes et al., 2018.

Source
fig = figures.plot_motion_resid(
    dataset, fmriprep_version, path_root, atlas_name=atlas_name, dimension=dimension
)
glue("ohbm-qcfc-fig", fig, display=False)
glue:figure - Unknown Directive
:figwidth: 800px
:name: "ohbm-qcfc-fig-notebook"

1.3.2Distance-dependent effects of motion on connectivity

Consistent with the literature, aroma reduces the distance dependency of motion on connectivity.

Source
fig = figures.plot_distance_dependence(
    dataset, fmriprep_version, path_root, atlas_name=atlas_name, dimension=dimension
)
glue("ohbm-dist-fig", fig, display=False)
glue:figure - Unknown Directive
:figwidth: 800px
:name: "ohbm-dist-fig-notebook"

1.3.3Network modularity

All strategies increased the overall network modularity compared to the baseline, with scrubbing based methods performing the best out of all. GSR-based strategies improved the network modularity compared to their conunterparts. The correlation between modularity quality and motion for each denoising approach shows that compcor-based and ICA-AROMA strategies are the best at eliminating correlations between motion and modularity.

Source
fig = figures.plot_network_modularity(
    dataset, fmriprep_version, path_root, atlas_name=atlas_name, dimension=dimension
)
glue("ohbm-network-fig", fig, display=False)
glue:figure - Unknown Directive
:figwidth: 800px
:name: "ohbm-network-fig-notebook"

1.4Conclusions

We replicated previous findings demonstrating the usefulness of standard denoising strategies (compcor, aroma, etc.). However, results involving global signal regression methods systematically contradict the literatureCiric et al., 2017 Parkes et al., 2018. This evaluation is implemented in a fully reproducible jupyter book framework, and it can be applied to evaluate denoising strategies for future fMRIPrep release. This software may also be useful for researchers to select the most suitable strategy and produce denoising benchmarks for their own dataset.

Footnotes
  1. Centre de recherche de l’institut Universitaire de gériatrie de Montréal (CRIUGM), Montréal, Québec, Canada

  2. Harvard University, MA, USA

  3. Massachusetts Institute of Technology, MA, USA

  4. Computer Science and Operations Research Department, Université de Montréal, Montréal, Québec, Canada

  5. Inria, CEA, Université Paris-Saclay, Paris, France

  6. Department of Psychology, Stanford University, Stanford, United States

  7. Psychology Department, Université de Montréal, Montréal, Québec, Canada

References
  1. Esteban, O., Markiewicz, C., Blair, R. W., Moodie, C., Isik, A. I., Erramuzpe Aliaga, A., Kent, J., Goncalves, M., DuPre, E., Snyder, M., Oya, H., Ghosh, S., Wright, J., Durnez, J., Poldrack, R., & Gorgolewski, K. J. (2018). fMRIPrep: a robust preprocessing pipeline for functional MRI. Nature Methods. 10.1038/s41592-018-0235-4
  2. Richardson, H., Lisandrelli, G., Riobueno-Naylor, A., & Saxe, R. (2018). Development of the social brain from age three to twelve years. Nature Communications, 9(1), 1027. 10.1038/s41467-018-03399-2
  3. Schaefer, A., Kong, R., Gordon, E. M., Laumann, T. O., Zuo, X.-N., Holmes, A. J., Eickhoff, S. B., & Yeo, B. T. T. (2017). Local-Global Parcellation of the Human Cerebral Cortex from Intrinsic Functional Connectivity MRI. Cerebral Cortex, 1–20. 10.1093/cercor/bhx179
  4. Ciric, R., Wolf, D. H., Power, J. D., Roalf, D. R., Baum, G. L., Ruparel, K., Shinohara, R. T., Elliott, M. A., Eickhoff, S. B., Davatzikos, C., Gur, R. C., Gur, R. E., Bassett, D. S., & Satterthwaite, T. D. (2017). Benchmarking of participant-level confound regression strategies for the control of motion artifact in studies of functional connectivity. NeuroImage, 154(1), 174–187. 10.1016/j.neuroimage.2017.03.020
  5. Parkes, L., Fulcher, B., Yücel, M., & Fornito, A. (2018). An evaluation of the efficacy, reliability, and sensitivity of motion correction strategies for resting-state functional MRI. NeuroImage, 171, 415–436. 10.1016/j.neuroimage.2017.12.073
  6. Power, J. D., Schlaggar, B. L., & Petersen, S. E. (2015). Recent progress and outstanding issues in motion correction in resting state fMRI. NeuroImage, 105, 536–551. 10.1016/j.neuroimage.2014.10.044
  7. Power, J. D., Barnes, K. A., Snyder, A. Z., Schlaggar, B. L., & Petersen, S. E. (2012). Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion. NeuroImage, 59(3), 2142–2154. 10.1016/j.neuroimage.2011.10.018
  8. Satterthwaite, T. D., Wolf, D. H., Loughead, J., Ruparel, K., Elliott, M. A., Hakon, H., Gur, R. C., & Gur, R. E. (2012). Impact of In-Scanner Head Motion on Multiple Measures of Functional Connectivity: Relevance for Studies of Neurodevelopment in Youth. NeuroImage, 60(1), 623–632. 10.1016/j.neuroimage.2011.12.063