adjacent video of task?

[koudyk]

Hi François,

This would be an amazing tool for data exploration! I was thinking that it might be useful in some cases to have an adjacent video showing what the participant was experiencing in the scanner. For example, if you use data from a movie-watching task, you could play the movie next to the 4D brain. But I don't have a good notion of how feasible this is, since I wouldn't know how to do it.

I'm excited to see the final product!

[FrancoisPgm]

That is a very good idea ! However that requires to have the start of the 4D fMRI data be synchronized with the video, or an indication of when the stimuli started. I don't know if there already is a possibility to add this information in the metadata of a nifty object. If not, maybe taking advantage of the BIDS format could make it easy to retreive this information.

In any case I will look into it, thank you for the suggestion.

[koudyk]

That's a good point, I'm sure it's a lot more complicated than it sounds. Well if you end up wanting to try it, @emdupre might know of some datasets with naturalistic stimuli with good timing data for syncing the stimuli and brain data.
Cheers

[emdupre]

I love the idea of linked viewers ! In case it's useful: stimuli onset times are required in BIDS, so if you're working with BIDS-formatted data that information should be in the associated _events.tsv file.

[FrancoisPgm]

Thanks @emdupre for the info. I'll definitely try to do something with the stimuli if I manage to finish the data visualizer before the end.