All Relations between representation and cross-modal perception

Publication Sentence Publish Date Extraction Date Species
Timothy J Tyree, Michael Metke, Cory T Mille. Cross-modal representation of identity in the primate hippocampus. Science (New York, N.Y.). vol 382. issue 6669. 2023-10-26. PMID:37883535. cross-modal representation of identity in the primate hippocampus. 2023-10-26 2023-11-08 marmoset
Timothy J Tyree, Michael Metke, Cory T Mille. Cross-modal representation of identity in the primate hippocampus. Science (New York, N.Y.). vol 382. issue 6669. 2023-10-26. PMID:37883535. yet, it is not known how these signals are integrated into a cross-modal representation of individual identity in the primate brain. 2023-10-26 2023-11-08 marmoset
Yanwu Yang, Chenfei Ye, Xutao Guo, Tao Wu, Yang Xiang, Ting M. Mapping Multi-modal Brain Connectome for Brain Disorder Diagnosis via Cross-modal Mutual Learning. IEEE transactions on medical imaging. vol PP. 2023-07-13. PMID:37440391. additionally, we investigate mutual learning in explicit and implicit ways: (1) cross-modal representations are obtained by cross-embedding explicitly based on the inter-modal correspondence matrix. 2023-07-13 2023-08-14 Not clear
Shuo Huang, Liang Sun, Muhammad Yousefnezhad, Meiling Wang, Daoqiang Zhan. Functional Alignment-Auxiliary Generative Adversarial Network-based Visual Stimuli Reconstruction via Multi-subject fMRI. IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society. vol PP. 2023-06-06. PMID:37279132. our proposed faa-gan includes three key components: 1) a generative adversarial network (gan) module for reconstructing visual stimuli, which consists of a visual image encoder as the generator that uses a nonlinear network to convert stimuli images into an implicit representation and a discriminator that generates the images comparable to the original images in detail; 2) a multi-subject functional alignment module, which is used to precisely align the individual fmri response space of each subject in a common space to reduce the heterogeneity among different subjects; and 3) a cross-modal hashing retrieval module used for similarity retrieval of two modalities of data, i.e., the visual images and the evoked brain responses. 2023-06-06 2023-08-14 human
Liang Shi, Chuqi Liu, Xiaojing Peng, Yifei Cao, Daniel A Levy, Gui Xu. The neural representations underlying asymmetric cross-modal prediction of words. Human brain mapping. 2023-01-30. PMID:36715307. the neural representations underlying asymmetric cross-modal prediction of words. 2023-01-30 2023-08-14 Not clear
Edward H Silson, Andre D Gouws, Gordon E Legge, Antony B Morlan. In a case of longstanding low vision regions of visual cortex that respond to tactile stimulation of the finger with Braille characters are not causally involved in the discrimination of those same Braille characters. Cortex; a journal devoted to the study of the nervous system and behavior. vol 155. 2022-09-02. PMID:36054997. these data suggest that tactile responses in s's foveal representation reflect unmasking of latent connections between visual and somatosensory cortices and not behaviourally relevant cross-modal plasticity. 2022-09-02 2023-08-14 Not clear
Mareike Bayer, Oksana Berhe, Isabel Dziobek, Tom Johnston. Rapid Neural Representations of Personally Relevant Faces. Cerebral cortex (New York, N.Y. : 1991). vol 31. issue 10. 2021-09-15. PMID:33987643. combining eeg and fmri in cross-modal representational similarity analyses, we provide evidence that representations of personal relevance start prior to structural encoding at 100 ms, with correlated representations in visual cortex, but also in prefrontal and midline regions involved in value representation, and monitoring and recall of self-relevant information. 2021-09-15 2023-08-13 human
M Alex Meredith, John M Kay, Stephen G Lomber, H Ruth Clem. Early hearing loss induces plasticity within extra-striate visual cortex. The European journal of neuroscience. vol 53. issue 6. 2021-06-29. PMID:33387377. whereas hearing loss results in crossmodal plasticity in auditory cortices, the same peripheral lesion can also induce intramodal plasticity within representations of the intact sensory systems that may also contribute to supranormal performance. 2021-06-29 2023-08-13 Not clear
Jin Gu, Baolin Liu, Xianglin Li, Peiyuan Wang, Bin Wan. Cross-modal representations in early visual and auditory cortices revealed by multi-voxel pattern analysis. Brain imaging and behavior. vol 14. issue 5. 2021-04-13. PMID:31183774. even though the cross-modal representation is robust when considering the restriction of top-down expectations and mental imagery in our experiments, the sound experience showed effects on cross-modal representation in v2 and v3. 2021-04-13 2023-08-13 human
Lora T Likov. Addressing long-standing controversies in conceptual knowledge representation in the temporal pole: A cross-modal paradigm. IS&T International Symposium on Electronic Imaging. vol 2017. 2020-09-30. PMID:31423471. addressing long-standing controversies in conceptual knowledge representation in the temporal pole: a cross-modal paradigm. 2020-09-30 2023-08-13 human
A W de Borst, B de Gelde. Mental Imagery Follows Similar Cortical Reorganization as Perception: Intra-Modal and Cross-Modal Plasticity in Congenitally Blind. Cerebral cortex (New York, N.Y. : 1991). vol 29. issue 7. 2020-09-28. PMID:30060011. we did find evidence of cross-modal activation of higher visual areas in blind participants, including the representation of specific-imagined auditory features in visual area v4. 2020-09-28 2023-08-13 human
Angélique Volfart, Jacques Jonas, Louis Maillard, Sophie Colnat-Coulbois, Bruno Rossio. Neurophysiological evidence for crossmodal (face-name) person-identity representation in the human left ventral temporal cortex. PLoS biology. vol 18. issue 4. 2020-07-27. PMID:32243450. neurophysiological evidence for crossmodal (face-name) person-identity representation in the human left ventral temporal cortex. 2020-07-27 2023-08-13 human
Xin Huang, Yuxin Peng, Mingkuan Yua. MHTN: Modal-Adversarial Hybrid Transfer Network for Cross-Modal Retrieval. IEEE transactions on cybernetics. vol 50. issue 3. 2020-02-20. PMID:30530383. first, a modal-sharing knowledge transfer subnetwork is proposed to jointly transfer knowledge from a single modality in the source domain to all modalities in the target domain with a star network structure, which distills modal-independent supplementary knowledge for promoting cross-modal common representation learning. 2020-02-20 2023-08-13 Not clear
Cathleen Cortis Mack, Kevin Dent, Geoff War. Near-independent capacities and highly constrained output orders in the simultaneous free recall of auditory-verbal and visuo-spatial stimuli. Journal of experimental psychology. Learning, memory, and cognition. vol 44. issue 1. 2019-05-08. PMID:28758775. we propose that both auditory-verbal and visuospatial list items are associated with a common temporal episodic context that is used to guide cross-modal retrieval, and we speculate that the limited, asymmetric interference could arise because the less variable representations of the dots share only a relatively small subset of features with the more variable representations of the words. 2019-05-08 2023-08-13 human
Ali Farshchian, Alessandra Sciutti, Assaf Pressman, Ilana Nisky, Ferdinando A Mussa-Ivald. Energy exchanges at contact events guide sensorimotor integration. eLife. vol 7. 2019-05-03. PMID:29809144. we used a visuomotor delay to induce cross-modal variations in state feedback and uncovered that the difference between visual and proprioceptive velocity estimations at isolated collision events was compensated by a change in the representation of arm inertia. 2019-05-03 2023-08-13 Not clear
Prosper Agbesi Fiave, Saloni Sharma, Jan Jastorff, Koen Nelisse. Investigating common coding of observed and executed actions in the monkey brain using cross-modal multi-variate fMRI classification. NeuroImage. vol 178. 2019-02-13. PMID:29787867. these results validate the use of cross-modal multi-variate fmri analyses to probe the representations of own and others' actions in the primate brain and support the proposed mapping of others' actions onto the observer's own motor cortices. 2019-02-13 2023-08-13 human
Björn Zierul, Brigitte Röder, Claus Tempelmann, Patrick Bruns, Toemme Noessel. The role of auditory cortex in the spatial ventriloquism aftereffect. NeuroImage. vol 162. 2018-07-25. PMID:28889003. together, the fmri results suggest that cross-modal spatial recalibration is accomplished by an adjustment of unisensory representations in low-level auditory cortex. 2018-07-25 2023-08-13 human
Jennifer K Bizley, Gareth P Jones, Stephen M Tow. Where are multisensory signals combined for perceptual decision-making? Current opinion in neurobiology. vol 40. 2018-02-26. PMID:27344253. it is unclear whether multisensory representations in sensory cortex directly inform decision-making in a multisensory task, or if cross-modal signals are only combined after the accumulation of unisensory evidence at a final decision-making stage in higher cortical areas. 2018-02-26 2023-08-13 Not clear
Yunchao Wei, Yao Zhao, Canyi Lu, Shikui Wei, Luoqi Liu, Zhenfeng Zhu, Shuicheng Ya. Cross-Modal Retrieval With CNN Visual Features: A New Baseline. IEEE transactions on cybernetics. vol 47. issue 2. 2018-01-26. PMID:27046859. specifically, off-the-shelf cnn visual features are extracted from the cnn model, which is pretrained on imagenet with more than one million images from 1000 object categories, as a generic image representation to tackle cross-modal retrieval. 2018-01-26 2023-08-13 Not clear
Prasandhya Astagiri Yusuf, Peter Hubka, Jochen Tillein, Andrej Kra. Induced cortical responses require developmental sensory experience. Brain : a journal of neurology. vol 140. issue 12. 2017-12-13. PMID:29155975. we evaluated time-frequency representations of local field potential recorded simultaneously in the primary auditory cortex and a higher-order area, the posterior auditory field, known to be differentially involved in cross-modal (visual) reorganization in deaf cats. 2017-12-13 2023-08-13 cat