Please use this identifier to cite or link to this item:
http://bura.brunel.ac.uk/handle/2438/29857
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Ji, X | - |
dc.contributor.author | Dong, Z | - |
dc.contributor.author | Zhou, G | - |
dc.contributor.author | Lai, CS | - |
dc.contributor.author | Qi, D | - |
dc.date.accessioned | 2024-10-01T09:32:18Z | - |
dc.date.available | 2024-10-01T09:32:18Z | - |
dc.date.issued | 2024-05-10 | - |
dc.identifier | ORCiD: Xiaoyue Ji https://orcid.org/0000-0002-3526-5215 | - |
dc.identifier | ORCiD: Zhekang Dong https://orcid.org/0000-0003-4639-3834 | - |
dc.identifier | ORCiD: Guangdong Zhou https://orcid.org/0000-0002-5824-9488 | - |
dc.identifier | ORCiD: Chun Sing Lai https://orcid.org/0000-0002-4169-4438 | - |
dc.identifier | ORCiD: Donglian Qi https://orcid.org/0000-0002-6535-2221 | - |
dc.identifier.citation | Ji, X. et al. (2024) 'MLG-NCS: Multimodal Local-Global Neuromorphic Computing System for Affective Video Content Analysis', IEEE Transactions on Systems, Man, and Cybernetics: Systems, 54 (8), pp. 5137 - 5149. doi: 10.1109/TSMC.2024.3392732. | en_US |
dc.identifier.issn | 2168-2216 | - |
dc.identifier.uri | https://bura.brunel.ac.uk/handle/2438/29857 | - |
dc.description.abstract | Despite neuromorphic computing (NC) technologies offer tremendous potential in executing computationally intensive tasks with high efficiency and low latency, most of existing methods are still difficult to achieve software-comparable accuracy. To address this challenge, we develop a multimodal local-global NC system (MLG-NCS) that can capture local characteristics and exchange global cross-modal information sufficiently. Specifically, a high-density memristor crossbar array is prepared to perform efficient parallel in-memory operations, serving as the fundamental component of the proposed MLG-NCS. To facilitate understanding of the proposed MLG-NCS design, the local feature representation module, the global cross-modal interaction module, and the output module are designed. The experimental results show that the proposed system has advantages in classification accuracy (ranked top three), time consumption (approximately ten times speed up), and latency (about 1.2–15.3 times faster), enabling good inter-related tradeoffs between latency, efficiency, and accuracy. This study is expected to promote the revolution and development of next-generation computing system, which takes a firm step toward artificial general intelligence (AGI). | en_US |
dc.description.sponsorship | National Postdoctoral Researcher Support Program (Grant Number: GZB20230356); Shuimu Tsinghua Scholar Program (Grant Number: 2023SM035); 10.13039/501100001809-National Natural Science Foundation of China (Grant Number: 62206062); Fundamental Research Funds for the Provincial University of Zhejiang (Grant Number: GK229909299001-06). | en_US |
dc.format.extent | 5137 - 5149 | - |
dc.format.medium | Print-Electronic | - |
dc.language | English | - |
dc.language.iso | en_US | en_US |
dc.publisher | Institute of Electrical and Electronics Engineers (IEEE) | en_US |
dc.rights | Copyright © 2024 Institute of Electrical and Electronics Engineers (IEEE). Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works (see: https://journals.ieeeauthorcenter.ieee.org/become-an-ieee-journal-author/publishing-ethics/guidelines-and-policies/post-publication-policies/). | - |
dc.rights.uri | https://journals.ieeeauthorcenter.ieee.org/become-an-ieee-journal-author/publishing-ethics/guidelines-and-policies/post-publication-policies/ | - |
dc.subject | affective video content analysis | en_US |
dc.subject | circuit design | en_US |
dc.subject | multimodal learning | en_US |
dc.subject | neuromorphic computing system (NCS) | en_US |
dc.title | MLG-NCS: Multimodal Local-Global Neuromorphic Computing System for Affective Video Content Analysis | en_US |
dc.type | Article | en_US |
dc.date.dateAccepted | 2024-04-15 | - |
dc.identifier.doi | https://doi.org/10.1109/TSMC.2024.3392732 | - |
dc.relation.isPartOf | IEEE Transactions on Systems, Man, and Cybernetics: Systems | - |
pubs.issue | 8 | - |
pubs.publication-status | Published | - |
pubs.volume | 54 | - |
dc.identifier.eissn | 2168-2232 | - |
dc.rights.holder | Institute of Electrical and Electronics Engineers (IEEE) | - |
Appears in Collections: | Dept of Electronic and Electrical Engineering Research Papers |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
FullText.pdf | Copyright © 2024 Institute of Electrical and Electronics Engineers (IEEE). Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works (see: https://journals.ieeeauthorcenter.ieee.org/become-an-ieee-journal-author/publishing-ethics/guidelines-and-policies/post-publication-policies/). | 1.28 MB | Adobe PDF | View/Open |
Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.