Please use this identifier to cite or link to this item:
http://bura.brunel.ac.uk/handle/2438/23210
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kalganova, T | - |
dc.contributor.author | Byerly, A | - |
dc.contributor.author | Dear, I | - |
dc.date.accessioned | 2021-09-13T09:26:25Z | - |
dc.date.available | 2021-09-13T09:26:25Z | - |
dc.date.issued | 2021-08-19 | - |
dc.identifier.citation | Byerly, A., Kalganova, T. and Dear, I. (2021) 'No routing needed between capsules', Neurocomputing, 463, pp. 545-553. doi: 10.1016/j.neucom.2021.08.064. | en_US |
dc.identifier.issn | 0925-2312 | - |
dc.identifier.uri | https://bura.brunel.ac.uk/handle/2438/23210 | - |
dc.description.abstract | Copyright © 2021 The Authors. Most capsule network designs rely on traditional matrix multiplication between capsule layers and computationally expensive routing mechanisms to deal with the capsule dimensional entanglement that the matrix multiplication introduces. By using Homogeneous Vector Capsules (HVCs), which use element-wise multiplication rather than matrix multiplication, the dimensions of the capsules remain unentangled. In this work, we study HVCs as applied to the highly structured MNIST dataset in order to produce a direct comparison to the capsule research direction of Geoffrey Hinton, et al. In our study, we show that a simple convolutional neural network using HVCs performs as well as the prior best performing capsule network on MNIST using 5.5× fewer parameters, 4× fewer training epochs, no reconstruction sub-network, and requiring no routing mechanism. The addition of multiple classification branches to the network establishes a new state of the art for the MNIST dataset with an accuracy of 99.87% for an ensemble of these models, as well as establishing a new state of the art for a single model (99.83% accurate). | en_US |
dc.format.extent | 545 - 553 | - |
dc.format.medium | Print-Electronic | - |
dc.language.iso | en | en_US |
dc.publisher | Elsevier | en_US |
dc.rights | Copyright © 2021 The Authors. This is an open access article under the CC BY license | - |
dc.rights.uri | https://creativecommons.org/licenses/by/4.0/ | - |
dc.subject | capsules | en_US |
dc.subject | convolutional Neural Network (CNN) | en_US |
dc.subject | homogeneous Vector Capsules (HVCs) | en_US |
dc.subject | MNIST | en_US |
dc.title | no Routing Needed Between Capsules | en_US |
dc.type | Article | en_US |
dc.identifier.doi | https://doi.org/10.1016/j.neucom.2021.08.064 | - |
dc.relation.isPartOf | Neurcomputing | - |
pubs.publication-status | Published | - |
pubs.volume | 463 | - |
dc.identifier.eissn | 1872-8286 | - |
Appears in Collections: | Dept of Electronic and Electrical Engineering Research Papers |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
FullText.pdf | 1.68 MB | Adobe PDF | View/Open |
This item is licensed under a Creative Commons License