I focus on... multilayer perceptrons because these are... discussed when researchers consider the relation… — Gary Marcus

[S]ymbol-manipulation consists of three... hypotheses... [M]ind [1] represents abstract relationships between variables... [2] has a system of recursively structured representations... [3] distinguishes between mental representations of individuals and mental representations of kinds. ...[T]hese can stand or fall separately. Any given model... can be consistent with one subset of the... hypotheses... or all...

The problem is that... connectionism has become synonymous with... back-propogation. ...[T]hat... type of network... occupies... a small corner in the... space of possible network models. ...[A]dequate models of most likely lie in a less explored part of the space...

I am not an anti-connectionist; I am opposed only to a... subset of possible connectionist models.