Abstract

The cognitive sciences, especially at the intersections with computer science, artificial intelligence, and neuroscience, propose 'reverse engineering' the mind or brain as a viable methodology. We show three important issues with this stance: 1) Reverse engineering proper is not a single method and follows a different path when uncovering an engineered substance versus a computer. 2) These two forms of reverse engineering are incompatible. We cannot safely reason from attempts to reverse engineer a substance to attempts to reverse engineer a computational system, and vice versa. Such flawed reasoning rears its head, for instance, when neurocognitive scientists reason about what artificial neural networks and brains have in common using correlations or structural similarity. 3) While neither type of reverse engineering can make sense of non-engineered entities, both are applied in incompatible and mix-and-matched ways in cognitive scientists' thinking about computational models of cognition. This results in treating mind as a substance; a methodological manoeuvre that is, in fact, incompatible with computationalism. We formalise how neurocognitive scientists reason (metatheoretical calculus) and show how this leads to serious errors. Finally, we discuss what this means for those who ascribe to computationalism, and those who do not.