Is it right to basically juxtapose #deepNetworks against #knowledgeBasedReasoning ?
Eg. Hopfield nets versus case based reasoning.
Where deep networks generally simulate parts of biological mechanisms, often on very fast/hungry hardware very quickly, often involving Hidden Layers for what's-actually-being-done.
Whereas in knowledge based reasoning, high level descriptions of the world are being reasoned about eg as cases, (+ situation calculus say). Decision trees.