I came across this interesting tidbit while reading one of Numenta’s papers on their HTM approach.
The No-Free-Lunch Theorem: “no learning algorithm has an inherent advantage over another learning algorithm for all classes of problems. What matters is the set of assumptions an algorithm exploits in order to learn the world it is trying to model.”
Or, as Robert Heinlein put it a while back, TANSTAAFL. There Ain’t No Such Thing As A Free Lunch.