So we're already doing 'fundamentally functional' operations? That's an interesting way to look at it, but it's still driven from an imperative language. The grandparent post talked about functional programming in a functional programming language on a GPU.
Is Theano a step in this direction? ( http://deeplearning.net/software/theano/ )