Are Deep Neural Nets Graphical Models?
In the talk, here at NIPS, they say that:
GANs and VAEs are Graphical Models, just with a particular CPD and cost function. They are bipartite complete graphs.
How can that be explained? I thought that you need probabilities enmeshed in the models, with variables having dependence relationships. In neural nets, they have all sorts of other things like ReLu nodes etc. i.e there are no probability relationships just a series of non linearities alongwith with priors such as regularization or convnet structure.
This seems to be very different view than that is explained at What's the relation between hierarchical models, neural networks, graphical models, bayesian networks? .
