Principles and applications of relational inductive biases in deep learning

Kelsey Allen, MIT Common intuition posits that deep learning has succeeded because of its ability to assume very little structure in the data it receives, instead learning that structure from large numbers of training examples. However, recent work has attempted to bring structure back into deep learning, via a new set of models known as “graph networks“. Graph networks allow for “relational inductive biases“ to be introduced into learning, ie. explicit reasoning about relationships between entities. In th