Abstract: In many applications, such as brain network connectivity or shopping recommendations, the underlying graph explaining the different interactions between participating agents is unknown.

While pre-training has transformed many fields in deep learning tremendously, its application to three-dimensional crystal structures and materials science remains limited and under-explored. In ...