My research interests include language modeling, self-supervision, sequetial modeling, and graph neural networks.