Bringing Back MLPs Permalink
It’s no news that transformers have dominated the field of deep learning ever since 2017. But in their recent work, titled ‘Pay Attention to MLPs,’ Hanxiao L...
Hi there, My name is Saurav.
I am a Computer Science student at the University of Manchester interested in Geometric Learning and Self Supervised Learning.
Recent Posts
Fourier Transform in Neural Networks ??!! Permalink
Continuing on the recent series of reports analyzing newly proposed pure MLP based architectures. In this report I breakdown “FNet Mixing Tokens with Fourier...