On: The FFT Strikes Back: An Efficient Alternative to Self-Attention

[evanb]

Now you’re talking efficiency—-certainly a wavelet transform may also work. But wavelets tend to be more localized than FTs.