Here's ST7735 on an raspberry pi:
http://youtu.be/elHCGuDMlkg?t=1m32s
As you can see, the ST7735 is capable of some good frame rates. If using a teensy 3.1, and creating a 40KB frame buffer, any chance we could do a DMA SPI transfer to dump the 40KB frame for some incredible frame rates?