One thing to note is depending on the distribution, the Arduino release provided by the distribution may be too far out of date or it may contain distribution specific patches that might be incompatible with the Teensy layer.
It is generally a good idea not to use the distribution Arduino package that you get with apt-get, yum, dnf, etc. Instead, go to
https://www.arduino.cc/en/Main/Software and download the official Linux distribution for Arduino that Teensy is compatible with (currently 1.6.5). Generally, these days, you want the 64-bit version, as some distributions no longer ship many/all of the 32-bit libraries (*). As the directions specify in the pjrc.com link, you need to change the executable status of the software you download, before you can update the Arduino files to include Teensy support.
I tend to create a new directory to hold each revision of the Teensy software, and install new Arduino software in it. This way, I can easily fall back to a previous version if there are problems. This is more of a belt & suspenders approach to new software, as I don't recall ever going back to a previous full release (once or twice during the beta cycle, something doesn't work right, and I might fall back to the previous full release).
(*) Unless of course you are using a 32-bit only distribution.