Teensy is a line if 32 bit microcontrollers in a standard bread board friendly form factor that can be programed many way, Arduino is a loose package of programing tools and libraries that can be used to write and program code for many micro controllers.
PJRC provides an add-on for the generic arduino install to allow arduino written code to be loaded to Teensys including the special loader program and a bunch of other quality of life things.
https://www.pjrc.com/teensy/td_download.html
You don't have to program a Teensy from Arduino, though it is generally easier to install and use the provided tool chain and then break one part of the chain at a time to get where you want to go and there are various pre built solutions for eclipse, visual studio , notepad++ along with various higher end IDEs.
To answer what I think you were originally asking, a Teensy LC out of the box does nothing but flash a LED. It can be programed to read an analog value and send it to the serial port very easily, and in fact there is an example built into Arduino that does just that.
https://www.arduino.cc/en/Tutorial/ReadAnalogVoltage
So you could take that code, tweak the write functions to match your PC side code and move on but yes you would need to write some Arduino code to do this (and install Arduino on at least one PC to program from), it's not prebuilt or configurable from a PC interface like a true data collection system would be.
Drivers wise on current windows versions a Teensy programed to be a serial device (which does need to be selected from the menu) will show up as a generic serial port like any other.
Edit: should also be pointed out that if you just want to read one value at a low rate and send it out the USB serial port pretty much any Ardunio will be capable of the job, with the really low cost options being a couple of dollars. At that price point your actual programing and build experience will be much rougher than buying an LC or OEM Arduino but it certainly could be done.