I agree that it is a tool in the tool bag, but it is no doubt that it get used more and more and that the capability of it have sky rocked the last few months.
The article is from 10th of November last years so GPT was on 5 (5.1, 5.2 and 5.3 Codex have arrived after this) Claude Opus was on 4.1 and 4.5 and 4.6 have arrived after this.
It is really 3 months of night and day performance difference. It maybe sound a bit exaggerating but try google on the below term and look at any of the videos comparing the models with real code examples. The last 3-4 months have had an absolute crazy shift in AI Capability. google this if you are interested in the difference:
claude opus 4.1 vs 4.6
I read the referenced article. My takeaways were:
1. As of last fall, the LLM models used often failed to generate correct code even after as many as 100 test-and-adjust iterations.
2. The test runs were done using python coding. This means that their results are hard to apply to programs in C++ which we use for Teensy programming.
3. The goal of the testing was to measure energy efficiency.
As a retired developer writing code to provide illustrations, or to record data for personal use, I am more concerned with the dollar cost of using advanced AI coders. My annual budget for software is about $500---about equally split between Office 365(Word, Excel, CoPilot and cloud backup), and a MatLab Home license (analyze data from Teensys, graphing, and mapping). Can I afford claude opus 4.6?
My dream AI Coding project would look something like this:
"Given the attached TeensyDuino 1.60 source code and USB association specifications, generate a new set of USB libraries which add an API to allow the straightforward addition of new USB devices"
My first test cases would be:
1. The addition of a USB Test and Measurement Class device driver using the T4.1 USB host port. This would allow high-speed transfer of data from multiple Teensy boards to a host controller for storage.
2. A USB Video Class driver using bulk-mode data transfer for the FLIR BOSON thermal imaging camera.
3. A USB Video Class driver using Isochronous transfers for image capture from inexpensive USB cameras.
It took me about 6 months of part-time coding to get working results for tests 1 and 2. The structure of the existing USB libraries makes the addition of new device types very difficult and required me to edit and recompile the existing USB library source--after weeks of studying the reference manual register descriptions to figure out exactly what the core code was doing.
AFAIK, no one has released code to solve test #3.
I think it took about two years work by a group of talented part-time developers to get the MTP driver integrated into TeensyDuino. While MTP transfers are vital to many of my data collection programs, TeensyDuino still shows MTP as "experimental". I think the 'experiments' have produced enough data to show that the MTP code is stable and efficient and can be considered to be a device driver, and not an experiment!
I look forward to the time when the TeensyDuino USB Type menu is not a list of pre-selected driver combinations, but a menu that has check boxes for the drivers your project requires and allows the addition of new check boxes as new drivers become available.