Some notes that C. Lee Giles had about LLMs:
* there's actually a lot of nice open source LLMs that can be tuned
* do transformers really known (understand) what we are asking or wanting?
* prompts are very important
* problems answering simple math questions
* using LLMs to write scholarly works should require expert review
* LLMs cannot read PDFs