Piles

Alex Reisner’s writing in the Atlantic is some of the best investigative coverage of Large Language Models out there. In this episode, we talk through the mind-bogglingly vast archives of random pirated material that provide every major commercial LLMs with their linguistic faculty. Definitely check out his writing, especially the phenomenal January 11 piece on “memorization.”