Nick Levine
@status_effects
training vintage language models
1.3K Following 3.8K Followers
@TheStalwart I wonder what is implicit in the shift from “memorabilia” to “collectibles”.
New work with @AlecRad and @DavidDuvenaud:
Have you ever dreamed of talking to someone from the past? Introducing talkie, a 13B model trained only on pre-1931 text.
Vintage models should help us to understand how LMs generalize (e.g., can we teach talkie to code?). Thread:
Show more
