Thanks everyone for all the kind words and feedback. Super happy that you are enjoying Build a Reasoning Model (From Scratch)!
Unfortunately, there's small typo in listing 6.5 on page 198 (see video below).
The line "torch.manual_seed(0)"
should be "torch.manual_seed(5)"
This correction is needed to reproduce the generated response in listing 6.5 and the corresponding log-probability outputs later in Chapter 6. If you use 0, the generated response and the results that follow will be different.
This will be fixed in the next printing. I am sorry about the oversight, and I hope this note saves you some debugging time.
顯示更多