Harry Potter and the Prisoner of Azkaban feels different because it lets Hogwarts become autumnal, strange, and slightly dangerous.
The Dementors, the rain, the Marauder’s Map, Buckbeak, Hogsmeade, and Lupin’s classroom all give the story a colder, more grown-up feeling.
It is the film where the series stops feeling like childhood and starts feeling like memory.