Who are the prisoners in Azkaban?

It's obvious that Pettigrew was the person repeating "I'm not serious" (actually "I'm not Sirius"), but do we have any guesses who the other people we heard are?