Download queue priority?

When downloading a bulk of like files, is it faster to prioritize the biggest ones first, smaller last? Or is it faster to queue smallest to largest? Or does it even matter?