From 2008, Stoyan Stefanov looks at the stats on how progressive JPEG files stack up size-wise compared to baseline JPEGs. Short summary: baseline tends to win under 10k in file size, progressive tends to win in larger files. Interesting. (via email from David Magda)
Linked by James Duncan Davidson.