I can't speak for the UI designers and their decisions, but I think that it's because the topbar menu points (the other clutter like questions, tags, users) are in the same bar as the search on SO.

On other SE sites with the new topbar, the other clutter is on a seperate bar underneath, so it's smaller on SO I suppose. 

I suppose they got complaints that the searchbar is too small for some users (like high reputation users) and did this to address that concern.