I am against such a measure, for multiple reasons, listed here in no particular order.
1. We shouldn't forbid users to do what they want to do.
OK, in some cases we should. That's why we delete rude comments or poll questions. But we need a really good reason for it. A "this is really harmful for you and the others" reason, not a "this is mildly irritating to some of the regular users" reason. Instead of micromanaging them, we can let them do it their way.
The natural reaction of a person told "don't do this" is a Jake-Shepherd-esque "Don't tell me what I can't do!". Or, sometimes, a "I'm so sorry I did something bad, please don't punish me". It forces the user to cope with an unpleasant emotion, and should be restricted to a minimum.
2. It would seem arbitrary to outsiders.
Stack Exchange is somewhat polarizing to netizens. Many people who encounter us for the first time are very unhappy with the existing strict system of rules, which seem completely arbitrary from their point of view. Lots of them decide that we are a bunch of loonies and don't stay around.
If we want to actually be open to others, and appear welcoming instead of running newbies through a maze of weird rules, we should minimize the prohibitions we place on their behavior. This is one prohibition we can easily live without.
3. It has its uses even when it appears like noise.
Sometimes, an upvote just isn't enough to express what a user is feeling. In this case, he is likely to add an emphasizing "+1 for pointing out the gotcha with integers". This is not noise, it is a way to 1) call attention to the fact that this answer seems to be unusually good, better than the average answer (which deserves an upvote only) and 2) to underline some very important point mentioned in the answer which newbies may glance over, especially in a detailed, long answer.
Sometimes it is also used in a more subtle manner. Imagine somebody seeing a question about "how to do [complicated calculation] in Excel", answering, and adding "but you are probably better off using R instead" and wondering if he is coming across as a pretentious prick. A quick "+1 for suggesting R", gathering upvotes itself, shows him that the advice is appreciated, in a way which a simple upvote wouldn't express.
4. It is part of Stack Exchange culture
I know all the arguments about being reserved, professional, and concentrate on creating good content, not building a social network. But we cannot escape the fact that we are a community, and as any community, we build our own set of shared behavioral patterns, in-jokes and memes. They help users feel part of the community and create an emotional bond, increasing their participation and their satisfaction.
The "+1/-1" comments are such a meme, sometimes also used as an in-joke. They are lightweight enough to not create too much friction, more easily adopted by new users than cryptic ones like "boat programming", but also typical enough to give the users a warm and fuzzy feeling of belonging. They are part of the social glue which holds us together and gives us a community identity.
5. They are a very good way to explain up- and downvotes.
Don't get me wrong, I'm not for mandatory vote explanation, mainly because votes (especially downvotes) are very useful even when not explained. But an explanation adds value to a vote, be it because the post author gets feedback which helps him improve, or because he knows when to ignore downvotes which are, in his eyes, not justified. And prefacing an explanation with "+1" or "-1" is a very succinct and unambiguous way to label the comment as a vote explanation.
Even if we think "but users can still write an explanation without prefacing it", users are tricky creatures who are likely to extrapolate rules where none exist, especially on a site where their first experience probably involved breaking rules of whose existence they had no idea. If we tell them "don't leave +1/-1 comments", many of them are likely to read into it "stop leaving vote explanation comments of any kind".
6. The users are already accustomed to them.
Taking stuff away from users is very unpleasant to them. Even when it is inferior stuff and we are giving them a better alternative. We should have a very good reason to take something away. For me, the "it's noise" argument is not strong enough.
7. We don't have sufficient evidence that they cause drama
I've heard the argument that, if a user is high strung, a "-1" comment can send him overboard and create drama. I agree that we don't need additional drama. But in my experience, if a user is really high strung, he can go off by lots of stuff, including getting a big red label in his face telling him "you cannot do what you want" (like leaving a +1 comment to somebody else). Or by seeing his question getting a downvote, without anybody explaining the downvote. Or by reading somebody's criticism on his post, without it being prefaced with a -1.
8. For completeness: it is trivially easy to circumvent the filter
There are many other answers explaining that one better, and I don't think it's as important as the other arguments, but here it is.
9. I don't see them causing a need for action
If the moderators on some site are busy deleting three "+1" comments per answer, then something should be done about such a flood, be it Shog's suggestion or something else. But I am not aware of such a problem. I see the comments pop up now and then, not enough to call it an epidemic.
To use a cooking metaphor, they are like vinegar. If there were drowning other content, that would be bad. A light sprinkling of them, used at strategic places - and this is what I have seen - spices up the site.
-1, that's awesome
.+1, did you read the question?
...