No, you are not notified of comment upvotes and there is no setting to change this.
You are not notified of comment deletions either (if they are deleted as a result of a flag), for example.
Comments are second-class citizens in the site, and it'stheir main purpose is to ask for clarification or to add more information to an existing post; and enabling additional notifications for them would be too noisy and distract from the primary feature of the site: questions and answers.
The only comment-related notifications are comment replies.