You can log out of Stack Overflow via the drop-down under the Stack Exchange logo menu to the right:
This applies just to the site your are active on. You really want to log out from the OpenID provider, too, as anyone can now use your computer to log back in to Stack Overflow, often without being challenged to re-enter credentials. How you do that depends on what provider you are using.
If your OpenID provider is Stack Exchange, then visit https://openid.stackexchange.com and click on the logout link there too:
For Google, Yahoo, Facebook, etc. you'll have to visit their sites and find the log-out option there.
You can find what OpenID providers are authorised by clicking on the my logins link under the Edit Profile & Settings tab in your profile: