OpenID log-out is a complete mess in general. This is just one symptom of that.
Basically, to fully log out, you need to:
log out from your OpenID provider (here, Google, but the same applies even if you log in through Stack Exchange);
clear your Stack Exchange global log-in credentials, and
finally, log out from each individual Stack Exchange site you've logged in to.
If you don't do all of these things, it's likely that valid log-in credentials will remain in your browser, making it trivial for anyone else using the same browser to log back in to your account.
One alternative solution is to always use Private Browsing / Incognito mode (Ctrl+Shift+P in Firefox, Ctrl+Shift+N in Chrome) when logging in to Stack Exchange from a shared computer. That way, any login credentials will automatically be cleared when you close the browser window.
Of course, this won't help if you've already logged in using a normal browser session, but in that case, you may be able to log yourself out by clearing all cookies and local storage from your browser. (It's still best to manually log out from your OpenID provider and SE first, since that will also invalidate your credentials on the server, but clearing cookies and local storage is a good way to sweep out any login credentials you might have otherwise missed.)