It turns out that no, you can't. But if you log in the same way, it'll associate the accounts together. Since I didn't know how I was logged in, to find out:
1) I selected "Log in using Stack Exchange" and "forgot my password" and entered my email address.
2) It sent me an email telling me that I don't have an account with that address but that I do have one using Google login.
3) Then I went back to the login page and logged in using Google login, and it created an account and associated it with my Stack Overflow account.