When you dismiss a Job Ad, it only affects whether you see that ad or not in the future. It doesn't affect any other system. The job should still show up in job searches and recommendations.
This is no longer correct. Now our job ad dismissals are synced with the dismiss feature on Stack Overflow Jobs. This means if you dismiss a job ad, it should not show up in any job searches or recommendations.
Currently there's no way to un-dismiss jobs from ads except for the "Undo" button that shows up immediately after dismissal:
Eventually we want to allow you guys to be able to see which ads you've dismissed and be able to un-dismiss them as you wish, but it's currently low priority. Our reasoning is that most users will dismiss a job ad because it's not relevant to their skills, location, salary range, etc..., and those things don't change very frequently (considering the standard job ad runs for 30 days).
If you accidentally dismiss a job, you can search for it on Stack Overflow Jobs in an Incognito/Private window (or otherwise log out), and then undismiss it from the job detail page (the same goes for Companies).