You can't really appeal an audit failure: you can post it here with the discussion and disputed-review-audits tags and ask for community input on a particular audit. Add details about why you think the post shouldn't be used as an audit and why you think that your review was justified. We'll discuss it and provide our opinions on whether the audit is appropriate.
As these audits are automatically selected, you're going to run into a few edge cases that may seem like they could go either way. If you think that an audit that requires a negative action is okay, then go to the original post (if it still exists) and upvote it. If an audit that requires a positive action seems poor to you, go to the original and downvote it. That is, take a counteraction to ensure that the audit is no longer used.
Audits are often subjective, but I think that, in this case, the audit was justified. You should have been on alert the second you saw the first sentence:
I just ran into the same issue while going through the same book.
Questions that start like that almost always end in another question; if the "answer" does not answer the question, it should be flagged as "Not an answer."
I get it: you were probably floating along through the queue and a large block of text that doesn't immediately appear to be spam probably seems like it's okay (especially since most late answers from new users are one-line and link-only). It happens to all of us, but in this case, the audit did its job: you likely weren't paying attention, and that can be dangerous in these queues because they're meant to help new users learn how to use the site.
I'd recommend taking a look at this post that I wrote for new reviewers to get an idea of what you should look out for in the First Posts and Late Answers queues.