Yeah, I was specifically wondering what the probe sees (which might not be easy to tell) rather than what you see on the page,
but your description of the behavior before you enabled the retries probably answers my question. I thought we might need to make sure the "bad string" did not show up in an unexpected place even when everything is okay, but if the probe worked properly without the retries, it must be seeing the right thing.
I find it odd that the log message is "Set for Redirect Retry", which would indicate the retry is the result of a redirect. But if the redirects were the problem, you should see an issue even without retries. It might just be a bad log message.
The configuration option seems to be pretty explicit that the probe should only retry when there is an alarm condition, which would be exactly what you want. Retrying when everything is okay does not make any sense, so it seems like there must either be a bug or something that looks wrong to the probe but is not obvious. Maybe I can setup a test URL and check if I am able to reproduce the problem.