Even if you have something, you can't give it to yourself, you already have it. So I wouldn't worry about it. If you are using a toy, then of course you're going to wash it after, you wouldn't stick it in your ass, suck on it, and then put it away. Unless you are doing that, or not bathing for days on end, then I believe you would be fine.
I have yet to be ill from ass to mouth, and I don't do a thorough internal cleaning.
From what I have read it is safe.
lol, I brush my teeth a lot after, and use a lot of mouth wash.
FYI on the mouthwash, it will get rid of any yuckky aftertaste, but it won't kill any bacteria.