Wow, look at what I found this morning!
If I can figure out more about the indicator's new behavior, I'll update this answer, but for now, it looks like it's working.
Followup: As of my next login (~8 hours after this answer was originally posted), I found no indicator on the review icon, but one pending review task. Perhaps this morning's success was due to the fact that there were several pending review tasks?