I mean, does an average passenger really know this? How can they know, for example, that the Crosstown tracks aren't connected to the IRT or BMT systems in downtown Brooklyn (which may be perceived as being possible for the rerouted to use), or that they aren't even connected to Jay St-MetroTech so that the rerouted train can't be heading towards York St and back to Manhattan? (On the Queens side, they may also not know whether it's possible for the to make a turn from Queens Plaza to 21 St-Queensbridge, or whether the only destination possible is Jamaica-179, but that's less relevant since a would terminate at Court Sq anyway.)
Coming back to the example at Times Sq, if they're unfamiliar with the system and such reroutes, someone going to Clark St can legitimately believe that the rerouted train will switch back to the after Fulton St, via an imaginary track connection that doesn't actually exist (but they don't know that). Somebody going to Grand Army Plaza may believe the train will switch back to Eastern Pkwy Express at Atlantic-Barclays, where a switch to do so actually exists.
We know that even a lot of railfans making deinterlining proposals make mistakes about which track connections exist and which do not, and people commenting on them can make the same mistakes. With some proposals swapping the 8th Av/6th Av locals past W4, which is enabled by the track layout, some comments shut them down because they wrongly thought you can't do so without introducing more interlining. Some proposals forget that CPW can only feed into 6th Av express but not local, or that SAS only feeds into Broadway express but not local, while others forget tracks that can go into either local or express (e.g. 63rd to 6th, 53rd to 8th). If even railfans don't have perfect knowledge of where it's physically possible for trains to go, how can you expect that from the general public?