This is a bit of a non issue.
I work in a hot zone and have been wearing N95s since early March. What I typically wear is a 3M N95 respirator with a port valve and a procedure mask over it. The N95 protects me (I am in a confined space 2 days a week) and the procedure mask, distance, and physical barrier protects my clients (who also must be masked in order to enter the premises). This concern is a bit of a non issue because if every single person was wearing an N95 (even with a port) this pandemic would be over in a month. Getting genuine NIOSH N95s is pretty difficult, though there has been a marked uptick in the availability of KN95s and cloth face masks with filter inserts. My guess is that most of us that have actual N95s with ports are able to access procedure masks and in my experience we are all outfitting them in the manner mentioned above.
My guess is that this is a bit more directed at the KN95/less educated crowd, but even there if more people were wearing KN95s, the R0 would decrease dramatically.
TLDR: If you have a real N95 with a port, cover it with a procedure mask or face shield for others. If not, do not worry about it because this is about the least of our worries right now with the pandemic.