Basically yes. The client can cancel the streams for pushed assets that are in cache. But the server doesn't have this information (natively) when one page is requested.

As others have said, there are workarounds using cookies. Which is yet another abuse of a very bad feature of HTTP.