I assume that even once Drive gets more famous and pictures of him do appear, people won't pay as much attention to his car, so if they really want to go the "his team just can't figure out Tomari is Drive" route I guess they can bullshit it that way.