It is worth it to wait if you want to eliminate random fps drops and stutters, because at those moments the game is demanding for more VRAM and your GPU doesn't have them and so fps drops for a few sec and stutters a bit. If you want to play at 4k ultra on the newest games and some current games too, you would definitely want a GPU with a minimum of 6GB VRAM, so far GTA V reached up to 6.8GB for me, but that was just one moment, it is usually using around an average of 5GB of VRAM. So it doesn't really matter if you get like 100 fps, if you don't have something else the game needs, like VRAM, it drops to 15-30 fps sometimes and ruins the gaming experience.