For months, there have been rumors that Tom Brady will leave the Patriots in the offseason, and the latest only adds fuel to the fire.