I recently had a similar situation trying to program my just acquired 2018 ES350. Following frustration when applying the instructions in the owners manual,
You tube explained that one must cancel existing memory by pressing buttons 1 and 3 simultaneously, wait for the light in the rear view mirror to flash constantly ,
then program as directed in the manual. Check You tube , Lexus ES350 homelink for more details !