Tan France just got real about why he didn’t want to join Queer Eye’s fab five