Had to investigate, and turns out you're right about the origin. The original grandfather clause was meant to exempt blacks from voting. See https://en.m.wikipedia.org/wiki/Grandfather_clause
I'm not a fan of term banning, however. We still use the number 9 even though Hitler said it a lot.
Just found out that there's a remake!