Am I being too sensitive about how they handle my card at restaurants?

When I hand over my card to pay,
they clear the food and tidy up,
but then they take my card and process the payment
while still wearing the same gloves they've been wearing the whole time.
Of course, I don't say anything, but am I just being too sensitive?