Agreed.
I don't knit, but I know people that do, and it can be more of something to do with your hands while doing something else, like listening or watching TV. People can have a conversation while knitting, not really so much with texting or video games.
I can't speak for everyone, but I would not consider that rude.