Especially if they are quick. I would probably wake up but anyone else in my family I could probably move their arm around easily. They might wake up but they would be confused and disoriented, I don’t think their first instinct would be to fight back.Some folks are very sound sleepers that wouldn't wake up if someone gently moved their hand in such a way. I certainly wouldn't wake up.