Unsubscribing groups can also be possible by clicking the same “Subscribe” link. If the member is already subscribed to the group, he will be prompted with an option to Unsubscribe from the group.
If the Unsubscribe option is selected, then that particular group will be untagged from the contact.