We need to pass a motion of ‘no confidence’ in a committee member to get rid of them from the committee

There is no such thing as a vote of no confidence at either committee or general meeting level. The right way to remove a committee member is an ordinary resolution. You can read more here.