Refuse no call

We hear constantly the phrase "refuse no call... every call comes from God" and yet we have members who constantly don't show up to do their callings regardles if it is as a teacher or anything. Is it not better to instead say sorry but I don't want that call for whatever reason can I have something else then to say yes and then not do it?