The minister has been accused by the Postbank board of being treated with hostility, undermined and disrespected