Don't turn your back on your customers needing your assistance, as what most businessmen do. They do not like to entertain problems like that. however, it is a wrong notion and an action that is detrimental to the interest of the people in the community and the reputation of your business and to you. You must be a man of integrity and value. Face them and ask about the thing they are problematic with. Who knows if they have a complaint about your workers? The customers may spread bad words against you and the business. it is better to resolve the existing conflict to gain peace.