Personally i feel it does affect the growth of the business, these days it's pretty hard to actually come across employees who are not only qualified but at the same time capable. A person's capabilities is not based on their gender, hence being selective on who to accept based on gender can lead to you loosing out on someone who is more than capable.