I think it depends on what kind of personality a speaker has to give a speech. I am pretty sure the majority would say it is easier to have a speech with co-workers. For the reason that they are familiar with each other and can talk with them informally. But then, a good speaker should not be limited to this situation. He or she needs to manage either way.