Males and females can be kept together when not in season, no raging hormones on either side. Have heard of entire males being removed from a business when in season (no unwanted pregnancies) and then put back when hormones settle.
Unless you wanted to breed from them it would probably be better to get them all neutered then they can live together all year round