You can still have group size 4 but have more than 16 entrants. In the middle bands tournaments of size 16 will fill up in under 10 minutes. Why not instead make larger tournaments? Increasing entrants to 64 only means one extra round (not counting extra rounds from ties).