It depends on your network design. You can think of it like VLAN. You can put tenants in 1 VLAN, for example using private VLAN. Or you can have VLANs dedicated for 1 tenant.
Overlay network is the same concept, the only difference is overlay network is encapsulated to be forwarded through any IP connectivity.