what about odd number sessions? like a three or five person session? would that be viable?

Yeah why not?