So, can you explain to me the relationship of Gamzee and Caliope/Caliborn

Gamzee set up their living place and provided food for them so that Caliborn could grow up and become Lord English.  He was also the one that chained them to the sarswapagus