They said in the story that Yaldabaoth spoke to caliborn in his native tongue, which according to Lord English's vast honk, is some sort of horrific growling thing. Yaldabaoth would sound different to the kids because he would speak english.