Wait but isn't his sign based on the shackles the signless wore or somefing

Yeah, which is a symbol that was created after the Signless died. Which was centuries before Karkat was born. Either that or casually taken from the list and adapted to those rare cases because it looked that way.