did Roxy actually have a crush on Dirk or was that a friendly/notsofriendly joke?

Yes Roxy does canonically have a crush on Dirk. She states that she loves him on this page.