Removing Memojis from iPhone keyboard without affecting custom stickers

I was wondering if there is a way to remove Memojis off my keyboard completely. I have seen many videos going through settings and turning off the Memoji switch but I don’t have that, I only see turn off stickers but I don’t want to remove stickers I had made I just want the Memojis gone. I tried going through the IMessage app but that doesn’t work either. Is there a way to only remove the Memoji stickers off my keyboard without taking out the custom ones I have?

[Re-Titled by Moderator]