How do you sharpen eyeliner pencils?

I tried using a regular pencil sharpener (handheld), but now the wood around the tip is rough and it feels rough on my eye.