What did they write with in the late 1800s?

They had pencils (not used for formal writing), dip pens, quills (which were really just home-made dip pens) and fountain pens. Wilde would likely have used a fountain pen.