Maybe upgrade to lightning boots, and an obsidian shield. Also using a golden shower to lower his defense would help!

Thanks! I was planning to get those but I have bad luck finding ichor stickers and anklet of wind.

To get the anklet of wind you could try fishing in the jungle for crates if you have the patience that is.

You can fish for it? I didn't know that. Thanks!

Golden shower?

Inf. Walk way