Many browser based games use it, and some etailers use it in their checkout process (such as the process of adding things to your cart, or customizing), and if you do your banking and bill payments online you may not be able to do it without Java. But other than those, if those don't affect you, you may never use it.
Instead of deleting it I would suggest you do what I do and just use NoScript which, among other features, it blocks Java applets from launching. Since most all exploits require the person going to a malicious web page or run a malicious applet, it takes care of that problem, among others.
Oh for the day when Java and Flash are replaced by HTML5...
ASUS Sabertooth 990FX/Gen3 R2, FX-8350 w/ Corsair H60, 8 GiB G.SKILL RipjawsX DDR3-2133, XFX HD 7970 Ghz, 512GB Vertex 4, 256GB Vector, 240GB Agility 3, Creative X-Fi Titanium w/ Creative Gigaworks S750, SeaSonic X750, HP ZR2440w, Win 7 Ultimate x64