Many browser based games use it, and some etailers use it in their checkout process (such as the process of adding things to your cart, or customizing), and if you do your banking and bill payments online you may not be able to do it without Java. But other than those, if those don't affect you, you may never use it.
Instead of deleting it I would suggest you do what I do and just use NoScript which, among other features, it blocks Java applets from launching. Since most all exploits require the person going to a malicious web page or run a malicious applet, it takes care of that problem, among others.
Oh for the day when Java and Flash are replaced by HTML5...
Crosshair IV Formula, Phenom II x4 965 w/ Corsair H60, 8 GiB OCZ Platinum DDR3 1600, XFX HD 7970 Ghz, 512GB Vertex 4, 256GB Vector, 240GB Agility 3, Creative X-Fi Titanium w/ Creative Gigaworks S750, SeaSonic X750, HP ZR2440w, Win 7 Ultimate x64