Beginning in ESXi 5.1, VMware supports hardware accelerated graphics with select NVIDIA GPUs. Earlier ESXi 5.0 added support for 3d graphics with software renderer. You can even VMotion running 3d applications between systems regardless if they have a GPU.
Assuming you have NVIDIA GPU on compatible ESXi system, you can install ESXi driver such as NVIDIA DRIVERS 304.76. And yes, these systems are capable of running 3d VDI workloads for months at a time, so they are stable.