How to install via apt-get (without nvidia-cg-toolkit)

No, sorry. While you can of course compile without NVIDIA Cg, it’s still compiled into the core libraries and cannot be removed from a build compiled with it. This will change in the future, especially as Cg is no longer maintained, but not the immediate future.