Here is some advice on interacting with hardware using Panda3D's build in keyboard and mouse support, as well as some suggestions for getting joystick information into Panda3D.