Hi townsbg ,
You didn't install the drivers rather they where installed when windows was installed.
But each time when i log on to a regular / limited user account and plug in the USB to pop-up in taskbar a message: A new device is installing or something like thing, can't remember what exact message it is.
Depending upon your device you might have the option of disabling USB ports on the BIOS settings (see your manual).
However, is this solution prevent no just a regular / limited user account also among all others users including an administrator account right?