Josh
We can accomplish what you are trying to do by integrating your VMAN instance with you Orion NPM or SAM. This will provide you with RBAC and allow you to set group access for an entire component (in this case virtualization) much like the current setup for NPM and SAM. Unfortunatly there is no way to accomplish what you need to do without touching every type of content with out integration enabled.
The thwack post describes some great integration features and a quick how to and videos.
Dreams Do Come True: Virtualization Manager 6.0 with Integration with SAM and NPM