That sounds like one of the components in your setup has a short and is not properly grounded. My recommendation would be to plug in only one component at a time, see if it exhibits the short as you described. If it does with just a single device, that unit has an internal short and should be repaired.
If it does not, try two components at a time, keep adding elements until you discover the combination, and then try to determine what changed.