Not quite, I don't think it has to be N!.
What I have figured out is there is a major misconception about the Berserker Armor and the DS: you actually have to pick UP the DS in order to wear the Berserker Armor.
So, you are able to pick up the DS FIRST, but not USE it until you get the Berserker Armor to drop?