Can't start battle in top floor

Can anyone let me know where I'm going wrong? 

I have 12 girls unlocked and am at about level 34, but I can't start a battle in the top floor.  I can select an opponent, pick a set of girls to attack, but when I hit the crossed swords button in the bottom left there's a brief high-pitched sound, but nothing else happens.

Any hints?