Source: Warhammer Fantasy: 8th Edition
Any challenge issued by the bearer of the Gauntlet of the Duel cannot be refused.