I like the tough guys, but I think if they dealt some less damage, so that a player could survive a few hits (2 hits, the third could be leathal already) it would be more enjoyable.
I agree with Quq on the magic aspect. People with high magic go there to kill one dlayo after another in less than a minute just to loot the good stuff from them.
Also I think having them loot what they actually carry around is more realistic. Have em drop a few coins, or one or a few pieces of their armor, or the weapon or shield they actually carry

Oh and if possible, make em not give up stance when they move. It seems like they stop, stance, slash, stop attack and move again. Would be more of a challenge if they slashed while moving
