That's why we have GM's. We don't have to draw the line, they'll do it for us and assess every situation to determine whether players are outstepping their bounds.
Personally I keep one thing as a rule of thumb ... "If my actions take another player's desire to play away, then it's grieving."