draw the line at
C2 verb — draw the line (at sth)

If someone says they know where to draw the line, they are talking about knowing at what point an activity or situation becomes unacceptable because it is wrong or too extreme