That's called the Bias Rule. You can find it where you set what your point values are (it's toward the bottom of that page). It should say "Ignore _ players (from bottom)" or something close to that and just enter in the amount of players you want to exclude.