Only mark new elements as known.