Paper · 2022 · Computers and Electronics in Agriculture

Improved generalization of a plant-detection model for precision weed control

Thijs Ruigrok; Eldert J. van Henten; Gert Kootstra

7
claims
14
verbatim quotes
24
citations
3
research areas
✓
Open access · cc-by

Abstract

Lack of generalization in plant-detection models is one of the main challenges preventing the realization of autonomous weed-control systems. This paper investigates the effect of the train and test dataset distribution on the generalization error of a plant-detection model and uses incremental training to mitigate the said error. In this paper, we use the YOLOv3 object detector as plant-detection model. To train the model and test its generalization properties we used a broad dataset, consisting of 25 sub-datasets, sampled from multiple different geographic areas, soil types, cultivation conditions, containing variation in weeds, background vegetation, camera quality and variations in illumination. Using this dataset we evaluated the generalization error of a plant-detection model, assessed the effect of sampling training images from multiple arable fields on the generalization of our plant-detection model, we investigated the relation between the number of training images and the generalization of the plant-detection model and we applied incremental training to mitigate the generalization error of our plant-detection model on new arable fields. It was found that the average generalization error of our plant-detection model was 0.06 mAP. Increasing the number of sub-datasets for training, while keeping the total number of training images constant, increased the variation covered by the training set and improved the generalization of our plant-detection model. Adding more training images sampled from the same datasets increased the generalization further. However, this effect is limited and only holds when the new images cover new variation. Naively adding more images does not prepare the model for specific scenarios outside the training distribution. Using incremental training the model can be adapted to such scenarios and the generalization error can be mitigated. Depending on the discrepancy between the training set and the new field, finetuning on as little as 25 images can already mitigate the generalization error.

Abstract from the paper’s OpenAlex record; open copy licensed cc-by. Read at the source ↗

The text the model read, with the source record’s inline markup (italics, sub- and superscripts) rendered and its character entities decoded; quote offsets refer to the raw text.

Claims 7

Method / resourceobservedoriginal resultpositivemeasured

Claim · model-written summary

Plant detection model performance: the average generalization error of our plant-detection model was 0.06 mAP

Taxon
plantt0
Outcome
generalization errore0
Value
0.06 mAPe0

Not reportedComparator

Verbatim

e0

“the average generalization error of our plant-detection model was 0.06 mAP”

✓ located verbatim in the source · abstract, characters 1183–1257 · show in text ↑
t0

“plant”

✓ located verbatim in the source · title, characters 29–34 · show in text ↑
Method / resourceobservedoriginal resultpositivemeasured

Claim · model-written summary

Plant detection model performance: Increasing the number of sub-datasets for training, while keeping the total number of training images constant, increased the variation covered by the training set and improved the generalization of our plant-detection model.

Taxon
plantt0
Outcome
generalizatione0
Direction
improvede0

Not reportedComparator

Verbatim

e0

“Increasing the number of sub-datasets for training, while keeping the total number of training images constant, increased the variation covered by the training set and improved the generalization of our plant-detection model.”

✓ located verbatim in the source · abstract, characters 1259–1484 · show in text ↑
t0

“plant”

✓ located verbatim in the source · title, characters 29–34 · show in text ↑
Method / resourceobservedoriginal resultpositivemeasured

Claim · model-written summary

Plant detection model performance: Adding more training images sampled from the same datasets increased the generalization further.

Taxon
plantt0
Outcome
generalizatione0
Direction
increasede0

Not reportedComparator

Verbatim

e0

“Adding more training images sampled from the same datasets increased the generalization further.”

✓ located verbatim in the source · abstract, characters 1485–1581 · show in text ↑
t0

“plant”

✓ located verbatim in the source · title, characters 29–34 · show in text ↑
Method / resourceobservedoriginal resultpositivemeasured

Claim · model-written summary

Plant detection model performance: this effect is limited and only holds when the new images cover new variation.

Taxon
plantt0
Outcome
effecte0

Not reportedComparator

Verbatim

e0

“this effect is limited and only holds when the new images cover new variation.”

✓ located verbatim in the source · abstract, characters 1591–1669 · show in text ↑
t0

“plant”

✓ located verbatim in the source · title, characters 29–34 · show in text ↑
Method / resourceobservedoriginal resultpositivemeasured

Claim · model-written summary

Plant detection model performance: Naively adding more images does not prepare the model for specific scenarios outside the training distribution.

Taxon
plantt0
Outcome
modele0

Not reportedComparator

Verbatim

e0

“Naively adding more images does not prepare the model for specific scenarios outside the training distribution.”

✓ located verbatim in the source · abstract, characters 1670–1781 · show in text ↑
t0

“plant”

✓ located verbatim in the source · title, characters 29–34 · show in text ↑
Method / resourceobservedoriginal resultpositivemeasured

Claim · model-written summary

Plant detection model performance: Using incremental training the model can be adapted to such scenarios and the generalization error can be mitigated.

Taxon
plantt0
Outcome
generalization errore0
Direction
mitigatede0

Not reportedComparator

Verbatim

e0

“Using incremental training the model can be adapted to such scenarios and the generalization error can be mitigated.”

✓ located verbatim in the source · abstract, characters 1782–1898 · show in text ↑
t0

“plant”

✓ located verbatim in the source · title, characters 29–34 · show in text ↑
Method / resourceobservedoriginal resultpositivemeasured

Claim · model-written summary

Plant detection model performance: finetuning on as little as 25 images can already mitigate the generalization error.

Taxon
plantt0
Outcome
generalization errore0
Direction
mitigatee0
Value
25 imagese0

Not reportedComparator

Verbatim

e0

“finetuning on as little as 25 images can already mitigate the generalization error.”

✓ located verbatim in the source · abstract, characters 1972–2055 · show in text ↑
t0

“plant”

✓ located verbatim in the source · title, characters 29–34 · show in text ↑