IDEAS home Printed from https://ideas.repec.org/a/gam/jgeogr/v3y2023i3p29-573d1228568.html
   My bibliography  Save this article

Investigating the Use of Street-Level Imagery and Deep Learning to Produce In-Situ Crop Type Information

Author

Listed:
  • Fernando Orduna-Cabrera

    (International Institute for Applied Systems Analysis, A-2361 Laxenburg, Austria)

  • Marcial Sandoval-Gastelum

    (International Institute for Applied Systems Analysis, A-2361 Laxenburg, Austria)

  • Ian McCallum

    (International Institute for Applied Systems Analysis, A-2361 Laxenburg, Austria)

  • Linda See

    (International Institute for Applied Systems Analysis, A-2361 Laxenburg, Austria)

  • Steffen Fritz

    (International Institute for Applied Systems Analysis, A-2361 Laxenburg, Austria)

  • Santosh Karanam

    (International Institute for Applied Systems Analysis, A-2361 Laxenburg, Austria)

  • Tobias Sturn

    (International Institute for Applied Systems Analysis, A-2361 Laxenburg, Austria)

  • Valeria Javalera-Rincon

    (International Institute for Applied Systems Analysis, A-2361 Laxenburg, Austria)

  • Felix F. Gonzalez-Navarro

    (Instituto de Ingeniería, Universidad Autónoma de Baja California, Mexicali 21000, Mexico)

Abstract

The creation of crop type maps from satellite data has proven challenging and is often impeded by a lack of accurate in situ data. Street-level imagery represents a new potential source of in situ data that may aid crop type mapping, but it requires automated algorithms to recognize the features of interest. This paper aims to demonstrate a method for crop type (i.e., maize, wheat and others) recognition from street-level imagery based on a convolutional neural network using a bottom-up approach. We trained the model with a highly accurate dataset of crowdsourced labelled street-level imagery using the Picture Pile application. The classification results achieved an AUC of 0.87 for wheat, 0.85 for maize and 0.73 for others. Given that wheat and maize are two of the most common food crops grown globally, combined with an ever-increasing amount of available street-level imagery, this approach could help address the need for improved global crop type monitoring. Challenges remain in addressing the noise aspect of street-level imagery (i.e., buildings, hedgerows, automobiles, etc.) and uncertainties due to differences in the time of day and location. Such an approach could also be applied to developing other in situ data sets from street-level imagery, e.g., for land use mapping or socioeconomic indicators.

Suggested Citation

  • Fernando Orduna-Cabrera & Marcial Sandoval-Gastelum & Ian McCallum & Linda See & Steffen Fritz & Santosh Karanam & Tobias Sturn & Valeria Javalera-Rincon & Felix F. Gonzalez-Navarro, 2023. "Investigating the Use of Street-Level Imagery and Deep Learning to Produce In-Situ Crop Type Information," Geographies, MDPI, vol. 3(3), pages 1-11, August.
  • Handle: RePEc:gam:jgeogr:v:3:y:2023:i:3:p:29-573:d:1228568
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2673-7086/3/3/29/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2673-7086/3/3/29/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Juan Carlos Laso Bayas & Linda See & Hedwig Bartl & Tobias Sturn & Mathias Karner & Dilek Fraisl & Inian Moorthy & Michaela Busch & Marijn van der Velde & Steffen Fritz, 2020. "Crowdsourcing LUCAS: Citizens Generating Reference Land Cover and Land Use Data with a Mobile App," Land, MDPI, vol. 9(11), pages 1-18, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.

      Corrections

      All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jgeogr:v:3:y:2023:i:3:p:29-573:d:1228568. See general information about how to correct material in RePEc.

      If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

      If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

      If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

      For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

      Please note that corrections may take a couple of weeks to filter through the various RePEc services.

      IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.