3D point cloud data to quantitatively characterize size and shape of shrub crops

Abstract

Size and shape are important properties of shrub crops such as blueberries, and they can be particularly useful for evaluating bush architecture suited to mechanical harvesting. The overall goal of this study was to develop a 3D imaging approach to measure size-related traits and bush shape that are relevant to mechanical harvesting. 3D point clouds were acquired for 367 bushes from five genotype groups. Point cloud data were preprocessed to obtain clean bush points for characterizing bush architecture, including bush morphology (height, width, and volume), crown size, and shape descriptors (path curve λ and five shape indices). One-dimensional traits (height, width, and crown size) had high correlations (R² = 0.88–0.95) between proposed method and manual measurements, whereas bush volume showed relatively lower correlations (R² = 0.78–0.85). These correlations suggested that the present approach was accurate in measuring one-dimensional size traits and acceptable in estimating three-dimensional bush volume. Statistical results demonstrated that the five genotype groups were statistically different in crown size and bush shape. The differences matched with human evaluation regarding optimal bush architecture for mechanical harvesting. In particular, a visualization tool could be generated using crown size and path curve λ, which showed great potential of determining bush architecture suitable for mechanical harvesting quickly. Therefore, the processing pipeline of 3D point cloud data presented in this study is an effective tool for blueberry breeding programs (in particular for mechanical harvesting) and farm management.

References

[1] United States Department of Agriculture, Agricultural Research Service . National nutrient database for standard reference release 28 (2016). https://ndb.nal.usda.gov/ndb/foods/show/2166. Accessed 9 August 2017.

[2] Overview global blueberry market. http://www.freshplaza.com/article/174017/OVERVIEW-GLOBAL-BLUEBERRY-MARKET. Accessed 9 August 2017.

[3] Araus, J. L. & Cairns, J. E. Field high-throughput phenotyping: the new crop breeding frontier. Trends Plant. Sci. 19, 52-61 (2014).

[4] Reynolds, M. & Langridge, P. Physiological breeding. Curr. Opin. Plant Biol. 31, 162-171 (2016).

[5] Shakoor, N., Lee, S. & Mockler, T. C. High throughput phenotyping to accelerate crop breeding and monitoring of diseases in the field. Curr. Opin. Plant Biol. 38, 184-192 (2017).

[6] Rosell, J. R. & Sanz, R. A review of methods and applications of the geometric characterization of tree crops in agricultural activities. Comput. Electron. Agric. 81, 124-141 (2012).

[7] Tertuliano, M. et al. Growing organic rabbiteye blueberries in Georgia, USA: results of two multi-year field studies. Int. J. Fruit Sci. 12, 205-215 (2012).

[8] Smith, E. D. & Harris, G. Plant nitrogen status of southern highbush blueberry (vaccinium corymbosum l. interspecific hybrid) grown in pine bark amended soils with varying rates of nitrates . Commun. Soil Sci. Plant Anal. 48, 878-885 (2017).

[9] Takeda, F., Krewer, G., Andrews, E. L., Mullinix, B. & Peterson, D. L. Assessment of the v45 blueberry harvester on rabbiteye blueberry and southern highbush blueberry pruned to v-shaped canopy. Horttechnology 18, 130-138 (2008).

[10] Yu, P. C. et al. Measurement of mechanical impacts created by rotary, slapper, and sway blueberry mechanical harvesters. Comput. Electron. Agric. 101, 84-92 (2014).

[11] Takeda, F. et al. Applying new technologies to transform blueberry harvesting. Agronomy 7, 33 (2017).

[12] van Dalfsen, K. B. & Gaye, M. M. Yield from hand and mechanical harvesting of highbush blueberries in british columbia. Appl. Eng. Agric. 15, 393-398 (1999).

[13] Brown, G. et al. Estimates of mechanization effects on fresh blueberry quality. Appl. Eng. Agric. 12, 21-26 (1996).

[14] Li, L., Zhang, Q. & Huang, D. F. A review of imaging techniques for plant phenotyping. Sensors 14, 20078-20111 (2014).

[15] Hartmann, A., Czauderna, T., Hoffmann, R., Stein, N. & Schreiber, F. Htpheno: an image analysis pipeline for high-throughput plant phenotyping. BMC Bioinformatics 12 (2011). https://doi.org/10.1186/1471-2105-12-148.

[16] Knecht, A. C., Campbell, M. T., Caprez, A., Swanson, D. R. & Walia, H. Image harvest: an open-source platform for high-throughput plant image processing and analysis. J. Exp. Bot. 67, 3587-3599 (2016).

[17] Gehan, M. A. et al. Plantcvv2: image analysis software for high-throughput plant phenotyping. PeerJ 5 (2017). https://doi.org/10.7717/peerj.4088.

[18] Reuzeau, C. et al. Traitmill: a discovery engine for identifying yield-enhancement genes in cereals. Plant Gene Trait. 1, 1-6 (2010).

[19] Gibbs, J. A. et al. Approaches to three-dimensional reconstruction of plant shoot topology and geometry. Funct. Plant Biol. 44, 62-75 (2017).

[20] Polo, J. R. R. et al. A tractor-mounted scanning LiDAR for the non-destructive measurement of vegetative volume and surface area of tree-row plantations: a comparison with conventional destructive measurements. Biosyst. Eng. 102, 128-134 (2009).

[21] Rosell, J. R. et al. Obtaining the three-dimensional structure of tree orchards from remote 2d terrestrial lidar scanning. Agric. For. Meteorol. 149, 1505-1515 (2009).

[22] Weiss, M. & Baret, F. Using 3d point clouds derived from uav rgb imagery to describe vineyard 3d macro-structure. Remote Sens. 9, 111-128 (2017).

[23] Wu, C. Y., He, L. Y., Du, X. Q., Chen, S. Z. & Ni, K. N. 3d reconstruction of chinese hickory tree for dynamics analysis. Biosyst. Eng. 119, 69-79 (2014).

[24] Diaz-Varela, R. A., de la Rosa, R., Leon, L. & Zarco-Tejada, P. J. High-resolution airborne uav imagery to assess olive tree crown parameters using 3d photo reconstruction: Application in breeding trials. Remote Sens. 7, 4213-4232 (2015).

[25] Underwood, J. P., Hung, C., Whelan, B. & Sukkarieh, S. Mapping almond orchard canopy volume, flowers, fruit and yield using LiDAR and vision sensors. Comput. Electron. Agric. 130, 83-96 (2016).

[26] Casamali, B ., Williamson, J. G., Kovaleski, A. P., Sargent, S. A. & Darnell, R. L. Mechanical harvesting and postharvest storage of two southern highbush blueberry cultivars grafted onto Vaccinium Arboreum rootstocks . HortScience 51, 1503-1510 (2016).

[27] Takeda, F., Krewer, G., Li, C. Y., MacLean, D. & Olmstead, J. W. Techniques for increasing machine harvest efficiency in highbush blueberry. Hort. Technol. 23, 430-436 (2013).

[28] Torr, P. H. S. & Zisserman, A. Mlesac: A new robust estimator with application to estimating image geometry. Comput. Vis. Image Underst. 78, 138-156 (2000).

[29] Gough, R. E. The Highbush Blueberry and its Management (CRC Press, 1993).

[30] Mu, Y. et al. Characterization of peach tree crown by using high-resolution images from an unmanned aerial vehicle. Hortic. Res. 5, 74 (2018).

[31] Patrick, A. & Li, C. Y. High throughput phenotyping of blueberry bush morphological traits using unmanned aerial systems. Remote Sens. 9 (2017). https://doi.org/10.3390/rs9121250.

[32] Jay, S., Rabatel, G., Hadoux, X., Moura, D. & Gorretta, N. In-field crop row phenotyping from 3d modeling performed using structure from motion. Comput. Electron. Agric. 110, 70-77 (2015).

[33] Herrero-Huerta, M., Gonzalez-Aguilera, D., Rodriguez-Gonzalvez, P. & Hernandez-Lopez, D. Vineyard yield estimation by automatic 3d bunch modelling in field conditions. Comput. Electron. Agric. 110, 17-26 (2015).

[34] Snavely, N., Seitz, S. M. & Szeliski, R. Modeling the world from internet photo collections. Int. J. Comput. Vis. 80, 189-210 (2008).

[35] Bosse, M., Zlot, R. & Flick, P . Zebedee: design of a spring-mounted 3-d range sensor with application to mobile mapping. IEEE Trans. Robot. 28, 1104-1119 (2012).

[36] Marselis, S. M., Yebra, M., Jovanovic, T. & van Dijk, A. I. J. M. Deriving comprehensive forest structure information from mobile laser scanning observations using automated point cloud classification. Environ. Model. Softw. 82, 142-151 (2016).

[37] Bauwens, S., Bartholomeus, H., Calders, K. & Lejeune, P. Forest inventory with terrestrial LiDAR: a comparison of static and hand-held mobile laser scanning. Forests 7, 127-144 (2016).

[38] Costa, C. et al. Shape analysis of agricultural products: A review of recent research advances and potential application to computer vision. Food Bioprocess Technol. 4, 673-692 (2011).

[39] Gonzalo, M. J. et al. Tomato fruit shape analysis using morphometric and morphology attributes implemented in tomato analyzer software program. J. Am. Soc. Hortic. Sci. 134, 77-87 (2009).

[40] Rodríguez, G. R. et al. Tomato analyzer: a useful software application to collect accurate and detailed morphological and colorimetric data from two-dimensional objects. J. Vis. Exp. 1856 (2010). https://doi.org/10.3791/1856.

[41] Hurtado, M. et al. Phenomics of fruit shape in eggplant (Solanum Melongena L.) using tomato analyzer software . Sci. Hortic. 164, 625-632 (2013).

[42] Klein, L. L. et al. Digital morphometrics of two north american grapevines (vitis: Vitaceae) quantifies leaf variation between species, within species, and among individuals . Front. Plant Sci. 8 (2017). https://doi.org/10.3389/fpls.2017.00373.

[43] Hill, T. A. et al. Regions underlying population structure and the genomics of organ size determination in capsicum annuum . Plant Genome 10 (2017). https://doi.org/10.3835/plantgenome2017.03.0026.

[44] Derbidge, R., Feiten, L., Conradt, O., Heusser, P. & Baumgartner, S. Assessment of shape changes of mistletoe berries: A new software approach to automate the parameterization of path curve shaped contours. PLoS ONE 8, 1-9 (2013).

[45] Andres, R. J. et al. Modifications to a late meristem identity1 gene are responsible for the major leaf shapes of upland cotton (Gossypium Hirsutum L.) . Proc. Natl Acad. Sci. USA 114, E57-E66 (2017).

[46] Costa, C. et al. Quantitative evaluation of tarocco sweet orange fruit shape using optoelectronic elliptic Fourier based analysis. Postharvest Biol. Technol. 54, 38-47 (2009).

[47] Goto, S. et al. Fruit shape variation in Fraxinus Mandshurica var. japonica characterized using elliptic Fourier descriptors and the effect on flight duration . Ecol. Res. 20, 733-738 (2005).

[48] Maeda, H., Akagi, T. & Tao, R. Quantitative characterization of fruit shape and its differentiation pattern in diverse persimmon (Diospyros Kaki) cultivars . Sci. Hortic. 228, 41-4418 (2018).

[49] Liao, F., Peng, J. & Chen, R. Leafletanalyzer, an automated software for quantifying, comparing and classifying blade and serration features of compound leaves during development, and among induced mutants and natural variants in the legume medicago truncatula . Front. Plant Sci. 8, 915 (2017).

[50] Almon, C. Path curves, an introduction to the work of l. Edwards on bud forms. Open Syst. Inf. Dyn. 2, 265-277 (1994).