3D GRAPHICAL MODELING OF VEGETABLE SEEDLINGS BASED ON A STEREO MACHINE VISION SYSTEM Ta-Te Lin, Wen-Chi Liao, Chung-Fan Chien Department of Bio-Industrial Mechatronics Engineering, National Taiwan University, Taipei, Taiwan, ROC

INTRODUCTION Plant models Plant models Visualization of plant models Visualization of plant models Digitizing methods Digitizing methods L-system for plant structure modeling L-system for plant structure modeling Model-based growth measurement Model-based growth measurement

MATERIALS & METHODS Stereo Machine Vision System Stereo Machine Vision System L-System Formulation L-System Formulation Graphical Modules Graphical Modules Test of Method Accuracy Test of Method Accuracy Model-based growth measurement Model-based growth measurement

FLOW CHART 3D GRAPHICAL SIMULATION Initialization and Calibration of the System Start Stereo Image Acquisition and Image Registration Image Segmentation Automatic Search for Positions and Orientation of Leaves Manual Correction and Supplement of Searched Results Conversion of Parameters and Creation of L-System Strings Computer Graphical Simulation and Calculation of Plant Features End

Rotary stage Image processing board RS-232 interface STEREO MACHINE VISION SYSTEM Rotary stage Steppermotorcontroller Color CCD camera

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION ROOT: R(X r, Y r, Z r ) INTERNODE: I(A ix, A iy, L i, D i ) LEAF: L(A px, A py, L p, A lx, A ly, W l, L l, N l )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION ROOT: R(X r, Y r, Z r )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION INTERNODE: I(A ix, A iy, L i, D i )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION INTERNODE: I(A ix, A iy, L i, D i )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION INTERNODE: I(A ix, A iy, L i, D i )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION INTERNODE: I(A ix, A iy, L i, D i )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION LEAF: L(A px, A py, L p, A lx, A ly, W l, L l, N l )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION LEAF: L(A px, A py, L p, A lx, A ly, W l, L l, N l )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION LEAF: L(A px, A py, L p, A lx, A ly, W l, L l, N l )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION LEAF: L(A px, A py, L p, A lx, A ly, W l, L l, N l )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION LEAF: L(A px, A py, L p, A lx, A ly, W l, L l, N l )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION LEAF: L(A px, A py, L p, A lx, A ly, W l, L l, N l )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION LEAF: L(A px, A py, L p, A lx, A ly, W l, L l, N l )

BASIC PLANT MODULES 3D GRAPHICAL SIMULATION LEAF: L(A px, A py, L p, A lx, A ly, W l, L l, N l )

L-SYSTEM R(260,70,204) I(-11.7,323.1,49.0,3) L(-40.9,284.0,0,50.3,-17.2,53.1,53.1,1) L(-50.5,74.0,0,75.4,-9.7,48.3,48.3,2) L(-38.7,355.2,0,76.9,-35.7,112.2,112.2,3) L(-20.5,194.0,0,70.4,-28.8,107.5,107.5,4) 3D GRAPHICAL SIMULATION

L-SYSTEM STRINGS 3D GRAPHICAL SIMULATION Digitizing Process Conversion and Calculation of L-system Parameters L-system Strings Translation Calculation of Dimension and Spatial Coordinates of Plant Modules Interpretation Creation of Plant Modules and Graphical Simulation

3D GRAPHICAL SIMULATION MAKING TEXTURAL IMAGE TEMPLATE

3D GRAPHICAL SIMULATION LEAF MODULE Elliptical Surface Approach Bezier Surface Approach

3D GRAPHICAL SIMULATION Top View Side View Real Image Graphical Simulation PEPPER SEEDLING

3D GRAPHICAL SIMULATION OTHER PLANTS

3D GRAPHICAL SIMULATION OTHER PLANTS

MODEL-BASED MEASUREMENT Point, Length, Angle, Texture L-system Semi-Automatic Measurement Automatic Measured 3D Computer Graphics Seedling Features By Model Computation

n Stem length n Height n Span n Total leaf area and individual leaf area n Top fresh weight (need calibration) n Top dry weight (need calibration) n Number of leaves n Leaf area index, LAI n Leaf length n Leaf width SEEDLING FEATURES MODEL-BASED MEASUREMENT

Comparisons of predicted plant height with manually measured plant height. Pepper

Comparisons of predicted plant height with manually measured plant height for four different types of vegetable seedlings. PepperCollard Cabbage Chinese cabbage

Comparisons of predicted plant total leaf area with manually measured plant total leaf area for four different types of vegetable seedlings. PepperCollard Cabbage Chinese cabbage

Comparisons of predicted and manually measured plant features. Slope aIntercept bR2R2 RMSERRMSE First internode mm2.4% Plant height mm4.3% Leaf length mm15.6% Leaf width mm12.9% Individual leaf area cm % Total leaf area cm 2 9.8% Petiole length mm57.2% Pepper Slope aIntercept bR2R2 RMSERRMSE First internode mm8.9% Plant height mm10.8% Leaf length mm21.1% Leaf width mm16.1% Individual leaf area cm % Total leaf area cm % Petiole length mm27.1% Collard

Comparisons of predicted and manually measured plant features. Cabbage Chinese cabbage Slope aIntercept bR2R2 RMSERRMSE First internode mm4.1% Plant height mm7.6% Leaf length mm16.6% Leaf width mm15.5% Individual leaf area cm % Total leaf area cm % Petiole length mm30.7% Slope aIntercept bR2R2 RMSERRMSE First internode mm4.6% Plant height mm8.1% Leaf length mm18.2% Leaf width mm21.4% Individual leaf area cm % Total leaf area cm % Petiole length mm36.3%

Growth curves of total leaf area for a batch of pepper seedlings showing the variability within the batch.

Growth curves of total leaf area for pepper seedlings cultured in pots of different sizes.

Average growth curves of leaf area for individual leaves of pepper seedlings cultured in pots of 180 ml volume.

Average growth curves of leaf area for the 1st leaf of pepper seedlings cultured in pots of different sizes.

CONCLUSIONS n A graphical model based on L-system was developed to represent vegetable seedling structures. n The structural model was implemented for efficient graphical simulation of various vegetable seedlings. n The basic geometric and textural information for vegetable seedlings were successfully digitized by a stereo machine vision system.

CONCLUSIONS n Measurements of four different seedlings were performed to assess the methodology. The system was successfully applied in measuring growth curves of pepper seedlings under different culture conditions. n The model-based measurement of plant features offers additional information than what conventional methods can provide.

THANK YOU 謝 謝 謝 謝