[{"_path":"/research/modeling","_draft":false,"_partial":false,"_locale":"en","_empty":false,"title":"Virtual plants and AI","description":"We use virtual plants to train neural networks. This allows us to detect plant organs without the need of collecting and annotating field data.","excerpt":{"type":"root","children":[{"type":"element","tag":"section-cover","props":{},"children":[{"type":"element","tag":"template","props":{"v-slot:title":""},"children":[{"type":"element","tag":"h1","props":{"id":"plant-modeling-and-ai"},"children":[{"type":"text","value":"Plant modeling and AI"}]}]},{"type":"element","tag":"p","props":{},"children":[{"type":"text","value":"We focus on the generation of synthetic ground truth data (images or point clouds) using virtual plant models, and on novel analysis techniques for 3D and 3D+time data."}]}]},{"type":"element","tag":"section-split","props":{},"children":[{"type":"element","tag":"template","props":{"v-slot:media":""},"children":[{"type":"element","tag":"p","props":{},"children":[{"type":"element","tag":"img","props":{"alt":"dashboard screenshot","src":"/assets/research/modeling/1-arabidopsis-model.jpg"},"children":[]}]}]},{"type":"element","tag":"p","props":{},"children":[{"type":"text","value":"The work on the plant models has resulted in approved models for Arabidopsis thaliana and tomato plants. The model of A. thaliana was successfully used to train neural networks for the semantic segmentation of images of real plants and to produce high-quality point clouds for subsequent machine learning and analysis tasks."}]}]},{"type":"element","tag":"section-split","props":{},"children":[{"type":"element","tag":"template","props":{"v-slot:media":""},"children":[{"type":"element","tag":"p","props":{},"children":[{"type":"element","tag":"img","props":{"alt":"dashboard screenshot","src":"/assets/research/modeling/2-chenopodium-model.jpg"},"children":[]}]}]},{"type":"element","tag":"p","props":{},"children":[{"type":"text","value":"This motivates the work to go further into the realistic rendering of plants and improve the physical coherence of the generated 3D plants. Existing state-of-the-art models, including ours, do not correctly detect and handle intersecting organs, for example. This problem is currently investigated together with other key issues related to photo-realistic rendering of plants."}]}]},{"type":"element","tag":"section-split","props":{},"children":[{"type":"element","tag":"template","props":{"v-slot:media":""},"children":[{"type":"element","tag":"p","props":{},"children":[{"type":"element","tag":"img","props":{"alt":"dashboard screenshot","src":"/assets/research/modeling/3-skeletons-zoom.jpg"},"children":[]}]}]},{"type":"element","tag":"p","props":{},"children":[{"type":"text","value":"The challenge remains to robustly segment 3D plant data into its constituent organs can be tackled using several methods, from geometric methods to machine learning methods that use 2D image segmentation or 3D point cloud segmentation. An additional challenge is the precise extraction of the plant's skeleton from a 3D representation."}]}]},{"type":"element","tag":"section-split","props":{},"children":[{"type":"element","tag":"template","props":{"v-slot:media":""},"children":[{"type":"element","tag":"p","props":{},"children":[{"type":"element","tag":"img","props":{"alt":"dashboard screenshot","src":"/assets/research/modeling/4-arabidopsis.png"},"children":[]}]}]},{"type":"element","tag":"p","props":{},"children":[{"type":"text","value":"Tracking the plant growth over time raises the issue on the space-time registration of the collected 3D data. The combination of plant models and machine learning may help us predict the plant's shape ahead of time."}]}]}]},"img":"/assets/research/modeling/0-cover.png","_type":"markdown","_id":"content:3.research:1.modeling.md","_source":"content","_file":"3.research/1.modeling.md","_extension":"md"},{"_path":"/topic-reports","_draft":false,"_partial":false,"_locale":"en","_empty":false,"title":"Topic Reports","description":"","excerpt":{"type":"root","children":[{"type":"element","tag":"h1","props":{"id":""},"children":[{"type":"element","tag":"binding","props":{"value":"$doc.title"},"children":[]}]},{"type":"element","tag":"section-videos","props":{":items":"[{\"id\":\"hduQ5_xpyTI\",\"description\":\"Microfarms and computational agriculture: a future of farming?\"},{\"id\":\"_zkYwUczc0Q\",\"description\":\"The ROMI plaftorm: a helping hand to farming communities\"},{\"id\":\"E05uVM7FPIQ\",\"description\":\"Open source and open hardware: developing tools that are accessible and customisable\"}]"},"children":[{"type":"element","tag":"h2","props":{"id":"introduction-to-romi"},"children":[{"type":"text","value":"Introduction to ROMI"}]}]},{"type":"element","tag":"section-videos","props":{":items":"[{\"id\":\"a5oOR8Pfwzc\",\"description\":\"Plant developmental biology: how ROMI's tools help advance research in biology\"},{\"id\":\"rZk7tN9pUos\",\"description\":\"Data segmentation and analysis: developing algorithms to virtually dissect plants\"},{\"id\":\"Bo32_KI6SZ0\",\"description\":\"Synthetic plant modelling: creating plants in 3D to train neural networks\"}]"},"children":[{"type":"element","tag":"h2","props":{"id":"romi-and-biology-research"},"children":[{"type":"text","value":"ROMI and Biology Research"}]}]},{"type":"element","tag":"section-videos","props":{":items":"[{\"id\":\"VflubCtuyvc\",\"description\":\"Computer vision: algorithms to make sense of the world\"},{\"id\":\"YbByI0pGESY\",\"description\":\"Embodied AI: making robots curious\"}]"},"children":[{"type":"element","tag":"h2","props":{"id":"computer-vision-and-segmentation"},"children":[{"type":"text","value":"Computer Vision and Segmentation"}]}]},{"type":"element","tag":"section-videos","props":{":items":"[{\"id\":\"7aKQSbrldc0\",\"description\":\"Tell me more: a deeper dive into the ROVER\"},{\"id\":\"IVo6hM8GWWQ\",\"description\":\"Tell me more: a deeper dive into the CABLEBOT\"},{\"id\":\"w_AxsZlTkyA\",\"description\":\"Tell me more: a deeper dive into the PLANT IMAGER\"},{\"id\":\"_3oiv_96-X8\",\"description\":\"Tell me more: a deeper dive into FARMER'S DASHBOARD\"},{\"id\":\"CTOhDddCxvE\",\"description\":\"Software tools used in ROMI: a quick look into some of the tools used to develop ROMI\"}]"},"children":[{"type":"element","tag":"h2","props":{"id":"the-romi-tools-in-depth"},"children":[{"type":"text","value":"The ROMI tools in depth"}]}]}]},"showToc":false,"_type":"markdown","_id":"content:4.topic-reports.md","_source":"content","_file":"4.topic-reports.md","_extension":"md"}]