TY - JOUR
T1 - Application and integration of computer vision technologies for automated recognition and recording of chemical experiments
AU - Sasaki, Ryosuke
AU - Fujinami, Mikito
AU - Nakai, Hiromi
N1 - Publisher Copyright:
© The Author(s) 2024.
PY - 2024/11
Y1 - 2024/11
N2 - Advancements in computer vision have significantly improved motion and object recognition accuracy. These advancements should aid the automatic recognition of chemical experiments, potentially contributing to the recording of experiments. Creating an electronic laboratory notebook from experiment filming enhances convenience and allows more detailed information storage compared to traditional manual recording methods. Our previous research focused on employing object detection and action recognition to automate the recognition of chemical experiments. This paper presents a novel system that combines object detection, action recognition, multiple object tracking, and barcode recognition to automatically generate experimental flowcharts. We implemented our system as a graphical user interface-based application for laboratory use that successfully constructs flowcharts from videos of chemical experiments, including simple chemical manipulations.
AB - Advancements in computer vision have significantly improved motion and object recognition accuracy. These advancements should aid the automatic recognition of chemical experiments, potentially contributing to the recording of experiments. Creating an electronic laboratory notebook from experiment filming enhances convenience and allows more detailed information storage compared to traditional manual recording methods. Our previous research focused on employing object detection and action recognition to automate the recognition of chemical experiments. This paper presents a novel system that combines object detection, action recognition, multiple object tracking, and barcode recognition to automatically generate experimental flowcharts. We implemented our system as a graphical user interface-based application for laboratory use that successfully constructs flowcharts from videos of chemical experiments, including simple chemical manipulations.
KW - Computer vision
KW - Electronic laboratory notebook
KW - Experimental flowchart
KW - Image recognition.
UR - http://www.scopus.com/inward/record.url?scp=85211157226&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85211157226&partnerID=8YFLogxK
U2 - 10.1093/bulcsj/uoae110
DO - 10.1093/bulcsj/uoae110
M3 - Article
AN - SCOPUS:85211157226
SN - 0009-2673
VL - 97
JO - Bulletin of the Chemical Society of Japan
JF - Bulletin of the Chemical Society of Japan
IS - 11
M1 - uoae110
ER -