View More Details & Registration
Please note: All Sessions are in Japan Standard Time Zone (UTC+09:00)
Back To Schedule
Friday, December 4 • 10:40 - 11:30
Acceleration Techniques of Image Preprocessing and Their Effect for Machine Learning System - Kyosuke Hashimoto & Masahiro Ito, Hitachi, Ltd.
Feedback form is now closed.
Deep learning technologies for images are adopted in various kinds of business applications such as autonomous driving and cancer prediction. Preprocessing massive amounts of images in a short time is necessary for building models that are applied to business applications. Popular deep learning frameworks such as PyTorch offer their preprocessing libraries such as torchvision, which are compatible with those deep learning frameworks.

We evaluated the performance of preprocessing libraries and the effect of the preprocessing tuning in deep learning frameworks.

We adopted MLPerf, which is the popular benchmark for machine learning applications, and confirmed that parallelization and queueing could reduce the preprocessing time dramatically in both torchvision and OpenCV case.

However, in PyTorch framework, preprocessing and training are conducted in parallel, the effect of the preprocessing tuning can be small when the training workload is larger than the preprocessing workload.

We concluded that whether we should tune preprocessing or training depends on the purpose of the machine learning system such as parameter search and transfer learning.

avatar for Masahiro Ito

Masahiro Ito

Engineer, Hitachi, Ltd.
Masahiro Ito has been working on development of big data and AI solutions with Apache Hadoop and its related open-source software. He is currently focusing on offering and co-creating MLOps solutions for customers who are going to build enterprise systems. So far, he has written the... Read More →
avatar for Kyosuke Hashimoto

Kyosuke Hashimoto

Researcher, Hitachi, Ltd.
Kyosuke HASHIMOTO is a Researcher of Lumada Data Science Laboratory at Hitachi. He has 7 years of experience in cloud computing, including virtual network and enterprise system management. Currently, he is focusing on the study of development and management of machine learning sy... Read More →

Friday December 4, 2020 10:40 - 11:30 JST
Virtual 3
  AI/ML/DL, Machine and Deep Learning (Framework + Libraries + Platform + Tools)
  • Skill Level Mid-level
  • Technical Talk Yes
  • Presentation Slides Attached Yes