miwo: App for AI Kuzushiji Recognition

News

2022-10-07 "miwo: App for AI Kuzushiji Recognition" was awarded the 2022 Good Design Award.

Release

Android: Google Play

iOS: App Store

On August 30, 2021, the Android and iOS version of the app was officially released. The app is free of charge. Install the app from Google Play or App Store, and use it on your smartphones or tablets. [Read more in Japanese]

Share

Please use the hashtag "#miwoapp" to share information about the miwo app.

Twitter: #miwoapp

Main Features

Show a recognition result in characters / Use the slider for comparing with the book image Show hentaigana and its root character Show a recognition result in text Save recognition results

Before using the app

When using the miwo app, please read the privacy policy and terms of use and notes (in Japanese).

The AI kuzushiji recognition is not perfect. The result of kuzushiji recognition may contain errors, and users should check it by themselves. CODH is not accepting inquiry about the error of kuzushiji recognition. If you would like to obtain the result of kuzushiji transcription without errors, please ask for transcription services provided by companies and individuals.

The AI kuzushiji recognition sends an image to the server operated by CODH, but CODH will not save the image sent to the server nor the result of recognition.

Problems

  1. You may be able to solve the problem by updating your OS to the latest version.
  2. A device that was sold more than four to five years ago is more likely to cause problems both on iOS and Android. We are working to fix these issues.
  3. The app needs permission to access to the camera and the album. When you happened to reject the permissions and could not use the app, please remove the app and install it again.

If the actions above cannot solve the problem, please tell us your situation from the page below. Information about the type of device (model) of the smartphone or the table, or the version of the OS is much appreciated.

Feedback for the "miwo" app

Prototype

The prototype of the miwo app was released for the exhibition program Letter shape @ Keio Museum Commons (KeMCo) from April 19 to June 18, 2021.

Kuzushiji and AI

It is said that only a few thousand people (about 0.01% of the Japanese population) can read Kuzushiji fluently. In order to make historical materials written in Kuzushiji more accessible to the general public, we need to transcribe the abundant amount of documents which would take very long time because of limited human resource. The question is: is it possible to use AI (artificial intelligence) to help transcribe the materials?

The ROIS-DS Center for Open Data in the Humanities (CODH) has developed “KuroNet” Kuzushiji recognition system which can automatically find characters and transcribe text from image using AI object detection technology. Later, we found a better AI Kuzushiji recognition model than KuroNet by collecting wisdom globally in Kaggle Kuzushiji Recognition Competition.

CODH then developed the smartphone app "miwo" so that anyone can use KuroNet easily. The name “miwo” comes from the 14th chapter of The Tale of Genji “miwotsukushi”, referring to waterway signs. Just as the miwotsukushi is a guide for boats in the sea, we aim to make our "miwo" app as a guide for traveling the ocean of historical documents.

AI Kuzushiji Recognition

After the version 1.1 released on October 2022, the miwo app started to use a new AI kuzushiji recognition system RURI (瑠璃). It was newly developed by Tarin Clanuwat (Google Research). In comparison to the previous AI kuzushiji recognition model, RURI's AI object detection technology has been optimized for kuzushiji recognition, and the performance has been improved for the cases when the color or the pattern of the background is complex. In terms of the target of kuzushiji recognition, the performance is best for woodblock-printed books in the Edo period, but it can also be used for old hand-written documents.

RURI was trained on more than one million characters in the “Kuzushiji dataset”, created by the National Institute of Japanese Literature and curated by the CODH. And we also created an expanded dataset to train RURI so that it can recognize additional characters that could not recognize before.

Member

Developer

  • Tarin Clanuwat (Google Research)

Collaborative Developers

  • Asanobu Kitamoto (ROIS-DS CODH / NII)
  • Mikel Bober-Irizar

Collaborative Researchers

  • Siyu Han

Art Direction

  • Rinna♡猫りんな

Awards

  1. Excellent Award in 2021 VLED 'Katte' Award, General Incorporated Association "Code for Japan", 2022-04-22
  2. 2022 Good Design Award, Japan Institute of Design Promotion, 2022-10-07

Grants

miwo app is free of charge to support humanities researches and promote classical Japanese culture. The servers (including GPUs) for the miwo app is operated by ROIS-DS Center for Open Data in the Humanities. The development of the app and the research of AI kuzushiji recognition is also supported by the following grants.

  1. End-to-end Pre-modern Japanese Kuzushiji Recognition with Deep Learning, JSPS kakenhi Grant-in-Aid for Early-Career Scientists (19K13085), PI Tarin Clanuwat
  2. 資料調査のためのオンデバイスくずし字認識, JST ACT-X AI活用で挑む学問の革新と創成(JPMJAX20A4), PI Tarin Clanuwat
  3. Data-Driven Reconstruction and Integrated Analysis of the Past World Using the Infrastructure for Historical Big Data, JSPS Kakenhi Grant-in-Aid for Scientific Research (A) (19H01141), PI Asanobu Kitamoto

Achievement

Since the release, 1,037,027 images have been recognized as of 2022-12-07T16:26:26+09:00.

News

2022-10-26

miwo version 1.1 was released.

2022-10-07

miwo was awarded '2022 Good Design Award'.

2021-08-30

miwo version 1.0 was released.