Conceptual
Login

Automated Manhwa Translation Pipeline for Low-Resource Languages

How comic translation can be automated end-to-end by chaining an object detector that finds speech bubbles, OCR that extracts the text, a neural machine translation model fine-tuned for a low-resource language pair, and re-overlay of the translated text onto the artwork. Illustrates the design decisions and evaluation metrics involved when composing vision and language models into one multimodal workflow.