Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learning
Researchers have developed a novel self-prompting method for editing scene text in images, addressing limitations of existing approaches that neglect visual details of target regions and are constrained by pre-trained glyph encoders. This new technique constructs style and glyph prompts directly from the image, leveraging the in-context learning capabilities of a Multi-Modal Diffusion Transformer (MM-DiT). The method achieves open-vocabulary and style-consistent text editing, demonstrating state-of-the-art performance across various languages. AI