๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

cv usk
@cv_usk
AI / Software Research Notes AI Agent, LLMOps, MLOps, Software Architecture ๆŠ•็จฟใฏๅ€‹ไบบใฎๆ„่ฆ‹ใงใ™ใ€‚
๊ฐ€์ž… May 2026
286 ํŒ”๋กœ์ž‰ ์ค‘    469 ํŒฌ
TL;DR: One encoder and one JSON schema turn documents, images, audio and video into structured, grounded text. It posts the top reported score on document parsing. Youtu-Parsing-Omni: One Encoder, One Schema, All Modalities Key points ใƒป๐Ÿงฉ A single shared Transformer encodes images, audio and video (initialized from Qwen3-0.6B-Base) ใƒปโฑ Rotary positions split into time/height/width, so video and sound share one timeline ใƒป๐Ÿ“ OmniSchema puts 10 tasks (documents, chemistry, sheet music, charts, audio, video...) into one JSON format ใƒป๐Ÿ” Post-training combines OSAD distillation from a self-refreshing teacher with schema-aware RLVR ใƒป๐Ÿ“„ OmniDocBench v1.6: 96.96 overall, the highest reported ใƒป๐ŸŽฌ OmniParsingBench: 75.08, best among open-weight models; text-rich video 75.62 vs 65.36 Gemini-3-Pro still scores higher at 77.44, and it trails Qwen3-Omni on Video-MME-v2. ASR is also a weak spot. Still, a promising step toward an "any-input parser" front end for LLM agents. #OmniModal# #DocumentParsing#
๋” ๋ณด๊ธฐ