时间:2025-04-26 13:02:43 来源:网络整理编辑:綜合
Apple is dabbling in AI image-editing with an open-source multimodal AI model.Earlier this week, res
Apple is dabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
SEE ALSO:Tim Cook says big Apple AI announcement is coming later this yearWhether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
TopicsAppleArtificial Intelligence
Satisfy your Olympics withdrawals with Nike's latest app2025-04-26 12:52
《9號秘事》第五季第一集中的25個足球梗(英格蘭名哨)2025-04-26 12:34
法國決賽會師阿根廷,梅西最後一舞,距登頂一步之遙(世界杯葡萄牙對摩洛哥戰績)2025-04-26 12:23
32歲梅西首談退役時間表 西媒列7大挑戰:完成你就是曆史最佳(內馬爾什麽時候踢球)2025-04-26 12:21
The five guys who climbed Australia's highest mountain, in swimwear2025-04-26 12:20
阿根廷球星阿圭羅正式宣布退役(梅西退役時間2017)2025-04-26 12:07
波蘭名哨確認執法世界杯決賽 ,爭議判罰必將伴隨本屆世界杯始終(英格蘭名哨)2025-04-26 11:47
米蘭鐵衛打破僵局,法國22025-04-26 11:41
Honda's all2025-04-26 11:20
“中國梅西”宣布退役,曾距離留洋一步之遙(梅西宣布退役了嗎知乎)2025-04-26 10:21
Singapore rolls out video2025-04-26 12:55
波蘭名哨確認執法世界杯決賽 ,爭議判罰必將伴隨本屆世界杯始終(英格蘭名哨)2025-04-26 12:31
米蘭鐵衛破僵 ,法國22025-04-26 12:02
現役第一人!梅西一戰創5大紀錄 世界杯再贏一場加冕球王(梅西三次進決賽)2025-04-26 11:46
MashReads Podcast: What makes a good summer read?2025-04-26 11:46
【波盈足球】 巴西球王比利辭世享壽82歲 曾3度奪世界盃冠軍 ( 比利,球王 )2025-04-26 10:57
阿根廷4隊晉級 !國足意外創曆史 ,成亞洲唯一擊敗過四強的球隊(瑞典和克羅地亞誰厲害些)2025-04-26 10:35
梅西 、阿爾瓦雷斯建功,阿根廷成功晉級決賽 !(阿根廷隊vs梅西)2025-04-26 10:33
Metallica to seek and destroy your eardrums with new album this fall2025-04-26 10:32
【波盈足球】 「C羅旋風」吹不動沙烏地?球迷排隊現場冷清 ( 聯賽,球迷 )2025-04-26 10:26