时间:2025-04-02 09:05:18 来源:网络整理编辑:綜合
Apple is dabbling in AI image-editing with an open-source multimodal AI model.Earlier this week, res
Apple is dabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
SEE ALSO:Tim Cook says big Apple AI announcement is coming later this yearWhether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
TopicsAppleArtificial Intelligence
Olympics official on Rio's green diving pool: 'Chemistry is not an exact science'2025-04-02 08:43
2日賠率 :曼聯對阿森納或丟分 熱刺小勝布倫特福德2025-04-02 07:38
朗尼克輪盤賭:C羅變導遊服務生? 博格巴穿粉紅芭蕾舞裙?2025-04-02 07:11
西媒點評武磊 :有望重拾信心 但關鍵動作仍不準確2025-04-02 07:03
Uber's $100M settlement over drivers as contractors may not be enough2025-04-02 07:01
廣州隊爭冠難度很大三歸化國腳將回歸 費南多很可能歸隊2025-04-02 06:50
申花全隊為邱芳芳打氣 :願你打贏生命之戰2025-04-02 06:45
另類塌房?梅西斥資興建酒店遭市政執法 勒令拆除2025-04-02 06:34
Man stumbles upon his phone background in real life2025-04-02 06:29
曼聯與萊比錫緋聞不斷 這一次輪到13球9助攻的他了2025-04-02 06:19
Two states took big steps this week to get rid of the tampon tax2025-04-02 09:01
貝克漢姆重返夢劇場觀戰 曼聯社媒發文:歡迎回家2025-04-02 08:54
媒體人 :中超爭冠組廣州賽區基本確定對球迷開放2025-04-02 08:30
大V熱議李霄鵬執教國足 :莫要飛蛾撲火 最危險考驗客戰越南2025-04-02 08:20
Two states took big steps this week to get rid of the tampon tax2025-04-02 08:07
歐冠抽簽:13日19時定乾坤 客場進球數優勢已取消2025-04-02 07:57
濱岩談C羅點讚風波 :非本人所為 應是團隊在操作2025-04-02 07:02
曝李鐵集訓期間暴瘦20斤 球迷:操心的事太多了2025-04-02 06:27
What brands need to know about virtual reality2025-04-02 06:25
埃弗拉懟卡拉格 :你隻踢過775場比賽 而C羅打進801球2025-04-02 06:19