时间:2025-04-02 18:21:49 来源:网络整理编辑:探索
Apple is dabbling in AI image-editing with an open-source multimodal AI model.Earlier this week, res
Apple is dabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
SEE ALSO:Tim Cook says big Apple AI announcement is coming later this yearWhether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
TopicsAppleArtificial Intelligence
Tributes flow after death of former Singapore president S.R. Nathan2025-04-02 17:50
津門虎隊內傷兵滿營 3場比賽傷了4名球員2025-04-02 17:11
曝伊卡爾迪同意冬窗加盟尤文 巴黎不接受先租後買2025-04-02 16:54
雙喜臨門 !登貝萊與女友完婚 下周將降薪續約巴薩2025-04-02 16:51
There's a big piece of fake chicken stuck to this phone case2025-04-02 16:50
一老一小 ?C羅獲評最佳35+球員 哈蘭德拿的卻是U212025-04-02 16:39
津門虎隊員關注中甲最後一輪大戰 提前為附加賽做心理預案2025-04-02 16:15
國安平深圳止頹勢 “新隊長”張玉寧成最大亮點2025-04-02 16:13
Twitter grants everyone access to quality filter for tweet notifications2025-04-02 15:55
京媒:一場平局對現在的國安可以接受 避免尷尬三連敗2025-04-02 15:51
Singapore rolls out video2025-04-02 18:14
國安VS深圳首發 :安德森PK卡爾德克 金特羅替補2025-04-02 17:43
加油瑞貝卡!女性裁判員將執法足總杯 創造新曆史2025-04-02 17:36
海港被全華班廣州隊逼平 兩輪不勝無緣再談爭冠2025-04-02 17:33
Two astronauts just installed a new parking spot on the International Space Station2025-04-02 17:16
加油瑞貝卡!女性裁判員將執法足總杯 創造新曆史2025-04-02 17:13
本土第一中鋒!張玉寧戲耍後衛破門4場轟3球 賽季斬獲9球2025-04-02 17:12
意媒:國米總部並未被搜查 稅警隻是造訪收集材料2025-04-02 16:47
This coloring book is here for all your relationship goals2025-04-02 16:31
UEFA俱樂部排名:拜仁力壓英超三傑 梅羅連席霸座2025-04-02 16:16