时间:2024-09-20 05:38:18 来源:网络整理编辑:休閑
Apple is dabbling in AI image-editing with an open-source multimodal AI model.Earlier this week, res
Apple is dabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
SEE ALSO:Tim Cook says big Apple AI announcement is coming later this yearWhether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
TopicsAppleArtificial Intelligence
Mom discovers security cameras hacked, kids' bedroom livestreamed2024-09-20 05:29
巴薩歐聯爆冷出局!預定四大皆空 這還不買中鋒 ?2024-09-20 05:09
薑祥佑乘坐11個小時高鐵抵達北京 即將與國安匯合2024-09-20 05:06
薑祥佑乘坐11個小時高鐵抵達北京 即將與國安匯合2024-09-20 04:54
Singapore rolls out video2024-09-20 04:52
大邱主帥:山東隊都是年輕球員 可能會讓比賽變得更困難2024-09-20 04:43
媒體人 :津門虎3名新援還在隔離 待足協確認後官宣2024-09-20 04:21
韋世豪嚴鼎皓或留在廣州隊 留住主力保級希望大增2024-09-20 04:06
Felix the cat just raised £5000 for charity because she's the hero we all need2024-09-20 03:20
傳承 !迷你羅為曼聯U12破門 複刻C羅經典慶祝動作2024-09-20 03:00
Here's what 'Game of Thrones' actors get up to between takes2024-09-20 05:30
韓媒關注世界杯小組對手 :加納臨時主帥合同到期 新帥未定2024-09-20 05:14
諾坎普真被攻陷!近4成竟是客隊球迷 哈維討要解釋2024-09-20 05:09
足協宣布中超國際轉會窗4月15日關閉 國內球員轉會4月29日截止2024-09-20 04:57
Tributes flow after death of former Singapore president S.R. Nathan2024-09-20 04:50
曝李霄鵬有較大的可能性主動提出辭職2024-09-20 04:22
陰謀論?圖赫爾:執法皇馬時 不是每名裁判都敢吹2024-09-20 04:08
傑拉德 :我不會說C羅的壞話 梅西除了進球還會傳球2024-09-20 03:41
U.S. government issues warning on McDonald's recalled wearable devices2024-09-20 03:23
歐聯四強對陣 :西漢姆VS法蘭克福 萊比錫VS流浪者2024-09-20 03:21