时间:2025-04-03 11:18:24 来源:网络整理编辑:綜合
Apple is dabbling in AI image-editing with an open-source multimodal AI model.Earlier this week, res
Apple is dabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
SEE ALSO:Tim Cook says big Apple AI announcement is coming later this yearWhether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
TopicsAppleArtificial Intelligence
This coloring book is here for all your relationship goals2025-04-03 10:56
《各位國民》資深騙子崔始源開始反擊!收視率UP !2025-04-03 10:17
《當她戀愛時》甜蜜定檔 輕鬆甜蜜解鎖戀愛新技能2025-04-03 10:09
《一場遇見愛情的旅行》熱播中 景甜原音演繹表現亮眼2025-04-03 09:43
WhatsApp announces plans to share user data with Facebook2025-04-03 09:37
Are dating apps getting too niche?2025-04-03 09:36
《青春鬥》曝“青春群像”版海報 鄭爽領銜青年成長史2025-04-03 09:16
汪汐潮新劇《鳳弈》熱播 化身蠢萌反派霸氣歸來2025-04-03 09:12
Satisfy your Olympics withdrawals with Nike's latest app2025-04-03 08:54
騰訊新聞出品深度紀錄片《明天之前》上線,首日全網播放量2481萬2025-04-03 08:34
More than half of women in advertising have faced sexual harassment, report says2025-04-03 11:08
經超《白發》收視攀升 傅籌情話不斷皆是柔情2025-04-03 11:02
“林燦”演活《破冰行動》毒辣劊子手,宋撼寰熱心公益 為自閉症群體發聲2025-04-03 10:43
《青春鬥》今晚真誠收官 聚焦社會現實紀錄時代縮影2025-04-03 10:42
Nate Parker is finally thinking about the woman who accused him of rape2025-04-03 09:43
《平凡的榮耀》深耕社會現狀 聚焦現實進行深度創作2025-04-03 09:41
黃奕新劇上線 反串“小鮮肉版”許仙太撩人2025-04-03 09:27
楊旭文《反恐特戰隊之天狼》今晚收官 “狼性”少年形象頻獲讚2025-04-03 09:24
Cat gets stuck in the most awkward position ever2025-04-03 08:38
《親愛的婚姻》今晚湖北開播 劉濤馬天宇挑戰現實話題劇2025-04-03 08:36