时间:2025-04-03 05:49:43 来源:网络整理编辑:熱點
Apple is dabbling in AI image-editing with an open-source multimodal AI model.Earlier this week, res
Apple is dabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
SEE ALSO:Tim Cook says big Apple AI announcement is coming later this yearWhether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
TopicsAppleArtificial Intelligence
'Rocket League' Championship Series Season 2 offers $250,000 prize pool2025-04-03 05:35
Killer Mike apologized after the NRA used his words to bash the March for Our Lives2025-04-03 05:26
People brought their pups to 'Isle of Dogs,' and here are the photos2025-04-03 04:59
After YouTube ban, gun vloggers find a new home on Pornhub2025-04-03 04:38
Daughter gives her 1002025-04-03 04:38
There's a house full of creepy statues for sale in Detroit, and we have questions2025-04-03 04:21
Zoosk Labs is trying to build the HQ of dating apps2025-04-03 04:19
Verge cryptocurrency hack shows, no, blockchain isn't invincible2025-04-03 04:16
Visualizing July's astounding global temperature records2025-04-03 03:35
Quick! Snatch up a Nintendo Switch for 20% off before it's too late!2025-04-03 03:10
Olympian celebrates by ordering an intimidating amount of McDonald's2025-04-03 05:36
Australian heroes brave floodwaters to save a giant spider2025-04-03 05:34
Ryan Reynolds can't help himself when it comes to rumors about his marriage2025-04-03 05:26
Snapchat adds augmented reality Easter egg hunt to Snap Maps2025-04-03 05:24
Uber's $100M settlement over drivers as contractors may not be enough2025-04-03 04:49
The NBA knows you only care about the fourth quarter. This proves it.2025-04-03 04:15
Shia LaBeouf missed out on some big movie roles2025-04-03 03:54
Stormy Daniels talks Donald Trump in '60 Minutes' interview2025-04-03 03:50
Photos show the Blue Cut fire blazing a path of destruction in California2025-04-03 03:34
The NBA knows you only care about the fourth quarter. This proves it.2025-04-03 03:32