Apple is Watch I Did It For You Onlinedabbling in AI image-editing with an open-source multimodal AI model.
Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or "MGIE;" a multimodal AI model that can edit images like Photoshop, based on simple text commands.
On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn't announce any big AI plans in the wake of last year's ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed "Apple GPT" and Tim Cook said Apple will be making some major AI announcements later this year.
Whether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.
While there are already AI image editing tools out there, "human instructions are sometimes too brief for current methods to capture and follow," said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or "expressive instruction," as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.
In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, "make this more healthy" infer that "this" is referring to the pepperoni pizza and "more healthy" can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.
In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt "add lightning and make the water reflect the lightning," other models omit the lightning reflection, but MGIE successfully captures it.
MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.
Topics Apple Artificial Intelligence
Mapping Markson by Sadie SteinMemories of the Lakeside by Lorin SteinMaurice Sendak on 'BumbleCrowdsourced Books, Twenties Muses, the World’s Worst Word by Sadie Stein'Quordle' today: See each 'Quordle' answer and hints for May 15Bernie Sanders and Elon Musk fight about billionaires tax on TwitterJoe Biden's website has a hidden message about face masksDear Sally Draper, Maybe Wait a Few Years to Read This by Adam WilsonA Great Stag, BroadRemembering Sendak, Gaining Honors by Sadie SteinMemories of the Lakeside by Lorin SteinBrowning at 200, Publishers at 83 by Sadie SteinWordle today: Here's the answer and hints for May 14It Is Hoped by Sadie Stein'Clone High' review: Joan of Arc and JFK return for a super fun, selfMemories of the Lakeside by Lorin SteinLiterary Paint Chips: Gallery 2 by Leanne Shapton and Ben Schott'Time' cover shows Trump struggling to stay afloat during 'Plague Election'Crowdsourced Books, Twenties Muses, the World’s Worst Word by Sadie Stein6 takeaways from the OpenAI senate hearing Traffic cameras might be unfairly ticketing drivers based on bad math Research note suggests the iPhone 8 will be delayed until 2018 Of course you're getting ads based on your emotions Surgeon transplants a second head onto a rat, wants to work on humans next This firm is creating 10,000 jobs in the U.S. because of Trump 'Stranger Things' Season 2 will have 'more horror' Fishermen claim that Siri saved their lives after their boat began sinking Hulu's cable killer is taking shape — and now includes NBC Michael Moore's plans to go after Trump with a one Hodor admits his 'Game of Thrones' nude scene was 'traumatic' Harry Styles' song 'Sweet Creature' will have you crying millennial pink tears Robin Williams has one last movie coming to the U.S. in 2017 Video game releases that we're psyched about in May 2017 India is too excited about its first high Hands on with Microsoft's $999 Surface Laptop Colin Kaepernick's noble deeds keep making haters look like bitter fools Facebook Messenger's Instant Games just got a serious upgrade Sarah Paulson absolutely lost her mind when she saw Madonna at the Met Gala Outlander Season 4 announces new cast members: Rollo puppies! This teen's $15 homemade prom dress is better than many Met Gala looks
1.3549s , 8207.203125 kb
Copyright © 2025 Powered by 【Watch I Did It For You Online】,Warmth Information Network