MIT Expertise Assessment bought to check out Astra in a closed-door dwell demo final week. It was a surprising expertise, however there’s a gulf between polished promo and dwell demo.
Astra makes use of Gemini 2.0’s built-in agent framework to reply questions and perform duties by way of textual content, speech, picture, and video, calling up current Google apps like Search, Maps, and Lens when it must. “It’s merging collectively a number of the strongest data retrieval techniques of our time,” says Bibo Xu, product supervisor for Astra.
Gemini 2.0 and Astra are joined by Mariner, a brand new agent constructed on high of Gemini that may browse the online for you; Jules, a brand new Gemini-powered coding assistant; and Gemini for Video games, an experimental assistant that you would be able to chat to and ask for suggestions as you play video video games.
(And let’s not overlook that within the final week Google DeepMind additionally introduced Veo, a brand new video era mannequin; Imagen 3, a brand new model of its picture era mannequin; and Willow, a brand new form of chip for quantum computer systems. Whew. In the meantime, CEO Demis Hassabis was in Sweden yesterday receiving his Nobel Prize.)
Google DeepMind claims that Gemini 2.0 is twice as quick because the earlier model, Gemini 1.5, and outperforms it on quite a lot of normal benchmarks, together with MMLU-Professional, a big set of multiple-choice questions designed to check the skills of huge language fashions throughout a variety of topics, from math and physics to well being, psychology, and philosophy.
However the margins between top-end fashions like Gemini 2.0 and people from rival labs like OpenAI and Anthropic are actually slim. Nowadays, advances in giant language fashions are much less about how good they’re and extra about what you are able to do with them.
And that’s the place brokers are available in.
Arms on with Undertaking Astra
Final week I used to be taken by means of an unmarked door on an higher flooring of a constructing in London’s King’s Cross district right into a room with robust secret-project vibes. The phrase “ASTRA” was emblazoned in large letters throughout one wall. Xu’s canine, Charlie, the venture’s de facto mascot, roamed between desks the place researchers and engineers have been busy constructing a product that Google is betting its future on.
