Gemini 3.8 Live Turning voice assistants into "act as you speak": Beyond 97 languages, the real challenge is ensuring uninterrupted background tasks
CoinMeta
09-21 09:50
Ai Focus
Google released Gemini 3.8 on September 15th, as did Live and Gemini 3.8 on the same day, with an update on the 17th. Both models are aimed at real-time voice processing, but their focuses differ: the former emphasizes scalability, low latency, and cost efficiency, while the latter reserves more computing power for complex, multi-step tasks. What they both signal is that voice AI is moving beyond the "ask a question, get an answer" customer service script model, entering a phase where conversations are maintained while tools are called upon to complete tasks.
Helpful
No.Help

On September 15th, Google released Gemini 3.8, as well as Live and Gemini 3.8, with an update to the documentation on the 17th. Both models are aimed at real-time voice processing, but they have different focuses: the former emphasizes scalability, low latency, and cost efficiency, while the latter reserves more computing power for complex, multi-step tasks. What they both signal is that voice AI is moving beyond the "ask a question, get an answer" customer service script model, entering a phase where conversations are maintained while tools are called upon to complete tasks.

What is most noteworthy about this upgrade is not that the voice now sounds more human-like. Gemini 3.8 Live can automatically recognize and switch between 97 languages during conversations, processing audio, images, videos, and text, and can also execute tools or API calls in the background. After a user makes requests such as booking tickets, checking inventory, or organizing documents, the model can first confirm the request, then continue to ask follow-up questions, while waiting for the results from external systems. In the past, voice robots would often fall silent once an interface was called, leaving users unsure whether the system was processing the request or if it had become stuck; the new design aims to turn this waiting period into a more understandable process.

The Extended Thinking version has taken another step forward. Google claims that it can continue to speak while performing reasoning, using early responses like "Let me check that" to confirm that a task has been received, and it also continuously updates progress throughout multi-step processes. This may sound like just a detail of interaction, but in reality, it is crucial for users to decide whether they are willing to entrust complex tasks to voice assistants. A system that remains silent for dozens of seconds would be difficult to use in high-stress scenarios such as banking, business travel, new employee onboarding, or equipment maintenance, even if its final answers are correct.

The list scores indicate the upper limit of capabilities, but they cannot replace actual business acceptance.

The officially announced results provide a reference point for the models. Gemini scored 3.8; in the Artificial Analysis voice-to-voice quality index, it achieved 82.6 points; in the τ- Voice task completion evaluation, it scored 68.6%, and in the Sierra bank scenario τ- Voice evaluation, it scored 35.1%; Big Bench Audio scored 97.7%. The regular Live version ranked second in Speech Agent Arena. It is also mentioned that both models balance task accuracy and dialogue experience in ServiceNow EVA - Bench, with relevant tests conducted in Gemini Enterprise Agent Platform's Live API.

These numbers cannot be directly translated as "68.6% of customer service calls can be handled unattended." Benchmark tests have fixed tasks, tools, and success criteria, but in real-life calls, there may be accents, noise, multiple people speaking at the same time, long pauses, incorrect account information, and sudden changes in speech. The result of 35.1% in the banking scenario actually reminds the market that the ability to communicate naturally and the ability to reliably complete regulated processes are two different skills. Deployers must test separately for recognition, intent understanding, tool invocation, permission verification, final confirmation, and manual intervention in case of exceptions, rather than relying solely on a comprehensive score.

The model cards also specify the boundaries. Both models are based on Gemini and Pro, supporting up to 128K context, with an output limit of 64K. The inputs include audio, images, video, and text. Live is distributed to Gemini API, Gemini, AI Studio, Vertex AI, and Search Live; Extended Thinking also enters Gmail, Docs, Keep, and other Workspace channels. However, the wide range of channels does not mean that all users, regions, and features are fully available at the same time; enterprises should still refer to the actual available permissions, pricing, and data terms of their own accounts.

After voice agents are deployed into the production environment, permissions and recoverability become more important than "appearing human-like".

Speaking while using tools simultaneously can improve efficiency, but it also increases the risk from answering incorrectly to executing errors. If a model mishears a date, it might not just result in a verbal mistake; it could lead to booking the wrong flight. Recognizing “cancel” as “confirm” could trigger a real payment. For this reason, production systems need to separate the state of conversations from the state of transactions: models can discuss options, but high-risk actions should only be executed after clear reiteration, double confirmation, and permission verification. Background tasks must have idempotent designs to ensure that network retries do not result in duplicate orders.

Language auto-switching also requires caution. Having the ability to recognize 97 languages means that the model can cater to a wider range of users, but it does not imply that the model performs consistently in terms of professional terminology, numerical dictation, and regulatory expressions in each language. Companies should measure performance for each target market separately, rather than extrapolating results from English to all languages. Visual input also presents new privacy concerns: when employees allow the model to view screens, documents, or on-site equipment, the images may contain irrelevant personal information, so the scope of data collection and retention policies must be defined in advance.

The scenarios demonstrated by Google include real-time employee onboarding, playing chess on a board, transforming sketches and oral feedback into React components, as well as coordinating multi-step bookings. These demonstrate that the model is capable of integrating visual, vocal, and tool-based interactions into a single chain of interaction. However, the demonstration does not equate to any processes being fully automated and stable. The most logical sequence for implementation would be to start with tasks that are reversible, auditable, and have low failure costs, and then gradually grant permissions for writing and payment functions.

Voice AI has improved in past issues with color, latency, and interruption handling; Gemini 3.8 Live pushes competition to the background for task scheduling. What truly determines whether it can become a core part of a company's processes is not the initial surprise users feel when they hear it "sound like a real person," but rather whether the system can still explain what steps it has completed, allow for human intervention, and avoid repeating the same mistakes on the 1000th occasion when encountering noise, timeouts, or changes in speech.

Tip
$0
Like
0
Save
0
Views 110
HQYC reminds readers to view blockchain rationally, stay aware of risks, and beware of virtual token issuance and speculation. All content on this site represents market information or related viewpoints only and does not constitute any form of investment advice. If you find sensitive content, please click“Report”,and we will handle it promptly。
Submit
Comment 0
Hot
Latest
No comments yet. Be the first!
Related
Binance invests $100 million in Circle: Five-year collaboration aims for growth in USDC; does not mean the landscape of stablecoins has been rewritten
Circle and Binance announced an expansion of their cooperation on September 22: Binance made a strategic equity investment of $100 million in Circle, and both parties signed a new five-year business agreement focusing on promoting, integrating, and expanding the use of USDC in emerging markets. Circle will provide the infrastructure services necessary for holding and using USDC, while Binance plans to enhance the visibility of USDC and its product integration within its platform.
币界网
·2026-09-23 09:56:08
290
Coinbase Assists in Eliminating EvilTokens: Phishing Tools Start Using AI to Select "The Most Vulnerable Victims"
On September 22, Coinbase disclosed that in collaboration with law enforcement and security partners, they dismantled a phishing service platform known as EvilTokens. This platform sold a full set of attack capabilities through a Telegram bot, including email collection, reconnaissance, web email interfaces, and AI automation. The operators also planned to expand the scope of their attacks to Gmail and Okta accounts. The danger of this incident lies not just in the emergence of another set of counterfeit login pages, but in the fact that the attackers entrusted the analysis of relationships after invading emails and the screening of payment targets to AI.
币界网
·2026-09-23 09:54:52
288
Canadian cross-border travel in July continues to show divergence: The recovery pace for American tourists and overseas tourists is not the same
Statistics Canada released cross-border travel data for July on September 22: 3.8599 million Canadian residents returned from overseas, a year-on-year increase of 6.9%; 4.5846 million non-resident visitors entered Canada, a year-on-year increase of 7.9%. After seasonal adjustment, 3.6838 million Canadian residents returned, a month-on-month decrease of 0.3%; 2.6283 million non-resident visitors entered, a month-on-month increase of 1.2%. The summer season is usually the peak period of the year, therefore it is necessary to consider the year-on-year and seasonally adjusted month-on-month figures separately.
币百科
·2026-09-23 09:53:50
45
UK borrowed £18.3 billion in August: Higher than predicted for a single month, but a decrease in debt ratio does not mean a lighter burden
In August, the UK's public sector net borrowing reached 18.3 billion pounds, an increase of 2.9 billion pounds from the same period last year, representing a growth of 19%. This figure is also 3.5 billion pounds higher than what was predicted by the Office for Budget Responsibility. Data released by the Office for National Statistics on September 22 also showed that the cumulative borrowing for the fiscal year from April to August amounted to 77.3 billion pounds, which is 2.2 billion pounds less than in the same period last year, but still 8.1 billion pounds higher than official forecasts.
币百科
·2026-09-23 09:52:50
37
Google Challenges with voices in 32 African languages: AI Understand Lingala and Shona; the difficulties are far more than just a lack of data
On September 22nd, Google Research announced the results of the WAXAL speech recognition challenge. WAXAL is an open-source speech dataset that covers 32 African languages. The competition was organized by Google in collaboration with the data science community Zindi. Participants were tasked with building automatic speech recognition systems based on Lingala and Shona. The project aimed to address a long-overlooked issue: millions of people primarily use local dialects in their daily communication, yet mainstream speech AI often fails to understand them.
CoinMeta
·2026-09-23 09:51:39
40
View More