Congrats Grok Voice team for topping the leaderboard on EVA-Bench, ServiceNow's voice agent benchmark
๐ Leaderboard:
servicenow.github.io/eva/#reโฆ
Announcement:
x.ai/news/grok-voice-3
@elonmusk
@GrahamSeamans @aidan_bau
@Daniel_Farinax @parker__conrad @wparkerashley
Grok Voice Think Fast 1.0 (@xAI) is truly impressive, it is the first model that crossed 50% score on both accuracy and experience dimensions in EVA-Bench (Enterprise Voice Agents benchmark)
@elonmusk
@Daniel_Farinax @parker__conrad @wparkerashley
๐ Grok Voice Think Fast 1.0 (@xAI) lands on the Pareto frontier on EVA-Bench โ no system in the eval beats it on accuracy without sacrificing experience, or vice versa.
๐ Leaderboard: servicenow.github.io/eva/#reโฆ
@elonmusk #VoiceAgents #ServiceNowResearch #EVABenchย #GrokVoice #xAI
Incredible effort ๐ Real-world voice agent scenarios across 3 enterprise domains, this kind of data simply didn't exist before!
huggingface.co/datasets/Servโฆ
โญ ๐๐ฉ๐-๐๐ฒ๐ป๐ฐ๐ต ๐๐ฎ๐๐ฎ ๐ฎ.๐ฌ: ๐ฏ ๐๐ผ๐บ๐ฎ๐ถ๐ป๐, ๐ญ๐ฎ๐ญ ๐ง๐ผ๐ผ๐น๐, ๐ฎ๐ญ๐ฏ ๐ฆ๐ฐ๐ฒ๐ป๐ฎ๐ฟ๐ถ๐ผ๐
We just published an article detailing the major expansion we have done to the data behind EVA-Bench.
๐๏ธ Data: huggingface.co/datasets/Servโฆ
๐ Article: huggingface.co/blog/ServiceNโฆ
#VoiceAgents #OpenSource #Data #AIResearch #ServiceNowResearch
Sridhar Nemala retweeted
Gloria Fann, MD, and Sridhar Nemala of @ai_curie discuss how to move toward more objective standards in #COPD management in the latest Pulmonology Commentary article. bit.ly/3ViHDqn
