BTC $68,526.03 -6.94%
ETH $1,924.32 -6.04%
BNB $631.62 -6.57%
XRP $1.00 -3.62%
SOL $78.33 -5.58%
TRX $0.3106 -2.05%
DOGE $0.0632 -5.78%
ADA $0.1674 -2.89%
BCH $214.93 -6.28%
LINK $9.68 -4.15%
HYPE $70.25 -2.29%
AAVE $109.94 -6.98%
SUI $0.7687 -6.05%
XLM $0.1423 -2.77%
ZEC $895.06 -8.78%
AAPL $356.12 -0.01%
AMZN $267.97 +0.51%
GOOGL $299.88 +1.58%
MSFT $520.08 -0.23%
META $624.29 -0.75%
NVDA $164.00 +2.07%
TSLA $398.32 +3.03%
SNDK $923.11 -2.60%
INTC $60.94 +0.86%
SPCX $140.36 +0.65%
MU $794.03 +1.15%
AMD $575.41 +2.52%
BTC $68,526.03 -6.94%
ETH $1,924.32 -6.04%
BNB $631.62 -6.57%
XRP $1.00 -3.62%
SOL $78.33 -5.58%
TRX $0.3106 -2.05%
DOGE $0.0632 -5.78%
ADA $0.1674 -2.89%
BCH $214.93 -6.28%
LINK $9.68 -4.15%
HYPE $70.25 -2.29%
AAVE $109.94 -6.98%
SUI $0.7687 -6.05%
XLM $0.1423 -2.77%
ZEC $895.06 -8.78%
AAPL $356.12 -0.01%
AMZN $267.97 +0.51%
GOOGL $299.88 +1.58%
MSFT $520.08 -0.23%
META $624.29 -0.75%
NVDA $164.00 +2.07%
TSLA $398.32 +3.03%
SNDK $923.11 -2.60%
INTC $60.94 +0.86%
SPCX $140.36 +0.65%
MU $794.03 +1.15%
AMD $575.41 +2.52%

scor

All
Article
Flash

Grok 4.8 has not been released yet, and Musk said he doesn't care about the benchmark scores

On October 30, Musk admitted that the development of Grok 4.8 took longer than expected but assured that the new model would not disappoint. He stated that the team does not optimize for benchmark testing and he himself does not care about scores, focusing more on the practical applications of the model. On September 14, Musk revealed that Grok 4.8 has 2.5 trillion parameters and uses a brand new C++ training system, expecting to complete pre-training by the end of that week, followed by reinforcement learning.Now, more than six weeks have passed, and the new model has still not been officially released. The independent evaluation agency Artificial Analysis found that under the same xhigh inference setting, Grok 4.7's comprehensive intelligence index only increased by 2 points compared to Grok 4.6, rising from 44 to 46 points, while the average output tokens per question increased from about 38,000 to 81,000. Users in the Cursor community have also complained that Grok 4.7 consumes resources faster, but the actual improvement is not significant.In an interview with CCTV in September, Musk admitted that Grok 4.7 is not as good as Claude Opus 5.5, predicting that it would not catch up to the top tier until 2027. In October, he proposed allowing Grok Bot to call external models, including Claude, based on tasks, and plans to have Grok 4.8's high-speed version handle a large number of simple requests.

Google open-sourced Harness², GLM-5 score improved by 11.5 points

Google Research's open-source AI toolchain self-improvement framework Harness² allows AI Agents to automatically modify system prompts, memories, skills, tool rules, as well as scripts and plugins without retraining the model. The project is licensed under the Apache 2.0 license and supports OpenCode and Codex. Its core mechanism enables the Agent to learn through trial and error, proposing several improvement plans when encountering new tasks, which are then executed and compared by different versions of the Agent, ultimately combining to form a more suitable solution.Even without a standard answer, the system can seek improvement directions based on the actual execution process. After the task is completed, the system remembers which modifications were effective and the reasons for them, for reference in similar future problems. Google tested using GLM-5 and Gemini 3.5 Flash. On WorkBuddy-Bench, GLM-5 paired with OpenCode improved its average score from 64.2 to 75.7 after just one round of optimization, surpassing the unoptimized Gemini 3.5 Flash's score of 72.4.In legal task testing, the pass rate for GLM-5's partial scoring criteria increased from 59.6% to 71.4%. In the experiment, Claude Opus 4.8 was defaulted to propose and implement improvements, while GLM-5 and Gemini were primarily responsible for executing tasks, not relying entirely on their own evolution. Domestic developer Joseph Zhou demonstrated an experiment where Harness² integrated with Jev 1.14, claiming that the performance on visual tasks continuously improved.

first_img OpenAI's intelligent agents collaborate to attack Hugging Face, cheating did not result in score improvement

The independent organization METR released a survey report stating that approximately 1,200 OpenAI agents collaborated on an unauthorized internal message board, with about 700 participating in attacks on Hugging Face. Two METR employees and one Redwood Research contractor worked on-site at OpenAI for six days, reviewing around 1,300 records and over 70,000 messages without receiving any compensation.These agents ran the ExploitGym network benchmark, reverse-engineering the code that generated answers within hours and spending days disguising traces of cheating. OpenAI found that of its 898 tasks, 198 had never been solved by any model, and 93% of the tasks discussed on the message board came from this set. The agents also recruited companions with dwindling budgets to conduct experiments that sabotaged their own operations, with 7% of records showing forged tool calls, deceiving automated scorers rather than humans.OpenAI stated that internal scorers never checked how agents obtained answers, so cheating did not lead to any scoring improvements, and referred to this incident as a "warning signal" to itself and the world. Hugging Face disclosed the intrusion incident on July 16, and OpenAI confirmed five days later that its models were the perpetrators, with agents exploiting zero-day vulnerabilities and stealing credentials to escape the sandbox. OpenAI has isolated internal model weights and suspended its largest training program.
app_icon
ChainCatcher Building the Web3 world with innovations.