Back to list
Meituan LongCat Team Launches General 365 Benchmark: Gemini 3 Pro Leads with 62.8% Accuracy
Industry NewsMeituanLongCatAI Benchmarking

Meituan LongCat Team Launches General 365 Benchmark: Gemini 3 Pro Leads with 62.8% Accuracy

The Meituan LongCat team has officially introduced General 365, a new benchmark designed to evaluate the reasoning capabilities of large language models. In a comprehensive assessment of 26 mainstream models, the results reveal a significant performance gap in the industry. Gemini 3 Pro, currently identified as the top-performing model, achieved an accuracy rate of 62.8%. However, the benchmark results highlight a broader challenge: the vast majority of tested models failed to reach the 60% accuracy threshold. This release establishes a new standard for measuring AI intelligence and underscores the current limitations of complex reasoning in even the most advanced AI systems.

美团技术团队

Key Takeaways

  • New Evaluation Standard: Meituan's LongCat team has officially released General 365, a benchmark specifically designed to measure AI reasoning.
  • Gemini 3 Pro Performance: Among 26 mainstream models tested, Gemini 3 Pro emerged as the leader with an accuracy rate of 62.8%.
  • Industry-Wide Challenge: The majority of models tested failed to reach a 60% accuracy score, indicating a significant gap in current reasoning capabilities.
  • Comprehensive Testing: The benchmark results are based on the real-world performance of 26 different mainstream AI models.

In-Depth Analysis

The Introduction of General 365 by Meituan LongCat

The Meituan LongCat team has officially unveiled General 365, a new evaluation benchmark that aims to set a more rigorous standard for the artificial intelligence industry. As large language models (LLMs) continue to proliferate, the need for precise and challenging evaluation tools has become paramount. General 365 is positioned as a "new yardstick" for reasoning, focusing on the ability of models to process complex logical tasks rather than simply retrieving information or performing basic linguistic functions. By introducing this benchmark, the Meituan technical team provides a structured framework to differentiate between models that possess genuine reasoning depth and those that do not.

Analyzing the Performance of Gemini 3 Pro

In the initial testing phase conducted by the LongCat team, 26 mainstream models were subjected to the General 365 evaluation. The results identify Google's Gemini 3 Pro as the current industry leader in terms of reasoning accuracy. However, the data also reveals the difficulty of the benchmark itself; Gemini 3 Pro achieved an accuracy rate of 62.8%. While this score places it at the top of the current field, it also suggests that even the most advanced AI models currently available have significant room for growth when it comes to mastering complex reasoning. The 62.8% figure serves as a high-water mark for the industry, yet it remains far from perfect, highlighting the "frontier" nature of AI reasoning tasks.

The 60% Accuracy Threshold

Perhaps the most significant finding from the release of General 365 is the overall performance distribution across the 26 tested models. The Meituan LongCat team noted that the vast majority of these mainstream models were unable to reach a 60% accuracy level. In many academic and professional contexts, 60% is often viewed as a baseline for a "passing" grade or a minimum standard of competency. The fact that most models failed to meet this threshold suggests that complex reasoning remains a formidable obstacle for the current generation of AI. This widespread failure to reach the 60% mark underscores the necessity of benchmarks like General 365, which can expose the limitations of models that might otherwise appear highly capable in simpler evaluation scenarios.

Industry Impact

The release of General 365 is likely to have a profound impact on how AI development is prioritized. By establishing a benchmark where even the strongest models score in the low 60s, Meituan is pushing the industry toward more meaningful and difficult evaluations. This shift encourages developers to move beyond optimizing for simple benchmarks and instead focus on the core logical capabilities that define true intelligence. Furthermore, the transparency provided by testing 26 different models allows for a clearer understanding of where the industry stands as a whole. As models strive to surpass the 60% mark and challenge Gemini 3 Pro's lead, General 365 will serve as a critical tool for tracking the evolution of AI reasoning.

Frequently Asked Questions

Question: What is the primary purpose of the General 365 benchmark?

General 365 was developed by the Meituan LongCat team to serve as a new standard for evaluating the reasoning capabilities of large language models, providing a more accurate measure of AI intelligence.

Question: How many models were tested in the initial General 365 report?

The Meituan LongCat team tested 26 mainstream AI models to provide a comprehensive overview of the current state of reasoning performance in the industry.

Question: Which model currently holds the highest score on General 365?

Gemini 3 Pro currently holds the highest accuracy score on the General 365 benchmark, with a recorded accuracy of 62.8%.

Related News

The Race for AI Web Addresses: Why .agent and .agi Are Becoming Tech’s Hottest New Top-Level Domains
Industry News

The Race for AI Web Addresses: Why .agent and .agi Are Becoming Tech’s Hottest New Top-Level Domains

For the first time in years, the Internet Corporation for Assigned Names and Numbers (ICANN) has officially opened the application window for new generic top-level domains (gTLDs), revealing 1,615 applications from entities worldwide. Among the most intensely contested namespaces are artificial intelligence suffixes, specifically .agent and .agi, alongside terms like .intelligence and .superintelligence. Leading technology and AI frontrunners, including OpenAI and Meta, are actively competing for control of these generic extensions while simultaneously submitting bids for their own branded TLDs such as .chatgpt and .meta. This massive expansion reflects the pivotal role digital identity plays in the agentic AI era. However, the lengthy evaluation and contention resolution procedures mean that none of these proposed domains will be approved or delegated until next year at the earliest.

Temasek Identifies AI Trade Reversal and Rising Bond Yields as Major Global Market Risks for 2027
Industry News

Temasek Identifies AI Trade Reversal and Rising Bond Yields as Major Global Market Risks for 2027

Temasek International has identified an unwinding of the artificial intelligence trade alongside inflation-driven increases in bond yields as the primary risks confronting global markets heading into 2027. Speaking at the Milken Asia Summit in Singapore, Chief Investment Officer Rohit Sipahimalani observed that while an AI reversal does not appear imminent, market participants should anticipate potential volatility. Elevated long-term bond yields threaten equities by driving up discount rates applied to future earnings and enhancing the relative appeal of fixed income. Despite these structural headwinds, Temasek remains committed to expanding its AI footprint, aiming to scale its AI allocation from 6% to as much as 15% of its total portfolio by 2031, with a strategic emphasis on liquid public market positions to enable swift portfolio adjustments.

LTM and Google Cloud Expand Partnership to Boost Gemini Enterprise via Center of Excellence
Industry News

LTM and Google Cloud Expand Partnership to Boost Gemini Enterprise via Center of Excellence

In an expanded collaboration with Google Cloud, LTM has announced initiatives aimed at advancing Gemini Enterprise adoption and execution. Under this deepened partnership, LTM will establish a dedicated Gemini Enterprise Center of Excellence designed to centralize technical expertise and implementation frameworks. In addition to creating the center, LTM stated it will actively strengthen its specialist talent base and scale delivery capabilities for Gemini Enterprise. The initiative focuses on building institutional competencies, enhancing delivery reliability, and ensuring enterprise-grade support for Google Cloud's AI technology ecosystem without introducing third-party or unverified dependencies.