Back to List
Meituan LongCat Team Launches General 365: A Rigorous New Benchmark for AI Reasoning Evaluation
Industry NewsMeituanAI BenchmarkingReasoning Models

Meituan LongCat Team Launches General 365: A Rigorous New Benchmark for AI Reasoning Evaluation

The Meituan LongCat team has officially released General 365, a new evaluation benchmark designed to test the reasoning capabilities of large language models. In an initial assessment involving 26 mainstream models, the benchmark revealed that current AI technology still faces significant challenges in complex reasoning. Gemini 3 Pro, identified as the top performer in the test, achieved an accuracy rate of only 62.8%. Furthermore, the majority of the models tested failed to reach a 60% accuracy threshold, which is considered the passing mark. This release by Meituan aims to establish a more demanding standard for the industry, highlighting the performance gap in existing AI reasoning models.

美团技术团队

Key Takeaways

  • Meituan's LongCat team has introduced General 365, a new benchmark specifically for reasoning evaluation.
  • Evaluation of 26 mainstream AI models shows a significant struggle with the benchmark's requirements.
  • Gemini 3 Pro emerged as the leader but only secured a 62.8% accuracy rate.
  • Most tested models failed to reach the 60% passing threshold, indicating a high level of difficulty.

In-Depth Analysis

The Introduction of General 365

The Meituan LongCat team has officially unveiled General 365, a benchmark that seeks to redefine how reasoning is measured in the field of artificial intelligence. By positioning this tool as a "new scale" for reasoning evaluation, the team addresses the need for more rigorous testing environments. The release comes at a time when many models claim high performance on existing benchmarks, yet General 365 suggests that true reasoning capabilities may still be lacking across the industry. The focus of this benchmark is to provide a clear, quantifiable measure of how well models can navigate complex logical tasks.

Benchmarking the Giants: Gemini 3 Pro and the 60% Threshold

The results from the initial testing phase of General 365 provide a sobering look at the current state of AI. Out of 26 mainstream models evaluated, the performance levels were notably lower than what is often seen in other standardized tests. Gemini 3 Pro, which is currently regarded as one of the most powerful models available globally, managed to achieve an accuracy of 62.8%. While this placed it at the top of the list, the score itself highlights the difficulty of the General 365 benchmark.

Perhaps more significant is the finding that the vast majority of the 26 models could not reach the 60% mark. In the context of this evaluation, 60% is treated as the "passing line," and the failure of most mainstream models to meet this standard suggests that current reasoning architectures are not yet optimized for the specific challenges presented by General 365. This gap between the leading model and the rest of the field, combined with the overall low scores, underscores the rigorous nature of Meituan's new evaluation framework.

Industry Impact

The release of General 365 by Meituan's LongCat team is significant for the AI industry as it introduces a more stringent set of criteria for reasoning. By demonstrating that even the most advanced models like Gemini 3 Pro struggle to exceed a 60% accuracy rate by a wide margin, the benchmark exposes the limitations of current large language models. This is likely to push developers and researchers to focus more heavily on the logical and reasoning components of AI, rather than just linguistic fluency or pattern recognition. As a new "ruler" for the industry, General 365 provides a clear target for future model iterations and sets a high bar for what constitutes a "passing" grade in AI reasoning.

Frequently Asked Questions

Question: What is the primary purpose of Meituan's General 365?

General 365 is a reasoning evaluation benchmark released by the Meituan LongCat team. Its purpose is to serve as a new, more rigorous standard for measuring the reasoning capabilities of mainstream AI models.

Question: How did the top-performing models fare on this benchmark?

In a test of 26 mainstream models, Gemini 3 Pro performed the best with an accuracy rate of 62.8%. However, most other models failed to reach the 60% passing threshold, indicating that the benchmark is highly challenging for current AI technology.

Question: How many models were included in the initial General 365 evaluation?

The Meituan LongCat team tested a total of 26 mainstream models to establish the initial performance data for the General 365 benchmark.

Related News

Meituan Launches LongCat-2.0: A Trillion-Parameter Model Trained on a 50,000-Card Domestic Computing Cluster
Industry News

Meituan Launches LongCat-2.0: A Trillion-Parameter Model Trained on a 50,000-Card Domestic Computing Cluster

Meituan's technology team has officially unveiled LongCat-2.0, a groundbreaking trillion-parameter model that marks a significant milestone in AI development. As the industry's first model of this scale to complete its entire training and inference lifecycle on a domestic computing cluster of 50,000 cards, LongCat-2.0 features 1.6 trillion total parameters with a dynamic activation range. Pre-trained from scratch, the model natively supports a 1M long context window. Its architecture is specifically engineered to excel in Agentic Coding tasks, focusing on the efficient and stable understanding, generation, and execution of code. This release highlights the growing capability of domestic infrastructure to support massive-scale AI workloads and specialized coding applications.

Meituan Technical Team Showcases Research Excellence at ICML 2026: A Selection of Academic Papers
Industry News

Meituan Technical Team Showcases Research Excellence at ICML 2026: A Selection of Academic Papers

The Meituan Technical Team has announced its selection of academic papers for ICML 2026, one of the most prestigious international conferences in the field of machine learning. ICML serves as a critical platform for addressing the future challenges and core issues of the industry. By focusing on research that offers both significant theoretical value and practical impact, the conference aims to drive the development of machine learning and lead future research directions. Meituan's participation underscores its commitment to contributing high-quality, cutting-edge research to the global scientific community, highlighting the synergy between theoretical advancement and real-world application in the evolving AI landscape.

Meituan Technical Team Showcases Advanced Research in Search and Recommendation Systems at Global AI Conferences
Industry News

Meituan Technical Team Showcases Advanced Research in Search and Recommendation Systems at Global AI Conferences

Meituan's Business R&D Platform and the Search & Recommendation ASX (Agentic System X) team have recently shared insights from their latest research papers accepted by top-tier AI conferences. The team focuses on developing Large Language Model (LLM) based Agent technology systems, specifically targeting LLM post-training, Agentic Reinforcement Learning, and multi-modal understanding. With dozens of papers published in prestigious venues like ICLR, NeurIPS, CVPR, and AAAI, Meituan is positioning itself at the forefront of AI innovation. This report highlights the team's progress in building sophisticated agentic systems to enhance search and recommendation capabilities, featuring a selection of six high-quality papers that demonstrate their deep technical cultivation in the field of artificial intelligence.