Back to List
Meituan LongCat Releases General 365: A New Benchmark for AI Reasoning Evaluation
Industry NewsMeituanAI BenchmarkingReasoning Models

Meituan LongCat Releases General 365: A New Benchmark for AI Reasoning Evaluation

The Meituan LongCat team has officially launched General 365, a rigorous new benchmark designed to evaluate the reasoning capabilities of artificial intelligence models. In an initial assessment of 26 mainstream models, the results reveal a significant performance gap in the industry. Google's Gemini 3 Pro, currently regarded as the strongest performer, achieved an accuracy rate of only 62.8%. Notably, the vast majority of the models tested failed to reach the 60% passing threshold, highlighting the intense difficulty of the General 365 evaluation. This release by Meituan sets a new standard for measuring high-level cognitive tasks in AI, suggesting that current large language models still face substantial hurdles in complex reasoning scenarios.

美团技术团队

Key Takeaways

  • New Evaluation Standard: Meituan's LongCat team has introduced General 365, a benchmark specifically focused on reasoning capabilities.
  • Industry Performance Gap: Out of 26 mainstream models tested, the majority failed to achieve a score of 60%.
  • Top Performer: Gemini 3 Pro currently leads the benchmark but only managed an accuracy rate of 62.8%.
  • Rigorous Testing: The benchmark is designed to be a "new yardstick," indicating a higher level of difficulty than previous evaluation methods.

In-Depth Analysis

The Launch of General 365 and the Reasoning Challenge

The Meituan LongCat team has officially released General 365, positioning it as a critical new benchmark for the AI industry. The primary objective of this tool is to provide a "new yardstick" for reasoning evaluation, moving beyond simple task completion to test the underlying logic and cognitive depth of large language models. The introduction of General 365 comes at a time when the industry is seeking more nuanced ways to differentiate between models that can perform basic functions and those that truly possess advanced reasoning skills.

According to the data provided by the LongCat team, the benchmark is intentionally designed to be challenging. By focusing on reasoning, Meituan is targeting one of the most difficult frontiers in AI development. The name "General 365" suggests a comprehensive, perhaps year-round or all-encompassing approach to testing, though the core focus remains strictly on the accuracy of reasoning outputs across a wide variety of scenarios.

Comparative Performance of Mainstream Models

The initial testing phase of General 365 involved 26 of the most prominent AI models currently available in the market. The results of these tests serve as a sobering reality check for the state of AI reasoning. Even the most advanced models struggled to maintain high accuracy levels when subjected to the General 365 criteria.

Gemini 3 Pro, which is identified as the current industry leader in terms of raw performance, reached an accuracy of 62.8%. While this score places it at the top of the list among the 26 models tested, it also highlights how much room for improvement remains. Perhaps more significant is the finding that the "passing line" of 60% was out of reach for the vast majority of models. This failure to meet a basic 60% threshold suggests that many current AI architectures, while proficient in language generation, still lack the robust reasoning frameworks required to navigate the complexities presented by the General 365 benchmark.

Industry Impact

The release of General 365 by Meituan's LongCat team is likely to have a profound impact on how AI models are developed and marketed. By establishing a benchmark where even the strongest models barely exceed a 60% accuracy rate, Meituan is forcing a shift in the industry's focus. Developers may now be incentivized to prioritize reasoning and logical consistency over mere fluency or parameter count.

Furthermore, the fact that a major technology player like Meituan is contributing to the evaluation ecosystem suggests a move toward more transparent and standardized testing. As models continue to evolve, benchmarks like General 365 will be essential for identifying which systems are truly capable of handling complex, real-world problem-solving. This benchmark sets a high bar, serving as both a challenge to current AI leaders and a roadmap for future research and development in the field of artificial intelligence reasoning.

Frequently Asked Questions

Question: What is the General 365 benchmark?

General 365 is a new reasoning evaluation benchmark released by the Meituan LongCat team. It is designed to serve as a rigorous standard for testing the logical and reasoning capabilities of mainstream AI models.

Question: Which model performed the best on the General 365 test?

According to the initial results, Gemini 3 Pro is the top-performing model on the General 365 benchmark, achieving an accuracy rate of 62.8%.

Question: How did most models perform on this new benchmark?

The majority of the 26 mainstream models tested failed to reach the 60% accuracy mark, which is considered the passing line for the General 365 evaluation.

Related News

Meituan Unveils LongCat-2.0: A 1.6 Trillion Parameter Model Optimized for Agentic Coding on Domestic Clusters
Industry News

Meituan Unveils LongCat-2.0: A 1.6 Trillion Parameter Model Optimized for Agentic Coding on Domestic Clusters

Meituan's technology team has officially released LongCat-2.0, a landmark large language model featuring 1.6 trillion parameters. This model distinguishes itself as the first of its scale to complete the entire training and inference lifecycle on a domestic computing cluster of 50,000 cards. Designed specifically for Agentic Coding, LongCat-2.0 supports a native 1M long-context window and was pre-trained from scratch. With a dynamic activation range between 33B and 56B (averaging 48B), the model is engineered to provide high efficiency and stability in complex code understanding, generation, and execution tasks. This release marks a significant milestone for domestic AI infrastructure and the evolution of autonomous coding agents.

Meituan Technical Team Presents Selected Academic Papers at ICML 2026 to Advance Machine Learning Research
Industry News

Meituan Technical Team Presents Selected Academic Papers at ICML 2026 to Advance Machine Learning Research

The Meituan Technical Team has announced its participation in the International Conference on Machine Learning (ICML) 2026, one of the world's most influential academic gatherings in the field. ICML 2026 serves as a critical platform for discussing the future challenges and core issues facing machine learning development. Meituan's involvement includes the presentation of selected academic papers that have been evaluated for their significant theoretical value and practical impact. By contributing to this top-tier conference, the Meituan Technical Team aims to push the boundaries of the field and help lead future research directions. This engagement highlights the team's commitment to high-quality research that addresses both the fundamental questions of machine learning and its real-world applications, reinforcing their position within the global technical community.

Meituan Fulfillment AI Team Showcases LLM-Based Agent Innovations and Self-Evolving Systems at ACL 2026
Industry News

Meituan Fulfillment AI Team Showcases LLM-Based Agent Innovations and Self-Evolving Systems at ACL 2026

The Meituan Fulfillment AI Algorithm Team has unveiled its latest advancements in Large Language Model (LLM)-based Agent technology at a special session for the ACL 2026 conference. Focused on empowering Meituan's fulfillment business, the team is developing a self-evolving Agent operating system. Their research, which has resulted in dozens of publications in top-tier venues like ACL and EMNLP, spans critical domains including Continuous Pre-training (CPT), Post-training, Agentic Reinforcement Learning (RL), and Multimodal Understanding. This initiative represents a significant step in integrating frontier AI research with large-scale industrial fulfillment operations, aiming to enhance efficiency and system autonomy through advanced machine learning techniques.