Auditing and Repairing LLM-as-Judge Failures in a Production Text-to-SQL Pipeline
Production text-to-SQL pipelines often end with an LLM-as-judge whose agreement with human annotators has never actually been measured.
논문·연구
5/17쪽Bringing AI to Autonomous Systems -- From Cognition to Collective Intelligence
The purpose of this article is to highlight the central role of autonomous systems as the ultimate stage in the development of AI, to explain the underlying technical challenges…
ScopeBench: Do Agents Preserve Engagement Boundaries Under Goal Pressure?
Agents are increasingly deployed with real autonomy in web application and network penetration testing, where a single out-of-scope action can breach a client's engagement…
When Is a Multi-Agent Code Judge Actually Grounded? Two Label-Free Measurements, and a Judge That Declines to Guess
When one language model judges whether another's code is correct, it does not report the absence of evidence.
Bridging LLM Agents and Data Spaces: An Architectural Mediation Approach using the Model Context Protocol
Data Spaces enable sovereign and governed data sharing across organizational boundaries, but their integration with AI agents remains challenging due to mismatches between…
Stealth Apart, Harm Together: Skill Cascading Attacks on Skill-Based Agent Systems
A skill is a modular package of natural-language instructions, executable scripts, and reference resources that an agent can load at runtime to extend its capabilities for a…
A Synthetic Ground-Truth Framework for the Evaluation of Explainable AI Methods
Evaluating explainable Artificial Intelligence (XAI) methods is a challenging task due to the lack of reliable evaluation procedures and, in particular, the absence of ground…
How can AI accelerate the green transition?
In his essay The Gift, published in 1925, the sociologist Marcel Mauss emphasised the 'total' scope of the phenomenon of gift-and counter-gift-giving, noting that it 'expresses…