Enhancing Multi-Agent LLM Output Quality Through Adversarial Critique: A Cross-Domain Evaluation
ID:70 View Protection:ATTENDEE Updated Time:2026-07-22 16:09:38 Hits:46 Online

Start Time:2026-07-31 12:10(Asia/Kolkata)

Duration:15min

Session:S6 Artificial Intelligence Use Cases » S6-4Artificial Intelligence Use Cases

Video No Permission Presentation File

Tips: Only the registered participant can access the file. Please sign in first.

Abstract
Multi-agent large language model (LLM) systems have shown promising results by dividing tasks among multiple agents with different roles. However, many existing approaches
focus mainly on collaboration and lack a dedicated mechanism for critically evaluating and improving generated responses. In this article, a multi-agent framework known as AdversarialMAS is introduced, which presents an adversarial critique stage to improve output quality. The framework consists of a Generator Agent that creates an initial response, a Critic Agent that analyzes the response, and a Revision Agent that refines the final output based on the feedback. Further AdversarialMAS is evaluated against three approaches: a Single-Agent LLM, a Sequential Multi-Agent pipeline, and a Self-Refine method. The evaluation is conducted across three domains—startup strategy development, research proposal generation, and software system design. Experimental results from automated metrics and LLMbased evaluation show that the proposed approach achieves the highest overall score of 4.19, with improvements in consistency, completeness, and faithfulness. The results suggest that adversarial critique can be an effective approach for improving the reliability and quality of multi-agent LLM outputs.
Keywords
Multi-agent systems, Large Language Models, adversarial critique, iterative refinement, LLM evaluation
Speaker
Rohit Kumar Gupta
Assistant Professor Manipal University Jaipur

Utkarsh Kalra
Student Manipal University Jaipur

Submission Author
Utkarsh Kalra Manipal University Jaipur
Rohit Kumar Gupta Manipal University Jaipur
Submit Comment
Verify Code Change Another
All Comments
Important Date
  • Conference Date

    Jul 30

    2026

    to

    Aug 01

    2026

  • Jul 28 2026

    Draft paper submission deadline

  • Jul 28 2026

    Registration deadline

Sponsored By
The United Societies of Science
Organized By
Kongunadu College of Engineering and Technology
Supported By
IEEE Section
IEEE Madras Section
Previous Conferences