A LangGraph Multi-Agent Framework for Automated Research Report Generation
Abstract
Large Language Models (LLMs) have substantially advanced automated information retrieval, however standard conversational interfaces remain inadequate for comprehensive academic and professional research. Existing single-prompt interactions yield superficial data aggregation, suffer from hallucinated claims, and lack rigorous source attribution. This study proposed an autonomous AI Research Agent architected to automate the complete deep-research and report-generation pipeline. Utilizing LangGraph, the system implemented a directed cyclic state-machine that orchestrated a specialized multi-agent workflow consisting of query planning, autonomous web searching, data scraping, critical review, and final synthesis. The framework executed an iterative refinement loop that actively identified informational gaps and triggered supplementary search queries until data sufficiency was achieved. To mitigate the high latency inherent in asynchronous deep research, the backend was integrated with a responsive web interface featuring real-time execution-state updates and dynamic contextual insights. Experimental deployments using state-of-the-art LLMs demonstrated that this architecture successfully produced comprehensive, logically structured, and rigorously cited reports with minimal human intervention. The proposed system achieved a Factual Consistency score of 0.94 and a Citation Precision of 0.98, outperforming all baseline approaches including standard zero-shot LLMs, basic RAG pipelines, and linear web-search agents. This framework provides a robust and extensible alternative to manual research by enforcing source provenance while maintaining high user engagement.References
[1] S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y. Cao, "ReAct: Synergizing reasoning and acting in language models," in Proc. Int. Conf. Learn. Representations (ICLR), 2023.
[2] A. Asai, Z. Wu, Y. Wang, A. Sil, and H. Hajishirzi, "Self-RAG: Learning to retrieve, generate, and critique through self-reflection," in Proc. Int. Conf. Learn. Representations (ICLR), 2024.
[3] T. Schick, J. Dwivedi-Yu, R. Dessì, R. Raileanu, M. Lomeli, L. Zettlemoyer, N. Cancedda, and T. Scialom, "Toolformer: Language models can teach themselves to use tools," in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), 2023.
[4] A. Madaan, N. Tandon, P. Gupta, S. Hallinan, L. Gao, S. Wiegreffe, U. Alon, N. Dziri, S. Prabhumoye, Y. Yang, S. Gupta, B. P. Majumder, K. Hermann, S. Welleck, A. Yazdanbakhsh, and P. Clark, "Self-Refine: Iterative refinement with self-feedback," in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), 2023.
[5] S. Min, K. Krishna, X. Lyu, M. Lewis, W. Yih, P. W. Koh, M. Iyyer, L. Zettlemoyer, and H. Hajishirzi, "FActScore: Fine-grained atomic evaluation of factual precision in long form text generation," in Proc. EMNLP, 2023.
[6] T. Zhang, V. Kishore, F. Wu, K. Weinberger, and Y. Artzi, "BERTScore: Evaluating text generation with BERT," in Proc. Int. Conf. Learn. Representations (ICLR), 2020.
[7] Z. Ji, N. Lee, R. Frieske, T. Yu, D. Su, Y. Xu, E. Ishii, Y. Bang, A. Madotto, and P. Fung, "Survey of hallucination in natural language generation," ACM Comput. Surv., vol. 55, no. 12, pp. 1–38, 2023.
[8] A. Lazaridou, E. Gribovskaya, W. Stokowiec, and N. Grigorev, "Internet-augmented language models through few-shot prompting for open-domain question answering," arXiv preprint arXiv:2203.05115, 2022.
[9] J. S. Park, J. C. O'Brien, C. J. Cai, M. R. Morris, P. Liang, and M. S. Bernstein, "Generative agents: Interactive simulacra of human behavior," in Proc. UIST, 2023.
[10] Gemini Team, Google, "Gemini: A family of highly capable multimodal models," arXiv preprint arXiv:2312.11805, 2023.
[11] J. Wei, X. Wang, D. Schuurmans, M. Bosma, B. Ichter, F. Xia, E. Chi, Q. Le, and D. Zhou, "Chain-of-thought prompting elicits reasoning in large language models," in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), vol. 35, pp. 24824–24837, 2022.
[12] P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. Küttler, M. Lewis, W. Yih, T. Rocktäschel, S. Riedel, and D. Kiela, "Retrieval-augmented generation for knowledge-intensive NLP tasks," in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), vol. 33, pp. 9459–9474, 2020.
[13] S. Pan, L. Luo, Y. Wang, C. Chen, J. Wang, and X. Wu, "Unifying large language models and knowledge graphs: A paradigm shift," IEEE Trans. Pattern Anal. Mach. Intell., vol. 46, no. 5, 2024.
[14] R. Nakano, J. Hilton, A. Balwit, J. Wu, L. Ouyang, C. Kim, C. Hesse, S. Jain, V. Kosaraju, W. Saunders, X. Jiang, K. Slama, A. Ray, J. Schulman, F. Kelton, L. Miller, K. Ndousse, A. Askell, and P. Christiano, "WebGPT: Browser-assisted question-answering with human feedback," arXiv preprint arXiv:2112.09332, 2021.
[15] C. Qian, X. Cong, C. Yang, W. Chen, Y. Su, J. Xu, Z. Liu, and M. Sun, "Communicative agents for software development," arXiv preprint arXiv:2307.07924, 2023.
Published
Issue
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.