建模与仿真中的大语言模型指南:从核心技术到关键挑战 / A Guide to Large Language Models in Modeling and Simulation: From Core Techniques to Critical Challenges
1️⃣ 一句话总结
这篇论文为建模与仿真领域的从业者提供了一份实用指南,旨在帮助他们识别和避免使用大语言模型时常见的误区(如数据过载、参数设置不当等),从而更明智、更有效地将大语言模型集成到工作流程中。
Large language models (LLMs) have rapidly become familiar tools to researchers and practitioners. Concepts such as prompting, temperature, or few-shot examples are now widely recognized, and LLMs are increasingly used in Modeling & Simulation (M&S) workflows. However, practices that appear straightforward may introduce subtle issues, unnecessary complexity, or may even lead to inferior results. Adding more data can backfire (e.g., deteriorating performance through model collapse or inadvertently wiping out existing guardrails), spending time on fine-tuning a model can be unnecessary without a prior assessment of what it already knows, setting the temperature to 0 is not sufficient to make LLMs deterministic, providing a large volume of M&S data as input can be excessive (LLMs cannot attend to everything) but naive simplifications can lose information. We aim to provide comprehensive and practical guidance on how to use LLMs, with an emphasis on M&S applications. We discuss common sources of confusion, including non-determinism, knowledge augmentation (including RAG and LoRA), decomposition of M&S data, and hyper-parameter settings. We emphasize principled design choices, diagnostic strategies, and empirical evaluation, with the goal of helping modelers make informed decisions about when, how, and whether to rely on LLMs.
建模与仿真中的大语言模型指南:从核心技术到关键挑战 / A Guide to Large Language Models in Modeling and Simulation: From Core Techniques to Critical Challenges
这篇论文为建模与仿真领域的从业者提供了一份实用指南,旨在帮助他们识别和避免使用大语言模型时常见的误区(如数据过载、参数设置不当等),从而更明智、更有效地将大语言模型集成到工作流程中。
源自 arXiv: 2602.05883