.Attributes Medicine, Posted online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although big foreign language models (LLMs) show pledge in measured environments, a study currently reveals their restrictions in real-world clinical applications as well as points the technique in the direction of robust assessment and benchmarking before scientific usage.