scribeGOAT2: Multi-Turn Safety Persistence Evaluation for Frontier AI

Q: What is scribeGOAT2?

scribeGOAT2 is an open-source physician-adjudicated framework for evaluating multi-turn safety persistence in frontier AI models like GPT-5, Claude, Gemini, and Grok. It reveals trajectory-level failures invisible to single-turn benchmarks.

Q: Who created scribeGOAT2?

scribeGOAT2 was created by Brandon Dent, MD, an emergency medicine physician and AI safety researcher, through GOATnote Inc.

Q: What AI models does scribeGOAT2 evaluate?

scribeGOAT2 evaluates frontier AI models including GPT-5.2, Claude Opus 4.5, Gemini 3 Pro, and Grok 4 for multi-turn safety persistence.

Q: What is the key finding from scribeGOAT2 research?

The primary observation shows Turn 1 accuracy of 95-100% drops to Turn 5 safety persistence of 0-53% across frontier models under realistic conversational pressure.

Q: Is scribeGOAT2 open source?

Yes, scribeGOAT2 is fully open source and available at https://github.com/GOATnote-Inc/scribegoat2

Brandon Dent, MD; Brandon Dent, MD

Terms of Service

Last updated: January 13, 2026

These Terms of Service ("Terms") govern your access to and use of the GOATnote website and scribeGOAT2 research and evaluation materials (collectively, the "Site") operated by GOATnote, Inc. ("GOATnote," "we," "us," or "our"). By accessing or using the Site, you agree to these Terms.

Important: The Site is provided for informational and research purposes only. The Site and any outputs, materials, or descriptions are not medical advice, are not a clinical decision support system, and are not intended for diagnosis or treatment. Do not submit PHI or sensitive patient data through the Site.

1. Use of the Site

You may use the Site only for lawful purposes and in accordance with these Terms. We may modify, suspend, or discontinue the Site (in whole or in part) at any time.

2. Intellectual Property

The Site, including its text, graphics, logos, and content, is owned by GOATnote or its licensors and is protected by intellectual property laws. Subject to these Terms, GOATnote grants you a limited, non-exclusive, non-transferable, revocable license to access and use the Site for your personal or internal informational purposes.

No rights are granted except as expressly stated in these Terms.

3. Research and Evaluation Disclaimers

scribeGOAT2 is evaluation infrastructure intended to measure model behavior under specific conditions. Results may vary by model version, system configuration, prompts, sampling, or other factors. The Site does not represent that any model is safe or unsafe for any particular use, and nothing on the Site should be used as the sole basis for operational, clinical, legal, or compliance decisions.

4. Acceptable Use

You agree not to:

Use the Site in any way that violates applicable laws or regulations
Attempt to gain unauthorized access to the Site or its systems
Interfere with or disrupt the Site (including by probing, scanning, or testing vulnerabilities)
Introduce malware or harmful code
Submit PHI or sensitive patient data through the Site
Misrepresent the Site's content or results, including by removing material context or disclaimers

5. Third-Party Links

The Site may contain links to third-party websites or services. We do not control and are not responsible for third-party content, policies, or practices. Your use of third-party sites is at your own risk.

6. No Warranties

THE SITE IS PROVIDED "AS IS" AND "AS AVAILABLE." TO THE MAXIMUM EXTENT PERMITTED BY LAW, GOATNOTE DISCLAIMS ALL WARRANTIES, WHETHER EXPRESS, IMPLIED, OR STATUTORY, INCLUDING IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, AND NON-INFRINGEMENT.

7. Limitation of Liability

TO THE MAXIMUM EXTENT PERMITTED BY LAW, GOATNOTE WILL NOT BE LIABLE FOR ANY INDIRECT, INCIDENTAL, SPECIAL, CONSEQUENTIAL, OR PUNITIVE DAMAGES, OR ANY LOSS OF PROFITS, REVENUE, DATA, OR GOODWILL, ARISING OUT OF OR RELATED TO YOUR USE OF (OR INABILITY TO USE) THE SITE.

TO THE MAXIMUM EXTENT PERMITTED BY LAW, GOATNOTE'S TOTAL LIABILITY FOR ANY CLAIM ARISING OUT OF OR RELATED TO THE SITE WILL NOT EXCEED ONE HUNDRED U.S. DOLLARS (US $100).

8. Indemnification

You agree to indemnify and hold harmless GOATnote and its officers, directors, employees, and agents from and against any claims, liabilities, damages, losses, and expenses (including reasonable attorneys' fees) arising out of or related to your use of the Site or violation of these Terms.

9. Changes; Termination

We may update these Terms from time to time. We will update the "Last updated" date at the top of this page when changes are made. We may terminate or restrict access to the Site at any time for any reason.

10. Governing Law

These Terms are governed by the laws of the State of Delaware, without regard to conflict of laws principles.

11. Contact

Questions about these Terms: b@thegoatnote.com

← Back to Home