Log inSign up
Log inSign up
SecureBio
228 posts
SecureBio profile banner
@SecureBio

SecureBio

@SecureBio
SecureBio is a research non-profit that works to advance biotechnology safely and prevent catastrophic pandemics
securebio.org
Joined January 2025
1 Following
1,061 Followers
RepliesRepliesRepostsRepostsMediaMedia

Log in or sign up for X

See what’s happening and join the conversation

Continue with phone
or
Log in with username or email
Terms·Privacy·Cookies·Accessibility·US TIDA·Ads Info·© 2026 X Corp.
  • @SecureBio
    SecureBio
    @SecureBio
    Sep 22
    Frontier AI now beats the best human virologists on biosecurity-relevant evals. Once an AI model bests every human expert we can test it against, a higher score stops telling us anything about real-world risk. Read our new blog post on how bio evals have to adapt:
    Diagram showing that as AI model capabilities move from beginner to expert to superhuman, evaluations for chess and cybersecurity can shift from human-built proxies (puzzles, coding benchmarks) to real endpoints (real games, real exploits), while biosecurity cannot safely make that shift and must instead rely on indirect signals: experimental prediction, design tasks, defensive acceleration, and adjacent domains.
  • @SecureBio
    SecureBio
    @SecureBio
    Sep 18
    Untargeted wastewater metagenomic sequencing screens hundreds of pathogens at once, but that breadth costs coverage, making variant tracking more difficult. However, by pooling CASPER reads nationally, we can recover real lineage and genotype trends. Read more:
  • @SecureBio
    SecureBio
    @SecureBio
    Sep 14
    We ran a brief pre-release assessment of OpenAI's GPT-6 Astra that included manual testing and key benchmarks evaluating misuse-relevant knowledge, agentic capabilities, and refusal behavior for hazardous biology queries. Read our summary here:
    SecureBio’s GPT-6 Astra Pre-Release Testing Report
    From securebio.substack.com
    1
  • @SecureBio
    SecureBio
    @SecureBio
    Sep 12
    SecureBio AI has conducted pre-release assessments and independent risk evaluations for multiple frontier model companies. We are hiring for engineers, researchers, and many other roles to expand this work. Reach out if you're interested in working on bio-focused third-party
    @DarioAmodei
    Dario Amodei
    Anthropic
    @DarioAmodei
    Sep 12
    We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our
    1
  • @SecureBio
    SecureBio
    @SecureBio
    Sep 11
    We updated our flagship virology troubleshooting benchmark, the Virology Capabilities Test (VCT), to be more shortcut-resistant and to have a larger headroom. We confirmed that the majority of VCT questions are scientifically valid and that neither VCT nor VCT-v2 is saturated.
    Flowchart showing theeneration of the updated 279-question VCT-v2. Of the 322 VCT questions, 43 were removed, including 25 easy, non-discriminating questions; 163 were edited to improve their scientific accuracy, clarity, and/or resistance to heuristic shortcuts; and 116 remained unchanged.
    1