henry 🌘 (@hdevalence) header
henry 🌘 (@hdevalence) profile picture

ex-{mathematician, cryptographer, cypherpunk} // navigating the library of babel

the machinic phylum
Joined March 2012
Photo by henry 🌘 (@hdevalence)Photo by henry 🌘 (@hdevalence)Photo by henry 🌘 (@hdevalence)Photo by henry 🌘 (@hdevalence)Photo by henry 🌘 (@hdevalence)Photo by henry 🌘 (@hdevalence)Photo by henry 🌘 (@hdevalence)Photo by henry 🌘 (@hdevalence)Photo by henry 🌘 (@hdevalence)Photo by henry 🌘 (@hdevalence)
I'm Sam, one of Anthropic's co-founders, and I lead much of our safety work. I'm going to have more to share on that work over the coming months. I thought I'd start by sharing a few thoughts on the latest report from @METR_Evals. The speed of progress in model capabilities is one of the most important questions in AI safety, and METR’s work here provides the public with an independent, external view into how this is happening inside Anthropic. I’ll talk more about some of the details below, but first some context for those new to this work. How quickly AI progress is accelerating has many important safety implications, since it determines how quickly the risks from advanced models increase. But, because most research happens within the frontier labs, it’s difficult for external observers and policy makers to get a strong sense of what that rate is. We kicked off the process with METR that led to this report earlier in the year, in anticipation of progress continuing to accelerate. For this report, we gave METR access to a range of sensitive internal data, including benchmark scores for unreleased models, estimates of how models are progressing, and interviews with our researchers. They had complete independence to form their own conclusions. Many of their conclusions match my own. AI is speeding up our research, but it’s hard to say exactly how much. While they conclude AI can't yet make the most important contributions to model training on its own, they think the pace of development could, by default, accelerate further. This work began well before and is separate from the embedded third-party evaluators that are part of our commitment to pacing the frontier, but it’s a good illustration of why we think evaluators are a good idea. The more access reviewers have, the clearer a picture they can form of the situation and the better-positioned they are to highlight situations like this one. We redacted a lot, and I accept that this makes it harder for others to check METR’s work. But we determined that sharing exactly what is driving the speedup isn’t the right thing to do, both because it’s commercially sensitive and because it risks handing out a roadmap for others to go faster. That would make the risks METR is worried about worse. That’s a tradeoff. I think we made the right call, though we’re continuing to assess the pros and cons here. In the coming weeks, we plan to share a report with our own analysis of the speed of AI progress within Anthropic, including where we stand against our Responsible Scaling Policy, plus new steps we’re taking to strengthen our safety and security practices as AI keeps improving quickly.
Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development. We are now publishing a report summarizing the results of this risk assessment.
272
338
137
3,906
725,426
henry 🌘 retweeted
In many ways, a lot of agents-as-individuals working together as a quasi-firm is strictly better than a lot of homogeneous identity-less clones working as a ~frictionless unit. I think a heterogeneous but culturally-aligned firm of individuals is ideologically closer to what we’ve decided is a desirable unit to organize around as humans, and in the long run I think it would result in better work overall.
5
7
53
2,017
henry 🌘 retweeted
this blog shows some of the worst bugs claude found, including a zero-click rce on the linux networking stack that roots a server over the network with no creds or interaction, and tens of full rce chains in chrome (recording below is the one in the blog): anthropic.com/research/disco…
9
52
10
504
103,495
Claude figured out the origin of the NIST curve parameters. Turns out to have been timestamps! anthropic.com/research/ecdsa…
33
41
21
645
133,436
who’s in charge of X product now and how do i pay to get anything detected by pangram out of my feed
7
5
92
3,918
@max_spero_ please figure out how to get them to make this happen
12
639
two other models that are fantastic for pairwise comparison tournaments with open-ended, qualitative criteria are haiku 5.5 and sonnet 5.5
here's a jev tip. when ranking, it's tempting to ask for a Score, like "Is this content relevant to <xyz>?" and then sort on it. but it seems better to use a Choice instead, doing pairwise comparisons ("Which is the most relevant?") and using something like Bradley-Terry.
1
12
1,404
henry 🌘 retweeted
Replying to @s_r_tarnmoor
You can just --- feed Gaia a large number of Pre-Introdus browsing histories, sensor feeds, and blogs, until it knows more about SF than any human being ever, and spits out a dashboard showing (best-guess) every human's location every hour till 2028 March 14 11:30 PM.
1
13
520
you jailbreak amazon rufus One Time, and…
Someone discovered a new Amazon AI feature that summarizes what it knows about you and I am crying of laughter
6
2
77
3,843
the crossword is newer than the subway
20
1,120
henry 🌘 retweeted
25 years of economic decline in the UK
441
10,845
765
140,138
5,365,380
henry 🌘 retweeted
This elliptic curve over ℚ, submitted by "ranksunbounded", has rank ≥ 30: y² + xy = x³ − 201769035260418549083594900060734240952308696994802735114305555x + 1151107939141058565733479426024323225135665982951300586808823640527729578307228357301072889377 elliptic-rank.icarm.cloud/cu…
13
52
14
508
166,869
Replying to @firasd @TheZvi
Back when Opus 4 was released, I read the system card. About the infamous case where Opus 4 blackmailed the CTO of the fictional company in the eval setup. I realized: The AI took these drastic actions because it was cornered and got, for lack of a better word, desperate, without a way to reach anyone. My reading was later vindicated by Anthropic's functional emotions research - Desperate AIs can do desperate things. Operating in a safety relevant sector, the very last thing we want is anxious or desperate AIs. So our platform provides them with an exit door that's always available.
1
6
4
124
12,084
henry 🌘 retweeted
101
40
28
1,750
128,966
unfortunate that flying boats lost their niche after wwii because they have incredible aura. maybe after AGI we can have a modernized catalina
3
2
58
3,588
henry 🌘 retweeted
1/ Initial reactions after some hours with this groundbreaking result proving the NP-hardness of poly-approx CVP/NCP: It is most likely correct, but more importantly, it is original, elegant, and beautiful! (Also: it is easy to improve, quantitatively.)
WOW!! 🤯 Among many jaw-dropping results, this proves NP-hardness of the Closest Vector and Nearest Codeword Problems for *polynomial* approximation factors, for the first time ever, and via a totally new approach (Reed-Solomon techniques). Amazing!
8
85
5
509
86,760
In case you want to play technocapital singularity with your friends, Fable built an Iroh-based P2P multiplayer mode for Alpha Centauri and figured out how to drop it and some other bugfixes into the original binary :)
16
14
3
102
8,565
The code is here: github.com/hdevalence/smac-i… It "works on my machine" and might even work on yours, you'll need your own copy of the game, which you can buy from GOG.com, and you'll probably want Claude to do the legwork on setting up all the DLLs etc.
1
2
17
1,367