Ian Tenney

@iftenney

Staff Research Scientist, Google DeepMind. Interpretability, analysis, and visualizations for LLMs. Opinions my own.

Seattle, WA

iftenney.github.io

Replies Reposts Media

Ian Tenney
@iftenney
Jul 18, 2025
At ICML? Interested in how we can do more with interpretability to have practical impact on the rest of AI? Come to our workshop this Saturday!
Hadas Orgad
@OrgadHadas
Jul 17, 2025
Hope everyone’s getting the most out of #icml25. We’re excited and ready for the Actionable Interpretability (@ActInterp) workshop this Saturday! Check out the schedule and join us to discuss how we can move interpretability toward more practical impact.
1
Ian Tenney
@iftenney
May 6, 2025
Submission deadline extended to May 19! Working on or have thoughts on real-world applications of interpretability, and how we can use it in practice? Consider submitting to our workshop at ICML 2025. More at actionable-interpretability.github.io and below👇
Hadas Orgad
@OrgadHadas
Mar 31, 2025
🎉 Our Actionable Interpretability workshop has been accepted to #ICML2025! 🎉 >> Follow @ActInterp @tal_haklay @anja_reu @mariusmosbach @sarahwiegreffe @iftenney @megamor2 Paper submission deadline: May 9th!
Ian Tenney
@iftenney
Dec 13, 2024
Check out our new work on scaling training data attribution (TDA) toward LLM pretraining - and some interesting things we found along the way. arxiv.org/abs/2410.17413 and more below from most excellent student researcher @tylerachang ⬇️
Tyler Chang
@tylerachang
Dec 13, 2024
We scaled training data attribution (TDA) methods ~1000x to find influential pretraining examples for thousands of queries in an 8B-parameter LLM over the entire 160B-token C4 corpus! medium.com/people-ai-rese…
Ian Tenney
@iftenney
Jun 29, 2024
Try out LLM Comparator to help make sense of LLM evaluations! Alongside the Gemma 2 launch, we've released a Python library to help run rater models, bulletizing, and clustering - so all you need are prompts and model responses. Scripts and notebooks at goo.gle/llm-comparator
Minsuk Kahng
@minsukkahng
Jun 27, 2024
With the Gemma 2 launch, we’ve updated our LLM Comparator tool with a Python library! This lets you more easily run the tool with your own models. goo.gle/llm-comparator
Ian Tenney
@iftenney
May 16, 2024
New open-source tool: LLM Comparator can help make sense of side-by-side model evals. In-browser demo at pair-code.github.io/llm-comparator/, and read more in the blog post below.
Minsuk Kahng
@minsukkahng
May 15, 2024
Very excited to open-source LLM Comparator! This new #visualization tool lets you analyze LLM responses side-by-side. It’s been used for evaluating LLMs @Google, and we're proud to release it as part of Google's Responsible GenAI Toolkit. medium.com/people-ai-rese…