Associate Professor, CMU. Researcher, Google. Evaluation and design of information retrieval and recommendation systems, including their societal impacts.
may be time to resurface this <squints> ten year old FATML paper that explored the ethics of automatic experimentation, say by agents.
841.io/doc/ethics-of-…
A confidential internal document shows TikTok withheld a safety feature from millions of users — including a teenager who died by suicide.
@livcarville in @BWbloomberg.com/news/features/…
standards bodies are good, but should go beyond benchmarks or laboratory testing. given the current state of ai evaluation, it's worth mentioning a few reasons why benchmarks are brittle...
1/6
