You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[email protected] added experimental_evaluate. In [email protected], it also publishes on the ai:telemetry tracing channel with type: 'experimental_evaluate' (vercel/ai#21162). Our v7 channel subscriber ignores unknown event types, so these calls make no span today.
Scope
Change only the v7 channel subscriber (packages/server-utils/src/integrations/vercel-ai/vercel-ai-dc-subscriber.ts). The function does not exist in ai v4 to v6.
Make one span for each call. The channel does not publish the inner model call.
Target span
Name: evaluate <modelId>, op gen_ai.evaluate, origin auto.vercelai.channel
gen_ai.operation.name: evaluate, gen_ai.provider.name (raw provider ID, for example typesafe.evaluation), gen_ai.request.model, gen_ai.response.model
Activity
linear-code commentedon Sep 24, 2026
JS-3782
feat(server-utils): Instrument Vercel AI experimental_evaluate (#24694)
github-actions commentedon Sep 28, 2026
A PR closing this issue has just been released 🚀
This issue was referenced by PR #24694, which was included in the 11.1.0 release.