OpenTelemetry Tracing for Vercel AI SDK

[rohit-kadhe]

We've developed a solution to trace key Vercel AI SDK functions, including generateText, streamText, embed, and embedMany. Currently, our tracing supports openai, with more vendors being added regularly!

Langtrace AI: https://github.com/Scale3-Labs/langtrace
Tracing Vercel AI SDK: https://docs.langtrace.ai/supported-integrations/web-frameworks/nextjs

[lgrammel]

@rohit-kadhe have you considered integrating with the OTel data that we provide? https://sdk.vercel.ai/docs/ai-sdk-core/telemetry

[rohit-kadhe]

I did look into it however it’s not fully compliant with genai conventions of opentelemetry. Probably that’s why it’s an “experimental” feature and am guessing you will be adapting it over time?

[lgrammel]

We plan to also send the genai attributes etc. We already sent some.

That being said, the standard is OpenAI centric and does not reflect the capabilities of the AI SDK and other model providers. We will also provide AI SDK specific attributes, spans and events for observability providers who want to provide more than basic visualizations & support for the AI SDK to their users.