Timothy (@timlrxx) profile picture

Data Scientist | Graph wizard ✨

Joined January 2020
Photo by Timothy (@timlrxx)Photo by Timothy (@timlrxx)Photo by Timothy (@timlrxx)Photo by Timothy (@timlrxx)Photo by Timothy (@timlrxx)Photo by Timothy (@timlrxx)Photo by Timothy (@timlrxx)Photo by Timothy (@timlrxx)Photo by Timothy (@timlrxx)Photo by Timothy (@timlrxx)
🧵 🚀 We just launched ASQI Engineer - Resaro's first open source project for evaluating AI systems with quality standards tailored to your use case! Built with the best-in-class test packages from top frameworks 👇
1
195
Integration made simple ⚡ Thanks to @LiteLLM , we support: - 100+ LLM providers - Your own custom chatbots - Seamless testing across different AI systems
1
1
1
773
Blog post on streaming user interfaces with #FastAPI and #Nextjs I dive deeper into the technical implementation behind three different approaches to streaming: - Text Streams - Object Stream as Text - Partial JSON Object Stream timlrx.com/blog/progressivel…
1
2
295
Feel free to try out the demo expense application over here: next-fastapi-object-stream.v… Source code: github.com/timlrx/next-fasta…
173
Replicated @vercel AI SDK object stream with a @FastAPI backend and @nextjs in 3 ways - stream from multiple providers of choice with @LiteLLM and generate Pydantic structured objects with Instructor
1
6
596
The useObject hook requires streaming text deltas from the backend but it's also interesting to consider streaming full JSON partials directly from the backend and parsing it on the frontend (example 3)
142
Since forking and taking over the maintenance of @contentlayerdev, I have finally patched the remaining issues in the latest release: npmjs.com/package/contentlay… Simplify change your contentlayer / next-contentlayer dependencies to contentlayer2 / next-contentlayer2 to upgrade 🎉
3
1
7
374
v0.4.6 - Fix build error in Node 20+ - Updated CLI binary - Fix absolute import path for Windows - Updated dev dependencies - Inline otel-exporter-trace-otlp-grpc, there should not be any peer-dependency warnings when installing - Updated example repo and StackBlitz link
1
3
313
Congratulations to the team at @IMDAsg for the soft-launch of Moonshot at #BlackHatAsia! Moonshot is a toolkit for structured benchmarking and red teaming of #LLMs.
1
257
The red-teaming component provides an interface to stress test #LLMs for potential vulnerabilities e.g. jailbreaking attacks or data leakage. It's still relatively manual for now, but from today's demo it seems that there are plans to make it automated!
1
122
If you are an existing contentlayer user, try migrating to the updated packages at: npmjs.com/package/contentlay… npmjs.com/package/next-conte…
123