Been definitely looking at using Claude to more efficient learn languages - not really found a proper process yet. We’ve spent a lot of time in France the last two years butchering French aha. I’m also curious how it’d do on Scottish Gaelic.

Congratulations Chris! Thoroughly deserved, would be great to catch up.

Book

Honestly I am still feeling dumb when it comes to skills - I get the distinction between it and a context file but on a practical level it’s lost on me. I haven’t got the oh I should probably create a skill trigger in my mind yet to fully understand how to leverage it.

Been thinking on this myself. I used to have hundreds of rss feeds or newsletters converted and a backlog. I somehow either lost or subconsciously just ignored them as the amount of stuff was overwhelming. The engaging with content actively I think is the key - and repetition.

I don’t know the product but I guess It will make a decision for you based upon the three biomarkers whether it’s viral or bacterial. Logistic regression if they’re smart, probs neural bet based upon pt data.

No but I’m working on it.

So, have you broke that single digits yet ? Waiting with anticipation over here ;)

I like that heuristic - i would also add you can compare on a test set on someone who’s trained up vs domain expert. Still subjective but a comparison can give confidence you’re not missing something. Expertise can also be prohibitive depending on outcome targeting.

This is supremely on point for my own work and covers a lot of my own UX instincts building the tool out. Thanks Chris very useful to hear more about your experience. Curious to hear more about the improving the product at time of review. Interesting idea.

Couldn’t agree more. Stop belittling your skill in other domains by using such language. Be what you want to become. In tech cvs I strongly urge people to remove pretty much everything clinical to no more than a paragraph. It does not define the role of a software dev.

So there’s multiple outputs to ensure accuracy/faithfullness.. (RAG used) also llm answer vs student answer. I have a good sense of where the failure modes are but really wanting to encourage llm trace reading, I’m coming at it as domain expert with the chops to build.

We’ve been developing llm driven interactive experiences within our platform that engages students with pathophysiology content with a vignettes and veering into clinical depending on the institution. There’s multiple llm outputs and llm validation between student/llm answer.

I’m building something for the physiology space - this is gold.

This is also great, I like the raw format and it’s great to just get thoughts out there in the world, takes courage! I liked your AI eval note, I’ve been majorly hovering over doing it for next cohort. Looks like a high quality course.

Great find, will defo be using this.

Love this Chris, really cherish you sharing these details. Looking forward to hearing you talk about it when I get a chance.

Damn impressive Chris. I’m yet to make the Jump, what’s working for you ? Would love to see a note about your experience!

Meta af

Good question it’s been on my mind! Aakash Gupta has written some good stuff on Substack but not specifically llm focused or healthcare’s. Can fire some of his articles to you as I subscribe if that would be of use. There are few books coming out, ‘building AI-powered products’