Sam Tucker (@scanningwithsam) header
Sam Tucker (@scanningwithsam) profile picture

Running open models on my own 5090s, 3090s, M3 Ultras and DGX Spark. Real numbers, including what broke. Current obsession: ternary models + SRAM.

Shepton Mallet, England
Joined June 2017
Photo by Sam Tucker (@scanningwithsam)Photo by Sam Tucker (@scanningwithsam)Photo by Sam Tucker (@scanningwithsam)Photo by Sam Tucker (@scanningwithsam)Photo by Sam Tucker (@scanningwithsam)Photo by Sam Tucker (@scanningwithsam)Photo by Sam Tucker (@scanningwithsam)Photo by Sam Tucker (@scanningwithsam)Photo by Sam Tucker (@scanningwithsam)Photo by Sam Tucker (@scanningwithsam)
Sam Tucker retweeted
Hark launches this week. The first 100,000 sign-ups get a paid plan for free I don't do anything without Hark anymore. The team has obsessed over every detail, and it shows. Can't wait to see how you all use it Join the waitlist: hark.com
413
193
113
3,837
1,145,873
Sam Tucker retweeted
Six months ago I had a hunch. Local AI won't become the norm until it feels instant. Running a model on your own machine should feel like magic, not like tapping your fingers waiting for a reply. The response to TensorFold since has blown me away. Thank you to everyone testing it, sending PRs and sharing feedback. There's a lot more speed to unlock. Right now most of my time goes on reviewing and landing PRs. That matters, and every fix makes TensorFold better, but the biggest gains are in deep performance work I can't get to quickly. If you want to see what TensorFold can really do, backing would let me work on it full time, with the hardware to test faster and dig into performance, and bring it to everyone in local AI. All in the open under Apache-2.0. We have been made aware that TF is being run in real production environments, so we could potentially look into support packages. To back the project, sponsor hardware or talk about support, my DMs are open. Even just sharing this post helps. 🫶🏼
43
67
9
350
28,005
Sam Tucker retweeted
LiteLLM HAS BEEN COMPROMISED, DO NOT UPDATE. We just discovered that LiteLLM pypi release 1.82.8. It has been compromised, it contains litellm_init.pth with base64 encoded instructions to send all the credentials it can find to remote server + self-replicate. link below
294
2,189
605
9,181
5,926,141
We recently celebrated a whopping 30,000 orders & to say thank you we're running a GIVEAWAY to win a 64GB Apple iPad in Space Grey worth £319! For a chance to win this fantastic prize - all you have to do to take part is: 👏 Like/Retweet 👏 Follow @FaceMaskStore Good luck!
339
776
18
781
It wasn’t up for long, but 👏👏👏
302
5,008
326
32,285
This is absolutely sickening. Shame on you @BorisJohnson @pritipatel
This Post is from an account that no longer exists. Learn more
1,181
5,531
605
19,027
The new way to dine out a deux in #coronavirusNederland
15
37
8
172
Richard Branson is now getting desperate. Give me a bailout and I'll give you your internet back. independent.co.uk/life-style…
103
535
73
1,698
Sam Tucker retweeted
Trump: "You know the way it was asked, I was looking at you." Reporter: "I wasn't there yesterday." Trump: "I know. I know."
274
565
283
1,813
From the start @eddiej25 I have advanced the arguments of Professor Sucharit Bhakdi of the University of Mainz that the shutdown would itself cost lives. He was of course quite right.
All over the TV news tonight, they hi-light that cancer treatment continues to be put on hold. Experts stating that if (worse case) there are 30,000 deaths with/from Covid-19, we can expect 50-60,000 from the current cancer strategy.... shocking if anything like true.
5
27
1
63
Giving Dan Wootton a question at a Covid briefing is like giving a harpsichord to a warthog. There's technically nothing stopping you from doing it but it does seem rather a waste.
50
506
32
3,677
Pro Tip When a government department is accused of online trolling and automated unaccountable information operations, probably not the best thing to reply with online trolling and automated unaccountable information operations. #WhitehallAnalytica
20
711
26
1,998
A *lot* of thought has obviously gone into this. I think I shall cut it out and frame it for later.
Journalists should stop asking about an ‘exit strategy.’ There is only one way we can ‘exit’ full lockdown and that is when we have a vaccine. Until then, we need to find ways we can adapt society and strike a balance between the health of the nation and our economy . #COVID19
30
20
2
176