Crypto trader and NFT enthusiast
Albemarle, NC
Joined April 2018
- Tweets10.5K
- Following7.5K
- Followers1.4K
- Likes14K
m retweeted
The challenge of optimizing LLM inference on phones is way greater than it should be.
This is partly because not many people are doing it, but also because on most systems it seems incredibly difficult to get proper access to the hardware underneath the OS.
I'll break down what I've tried and where I ran into issues along the way. 🧵
🤖 Made with AI
m retweeted
nerding out for a moment on governance nuances:
this is cool because while @VitalikButerin did have to trust me enough to nominate a winning claim, he retains 1 ETH worth of onchain voting rights to confirm/deny the payout
@poidhxyz is simple, scoped, onchain coordination tech
I have nominated a winner on the Android local AI bounty...
congratulations to Commonplace by @0xPD33!
this nomination comes after extensive testing and review alongside bounty contributors, with a final recommendation from majority contributor @VitalikButerin
Commonplace demonstrated exceptional speed, accuracy, and thoughtfulness with user queries
we consider it a brilliant showcase of what's possible with modern local AI, running entirely offline on a resource-constrained Android device
the voting period is now open, and contributors are free to approve or reject this nomination via the bounty page over the next 48 hours
a massive thank you goes out to everyone who participated, we saw an incredible amount of talent, effort, and ingenuity across these submissions
we strongly encourage anyone interested in local AI to browse the claims, explore the projects, and try out as many of these apps as possible!
I've linked them in the thread below and tagged creators to aid with discovery
m retweeted
I created a little website for Commonplace askcommonplace.app/
As the app gets updated, the website will also be. I'm also figuring out how to create a dedicated profile on X for the app so updates etc. move to that profile.
Thanks for the support, encouragement and kind words from everyone so far!
m retweeted
I have nominated a winner on the Android local AI bounty...
congratulations to Commonplace by @0xPD33!
this nomination comes after extensive testing and review alongside bounty contributors, with a final recommendation from majority contributor @VitalikButerin
Commonplace demonstrated exceptional speed, accuracy, and thoughtfulness with user queries
we consider it a brilliant showcase of what's possible with modern local AI, running entirely offline on a resource-constrained Android device
the voting period is now open, and contributors are free to approve or reject this nomination via the bounty page over the next 48 hours
a massive thank you goes out to everyone who participated, we saw an incredible amount of talent, effort, and ingenuity across these submissions
we strongly encourage anyone interested in local AI to browse the claims, explore the projects, and try out as many of these apps as possible!
I've linked them in the thread below and tagged creators to aid with discovery
m retweeted
The reason I wanted to create a private on-device LLM app for a long time goes beyond just looking to claim a bounty or profiting off of it in a financial way:
The future of LLM inference should be private and under your control and this, in my opinion, is true freedom. AI is not going away, but your privacy is. Unless things turn around and more people realize what is at stake, you might end up waking up in a world where everything you say or do with an LLM is controlled and surveilled.
I can't let such things happen so my humble approach to combating this is bringing a usable app that keeps your data safe and runs well on all kinds of phones to people.
m retweeted
Thanks to the @base community for launching a little token for this project using @bankrbot
I've never had this happen for a project of mine so I appreciate it. Also another thanks to @VitalikButerin for mentioning the app, I'm thankful that this project is getting some eyes.
Commonplace will continue being improved as time goes on and I already had some things planned like:
- switch to the new LFM 3 series model for most CPUs (huggingface.co/LiquidAI/LFM3…) which will outperform the current models being used for the CPU
- add a "read out loud" mode to the app that uses TTS to read out the answer using efficient on-device TTS
- improve performance and infra in the backend even more so its more snappy and feels good
- more love in general for older Android devices
After all the app will stay without an Internet permission so everything you do and ask will stay on your own device.
If you have a Android or (best case) GrapheneOS device feel free to try out the app! And my DMs are also open for any improvements you guys wish to make.
Worked on some updates for Commonplace, my offline research app for Android/GrapheneOS.
We now properly utilize the Tensor NPU on the Pixel 10. It is now the standard model for Pixel 10 and up and writes 2.5x faster than the CPU.
There have been some more updates to the reranker, the starter set and the general harness to improve speed and accuracy.
m retweeted
really appreciate vitalik taking the time to test field atlas and mention it in his post 🙏🏻
if you want to try it too, the app is available now. would love any feedback on setup, speed, answer quality, or anything that feels off.
getfieldatlas.com/
m retweeted
Introducing $STLN: The official token for Sightline.
ca: 0xed3c833cbf55ce7fadc90eca3f5f7e0c3e95de70
app: trysightline.io
Sightline has been live on mainnet for a week. Now we're bringing our token onchain to deepen the economy around the product.
Tokenize any real-world event on Robinhood Chain with Sightline.
m retweeted
nitter.gq/hooklinetrade/status/2…
First project with Aggregator Hooks integrated on Pons
0xde36bc5f7e2a2e5e04ddb9dcc7aad819ec354c07
How much do Aggregator Hooks actually add? Hookline measures it on every quote.
The router computes the best route with every pool on Robinhood Chain, and the best route with native Uniswap pools only. If the hooks help, you see "+X more than Uniswap pools alone" next to your quote, in tokens and in percent.
Today it ranges from nothing on pairs where Uniswap is deepest, to around half a percent on large PONS trades where Slipstream holds deep liquidity.
No marketing number: the real gap for your trade, right now.
hookline.trade/swap
m retweeted
Same trade. More with hooks.
Every Hookline quote runs the full search twice: once with every pool, once with Uniswap pools only. The difference is what Uniswap's Aggregator Hooks add to your trade, and it is printed under the quote.
Right now, selling 200,000 PONS for ETH: the best route goes through a Slipstream pool via an Aggregator Hook, then Uniswap v3, and returns 0.67% more ETH than the best route with Uniswap pools alone.
On big orders, that is real money. On small ones, Hookline simply takes the best pool, hook or not.
hookline.trade
m retweeted
Hookline is live on Robinhood Chain.
It is a swap that checks every pool before you trade: Uniswap's new Aggregator Hooks plug in. Then it splits your order for the best price.
hookline.trade
CA :
0xde36bc5f7e2a2e5e04ddb9dcc7aad819ec354c07
m retweeted
There's a new token in the base:0xe34356dcd3d7bb991248f322e4ec31b5d60bc54e ecosystem: $DSP
dispatch.cash/app/
0x0039d6a1773888cbe38addeeb2054fe145333dfb
m retweeted
New Research branch started at robinhood:0x2eb2849cde7957b86d0dfd4b59e450a9f9d15559
GPT - OSS 20B , Mixture Of Experts Model
Getting ready to get on chain
only on @RobinhoodCrypto ,@vladtenev
Follow the code and results:
github.com/Gh0stllm/GH0ST/tr…
m retweeted
Privacy Lives On
$ZC // Zipcoin Reborn
0xa2f6441c4839a7fd4ef8536b971ced04c48a1cea
We will set up the project base first, including socials, website, and begin testing the privacy protocol.
Community suggestions welcome. Drop in comments.
Tokens can now be paired with $ZC zipcoin
0xa2f6441c4839a7fd4ef8536b971ced04c48a1cea
Launch on etherstreet.fun