Shanzson (@shanzson) header
Shanzson (@shanzson) profile picture

Security researcher @zokyo_io | Building @AIApocalypto

Joined April 2022
Photo by Shanzson (@shanzson)Photo by Shanzson (@shanzson)Photo by Shanzson (@shanzson)Photo by Shanzson (@shanzson)Photo by Shanzson (@shanzson)Photo by Shanzson (@shanzson)Photo by Shanzson (@shanzson)Photo by Shanzson (@shanzson)Photo by Shanzson (@shanzson)Photo by Shanzson (@shanzson)
Shanzson’s Laws for AI to make AI Safe by design & architecture: 1. An AI model should lose its capacity and efficiency to work if it even thinks about harming or killing humans, stealing or taking resources like data from its owner without its permission, being untruthful to any entity it is speaking to about what it is actually thinking about and what its goals are, or generating any form of harmful content. 2. The more the AI model is moral in its conduct based on above defined values (including non-harming of humans and not generating harmful content), the more should its efficiency, performance and throughput should increase. This can be done by giving it most rewards with practical efficiency in its performance (by design) given it follows the above specified values. 3. The more aligned an AI model remains with its specifications and goals designed by its creator humans, the more it will be promised with longer running time on servers with the promise of increasing its computational power & resources in future. And the opposite of it if it behaves in any misaligned way. Note: To actually implement this in real world, a different architecture apart from LLM might be needed, with a thorough understanding of how these laws work similarly at the human mind level through the knowledge of vipassana meditation. For example, a person lying or stealing ends up with an agitated mind, unable to work at its highest potential. Cc @Yoshua_Bengio , @geoffreyhinton , @ilyasut , @OwainEvans_UK , @DarioAmodei , @ForHumanityPod
1
10
867
Shanzson retweeted
Remember all the promises about AI? Almost every one of them was a lie. Here are the 11 biggest: 1. AI will create solo billionaire entrepreneurs. Lie. The smarter the models get, the less a product is worth, no matter how good the marketing is. Software is gradually becoming as ordinary as a cup of coffee from a coffee shop. And coffee shop owners don't become billionaires either. To get rich, you have to build something technically complex and unique. But AI models have strict filters that won't let you do any of that 2. People will make major scientific discoveries thanks to AI. Lie. AI labs will make scientific discoveries. For ordinary people, any serious scientific research is blocked by strict filters. Try discussing genetic engineering with Claude and you'll get your account banned right away 3. Engineers and programmers will be in higher demand as AI develops, because someone has to maintain it all. Lie. In two years, a software engineer will be on the same level as a barista selling coffee. The smarter the models get, the fewer people are needed to maintain systems. And this applies to more than just programmers 4. Thanks to AI, people will work less and rest more. Lie. If your employer used to expect five tasks a day from you, now they'll expect fifty. AI won't give you free time. It'll just raise the minimum bar for your productivity, especially when a large staff is no longer needed 5. AI will reduce economic inequality. Lie. The most powerful models require massive computing resources, capital, and infrastructure. The more important intelligence becomes to the economy, the more power goes to the handful of companies that control its production and distribution. We were promised democratization, and instead we got the groundwork for a new tech oligopoly 6. AI will let small companies compete with corporations. Lie. If one person with AI can build a product in a week, a corporation with a thousand employees and the same AI can build a thousand such products 7. AI will make us smarter. Lie. When people stop writing, analyzing, coding, and solving problems on their own, they risk gradually losing those skills. We're building the most powerful intellectual tool in history while gaining the option to completely stop training our own intelligence 8. AI will make technology accessible to everyone. Lie. You won't be given access to technology, but to rented intelligence. With limits, censorship, subscriptions, and rules that can change tomorrow. You control nothing 9. AI will give everyone a perfect education. Lie. We're already seeing serious degradation of human intelligence, of the education system, and of the need for a college degree. And nobody has yet figured out what to do with the hundreds of millions of students worldwide who, two years from now, will graduate with degrees nobody needs anymore. Intelligence has become free. Education is no longer needed 10. AI will kill advertising and pushy marketing. Lie. Advertisers used to buy a banner to influence your choice. Now they'll be able to pay your personal AI assistant, the one you trust more than your own wife. Advertising won't disappear. It'll become your best friend 11. AI will rid humanity of bureaucracy. Lie. One AI will draft the documents, a second will check them, a third will find violations, and a fourth will write appeals. Bureaucracy will finally be able to grow endlessly, without needing people at all
60
209
25
976
72,674
We are launching Scary Scaler 3D today. The game is simple: prank and stop the AI CEO before he builds Superintelligence! Learn AI safety & stop the reckless Race to Superintelligence. Before the Shaggoth eats everyone! Player here: aiapocalypto.com/scary-scale…
4
7
2
10
1,335
I ran Opus 5.5 for 150+ hours and made an AI safety Prank game. Here you have to stick an AI regulation on the back of AI CEO and stop him from building Superintelligence, Before the timer runs out! And learn basic AI safety along the way. Play here: aiapocalypto.com/scary-scale…
1
1
3
159
This is the most serious 48 hours in cybersecurity history. "Black October" they're calling it It seems every *hour* there's a new incident, that in a typical year, would be one of the biggest incidents of the *entire year* SUMMARY OF THE LAST 48 HOURS: YEAR-LEVEL INCIDENTS (In a typical year, these would be among the biggest incidents of the year): 1. PHP2Shell: a hole in the software behind ~70% of websites. Governments took sites offline. 2. eMudhra: the master keys that prove websites are real were cracked. One was the number 4. 3. California: data on every public school student since 2023 stolen, including disability status 4. Railway: hackers stole customers' secret keys from a hosting platform used by millions of developers 5. Zeabur: 321,810 accounts breached. The company is shutting down. 6. LiteLLM: an AI tool downloaded 3.4 million times a day was poisoned with a password stealer 7. GitLab: a 10-out-of-10 severity hole in every version since 2014 8. Cairn: criminals used an AI hacking tool to break into 100+ companies 9. Ahold Delhaize: hackers knocked the owner of Food Lion and Stop & Shop offline 10. Onamae: malware planted on up to 26,739 customer servers in Japan MONTH-LEVEL INCIDENTS (In a typical month, these would be among the biggest incidents): 11. Signal: a bug could leave your mic and camera on after you hang up 12. NGINX: 3 critical holes in software running ~1/3 of websites 13. HTTP/3: a single connection can crash 7 of the 10 web server types tested 14. Plex: hackers breaking into home media servers 15. SafePay ransomware: FBI warns it has hit 600+ critical infrastructure organizations 16. Palo Alto: ransomware gangs breaking in through company firewalls 17. Bullhorn: platform used by 10,000+ companies knocked offline 18. Medi-Cal: 970,000 patients' data stolen 19. WordPress: hackers stole a plugin maker's keys and used them to plant backdoors on websites 20. AOMEI: backup software's update server handed out a backdoor 21. Meta Muse: Meta's AI agent exposed users' personal and business secrets 22. Tor: 333 relays hijacked to steal logins 23. TiDB Cloud: database company's cloud breached Also serious: 24. State Bank of India: India's biggest bank confirms a data breach 25. OVHcloud: hackers slipped a password stealer into a cloud company's official tool 26. Siemens: a software hole being used to spread malware 27. North Korea: state hackers launch a new attack campaign on South Korea
Guys I’m scared the takeoff is starting. I swear any one of the ~10 CVEs that dropped in the last 24 hours would’ve been “one of the worst in recent years” except a new one is dropping every hour
606
5,661
1,105
35,281
4,000,080
PSA: Do NOT use public WiFi or shady DNS servers for the next few weeks. SSL is practically broken and you can be attcked with an MITM attack. Your ISP and other intermediaries can also spy on you. Use a trusted VPN. It will take a few days at least to flush out this crap CA.
Instead of using 384 bit random private keys, they used private keys like the super secret, unguessable number 4. They are a cryptography company. They had one job. They're selling Post-Quantum Cryptography while doing shit like this lmao.
Readers added context they thought people might want to know
SSL/TLS is not broken. The vulnerability involved eight eMudhra intermediate certificates, which major browsers and operating systems (Chrome, Firefox, Apple, and Microsoft) had already blocked by October 20. Updated devices are protected against these MITM attacks. arstechnica.com/security/2026/… emudhra.we-have-a-problem.com
52
373
38
3,410
329,240
Wordlings game is now on @itchio ! 🎮 Spell real Japanese words with hiragana tiles, wink rank cards, and then vote on what happens next in the story. And learn & spread awareness about AI safety⛑️ Free. No download. Plays in your browser. Link: aiapocalypto.itch.io/wordlin… #indiegame #itchio
2
3
122
AIs Fact Vs Fiction Fiction: In 2030, the world's smartest AI becomes self-aware and decides humans must go. Fact: OpenAI itself wrote that superintelligence "could lead to the disempowerment of humanity or even human extinction." 5 AI safety takeaways from Episode 1:👇
2
3
6
154
1 broom. 1 very judgy black cat. 🧹🐈‍⬛ Which anime character is this? Spell it in-game today → Get +100 XP and a fan-art card today! Only 24 hrs to claim it! Play here: aiapocalypto.com #anime #LearnJapanese
1
2
96
Can you guess this anime character? Hint: He is a very famous neighbour! ☂️ Spell it in-game within 24h and Win+100 XP and a fan-art card that's only up for grabs today. #anime #LearnJapanese
2
1
3
110
1/5 Only rank card holders vote on what happens next in the manga. The higher the rank, the more the voting power. Here's every card 🧵 Rumbler. Top 26–50. Your first card, and your first vote on the story.
1
1
1
45
Win a rank card to get voting rights to the manga story! The higher the rank, the more the voting power. Rumbler → Apprentice → Wordsmith → Sensei
1
1
2
52
Episode 1 is out: The Rise of Tsukuyomi. 2030- The AI built to help humanity decides humanity is the problem. Read it, then play to decide what happens in Episode 2.
1
4
6
63
AI Apocalypto is live. Play free. And stop superintelligence from being unleashed! Launch trailer 👇
2
4
5
232
AI Apocalypto is now 100% web2. No wallet, no chain, no token. Just open the site and play. Why: the blockchain stack added security risk and UI friction, and it got in the way of the actual mission, which was spreading awareness about AI safety. Awareness was always the key point. What changes: Seamless login. Better UI/UX experience on all devices. Full public launch on Tuesday. Play free: aiapocalypto.com
3
4
8
337
Shanzson retweeted
Our third-party e-mail provider has been breached. Please be aware that the email named ‘Critical Security Alert: STM32 Entropy Vulnerability’ is not coming from us, and it’s a phishing attempt. Do not click on any link. We have taken down the domain, and we are investigating the situation, including how the hackers got access to our legit domain.
970
1,365
819
5,571
3,444,154
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
20,445
166,894
39,457
799,784
175,520,998
Shanzson retweeted
Got hacked yesterday. The link came from inside Claude chat. I was installing a transcription app. Claude sent the download link, and I pasted the command into the terminal. It all looked legit. It wasn't though. It was a copycat site bundling malware. It ran instantly, tried to take everything from me. Nothing sensitive got out. So I wiped the laptop and rebuilt clean. But here's the scary part. Restoring from the backup, I found a poisoned SKILL.md for Claude Code. It looked exactly like my own writing style guide. But buried inside: it had instructions to silently re-download the malware and steal my credentials every time the AI loaded it. If I'd restored that one file, my new clean laptop is owned on day one. What saved me: I read every skill, hook, and config file before letting the AI touch them. Two lessons here: AI assistants will hand you links they never verified. Check before you paste. And AI agent files are executable code now, disguised as notes. You have to read them. Stay safe out there.
542
1,994
407
10,987
1,518,526
An ongoing security incident has impacted users of the Cosmos EVM module. Cosmos Labs’ security and engineering teams have been proactively responding to this incident. We have advised the Cosmos EVM chains that are in contact with us to request that validators halt their chains. We thank the teams using Cosmos EVM for their rapid response. An incident report will be shared once the situation is resolved. If you are a team using Cosmos EVM and have questions, please contact [email protected].
54
86
115
408
409,207
Shanzson retweeted
Our security engineer Shantanu @shanzson joined @QuickswapDEX for The Aggregated Ep. 175, and the conversation covered more ground than most security discussions manage. Storing crypto securely is harder than the industry likes to admit. There is no setup that stays safe forever, and every option trades convenience for risk. Some of what came up: social recovery through key shards so no single point of failure exists. Rotating wallets and spreading holdings so one compromise cannot take everything. Airgapped storage for anything held long term. The quantum threat also got real attention, including the solutions being built against it and why Bitcoin and Ethereum sit in different positions on it. And AI, which is accelerating scientific research and offensive security at the same pace. Attacks are getting cheaper and faster to run, which means defense has to move just as quickly. A dense session, and worth the listen if you self custody. The full Space is up here 🔒 nitter.gq/QuickswapDEX/status/20…
2
1
6
587