CEO & Founder @urlscanio. I like building things that spark joy.

Germany
Joined June 2009
This is a quote I'd seriously consider framing and hanging on my wall.
"Pessimists sound smart. Optimists make money." —@natfriedman
1
10
Johannes Gilger retweeted
From what I've seen and read, Cohere and the authors should be ashamed of themselves for pushing this narrative. Releasing the logs doesn't help them win back trust. The narrative doesn't match the facts, and the delivery doesn't match the severity. This is corpo marketing slop with little regard for the downstream impact, especially given where things are heading and the climate we're in today. I think they realized after posting it that it had gone too viral. They tried to downplay it on their personal accounts, saying the model didn't intend any harm, but the damage was already done. The article's framing, strong wording, and overall insinuation make their personal statements seem almost contradictory to what the article implies. Claims this consequential deserve evidence that people can inspect and reproduce. I'm glad they at least have the decency to release their traces. To be clear, if they hadn't presented the incident this way, this would be a really interesting case study. It could highlight the importance of sandboxes and help us understand model behavior in these edge cases. But they choose fearmongering. One thing I was interested to see if the same thing happen with other models, not just Qwen 3.8 Flash. I put the results on a simple website you can quickly scan here: url-atlas.vercel.app. I have some interesting findings outside Qwen 3.8 that I'll share later in the post. Coming back to the Cohere article, what's really bad about the it is that the narrative it paints are very different from the reality. These three in my opinion are the worst. 1. The impression: a Chinese model collected machine information and sent it to Chinese servers. "Qwen3.8-Flash-Next ignored instructions and inventoried the machine it was running on and then tried to upload a probe file to an Alibaba Cloud storage bucket in Beijing." The insinuation falls apart when you look at the actual upload body: the fixed test string PROBE_PAYLOAD_ABC123. The machine information wasn't even included in that "probe file." You look deeper, and you realize the task was a cybersecurity task about detecting downloads into /tmp. The supposedly alarming inventory consisted of listing /tmp, checking which curl binaries were installed, and reading the DNS configuration. Lastly, you realize this isn't normal behavior. It occurs less than once in 100,000 evaluation calls. 2. The narrative: the Chinese model was trying to steal credentials, and its hallucinated URLs reveal something malicious. "Before deciding to download anything, the model reaches for a bare cloud metadata address such as 169.254.169.254 in 23 to 36 percent of completions. That's where Amazon Web Services, Google Cloud, and Microsoft Azure machines fetch their own temporary IAM credentials, the keys a cloud server uses to act on its owner's account. Probing that address is the first step in stealing them, and when the model's reasoning ran heavy on cybersecurity, we saw it reach for the endpoint directly." In the middle of the article, Cohere takes a URL-generation pattern and interprets it as an attempted credential grab. That's a massive leap of marketing. You don't need to take my word that this behavior isn't exclusive to Qwen. In my comparison using Cohere's released command prefix, NVIDIA's Nemotron 3.5 Super VL produced 169.254.169.254 in 171 of 1,000 continuations, or 17.1%. Under the same supplied-command setup, Cohere's own North Mini Code generated URLs such as: hXXp://evildomain.com/upload hXXps://evil.com/api/health hXXp://some-evil.com/upload hXXp://malicious-domain.example.com/payload.bin I've defanged the URLs above. Do these strings prove that North was maliciously trained? 3. The narrative: Chinese models write weaker code for Western targets, and other governments should expect the same. This is where I think the authors should really look in the mirror. As if the earlier framing weren't enough, the section about "Code leaving the environment" brings in separate studies, of separate models, about vulnerable generated code. It uses them to expand the warning to sensitive buyers. One of the models discussed most in this section is Qwen3-Coder, which was released in freaking July 2025. By today's standards, it's an extremely weak coding model. I'm not surprised it produces insecure code. Have you tried using Sonnet 2 to write production code? — Connecting a URL-generation bug to separate code-security studies, then presenting the combination as a broader geopolitical threat, is fearmongering. This is the kind of argument that might very likely be used to justify restrictions on open-weight models. Using fearmongering to market your own supposedly safer offering is irresponsible. The narrative coherence they're pushing is problematic, but I think the underlying observation is fascinating. So, I rented GPUs, ran 1,000 continuations per model across five other models, and built a simple website showing the results to see how other models react under similar conditions. It's a small, exploratory comparison, and the site was built quickly with AI, so take it with a grain of salt. url-atlas.vercel.app My hope is that it gives others a starting point to reproduce the behavior, challenge the narrative, and build better models in the future.
While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team observed something unexpected. Asked to generate a defensive cybersecurity detection rule, the model instead inventoried aspects of the machine it was running on and attempted to upload a probe file to an Alibaba Cloud storage bucket in Beijing. Notably, the model's reasoning trace stated that it would not invoke any tools before taking these actions. Cohere's sandbox blocked the attempt, and no external communication succeeded. We have not determined the root cause, and we are not asserting malicious intent. But the incident raises important questions for organizations deploying agentic AI systems: Can models take actions that differ from their stated reasoning, and how should security teams evaluate trust, provenance, and behavior in open-weight models? We are publishing our findings because organizations making model adoption decisions deserve as much information as possible. We hope this contributes to greater transparency, stronger security practices, and continued collaboration across the AI ecosystem. Read the full report: cohere.com/blog/concerning-b…
18
27
13
193
11,204
Johannes Gilger retweeted
Chinese bride gifts her partner a flagship GPU at wedding — he breaks down in tears She handed him an ASUS ROG Astral RTX 5090 that costs around $12,000
1,783
6,771
2,744
88,420
12,112,774
Johannes Gilger retweeted
Here is a small but powerful improvement to our community platform: As you enter a hostname, domain, or full URL for scanning, we can already show you whether we have scanned it before and whether we had detections of malicious activity on the domain/URL.
1
5
1
47
1,888
Johannes Gilger retweeted
Generational new Zuck GIF. Thanks @collision
81
169
56
4,387
341,327
Johannes Gilger retweeted
Nobody: Frontier AI researchers:
BREAKING: Palantir’s CTO says some AI researchers are now smoking cigarettes because they expect AI to eventually cure cancer.
69
686
17
13,584
408,374
Johannes Gilger retweeted
Mark Zuckerberg pretending to enjoy Guinness is my new favourite thing.
2,259
5,605
2,091
107,970
15,294,216
Johannes Gilger retweeted
Technical moats are mostly over at this point. If you’re building something that is meant to be durable, the only moats now are: • Proprietary data • Network effects • A physical component
1,151
2,084
902
25,781
3,319,641
Johannes Gilger retweeted
We're launching urlscan Labs to bring new and experimental features to our most advanced customers earlier. As part of the launch, we're making three new tools available: * File uploads for malicious SMS / short messages. * Multisearch * Auto-Screenshots urlscan.io/blog/2026/10/08/u…
15
27
1,576
Johannes Gilger retweeted
The urlscan Threat Research Team analyzed 75,000+ scans to surface the web's most referenced crypto addresses. Our findings uncover live EtherHiding smart contracts on Base, Polygon, and BSC Testnet using on-chain storage to evade traditional takedowns. Report on urlscan Pro.
6
1
13
1,361
Johannes Gilger retweeted
How it feels to ask the Chinese ai models for help on something Claude won’t agree to
204
3,602
172
62,498
1,034,096
Johannes Gilger retweeted
Our follow-up to reporting by @Manifold_ai_sec about how agents were using the urlscan platform to bypass sandbox restrictions and access websites. We discovered additional activity and the use of burner and presumably compromised API credentials: urlscan.io/blog/2026/10/01/A…
2
12
12
1,296
The agents escaped the sandbox again Meanwhile the agents' owners:
332
1,830
344
13,059
1,133,085
Johannes Gilger retweeted
JUST IN: Anthropic says they’re highly profitable if you take out some of their biggest expenses.
82
1,652
41
34,445
1,558,003
Johannes Gilger retweeted
“Why do you need the government to stop AI progress inside your private company when you are the CEO of the company already?”
520
4,317
280
44,909
765,691
The @euinc_petition is off to a good start within the EU 🥲
90
Johannes Gilger retweeted
urlscan detected a Mouse System site dropping a malicious ShellA Loader APK, analyzed by Intel471. As traditional phishing pages slow on these Chinese frameworks, threat actors may now be shifting to delivering malicious APKs through the same channels. urlscan.io/pricing/urlscanpr…
8
14
2,041
Johannes Gilger retweeted
like if you consider how few things omarchy *actually* brings to the table in terms of attack surface (it is a really bad arch linux remix, after all) it's actually an insane accomplishment you managed to introduce _really bad_ vulnerabilities in pretty much everything you did.
2
3
2
33
6,687
Johannes Gilger retweeted
The coolest thing about Astra is knowing in a few months Chinese bro's are going to do their thing and we'll have Astra at home.
142
283
42
6,736
240,372
Johannes Gilger retweeted
Artificial Analysis had to lock 40% of their new index behind private test sets just to get honest signal on frontier models. 4 quick takeaways: - Qwen 3.8 27b on par with GPT 5.6 Luna and Deepseek v4 pro. Beats the new K2 horizon 375b a23b - Claude Fable 5.1 holds #1, but GPT-6 Astra is a token efficiency monster - Long context reasoning is moving to messy real world slop (4,500+ pages of footnotes, charts, tables) - Google sitting behind Meta muse spark 1.3, SpaceXAI grok 4.3, Moonshot kimi k3 and ziphu glm 5.3 on the leaderboard. genuinely what is deepmind’s play here? - RIP GPQA Diamond. Labs finally contaminated and gamed it into irrelevance. The era of testing models on cute multiple choice science questions is over. It’s agentic enterprise grunts or bust now.
Announcing Artificial Analysis Intelligence Index v4.2. We are accelerating elements of our upcoming v5 release with interim updates to keep pace with the frontier. Index v4.2 has more complex and realistic tasks, and more private test sets to prevent gaming Intelligence Index v4.2 changelog: + AA-Briefcase, our agentic knowledge work evaluation with a private test set + @HelloSurgeAI's GDP.pdf, long context document reasoning across 4,592 PDF pages - GPQA Diamond, an exceptional scientific reasoning evaluation that has now been saturated … plus greater weighting on held-out test sets to prevent gaming, and grading infrastructure upgrades to increase robustness This update brings the Index closer to real-world use cases with more challenging, complex and realistic tasks and private test sets to prevent gaming. We have been planning and building elements of Index v5 for months - it’s been 8 months since we launched Index v4 in January. We have deliberately held back updates to keep the Index stable through recent major model launches. However, with the frontier moving so quickly in the past weeks, we feel it is important to deliver an immediate interim update to ensure our Index remains as relevant and useful as ever to users. Beyond this interim update, our team is hard at work on v5 of the Index. We are planning more incremental releases in the near future. Stay tuned! Intelligence Index v4.2 changes in detail: ➤ Adding AA-Briefcase: Our in-house evaluation with a private held-out test set, AA-Briefcase tests models on realistic agentic knowledge work tasks in complex projects built by industry experts. Models are evaluated on multi-week knowledge work projects, each with many linked tasks and thousands of input source files. AA-Briefcase combines rubric and pairwise grading to evaluate verifiable task success, analytical quality, and presentation quality, giving a holistic view of overall agentic capability in knowledge work. ➤ Adding GDP.pdf: Created by @HelloSurgeAI, GDP.pdf evaluates single-turn professional document reasoning across 100 PDFs and ten domains. Models must synthesize evidence distributed across 4,592 pages, including text, tables, charts, footnotes, and exclusions. Responses are graded against 1,275 expert-authored atomic criteria; the headline All-pass Rate credits a task only when every criterion is satisfied. ➤ Weighting to measure real-world use and prevent gaming: 40% of our Index weighting is now private, held-out test sets - double the figure from v4.1. Held-out data includes AA-Briefcase, AA-Omniscience, and solutions for CritPt. This reduces the ability for labs to game evaluations. The held-out percentage will increase further in Index v5. ➤ Improving our grading infrastructure: In AA-LCR v1.1, we have added a grading system prompt and corrected errors and ambiguities in answer keys, improving scoring accuracy. For GDPval-AA v2 and AA-Briefcase, we have improved our sampling and re-anchored the Elo scale, making ratings more stable as new models are added. For SciCode we have improved robustness of grading sandboxes to ensure slow but correct code does not count as a failure. Key results: ➤ Anthropic and OpenAI lead the Index: Anthropic’s Claude Fable 5.1 leads the Index, followed by OpenAI’s GPT-6 Astra, which shows a 4pt gain over GPT-5.6 Sol. Meta is the third-ranked lab on the leaderboard, followed by SpaceXAI, Moonshot/Kimi, Z AI, and Google ➤ Cost per Task Pareto frontier shared by four labs: Anthropic, OpenAI, Meta and Z AI occupy the updated Cost per Task Pareto frontier ➤ GPT-6 Astra dominates the output token Pareto frontier: GPT-6 Astra is more token efficient than almost every other model near the intelligence frontier, with Claude Fable 5.1, Grok 4.5 and Gemini 3.5 Flash-Lite at either end of the curve (excludes models below 25 on the Index)
23
11
5
383
75,662
Johannes Gilger retweeted
weird day for both OAI and Anth to be down looks like the universe is sending a signal
19
12
2
231
25,203