How much would have this cost in the cloud?
Translated into AWS server types, it’s pretty much im4gn.8xlarge instances per pods. The test ran for 30 minutes. In us-east-1 region (N. Virginia), the test would have cost $110. I.e. a similar infrastructure cost 5K per day 😱
Short technical summary:
The #kafka cluster is running on #kubernetes (1.30 with #cilium CNI), 76 brokers (pods) with 40GB RAM, 16 cores and 6TB nvme disk each, 512 partitions per topics. A single broker can seamlessly handle 40Gb/s. The current bottleneck is the disk I/O.
Thrilled to announce that we've achieved a staggering 3 Tb/s outbound bandwidth from our #kafka cluster on our on-premise infrastructure! 🚀This is a monumental leap in data streaming performance. Kudo to the @apachekafka team, the technology is simply amazing! Onward and upward!
Took a while, but #kafka integration to #arkime finally went through github.com/arkime/arkime/pul…. Probably something to talk about in arkime.com/arkimeet!
TX has been submitted and will arrive soon! Follow the status at testnet.alephium.org/transac…
@swissborg your thematic looks overall great! I'm just missing an aggregated view of it's value in the Marketplace based on the current allocation. Can this feature be added to the roadmap if not already?
TX has been submitted and will arrive soon! Follow the status at testnet.alephium.org/transac…