How much would have this cost in the cloud?
Translated into AWS server types, it’s pretty much im4gn.8xlarge instances per pods. The test ran for 30 minutes. In us-east-1 region (N. Virginia), the test would have cost $110. I.e. a similar infrastructure cost 5K per day 😱
Short technical summary:
The #kafka cluster is running on #kubernetes (1.30 with #cilium CNI), 76 brokers (pods) with 40GB RAM, 16 cores and 6TB nvme disk each, 512 partitions per topics. A single broker can seamlessly handle 40Gb/s. The current bottleneck is the disk I/O.
Thrilled to announce that we've achieved a staggering 3 Tb/s outbound bandwidth from our #kafka cluster on our on-premise infrastructure! 🚀This is a monumental leap in data streaming performance. Kudo to the @apachekafka team, the technology is simply amazing! Onward and upward!
TX has been submitted and will arrive soon! Follow the status at explorer-v112-v17.testnet.al…
TX has been submitted and will arrive soon! Follow the status at explorer-v112-v17.testnet.al…
Took a while, but #kafka integration to #arkime finally went through github.com/arkime/arkime/pul…. Probably something to talk about in arkime.com/arkimeet!
TX has been submitted and will arrive soon! Follow the status at explorer-v112.testnet.alephi…
TX has been submitted and will arrive soon! Follow the status at explorer-v112.testnet.alephi…
TX has been submitted and will arrive soon! Follow the status at testnet.alephium.org/transac…
TX has been submitted and will arrive soon! Follow the status at explorer-v112.testnet.alephi…
TX has been submitted and will arrive soon! Follow the status at testnet.alephium.org/transac…
TX has been submitted and will arrive soon! Follow the status at testnet.alephium.org/transac…
TX has been submitted and will arrive soon! Follow the status at explorer-v112.testnet.alephi…
TX has been submitted and will arrive soon! Follow the status at testnet.alephium.org/transac…
TX has been submitted and will arrive soon! Follow the status at testnet.alephium.org/transac…