Alternatives to Administering and Running Apache Kafka

View the show notes on the web:
https://www.codingblocks.net/episode237

In the past couple of episodes, we'd gone over what Apache Kafka is and along the way we mentioned some of the pains of managing and running Kafka clusters on your own. In this episode, we discuss some of the ways you can offload those responsibilities and focus on writing streaming applications. Along the way, Joe does a mighty fine fill-in for proper noun pronunciation and Allen does a southern auctioneer-style speed talk.

Reviews

As always, thank you for leaving us a review - we really do appreciate them!

From iTunes: Abucr7

Upcoming Events

Atlanta Dev Con
September 7th, 2024
https://www.atldevcon.com/

DevFest Central Florida on September 28th, 2024
Interested? Submit your talk proposal here:
https://sessionize.com/devfest-florida-orlando-2024/

Kafka Compatible and Kafka Functional Alternatives

Why? Because running any type of infrastructure requires time, knowledge, and blood, sweat and tears

Confluent

• https://www.confluent.io/confluent-cloud/pricing/
• We've personally had good experiences with their Kafka as a service

WarpStream

• https://www.warpstream.com/
• "WarpStream is an Apache Kafka® compatible data streaming platform built directly on top of object storage: no inter-AZ bandwidth costs, no disks to manage, and infinitely scalable, all within your VPC"
• ZERO disks to manage
• 10x cheaper than running Kafka
• Agents stream data directly to and from object storage with no buffering on local disks and no data tiering.
• Create new serverless “Virtual Clusters” in our control plane instantly
• Support different environments, teams, or projects without managing any dedicated infrastructure
• Things you won't have to do with WarpStream
  • Upscale a cluster that is about to run out of space
  • Figure out how to restore quorum in a Zookeeper cluster or Raft consensus group
  • Rebalance partitions in a cluster
• "WarpStream is protocol comp