Tasnim Zotder

Publish/Subscribe Model

Pub/Sub is a decoupled asynchronous messaging pattern. The publishers send messages to a topic and the subscribers receive messages from the topic.
5 min read

Introduction

Publish/Subscribe is an asynchronous messaging pattern. Pub/Sub allows messages to be broadcasted to multiple subscribers asynchronously. The publisher sends messages to a topic and the subscriber receives messages from the topic. A topic is a channel for messages to be sent to. In Pub/Sub, the publisher and subscriber are decoupled and unaware of each other. A middleware called broker is used to manage the messages. The broker is responsible for storing the messages and delivering them to the subscribers.

Message Queue Telemetry Transport (MQTT) is a publish/subscribe based messaging protocol. It is a lightweight protocol that is used for IoT applications. In MQTT, the publisher and the subscriber are called clients. The broker is called the broker server.

Working of Pub/Sub

In Pub/Sub, the publisher publishes messages to a topic. Then the subscriber retrieves the messages from the topic. The following diagram shows the working of Pub/Sub.

Pub/Sub without broker

But in real-world applications, the published messages are not delivered directly to the subscriber. In this case, if the subscriber is not available, the messages are lost. To overcome this issue, a middleman is intruduces called a broker. The broker is responsible for storing the messages and delivering them to the subscribers. The following diagram shows the working of Pub/Sub with a broker.

Pub/Sub with broker

Advantages of Pub/Sub

  • Asynchronous: When the publisher sends a message to the topic, the publisher does not wait for the message to be delivered to the subscriber. The publisher can continue with its work and the subscriber can receive the message at a later time.
  • Decoupled: The publisher and subscriber are decoupled and unaware of each other. The publisher does not know who the subscriber is and the subscriber does not know who the publisher is.
  • Scalable: Pub/Sub is scalable and can handle a large number of publishers and subscribers without affecting the current flow of messages.
  • Reliable: Pub/Sub is reliable and ensures that the messages are delivered to the subscriber. If the subscriber is not available, the messages are stored in the broker until the subscriber is available.
  • Push Delivery: Pub/Sub pushes the messages to the subscriber when the message is published to the subscribed topic. The subscriber does not need to poll the broker to check for new messages.
  • Fan-out: Pub/Sub allows a single message to be delivered to multiple subscribers. This is called fan-out.

Disadvantages of Pub/Sub

  • No guarantee of delivery: Pub/Sub does not guarantee that the messages are delivered to the subscriber. If the subscriber is not available, the messages are lost.
  • Unaware of the delivery status: The publisher is unaware of the delivery status of the message. The publisher does not know if the message is delivered to the subscriber or not.
  • No message ordering: Pub/Sub does not guarantee the order of the messages. The messages can be delivered to the subscriber in any order.

Use Cases of Pub/Sub

  • Distributed Logging: Pub/Sub can be used to send logs from multiple servers to a central server. The central server can then process the logs and store them in a database.
  • IoT Applications: In IoT applications, sensor data from multiple sensors can be published to a central server through different topics. The central server can then process the data and send commands to the sensors.
  • Parallel Processing: The tasks can be divided into multiple parts and each part can be processed by a different subscriber. The results can then be combined to get the final result. For example, an image can be shared to multiple subscribers to process the image (add image filter) and the results can be combined to get the final image.

Key Takeaways

  • Pub/Sub is an asynchronous messaging pattern.
  • Pub/Sub allows messages to be broadcasted to multiple subscribers asynchronously.
  • In Pub/Sub, the publisher and subscriber are decoupled and unaware of each other.
  • A broker is used to manage the messages.
  • Pub/Sub is scalable and can handle a large number of publishers and subscribers without affecting the current flow of messages.
  • Pub/Sub is reliable and ensures that the messages are delivered to the subscriber.

References