Skip to content
Sergey Ivasenko edited this page Jan 14, 2018 · 11 revisions

Kino - framework for building Actor-like networks

Building a Web service is one of the ways to implement a component, accessible over the network. Following good design principles, we will create reusable, granular and relevant interface for our service. To be able to survive failures, we would deploy it redundantly and make it accessible over the load-balancer at some well-known URL.

But what if the functionality we would like to expose is too small for a stand-alone service? What if we would like to scale out or extract for better reusability just some parts of existing service? At some point we might find ourselves managing dozens of new services, URLs and a lot of network configurations. This still might be a proper design choice, but let's try something else...

Kino is an Actor-like framework for implementing and hosting components, accessible over the network. In other words, kino allows to build networks of components. Although, the framework does not implement classical Actor Model, we will still call our components as actors.

An Actor contains implementation, some methods, which others can invoke by sending corresponding Message. You don't have to know address of an actor to send a message. The only thing needed - is the message itself. Message Identity (or type) and Version are used to find concrete actor and invoke its method. That's it. You send a message somewhere and it is routed to a proper actor's method for you.

Actors

For this magic to work we need someone, who will create the mapping between messages and actors' methods. In kino this is done by the ActorHost. During registration ActorHost queries actor's interface, tuples of method and message type, and builds the ActorHandlerMap table. This mapping table is used to find corresponding handling method for each message from the incoming message queue.

ActorHost

This looks good but still far from being a network of actors. We need to scale in number of actors and physical nodes. We do it with the help of MessageRouter. ActorHost contains registration information, necessary to perform in-proc routing of the messages. MessageRouter, in its turn, makes this registration information available for out-of-proc message routing. Let's take a look how this is achieved.

Message passing between core kino components (ActorHosts, MessageRouters and some others) is done over the sockets. Along with URL, every receiving socket has globally unique socket Identity assigned. This socket identity together with message identity and message version are used for message routing.

MessageRouter

During actor registration process, after ActorHost has added corresponding entries with message identities and method references to ActorHandlerMap table, it sends the same registration information to MessageRouter, replacing method references with the identity of its receiving socket. MessageRouter stores this registration into InternalRoutingTable. MessageRouter can also connect to other MessageRouter(s) over the scale out socket (for simplicity's sake, receiving and sending scale out sockets shown as one) and exchange information about the registrations they have in their InternalRoutingTable. But this time, MessageRouter replaces socket identities of ActorHosts with its own identity of the scale out socket. When other MessageRouter receives such a registration information, it stores it into it's ExternalRoutingTable. This is how in kino network everyone knows everything.

Now, when MessageRouter receives a message, either via local or scale out socket, it looks up InternalRoutingTable by message identity to find a socket identity of an ActorHost, which is able to process the message. If there is an entry, incoming message is routed to ActorHost socket. ActorHost picks up the message, does a lookup in its ActorHandlerMap for a handling method and passes the message to a corresponding actor.

If, nevertheless, MessageRouter doesn't find any entry in its InternalRoutingTable, it does a lookup in ExternalRoutingTable. The socket identity, if found, in this case points to another MessageRouter, to which then the message is finally forwarded for processing.

It is also worth mentioning, that the same actors can be hosted redundantly within one network. In this case, messages will be fairly distributed among them.

Now, we know how actors are registered within ActorHosts and how MessageRouters can exchange registrations and forward messages to each other. Let's take a look how MessageRouters, eventually deployed on different nodes, can find each other in this big world.

kino provides a Rendezvous Service for sole MessageRouters. Rendezvous Service endpoint is the single well-known endpoint, which should be configured on every MessageRouter connected to the same kino network. No need to share or configure any other URLs.

Rendezvous

Rendezvous Service is that glue, which keeps all parts together: it forwards registration information from newly connected routers to all members of the network. Because of its importance, Rendezvous service is usually deployed on a cluster of servers, so that it can survive hardware failures. Nevertheless, even if the Rendezvous cluster dies (or stops because of deployment), kino network still continues to operate, except that network configuration changes will not be propagated until the cluster is online again.

Actor's method, that was invoked by ActorHost to process incoming message, may respond with a new message. This new message will be traveling over the network until it reaches other actor and so on. If an actor can only create a response message, how can we create initial request message? MessageHub is used to send a message into kino network. Depending on your needs, you may send either one-way message, or specify a callback point. To explain what the callback point is, let's talk a bit about message flows.

When we build an application, we try to group relevant code into some components. These components have well-defined interface and responsibilities. At high level, code of the application looks like a sequence of calls to some components with expected type of return value. If we replace components with actors, which are sending and receiving messages, we may say that we have a message flow, which implements desired behavior of the application. Return value of expected type - this is a callback point in message flow. When building application with kino, we design a message flow, which we expect to finish at some point in time with predefined result - message. So, callback point, is nothing else than identity of the message, which should be routed back to initiator of the flow.

Callback

In nutshell, caller sends initial flow message via MessageHub into kino network and defines a callback point. Dozens of new messages may be created during this flow, traveling over different nodes, but as soon as somewhere someone creates a message with the identity, defined in the callback, this message will be immediately routed back to the caller. Voila, you've got your return value!

Messages