Cassandra Architecture & Replication Factor
Cassandra is designed to handle Big Data. Cassandra’s main feature is to store data on multiple nodes with no single point of failure.
The reason for this kind of Cassandra’s architecture was that the hardware failure can occur at any time. Any node can be down. In case of failure data stored in another node can be used. Hence, Cassandra is designed with its distributed architecture.
Cassandra stores data on different nodes with a peer to peer distributed fashion architecture.
All the nodes exchange information with each other using Gossip protocol. Gossip is a protocol in Cassandra by which nodes can communicate with each other.
In this tutorial, you will learn-
- Components of Cassandra Architecture
- Data Replication in Cassandra
- Write Operation in Cassandra
- Read Operation in Cassandra
Components of Cassandra Architecture
There are following components in the Cassandra Architecture:
Node
Node is the place where data is stored. It is the basic component of Cassandra.
Data Center
A collection of nodes are called data center. Many nodes are categorized as a data center.
Cluster
The cluster is the collection of many data centers.
Commit Log
Every write operation is written to Commit Log. Commit log is used for crash recovery.
Mem-table
After data written in Commit log, data is written in Mem-table. Data is written in Mem-table temporarily.
SSTable
When Mem-table reaches a certain threshold, data is flushed to an SSTable disk file.
Data Replication in Cassandra
As hardware problem can occur or link can be down at any time during data process, a solution is required to provide a backup when the problem has occurred. So data is replicated for assuring no single point of failure.
Cassandra places replicas of data on different nodes based on these two factors.
- Where to place next replica is determined by the Replication Strategy.
- While the total number of replicas placed on different nodes is determined by the Replication Factor.
One Replication factor means that there is only a single copy of data while three replication factor means that there are three copies of the data on three different nodes.
For ensuring there is no single point of failure, replication factor must be three.
There are two kinds of replication strategies in Cassandra.
SimpleStrategy in Cassandra
SimpleStrategy is used when you have just one data center. SimpleStrategy places the first replica on the node selected by the partitioner. After that, remaining replicas are placed in clockwise direction in the Node ring.
Here is the pictorial representation of the SimpleStrategy:
NetworkTopologyStrategy in Cassandra
NetworkTopologyStrategy is used when you have more than two data centers. In NetworkTopologyStrategy, replicas are set for each data center separately. NetworkTopologyStrategy places replicas in the clockwise direction in the ring until reaches the first node in another rack. This strategy tries to place replicas on different racks in the same data center.
This is due to the reason that sometimes failure or problem can occur in the rack. Then replicas on other nodes can provide data.
Here is the pictorial representation of the Network topology strategy:
Write Operation in Cassandra
The coordinator sends a write request to replicas. If all the replicas are up, they will receive write request regardless of their consistency level.
Consistency level determines how many nodes will respond back with the success acknowledgment.
The node will respond back with the success acknowledgment if data is written successfully to the commit log and memTable.
For example, in a single data center with replication factor equals to three, three replicas will receive write request. If consistency level is one, only one replica will respond back with the success acknowledgment, and the remaining two will remain dormant.
Suppose if remaining two replicas lose data due to node downs or some other problem, Cassandra will make the row consistent by the built-in repair mechanism in Cassandra.
Here it is explained, how write process occurs in Cassandra,
- When write request comes to the node, first of all, it logs in the commit log.
- Then Cassandra writes the data in the mem-table. Data written in the mem-table on each write request also writes in commit log separately. Mem-table is a temporarily stored data in the memory while Commit log logs the transaction records for back up purposes.
- When mem-table is full, data is flushed to the SSTable data file.
Read Operation in Cassandra
There are three types of read requests that a coordinator sends to replicas.
- Direct request
- Digest request
- Read repair request
The coordinator sends direct request to one of the replicas. After that, the coordinator sends the digest request to the number of replicas specified by the consistency level and checks whether the returned data is an updated data.
After that, the coordinator sends digest request to all the remaining replicas. If any node gives out of date value, a background read repair request will update that data. This process is called read repair mechanism.
Summary
- This tutorial explains the Cassandra internal architecture, and how Cassandra replicates, write and read data at different stages.
- Also, here it explains about how Cassandra maintains the consistency level throughout the process.
- Components of Cassandra Architecture: Node, Data Center, Cluster, Commit Log, Mem-table, SSTable
- One Replication factor means that there is only a single copy of data while three replication factor means that there are three copies of the data on three different nodes.
- SimpleStrategy is used when you have just one data center.
- NetworkTopologyStrategy is used when you have more than two data centers.
