Download our e-book of Introduction To Python
Related Blog
Discuss Microsoft Cognitive ToolkitMatplotlib - Subplot2grid() FunctionMicrosoft Cognitive Toolkit (CNTK) - CPU and GPUMatplotlib - PyLab moduleMatplotlib - Twin AxesMatplotlib - MultiplotsMatplotlib - Working with ImagesMatplotlib - Working With TextPython Forensics - Memory and ForensicsMatplotlib - Setting Ticks and Tick Labels View More
Top Discussion
How can I write Python code to change a date string from "mm/dd/yy hh: mm" format to "YYYY-MM-DD HH: mm" format? Exception Type: JSONDecodeError at /update/ Exception Value: Expecting value: line 1 column 1 (char 0) Someone guide please. How to store the name of IV in a list which show non linear behavior ?.......How to understand data is linear or non linear ? 'collections.OrderedDict' object has no attribute 'status_code' What is the difference between a module and a package in Python? How can i use pyspark to parallelize a file's payload How to leave/exit/deactivate a Python virtualenvironment Join Discussion
Top Courses
Webinars
Generative AI Journey in Data Science
Dec 6th (8:00 PM) 2014 Registered
Python Data Persistence - Cassandra Driver
Neha Kumawat
2 years ago
Table of Contents
- Introduction
- Cassandra Driver
- Classes of Statement type
1. SimpleStatement
2. BatchStatement
3. Prepared Statement
Introduction
Cassandra is another popular NoSQL database. High scalability, consistency, and fault-tolerance - these are some of the important features of Cassandra. This is the Column store database. The data is stored across many commodity servers. As a result, data highly available.
Cassandra is a product from the Apache Software Foundation. Data is stored in a distributed manner across multiple nodes. Each node is a single server consisting of keyspaces. The fundamental building block of the Cassandra database is keyspace which can be considered analogous to a database.
Data in one node of Cassandra, is replicated in other nodes over a peer-to-peer network of nodes. That makes Cassandra a foolproof database. The network is called a data center. Multiple data centers may be interconnected to form a cluster. Nature of replication is configured by setting Replication strategy and replication factor at the time of the creation of a keyspace.
One keyspace may have more than one Column families – just as one database may contain multiple tables. Cassandra’s keyspace doesn’t have a predefined schema. It is possible that each row in a Cassandra table may have columns with different names and in variable numbers.
Cassandra software is also available in two versions: community and enterprise. The latest enterprise version of Cassandra is available for download at https://cassandra.apache.org/download/. Community edition is found at https://academy.datastax.com/planet-cassandra/cassandra.
Cassandra has its own query language called Cassandra Query Language (CQL). CQL queries can be executed from inside a CQLASH shell – similar to MySQL or SQLite shell. The CQL syntax appears similar to standard SQL.
The Datastax community edition also comes with a Develcenter IDE shown in the following figure −
Cassandra Driver
Python module for working with Cassandra database is called Cassandra Driver. It is also developed by the Apache foundation. This module contains an ORM API, as well as a core API similar in nature to DB-API for relational databases.
The installation of Cassandra's driver is easily done using pip utility.
pip3 install cassandra-driver
Interaction with the Cassandra database is done through the Cluster object. Cassandra.cluster module defines Cluster class. We first need to declare a Cluster object.
from cassandra.cluster import Cluster
clstr=Cluster()
All transactions such as insert/update, etc., are performed by starting a session with a keyspace.
session=clstr.connect()
To create a new keyspace, use the execute() method of the session object. The execute() method takes a string argument which must be a query string. The CQL has a CREATE KEYSPACE statement as follows. The complete code is as below −
from cassandra.cluster import Cluster
clstr=Cluster()
session=clstr.connect()
session.execute(“create keyspace mykeyspace with replication={
'class': 'SimpleStrategy', 'replication_factor' : 3
};”
Here, SimpleStrategy is a value for the replication strategy and the replication factor is set to 3. As mentioned earlier, a keyspace contains one or more tables. Each table is characterized by its data type. Python data types are automatically parsed with corresponding CQL data types according to the following table −
To create a table, use the session objects to execute the CQL query for creating a table.
from cassandra.cluster import Cluster
clstr=Cluster()
session=clstr.connect('mykeyspace')
qry= '''
create table students (
studentID int,
name text,
age int,
marks int,
primary key(studentID)
);'''
session.execute(qry)
The keyspace so created can be further used to insert rows. The CQL version of the INSERT query is similar to the SQL Insert statement. The following code inserts a row in the students table.
from cassandra.cluster import Cluster
clstr=Cluster()
session=clstr.connect('mykeyspace')
session.execute("insert into students (studentID, name, age, marks) values
(1, 'Juhi',20, 200);"
As you would expect, the SELECT statement is also used with Cassandra. In the case of execute() method containing SELECT query string, it returns a result set object which can be traversed using a loop.
from cassandra.cluster import Cluster
clstr=Cluster()
session=clstr.connect('mykeyspace')
rows=session.execute("select * from students;")
for row in rows:
print (StudentID: {} Name:{} Age:{} price:{} Marks:{}'
.format(row[0],row[1], row[2], row[3]))
Cassandra’s SELECT query supports the use of the WHERE clause to apply a filter on the result set to be fetched. Traditional logical operators like <, > == etc. are recognized. To retrieve, only those rows from students table for names with age>20, the query string in execute() method should be as follows −
rows=session.execute("select * from students WHERE age>20 allow filtering;")
Note, the use of ALLOW FILTERING. The ALLOW FILTERING part of this statement allows to explicitly allow (some) queries that require filtering.
Classes of Statement type
Cassandra driver API defines following classes of Statement type in its cassendra.query module.
1. SimpleStatement
A simple, unprepared CQL query contained in a query string. All examples above are examples of SimpleStatement.
2. BatchStatement
Multiple queries (such as INSERT, UPDATE, and DELETE) are put in a batch and executed at once. Each row is first converted as a SimpleStatement and then added in a batch.
Let us put rows to be added in Students table in the form of a list of tuples as follows −
studentlist=[(1,'Juhi',20,100), ('2,'dilip',20, 110),(3,'jeevan',24,145)]
To add above rows using BathStatement, run following script −
from cassandra.query import SimpleStatement, BatchStatement
batch=BatchStatement()
for student in studentlist:
batch.add(SimpleStatement("INSERT INTO students
(studentID, name, age, marks) VALUES
(%s, %s, %s %s)"), (student[0], student[1],student[2], student[3]))
session.execute(batch)3. Prepared Statement
Prepared statement is like a parameterized query in DB-API. Its query string is saved by Cassandra for later use. The Session.prepare() method returns a PreparedStatement instance.
For our student's table, a PreparedStatement for INSERT query is as follows −
stmt=session.prepare("INSERT INTO students (studentID, name, age, marks) VALUES (?,?,?)")
Subsequently, it only needs to send the values of parameters to bind. For example −
stmt=session.prepare("INSERT INTO students (studentID, name, age, marks) VALUES (?,?,?)")
Finally, execute the bound statement above.
session.execute(qry)
This reduces network traffic and CPU utilization because Cassandra does not have to re-parse the query each time.
I hope you enjoyed reading this article and finally, you came
to know about Python Data Persistence - Cassandra Driver.
For more such blogs/courses on data science, machine
learning, artificial intelligence and emerging new technologies do visit us at InsideAIML.
Thanks for reading…
Happy Learning…