SQLite 3 - A. Connect/Create/Insert/Drop 2020
"SQLite is a software library that implements a self-contained, serverless, zero-configuration, transactional SQL database engine. SQLite is the most widely deployed SQL database engine in the world."
- http://www.sqlite.org/
To use the SQLite3 module we need to add an import statement to our python script:
>>> import sqlite3
We can check sqlite version:
>>> sqlite3.version '2.6.0' >>> sqlite3.sqlite_version '3.7.17
The sqlite.version is the version of the pysqlite (2.6.0), which is the binding of the Python language to the SQLite database. The sqlite3.sqlite_version gives us the version of the SQLite database library. In our case it is 3.7.17.
To connect to the database, we can use sqlite3.connect function by passing the name of a file to open or create it:
>>> import sqlite3 >>> db = sqlite3.connect('data/test.db')
We can use the argument ":memory:" to create a temporary DB in the RAM:
>>> import sqlite3 >>> dbm = db = sqlite3.connect(':memory:')
When we are done working with the DB we need to close the connection:
>>> db.close() >>> dbm.close()
Another way of creating db is to use the sqlite3 command line tool:
$ ls $ sqlite3 test.db SQLite version 3.7.17 2013-05-20 00:56:22 Enter ".help" for instructions Enter SQL statements terminated with a ";" sqlite> .tables sqlite> .exit $ ls test.db
The .tables command gives a list of tables in the test.db database. We don't have any tables now. The .exit command terminates the interactive session of the sqlite3 command line tool.
To use the database, we need to get a cursor object and pass the SQL statements to the cursor object to execute them. Then, we should commit the changes.
We are going to create a books table with title, author, price and year columns.
>>> cursor = db.cursor() >>> cursor.execute('''CREATE TABLE books(id INTEGER PRIMARY KEY, ... title TEXT, author TEXT, price TEXT, year TEXT) ... ''') >>> db.commit()
Note that the commit function is invoked on the db object, not the cursor object.
To drop a table:
>>> cursor = db.cursor() >>> cursor.execute('''DROP TABLE books''') >>> db.commit()
To insert data we use the cursor to execute the query. In this example we are going to insert two books in the database, their information will stored in python variables.
>>> db.close() >>> import sqlite3 >>> db = sqlite3.connect('data/test.db') >>> cursor = db.cursor() >>> cursor.execute('''CREATE TABLE books(id INTEGER PRIMARY KEY, ... title TEXT, author TEXT, price TEXT, year TEXT) ... ''') >>> db.commit() >>> import sqlite3 >>> db = sqlite3.connect('data/test.db') >>> cursor = db.cursor() >>> title1 = 'Learning Python' >>> author1 = 'Mark Lutz' >>> price1 = '$36.19' >>> year1 ='Jul 6, 2013' >>> >>> title2 = 'Two Scoops of Django: Best Practices For Django 1.6' >>> author2 = 'Daniel Greenfeld' >>> price2 = '$34.68' >>> year2 = 'Feb 1, 2014' >>> cursor.execute('''INSERT INTO books(title, author, price, year) ... VALUES(?,?,?,?)''', (title1, author1, price1, year1)) >>> cursor.execute('''INSERT INTO books(title, author, price, year) ... VALUES(?,?,?,?)''', (title2, author2, price2, year2)) >>> db.commit()
Note: If we need values from Python variables it is recommended to use the "?" placeholder. Never use string operations or concatenation to make your queries because is very insecure.
The values of the Python variables are passed inside a tuple.
If we have more books to insert, we can continue. But this time, we'll do it another way: passing a dictionary using the ":keyname" placeholder:
>>> title3 = 'Python Cookbook' >>> author3 = 'David Beazley' >>> price3 = '$30.29' >>> year3 = 'May 29, 2013' >>> cursor.execute('''INSERT INTO books(title, author, price, year) ... VALUES(:title, :author, :price, :year)''', ... {'title':title3, 'author':author3, 'price':price3, 'year':year3}) <sqlite3.Cursor object at 0x7f1d2717d650> >>> >>> db.commit()
If we need to insert several users, we can use executemany and a list with the tuples:
>>> title4 = 'The Quick Python Book' >>> author4 = 'Naomi R. Ceder' >>> price4 = '$16.39' >>> year4 = 'Jan 15, 2010' >>> >>> title5 ='Python Testing' >>> author5 ='David Sale' >>> price5 = '$38.20' >>> year5 = 'Sep 2, 2014' >>> books = [(title4,author4, price4, year4), ... (title5,author5, price5, year5)] >>> cursor.executemany('''INSERT INTO books(title, author, price, year) VALUES(?,?,?,?)''', books) >>> db.commit()
Let's see what we've done so far using sqlite command shell:
$ sqlite3 test.db SQLite version 3.7.17 2013-05-20 00:56:22 Enter ".help" for instructions Enter SQL statements terminated with a ";" sqlite> .tables books sqlite> SELECT * FROM books; 1|Learning Python|Mark Lutz|$36.19|Jul 6, 2013 2|Two Scoops of Django: Best Practices For Django 1.6|Daniel Greenfeld|$34.68|Feb 1, 2014 3|Python Cookbook|David Beazley|$30.29|May 29, 2013 4|The Quick Python Book|Naomi R. Ceder|$16.39|Jan 15, 2010 5|Python Testing|David Sale|$38.20|Sep 2, 2014 sqlite> .mode column sqlite> .headers on sqlite> SELECT * FROM books; id title author price year ---------- --------------- ---------- ---------- ----------- 1 Learning Python Mark Lutz $36.19 Jul 6, 2013 2 Two Scoops of D Daniel Gre $34.68 Feb 1, 2014 3 Python Cookbook David Beaz $30.29 May 29, 201 4 The Quick Pytho Naomi R. C $16.39 Jan 15, 201 5 Python Testing David Sale $38.20 Sep 2, 2014 sqlite>
Note that we modified the way the data is displayed in the console. We used the column mode and turned on the headers.
more
Python tutorial
Python Home
Introduction
Running Python Programs (os, sys, import)
Modules and IDLE (Import, Reload, exec)
Object Types - Numbers, Strings, and None
Strings - Escape Sequence, Raw String, and Slicing
Strings - Methods
Formatting Strings - expressions and method calls
Files and os.path
Traversing directories recursively
Subprocess Module
Regular Expressions with Python
Regular Expressions Cheat Sheet
Object Types - Lists
Object Types - Dictionaries and Tuples
Functions def, *args, **kargs
Functions lambda
Built-in Functions
map, filter, and reduce
Decorators
List Comprehension
Sets (union/intersection) and itertools - Jaccard coefficient and shingling to check plagiarism
Hashing (Hash tables and hashlib)
Dictionary Comprehension with zip
The yield keyword
Generator Functions and Expressions
generator.send() method
Iterators
Classes and Instances (__init__, __call__, etc.)
if__name__ == '__main__'
argparse
Exceptions
@static method vs class method
Private attributes and private methods
bits, bytes, bitstring, and constBitStream
json.dump(s) and json.load(s)
Python Object Serialization - pickle and json
Python Object Serialization - yaml and json
Priority queue and heap queue data structure
Graph data structure
Dijkstra's shortest path algorithm
Prim's spanning tree algorithm
Closure
Functional programming in Python
Remote running a local file using ssh
SQLite 3 - A. Connecting to DB, create/drop table, and insert data into a table
SQLite 3 - B. Selecting, updating and deleting data
MongoDB with PyMongo I - Installing MongoDB ...
Python HTTP Web Services - urllib, httplib2
Web scraping with Selenium for checking domain availability
REST API : Http Requests for Humans with Flask
Blog app with Tornado
Multithreading ...
Python Network Programming I - Basic Server / Client : A Basics
Python Network Programming I - Basic Server / Client : B File Transfer
Python Network Programming II - Chat Server / Client
Python Network Programming III - Echo Server using socketserver network framework
Python Network Programming IV - Asynchronous Request Handling : ThreadingMixIn and ForkingMixIn
Python Coding Questions I
Python Coding Questions II
Python Coding Questions III
Python Coding Questions IV
Python Coding Questions V
Python Coding Questions VI
Python Coding Questions VII
Python Coding Questions VIII
Python Coding Questions IX
Python Coding Questions X
Image processing with Python image library Pillow
Python and C++ with SIP
PyDev with Eclipse
Matplotlib
Redis with Python
NumPy array basics A
NumPy Matrix and Linear Algebra
Pandas with NumPy and Matplotlib
Celluar Automata
Batch gradient descent algorithm
Longest Common Substring Algorithm
Python Unit Test - TDD using unittest.TestCase class
Simple tool - Google page ranking by keywords
Google App Hello World
Google App webapp2 and WSGI
Uploading Google App Hello World
Python 2 vs Python 3
virtualenv and virtualenvwrapper
Uploading a big file to AWS S3 using boto module
Scheduled stopping and starting an AWS instance
Cloudera CDH5 - Scheduled stopping and starting services
Removing Cloud Files - Rackspace API with curl and subprocess
Checking if a process is running/hanging and stop/run a scheduled task on Windows
Apache Spark 1.3 with PySpark (Spark Python API) Shell
Apache Spark 1.2 Streaming
bottle 0.12.7 - Fast and simple WSGI-micro framework for small web-applications ...
Flask app with Apache WSGI on Ubuntu14/CentOS7 ...
Fabric - streamlining the use of SSH for application deployment
Ansible Quick Preview - Setting up web servers with Nginx, configure enviroments, and deploy an App
Neural Networks with backpropagation for XOR using one hidden layer
NLP - NLTK (Natural Language Toolkit) ...
RabbitMQ(Message broker server) and Celery(Task queue) ...
OpenCV3 and Matplotlib ...
Simple tool - Concatenating slides using FFmpeg ...
iPython - Signal Processing with NumPy
iPython and Jupyter - Install Jupyter, iPython Notebook, drawing with Matplotlib, and publishing it to Github
iPython and Jupyter Notebook with Embedded D3.js
Downloading YouTube videos using youtube-dl embedded with Python
Machine Learning : scikit-learn ...
Django 1.6/1.8 Web Framework ...
Ph.D. / Golden Gate Ave, San Francisco / Seoul National Univ / Carnegie Mellon / UC Berkeley / DevOps / Deep Learning / Visualization