Skip to content

Testing framework for PostgreSQL and its extensions

License

NotificationsYou must be signed in to change notification settings

postgrespro/testgres

Repository files navigation

Build StatuscodecovPyPI version

testgres

PostgreSQL testing utility. Both Python 2.7 and 3.3+ are supported.

Installation

To install testgres, run:

pip install testgres

We encourage you to use virtualenv for your testing environment.

Usage

Note: by default testgres runs initdb, pg_ctl, psql provided by PATH. To specify a custom postgres installation, set the environment variable PG_CONFIG pointing to the pg_config executable: export PG_CONFIG=/path/to/pg_config.

Overview

Here is an example of what you can do with testgres:

import testgres

with testgres.get_new_node('test') as node:
    node.init()  # run initdb
    node.start() # start PostgreSQL
    print(node.execute('postgres', 'select 1'))
    node.stop()  # stop PostgreSQL

Let's walk through the code. First, you create a new node using:

with testgres.get_new_node('master') as node:

or

with testgres.get_new_node('master', '/path/to/DB') as node:

where master is a node's name, not a DB's name. Name matters if you're testing something like replication. Function get_new_node() only creates directory structure in specified directory (or somewhere in '/tmp' if we did not specify base directory) for cluster. After that, we have to initialize the PostgreSQL cluster:

node.init()

This function runs initdb command and adds some basic configuration to postgresql.conf and pg_hba.conf files. Function init() accepts optional parameter allows_ which configures cluster for replication (default is False). Now we are ready to start:

node.start()

Finally our temporary cluster is able to process queries. There are four ways to run them:

  • node.psql(database, query) - runs query via psql command and returns tuple (error code, stdout, stderr)
  • node.safe_psql(database, query) - same as psql() except that it returns only stdout. If an error occures during the execution, an exception will be thrown.
  • node.execute(database, query) - connects to postgresql server using psycopg2 or pg8000 library (depends on which is installed in your system) and returns two-dimensional array with data.
  • node.connect(database='postgres') - returns connection wrapper (NodeConnection) capable of running several queries within a single transaction.

The last one is the most powerful: you can use begin(isolation_level), commit() and rollback():

with node.connect() as con:
    con.begin('serializable')
    print(con.execute('select %s', 1))
    con.rollback()

To stop the server, run:

node.stop()

Logging

Nodes support python logging system, so if you have configured logging in your tests you can use it to redirect postgres logs to yours. To do that just use use_logging argument like here:

node = testgres.get_new_node('master', use_logging=True)

You can find working configuration example for logging in tests/test_simple.py.

Backup & replication

It's quite easy to create a backup and start a new replica:

with testgres.get_new_node('master') as master:
    master.init().start()
    with master.backup() as backup:
	    replica = backup.spawn_replica('replica').start()
		print(replica.execute('postgres', 'select 1'))

Note: you could take a look at pg_pathman to get an idea of testgres' capabilities.

Authors

Ildar Musin <i.musin(at)postgrespro.ru> Postgres Professional Ltd., Russia
Dmitry Ivanov <d.ivanov(at)postgrespro.ru> Postgres Professional Ltd., Russia
Ildus Kurbangaliev <i.kurbangaliev(at)postgrespro.ru> Postgres Professional Ltd., Russia
Yury Zhuravlev <stalkerg(at)gmail.com>