Astropy Testing Tools

This section is primarily a reference for developers that want to understand or add to the Astropy testing machinery. See Testing Guidelines for an overview of running or writing the tests.

astropy.tests.helper Module

To ease development of tests that work with Astropy, the astropy.tests.helper module provides some utility functions to make tests that use Astropy conventions or classes easier to work with. e.g., functions to test for near-equality of Quantity objects.

The functionality here is not exhaustive, because much of the useful tools are either in the standard library, py.test, or numpy.testing. This module contains primarily functionality specific to the astropy core package or packages that follow the Astropy package template.

Note that this module also includes the remote_data marker, which is used to indicate a test accesses data from the internet while running. It is intended to be used as:

from astropy.tests.helper import remote_data

@remote_data
def test_something():
    """
    This test downloads something from the internet
    """
    # test code here ...

This test will now only run if the test suite is invoked as python setup.py test --remote-data.

Reference/API

astropy.tests.helper Module

Functions

enable_deprecations_as_exceptions([…]) Turn on the feature that turns deprecations into exceptions.
treat_deprecations_as_exceptions() Turn all DeprecationWarnings (which indicate deprecated uses of Python itself or Numpy, but not within Astropy, where we use our own deprecation warning class) into exceptions so that we find out about them early.
assert_follows_unicode_guidelines(x[, roundtrip]) Test that an object follows our Unicode policy.
quantity_allclose(a, b[, rtol, atol]) Returns True if two arrays are element-wise equal within a tolerance.
assert_quantity_allclose(actual, desired[, …]) Raise an assertion if two objects are not equal up to desired tolerance.
check_pickling_recovery(original, protocol) Try to pickle an object.
pickle_protocol(request) Fixture to run all the tests for protocols 0 and 1, and -1 (most advanced).
generic_recursive_equality_test(a, b, …) Check if the attributes of a and b are equal.

Classes

raises(exc) A decorator to mark that a test should raise a given exception.
catch_warnings(*classes) A high-powered version of warnings.catch_warnings to use for testing and to make sure that there is no dependence on the order in which the tests are run.

Astropy Test Runner

When executing tests with either astropy.test or python setup.py test the call to pytest is controlled by the astropy.tests.runner.TestRunner class.

The TestRunner class is used to generate the astropy.test function, the test function generates a set of command line arguments to pytest. The arguments to pytest are defined in the run_tests method, the arguments to run_tests and their respective logic are defined in methods of TestRunner decorated with the keyword decorator. For an example of this see TestRunnerBase. This design makes it easy for packages to add or remove keyword arguments to their test runners, or define a whole new set of arguments by subclassing from TestRunnerBase.

Reference/API

astropy.tests.runner Module

Classes

TestRunner(base_path) A test runner for astropy tests
TestRunnerBase(base_path) The base class for the TestRunner.
keyword([default_value, priority]) A decorator to mark a method as keyword argument for the TestRunner.

Class Inheritance Diagram

Inheritance diagram of astropy.tests.runner.TestRunner, astropy.tests.runner.TestRunnerBase, astropy.tests.runner.keyword