irctest/pytest.ini

[pytest]
python_files = *_tests/*.py
markers =
    # specifications
    RFC1459
    RFC2812
    IRCv3
    modern
    ircdocs
    Ergo

    # misc marks
    strict
    deprecated
    services
    arbitrary_client_tags
    react_tag
    private_chathistory

    # capabilities
    account-notify
    account-tag
    away-notify
    batch
    echo-message
    extended-join
    extended-monitor
    labeled-response
    message-tags
    draft/multiline
    multi-prefix
    server-time
    setname
    sts

    # isupport tokens
    BOT
    ELIST
    INVEX
    MONITOR
    PREFIX
    STATUSMSG
    TARGMAX
    UTF8ONLY
    WHOX

python_classes = *TestCase Test*

# Include stdout in pytest.xml files used by the dashboard.
junit_logging = system-out
Use pytest as a test runner instead of unit test './test <controller> -s spec1 -s spec2' becomes: 'pytest --controller <controller> -k "spec1 or spec2"' This uses pytest's test selection, which allows finer selection of which tests to run (for example, it will allow running all tests but those requiring one feature or combination of features). It also allows running only a particular test (or set of test) by filtering on their name or file name. pytest also shows a much nicer output while testing (grouped by file, percentage of tests run, manages the verbosity); and it captures all the output and only shows it if the test fails, which makes --show-io irrelevant. 2021-02-16 23:51:47 +00:00			`[pytest]`
Remove 'test_' prefix for all file names. It's redundant. 2021-08-11 17:21:28 +00:00			`python_files = _tests/.py`
Use pytest as a test runner instead of unit test './test <controller> -s spec1 -s spec2' becomes: 'pytest --controller <controller> -k "spec1 or spec2"' This uses pytest's test selection, which allows finer selection of which tests to run (for example, it will allow running all tests but those requiring one feature or combination of features). It also allows running only a particular test (or set of test) by filtering on their name or file name. pytest also shows a much nicer output while testing (grouped by file, percentage of tests run, manages the verbosity); and it captures all the output and only shows it if the test fails, which makes --show-io irrelevant. 2021-02-16 23:51:47 +00:00			`markers =`
Change IRCv3 marks to reference capabilities instead of v3.1 / v3.2 2021-02-27 09:36:30 +00:00			`# specifications`
Use pytest as a test runner instead of unit test './test <controller> -s spec1 -s spec2' becomes: 'pytest --controller <controller> -k "spec1 or spec2"' This uses pytest's test selection, which allows finer selection of which tests to run (for example, it will allow running all tests but those requiring one feature or combination of features). It also allows running only a particular test (or set of test) by filtering on their name or file name. pytest also shows a much nicer output while testing (grouped by file, percentage of tests run, manages the verbosity); and it captures all the output and only shows it if the test fails, which makes --show-io irrelevant. 2021-02-16 23:51:47 +00:00			`RFC1459`
			`RFC2812`
Change IRCv3 marks to reference capabilities instead of v3.1 / v3.2 2021-02-27 09:36:30 +00:00			`IRCv3`
			`modern`
			`ircdocs`
rename Oragono to Ergo 2021-05-27 03:55:21 +00:00			`Ergo`
Change IRCv3 marks to reference capabilities instead of v3.1 / v3.2 2021-02-27 09:36:30 +00:00
			`# misc marks`
Use pytest as a test runner instead of unit test './test <controller> -s spec1 -s spec2' becomes: 'pytest --controller <controller> -k "spec1 or spec2"' This uses pytest's test selection, which allows finer selection of which tests to run (for example, it will allow running all tests but those requiring one feature or combination of features). It also allows running only a particular test (or set of test) by filtering on their name or file name. pytest also shows a much nicer output while testing (grouped by file, percentage of tests run, manages the verbosity); and it captures all the output and only shows it if the test fails, which makes --show-io irrelevant. 2021-02-16 23:51:47 +00:00			`strict`
Use a dedicated 'deprecated' mark instead of add '-deprecated' for each spec Also rename `@cases.SpecificationSelector.requiredBySpecification("xxx")` to `@cases.mark_specifications("xxx")` because it's shorter and looks like pytest's own syntax 2021-02-24 14:51:52 +00:00			`deprecated`
Add a 'services' mark, to allow disabling tests that depend on them. 2021-07-01 14:58:20 +00:00			`services`
Make all tests pass with Unreal (minus service tests) 2021-07-02 19:41:35 +00:00			`arbitrary_client_tags`
unreal: deselect tests depending on +draft/react Unreal won't support them 1st-party: https://github.com/unrealircd/unrealircd/pull/149 2021-07-03 07:40:49 +00:00			`react_tag`
Remove some Ergo marks (#70) * Remove some 'Ergo' marks These are not ergo-specific specs * Make chathistory test less Ergo-specific Although they can only run on Ergo for now, as Unreal has a couple of minor bugs that prevents them from passing. * Fix synchronization issue (NickServ sets MODE +r, which is unexpected caught by the next self.assertMessageMatch call) 2021-07-04 13:04:48 +00:00			`private_chathistory`
Change IRCv3 marks to reference capabilities instead of v3.1 / v3.2 2021-02-27 09:36:30 +00:00
			`# capabilities`
Add tests for draft/extended-monitor (#180) 2023-03-04 09:11:51 +00:00			`account-notify`
Add test for account tag on INVITE messages. This will catch issues like https://github.com/solanum-ircd/solanum/issues/166 (when we have registration support for solanum) 2021-06-26 16:44:55 +00:00			`account-tag`
Change IRCv3 marks to reference capabilities instead of v3.1 / v3.2 2021-02-27 09:36:30 +00:00			`away-notify`
			`batch`
			`echo-message`
			`extended-join`
Add tests for draft/extended-monitor (#180) 2023-03-04 09:11:51 +00:00			`extended-monitor`
Change IRCv3 marks to reference capabilities instead of v3.1 / v3.2 2021-02-27 09:36:30 +00:00			`labeled-response`
			`message-tags`
			`draft/multiline`
			`multi-prefix`
			`server-time`
Add tests for draft/extended-monitor (#180) 2023-03-04 09:11:51 +00:00			`setname`
Enable mypy, and do the minimal changes to make it pass 2021-02-28 11:23:06 +00:00			`sts`
Change IRCv3 marks to reference capabilities instead of v3.1 / v3.2 2021-02-27 09:36:30 +00:00
			`# isupport tokens`
Add tests for the draft bot mode. 2021-07-01 13:34:26 +00:00			`BOT`
Add tests for ELIST 2022-03-20 13:07:46 +00:00			`ELIST`
Add tests for the two invite lists (#149) * Add tests for the two invite lists * Add workaround for Hybrid * Skip testInviteList on ircu2 * Fix merge 2022-04-14 19:28:12 +00:00			`INVEX`
Change IRCv3 marks to reference capabilities instead of v3.1 / v3.2 2021-02-27 09:36:30 +00:00			`MONITOR`
Add test for ISUPPORT PREFIX. (#128) 2022-03-09 19:01:34 +00:00			`PREFIX`
statusmsg: Make tests non Oragono-specific. 2021-02-27 14:58:02 +00:00			`STATUSMSG`
Add TARGMAX test 2021-08-13 20:48:11 +00:00			`TARGMAX`
Run utf8 tests on servers which advertise UTF8ONLY (#185) 2023-01-28 09:12:32 +00:00			`UTF8ONLY`
Add tests for WHOX. (#131) 2022-02-21 20:43:22 +00:00			`WHOX`
Switch from unittest-style to pytest-style test collection I was to use parametrization in a future test, but pytest doesn't support it on unittest-style tests. 2021-07-04 14:18:33 +00:00
			`python_classes = TestCase Test`
Produce a dashboard website after running tests (#152) 2022-04-10 08:40:39 +00:00
			`# Include stdout in pytest.xml files used by the dashboard.`
			`junit_logging = system-out`