No warning when class is skipped due to __init__

[pytestbot]

Originally reported by: Sam Thursfield (BitBucket: samthursfield, GitHub: samthursfield)

---

I just spent a whole afternoon trying to work out why a testsuite class was being skipped. It turns out it was because there was an init() function in the class.

Py.test doesn't give any kind of warning as to why the function was skipped; it took going through the code and attaching 'pdb' to find the exception that says 'class test_htol_results.TestHtolResultRecords with init won't get collected'. OK, if I'd read the documentation from start to finish I'm sure I'd have known :-) But if Py.test had outputted a warning as to why the testsuite was skipped it would have saved me a lot of time.

---

• Bitbucket: https://bitbucket.org/pytest-dev/pytest/issue/410

[pytestbot]

Original comment by holger krekel (BitBucket: hpk42, GitHub: hpk42):

---

Yikes. Sorry you stumbled over this. Indeed i think we need to have a little warning subsystem so that the result at the end would say "1 passed, ..., 1 WARNING" and then have a switch to present those warnings. So i agree with your suggestion to present warnings.

[pytestbot]

Original comment by Ronny Pfannschmidt (BitBucket: RonnyPfannschmidt, GitHub: RonnyPfannschmidt):

---

what version of pytest? recently we do cause a skip for those

[pytestbot]

Original comment by Sam Thursfield (BitBucket: samthursfield, GitHub: samthursfield):

---

Ronny: it's version 2.5.2 of pytest

[pytestbot]

Original comment by Torsten Landschoff (BitBucket: bluehorn, GitHub: bluehorn):

---

Yesterday the same thing happened to us: Somebody added a init to a test class and somehow all the tests in the class were skipped.

We finally found the reason here from http://pytest.org/latest/goodpractises.html?highlight=discovery#conventions-for-python-test-discovery:

pytest implements the following standard test discovery:
[...]

• Test prefixed test classes (without an init method)
  [...]

Is there any reason why a test class can not have an init method without arguments? Interestingly enough, it is possible to override new in a test class.

Observe:

torsten@horatio:.../testclass_init$ cat test_init.py 
class TestInit(object):

    def __init__(self):
        pass

    def test_method(self):
        pass
torsten@horatio:.../testclass_init$ py.test -rsx -v test_init.py 
============================ test session starts =============================
platform linux2 -- Python 2.7.6 -- pytest-2.5.1 -- /opt/dynasdk/loco2-precise/bin/python
plugins: cov, capturelog, xdist
collected 0 items / 1 skipped 

========================== short test summary info ===========================
SKIP [1] /opt/dynasdk/loco2-precise/lib/python2.7/site-packages/_pytest/python.py:503: class test_init.TestInit with __init__ won't get collected
========================= 1 skipped in 0.06 seconds ==========================

Compare this with overriding new:

(loco2-precise)torsten@horatio:~/pytest-bug/testclass_init$ cat test_new.py 
class TestNew(object):

    def __new__(cls):
        print "new called"
        return object.__new__(cls)

    def test_a(self):
        print "TestNew.test_a"

    def test_b(self):
        print "TestNew.test_b"
(loco2-precise)torsten@horatio:~/pytest-bug/testclass_init$ py.test -rsx -v test_new.py 
==================================================================================== test session starts ====================================================================================
platform linux2 -- Python 2.7.6 -- pytest-2.5.1 -- /opt/dynasdk/loco2-precise/bin/python
plugins: cov, capturelog, xdist
collected 2 items 

test_new.py:7: TestNew.test_a PASSED
test_new.py:10: TestNew.test_b PASSED

================================================================================= 2 passed in 0.02 seconds ==================================================================================

What's also interesting is the calling sequence:

(loco2-precise)torsten@horatio:~/pytest-bug/testclass_init$ py.test --capture=no test_new.py 
==================================================================================== test session starts ====================================================================================
platform linux2 -- Python 2.7.6 -- pytest-2.5.1
plugins: cov, capturelog, xdist
collecting 0 itemsnew called
new called
new called
collected 2 items 

test_new.py new called
TestNew.test_a
.new called
TestNew.test_b
.

================================================================================= 2 passed in 0.01 seconds ==================================================================================

So the dunder new method is called three times during collection of the two tests (unexpected to me), while when running the tests each method gets a new instance of the class (as expected).

I would prefer that dunder init (without arguments) works just as dunder new.

[ghostsquad]

👍

[nicoddemus]

Current master displays warnings for this case. Consider:

# content of test_foo.py
class Test:

    def __init__(self):
        pass

    def test_foo(self):        
        pass

def test_bar(): 
    pass

py.test test_foo.py
============================= test session starts =============================
platform win32 -- Python 3.4.3, pytest-2.8.0.dev4, py-1.4.30, pluggy-0.3.0
rootdir: X:\pytest, inifile: tox.ini
collected 1 items

test_foo.py .

==================== 1 passed, 1 warnings in 0.01 seconds =====================

(And the footer "1 passed, 1 warnings" even appears in yellow)

Running with -rw, it displays a more verbose message:

test_foo.py .

=============================== warning summary ===============================
WC1 X:\pytest\test_foo.py cannot collect test class 'Test' because it has a __init__ constructor
==================== 1 passed, 1 warnings in 0.01 seconds =====================

So I'm closing this issue. If people would like to discuss if having an __init__ without parameters should be collected, I think a new issue should be opened. 😄

[h-vetinari]

What's the reason a TestClass with __init__ cannot be collected?

I have a hierarchy of objects and want to emulate this hierarchy on the test side, so that each TestChildClass inherits all the tests from TestParent (just like it inherits the methods on the code side). For organisational purposes, it would be very helpful if I could define an __init__ on my test-class.

[ruslanoid]

just stumbled upon this behaviour.
i am dealing with older already written tests that are executed by a different test runner and the structure there is having a single test() method for a Test() class - these classes do have the __init__() but nothing is passed to it.

my question is:

• could i use some pytest hook during collection that would replace the __init__() methods to setup_class() - or something of this sort?

my preferable way would be to avoid changing the code of the Test classes themselves as it still needs to be runnable via the legacy runner and if pytest could collect and run those tests by first running the __init__() as setup_class() and then the test() method as the other runner does - it would help a lot

[nicoddemus]

Perhaps we can relax this restriction a bit and allow __init__ methods which don't accept any other arguments other than self. Do you see a problem with this @RonnyPfannschmidt?

[pylang]

I'm not understanding why having a bare __init__ is an issue...

[nicoddemus]

I think it is a matter of that TestCase classes usually don't have __init__ methods at all, so pytest tried to be conservative initially to not collect classes with that method implemented. As I said, I think it is OK to accept test classes whose __init__ methods don't accept parameters other than self.