Should this also trickle down to the test method names as well?
In my experience, py.test will run the usual methods of a test class that inherits from unittest.TestCase. No need for change there (for pytest compatiblity).
If/when we switch from unittest to native pytest functions, then yes, we’d want to use a test_ prefix for those functions.
Also, this implies that things that aren't tests should not begin with test.
I think pytest would just find the module, but not see any unittest.TestCase subclasses, so there should be no direct harm. I haven’t tested or thought deeply about this. But in principle, yes, non-test modules in a tests/ directory shouldn’t look like tests to humans either.