[Opendnssec-develop] Regression testing update

Siôn Lloyd sion at nominet.org.uk
Mon Dec 17 11:30:18 UTC 2012


On 17/12/12 08:49, Jerry Lundström wrote:
> On Dec 13, 2012, at 11:47 , Sara Dickinson wrote:
>
>>>> Tracking
>>> This is fine as long as it does not make the test case directories in
>>> each branch the "master database" of what is to be tested. In other
>>> words; I would rather have the wiki as a master saying what kinds of
>>> tests we should have and then maybe auto generate tests into each
>>> branch then adding the test code for that branch for those specific
>>> cases.
>> I'm not sure I understand what you mean here. The idea is that the script output tells you "what is currently tested" by looking directly at the existing tests in the branches and the wiki will be a wish list of what tests we still need to add. 
> I feel that the Wiki should not be a "wish list", we should have a clear list of what should be tested.
>

>From experience, keeping test documentation up to date is prone to
error. If they can be made as "self documenting" as possible then this
is more likely to reflect what is actually tested. Of course we still
rely on comments being kept up to date, but the overhead is smaller.

Sion



More information about the Opendnssec-develop mailing list