D2. Verify that you have no block*treatment interaction
In experimental designs with a blocking factor, the test for treatment differences is based on an error term involving block by treatment interactions. This error variation can occur due to random noise, or due to real interactions between the blocks and treatments, such that in some blocks the ranking of treatments, or differences among them, changes. The latter variation will increase the size of the error term, making treatment tests unable to pick up differences (loss of power).
The %MMAOV macro calculates a test for these interactions, the Tukey's Single DF Test for Additivity, and produces two plots to allow visual assessment of interactions. Both plots give the same information, use the one that is easier to interpret (usually the one with fewer lines in the graph). One displays how blocks change across treatment combinations, the other displays how treatments change across blocks.
A typical example is shown here (click plots to see full sized versions).
The Tukey test is printed as a title for the graph. Here the P-value is >0.05, leading to acceptance of Ho:, and concluding that true block by treatment interactions do not exist. As usual with diagnostic tests, this test is too sensitive, will reject Ho: too often, so visual examination of the plots is essential when p<0.05. See if the lines in the graph are "close" to parallel. Parallel responses indicate no interactions, as the rankings do not change.
In the bottom Tukey Test plot, responses look reasonably parallel, with one exception. Treatment combination 1 shows a dramatic increase between years 2000 and 2001, quite different from the other treatments.
Based on these diagnostic results, there appears to be no great concern that block by treatment interactions are increasing the error term. However, you might consider a scientific examination of treatment combination 1 data in 2000, why were measured values much lower than expected?
In general, if block by treatment interactions are found, the following approaches can be used to correct the problem.
|H I N T S :|
|Values in the plot are coded. The codes are translated in a table printed on the SAS output page following the graphs.|
|Decisions about deleting data are also discussed in Step A. This also tells you how to rerun the analysis.|