Rules that cannot be ignored about experimental evaluation design
Randomization: The first principle of an experimental design is randomization, which is a random process of assigning treatments to the experimental units. The random process implies that every possible allotment of treatments has the same probability (eMATHZONE, n.a.). It is generally difficult to eliminate bias using only their expert judgment and hence the use of randomization in experiments is common practice. In a randomized experimental design, objects or individuals are randomly assigned (by chance) to an experimental group. Using randomization is the most reliable method of creating homogeneous treatment groups, without involving any potential biases or judgments (Course, 1997).
Replication: The second principle of an experimental design is replication, which is a repetition of the basic experiment. Although randomization helps to insure that treatment groups are as similar as possible, the results of a single experiment, applied to a small number of objects or subjects, should not be accepted without question. Randomly selecting two individuals from a group of four and applying a treatment with “great success” generally will not impress the public or convince anyone of the effectiveness of the treatment. To improve the significance of an experimental result, replication, the repetition of an experiment on a large group of subjects, is required.
Local Control: It has been observed that all extraneous sources of variation are not removed by randomization and replication. This necessitates a refinement of the experimental technique. In other words, we need to choose a design in such a manner that all extraneous sources of variation are brought under control. For this purpose, we make use of local control, a term referring to the amount of balancing, blocking and grouping of the experimental units. Balancing means that the treatments should he assigned to the experimental units in such a way that the result is a balanced arrangement of the treatments. Blocking means that like experimental units should be collected together to form a relatively homogeneous group. A block is also a replicate. The main purpose of the principle of local control is to increase the efficiency of an experimental design by decreasing the experimental error (eMATHZONE, n.a.).
[1] Treatment groups here refer to groups where a certain intervention is employed as opposed to control groups that receive no intervention (also known as receiving placebo in medical interventions)
Bibliography
How to cite: Tomar, Manika. 2021. “Rules that cannot be ignored about experimental evaluation design.” DevInsights.