The test of internal consistency involves ensuring that each part of the test generates similar results, and that each part of a test measures the correct construct.įor example, a test of IQ should measure IQ only, and every single question must also contribute. In a school exam, for example, the same test upon the same subjects will generally result in better results the second time around, so testing stability is not practical.Ĭhecking that two researchers observe similar results also falls within the remit of the test of equivalence. Split-testing is one way of ensuring this, especially in tests or observations where the results are expected to change over time. Testing equivalence involves ensuring that a test administered to two people, or similar tests administered at the same time give similar results. Of course, there is no such thing as perfection and there will be always be some disparity and potential for regression, so statistical methods are used to determine whether the stability of the instrument is within acceptable limits. The test-retest method is one way of ensuring that any instrument is stable over time. In the social sciences, this is much more difficult, so any instrument must be tested with a reasonable range of reliability.Īny test of instrument reliability must test how stable the test is over time, ensuring that the same test performed upon the same individual gives exactly the same results. In the physical sciences, it is possible to isolate a measuring instrument from external factors, such as environmental conditions and temporal factors. Political opinion polls, on the other hand, are notorious for producing inaccurate results and delivering a near unworkable margin of error. A survey to measure reading ability in children must produce reliable and consistent results if it is to be taken seriously. In the non-physical sciences, the definition of an instrument is much broader, encompassing everything from a set of survey questions to an intelligence test. Some of the highly accurate balances can give false results if they are not placed upon a completely level surface, so this calibration process is the best way to avoid this.

Instruments in Research As an example, a researcher will always test the instrument reliability of weighing scales with a set of calibration weights, ensuring that the results given are within an acceptable margin of error.

Test of reliability in research