Synthetic Aperture Personality Assessment
Synthetic Aperture Personality Assessment is a method used for telemetric assessment of individual differences, primarily in the context of online surveys. The SAPA method uses data collected from the administration of large inventories of personality assessment items to large pools of participants, though it differs from traditional data collection methods in that each participant responds to only a small subset of all available items. In other words, each participant receives a random subset of the items under study. As long as some of the items are overlapping between pairs of participants, the smaller subset is more palatable for individual participants yet can be combined to synthesize large covariance matrices. In this way, the SAPA methodology is well-suited for assessing personality and individual differences across multiple domains. It is also a highly efficient means for new item prototyping and scale construction.
The SAPA Methodology
The procedure is straightforward. From a large set of personality and ability items, a smaller subset of items are presented to any one subject. With random sampling of the items, all possible pairs of items are eventually presented together. As the number of subjects grows, each item has been given to subjects, and each pair of items has been given to subjects. The developed by William Revelle has used this technique with approximately 200,000 participants as of 2012. In this example, each participant receives a subset of items equal to approximately 75, though the full set of items being administered at any given time may be as high as 500.The Traditional Method Used for Internet Surveys
Studies of individual differences in cognitive and non-cognitive aspects of personality are frequently limited by the sample sizes available in the typical university research setting. Small but stable relationships are difficult to detect when one is limited to 50 to 100 subjects, and detecting complex relationships between multiple measures is difficult when participants are limited to short one or two-hour studies. Alternative procedures involve large research groups collecting data across many research sites. Since the 1990s, an increasing number of psychologists have begun to employ web-based data collection techniques as a means of increasing both the size and breadth of samples with little loss of validity. While several online surveys have collected data from very large samples, most of these studies administer short questionnaires or basic cognitive tasks.Explanation of the "Synthetic-Aperture" Analogy
As a variation of standard web-based assessment methods, the SAPA methodology borrows by analogy a technique used in radio and optical astronomy: Synthetic Aperture Measurement. The resolution of a telescope is limited by its diameter which may be functionally increased a great deal by combining input from multiple, linked sites into one coherent image. Effectively, a very large telescope is created by synthesizing the input of many smaller ones. A classic example in radio astronomy is the Very Large Array, part of the National Radio Astronomy Observatory in Socorro, New Mexico, where 27 relatively small radio telescopes are spread out in a Y-shaped configuration to simulate the resolution of a 36 km telescope. The configuration is adjustable so that the telescope can either emphasize resolution or sensitivity. In optical astronomy similar techniques are used in inferometry at the W. M. Keck Observatory in Hawaii with "outriggers" to supplement the main telescope. Similar techniques are available for "telemetric assessment" of psychological constructs. Rather than combining signals from the same source using different telescopes as is done in astronomy, the structure of personality can be studied by combining the responses of many people across more items than any one person is willing to take. This is not an entirely novel procedure. The Educational Testing Service, for example, has long used the very large samples available when students take the SAT or GRE to develop new items by randomly giving small subsets of items to much smaller subsamples of students. The SAPA methodology allows for these techniques to be used by a broader population of researchers by making use of open source and public domain software.Public-Domain Item Pools
During the past century, the measurement of personality and ability has tended to be fragmented by separate groups of individuals using proprietary sets of measures. Indeed, the proprietary nature is partly seen in the choice of names for these inventories and tests: the Minnesota Multiphasic Personality Inventory, the California Psychological Inventory, the Eysenck Personality Questionnaire, the Freiburger Persönlichkeitsinventar, the Guilford-Zimmerman Temperament Survey, the Hogan Personality Inventory, the Jackson Personality Research Form, the Myers-Briggs Type Indicator, the Stanford-Binet Intelligence Scales, the Wechsler Adult Intelligence Scale, the Wechsler Intelligence Scale for Children, etc. Each of these tests was carefully developed by research groups and each is protected by copyright. Although some groups will allow non-profit use of the measures for minimal cost, this is the exception. Many of these inventories have similar sounding scales, but given the expense, there are a limited number of studies directly comparing the inventories.An alternative to the proprietary nature of personality measurement is the developed by Lewis Goldberg. Including more than 2,400 items in the form of sentence stems, the IPIP collaboratory has at least 269 scales targeted at everything from achievement striving to vitality/zest and includes public domain scales meant to reflect constructs found in at least 17 commonly used personality inventories. All of the IPIP items and the common personality inventories have been given to the same community sample in Eugene/Springfield, Oregon, and item statistics are freely available from Goldberg and his associates. Some have questioned the open and free use of the IPIP items with respect to the possibility of the public learning to fake personality tests used in employment settings. Others have worried about whether the freedom to select items will lead to fragmentation of constructs rather than the hoped for integration.
Even more proprietary than non-cognitive personality scales and items are measures of intellectual ability. Items and scales are either under copyright or are completely idiosyncratic to particular labs and yet still not openly published. As a result, there are currently few alternatives for researchers in search of validated, open source measures of cognitive ability.