Aptitude Assessment Battery: Programming

November 12, 1996

The results indicate that if 90% or higher scoring candidates on the Wolfe AABP test battery are hired, they are very likely to attain at least “Successfully Meets Requirements” (SM) if not “Frequently Meets Requirements” (FM) performance on the job. If the candidates were randomly selected without testing, it is likely that they would be randomly distributed across the 5 rating scales and there would not be such a profound bias toward the “Frequently Meets Requirements” and “Significantly Meets Requirements” (EX) ratings. A secondary analysis (t Test) of the Wolfe AABP test battery was conducted with regard to male vs. female programming candidates. The results (t = 0.67) showed that there is no significant difference between the tests scores of male and female candidates.

June 17, 1993

The Wolfe Assessment Battery Programming Test was administered to 63 candidates, of varying levels of Data Processing experience, at a Walden client company located in the southeast. The AABP test scores obtained were correlated to observed supervisory ratings for programming work performed in Applications Programming after one year of on-the-job experience. The Pearson correlation coefficient of (r) = 0.37 was found. This is significant to the 0.01 level, i.e. there is only 1 possibility in 100 that this result could have occurred by chance.  This indicates that the test is highly predictive of on the job success as an  Applications Programmer.

March 1978

The study demonstrated significant correlation between the predictive AABP test scores, and the supervisory performance ratings of the four job criteria at the CIA. The validation report was prepared by the Central Intelligence Agency (CIA), Washington, D.C.

April 1989

Based on the evaluation of the Programmer Analyst position at XYZ Glass Packaging Corp. utilizing the Aptitude Assessment Battery Programming, the results conclusively demonstrated that the selection procedure measures, and is a representative sample of, that knowledge, those skills or abilities which are a necessary prerequisite to performance of critical or important work behavior(s). Conclusion:  There was a significant overlap between the number of "essential" traits identified for the job of Programmer Analyst at XYZ Glass Packaging Corp. and those tested by the AABP.

1981 - Test Reliability Report

The relationship between the scores achieved on the test and the retest are highly significant, even after the passage of several years. The AABP is consistently measuring some characteristics which validity studies correlate with programmer success without sex or cultural bias. Conclusion: The time and expense of testing in the employment process can be justified only if the results obtained are consistently and accurately measuring some factors which will influence future on-the-job behavior. The Wolfe AABP Test seems to be a reliable and valid instrument which can provide quantitative data to aid in employment and training decision making.

January 1974

Summary of the Validation Study of the Wolfe Assessment Battery Programming Test by the Central Intelligence Agency (CIA), Washington, D.C. Results: The AABP Test was found to be as highly related to job training performance. This finding is in contrast to research reported for the IBM Programmers Aptitude Test which produced correlations with training performance, but significantly lower relationships with actual job performance. Click here for the full study.

January 10, 1984

This Assessment Battery Programming Test was administered to 30 candidates of varying levels of Data Processing experience at a Wolfe client company located in Pittsburgh, PA. The AABP test scores were correlated to observed supervisory ratings for programming work done in Applications Programming after six months on the job. The correlation coefficient (r = 0.52) is significant to the 0.01 level and indicates that the test is highly predictive of on-the-job success in Applications Programming.

March 1972

This study was designed to report on the long range predictive capabilities of the Assessment Battery Programming Test.

June 19, 1978

This Validation Study of the Wolfe Aptitude Assessment Battery Programming Test (AABP) was conducted with regard to minority and women programming candidates. The report was prepared by Dr. Jack Wolfe of Programming Specialists Inc., the publisher of the AABP Test.

Wolfe-Spence Programming Aptitude Test

August 1990

The Programmer Analyst must accomplish fourteen tasks to successfully perform his/her job responsibilities. A total of 54 traits were judged to be essential to accomplishing these tasks.  Of these 54 traits, 33 are assessed by one or more questions in the Wolfe-Spence Programming Aptitude Test (WSPAT). Thus, a significant portion (61.1%) of the intended domain is assessed by the WSPAT. As well, if the relative importance of the essential traits tested, to the ''weighted'' importance of the task, is considered - the overlap percentage improves to 63.2%.

December 1980

This concurrent validation study was conducted at a large and prominent insurance company. Entry-level programming candidates were selected for an on-going extensive in-house training program. The study was designed to measure the effectiveness of the Wolfe-Spence Programming Aptitude Test in predicting successful completion of the programming training course, and on-the-job performance as measured by the first supervisory evaluation.

July 1990

This validation study conducted in three introductory university programming courses simulated the training class environment commonly found in industry. The Wolfe-Spence Programming Aptitude Test was found to be predictive of final course grades obtained by the students.

W-APT Programming Aptitude Test

May 29, 1992

With a sample size of 2173 and to a confidence level of 95%, no significant difference was found in the average scores between whites and protected minorities and average scores between males and females. The source is the Walden database statistics of May 1992.

Systems Programming Aptitude Test

May 1, 1981

This validation study of the Wolfe Systems Programming Aptitude Test demonstrates a significant relationship between test scores and supervisory performance ratings. This report is based on the findings at 18 client companies, and was conducted by Walden Personnel Testing & Consulting Inc.

Systems Analysis Aptitude Test

July 1978

The Systems Analysis Aptitude Test appears to be a useful guide to personnel and data processing management in assessing an applicant's aptitude for the analytical and design aspects of the Systems Analyst position. This study was conducted at 14 client companies and government agencies. The validation report was prepared by Dr. Jack M. Wolfe, the author of this test.

Wolfe Computer Operator Aptitude Test

February 24, 1987

A significant higher proportion of the candidates who have achieved higher levels in the Information Systems Department, had obtained higher than average scores on the Wolfe Computer Aptitude Test.

April 15, 1982

This validation study of the Wolfe Computer Operator Aptitude Test (WCOAT) found a significant relationship between test predictions and supervisory ratings (r = 0.36) significant to the 0.05 level.  The report was prepared by Walden Personnel Testing & Consulting Inc. from data obtained at 11 client companies.

July 21, 1979

This interim study of the Wolfe Computer Operator Aptitude Test (WCOAT) will be followed by a more extensive validation study of this test. The report was prepared by Dr. Jack M. Wolfe, Ph.D., the author of the Wolfe Computer Operator Aptitude Test.

May 1990

The Operations Trainee must accomplish eleven tasks to successfully perform his/her job responsibilities. A total of 34 traits were judged to be essential to accomplishing these tasks.  Of these 34 traits, 22 are assessed by one or more questions in the Wolfe Computer Operator Aptitude Test (WCOAT). Thus, a significant portion (64.7%) of the intended domain is assessed by the WCOAT.  As well, if the relative importance of the essential traits tested, to the ''weighted'' importance of the task, is considered - the overlap percentage improves to 74.9+%.

Programmer Analyst Aptitude Test (1 hour)

December 1997

The Programmer Analyst - Introductory/Trainee must accomplish fourteen essential functions to successfully perform his/her job responsibilities.  A total of 56 traits were judged to be essential to accomplishing these tasks.  Of these 56 skills, 37 are assessed by one or more questions in the Programmer Analyst Aptitude Test - 1-Hour Version (PAAT - 1HR).  Thus, a significant portion (66.1%) of the intended domain is assessed by the PAAT - 1HR.  As well, if the relative importance of the essential traits tested, to the ''weighted'' importance of the task, is considered - the overlap percentage improves to 73.2%.

Programmer Analyst Aptitude Test (2 hours)

January 1998

Based on the job description submitted by BCP Bank Card Processing Worldwide Corp., the Programmer Analyst must accomplish fourteen essential functions to successfully perform his/her job responsibilities. A total of 56 traits were judged to be essential to accomplishing these tasks. Of these 56 skills, 36 are assessed by one or more questions in the Programmer Analyst Aptitude Test (PAAT). Thus, a significant portion (64.3%) of the intended domain is assessed by the PAAT. As well, if the relative importance of the essential traits tested, to the ''weighted'' importance of the task, is considered - the overlap percentage improves to 69.3%.

April 1998

A statistically significant relationship exists between the PAAT and job success. The correlation coefficient (r = 0.457) is significant to the 0.01 level and indicates that the PAAT is highly predictive of on-the-job success for the programmer analyst position.  This conclusion was based on a study that compared the supervisory ratings of 63 application programmers whose performance was compared against their initial PAAT scores.  

This report presents a study of the reliability of the widely used test; the Programmer Analyst Aptitude Test. Reliability is a measure of the consistency of the instrument. If all external factors could be eliminated, test scores should generate "normative data" (i.e., mean mode, standard deviation) that is consistent regardless of population location. The conclusion is that there is no significant difference between population test scores according to geographic location. This conclusion was based on a study that compared the test scores of 4,165 application programmers in four geographical areas: Southeast (US), Midwest (US), Northwest (US), and Canada.

Business Analyst Skills Evaluation (1 Hour)

Business Analyst Skills Evaluation (2 Hours)

April 19, 1987

The Business Analyst Skills Evaluation was administered to 30 candidates of varying levels of data processing experience at a Walden client company located in Pittsburgh, PA.  The Business Analyst Skills Evaluation test scores were correlated to observed supervisory ratings for work done in business systems analysis after twelve months on the job.  The correlation coefficient (r = 0.49) is significant to the 0.01 level and indicates that the test is highly predictive of on-the-job success in business systems analysis. A secondary analysis (t Test) of the Wolfe AABP test battery was conducted with regard to male vs. female programming candidates. The results (t = 0.67) showed that there is no significant difference between the test scores of male and female candidates.

June 1987

This test was administered to 116 candidates at a large insurance company in Boston, MA.  The test was found to be highly correlated with supervisory ratings (r = 0.29), which is significant to the 0.01 level. This report was prepared by Carol Ann Dalto, Ph.D.

November 1992

Based on the evaluation of three positions at a major bank in New York, utilizing the Walden Business Analyst Skills Evaluation, the results conclusively demonstrated that the selection procedure measures and is a representative sample of those knowledge, skills and/or abilities, which are used in, and are a necessary prerequisite to, performance of critical or important work behavior(s). Conclusion: In every case, there was a significant overlap between the number of “essential” traits identified for the positions of Microcomputer Systems Analyst I, Microcomputer Systems Analyst II, Microcomputer Systems Analyst III, and those tested by the Business Analyst Skills Evaluation.

Project Leader Skills Evaluation (1 Hour)

Project Leader Skills Evaluation (3 Hours)

May 1991

For each of the five ''LEVELS'' of skill categories for the Project Management, Planning and Analytical job responsibilities, the job analysis indicated that a significant portion (from 54.5% to 61.6%) of the intended domain (essential traits) was assessed by the IS Project Leader Skills Evaluation (PLSE) test. In particular, if the relative importance of the essential traits tested, to the ''weighted'' importance of the task is considered, the results for each ''LEVEL'' were:

LEVEL 1: 11 tasks, 72 essential traits, 54.5% assessed by PLSE

LEVEL 2: 13 tasks, 78 essential traits, 58.1% assessed by PLSE

LEVEL 3: 14 tasks, 78 essential traits, 61.6% assessed by PLSE

LEVEL 4: 16 tasks, 85 essential traits, 59.5% assessed by PLSE

LEVEL 5: 15 tasks, 86 essential traits, 58.5% assessed by PLSE

PC Software User Aptitude Test

April 1987

Scores on the PC Software User Aptitude Test were found to be highly predictive of levels of learning of programming languages. It was not predictive of success in computer literacy courses, and appears to be highly correlated with problem solving on the PC. This validation report was prepared by George Jacobsen, George Burstein & Parviz Partow-Navid of California State University.

Network Analyst Staff Selector

August 1994

The Network Analyst must accomplish eight tasks to successfully perform his/her job responsibilities. A total of 68 traits were judged to be essential to accomplishing these tasks. Of these 68 traits, 44 are assessed by one or more questions in the Network Analyst Staff Selector (NASS) test. Thus, a significant portion (64.7%) of the intended domain is assessed by the NASS. As well, if the relative importance of the essential traits tested, to the ''weighted'' importance of the task, is considered - the overlap percentage improves to 70.4%.

Object-Oriented Programmer Analyst

January 1997

The Programmer Analyst must accomplish fourteen tasks to successfully perform his/her job responsibilities. Within the scope of testing, a total of 64 traits were judged to be essential to accomplishing these tasks. Of these 64 traits, 36 are assessed by one or more questions in the Object-Oriented Programmer Analyst Staff Selector. Thus, a significant portion (56.3%) of the intended domain is assessed by the Object-Oriented Programmer Analyst Staff Selector. As well, if the relative importance of the essential traits tested, to the ''weighted'' importance of the task, is considered - the overlap percentage improves to 71.9% for the Programmer Analyst.

Software Engineer Staff Selector

The Software Engineer must accomplish eleven tasks to successfully perform his/her job responsibilities. Within the scope of testing, a total of 76 traits were judged to be essential to accomplishing these tasks. Of these 76 traits, 47 are assessed by one or more questions in the Software Engineer Staff Selector. Thus, a significant portion (61.8%) of the intended domain is assessed by the Software Engineer Staff Selector. As well, if the relative importance of the essential traits tested, to the ''weighted'' importance of the task, is considered - the overlap percentage improves to 76.2% for the Software Engineer.

Computer Literacy Skills Profile

March 1997

The Staff Support Services Assistant must accomplish twelve tasks to successfully perform his/her job responsibilities.  Within the scope of testing, a total of 64 traits were judged to be essential to accomplishing these tasks.  Of these 64 traits, 37 are assessed by one or more questions in the Computer Literacy Skills Profile Test.  Thus, a significant portion (57.8%) of the intended domain is assessed by the Computer Literacy Skills Profile Test.  As well, if the relative importance of the essential traits tested, to the ''weighted'' importance of the task, is considered - the overlap percentage improves to 72.7% for the Staff Support Services Assistant.

Call Center Skills Test

Customer Service Skills Test

August 2001

A statistically significant relationship exists between the CSST (Internet version) and on-the-job performance. The correlation coefficient (r=0.427) is significant to the 0.05 level and indicates that the CSST (Internet version) is highly predictive of on-the-job success for this current position. This conclusion was based on a validation study that compared the supervisory ratings of 33 customer service representatives whose performances were compared to their initial CSST (Internet version) scores at Circle Corp.

Sales Skills Test

April 2001

The Sales Associate must accomplish thirteen tasks to successfully perform his/her job responsibilities. Within the scope of testing, a total of 49 traits were judged to be essential to accomplishing these tasks. Of these 49 traits, 31 are assessed by one or more questions in the Sales Skills Test. Thus, the test battery assesses a significant portion (63.3%) of the intended domain. As well, if the relative importance of the essential traits tested is compared to the ''weighted'' importance of the task, the overlap percentage improves to 80.6% for the Sales Associate job position.

Telemarketing Skills Test