Aptitude Assessment Battery Programming

Purpose

To evaluate the aptitude and potential of candidates, at all experience levels, for their suitability for all aspects of applications programming.

General Description

The AABP is used for assessing your candidate's technical ability and work habits for applications programming positions. It can be used for candidates with or without prior programming training. The test functions independently of programming language and computer hardware knowledge. It answers the question, "How good a programmer is this candidate likely to be, and why?"

The AABP is neither an IQ nor a personality test. It simulates on-the-job assignments. Consisting of five problems, it permits evaluations of candidates' abilities to:

Positions for which the test is appropriate

This test will effectively measure programming potential for entry-level trainees and experienced candidates in the following positions.

Job Requirements and Activities

The AABP test has been used by over 2,000 client organizations to evaluate a candidate’s potential for work as an Applications Programmer. Extensive surveys have been conducted by our organization in conjunction with several client organizations to define the job requirements (traits) and job activities (duties).

Prime Traits Required

These are traits and skills, which were found to be essential for success as a programmer in the survey of job requirements:

1. Ability to think logically.
2. Ability to solve problems accurately .
3. Ability to perform basic arithmetic calculations (add, subtract, multiply, and divide).
4. Ability to work rapidly and accurately.
5. Ability to remember details and follow instructions.
6. Attention to detail.
7. Ability to handle new problems and adjust to changing situations.
8. Ability to document all aspects of work and communicate in written fashion.  
9. Ability to sustain concentration and withstand interruptions.
10. Ability to interpret intricate specifications of the type found in a programming manual, and to comprehend written material.
11. Ability to check coded information accurately .
12. Ability to produce original ideas in solving problems.
13. Ability to analyze charts, tables, and graphs.
14. Ability to persevere (stay with a problem until completed in all aspects).
15. Interest in programming as a career.
16. Ability to reason abstractly.
17. Ability to attack a problem from many angles.

Secondary Traits

These are traits, skills or job requirements which are nice to have, but not essential:

1. Ability to be open to suggestions.
2. Ability to relate to people.
3. Ability to show patience.
4. Ability to organize and plan.
5. Knowledge of structured programming.
6. Ability to work under pressure.
7. Finger dexterity.
8. Eye-hand coordination.
9. Ability to keep an even temperament.
10. Ability to exercise stability.
11. Knowledge of management information system.  
12. Ability to do a complete job.
13. Ability to comprehend quickly.
14. Ability to cooperate with others.
15. Ability to work with others in teams.
16. Ability to remember plans, rules and overall policy.
17. Ability to make decisions quickly and accurately.
18. Ability to initiate new activities or change current ones.
19. Ability to communicate orally.
20. Ability to show tact when dealing with others.
21. Ability to concentrate under distracting conditions.
22. Ability to work at repetitive or routine tasks.
23. Ability to set one’s own pace.
24. High school education – junior programmer.
25. Two years of college – intermediate programmer.
26. Four years of college – senior programmer.
27. Knowledge of computer mechanics, electronics, service.
28. Ability to listen effectively.
29. Ability to accept responsibility.
30. Ability to see problems as a challenge.
31. Ability to think critically.
32. Ability to adjust to change.
33. Ability to work independently.
34. Ability to show endurance.
35. Ability to demonstrate mental maturity.
36. Ability to work in a professional manner.  

Job Activities, Duties, Tasks and Responsibilities

These are for the Applications Programming position (all levels – junior, intermediate, and senior programmers):

1. Participating in the analysis and design of computer systems by analyzing problems in proposed systems.
2. Under supervision, performs simple program module design; codes, assembles, tests, and documents programs from prepared specifications.
3. Translate flow charts into machine language computer instructions.
4. Design program logic from detailed specifications, for simple to medium complexity routines.
5. Performs program maintenance to existing programs.
6. Compiles, assembles, debugs and tests new or modified program modules.
7. Prepares necessary Job Control Language to execute modules.
8. Desk checks, prepares unit test material, debugs, effects corrections and revisions.
9. Writes and maintains program and test documentation in accordance with standards.
10. Develops a working knowledge of the areas internal control procedure and its interface and impact on the external O. & S. project control procedure.  
11. Constantly searches for new and better programming techniques, and applies them to assigned new and existing programs.
12. Has a detailed knowledge of I/O capabilities.
13. Prepares specifications of the most complex programs or modules.
14. Document test results from program testing and required design changes.
15. Determine the structure and organization of storage files, tables, records and items for a data base design.
16. Devise a set of appropriate test data to use in evaluating specific program or run.
17. Prepare operating instructions for computer operator for each run, including handling of peripheral equipment and errors.
18. Write programs under an input-output control system.
19. Write programs that employ multiple channel I/O operations.
20. Write programs that employ random access storage devices.
21. Apply knowledge of mathematical techniques to solve business or technical problems.
22. Revise current forms or design new forms for necessary files and records.
23. Provide advice and assistance to systems analyst regarding capabilities and limitations of a computer system.
24. Monitor changes introduced at any stage of a program system development to insure that the impact of the change on all parts of the system is considered.  
25. Provide on-the-job training and guidance for IS/IT personnel.
26. Perform various maintenance operations such as error checking, testing, setup, error correction, verification, and maintenance documentation.
27. Prepare various reports including construction of forms, filling out and submission for maintenance, programs and/or progress reports.
28. Carry out training activities either in attending training, providing training to new employees or other DP personnel in unit.
29. Code program from specifications definition, adhering to department programming standards.
30. Prepare test data and test programs to insure job accuracy.
31. Design conversion procedure when required.
32. Prepare job control for programs.
33. Document programs and provide all ingredients required for job documentation.
34. Prepare documentation for user departments and assist in user training.
35. Design own data files.
36. Assist as required in solution of operation difficulties encountered in existing programs.
37. Design and develop test data and programs for testing. Is capable of testing, debugging and analyzing the results for validity and content.
38. Keeps abreast of improvements in programming, and documentation concepts.  

Administration Instructions

The test must be administered in your offices under supervision. The candidate should be allowed as much time as required in order to complete the test. The average time for completion is just over two hours. The test should be scheduled for the morning. A sandwich lunch may be provided at the desk rather than to allow an unsupervised outside lunch where several applicants taking the test would almost certainly discuss the test problems even if you asked them not to do so. The testing should not be extended to an additional day. If the person taking the test does not have a watch, a clock should be within view.

Several pencils should be provided, preferably No. 2 with an eraser. If feasible, a pencil sharpener should be available. The person should be instructed NOT to do his/her work in pen.  

There is more than enough space provided in the test booklet for every problem, but occasionally a person may need additional workspace, particularly if he does extensive desk-checking. The test administrator should give additional work paper only upon request, and after seeing that the original workspace was already used. Scrap paper should NOT be provided for the person to try out the problems in a preliminary way prior to his writing his solution in the test booklet. We must see all attempts made by the person in trying the problem. We do not grade answers only. All supportive written work must be shown in writing. If the person’s work does not show the supportive written work, our evaluation will be INCOMPLETE. The test booklet will be considered used. A retest for that person will not be authorized for a period of six months. Under no circumstances should a person be permitted to sue his own scrap paper. Such use would compromise the security of the test, and will, in effect, have removed a copy of one or more of the test problems.  

Under no circumstances should a person be permitted to take the test at home. He may try to help on the problems, or he may permit someone else to see the test or even make a copy of it. Another applicant with such advance preparation may later seek employment in your company, or another company using the test.

Some applicants have already spent hundreds of dollars on courses in programming, and will generally rationalize that there is nothing wrong about getting help on the test so long as they finally understand how to do the problems. But the test is designed on the assumption that these problems are new to the applicant, and that he is basing his understanding of the problem only on the written explanations stated in the problems.

The test administrator should NOT fill in any of the information requested of the applicant on pages 2, 6 and 32 of the test booklet. We must know whether the applicant is meticulous or non-responsive to requests for information on administrative forms, etc. The applicant should be told to turn to page 2 and BEGIN.  

We do not send an evaluation report to the person who took the test. It is the company that is our client. The return name and address filled in on page 5 of the test booklet must include the name of the company. If you are mailing more than one test booklet in the same envelope, it is not necessary to fill in the return information in all of the test booklets. One suffices.

If you wish to have the results in an abbreviated form as soon as we complete the grading and evaluation, please so request on page 5 and provide the name and telephone number. We will telephone you collect.

Grading of the test

The test is a five-problem test to evaluate the potential for success as an Applications Programmer. The applicant is required to do problems of increasing difficulty measuring his/her relative skill level in programming.

The AABP test measures the following traits and skills:

There are problems dealing with logical skills, documentation, and problems that test the ability to interpret specifications of the type found in a programming manual. Points are deducted in varying amounts depending upon the relative importance of the error. Logical errors are the most severely penalized. Error classifications are predetermined and checked for each test by following the candidate’s methodology and obtaining a “track” of the errors made throughout the test booklet by the candidate.

A detailed narrative report is prepared on each candidate where we choose an appropriate letter from a bank of approximately 10,000. The appropriate letter and accompanying skills and traits are selected and re-verified. The resulting narrative defines, very precisely, the relative strengths and weaknesses of the candidate.  

Sample question (segment)

Sample Candidate Evaluation Report

Click here to view a sample detailed evaluation report.

Evaluation

The overall rating is based on scores according to the following table:

*Percentile and Evaluation may differ due to time.

Validation Information

Prediction of Computer Programmer Training of Computer Programmer Training and Job Performance Using the AABP Test - A study conducted by the Central Intelligence Agency.

November 12, 1996: The results indicate that if 90% or higher scoring candidates on the Wolfe AABP test battery are hired, they are very likely to attain at least “Successfully Meets Requirements” (SM) if not “Frequently Meets Requirements” FM performance on the job. If the candidates were randomly selected without testing, it is likely that they would be randomly distributed across the 5 rating scales and there would not be such a profound bias toward the “Frequently Meets Requirements” and “Significantly Meets Requirements” (EX) ratings. A secondary analysis (t Test) of the Wolfe AABP test battery was conducted with regard to male vs. female programming candidates. The results (t = 0.67) showed that there is no significant difference between the tests scores of male and female candidates.

June 17, 1993: The Wolfe Assessment Battery Programming Test was administered to 63 candidates of varying levels of Data Processing experience at a Walden client company located in the southeast. The AABP test scores obtained were correlated to observed supervisory ratings for programming work performed in Applications Programming after one year of on-the-job experience. The Pearson correlation coefficient of (r) = 0.37 was found. This is significant to the 0.01 level, i.e. there is only 1 possible in 100 that this result could have occurred by chance.  This indicates that the test is highly predictive of on the job success as an  Applications Programmer.

April, 1989: Based on the evaluation of the Programmer Analyst position at XYZ Glass Packaging Corp. utilizing the Aptitude Assessment Battery Programming marketed by Walden Personnel Testing and Training Inc., the results conclusively demonstrated that the selection procedure measures, and is a representative sample of, that knowledge, those skills or abilities which are a necessary prerequisite to performance of critical or important work behavior(s). Conclusion:  There was a significant overlap between the number of "essential" traits identified for the job of Programmer Analyst at XYZ Glass Packaging Corp. and those tested by the AABP.

1981 - Test Reliability Report: The relationship between the scores achieved on the test and the retest are highly significant, even after the passage of several years. The AABP is consistently measuring some characteristics which validity studies correlate with programmer success without sex or cultural bias. Conclusion: The time and expense of testing in the employment process can be justified only if the results obtained are consistently and accurately measuring some factors which will influence future on-the-job behavior. The Wolfe AABP Test seems to be a reliable and valid instrument which can provide quantitative data to aid in employment and training decision making.

Languages published