The Adult Profile (AP) screens probationers for problems that are
barriers to successful post-probation adjustment. When used as intake, this
test enables probation officer's to know their probationers strengths and
weaknesses. The Adult Profile (AP) identifies negative attitudes, violent
tendencies, emotional problems, substance (alcohol and other drugs) abuse and
difficulties that are barriers to successful adjustment. Early problem
identification and measurement of problem severity enables probation officers
to match problem severity with counseling or treatment intensity. And this
increases successful outcomes.
We now know that timely and appropriate intervention directly influences
treatment effectiveness. So what does the Adult Profile (AP) screen? Areas of
inquiry are defined by AP scale or measures.
TEN AP SCALES
Truthfulness Scale: measures the truthfulness of
the probationer while completing the Adult Profile. This scale measures
denial, problem minimization and attempts to fake good.
Self-Esteem Scale: reflects the probationer's
explicit valuing and appraisal of self. This scale incorporates an attitude of
acceptance-approval versus rejection-disapproval.
Antisocial Scale: measures antisocial attitudes
and behavior. It identifies probationers that are opposed to society and can
be aggressive, destructive and irresponsible. High scorers are opposed to
social organization and moral codes.
Anxiety Scale: measures apprehension, nervousness
and somatic correlates of anxiety. Worry, fear, dread and angst are assessed.
Depression Scale: measures dejection,
discouragement, melancholy and self-depreciating emotional states. Melancholy
and dysphoria are assessed.
Distress Scale: measures experienced pain, worry,
sorrow, stress and distress. Distress can involve both mental and physical
strain. Distress can involve reasons why people seek counseling.
Family Issues Scale: measures family stability,
problems and concerns. The probationers rate their own family and relationship
stability.
Alcohol Scale: measures the probationer's alcohol
use and if present the severity of abuse. Alcohol refers to beer, wine and
other liquors.
Drugs Scale: measures drug use, and if present the
severity of abuse. Drugs refer to marijuana, crack, cocaine, amphetamines,
barbiturates, meth and heroin. Measures the severity of drug use and abuse.
Stress Coping Abilities Scale: measures how well
the probationer copes with stress. Stress exacerbates emotional and mental
health problems. A Stress Coping Abilities Scale score at or above the 90th
percentile identifies the presence of an established emotional or mental health
problems.
The Adult Profile (AP) provides a sound empirical basis for decision making. In
addition to establishing probationer truthfulness and substance abuse
involvement the AP measures important treatment recovery and relapse
indications.
Many probation officers need accurate and meaningful information before
referring probationers for help. The Adult Profile (AP) is an empirically based
assessment instrument or test that has impressive reliability and validity. The
Adult Profile (AP) helps make appropriate referrals as it identifies the nature
of needed treatment along with the appropriate level of care.
Advantages of Screening
Screening or assessment instruments filter out individuals with serious
problems that may require referral for substance abuse treatment or counseling.
This filtering system works as follows:
AP RISK RANGES
Risk Category
Risk Range Percentile
Total Percentage
Low Risk
0 - 39%
39%
Medium Risk
40 - 69%
30%
Problem Risk
70 - 89%
20%
Severe Problem
90 -100%
11%
Reference to the above table shows that a "problem" is not identified until a
scale score is at the 70th percentile or higher. These risk range percentiles
are calculated on the probationers that have completed the AP. This procedure
is fair and avoids extremes such as over-identification and
under-identification of problems.
Budgetary savings (dollars) can be large with no compromises in probationers
receiving appropriate evaluation and/or treatment services. Indeed, more
probationers would receive help. Without a screening program, there is usually
more risk of over or under-utilization of additional professional services.
AP Test Booklets
AP test booklets are provided free. These booklets contain 180 items and are
written at a 5th to 6th grade reading level. If a person can read the
newspaper, they can read the Adult Profile (AP).
Reports
In brief, AP reports summarize the probationer's self-report history, explain
what attained scale scores mean and offer specific score-related
recommendations.
Within 2 minutes of test data entry, automated (computer-scored) four-page
reports are printed on-site. These reports summarize a lot of information in an
easily understood format. For example, reports include a AP profile (graph),
which summarizes scale scores at a glance. Also included are attained scale
scores, an explanation of what each score means and specific score-related
recommendations. In addition, significant items (direct admissions) are
highlighted, and answers to a built-in interview (last sequence of items) are
presented. Emphasis is placed on having meaningful reports that are helpful and
easily understood.
To go directly to the example AP report, click on the AP Report link.
EXAMPLE AP REPORT
Reliability and Validity
The AP has a proprietary built-in database that insures inclusion of all tests
administered in a confidential (no names) manner. These reliability and
validity statistics are reported in the document titled "AP: An Inventory of
Scientific Findings." Annual database analysis further demonstrates the AP
scale to have high reliability and validity coefficients.
For example, the internal consistencies (coefficient alphas) for AP scales are
reported in the following table for AP assessed probationers in the year 2006.
This is one among several studies.
AP RELIABILITY COEFFICIENTS (N=3,414, 2006)
AP Scales
Coefficient Alpha
Significance Level
Truthfulness Scale
.88
p<.001
Antisocial Scale
.88
p<.001
Anxiety Scale
.92
p<.001
Depression Scale
.89
p<.001
Self-Esteem Scale
.91
p<.001
Distress Scale
.90
p<.001
Family Issues Scale
.88
p<.001
Alcohol Scale
.93
p<.001
Drugs Scale
.90
p<.001
Stress Coping Abilities Scale
.94
p<.001
All AP scales are reliable. All alpha coefficients are well above the
professionally accepted standard of .75. The results clearly demonstrate that
the AP is a reliable test.
Early AP validation studies involved other tests that measured the same thing.
These criterion group studies are reported in the document titled "AP: An
Inventory of Scientific Findings." Subsequent database research further
supports the validity of the AP. Moreover, in the 2006 study (N=3,414) reported
above, the accuracy of the AP was demonstrated. Of the probationers involved
who admitted to serious problems, the accuracy of identification is
demonstrated in the following table.
An AP research study is presented at the end of this webpage. To go directly to
this research, click the AP Research Study link.
AP ACCURACY (N=3,414, 2002)
AP Scales
Correct Problem Identification
Alcohol Scale
100%
Antisocial Scale
100%
Drugs Scale
100%
Anxiety Scale
100%
Depression Scale
98.1%
Distress Scale
93.1%
Family Issues Scale
100%
The 70th percentile cutoff for problem identification correctly classifies
nearly 100% of probationers with problems. The Low Risk level of 39% avoids
putting a large number of probationers into a "moderate" range.
Undesirable outcomes associated with inappropriate treatment level placement
are discussed by Andrews, Bonta and Hoge (1990). Their conclusions emphasize
the importance of AP scale accuracy. By most, if not all standards, AP scales
are reliable, valid and accurate.
Database
The AP system contains a proprietary built-in database. Earlier, it was noted
that all used AP diskettes are returned to Behavior Data Systems, and test data
is downloaded into the AP database. This expanding database allows ongoing
research and testing program summary. No personal information, names, social
security numbers, etc. are ever downloaded into any test database.
In summary, all returned AP diskettes' test data is centrally filed at Behavior
Data Systems' offices in the AP database. This database has many advantages.
Database analysis permits ongoing cost efficient research that includes scale
alpha coefficients, ANOVA, frequency distributions, correlations, cross-tab
statistics along with reliability, validity and accuracy determinations. Annual
testing program summary provides a vehicle for program evaluation.
Annual Summary Reports
Behavior Data Systems can access each of its tests' built-in databases for
statistical analysis and summarization of all tests administered in a year.
Annual Summary Reports are prepared for state, department, agency and even some
high volume individual providers -- at no cost to them. These reports are
provided as a professional courtesy to large volume test users. Summary reports
include demographics, court-history when relevant, and test statistics
(reliability, validity). Has anyone offered to summarize your testing program?
Annually? At no additional cost to you? Minimum testing volume for annual
reports is 350 tests. There is no maximum limit. Behavior Data Systems' annual
reports range in size from 800 tests to over 55,000 tests annually. An example
Annual Summary Report can be viewed by clicking on this
Annual Summary Report link.
Staff Member Input
The AP is to be used in conjunction with experienced staff judgment.
Experienced staff should interview the probationer. For these reasons, the
following statement is contained in each AP report: "Adult Profile results are
confidential and should be considered a working hypothesis. No diagnosis or
decision should be based solely upon these results. Use only with experienced
staff judgment."
Unique AP Features
Truthfulness Scale: Identifies denial, problem
minimization and faking. It is now known that many probationers attempt to
minimize their problems. A Truthfulness Scale is a necessary component in
contemporary tests. The AP's Truthfulness Scale has been validated with the
Minnesota Multiphasic Personality Inventory (MMPI), polygraph exams, other
tests, truthfulness studies and experienced staff judgment. The AP's
Truthfulness Scale has been demonstrated to be reliable, valid and accurate. In
some respects, the AP's Truthfulness Scale is similar to the MMPI's L and
F-Scales. It consists of a number of items that most people agree or disagree
with.
Truth-Corrected Scores: Have proven to be very
important for assessment accuracy. This proprietary truth correction process is
comparable to the MMPI's K-Scale correction. The AP's Truthfulness Scale has
been correlated with the other 9 scales. The Truth Correction equation converts
raw scores to Truth-Corrected scores. Truth-Corrected scores are more accurate
than raw scores. Raw scores reflect what the probationer wants you to know.
Truth-Corrected scores reveal what the probationer is attempting to hide.
Stress Coping Abilities Scale: Measures how well
the probationer handles stress, tension and pressure. And, we now know that
stress exacerbates emotional and mental health symptomatology. This scale is a
non-introversive way to screen for established (diagnosable) mental health
problems. A person scoring at or above the 90th percentile on the Stress Coping
Abilities Scale should be referred to a certified mental health professional
for a more comprehensive evaluation and diagnosis.
Three ways to give the AP. The AP can be
administered in three different ways: 1. Paper-pencil
test booklet format is the most popular testing procedure. AP English and
Spanish test booklets and answer sheets are available. 2.
Tests can be given directly on the computer screen. Some agencies dedicate
computers for AP testing. And, 3. Human Voice
Audio in English or Spanish is available. These three test administration modes
are discussed in the "AP: Orientation and Training Manual." Each test
administration mode has advantages and some limitations. Behavior Data Systems
offers these three test modes so test users can select the administration mode
that is optimally suited to their needs.
Reading Impaired Assessment: Reading impaired
probationers represent 20+ percent of the probationers tested. This represents
a serious problem to other treatment tests. Behavior Data Systems has developed
an alternative for dealing with this problem: Human Voice Audio.
Human Voice Audio: Presentation of the AP is in
English and Spanish. Clients' passive vocabularies are often greater than their
active vocabularies. Hearing items read out loud often helps reduce cultural
and communication problems. This administration mode requires earphones and
simple instructions to orient the probationer to the up-down arrow keys on the
computer keyboard. Human Voice Audio is an alternative approach for screening
reading impaired probationers.
Confidentiality: Behavior Data Systems encourages
test users to delete probationer names from diskettes before they are returned
to Behavior Data Systems. Once probationer names are deleted, they are gone and
cannot be retrieved. Deleting probationer names does not delete demographics or
test data, which is downloaded into the AP database for subsequent analysis.
This proprietary name deletion procedure involves a few keystrokes and insures
probationer confidentiality and compliance with HIPAA (federal regulation 45
C.F.R. 164.501).
Test Data Input Verification: Allows the person
that inputs test data from the answer sheet into the computer to verify the
accuracy of their data input. In brief, test data is input twice, and any
inconsistencies between the first and second data entries are highlighted until
corrected. When the first and second data entries match or are the same, the
staff person can continue. This proprietary Data Input Verification procedure
is optional, yet strongly recommended by Behavior Data Systems.
Orientation and Training Manual: The "AP:
Orientation and Training Manual" (O&T Manual) explains how the AP works. It
is a must read for staff that will be using the AP. O&T Manual content
includes, but is not limited to, the following: instructions for testing, an
explanation of how scores are derived, a clarification of how court-related
information is used, a description of unique AP features and much more.
Staff Training: Behavior Data Systems' staff is
available to participate in AP training programs conducted by statewide
programs, departments and high volume agencies in the United States. Sometimes,
smaller volume providers get together for collective (multiple providers)
on-site training. Behavior Data Systems typically participates in 4-hour or
6-hour AP training sessions. This training can include hands-on computer
scoring, as desired. Behavior Data Systems gives attendees certificates
attesting to their AP training.
Staff training is also provided on Fridays at Behavior Data Systems' Phoenix
offices from 8:30 a.m. to 11:30 a.m. or from 1:30 p.m. to 4:30 p.m. These
training sessions are free. To participate, contact Behavior Data Systems at
least ten days in advance. Participation is on a first call, first scheduled
basis.
Support Services: Behavior Data Systems provides a
full range of support services. These services include e-mail, fax and
telephone availability, provision of test-related information, telephone
walk-through assistance, staff training and test consultation. Support services
and test-related materials are provided free.
Test Unit Fee (Cost): AP cost information can be
reviewed by clicking on the Test Unit Fee (Cost) link.
There is only the one cost or charge, and that is the test unit fee. Everything
else is included at no additional cost to the test user. This includes test
booklets, answer sheets, training manuals, upgrades, ongoing database research,
annual summary testing reports, staff training, and support services. Do not be
misled by some test publishers' à la carte pricing like separate costs for each
test administration as well as for each of the test-related items listed above.
Instead of asking for the test administration cost, ask for the total cost
involved in using a test. We believe Behavior Data Systems' one test unit fee
is very affordable.
Free Examination Kit: A 1-test demonstration
diskette is available on a 30-day cost free basis. Demo diskettes are in
Windows format. The Examination Kit includes a 1-test demo diskette,
installation CD (with instructions), test booklet, answer sheet and some
descriptive materials. Behavior Data Systems, Ltd. does want the test booklet
and diskette returned within 30 days.
Reference
Andrews, D., Bonta, J. & Hoge, R. (1990). Classification for effective
rehabilitation: Rediscovering Psychology. Criminal Justice and Behavior 17, 19
- 52.
Selecting a Screening and Referral or Intake Test
If you are selecting a screening and referral and/or intake screening test, the
following Comparison Checklist should prove helpful. It lists important
screening test qualities. The "Other" column represents any other test you
might want to compare to the AP.
TEST COMPARISON CHECKLIST
COMPARISON CATEGORIES
AP
Other
Designed Specifically for Screening and Referral
Yes
A Counseling and Treatment Intake Test
Yes
Test Reliability and Validity Research Provided
Yes
Test Completed in 30 Minutes
Yes
On-Site Reports within 2½ Minutes On-Site
Yes
Truthfulness Scale to Detect Minimization and Faking
Yes
Truth-Corrected Scores for Accuracy
Yes
Three Test Administration Options
Yes
1. Paper-Pencil (English and Spanish)
Yes
2. On Computer Screen (English and Spanish)
Yes
3. Human Voice Audio (English and Spanish)
Yes
Delete Client Names (insures confidentiality) Program
Yes
HIPAA (federal regulation) Compliant
Yes
Test Data Input Verification (insures accuracy) Program
Within 2 minutes of test data entry, automated (computer-scored) three-page
reports are printed on-site. These reports summarize a lot of information in an
easily understood format. For example, reports include an AP profile (graph),
which summarizes scale scores at a glance. Also included are attained scale
scores, an explanation of what each score means and specific score-related
recommendations. In addition, significant items (direct admissions) are
highlighted, and answers to a built-in interview (last sequence of items) are
presented. Emphasis is placed on having meaningful reports that are helpful and
easily understood.
Largely because the Adult Profile (AP) is a probation screening test,
considerable space has been allocated for the evaluator's recommendations.
Sometimes, assessors are influenced by information obtained from the
probationer's record, in interview or from a significant "other." It is
recommended that such sources of information be referenced and clarified. In
other instances, the assessor may want to note their intuitions, insights or
"hunches." And, it often requires space to summarize the clinical situation,
probationer's motivation and recommendations. Page 4 of the AP report provides
space for the evaluator's observations, conclusions and recommendations. Page 4
concludes with the probation officer's signature, date of the evaluation and a
summary of the probationer's answers.
Additional information can be provided upon request by writing:
Behavior Data Systems, Ltd. P.O. Box 44256 Phoenix, Arizona 85064-4256.
Our telephone number is (602) 234-3506
Our fax number is (602) 266-8227
and our e-mail address is
bds@bdsltd.com.
