Behavior Data Systems
Assessment Tests and Interviews Reliable Computer Graded Assessment

   

Juvenile Treatment Outcome
Counseling / Treatment -- Outcome / Effectiveness Tests

Juvenile Treatment Outcome (JTO) is an automated (computer scored on-site) assessment instrument or tests that can be used to evaluate counseling and treatment outcome.  In brief, the same test is administered at the beginning of treatment and at the completion of treatment.  The JTO provides an objective pretest-posttest outcome comparison.


APPLICATIONS
** Juvenile Treatment Outcome (JTO) **
  • Juvenile counseling outcome
     
  • Juvenile treatment effectiveness
     
  • Appropriate for males and females
     
  • Counseling & treatment effectiveness
     
  • Counseling program & health professionals
     

The Juvenile Treatment Outcome (JTO) is an objective outcome test.  It has 163 items and takes 35 to 40 minutes to complete.  JTO has twelve scales (measures):

  • 1. Truthfulness Scale
  • 2. Self-Esteem Scale
  • 3. Outlook Scale
  • 4. Adjustment Scale
  • 5. Depression Scale
  • 6. Anxiety Scale
  • 7. Suicide Scale
  • 8. Control Scale
  • 9. Violence Scale
  • 10. Alcohol Scale
  • 11. Drugs Scale and
  • 14. Stress Coping Abilities Scale.

The twelve JTO scales (measures) are the criterion for comparison.  These scales are a standard by means of which a judgment (improved, stayed the same or got worse) can be made.  Pretest scale scores are the baseline against which posttest scale scores are compared.  The attitudes and behaviors attained at the pretest represent the standard used to evaluate subsequent posttest scale scores.  JTO pretest scale scores are the standard for judging outcome, for example at posttest, if the posttest scale score is higher than the pretest scale score - then the client got worse.  If pretest and posttest scores are the same - the client stayed the same.  And if the posttest scales are lower than the pretest scale scores - the client improved or got better.

Twelve Juvenile Treatment Outcome Scales

1.      Truthfulness Scale: determines how truthful the juvenile was while completing the test.  This scale identifies denial, defensiveness, attempts to minimize problems and "faking good."

2.      Self-Esteem Scale:reflects a youth's explicit valuing and appraisal of self.  Self-Esteem incorporates an attitude of acceptance-approval versus rejection-disapproval.  It measures a person's perception of self.

3.      Outlook Scale: reflects a relatively stable predisposition to react to life adjustments in a consistent way.  A person's outlook or attitudes are complex and include enduring preferences, prejudices, views and predilections.  Simply stated juveniles often convey a positive, negative or neutral outlook.

4.      Adjustment Scale: measures the youth's ability to adapt, conform and function.  This scale recognizes personal and social stressors at home, school and in authority relationships.  It incorporates personal and social forces involved in adapting to one's environment.

5.      Depression Scale: measures dejected and self-depreciating, emotional states that vary from normal to pathological.  Melancholy, unhappiness and dysphoria are included in this definition of depression.

6.      Anxiety Scale: measures nervousness, apprehension and somatic correlates of anxiety.  This score varies directly with experienced symptoms.  "Adolescence" has been characterized as the "age of anxiety."

7.      Control Scale: measures a youth's need to control others.  In social psychology control is often a synonym for power and influence.  Control refers to the process of regulating, restraining or controlling others.

8.      Violence Scale:measures the juvenile's propensity for using force to injure, damage or destroy.  This scale identifies people that are dangerous to themselves and others.

9.      Suicide Scale: identifies suicide prone juveniles.  These youth are often desperate, overwhelmed, emotionally isolated while manifesting suicidal ideation and symptomatology.

10.  Alcohol Scale: measures alcohol use and the severity of abuse.  "Alcohol" refers to beer, wine and other liquors.  This scale measures the severity of alcohol abuse while identifying alcohol-related problems.

11.  Drugs Scale: measures the severity of drug (marijuana, crack, ice, LSD, ecstasy, amphetamines, barbiturates and heroin) use and abuse while identifying drug-related problems.

12.  Stress Coping Abilities Scale: measures the youth's ability to cope effectively with stress, tension and pressure.  Stress exacerbates emotional and mental health symptoms.  This is a non-introversive way to screen for the presence of diagnosable mental health problems.

JTO  REPORTS

The Juvenile Treatment Outcome (JTO) measures attitudes and behaviors important to counseling and treatment outcome.  In brief, there are two Juvenile Treatment Outcome (JTO) reports.  The Pretest report is generated the first time a juvenile is tested.  The Treatment Outcome report results from a computer-generated comparison of JTO Pretest and JTO Posttest results.  Scale scores in the JTO Treatment Outcome report are reported in terms of having improved, stayed the same or gotten worse.

This test is scheduled to be added to our online testing platform, www.online-testing.com.

As noted earlier, the Treatment Outcome Report results from a computer generated comparison of the JTO Pretest scale and JTO Posttest scale results.  And the JTO Treatment Outcome Report objectively compares pretest with posttest scores to show if the juvenile's scale scores improved, stayed the same or got worse.

To help insure accurate pre-post comparison juveniles are instructed to answer JTO statements in the "present" tense and how the feel "now."  Instructions continue "If necessary use the last month (30 days) as your reference."  In addition, several JTO items refer to "this past month (30 days)" as additional "time reference" reminders.

It should be noted that youth's are administered the same JTO test twice.  The juvenile's responses to the first JTO test administration are then the comparison criteria for subsequent JTO test administrations.  Using the youth's first JTO test scores as the standard against which subsequent JTO test administrations are compared has several advantages.  JTO orientation is consistent.  Each individual's interpretation of JTO instructions, although individualized or even idiosyncratic, is more likely to be uniform.  JTO scales (measures) are then the comparison criteria.  This insures comparison of objective, unchanging and measurable scale scores.

The Juvenile Treatment Outcome test is to be used as an objective outcome instrument that measures important attitudes and behaviors typically addressed in juvenile counseling/treatment/therapeutic programs.

The JTO Pretest is administered before counseling/treatment.

The Posttest is administered after treatment.

The Example Reports are available here for review.

Software

The Juvenile Treatment Outcome (JTO) is available in Windows format.  Windows diskettes require a one time computer setup procedure after which JTO data diskettes (25 or 50 test applications) are used.  Training manuals are provided and new test users can be walked through these procedures over Behavior Data Systems (BDS) telephone line.

Proprietary data diskettes contain 25 or 50 test applications.  The 3½" data diskettes score, interpret and print JTO reports on-site.

How the System Works

Once your testing account is established with BDS ordered diskettes are mailed to users.  Ninety-eight percent of new orders are lace n the same day's return mail.  When all test applications are use on a data (25 or 50 tests) diskette, you should "delete" all client (respondent) names and return the diskette to BDS where the test data and demographics are downloaded into the JTO database for subsequent research analysis.  This is done at no additional cost to test users.

The proprietary "delete names" program is activated by the test user with a few keystrokes to delete all client names from diskettes before they are returned to BDS.  Deleting all client names insures juvenile confidentiality and compliance with HIPAA (federal regulation 45 C.F.R 164.501).

JTO Database

The JTO system contains a built-in database.  Earlier it was noted that all JTO used diskettes are returned to BDS, and the test data along with juvenile demographics (age, gender, education) are downloaded into the JTO database.  This database allows ongoing database research and testing program summary -- at no additional cost.  Ongoing research insures quality control.  Testing programs summaries provide program self-evaluation.

Built-in Database

JTO permits ongoing research and annual program summary -- at no additional cost.  As discussed earlier, when the 25 or 50 test applications or a diskette are used, that diskette is returned to BDS, and downloaded into JTO's expanding database (research) analysis and annual summary reports.  To review an annual summary report click on thisAnnual Summary Report link.

No personal information, names, social security numbers, etc. are ever downloaded into any test database.

In summary, having all used JTO test diskettes centrally filed at BDS offices in the JTO database has many advantages.  Database analysis permits ongoing cost efficient research that includes scale alpha coefficients, frequency distributions, correlations, ANOVA, cross-tab statistics along with reliability, validity and accuracy determinations.

After downloading test data returned diskettes are destroyed.

Annual Summary Reports

BDS can access each of its tests' built-in databases for statistical analysis and summarization of all tests administered in a year.  Annual summary reports are prepared for state, department, agency and even some individual providers -- at no cost to them.  These reports are provided as a professional courtesy to large volume test users.  Summary reports include demographics, court history when relevant and test statistics (reliability, validity and accuracy).  Has anyone offered to summarize your testing program?  Annually?  At no additional cost to you.  Minimum testing volume for free annual reports is 350 tests.  This is no maximum limit.  BDS's annual summary reports range in size from 350 to over 55,000 tests annually.  An example annual summary report can be viewed by clicking on this Annual Summary Report link.

Research: Reliability, Validity and Accuracy. The JTO has a built-in database that insures inclusion of tests administered in a confidential "no names" manner.  And, these reliability, validity and accuracy statistics are in the document titled "JTO: An Inventory of Scientific Findings."

JTO Reliability

Within-test reliability or inter-item reliability coefficients alphas for the JTO are presented in the table below.  As demonstrated in the table, alpha coefficients for all JTO scales are well above the professionally accepted standard of .80.  Indeed, all of the JTO scales are at or above .84.  These high reliability statistics are very impressive for an outcome test.  These results show that the JTO is a very reliable outcome assessment instrument or test.

JTO Pretest and Posttest test booklets are the same.  The Pretest is administered before counseling/treatment and the Posttest is administered after treatment.

Juvenile Treatment Outcome

The reliability coefficients demonstrate that the JTO maintains high test-retest reliability.  The JTO Posttest reliability coefficients are as high as the Pretest coefficients.

All JTO scales have alpha coefficients well above the professionally accepted standard of .80 and are highly reliable.  And, all coefficients alphas are significant at the P.001 level.  People interested in an "outcome" test might initially inquire about the test's Pretest-Posttest relationship.  Scores between the Pretest and Posttest vary to an unknown degree because of the impact of the intervention (counseling or treatment) is unknown until demonstrated by the Pretest-Posttest outcome comparison.  Establishing this relationship is the purpose of the JTO that is to measure the impact of the intervention (counseling or treatment).  Successful treatment should result in lower Posttest scores.  In contrast, ineffective or unsuccessful counseling or treatment should result in higher Posttest scale scores.

Staff Member Input

Some mental health professionals advocate fully automating assessment.  BDS does not.  The JTO is to be used in conjunction with experienced staff judgment.  Experienced staff should also interview the client.  For these reasons, the following statement is contained on each JTO report: "The JTO is to be used in conjunction with experienced staff judgment.  No diagnosis or decision should be based solely upon JTO results."

Truthfulness Scale

This scale identifies denial, problem minimization and faking.  It is now known that most problematic juveniles attempt to minimize their problems.  We believe a Truthfulness Scale is a necessary component in contemporary tests.  The JTO has been validated with Minnesota Multiphasic Personality Inventory (MMPI), polygraph exams, and other tests.  The JTO Truthfulness Scale has been empirically demonstrated to be reliable, valid and accurate.  In some respects the JTO Truthfulness Scale is similar to the MMPI's L and F scales.  It consists of a number of items that most juveniles agree or disagree with.

Selecting an Outcome Test

If you are searching for a juvenile outcome assessment instrument or test, the following Comparison Checklist should prove helpful.  It lists important "outcome" test characteristics.  The "Other" column represents any other outcome (treatment effectiveness) test you might want to compare to the Juvenile treatment Outcome (JTO).


TEST COMPARISON CHECKLIST
COMPARISON CATEGORIES JTO Other
Designed Specifically for Juvenile Assessment Yes  
Test Reliability & Validity Research Provided Yes  
Test Completed in 15 to 20 Minutes Yes  
On-Site Reports within 2½ Minutes Yes  
Truthfulness Scale to Detect Faking Yes  
Truth-Corrected Scores for Accuracy Yes  
Three Test Administration Options Yes  
  1. Paper-Pencil (English and Spanish) Yes  
  2. On Computer Screen (English and Spanish) Yes  
  3. Human Voice Audio (English and Spanish) Yes  
Delete Juveniles Names (confidentiality) procedure Yes  
HIPAA (federal regulation) Compliant Yes  
Very Affordable Test Unit Fee Yes  
Test Data Input Verification (accurate scoring) Yes  
Available in English and Spanish Yes  
Built-in Database Yes  
Annual Database Research (Free) Yes  
Annual Test Program Summary (Free) Yes  
Comprehensive Assessment (Five Scales) Yes  
Specific Scale Score-Related Recommendations Yes  
Alcohol and Drugs Scales Yes  
Distress Scale Yes  
Adjustment Scale Yes  
Easily Understood and Helpful Reports Yes  
ASAM Compatible Recommendations Yes  
Staff Training (Free) Yes  
Examination Kits (Free) Yes  

Reading Impaired Assessment

Reading impaired juveniles represent 20+ percent of the juveniles tested.  This represents a serious problem to other tests.  BDS has developed an alternative for dealing with this problem: Human Voice Audio.

Human Voice Audio

Presentation of the JTO is in English and Spanish.  Juvenile's passive vocabularies are often greater than their active (spoken) vocabularies.  Hearing items read out loud often helps reduce cultural and communication problems.  This test administration mode requires earphones and simple instructions to orient the youth to the up-down arrow keys on the keyboard.  Human Voice Audio provides an alternative for testing reading impaired juveniles.

Confidentiality

Behavior Data Systems (BDS) encourages test users to delete juvenile's names from diskettes before they are returned to BDS.  Once a youth's name is deleted, it is gone and cannot be retrieved.  Deleting names does not delete demographics or test data, which is downloaded into the JTO database for subsequent analysis.  This proprietary name deletion procedure involves a few keystrokes and insures youth confidentiality and full compliance with HIPAA (federal regulation 45 C.F.R. 164.501).

Test Data Input Verification

Data input verification allows the person that inputs test data from an answer sheet into the computer to verify the accuracy of their data input.  In brief, test data is input twice and any inconsistencies between the first and second data entries are highlighted until corrected.  When the first and the second data entries match or are the same, the staff person can continue.

Orientation and Training Manual

The "JTO Orientation and Training Manual" explains how the JTO works.  It is recommended to staff that will be using the JTO.  This manual's content includes the following: instructions for testing, an explanation of scoring, description of unique JTO features and much more.

Staff Training

BDS's staff are available to participants in JTO training programs conducted by statewide programs, departments and high volume testing agencies in the United States and Canada.  Sometimes smaller volume providers get together for collective (multiple providers) on-site training.  BDS gives attendees certificates attesting to their JTO training.

Staff training is also provided on Fridays at BDS's Phoenix Arizona offices from 8:30 a.m. to 11:30 a.m. or from 1:30 p.m. to 4:40 p.m.  These training sessions are free.  To participate contact BDS at least 10 working days in advance.  Participation is on a first call, first scheduled basis.

Cost (Test Unit Fee)

JTO cost information can be reviewed by clicking on this Prices link.  There is only the one cost or charge which we call the Test Unit Fee.  Everything else is included at no additional cost to the test user.  This includes test booklets, training manuals, upgrades, ongoing database research, annual summary reports, staff training and support services.

Free Examination Kit

A 1-test demonstration diskette is available on a 30-day cost free basis. Demo diskettes are in Windows format. The Examination Kit includes a 1-test demo diskette, installation CD (with instructions), test booklet, answer sheet and some descriptive materials. Behavior Data Systems, Ltd. does want the test booklet and diskette returned within 30 days.



Additional information can be provided upon request by writing:
Behavior Data Systems, Ltd.
P.O. Box 44256
Phoenix, Arizona 85064-4256.

Our telephone number is (602) 234-3506
Our fax number is (602) 266-8227
and our e-mail address is bds@bdsltd.com.


Behavior Data Systems, Ltd. Copyright © 2007. All Rights Reserved

* * * * *

***************************************