This customized study will help you evaluate the success of your institution’s Advanced Placement Program® (AP) Exam placement policies. It gives you information on how well your current policies for granting AP credit for introductory courses are working for each higher-level course you choose to study.
To assess whether a particular policy is working as intended, the study will compare the performance of students who entered the higher-level course through AP credit to the performance of students who entered the course by completing the introductory AP-equivalent course or courses at your institution.
Designing Your Study
Get an overview of how to design your study below. For detailed step-by-instructions, download the ACES AP Placement Validity Study Guide (.pdf/558KB) or see the FAQ at the bottom of this page.
Choosing a Criterion and Predictors
In an ACES study, a criterion means a measure of student success that can be used to validate your admission or placement policies. The standard criterion for an ACES placement validity study is an end-of-course grade in a specific college course. For an AP placement validity study, you should use the course into which you place your students rather than the course out of which you will place students.
A predictor means a data point that you’re using to make your decisions and whose effectiveness you want to analyze. The standard predictors for an ACES AP placement validity study are AP Exam scores or final course grade in the course for which your institution offers AP credit.
Submitting Your Student Data
Which Students to Include
To be included in the sample, students must have a valid course grade on the criterion. Your results will help you make more accurate predictions if you keep these rules in mind:
- The sample of students used for the study should be similar to the group of students whose success you want to predict. Characteristics of the population such as gender, ethnicity, and age should be represented in the sample. We recommend including at least one entire cohort of students and two academic years of course records.
- The data from the predictor must have been collected before the criterion. That is to say, AP Exam scores or pre-requisite courses must have been completed before the student took the criterion course.
For help in analyzing the validity of a predictor for a sequence of courses, contact the ACES staff at [email protected].
Which Data to Include
You’ll need to supply identifying information on the students in your sample as well as data on your institution's AP credit and placement policy and the criterion (e.g., their final grade in the relevant course at your institution). Identifying information will be used to include College Board records on AP Exam scores.
Submitting Your Data File
You’ll be prompted to submit a data file when you design a new study. You can upload a new data file or reuse one from a previous study.
Your data file format must be Microsoft Excel, Comma Separated Value (CSV), Tab Delimited (.txt), or SAS Transport (XPORT).
For detailed information on preparing your data file, see the ACES Data Preparation Guidelines (.pdf/606KB).
Getting Your Report
When your study is complete—within 20 business days of your completed request—we’ll notify you that your report is available on the ACES website and you can sign in to access it. You’ll get two deliverables:
- A complete, printable report in PDF format that shows the strength of your chosen predictors of success—alone and in combination—with charts, tables, and detailed explanations.
- A report in HTML format featuring interactive graphs. You can click to display or hide data, compare data, zoom in and out, take a snapshot, sort table columns, and more.
See a Sample Report
-
ACES Sample AP Placement Validity Report
Sample ACES report analyzing how performance on AP Exams relates to student performance in sequent and subsequent coursework to evaluate credit and placement policies.
-
ACES Sample AP Placement Validity Report: Interactive Graphs
Sample interactive graphs that accompany the above report.
-
ACES AP Placement Validity Study Detailed Documentation
Supplemental information on how to specify different placement policies and logistics on conducting an AP Placement Validity Study.
Frequently Asked Questions
Placement Validity Studies
-
Do I need to submit a new data file for a placement study based on students analyzed in our admission study?
-
Can we get placement information for our math and English courses at the same time?
-
We use SAT scores for admission. How can we tell if they could help us in placement?
-
Can we include students with Pass/Fail grades in our placement validity study?
-
Can we include students with Fail, Incomplete, or Withdraw grades?
-
How should we collect data for a placement validity study?
-
What’s the minimum number of students needed for a placement validity study?
-
How many semesters of data are required for a study?
-
Can I include more than one cohort?
-
What if there is no specified sequent course?
-
Are grades required?
-
What if we only give placement for AP Exam scores and not course credit?
-
What if we only give course credit for AP Exam scores and not placement into a more advanced course?
-
What if our policy awards credit for more than one course?
-
What if students can earn course credit through other pathways, such as dual enrollment?
-
Can I conduct subgroup analyses or include control variables in the study?
-
Can we include other commercial exams as a predictor in my ACES study?
-
How do I analyze and articulate my institution’s AP credit and placement policies within ACES?