Actuarial Outpost
 
Go Back   Actuarial Outpost > Exams - Please Limit Discussion to Exam-Related Topics > SoA/CAS Preliminary Exams > Short-Term Actuarial Math
FlashChat Actuarial Discussion Preliminary Exams CAS/SOA Exams Cyberchat Around the World Suggestions


Upload your resume securely at https://www.dwsimpson.com
to be contacted when our jobs meet your skills and objectives.


Short-Term Actuarial Math Old Exam C Forum

Reply
 
Thread Tools Search this Thread Display Modes
  #11  
Old 01-20-2015, 01:14 PM
x_chuck_x x_chuck_x is offline
Member
CAS
 
Join Date: Jul 2010
Location: Southeastern USA
Studying for 5
College: South Alabama(BS)/Jacksonville State (MBA)
Favorite beer: Root
Posts: 1,078
Default

Quote:
Originally Posted by Statatak View Post
Rumor alert.

The SOA adjusts the difficulty dynamically depending on the performance of previous students sitting for the exam in that window. If more students are passing than usual, the difficulty is increased. The opposite is true as well. This protects the integrity of the exam process and maintains the quality of the ASA credential.

This could be a total lie, but this is what I've been told.
I'm taking it on the last day hoping everyone who takes it before me fails and they make it super easy.
__________________
1 FM 3F 3L 4 5 6
VEE (ec) VEE (fin) VEE (st)
Online Course 1
Online Course 2
COP
Reply With Quote
  #12  
Old 01-20-2015, 01:28 PM
Abelian Grape's Avatar
Abelian Grape Abelian Grape is offline
Meme-ber                         Meme-ber
CAS
 
Join Date: Jul 2014
Favorite beer: Allagash Curieux
Posts: 42,069
Default

Quote:
Originally Posted by Sweetness0632 View Post
FWIW red text on the AO means sarcasm.

They don't adjust the difficulty that would completely ruin the SOA's integrity.

It's very simple, people who take the exam earlier in the window are more prepared so they think the exam is easier. People later in the window are less prepared so the exam seems harder.(on average)
__________________
Quote:
Originally Posted by Pension.Mathematics View Post
what's your problem man?
Reply With Quote
  #13  
Old 01-20-2015, 02:46 PM
sicn@rf's Avatar
sicn@rf sicn@rf is offline
Member
SOA
 
Join Date: Nov 2008
Posts: 170
Default

See what the SOA has to say on this..

"Some of the preliminary examinations are administered and scored according to computer–based testing methodologies. For the other multiple–choice examinations, a modified Angoff passing score study is performed. This is a common testing and measurement technique where a panel of experts in the subject material reviews the examination. Each expert is asked to review each question in the examination, and assess the difficulty of that question. More specifically, they are asked to estimate the likelihood that a candidate with minimum adequate knowledge competency would answer the question correctly. The sum of these probabilities, averaged across the panel of experts, gives a preliminary estimate of the pass mark.

The estimated pass mark resulting from the modified Angoff passing score study is compared to and balanced with the actual performance statistics on the examination in finalizing the pass mark. The effects of any particularly difficult questions are also factored into the determination of the final pass mark."
__________________
ASA ERM LP LFV MODULES DMAC FAC
Reply With Quote
  #14  
Old 01-20-2015, 03:19 PM
sicn@rf's Avatar
sicn@rf sicn@rf is offline
Member
SOA
 
Join Date: Nov 2008
Posts: 170
Default

I do not believe that the pass marks are adjusted based on early exam takers for the sitting in question.

I suspect that each question is given a weight on a scale of 1-10 based on difficulty (which may have influenced by the results on previous sittings). A panel then decides how many correct answers are required based on a series of average scores. Eg. avg. difficulty of 6 may require 20/30 to pass whereas an exam with an avg. difficulty of 5 may require 22/30 to pass.

Perhaps, each CBT randomly generates questions with a uniform distribution of average difficulty of say 5 to 7 with each exam pass mark already predetermined. This would ensure that the papers are fairly assessed from sitting to sitting so if more students meet the minimum requirement on a particular sitting than normal then so be it. What this means is that more students would have been more adequately prepared than other sittings.

My two cents worth on this.. I could be wrong.
__________________
ASA ERM LP LFV MODULES DMAC FAC
Reply With Quote
  #15  
Old 01-20-2015, 03:21 PM
actuary_aspire actuary_aspire is offline
Member
CAS
 
Join Date: Sep 2009
Posts: 3,979
Default

False.
Reply With Quote
  #16  
Old 01-20-2015, 03:31 PM
sicn@rf's Avatar
sicn@rf sicn@rf is offline
Member
SOA
 
Join Date: Nov 2008
Posts: 170
Default

Quote:
Originally Posted by sicn@rf View Post
I do not believe that the pass marks are adjusted based on early exam takers for the sitting in question.

I suspect that each question is given a weight on a scale of 1-10 based on difficulty (which may have influenced by the results on previous sittings). A panel then decides how many correct answers are required based on a series of average scores. Eg. avg. difficulty of 6 may require 20/30 to pass whereas an exam with an avg. difficulty of 5 may require 22/30 to pass.

Perhaps, each CBT randomly generates questions with a uniform distribution of average difficulty of say 5 to 7 with each exam pass mark already predetermined. This would ensure that the papers are fairly assessed from sitting to sitting so if more students meet the minimum requirement on a particular sitting than normal then so be it. What this means is that more students would have been more adequately prepared than other sittings.

My two cents worth on this.. I could be wrong.
Apparently here goes..

"each administration consists of multiple versions of the examination given
over a period of several days. The examinations are constructed and scored using Item Response Theory (IRT). Under IRT, each operational item that appears on an examination has been calibrated for difficulty and other test statistics and the pass mark for each examination is determined before the examination is given. All versions of the examination are constructed to be of comparable difficulty to one another."
__________________
ASA ERM LP LFV MODULES DMAC FAC
Reply With Quote
  #17  
Old 01-20-2015, 03:32 PM
PeppermintPatty's Avatar
PeppermintPatty PeppermintPatty is offline
Member
CAS
 
Join Date: Sep 2001
Posts: 39,342
Default

Quote:
Originally Posted by Sweetness0632 View Post
FWIW red text on the AO means sarcasm.

They don't adjust the difficulty that would completely ruin the SOA's integrity.

It's very simple, people who take the exam earlier in the window are more prepared so they think the exam is easier. People later in the window are less prepared so the exam seems harder.(on average)
This.

I was tangentially involved when the CAS helped transfer the joint prelininary exams to CBT. They used "standard computer–based testing methodologies". Which don't involve one person's performance in this window affecting other people sitting later in the window. I would be shocked if the exams were adjusted that way. I would be not-at-all-shocked to learn that people who think they need two more days to study are, on average less prepared than people who pick a conveninent date that happens to be earlier in the window, or than people who want to get it over with as soon as possible.
Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


All times are GMT -4. The time now is 01:56 PM.


Powered by vBulletin®
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.
*PLEASE NOTE: Posts are not checked for accuracy, and do not
represent the views of the Actuarial Outpost or its sponsors.
Page generated in 0.36447 seconds with 11 queries