{"id":12274,"date":"2012-12-07t15:18:44","date_gmt":"2012-12-07t20:18:44","guid":{"rendered":"\/\/www.imrbdigital.com\/?page_id=12274"},"modified":"2021-03-01t10:47:09","modified_gmt":"2021-03-01t15:47:09","slug":"writing-good-multiple-choice-test-questions","status":"publish","type":"page","link":"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/","title":{"rendered":"writing good multiple choice test questions"},"content":{"rendered":"<table style=\"height: 72px\" width=\"725\">\n<tbody>\n<tr>\n<td width=\"235\"><em>by cynthia j. brame<\/em><\/td>\n<td style=\"text-align: right\" width=\"208\"><a href=\"\/\/www.imrbdigital.com\/wp-content\/uploads\/sites\/59\/handout_mc-test-items_rev2.docx\">print version<\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<table style=\"height: 37px\" width=\"731\">\n<tbody>\n<tr>\n<td bgcolor=\"#deeaee\" width=\"443\">\n<p style=\"padding-left: 30px\"><strong>cite this guide:<\/strong> brame, c. (2013) writing good multiple choice test questions. retrieved [todaysdate] from \/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/.<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<hr \/>\n<ul>\n<li><a href=\"#stem\">constructing an effective stem<\/a><\/li>\n<li><a href=\"#alternative\">constructing effective alternatives<\/a><\/li>\n<li><a href=\"#guidelines\">additional guidelines for multiple choice questions<\/a><\/li>\n<li><a href=\"#higher\">considerations for writing multiple choice items that test higher-order thinking<\/a><\/li>\n<li><a href=\"#resources\">additional resources<\/a><\/li>\n<\/ul>\n<hr \/>\n<p>multiple choice test questions, also known as items, can be an effective and efficient way to assess learning outcomes. multiple choice test items have several potential advantages:<\/p>\n<p style=\"padding-left: 30px\"><span style=\"color: #800000\"><strong><em>versatility:<\/em><\/strong><\/span> multiple choice test items can be written to assess various levels of <img data-attachment-id=\"12277\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/abcd\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130103\/abcd.jpg\" data-orig-size=\"760,2200\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"abcd\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130103\/abcd-103x300.jpg\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130103\/abcd-224x650.jpg\" loading=\"lazy\" class=\"alignright size-medium wp-image-12277\" title=\"abcd\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130103\/abcd-103x300.jpg\" alt=\"\" width=\"103\" height=\"300\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130103\/abcd-103x300.jpg 103w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130103\/abcd-224x650.jpg 224w\" sizes=\"(max-width: 103px) 100vw, 103px\" \/>learning outcomes, from basic recall to application, analysis, and evaluation. because students are choosing from a set of potential answers, however, there are obvious limits on what can be tested with multiple choice items. for example, they are not an effective way to test students\u2019 ability to organize thoughts or articulate explanations or creative ideas.<\/p>\n<p style=\"padding-left: 30px\"><span style=\"color: #800000\"><strong><em>reliability:<\/em><\/strong> <\/span>reliability is defined as the degree to which a test consistently measures a learning outcome. multiple choice test items are less susceptible to guessing than true\/false questions, making them a more reliable means of assessment. the reliability is enhanced when the number of mc items focused on a single learning objective is increased. in addition, the objective scoring associated with multiple choice test items frees them from problems with scorer inconsistency that can plague scoring of essay questions.<\/p>\n<p style=\"padding-left: 30px\"><span style=\"color: #800000\"><strong><em>validity:<\/em><\/strong> <\/span>validity is the degree to which a test measures the learning outcomes it purports to measure. because students can typically answer a multiple choice item much more quickly than an essay question, tests based on multiple choice items can typically focus on a relatively broad representation of course material, thus increasing the validity of the assessment.<\/p>\n<p>the key to taking advantage of these strengths, however, is construction of good multiple choice items.<\/p>\n<p style=\"text-align: left\">a multiple choice item consists of a problem, known as the stem, and a list of suggested solutions, known as alternatives. the alternatives consist of one correct or best alternative, which is the answer, and incorrect or inferior alternatives, known as distractors.<\/p>\n<p style=\"text-align: center\"><img data-attachment-id=\"12463\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/stem-alt\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130044\/stem-alt.png\" data-orig-size=\"952,449\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"stem-alt\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130044\/stem-alt-300x141.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130044\/stem-alt-650x306.png\" loading=\"lazy\" class=\"size-full wp-image-12463 aligncenter\" title=\"stem-alt\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130044\/stem-alt.png\" alt=\"\" width=\"476\" height=\"246\" \/><\/p>\n<h2><a name=\"stem\"><\/a>constructing an effective stem<\/h2>\n<p>1. <span style=\"color: #3d8dc2\"><strong>the stem should be meaningful by itself<\/strong> <\/span>and should present a definite problem. a stem that presents a definite problem allows a focus on the learning outcome. a stem that does not present a clear problem, however, may test students\u2019 ability to draw inferences from vague descriptions rather serving as a more direct test of students\u2019 achievement of the learning outcome.<\/p>\n<p><img data-attachment-id=\"12466\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/stem-not-meaningful\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130043\/stem-not-meaningful.png\" data-orig-size=\"687,444\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"stem-not-meaningful\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130043\/stem-not-meaningful-300x193.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130043\/stem-not-meaningful-650x420.png\" loading=\"lazy\" class=\"alignleft size-full wp-image-12466\" title=\"stem-not-meaningful\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130043\/stem-not-meaningful.png\" alt=\"\" width=\"304\" height=\"211\" \/><img data-attachment-id=\"12468\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/better-stem2\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130042\/better-stem2.png\" data-orig-size=\"684,443\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"better-stem2\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130042\/better-stem2-300x194.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130042\/better-stem2-650x420.png\" loading=\"lazy\" class=\"size-full wp-image-12468 alignright\" title=\"better-stem2\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130042\/better-stem2.png\" alt=\"\" width=\"307\" height=\"214\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: left\">2.<span style=\"color: #3d8dc2\"> <strong>the stem should not contain irrelevant material<\/strong>,<\/span> which can decrease the reliability and the validity of the test scores (haldyna and downing 1989).<\/p>\n<p style=\"text-align: center\"><img data-attachment-id=\"25184\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/irr-material\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27124503\/irr-material.png\" data-orig-size=\"587,496\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"irr-material\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27124503\/irr-material-300x253.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27124503\/irr-material.png\" loading=\"lazy\" class=\"wp-image-25184 aligncenter\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27124503\/irr-material.png\" alt=\"irr-material\" width=\"303\" height=\"266\" \/><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: left\">3. <span style=\"color: #3d8dc2\"><strong>the stem should be negatively stated only when significant learning outcomes require it.<\/strong> <\/span>students often have difficulty understanding items with negative phrasing (rodriguez 1997). if a significant learning outcome requires negative phrasing, such as identification of dangerous laboratory or clinical practices, the negative element should be emphasized with italics or capitalization.<\/p>\n<p style=\"text-align: left\"><img data-attachment-id=\"12545\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/neg-phrase1\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130040\/neg-phrase1.png\" data-orig-size=\"773,463\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"neg-phrase1\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130040\/neg-phrase1-300x179.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130040\/neg-phrase1-650x389.png\" loading=\"lazy\" class=\"size-medium wp-image-12545 alignleft\" title=\"neg-phrase1\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130040\/neg-phrase1-300x179.png\" alt=\"\" width=\"300\" height=\"179\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130040\/neg-phrase1-300x179.png 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130040\/neg-phrase1-650x389.png 650w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130040\/neg-phrase1.png 773w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p style=\"text-align: left\"><img data-attachment-id=\"12651\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/negative2\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/negative2.png\" data-orig-size=\"575,344\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"negative2\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/negative2-300x179.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/negative2.png\" loading=\"lazy\" class=\"wp-image-12651 size-medium alignright\" title=\"negative2\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/negative2-300x179.png\" alt=\"\" width=\"300\" height=\"179\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/negative2-300x179.png 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/negative2.png 575w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: left\"><img data-attachment-id=\"12652\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/better-neg-phrase\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/better-neg-phrase.png\" data-orig-size=\"572,410\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"better-neg-phrase\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/better-neg-phrase-300x215.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/better-neg-phrase.png\" loading=\"lazy\" class=\"aligncenter wp-image-12652 size-medium\" title=\"better-neg-phrase\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/better-neg-phrase-300x215.png\" alt=\"\" width=\"300\" height=\"215\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/better-neg-phrase-300x215.png 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/better-neg-phrase-72x53.png 72w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/better-neg-phrase.png 572w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: left\">4. <span style=\"color: #3d8dc2\"><strong>the stem should be a question or a partial sentence.<\/strong><\/span> a question stem is preferable because it allows the student to focus on answering the question rather than holding the partial sentence in working memory and sequentially completing it with each alternative (statman 1988). the cognitive load is increased when the stem is constructed with an initial or interior blank, so this construction should be avoided.<\/p>\n<p><img data-attachment-id=\"12549\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/blanks1\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130032\/blanks1.png\" data-orig-size=\"769,464\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"blanks1\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130032\/blanks1-300x181.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130032\/blanks1-650x392.png\" loading=\"lazy\" class=\"alignleft wp-image-12549 size-medium\" title=\"blanks1\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130032\/blanks1-300x181.png\" alt=\"\" width=\"300\" height=\"181\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130032\/blanks1-300x181.png 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130032\/blanks1-650x392.png 650w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130032\/blanks1.png 769w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><img data-attachment-id=\"12656\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/blanks3\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/blanks3.jpg\" data-orig-size=\"775,466\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"blanks3\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/blanks3-300x180.jpg\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/blanks3-650x390.jpg\" loading=\"lazy\" class=\"wp-image-12656 size-medium alignright\" title=\"blanks3\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/blanks3-300x180.jpg\" alt=\"\" width=\"300\" height=\"180\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/blanks3-300x180.jpg 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/blanks3-650x390.jpg 650w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130018\/blanks3.jpg 775w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<h2><a name=\"alternative\"><\/a>constructing effective alternatives<\/h2>\n<p><span style=\"color: #3d8dc2\"><span style=\"color: #000000\">1. <\/span><strong>all alternatives should be plausible.<\/strong><\/span> the function of the incorrect alternatives is to serve as distractors,which should be selected by students who did not achieve the learning outcome but ignored by students who did achieve the learning outcome. alternatives that are implausible don\u2019t serve as functional distractors and thus should not be used. common student errors provide the best source of distractors.<\/p>\n<p><img data-attachment-id=\"12555\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/implausable\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130031\/implausable.png\" data-orig-size=\"777,530\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"implausable\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130031\/implausable-300x204.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130031\/implausable-650x443.png\" loading=\"lazy\" class=\"aligncenter wp-image-12555 size-medium\" title=\"implausable\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130031\/implausable-300x204.png\" alt=\"\" width=\"300\" height=\"204\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130031\/implausable-300x204.png 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130031\/implausable-650x443.png 650w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130031\/implausable.png 777w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>2. <span style=\"color: #3d8dc2\"><strong>alternatives should be stated clearly and concisely. <\/strong><\/span>items that are excessively wordy assess students\u2019 reading ability rather than their attainment of the learning objective<\/p>\n<p><img data-attachment-id=\"12564\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/wordy\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130030\/wordy.png\" data-orig-size=\"1086,724\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"wordy\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130030\/wordy-300x200.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130030\/wordy-650x433.png\" loading=\"lazy\" class=\"aligncenter wp-image-12564 size-medium\" title=\"wordy\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130030\/wordy-300x200.png\" alt=\"\" width=\"300\" height=\"200\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130030\/wordy-300x200.png 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130030\/wordy-650x433.png 650w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130030\/wordy.png 1086w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>3. <span style=\"color: #3d8dc2\"><strong>alternatives should be mutually exclusive.<\/strong><\/span> alternatives with overlapping content may be considered \u201ctrick\u201d items by test-takers, excessive use of which can erode trust and respect for the testing process.<\/p>\n<p><img data-attachment-id=\"12664\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/overlap\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130016\/overlap.png\" data-orig-size=\"669,469\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"overlap\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130016\/overlap-300x210.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130016\/overlap-650x455.png\" loading=\"lazy\" class=\"aligncenter wp-image-12664 size-medium\" title=\"overlap\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130016\/overlap-300x210.png\" alt=\"\" width=\"300\" height=\"210\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130016\/overlap-300x210.png 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130016\/overlap-650x455.png 650w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130016\/overlap.png 669w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>4. <span style=\"color: #3d8dc2\"><strong>alternatives should be homogenous in content.<\/strong> <\/span>alternatives that are heterogeneous in content can provide cues to student about the correct answer.<\/p>\n<p><img data-attachment-id=\"12659\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/hetero\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130017\/hetero.png\" data-orig-size=\"669,469\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"hetero\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130017\/hetero-300x210.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130017\/hetero-650x455.png\" loading=\"lazy\" class=\"aligncenter wp-image-12659 size-medium\" title=\"hetero\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130017\/hetero-300x210.png\" alt=\"\" width=\"300\" height=\"210\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130017\/hetero-300x210.png 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130017\/hetero-650x455.png 650w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130017\/hetero.png 669w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>5. <span style=\"color: #3d8dc2\"><strong>alternatives should be free from clues about which response is correct.<\/strong><\/span> sophisticated test-takers are alert to inadvertent clues to the correct answer, such differences in grammar, length, formatting, and language choice in the alternatives. it\u2019s therefore important that alternatives<\/p>\n<ul>\n<li>have grammar consistent with the stem.<\/li>\n<li>are parallel in form.<\/li>\n<li>are similar in length.<\/li>\n<li>use similar language (e.g., all unlike textbook language <em>or <\/em>all like textbook language).<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p>6. <span style=\"color: #3d8dc2\"><strong>the alternatives \u201call of the above\u201d and \u201cnone of the above\u201d should not be used.<\/strong> <\/span>when \u201call of the above\u201d is used as an answer, test-takers who can identify more than one alternative as correct can select the correct answer even if unsure about other alternative(s). when \u201cnone of the above\u201d is used as an alternative, test-takers who can eliminate a single option can thereby eliminate a second option. in either case, students can use partial knowledge to arrive at a correct answer.<\/p>\n<p>&nbsp;<\/p>\n<p>7. <span style=\"color: #3d8dc2\"><strong>the alternatives should be presented in a logical order<\/strong><\/span> (e.g., alphabetical or numerical) to avoid a bias toward certain positions.<\/p>\n<p><img data-attachment-id=\"29792\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/logic2-300x180\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2012\/12\/25092520\/logic2-300x180.jpg\" data-orig-size=\"300,180\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;1&quot;}\" data-image-title=\"logic2-300&#215;180\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2012\/12\/25092520\/logic2-300x180-300x180.jpg\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2012\/12\/25092520\/logic2-300x180.jpg\" loading=\"lazy\" class=\"wp-image-29792 size-full alignleft\" title=\"logic\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2012\/12\/25092520\/logic2-300x180.jpg\" alt=\"\" width=\"300\" height=\"180\" \/><img data-attachment-id=\"12583\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/alpha\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/alpha.png\" data-orig-size=\"771,465\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"alpha\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/alpha-300x180.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/alpha-650x392.png\" loading=\"lazy\" class=\"size-medium wp-image-12583 alignright\" title=\"alpha\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/alpha-300x180.png\" alt=\"\" width=\"300\" height=\"180\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/alpha-300x180.png 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/alpha-650x392.png 650w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/alpha.png 771w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>8.<strong> <span style=\"color: #3d8dc2\">the number of alternatives can vary among items as long as all alternatives are plausible. <\/span><\/strong>plausible alternatives serve as functional distractors, which are those chosen by students that have not achieved the objective but ignored by students that have achieved the objective. there is little difference in difficulty, discrimination, and test score reliability among items containing two, three, and four distractors.<\/p>\n<p>&nbsp;<\/p>\n<h2><a name=\"guidelines\"><\/a>additional guidelines<\/h2>\n<p>1. <strong><span style=\"color: #3d8dc2\">avoid complex multiple choice items<\/span><\/strong>, in which some or all of the alternatives consist of different combinations of options. as with \u201call of the above\u201d answers, a sophisticated test-taker can use partial knowledge to achieve a correct answer.<\/p>\n<p><img data-attachment-id=\"12585\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/complex\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/complex.png\" data-orig-size=\"771,463\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"complex\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/complex-300x180.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/complex-650x390.png\" loading=\"lazy\" class=\"size-medium wp-image-12585 aligncenter\" title=\"complex\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/complex-300x180.png\" alt=\"\" width=\"300\" height=\"180\" srcset=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/complex-300x180.png 300w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/complex-650x390.png 650w, https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130027\/complex.png 771w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>2. <strong><span style=\"color: #3d8dc2\">keep the specific content of items independent of one another.<\/span><\/strong> savvy test-takers can use information in one question to answer another question, reducing the validity of the test.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<h2><a name=\"higher\"><\/a>considerations for writing multiple choice items that test higher-order thinking<\/h2>\n<p>when writing multiple choice items to test higher-order thinking, design questions that focus on higher levels of cognition as defined by <a href=\"\/\/www.imrbdigital.com\/guides-sub-pages\/blooms-taxonomy\/\" target=\"_blank\" rel=\"noopener noreferrer\">bloom\u2019s taxonomy<\/a>. a stem that presents a problem that requires application of course principles, analysis of a problem, or evaluation of alternatives is focused on higher-order thinking and thus tests students\u2019 ability to do such thinking. in constructing multiple choice items to test higher order thinking, it can also be helpful to design problems that require multilogical thinking, where multilogical thinking is defined as \u201cthinking that requires knowledge of more than one fact to logically and systematically apply concepts to a \u2026problem\u201d (morrison and free, 2001, page 20). finally, designing alternatives that require a high level of discrimination can also contribute to multiple choice items that test higher-order thinking.<\/p>\n<p><img data-attachment-id=\"12589\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/higher-order\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130026\/higher-order.png\" data-orig-size=\"896,796\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"higher-order\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130026\/higher-order-300x266.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130026\/higher-order-650x577.png\" loading=\"lazy\" class=\"size-large wp-image-12589 aligncenter\" title=\"higher-order\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130026\/higher-order-650x577.png\" alt=\"\" width=\"452\" height=\"412\" \/><img data-attachment-id=\"12590\" data-permalink=\"\/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/higher-order2\/\" data-orig-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130019\/higher-order2.png\" data-orig-size=\"872,571\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;}\" data-image-title=\"higher-order2\" data-image-description=\"\" data-image-caption=\"\" data-medium-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130019\/higher-order2-300x196.png\" data-large-file=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130019\/higher-order2-650x425.png\" loading=\"lazy\" class=\"size-large wp-image-12590 aligncenter\" title=\"higher-order2\" src=\"https:\/\/cdn.vanderbilt.edu\/vu-wp0\/wp-content\/uploads\/sites\/59\/2019\/03\/27130019\/higher-order2-650x425.png\" alt=\"\" width=\"455\" height=\"327\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<h2><a name=\"resources\"><\/a>additional resources<\/h2>\n<ul>\n<li>burton, steven j., sudweeks, richard r., merrill, paul f., and wood, bud. how to prepare better multiple choice test items: guidelines for university faculty, 1991.<\/li>\n<li>cheung, derek and bucat, robert. how can we construct good multiple-choice items? presented at the science and technology education conference, hong kong, june 20-21, 2002.<\/li>\n<li>haladyna, thomas m. developing and validating multiple-choice test items, 2<sup>nd<\/sup> edition. lawrence erlbaum associates, 1999.<\/li>\n<li>haladyna, thomas m. and downing, s. m.. validity of a taxonomy of multiple-choice item-writing rules. <em>applied measurement in education<\/em>, 2(1), 51-78, 1989.<\/li>\n<li>morrison, susan and free, kathleen. writing multiple-choice test items that promote and measure critical thinking. <em>journal of nursing education <\/em>40: 17-24, 2001.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<hr \/>\n<p><a href=\"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/\" rel=\"license\"><img class=\"aligncenter\" src=\"https:\/\/i.creativecommons.org\/l\/by-nc\/4.0\/80x15.png\" alt=\"creative commons license\" \/><\/a><br \/>\nthis teaching guide is licensed under a <a href=\"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/\" rel=\"license\">creative commons attribution-noncommercial 4.0 international license<\/a>.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>by cynthia j. brame print version cite this guide: brame, c. (2013) writing good multiple choice test questions. retrieved [todaysdate] from \/\/www.imrbdigital.com\/guides-sub-pages\/writing-good-multiple-choice-test-questions\/. constructing an effective stem constructing effective alternatives additional guidelines for multiple choice questions considerations for writing multiple choice items that test higher-order thinking additional resources multiple choice test questions, also known as items,&#8230;<\/p>\n","protected":false},"author":452,"featured_media":0,"parent":18232,"menu_order":10,"comment_status":"open","ping_status":"open","template":"","meta":{"spay_email":"","_links_to":"","_links_to_target":""},"tags":[],"acf":[],"_links":{"self":[{"href":"\/\/www.imrbdigital.com\/wp-json\/wp\/v2\/pages\/12274"}],"collection":[{"href":"\/\/www.imrbdigital.com\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"\/\/www.imrbdigital.com\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"\/\/www.imrbdigital.com\/wp-json\/wp\/v2\/users\/452"}],"replies":[{"embeddable":true,"href":"\/\/www.imrbdigital.com\/wp-json\/wp\/v2\/comments?post=12274"}],"version-history":[{"count":24,"href":"\/\/www.imrbdigital.com\/wp-json\/wp\/v2\/pages\/12274\/revisions"}],"predecessor-version":[{"id":37903,"href":"\/\/www.imrbdigital.com\/wp-json\/wp\/v2\/pages\/12274\/revisions\/37903"}],"up":[{"embeddable":true,"href":"\/\/www.imrbdigital.com\/wp-json\/wp\/v2\/pages\/18232"}],"wp:attachment":[{"href":"\/\/www.imrbdigital.com\/wp-json\/wp\/v2\/media?parent=12274"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"\/\/www.imrbdigital.com\/wp-json\/wp\/v2\/tags?post=12274"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}