Item Writing


 

The Item-Writing Course series was developed by NBCRNA to offer a foundation for potential item writers. All courses are eligible for Class A credit, are free and are offered online. To register for any of the courses, email learning@nbcrna.com. Find out more in the FAQs.


NEW! Course 3: Item-Writing Theory and Practice: Writing Clinical Scenario Item Series

This course builds on the material in the Foundational and Alternative Question Format courses (prerequisites) to offer guidelines and techniques for creating clinical scenario question sets. Instructors explore potential pitfalls of this question type such as inappropriate Webinar_Cover1.pnglevel of complexity, non-relatedness of questions and scenarios, and inter-item dependence and cuing, and provide techniques to avoid them.The course outlines key-feature-problem writing technique and its potential application to computer-based testing, and provides a wealth of item examples.



 

Course 1: Item-Writing Theory and Practice: Foundation
2.75 Class A credits

This course covers fundamental concepts of test development, including professional practice analysis, standard setting, and the life cycle of an item. It serves as a prerequisite to the second course/course 2.


Course 2: Item-Writing Theory and Practice: Alternative Question Formats
1.0 Class A credit

This course offers insight into the advantages and disadvantages of multiple choice questions. It provides examples and best practices for authoring alternative question formats such as multiple choice response, short answer, drag-and-drop, and hotspots.


IW_Email_Register.png 


Online Item-Writing Courses FAQ

The answers to the questions below provide key details regarding the online item-writing courses. If you don't see the information you need, please contact
learning@nbcrna.com.

How many item-writing courses are there?

There are three courses: Item-Writing Theory and Practice: Foundation, Item-Writing Theory and Practice: Alternative Question Formats, and Item-Writing Theory and Practice: Writing Clinical Scenario Item Series.​

 

What are the courses about?

(See above for the description of the latest item-writing course.)

Item-Writing Theory and Practice: Foundation covers fundamental concepts of test development, including professional practice analysis, standard setting, and the life cycle of an item. It lays out best practices for authoring psychometrically sound multiple-choice question stems and options, and techniques for maximizing coverage of higher-order thinking. The course uses video, readings, and an interactive tutorial.

Item-Writing Theory and Practice: Alternative Question Formats picks up from the Foundation course to offer insight into advantages and disadvantages of multiple-choice questions. It provides examples and best practices for authoring alternative question formats such as multiple choice response, short answer, drag-and-drop, and hotspots.


Item-Writing Theory and Practice: Foundation is a prerequisite for Item-Writing Theory and Practice: Alternative Question Formats. If you pass the Foundation course, you will be automatically registered for Alternative Question Formats. The Foundation course is also a prerequisite for the Writing Clinical Scenario Item Series course.

 

What is there to know about question writing? It seems simple.

Although almost everyone has taken standardized exams, most are unaware of the extent of the knowledge and effort involved in creating and maintaining useful, defensible exams. In terms of certification exams, there are procedures beyond just the correct writing and review of items that maximize the validity of an exam for determining whether professionals meet an acceptable level of competence. These courses cover item-writing best practices in some depth and also give an overview of certification test development procedures.

 

What kinds of materials are included in the courses?

The courses include video lecture with accompanying slides, reading material from the Institute for Credentialing Excellence Handbook on credentialing exams, published articles on testing, item-writing development guidelines, an alternative item tutorial, and alternative item samples.

Who developed these courses?

​The courses were developed by the NBCRNA.

How long do the courses take?

The Foundation course includes video material that is approximately 3 hours in length.

In addition to video, the accompanying reading material could take several hours to read in depth, although only the video lecture material is directly tested. The posttest is 30 questions and could be completed in under an hour. The program evaluation takes 10 minutes to complete.


The Alternative Question Formats course video is 1 hour. In addition to video, the accompanying reading material could take several hours to read in depth, although only the video lecture material is directly tested. The posttest is 10 questions and could be completed in under 30 minutes. The program evaluation takes 10 minutes to complete.

The Writing Clinical Scenario Item Series course video totals 90 minutes. Accompanying reading material could take about 2 hours to review, but only video lecture material is tested. The posttest is 15 questions and could be completed in about 45 minutes. The evaluation takes 10 minutes to complete.

How much time will I have to complete the courses once I register?

You can work through the courses at whatever pace suits you. Class A CE credit for the courses is available until June 2018. CE credit for the Writing Clinical Scenario Item Series course is available until June 2019.​

 

Do the courses include questions from NBCRNA exams?

To maintain the integrity of NBCRNA exams, we cannot include any live test materials in the course. However, the types of items in the examples are representative of items on NBCRNA exams, and most do concern nurse anesthesia.

 

Do I have to take the courses at a specific time?

​The courses can be completed any time of day or night, any day of the week.

 

Do I have to take the courses in a specific order?

​Yes. The Foundation course is a prerequisite for the Alternative Question Formats course and Writing Clinical Scenario Item Series.

Within each course, there is also an order of required course elements that participants have to follow. Videos have to be watched in order, and all requirements have to be completed before taking the posttests. But participants can go back to already completed elements as needed.

How much Class A CE credit can I get?

The Foundation course is prior-approved by the AANA for 2.75 Class A CE credits. The Alternative Question Formats course is prior-approved for 1 credit.​

 

What are the course objectives?

 ​Foundations:

  • Identify some important statistical terms in testing.
  • Detail the process that results in an exam content outline.​
  • Outline the steps in the life cycle of an item.
  • Summarize 2 methods for standard setting.
  • Explain the test theory behind item-writing best practices.
  • Name the key elements of a multiple-choice question.
  • Identify common psychometric flaws in multiple-choice item stems.
  • Select appropriate methods of revision for sample flawed item options.
  • Apply important terms used to describe common item flaws.
  • Distinguish different levels of skill and knowledge tested by multiple-choice items.
  • Construct items to reach higher levels of Bloom's taxonomy.


Alternative Question Formats:

  • Identify advantages and disadvantages of multiple-choice questions.
  • Distinguish more effective revision choices from less effective ones.
  • Contrast alternative question formats with multiple-choice items.
  • Appropriately convert multiple-choice items into alternative question formats.

Writing Clinical Scenario Item Series:

  • ​Write clinical case scenario items that integrate different types of knowledge into a real-life application context.
  • Target questions to assess discrete clinical decision points within a series of questions based on a single scenario.
  • Distinguish questions that are related to an initial clinical case from those that are fact-oriented, do not require a case, or extend beyond the case.
  • Identify some of the challenges of writing case-based scenario question sets and how to address them.

Who can take the courses?

​The courses are aimed at nurse anesthesia program administrators and faculty, but anyone can register for them. However, only nurse anesthetists can receive Class A CE credit approved by the AANA.

 

How do I register?

Contact learning@nbcrna.com to request a set of instructions to create an account in our online learning management system. This will automatically register you for the foundation course.

 

How do I get my Class A CE credit?

When you pass the posttest for a course and complete the online course evaluation, you will be able to print out a certificate. NBCRNA will report completed Class A CE credits to the AANA at the end of the month. It will not be possible to obtain immediate credit for completing the courses.

 

Is there a posttest?

Per AANA requirements for this type of Class A CE program, there is a posttest for each course that requires a passing score of 80%. There are no time limits on the posttests. There are no practice questions for them either, although checkpoint questions during the videos touch on some of the same content.

After you finish a test, you will immediately know whether you passed or failed. You will be able to see your entire test performance after you fill out the course evaluation.

If you do not pass the posttest, you will not receive Class A CE credit for the course, nor will you be able to retake the course or the test per AANA requirements. Reviewing course materials before the test is strongly encouraged.

 

How much do the courses cost?

​The courses are free.

 

What equipment do I need?

It is better to take the courses on a PC rather than a tablet or mobile phone, as some course elements may not present as well on a smaller screen. You will also need a good broadband connection, preferably at least 2.5 Mbps, to view the video elements. Chrome is the recommended browser; we have seen some issues reported using Firefox, so that browser is not recommended at this time. 

Other important parameters include:
CPU: 2 GHz
Memory: 2 GB RAM (32-bit) or 4 GB RAM (64-bit)
Operating System (at least): Windows 7, Mac OS X 10.7, iOS 6, Android 4
Screen Resolution: 1024 × 768
Browser Plugins: Flash Version 10.1

 

Whom do I contact about technical issues?

Please contact learning@nbcrna.com​.