According to Instructional Design Competencies: The Standards (2013), instructional designers should be able to (Koszalka, Russ-Eft, and Reiser 2013, 51): “Select or modify existing instructional materials (essential). This is an essential competency and it includes four performance statements, two are essential and two are advanced.” The performance standards for this competency include: “(a) Identify and select materials that support the content analyses, proposed technologies, delivery methods, and instructional strategies (essential); (b) Conduct cost-benefit analyses to decide whether to use or modify existing materials (advanced); (c) Validate selection or modification of existing instruction (advanced); (d) Integrate existing instructional materials into the design (essential)” (Koszalka, Russ-Eft, and Reiser 2013, 51).
This chapter provides additional information about this competency. It offers advice on how to identify and select materials, conduct cost-benefit analysis, and validate the selection or modification of existing instruction.
When instructional designers select, develop, or modify instructional materials, they:
These four general steps are followed whether selecting, modifying, or developing instruction. Chapter 12 will add to these steps, examining two subsequent steps that follow those listed above.
Before examining materials supplied by others, prepare a general working outline to achieve the objectives established for the learning experience. The objectives are the results to be achieved; the outline operationalizes those objectives, showing how they will be achieved. If materials are to be selected or modified from others, it is critically important to ensure that the outline covers what is unique to meet the organization's unique needs. The outline need not be detailed, but it does need to emphasize what is most important.
Adults can be uniquely tied to (some might say “fixated on”) their contexts. For instance, preparing a training program can be the task confronting instructional designers. Material drawn from a retail setting may have to modified heavily if it is to work in a manufacturing organization because learners will see only the contextual differences and not the conceptual similarities. Such an issue must be covered in the outline.
Simply consider questions such as these in formulating the outline:
Conducting research, the second step in selecting or modifying instructional materials, is carried out to identify materials available inside or outside an organization. The cost of developing tailor-made materials is usually formidable. Instructional designers should not waste precious time, staff, and money preparing these materials if they can be obtained from other sources inside or outside the organization.
Begin research for instructional materials inside an organization by identifying knowledgeable people such as experienced workers, supervisors, union officials, top managers, human resource managers, or trainers. Ask them if they know of any unit, department, or division that might have had a past need (perhaps for on-the-job training purposes) for instructional materials like those necessary to meet the performance objectives.
Describing the materials carefully, ask the knowledgeable people three questions:
Even when instructional materials are not available inside an organization, instructional designers may still transform existing work-related materials into instructional materials with minimal effort.
Begin research for materials outside the organization in a different way. First, network with instructional designers in other organizations. Find them by using social media or professional associations.
Contact colleagues through these organizations to determine whether they have previously had occasion to design or select similar instructional materials. Ask to see their materials. Remember, however, that some organizations consider their instructional materials proprietary or copyrighted, so comply with any organizational protocols. If it is not possible to examine materials, then at least ask how they were prepared, focusing on the processes used rather than the products developed. Most instructional designers will share that information, even if they cannot share actual work products. (The favor may have to be reciprocated someday.)
Searching print and computer-based references is another way to find existing instructional materials outside an organization. While few references will lead directly to instructional materials, many books or websites will be useful in sourcing them. Sometimes, instructional designers may even be lucky enough to find off-the-shelf instructional materials. Numerous references can be invaluable in conducting such searches. For instance, look for videos on the following websites or similar ones:
Numerous training materials can also be found for free, or for purchase, through searches on the web. (But note that copyright issues may sometimes be cloudy, so check with the website owner on fair use of all materials.)
Evaluating existing instructional materials is the third step in selecting or modifying instructional materials. When debating whether to use existing instructional materials, be sure they follow the instructional strategy and performance objectives established for the planned learning experience. (Do not expect to plug-and-play existing materials to meet specific performance objectives without making at least minor modifications, even though relying on reusable learning objects may be possible.) Sometimes it is helpful to compare existing materials to a list of criteria on an evaluation checklist prepared in advance. When using such a checklist, think about these questions: (1) Can the existing instructional materials be used as they are, with minimal revisions? (2) What revisions must be made? and (3) Are the performance objectives to be met by learners so unique as to prevent use of anything except tailor-made materials?
Arranging or modifying existing materials is the fourth step in selecting or modifying instructional materials. When existing instructional materials are appropriate to use, it may be necessary to secure copyright permissions and arrange or modify the materials in ways appropriate for satisfying the objectives.
To request permission to use the material, write directly to the copyright holder. State where the material will be used (in-house only?), how much will be used (the entire document or only part of it?), and how it will be used (in-house training only?). Will the material be adapted in any way? Also indicate how soon it will be used (is there an urgent need for a response?), how many copies are to be made (will all participants in training be given a copy?), who will receive the copies (who are the learners?), why the material is needed (training only? promotional use?), and how often future requests will be made (how many times will the material be used each year?). Be prepared to pay a (possibly hefty licensing) fee for the privilege of using the material.
Begin by making the most obvious changes. Revise titles and case study settings so they match up to the organization and learners. (Be sure that changes to be made to copyrighted material are noted in the permission request.) Then make major changes, if they must be made. It is often helpful to record each change on a point sheet. The point sheet, a lined document resembling a page of footnotes, is based on a syllabus and becomes a guiding document to help a team of instructional designers tackle revision. Finally, arrange the materials so their format matches up to any special requirements favored by the organization in which they will be used. It can be useful doing this in front of a computer with two screens rather than one only.
Cost-benefit analysis is not one thing; rather, it is many (Phillips 2011). There are many ways to conduct it.
The basic principle of cost-benefit analysis is simple enough. Compare the costs of something to the benefits of using it. If the benefits outweigh the costs, then it is worth doing; if the costs outweigh the benefits, then it is not worth doing. This approach is sometimes associated with so-called return on investments (ROI) to determine whether training is worth delivering. If the benefits (that is, the financial value of solving a problem) outweigh the costs of training (computed by totaling all costs associated with analyzing the issue, designing and developing instruction, implementing the instruction, and evaluating it), then training is worth doing. ROI may be forecasted before training is designed or after it has been conducted.
The same principle may apply to deciding whether to “make” instruction (that is, design it) or “buy” instruction (that is, purchase from an external vendor such as an online provider, a consulting firm, a community college or university, or some other group). Much instructional material is readily available—some of it on the web—but rarely is so-called “off-the-shelf” instructional material so well prepared that it can meet all instructional needs for all audiences. The real question is this: will the benefits of buying and modifying instruction from an external source outweigh the costs associated with tailoring them to meet the unique needs for a targeted group?
Several challenges exist when conducting cost-benefit analysis. The first is that it is much easier to pinpoint financial costs than it is to pinpoint benefits. Much has been published on determining costs, which can be relatively easy for a cost accountant. But less has been published on determining benefits—some of which may be nonfinancial (such as improved customer service, improved operational efficiency, or increased worker engagement).
The second issue is that financial issues alone may not be sufficient to make decisions. Are there sufficient instructional designers available to meet the organization's demands? If not, high-priced instructional materials may be worthwhile even if they fail a financial cost-benefit test because trained staff are unavailable to meet stakeholder demands. Pleasing the internal customer may outweigh financial decisions.
Instructional designers often believe that instruction is not finished until the targeted learners can learn from the material. Concerned with helping formulate instruction, this step in the instructional design process calls for formative evaluation. Usually distinguished from summative evaluation, which helps summarize results of instruction, formative evaluation is conducted before instructional materials are delivered to a majority of the targeted learners. Summative evaluation is conducted after instructional materials have been used with targeted trainees and results have been measured. Evaluation in all its forms has figured prominently in recent treatments of instruction as decision-makers demand increasing accountability. A later chapter will examine formative evaluation in more detail.