With data in hand, what's next? Should the data be used to modify the project, change the process, show the contribution, justify new projects, gain additional support, or build goodwill? How should the data be presented? The worst course of action is to do nothing. Communicating results is as important as achieving results. Achieving results without communicating them is like planting seeds and failing to fertilize and cultivate the seedlings—the yield simply won't be as great. This chapter provides useful information to help present evaluation data to the various audiences using a variety of reporting methods.
Communicating results is a critical issue in consulting. While it is important to communicate achieved results to interested stakeholders when the project is complete, it is also important to communicate throughout the consulting project. Routine communication ensures that information is flowing so that adjustments can be made and so that all stakeholders are aware of the success and issues surrounding the consulting project.
The contribution of the consulting project involves the six major types of outcome measures, a confusing issue at best. The varied target audiences will need a thorough explanation of the results. A communication strategy including techniques, media, and the overall process will determine the extent to which they understand the contribution. Communicating results, particularly with business impact and ROI, can quickly become confusing for even the most sophisticated target audiences. Communication must be planned and implemented with the goal of making sure the audiences understand the full contribution.
Because information is collected at different points during the process, the communication or feedback to the various groups that will take action is the only way adjustments can be made. Thus, the quality and timeliness of communication become critical issues for making necessary adjustments or improvements. Even after the project is completed, communication is necessary to ensure the target audience fully understands the results achieved and how the results could be enhanced in either future projects or in the current project, if it is still operational. Communication is the key to making these important adjustments at all phases of the project.
Communication is one of those important issues that can cause major problems. Because the results of an intervention can be closely linked to the political issues in an organization, communication can upset some individuals while pleasing others. If certain individuals do not receive the information, or it is delivered inconsistently from one group to another, problems can quickly surface. Not only is it an understanding issue, it is also a fairness, quality, and political correctness issue to make sure communication is properly constructed and effectively delivered to all key individuals who need the information.
Because there are so many potential target audiences for receiving communication on the success of a consulting project, it is important for the communication to be tailored directly to their needs. A varied audience will command varied needs. Planning and effort are necessary to make sure the audience receives all of the information it needs, in the proper format, and at the proper time. A single report for all audiences may not be appropriate. The scope, size, media, and even the actual information of different types and different levels will vary significantly from one group to another, making the target audience the key to determining the appropriate communication process.
Usually, consulting results should be communicated as soon as they are known. From a practical standpoint, it may be best to delay the communication until a convenient time, such as the publication of the next client newsletter or the next general management meeting. Questions about timing must be answered. Is the audience ready for the results in light of other things that may have happened? Is it expecting results? When is the best time for having the maximum effect on the audience? Are there circumstances that dictate a change in the timing of the communication? The timing and content of the communication should be consistent with past practices. A special communication at an unusual time during the consulting intervention may provoke suspicion. Also, if a particular group, such as top management, regularly receives communication on consulting outcomes, it should continue receiving communication—even if the results are not positive. If some results are omitted, it might leave the impression that only positive results are reported.
It is important to separate fact from fiction and accurate statements from opinions. Various audiences may accept communication from consultants with skepticism, anticipating biased opinions. Boastful statements sometimes turn off recipients, and most of the content is lost. Observable, believable facts carry far more weight than extreme or sensational claims. Although such claims may get audience attention, they often detract from the importance of the results.
Collectively, these reasons make communication a critical issue, although it is often overlooked or underestimated in consulting interventions. This chapter builds on this important issue and shows a variety of techniques for accomplishing all types of communication for various target audiences.
Because there may be many reasons for communicating results, the rationale should be tailored to the organization on the specific project, the setting, and the unique needs. The results communicate are in three broad categories: projected results, early feedback, and complete results. Here are the eleven most common reasons.
If the reasons for communicating results are plentiful because there may be other reasons for communicating results, the list should be tailored to the project and situation.
Any successful activity must be carefully planned for it to produce the maximum results. This is certainly true when communicating the results of consulting projects. Planning is necessary to ensure that each audience receives the proper information at the right time and that appropriate actions are taken. Several issues are important in planning the communication of results.
Client and consulting team policy issues will influence the content medium, duration, and timing of communication. Some policies may exist; others may need to be developed. Internally, the client may have policies for communicating results as part of an overall policy on consulting projects. The consulting team may have a policy as part of the results-based approach to consulting. Seven different areas will need some attention as the policies are developed or followed.
Collectively, these seven issues will frame the policy for communication as a whole. If a policy does not exist, perhaps it should be created.
When a project is approved, the communication plan is usually developed. This details how specific information is developed and communicated to various groups and the expected actions. In addition, this plan details how the overall results will be communicated, the time frames for communication, and the appropriate groups to receive information. The client and consultant need to agree on the extent of detail in the plan. Additional information on this type of planning is provided later.
The third type of plan is aimed at presenting the results of an impact study. This occurs when a major consulting project is completed, and the detailed and compete results are known. One of the major decisions is to determine who should receive the results and in what form. This is more specialized than the plan for the entire project because it involves the final study from the project. Table 15.1 shows the communication plan for a consulting project for stress reduction. Teams were experiencing high levels of stress and, through a variety of activities and job changes, stress began to diminish among the teams. The same process was made available to other teams who were experiencing similar symptoms.
Table 15.1 Consulting Project Communication Plan
Communication Document | Communication Target(s) | Distribution Method |
Complete report with appendices (75 pages) |
|
Distribute and discuss in a special meeting |
Executive Summary (8 pages) |
|
Distribute and discuss in routine meeting |
General interest overview and summary without the actual ROI calculation (10 pages) |
|
Mail with letter |
General interest article (1 page) |
|
Publish in company publication |
Brochure highlighting project, objectives, and specific results |
|
Include with other marketing materials |
Five different communication pieces were developed for different audiences. The complete report was an ROI impact study, a 75-page report that served as the historical document for the project, distributed after a live meeting with the ultimate client. It went to the client, the consulting team, and the managers of each of the teams involved in the studies. An executive summary, a much smaller document, went to some of the higher-level executives. A general interest overview and summary without the ROI calculation went to the participants. A general-interest article was developed for company publications, and a brochure was developed to show the success of the consulting project. That brochure was used in marketing the same process internally to other teams and served as additional marketing material for the consulting team. This detailed plan may be part of the overall plan for the consulting assignment but may be fine-tuned during the actual consulting process.
The potential target audiences to receive information on consulting results are varied in terms of job levels and responsibilities. Determining which groups will receive a particular communication piece deserves careful thought, as problems can arise when a particular group receives inappropriate information or when another is omitted altogether.
When approaching a particular audience, the following questions should be asked about each potential group:
For each target audience, three actions are needed. First, the consultants should get to know and understand the target audience. Next, the consultants should find out what information is needed and why. Each group will have its own needs relative to the information desired. Some will want detailed information while others want brief information. Rely on the input from others to determine audience needs. Finally, the consultants should try to understand audience bias. Each will have a particular bias or opinion. Some will quickly support the results, whereas others may be against them or be neutral. The staff should be empathetic and try to understand differing views. With this understanding, communications can be tailored to each group. This is especially critical when the potential exists for the audience to react negatively to the results.
A sound basis for proper audience selection is to analyze the reason for communication, as discussed in an earlier section. Table 15.2 shows common target audiences and the basis for selecting the audience.
Table 15.2 Common Target Audiences
Reason for Communication | Primary Target Audiences |
To Secure Approval for the Project | Client, Top Executives |
To Gain Support for the Project | Immediate Managers, Team Leaders |
To Secure Agreement with the Issues | Participants, Team Leaders |
To Build Credibility for the Consulting Team | Top Executives |
To Enhance Reinforcement of the Processes | Immediate Managers |
To Drive Action for Improvement | Consultants |
To Prepare Participants for the Project | Team Leaders |
To Enhance Results and Quality of Future Feedback | Participants |
To Show the Complete Results of the Project | Client Team |
To Underscore the Importance of Measuring Results | Client, Consultants |
To Explain Techniques Used to Measure Results | Client, Support Staff |
To Create Desire for a Participant to Be Involved | Team Leaders |
To Stimulate Interest in the Consulting Firm's Products | Top Executives |
To Demonstrate Accountability for Client Expenditures | All Employees |
To Market Future Consulting Projects | Prospective Clients |
Perhaps the most important audience is the client or client team. This group (or individual) initiates the project, reviews data, selects the consultant, and weighs the final assessment of the effectiveness of the project. Another important target audience is the top management group. This group is responsible for allocating resources to the consulting intervention and needs information to help justify expenditures and gauge the effectiveness of the efforts.
Selected groups of managers (or all managers) are also important target audiences. The support and involvement of management in the consulting process and the department's credibility are important to success. Effectively communicating project results to management can increase both support and credibility.
Communicating with the participants' team leaders or immediate managers is essential. In many cases, they must encourage participants to implement the project. Also, they often support and reinforce the objectives of the project. An appropriate return on investment improves the commitment to consulting and provides credibility for consultants.
Consulting participants need feedback on the overall success of the effort. Some individuals may not have been as successful as others in achieving the desired results. Communicating the results adds additional pressure to effectively implement the project and improve results for the future. For those achieving excellent results, the communication will serve as a reinforcement of the consulting. Communicating results to project participants is often overlooked, with the assumption that since the project is over, they do not need to be informed of its success.
Occasionally, results are communicated to encourage participation in the project. This is especially true for those projects where the participants are involved on a volunteer basis. The potential participants are important targets for communicating results.
The consulting team must receive information about project results. Whether for small projects where consultants receive a project update, or for larger projects where a complete team is involved, those who design, develop, facilitate, and implement the project must be given information on the project's effectiveness. Evaluation information is necessary, so adjustments can be made if the project is not as effective as it could be.
The support staff should receive detailed information about the process to measure results. This group provides support services to the consulting team, usually in the department where the project is conducted.
Company employees and stockholders may be less likely targets. General-interest news stories may increase employee respect. On the one hand, Goodwill and positive attitudes toward the organization may also be byproducts of communicating project results. Stockholders, on the other hand, are more interested in the return on their investment.
While Table 15.2 shows the most common target audiences, there can be others in a particular organization. For instance, management or employees could be subdivided into different departments, divisions, or even subsidiaries of the organization. The number of audiences can be large in a complex organization. At a minimum, four target audiences are always recommended: a senior management group, the consulting participants, the consulting participants' immediate manager or team leader, and the consulting team.
The type of formal evaluation report depends on the extent of detailed information presented to the various target audiences. Brief summaries of project results with appropriate charts may be sufficient for some communication efforts. In other situations, particularly with significant consulting projects requiring extensive funding, the amount of detail in the evaluation report is more crucial. A complete and comprehensive impact study report may be necessary. This report can then be used as the basis of information for specific audiences and various media. The report may contain the following sections.
The management summary is a brief overview of the entire report, explaining the basis for the evaluation and the significant conclusions and recommendations. It is designed for individuals who are too busy to read a detailed report. It is usually written last but appears first in the report for easy access.
The background information provides a general description of the project. If applicable, the needs assessment that led to the need for the project is summarized. The project is fully described, including the events that led to the consulting project. Other specific items necessary to provide a full description of the project are included. The extent of detailed information depends on the amount of information the audience needs.
The objectives for the project are outlined so that the reader clearly understands desired accomplishments for the project. These are the objectives from which the different types or levels of data were collected.
The evaluation strategy outlines all of the components that make up the total evaluation process. Several components of the results-based approach and the ROI methodology presented in this book are discussed in this section of the report. The specific purposes of evaluation are outlined, and the evaluation design and methodology are explained. The instruments used in data collection are also described and presented as exhibits. Any unusual issues in the evaluation design are discussed. Finally, other useful information related to the design, timing, and execution of the evaluation is included.
This section explains the methods used to collect data as outlined in earlier chapters of this book. The data collected are usually presented in the report in summary form. A section, showing how the data are integrated along different levels, is usually presented. The methods of data analysis are briefly described.
This section details the data collected from key stakeholders, particularly the participants involved in the process, to measure the reaction to the consulting project and a level of satisfaction with various issues and parts of the process. Other input from the client group is also included to show the level of satisfaction.
This section shows a brief summary of the formal and informal measures of learning. It explains what participants have learned in the terms of new processes, skills, tasks, procedures, and practices needed to make the consulting project successful.
This section shows the success with the application of new skills and knowledge. Implementation success is addressed, including progress and/or lack of progress.
This section shows the business impact measures representing the business needs that initially drove the project. This shows the extent to which business performance has changed during the implementation of the consulting project.
Project costs are presented in this section. A summary of the costs by category is included. For example, analysis, development, implementation, and evaluation costs are recommended categories for cost presentation. The assumptions made in developing and classifying costs are discussed in this section of the report.
This section shows the ROI calculation along with the benefits/cost ratio. It compares the value to what was acceptable (objective) and provides an interpretation of the calculation.
This section shows the various intangible measures directly linked to the consulting project. Intangibles are those measures not converted to monetary values and not included in the ROI calculation.
The various problems and obstacles affecting the success of the project are detailed and presented as barriers to implementation. Also, those factors or influences that had a positive effect on the project are included as enablers. Together, they provide insight into what can inhibit or enhance projects in the future.
This section presents conclusions based on all of the results. If appropriate, brief explanations are presented on how each conclusion was reached. A list of recommendations or changes in the project, if appropriate, is provided with brief explanations for each recommendation. It is important that the conclusions and recommendations are consistent with one another and with the findings described in the previous section.
Collectively, these components make up the major parts of a complete evaluation report, an all-important document that reflects the complete project for those individuals who need much detail. Also, it's an excellent document for knowledge sharing and management for both the client and consultant.
Table 15.3 shows the contents from a typical evaluation report for an ROI study on consulting. This specific study was conducted for a large financial institution and involved an ROI analysis on a consulting project for commercial banking. The typical report provides background information, explains the processes used, and most important, presents the results.
Table 15.3 Format of an Impact/ROI Study Report
|
|
While this report is an effective, professional way to present ROI data, several cautions need to be followed. Since this document reports the success of a consulting project involving a group of employees, complete credit for the success must go to the participants and their immediate leaders. Their performance generated the success. Another important caution is to avoid boasting about results. Although the ROI methodology is accurate and credible, all executives do not necessarily understand it. Huge claims of success can quickly turn off an audience and interfere with the delivery of the desired message.
A final caution concerns the structure of the report. The methodology should be clearly explained, along with assumptions made in the analysis. The reader should readily see how the values were developed and how the specific steps were followed to make the process more conservative, credible, and accurate. Detailed statistical analyses should be placed in the appendix.
There are many options available to communicate project results. In addition to the impact study report, the most frequently used media are meetings, interim and progress reports, routine communication tools, electronic media, brochures and pamphlets, and case studies.
Meetings are fertile opportunities for communicating project results, if used properly. All organizations have a variety of meetings and, in each, the proper context and consulting results are an important part. A few examples illustrate the variety of meetings.
Regular meetings with the first-level management group are quite common. These meetings can be an excellent forum for discussing the results achieved in a consulting project when the project relates to the group's activities. A discussion of results can be integrated into the regular meeting format.
A few organizations have initiated a periodic meeting for all members of management, in which the CEO reviews progress and discusses plans for the coming year. A few highlights of consulting project results can be integrated into the CEO's speech, showing top executive interest, commitment, and support. Consulting results are mentioned along with operating profit, new facilities and equipment, new company acquisitions, and next year's sales forecast.
Whenever a management group convenes in significant numbers, evaluate the appropriateness of communicating consulting project results.
Although usually limited to large projects, a highly visible way to communicate results is through interim and routine memos and reports. Published or disseminated through e-mail on a periodic basis, they usually have several purposes:
A more subtle reason for the report is to gain additional support and commitment from the management group and to keep the project intact. This report is produced by the consulting staff and distributed to a select group of managers in the organization. Format and scope vary considerably. Common topics are as follows:
While the list may not be suited for every report, it represents topics that should be presented to the management group. When produced in a professional manner, the report can improve management support and commitment to the effort.
To reach a wide audience, consultants can use in-house publications. Whether a newsletter, magazine, newspaper, or electronic files, these types of media usually reach all employees. The information can be quite effective if communicated appropriately. The scope should be limited to general interest articles, announcements, and interviews.
Results communicated through these types of media must be significant enough to arouse general interest. For example, a story with the headline “Safety project helps produce 1 million hours without a lost-time accident” will catch the attention of many people because they may have participated in the project and can appreciate the significance of the results. Reports on the accomplishments of a group of participants may not create interest unless the audience relates to the accomplishments.
For many consulting projects, results are achieved weeks or even months after the project is completed. Participants need reinforcement from many sources. If results are communicated to a general audience, including the participant's subordinates or peers, there is additional pressure to continue the project or pursue similar ones in the future.
Stories about participants involved in consulting projects and the results they achieve create a favorable image. Employees are made aware that the company is investing time and money to improve performance and prepare for the future. This type of story provides information about projects that employees otherwise may not have known about and sometimes creates a desire to participate if given the opportunity.
General audience communication can bring recognition to project participants, particularly those who excel in some aspect of the project. When participants deliver unusual performance, public recognition can enhance their self-esteem. Many human-interest stories can come out of consulting projects. A rigorous project with difficult requirements can provide the basis for an interesting story on participants who implement the project.
In one organization, the editor of the company newsletter participated in a very demanding consulting project and wrote a stimulating article about what it was like to be a participant. The article gave the reader a tour of the entire project and its effectiveness in terms of the results achieved. It was an interesting and effective way to communicate about a challenging activity.
The benefits are many and the opportunities endless for consultants to utilize in-house publications and company-wide intranets to let others know about the success of projects.
Internal and external web pages on the Internet, company-wide intranets, and e-mail are excellent vehicles for releasing results, promoting ideas, and informing employees and other target groups of consulting results. E-mail, in particular, provides a virtually instantaneous means by which to communicate and solicit response from large numbers of people.
A brochure might be appropriate for projects conducted on a continuing basis, where participants have produced excellent results. It should be attractive and present a complete description of the project, with a major section devoted to results obtained with previous participants, if available. Measurable results and reactions from participants, or even direct quotes from individuals, could add spice to an otherwise dull brochure.
Case studies represent an effective way to communicate the results of a consulting project. Consequently, it is recommended that a few projects be developed in a case format. A typical case study describes the situation, provides appropriate background information (including the events that led to the intervention), presents the techniques and strategies used to develop the study, and highlights the key issues in the project. Case studies tell an interesting story of how the evaluation was developed and the problems and concerns identified along the way.
Case studies have many useful applications in an organization. First, they can be used in group discussions, where interested individuals can react to the material, offer different perspectives, and draw conclusions about approaches or techniques. Second, the case study can serve as a self-teaching guide for individuals trying to understand how evaluations are developed and utilized in the organization. Finally, case studies provide appropriate recognition for those involved in the actual case. More important, they recognize the participants who achieved the results, as well as the managers who allowed the participants to be involved in the project. The case study format has become one of the most effective ways to learn about consulting evaluation.
Perhaps the greatest challenge of communication is the actual delivery of the message. This can be accomplished in a variety of ways and settings based on the actual target audience and the media selected for the message. Three particular approaches deserve additional coverage. The first approach is providing insight into how to provide feedback throughout the consulting project to make sure information flows, so changes can be made. The second is presenting an impact study to a senior management team. This may be one of the most challenging tasks for the consultant. The third is communicating regularly and routinely with the executive management group. Each of these three approaches is explored in more detail.
One of the most important reasons for collecting reaction, satisfaction, and learning data is to provide feedback, so adjustments or changes can be made throughout the consulting project. In most consulting projects, data are routinely collected and quickly communicated to a variety of groups.
As the plan shows, data are collected during the project at four specific time intervals and communicated to at least four audiences—and sometimes six. Some of these feedback sessions result in identifying specific actions that need to be taken. This process becomes comprehensive and needs to be managed in a very proactive way. The following steps are recommended for providing feedback and managing the feedback process. Many of the steps and issues follow the recommendations of Peter Block in his successful consulting book Flawless Consulting.1
Following these 12 steps will help move the project forward and provide important feedback, often ensuring that adjustments are supported and made.
Perhaps one of the most challenging and stressful communications is presenting an impact study to the senior management team, which also serves as the ultimate client in a consulting project (they fund the project). The challenge is convincing this highly skeptical and critical group that outstanding results have been achieved (assuming they have), in a very reasonable time frame, addressing the salient points, and making sure the managers understand the process. Two particular issues can create challenges. First, if the results are very impressive, it may be difficult to make the managers believe the data. On the other hand, if the data are negative, it will be a challenge to make sure managers don't overreact to the negative results and look for someone to blame. Following are guidelines that can help make sure this process is planned and executed properly:
Collectively, these steps will help prepare for and present one of the most critical meetings in the consulting ROI process. Figure 15.1 shows the details of this meeting.
The best indicator of how effectively the results of a consulting project have been communicated is the level of commitment and support from the management group. The allocation of requested resources and strong commitment from top management are tangible evidence of management's perception of the results. In addition to this macro-level reaction, there are a few techniques consultants can use to measure the effectiveness of their communication efforts.
Whenever results are communicated, the reaction of the target audiences can be monitored. These reactions may include nonverbal gestures, oral remarks, written comments, or indirect actions that reveal how the communication was received. Usually, when results are presented in a meeting, the presenter will have some indication of how the results were received by the group. The interest and attitudes of the audience can usually be quickly evaluated.
During the presentation, questions may be asked or, in some cases, the information is challenged. In addition, a tabulation of these challenges and questions can be useful in evaluating the type of information to include in future communications. Positive comments about the results are certainly desired and, when they are made—formally or informally—they should also be noted and tabulated.
Consulting staff meetings are an excellent arena for discussing the reaction to communicating results. Comments can come from many sources depending on the particular target audiences. Input from different members of the staff can be summarized to help judge the overall effectiveness.
When major project results are communicated, a feedback questionnaire may be used for an entire audience or a sample of the audience. The purpose of this questionnaire is to determine the extent to which the audience understood and/or believed the information presented. This is practical only when the effectiveness of the communication has a significant impact on the future actions of the consulting team.
Another approach is to survey the management group to determine its perceptions of the results. Specific questions should be asked about results. What does the management group know about the results? How believable are the results? What additional information is desired about the project? This type of survey can help provide guidance in communicating results.
The purpose of analyzing reactions is to make adjustments in the communication process—if adjustments are necessary. Although the reactions may involve intuitive assessments, a more sophisticated analysis will provide more accurate information to make these adjustments. The net result should be a more effective communication process.
This chapter presents the final step in the results-based approach to consulting accountability. Communicating results is a crucial step in the overall evaluation process. If this step is not taken seriously, the full impact of the results will not be realized. The chapter begins with general principles for communicating project results. The various target audiences are discussed and, because of its importance, emphasis is placed on the executive group. A suggested format for a detailed evaluation report is also provided. Much of the remainder of the chapter includes a detailed presentation of the most commonly used media for communicating project results, including meetings, client publications, and electronic media. Numerous examples illustrate these concepts.