chapter four

Neurolinguistic programming for managers and engineers as evidence-based practitioners

Tomasz Witkowski

Polish Skeptics Club

 

Stawomir Jarmuz

Moderator Ltd.

Contents

Introduction: Managers and engineers as evidence-based practitioners

When a crime is committed, the police gather and secure evidence. If we were to appear in court, standing accused of that crime, and we were not presented with sufficient proof, we would likely conclude that our rights had been violated. We rely on evidence when we sit down on a roller coaster. We trust that the engineers gathered enough evidence on the durability of the particular materials used in its construction. We also trust that the doctor treating us is applying evidence-based methods, and if this were not the case, we’d probably get quite angry with him/her. Why is it that in so many situations we seek out evidence and rely on it?

Likely because evidence-based actions deliver good results. Evidence-based medicine led to a significant increase in humans’ average lifespan in the twentieth century, and diseases which were fatal just a few decades earlier are today a far lesser threat. The development of technology we are both witnesses to and beneficiaries of is possible only because of serious consideration being given to evidence. On the other hand, actions undertaken without evidence or in which evidence is given insufficient consideration frequently end in disaster, or even tragedy. Are we, however, rational enough to seek out in every sphere of activity evidence that would serve to guarantee our effectiveness? Do we ask the teachers teaching our children for evidence? Are their methods based on evidence? How much weight do managers responsible for managing people give to evidence? Or trainers in charge of training our employees? As it is, the answer here is far less than clear. Many methods of teaching or management are based on evidence, but many of them are simply “common wisdom,” or long-standing myths that can do more harm than good. Why, then, do we depend solely on evidence in some areas, while in others we do not?

We can identify two main causes of this phenomenon:

  • The first—the application of ineffective methods in teaching or management rarely leads to spectacular catastrophes. The negative effects consist in insignificant wasting of time at trainings, but frequently for a large number of people. This is also an inefficient use of financial resources, but almost never of such sums that would threaten the company.

  • The second cause results directly from the first. Because the failures that derive from the application of ineffective methods are never spectacular, we have become accustomed to adopting a very tolerant approach to evidence, and we frequently accept subjective experiences as evidence. We demand that an engineer present us with hard calculations, but from training methods we often only require that they be attractive and appealing to their participants. Is this a rational approach? Shouldn’t we ask about evidence with greater frequency? Shouldn’t we look for the most effective methods? The question is, however, how should we do so?

Most importantly, we should know that almost anything can constitute evidence. The testimony of an eyewitness who has seen a UFO can be evidence confirming the existence of extraterrestrials. In turn, a picture of someone wandering around the mountains can become evidence of the existence of beings referred to as Yeti. The recommendations of patients can be evidence of the effectiveness of a doctor, while the value of training and developmental methods can be attested to in the opinions of participants. We can identify many such kinds of evidence, but scientists do not treat them as decisive; indeed, the essence of evidence-based practices is the search for the best available evidence, and not just any evidence at all. Here, however, another question arises that may seem a difficult one at first glance: how can we determine whether a given piece of evidence is of greater or lesser value? How to orient oneself in the thicket of methods and means of distinguishing which piece of evidence is worthy of trust? Thankfully, we are aided by scientists, who have wondered for decades about which proofs should be given the greatest weight, and which should be approached with caution. We can be aided in this respect by the broadly respected hierarchy of evidence (e.g., Ng & Benedetto, 2016; Page & Meerabeau, 2004; Petrisor & Bhandari, 2007). Despite minor differences among authors, the majority of them admit that the evidence we cite is at the bottom of the hierarchy. The majority of scientists also agree with the statement that the highest level is occupied by umbrella reviews, meta-analyses, and systematic reviews. One rung lower are randomised controlled trials, and lower still are quasi-randomised trials and observational studies.

Desiring to act rationally, whether in making a decision about a training seminar, or in selecting a management method, we should always examine on what level of the hierarchy of evidence are the proofs we are using to justify our actions. Basing one’s actions on evidence lower in the hierarchy when there is evidence of greater significance available to us brings to mind an old Indian tale of blind men who decide to learn about an elephant. One of them, upon touching the elephant’s hard skin, said it was a wall. The second touched a tusk, and said it was a spear. The third, having touched the elephant’s trunk, was convinced he had encountered a sort of snake. The fourth, brushing up against the elephant’s knee, said it was a tree. Having felt a gust of wind caused by the elephant’s breathing, the fifth blind man called it a fan. And, finally, the sixth, having grabbed the elephant by its tail, said that it was just a normal piece of rope.

The evidence-based approach was developed in places where opinions and viewpoints can have no truck—in saving human lives, in the work of engineers. It has proven itself, which is why thinking managers employ it in managing, good teachers in teaching, and good trainers in trainings. There is also increasingly frequent mention of evidence-based politics. We recommend this approach to all practitioners, which is why we have performed an analysis of the available evidence regarding the effectiveness of neurolinguistic programming that can serve as an aid in taking decisions about using it for one’s own development, as well as for needs related to employee training.

The outline of the model (as created by Bandler and Grinder)

In the 1970s, Richard W. Bandler and John Grinder had the idea to create a practical therapy model. They reasoned that a group of recognised psychotherapists acted on the basis of implicit theories that helped them achieve substantial psychotherapeutic effectiveness and great rapport with clients. Grinder and Bandler concluded that careful observation of these skillful therapists at work should lead to the identification of successful patterns of practice that would then be empirically verified and disseminated to other practitioners. For several years, they observed such therapists as Fritz Perls, Milton H. Erickson, and Virginia Satir at work. Based on these observations and reflections, Grinder and Bandler formulated neuro-linguistics programme’s (NLP’s) tenets and hypotheses. With time, their strategy was promoted as a “science of excellence.” It reflected a procedure also known as “modelling,” in which one studies the performance of highly successful people from different walks of life in order to learn skills to improve one’s own personal and professional life (O’Connor & Seymour, 1993).

The originators of NLP described it as a “model” rather than a “theory.” The central philosophy of the NLP model is summed up in the phrase “the map is not the territory” (e.g., Lankton, 1980, p. 7). The idea is that each individual operates on the basis of his or her internal representation of the world (the “map”) and not the world itself (the “territory”). One’s interactions with the world are formed by mental maps created from one’s surroundings. The maps are by nature distorted, limited, and inflexible. The task of the therapist is to understand the client’s particular map and to convey that understanding to the client. As Heap (2008) and Newbrook (2008) maintained, this philosophy was verbalised by the philosopher and linguist Korzybski (1933).

At the core of NLP lies the notion of a preferred representational system (PRS). It is argued that the maps people make of their world are represented by five senses: visual, kinaesthetic (referring to both tactical and visceral sensations), auditory, olfactory, and gustatory. Every experience is composed of information received through these sensory systems. NLP proponents coined the term “representational systems” to describe the patterns in the way that sensory data are represented in people’s minds (Bandler & Grinder, 1979; Grinder & Bandler, 1976). They claimed that every person processes most information using predominantly one PRS.

Another ostensible discovery of which NLP originators were particularly proud was the idea that access to the representational systems is possible through so-called accessing cues, and more specifically, through eye movements (EMs). They explained, for instance, that a person engaged in a cognitive activity in the visual mode would tend to look upwards, whereas a person using the auditory model would tend to look horizontally (Bandler & Grinder, 1979). The kinaesthetic mode is believed to be associated with a gaze downwards to the right. Thus, careful observation of such EMs should enable an NLP therapist to unequivocally identify the PRS of a client or an interlocutor and, as a consequence, facilitate a therapeutic intervention matched to the individual’s particular PRS.

The final assertion is that by matching, mirroring, or pacing clients’ verbal and non-verbal behaviour, including their PRS, the NLP practitioner has the opportunity to achieve effective communication, gain the client’s trust, and enhance rapport. Reflecting on the example of model therapists, in order to work effectively with a client, the therapist should strive to match the client’s PRS to be able to use his or her “map.” A trained practitioner can identify the method in which information is stored through careful observation of the client’s eye-gaze patterns, posture, breathing patterns, tone of voice, and language patterns. Subsequently, the therapist takes every care to match the clients’ PRS while communicating with them. PRS matching effected through following the same language patterns—i.e., by using predicates typical of the mode operated by the client—ostensibly yields the best results in facilitating communication and enhancing therapeutic effectiveness.

The NLP originators promoted it as a sensationally effective and rapid form of psychological therapy. They claimed that NLP helped overcome such problems as phobias and learning disabilities in less than an hour’s session, whereas with other therapies, progress might take weeks or months (e.g., Bandler & Grinder, 1979, p. ii; Lankton, 1980, pp. 9–13). They also maintained that a single session of NLP combined with hypnosis could eliminate certain eyesight problems, such as myopia (Grinder & Bandler, 1981, p. 166), and even cure the common cold (Grinder & Bandler, 1981, p. 174). Today, we can find similarly alluring promises in many NLP programmes and advertisements.

The development of NLP can be analysed in terms of a particular research paradigm within social psychology known as the “full cycle” approach, developed by Cialdini (1980). Cialdini critically argued that experimental lab-based research, although offering the opportunity to control variables and establish causality, had several accompanying weaknesses. The most prominent was the inability to determine the strength or prevalence of phenomena in the natural environment. Cialdini argued instead that researchers should use naturalistic observation to determine the presence of an effect in the real world, then develop a theory to determine what processes may underlie the effect, followed by experimentation to verify the effect and its underlying processes, and finally return to the natural environment to corroborate the experimental findings.

Bandler and Grinder omitted the critical stage of empirical verification of their assertions. They found that part of the process redundant and unnecessary, and so moved directly to the formulation of the model and to putting it into practice. They were known for their openly demonstrated contempt for the scientific verification of NLP hypotheses:

As far as I can tell, there is no research to substantiate the idea that there is eyedness. You won’t find any research that is going to hold up. Even if there were, I still don’t know how it would be relevant to the process of interpersonal communication, so to me it’s not a very interesting question. (Bandler & Grinder, 1979, p. 31)

Nevertheless, many subsequent researchers did subject NLP to empirical evaluation.

Review of research to date

Beginning in the 1980s, a wide range of articles on NLP were published. Particular attention should be paid to several reviews of research on the effectiveness of NLP. The first two were conducted by Sharpley (1984, 1987). In his first analysis, he reviewed 15 studies examining the possibility of identifying and matching clients’ PRS. Sharpley (1984) concluded that “the identification of this PRS (if it is a PRS and not merely current language style) by either eye movements or self-report is not supported by the research data … The existence or stability of the PRS is irrelevant to predicate matching as a counselling process, and parsimony argues for the process rather than the yet unverified theory … Of most importance, there are no data reported to date to show that NLP can help clients change” (p. 247).

The second review (Sharpley, 1987) is even more conclusive. It was written as a response to a critical paper by Einspruch and Forman (1988), who analysed 39 studies on NLP and described methodological errors and a lack of sufficient knowledge about the theoretical underpinnings of NLP demonstrated by authors. Sharpley took into account works investigated by Einspruch and Forman and expanded that sample with additional ones to perform an analysis of 44 studies. Six papers (13.6%) provided evidence supportive of NLP-derived theses, 27 (61.4%) failed to lend support for one or more of those tenets, and 11 (25%) showed only partial support. Sharpley examined all works available, starting from doctoral dissertations to papers published in high-ranking peer-reviewed journals. He summed up his review as follows:

There are conclusive data from research on NLP, and the conclusion is that the principles and procedures suggested by NLP have failed to be supported by those data … Certainly research data do not support the rather extreme claims that proponents of NLP have made as to the validity of its principles or the novelty of its procedures. (pp. 105–106)

There are also other important research reviews. In 1988, Heap analysed 63 studies and concluded that the assertions of NLP writers concerning representational systems had been objectively investigated and found to be wanting. The hypothesis that it is possible to identify PRS through careful observation of EMs was likewise not confirmed. In Heap’s view, the stated conclusions and the failure of investigators to demonstrate convincingly the alleged benefits of predicate matching seriously questioned the role of such procedures in counselling. Dorn, Brunson, Bradfor, and Atwater (1983) similarly concluded from their review that there was no demonstrably reliable method of assessing the hypothesised PRS.

If the NLP assertion of a reliably identifiable PRS and the corresponding ability to enhance communication through PRS matching proved to be true, it would have important implications for neuroscience, cognitive psychology, and a number of other disciplines. If the NLP claims concerning its instant effectiveness proved to be true, the field of psychotherapy would be transformed, perhaps even revolutionised, and research reporting the effectiveness of therapy would position NLP as a potential first-rate therapy. Nothing of the sort has taken place. Instead, experts warn against using NLP, and classify it is as one of many dubious “fringe therapies” (Beyerstein, 2001) or “power therapies” (Devilly, 2005). NLP is also found on many lists of discredited therapies. Norcross, Koocher, and Garofalo (2006) sought to establish consensus on discredited psychological treatments and assessments using the Delphi methodology. A panel of 101 experts participated in a two-stage survey, wherein they had to report familiarity with 59 treatments and 30 assessment techniques and rate them on a continuum from not at all discredited (1) to certainly discredited (5). Neurolinguistic Programming for treatment of mental/behavioural disorders was assessed at an average of 3.87 (SD = 0.92). For comparison, “angel therapy for treatment of mental/behavioral disorders” obtained the highest score, M = 4.98 (SD = 0.14), and “behavior therapy for sex offenders” obtained the lowest, M = 2.05 (SD = 0.91).

Similarly, Roderique-Davies (2009) cautioned against applying NLP to therapeutic practice in an article Neuro-linguistic programming: Cargo cult psychology? in which he concluded:

NLP masquerades as a legitimate form of psychotherapy, makes unsubstantiated claims about how humans think and behave, purports to encourage research in a vain attempt to gain credibility, yet fails to provide evidence that it actually works. (p. 62)

The Army Research Institute (ARI) asked the National Research Council to assess the credibility of “New Age” techniques, including NLP, considered for implementation by the US Army with a view to enhancing human performance. The committee in charge of the review also challenged the effectiveness of NLP. They concluded:

The conclusion was that little if any evidence exists either to support NLP’s assumptions or to indicate that it is effective as a strategy for social influence. (Swets & Bjork, 1990, p. 90)

Von Bergen, Soper, Rosenthal, and Wilkinson (1997) analysed areas of application of “alternative training techniques” in human resources management, and likewise concluded:

We identified four alternative training techniques that have been widely touted and sold to government and industry: subliminal stimulation, mental practice, meditation, and NLP. Finding that the claims made for three of these techniques, mental practice being the exception, did not stand up to scientific scrutiny, we encourage HRD professionals to guard against substituting testimonials and popularity in the marketplace for research evidence when they consider a new training aid. (p. 291)

An evaluation of the effectiveness of NLP as a communication theory and its contribution to clinical practice and family therapy is similarly unflattering:

The academic verdict on NLP is given: NLP’s theory of the person cannot account for the wide range of intrapsychic and interpersonal problems encountered in clinical practice. A final verdict is withheld until further clinical studies and experimental investigations are reported. (Baddeley, 1989, p. 73)

In 2010, another review of research on NLP was published (Witkowski, 2010). It presented the concept of NLP in the light of empirical research in the Neuro-Linguistic Programming Research Data Base. From among 315 articles, the author selected 63 studies published in journals from the Master Journal List of ISI. Out of 33 empirical studies, 18.2% show results supporting the tenets of NLP, 54.5% results non-supportive of the NLP tenets, and 27.3% report uncertain results. The qualitative analysis indicates the greater weight of the non-supportive studies and their greater methodological worth against the ones supporting the tenets. Analysis results contradict the claim of empirical bases of NLP.

Two years later, a systematic research review was published (Witkowski, 2012). In order to examine the scientific status of NLP, 401 publications were identified, including a subsample (n = 66) that was published in prestigious journals. Of the entire sample, 21 methodologically sound empirical studies published since the last comprehensive reviews of NLP were identified (Heap, 1988; Sharpley, 1984, 1987). Of these studies, 9.5% were found to be generally supportive of the tenets of NLP and/or the effectiveness of NLP techniques, 19% were partially supportive, and 71.5% were non-supportive. The author concluded his review:

NLP is ineffective both as a model explaining human cognition and communication, and as a set of techniques of influence and persuasion. (p. 37)

Also in 2012, Sturt with her co-workers published a systematic review of the effects of NLP on health outcomes. To evaluate these effects the researchers searched: MEDLINE®, PsycINFO, ASSIA, AMED, CINAHL®, Web of Knowledge, CENTRAL, NLP specialist databases, reference lists, review articles, and NLP professional associations, training providers, and research groups. Their searches revealed 1,459 titles from which ten experimental studies were included into the review. Five studies were randomised controlled trials (RCTs), and five were pre-post studies. Targeted health conditions were anxiety disorders, weight maintenance, morning sickness, substance misuse, and claustrophobia during MRI scanning. NLP interventions were mainly delivered across 4–20 sessions, although three were single-session. Eighteen outcomes were reported, and the RCT sample sizes ranged from 22 to 106. Four RCTs reported no significant between-group differences, with the fifth finding in favour of the NLP arm. Three RCTs and five pre-post studies reported within-group improvements. The authors concluded that there is little evidence that NLP interventions improve health-related outcomes. In their opinion, there was insufficient evidence to support the allocation of National Health Service (NHS) resources to NLP activities outside of research purposes (Sturt et al., 2012).

The only meta-analysis on NLP was published in 2015 (Zaharia, Reiner, & Schütz, 2015). The authors removed 350 from a total number of 425 studies, considering them not relevant based on the title and abstract. In the final analysis, they included 12 studies, with numbers of participants ranging between 12 and 115. The vast majority of studies were prospective-observational. The article evaluates the effectiveness of NLP therapy for individuals with social/psychological problems. The overall meta-analysis found that NLP therapy may add an overall standardised mean difference of 0.54, with a confidence interval of CI = [0.20; 0.88]. In the opinion of the authors, NLP as a psychotherapeutic modality shows results that can hold their ground in comparison with other psychotherapeutic methods.

As the results of this meta-analysis run contrary to the conclusions derived from former reviews, they must be taken into account very carefully. First of all, it is not quite clear how the researchers reduced the number of studies from 75 to 12. Although they write about excluding criteria such as “Not the right population; studies conducted on healthy individuals with social/psychological problems (n = 19); Not the right intervention (n = 17): studies conducted in healthy individuals with social/psychological problems (n = 8), depression (n = 5), other (n = 4); Not the good outcome: studies carried out in healthy individuals with social/psychological problems (n = 17); Excluded based on study design (n = 11): review, editorial, comment letter, study design protocol. (p. 357),” we are unable to see what studies were excluded. Moreover, the authors included into their sample also unpublished and never peer-reviewed data. Also of significance is that all authors of this article are active practitioners of NLP, which may give rise to conflicts of interest.

Today, after 40 years of research devoted to the concept, NLP is closer to the image of an unstable house built on sand rather than an edifice founded on empirically-based rock. In 1988, Heap passed verdict on NLP. As the title of his article indicated, this was an interim verdict. In his conclusions, he wrote:

If it turns out to be the case that these therapeutic procedures are indeed as rapid and powerful as is claimed, no one will rejoice more than the present author. If however these claims fare no better than the ones already investigated then the final verdict on NLP will be a harsh one indeed. (p. 276)

We are fully convinced that we have gathered enough evidence to announce this harsh verdict now, but before we do so, we would like to take a thorough look at the practice of NLP.

Between theory and practice—a review of the present content of NLP training methods

NLP is a collection of diverse methods and techniques that would be hard to call an obligatory canon. NLP practitioners in different countries use chosen methods in combination with their own inventions. We decided to describe and assess a few of the methods most frequently appearing in books on NLP and in training programmes. The selection is thus necessarily a subjective one, but it encompasses the most important offerings one can come across at NLP courses, in books, and in internet-based materials.

Presuppositions

The definition of “presupposition” is an assumption, a judgement, a condition. More precisely, an assumption we silently adopt in many of our statements. The term comes from linguistics, with a tradition in science reaching back to the mid-nineteenth century. Considerations addressing similar issues, however, can be traced back to the work of Aristotle, and are present throughout the entire history of philosophy (Horn, 1996). Let us recall here that NLP, which generally does not address the roots of presupposition, came about in the 1970s. Thus, existing knowledge was incorporated into it, and the “user” of NLP is generally unaware of its true roots.

The majority of our utterances contain some assumptions. Without them, it is impossible to say whether a sentence is true or false in the classic sense of truth as being in accordance with reality. In the sentence “John likes trainings about emotional intelligence for managers,” we are faced with several presuppositions. First, that there really is a person named John. Second, that there are trainings for managers on the subject of emotional intelligence. And third, that John participates in them. In the absence of these assumptions, we would be unable to declare whether the sentence is true or false. These kinds of presuppositions seem obvious. However, presuppositions related to attempts at persuasion are more interesting. The sentence “When will you decide to get a new job?” contains the hidden assumption that the addressee is considering changing employment. Perhaps this individual has not yet in fact taken a decision, and the utterance serves to induce such a step. In the context of negotiations and sales, a sentence with a presupposition could go like this: “Which model do you choose, the first or the second?” The client is pressed into making a choice, while in fact no decision has yet been made by that person as to whether or not to buy. Presuppositions of this nature open up space for social influence, and often—manipulation. And this is precisely why they have been incorporated into NLP as verbal devices for achieving goals. The tools of linguistics are employed in such fields as politics, advertising, and marketing. NLP in these cases is not creating theory, but rather taking advantage of scientific achievements under its own banner. This is analogous to developing a new field of knowledge with a fancy-sounding name, while simply teaching arithmetic under its aegis. The Middle Ages philosopher William Ockham developed the famous rule which bears his name, “Ockham’s Razor,” also known as economy of thought. This rule says that when seeking to explain some phenomenon, the number of notions employed should be limited. NLP violates the precept of “Entia non sunt multiplicanda praeter necessitatem.”

Metamodel

The metamodel—like presuppositions—is a linguistic device. Some NLP proponents treat presuppositions as a part of a metamodel. Here, however, we treat these two issues separately. The metamodel serves the analysis of language and uncovering of hidden meanings contained in a message, which serves to facilitate communication. The conception was elaborated by the creators of NLP, Richard Bandler and John Grinder, in the first book written on the subject (Grinder & Bandler, 1976). In their work, the progenitors of NLP adopt the following assumption:

Language serves as a representational system for our experiences. Our possible experiences as humans are tremendously rich and complex. If language is adequately to fulfill its function as a representational system, it must itself provide a rich and complex set of expressions to represent our possible experiences. (p. 24)

According to Grinder and Bandler, the problem is that language frequently deforms real experience. This is why tools are needed for messages to refer to the greatest degree possible to experiences and facts. The metamodel distinguishes three processes that alter the precise meaning of a message: generalisation, deletion, and distortion. Generalisation consists in drawing general conclusions from individual events; for example, when an employee does not perform his task correctly, the manager says: “He never does his work properly.” This generalisation disfigures the image of the employee if he has performed other tasks correctly. Generalisations are characterised by the application of general quantifiers, e.g., such words as every, everybody, always, never, etc. Another example of generalisation comes in the form of imprecise verbs, whose general meanings can be understood in different ways. A typical example in business relations is the assurance “I will do everything in my power.” We don’t know what, specifically, that person will do in that particular situation.

The second process altering the meaning of a message is deletion. It occurs when certain aspects of information are omitted, which leads to an incorrect conclusion. In a business situation, the salesperson says to the client: “Our solution is the best.” We don’t know exactly what he/she has in mind, nor with what other solutions he/she is comparing his/her offer to. The deletion of this information leads to a warping of the general assessment. The third process distinguished in the metamodel is distortion, which consists in employing notions or terms that can be understood differently in different contexts. Grinder and Bandler argue that distortions are not only a linguistic process, but also constitute the basis of artistic activity. Creation consists in a modification of reality. There are many instances of distortions described by NLP practitioners. One of them is “mind reading,” consisting in assigning a specific intention to someone, for example “There’s no way that you like me.” This kind of message makes it difficult to maintain good relations. Another example is the lost performative, which consists in creating sentences without subjects, e.g., “That system shouldn’t be activated.” The absence of a subject makes the message sound like an objective need or necessity, and makes discussion of a problem difficult.

The metamodel is not limited to detailing processes that make it harder to drill down to real meanings, but it also offers tools to enhance communication. These are questions uncovering real meaning or intentions. Here are some examples that relate to the ones presented in the preceding passages:

  • GENERALISATION

    “He never does his work properly.” “Never? So what would you say about the project he oversaw that got rave reviews?”

    “I will do everything in my power.” “What, exactly, will you do? What will the result of your work be?”

  • DELETION

    “Our solution is the best.” “In what sense? Compared to what solutions?”

  • DISTORTION

    “There’s no way that you like me.” “For what reasons do you think so? And what could convince you that I in fact do like you?”

    “That system shouldn’t be activated.” “Who thinks we should activate that system? What are the arguments in favor of activating it? What will happen if we don’t?”

Initially, the metamodel was used by NLP practitioners in therapy, and then it entered the world of trainings and personal development. As opposed to many of the offerings of NLP, the metamodel is a useful tool that raises no doubts, and which primarily serves to improve communication in diverse social contexts. Because the processes of generalisation, deletion, and distortion at times are put into service of the goal of manipulation, the questions proposed in the metamodel are a good way of coping with manipulation. The usefulness of this area of NLP is likely linked to strong inspiration from psycholinguistics, and thus a field of science with a strong empirical foundation.

Anchoring

Another tool we can identify in the programmes of the majority of NLP courses is anchoring. Because the NLP literature contains various definitions and descriptions of this device, we have selected that which is presented on Wikipedia. It links elements of several others proposed by leading proponents of this trend.

NLP teaches that we constantly make anchors (Classical Conditioning) between what we see, hear and feel and our emotional states. While in an emotional state if a person is exposed to a unique stimulus (sight, sound or touch) then a connection is made between the emotion and the unique stimulus. If the unique stimulus occurs again, the emotional state will then be triggered. NLP teaches that anchors (such as a particular touch associated with a memory or state) can be deliberately created and triggered to help people access ‘resourceful’ or other target states. (Methods of neuro-linguistic programming, n.d.)

In using anchoring, NLP practitioners first define what emotions we will require in a given situation. These can be courage, serenity, joy, as well as others. In the second step, we should recall a situation in our life when we had a clear experience of a given emotion, e.g., when listening in our youth to a particular piece of music, we felt joy. The following step is linking that recalled situation with some sort of neutral gesture, such as folding our arms, an image, or some other stimulus referred to as an anchor. According to NLP practitioners, the association of a neutral gesture with a recalled situation creates conditioning that evokes the pleasant, desired emotion. In the opinion of NLP proponents, in this manner we can cope with negative emotions by substituting positive ones in their place. If we experience fear before a public appearance, it is enough to perform the appropriate gesture that will evoke positive mental associations, including the desired emotion. If this emotion is courage, then the fear is conquered, driven away by positive affect. This process should be repeated in order to make the association permanent.

The anchoring technique seems a simple and useful one. However, from the scientific point of view, it is average at best. Apart from theoretical analysis, this is attested to by empirical study. Several researchers have compared the usefulness of this technique with traditional methods of coping with public appearances. As it occurred, contrary to the promises of NLP’s creators describing the negation of fear before public appearances in the course of one session, anchoring generated effects no better than those of other methods (Krugman et al., 1985). The explanation of the ineffectiveness of this device is associated with a failure to understand the mechanism of classical conditioning that some NLP practitioners systematically invoke.

The mechanism of classical conditioning was discovered and described by the Russian physiologist, Ivan Pavlov. It consists in an unconditional stimulus, such as the appearance of food, evoking an unconditional reaction, i.e., drooling. If the unconditional stimulus appears concurrently with some other stimulus referred to as conditional—for example, the flashing of a lamp—then after several repetitions of the sequence, the conditional stimulus will itself evoke the unconditional response. Conditioning can also apply to negative situations. Explanations of this mechanism in psychology often invoke a study during which a young boy named Albert was playing with his favourite white rat. During the child’s play, an experimenter placed behind a curtain hit a metal bar, evoking fear in the child. After a few repetitions, the child began crying on sight of the rat, and generalised this reaction to other white animals. The described mechanism was discovered in the first half of the twentieth century, and constitutes an important contribution to knowledge on the subject of learning by animals, including by humans (Moore, Manning, & Smith, 1978). Let us observe that the link between the unconditional stimulus and the conditional relation relates to activities important to survival, and requires a real, rather than imagined concurrence. Such unconditional reactions as drooling, fear, or sexual arousal occur as an effect of real stimuli (food, loud noise, object of sexual desire). Merely imagining them does not evoke emotion, or at least not strong emotion. If it were possible through force of imagination to create any and all emotions, people would probably take advantage of that possibility continually, without a second thought. NLP suggests the possibility of evoking emotions by way of imagination. What is more, these emotions are linked with a neutral gesture, such as folding one’s arms, treated as a conditional stimulus. Since there is a very slight link between imagination and emotion, there should be a slighter a link between the trivial action of folding one’s arms and emotions. We add that classical conditioning concerns primary emotions. When it comes to complex emotions—which, in the opinion of NLP proponents, are to be evoked by anchors—the mechanisms are more complicated. We are thus dealing with an entirely providential interpretation of classical conditioning as justification for the effectiveness of anchoring.

Even more confusing is the application of this technique in real situations. Referring to the problem with public appearances, NLP practitioners state that negative feelings, such as nervousness or fear, can be substituted with positive emotions such as confidence or joy. It’s enough to simply apply anchoring. Unfortunately, things are not so simple. In psychology, there are very thorough examinations and descriptions of the effect known as “bad is stronger than good” (Baumeister, Bratslavsky, Finkenauer, & Vohs, 2001). It turns out that negative events or emotions have a much stronger influence on us than positive ones. This is linked with the evolutionary history of our species, when reacting to negative or threatening stimuli was far more important for survival than reacting to pleasant situations. This is why, for example, we have a far stronger sense of smell when it comes to unpleasant odors as compared to pleasant ones. Turning back to the advice of NLP practitioners, in difficult situations such as public appearances, anchoring is supposed to replace negative emotions with positive ones. Taking into consideration the phenomenon of “bad is stronger than good,” negative emotions associated with that situation will likely be far stronger than those positive ones that are (if at all) evoked in the imagination. If anchors are to work at all, then, paradoxically, they are far more effective in evoking negative emotions. Thus, on grounds of established psychological knowledge, the practice of anchoring would seem an ineffective one, and the absence of studies confirming the effectiveness of anchoring would seem to reinforce this conviction.

Metaprograms

In NLP training programmes, we may frequently encounter so-called metaprograms, that is, methods people employ for processing information and creating action plans based on that information. According to Hoag (2018), “metaprograms are mental processes which manage, guide and direct other mental processes.” The conception of metaprograms assumes that people unconsciously filter information in their own characteristic manner, which in consequence modifies their behaviour. Thus, recognition of a person’s metaprograms allows us to predict his/her behaviour, to improve communication, and to exert influence.

This general description is best illustrated using examples. One of the primary metaprograms is Toward vs Away From. An individual possessing the metaprogram Away From (more specifically, a plan resulting from the metaprogram) focuses on problems, predicts difficulties, and has difficulty in setting goals. He/she frequently uses phrases like “I won’t,” “I don’t want to,” “It can’t be done,” etc. Such people are more easily manipulated, because they are more concerned with duties rather than personal aspirations. In turn, people with the metaprogram Toward work with constancy to achieve set goals. Their thinking is so strongly oriented towards achieving results that they fail to perceive barriers. Their vocabulary frequently features such words as “I want,” “I’ll get it,” and “I will achieve”. It is more difficult to influence people with the Toward metaprogram than Away From.

Another metaprogram, Self-Reference vs Other Reference, concerns focusing attention on oneself or on others. In the first case, assessment of events is associated with personal observations, experiences, or values, and most frequently serves to maintain one’s high feelings of self-worth. If, for example, someone points out a mistake made by that person, the reaction comes in the form of a statement such as “That’s your opinion.” When we ask how they know they’ve done something well, they say “That’s how it seems to me.” The opposite tendency is demonstrated by people on the other side of the Self-Reference vs Other Reference metaprogram. The criterion for information intake is other people, their needs, and values. When pointing out to such people that they have erred, we hear that they need to consult with others and take corrective action. In turn, when asking how they recognise that they have done their work well, they invoke the opinions of others. According to NLP practitioners, the Self-Reference vs Other Reference metaprogram is not equivalent to the well-known extroversion–introversion dimension. Initially, eight metaprograms were detailed within NLP, and more were successively added. In 2009, there were around 60 of them (Vaknin, 2010).

This short description of two metaprograms shows that they were intended to be based on a cognitive approach to personality. The essence of this approach is the statement that the manner in which a person takes in and processes information impacts emotions and behaviour. The cognitive approach is very important in contemporary psychology. Although the conception of metaprograms refers in its assumptions to mainstream psychology, it has some very serious flaws. First, metaprograms divide people into a dichotomy: those who prefer one of two opposing scenarios. From the perspective of present-day knowledge gathered in the field of social psychology, the situation has a very strong impact on interpretations of events and on behaviour. This does not mean that internal factors such as personality play no role. However, in teaching managers to understand their own behaviours and those of others through the framework of metaprograms, we frequently play loose and fast with the truth. Second, the conception of metaprograms attempts to describe differences between people, but does so inaccurately, or at least there is no empirical data indicating the sufficiency of metaprograms.

In the PsychINFO database of refereed articles (August 2018), a search for the term “metaprograms” returns only one empirical study, and that is a qualitative one (Brown, 2004). This attests to the lack of interest by scientists in verifying this conception, or to its theoretical opacity. This situation could result from the fact that metaprograms do not form a comprehensive conception of personality, cognitive styles, or other individual differences. They are a collection of ideas inspired in part by practice, and in part by the intuition of NLP trainers. In addition, in NLP publications and programmes there are further metaprograms on a different level of generality, with the relations between particular constructions unclear. The myriad of metaprograms leads to problems with explaining and predicting behaviour, because it is difficult to classify a specific behaviour to one metaprogram. What is more, distinguishing and applying several dozen metaprograms becomes practically worthless. The average person is not capable of analysing others’ behaviour applying dozens of explanatory categories.

In summary, metaprograms are an attempt at describing individual differences between people and making practical use of these differences. Studies have not proven the accuracy of this conception. Thus, in spite of its cognitive foundations, it is theoretically immature. From the practical standpoint, the conception of metaprograms is difficult in application.

The Dilts Pyramid

Robert Dilts is a leading NLP authority. He has written a number of books forming the canon of this field (e.g., Dilts, 1983, 1998). The most frequently applied in NLP is the conception known as the Dilts Pyramid, or the Dilts Logical Pyramid, and also Dilts’ NeuroLogical Levels. According to Dilts, who drew inspiration from the anthropologist Bateson (1979), the individual should be examined on several levels. Each of these levels is a system in and of itself, and influences the remaining ones. At the bottom of the pyramid is environment, i.e., the conditions in which the person lives: social surroundings, physical environment, weather, food, sounds, etc. The environment is perceived by our senses, and this perception is formed by our nervous system. In Dilts’ opinion, we can begin to understand a person starting from the way she perceives and analyses her environment.

The second level is behaviour, that is, reactions and actions that a person undertakes in his environment. The psychomotor system is responsible for this level.

The next, third level, is our capabilities. Dilts understands capabilities as a “mental map” that organises experience. Without capacities, our behaviours would be only a response to stimuli, a collection of habits. It is capabilities as an internal structure that is responsible for a given set of behaviours demonstrated by an individual. Capabilities make it possible to acquire proficiency or mastery in a given class of behaviours. The physiological base of this level is the activity of the “grey matter” of the cortex, where information from the senses is organised in the form of mental maps.

A higher level of the Dilts Pyramid concerns beliefs and values, which refer to fundamental judgements about the world, other people, and oneself. Beliefs and values determine the meaning we assign to our surroundings and experiences. They are also the foundation of motivation to action. The physiological base of beliefs and values is comprised of the limbic system and hypothalamus. As Dilts claims, although these parts are more primitive than the cortex, they integrate information from the brain complex and regulate the activity of the autonomous nervous system, such as the heart action.

Going even higher in the Dilts Pyramid, we reach the level of identity, that is, the answer to the question “Who am I?” The feeling of identity impacts beliefs and values, establishes missions, and determines goals and roles performed. As opposed to the lower levels for which particular parts of the human nervous system are responsible, the nervous system as a whole is engaged at the level of personality.

Robert Dilts ultimately introduces a sixth level, called purpose. It is a response to the existential questions of “Why?” and “For whom?” Because the individual is part of a greater system, the sense of his/her life should be something external to himself/herself. The level of purpose is this responsible for links between the individual and a broader perspective beyond the self. At the physiological level, Dilts advances controversial theories about a collective nervous system creating fields of interaction between people. He invokes the highly enigmatic, even esoteric conception of Rupert Sheldrak, which postulates the existence of a so-called morphogenetic field. The morphogenetic field, in Sheldrak’s opinion, is responsible for unexplained phenomena such as changes in the behaviour of a portion of a population causing a change in the remaining portion in the absence of the possibility of communication between them. Sheldrak’s conception has never gained the acceptance of scientists.

Robert Dilts claims that the particular levels of the pyramid impact one another. However, the top-down impact is significantly stronger, meaning that, for example, a change in beliefs and values impacts behaviour, and partially environment, but has a lesser impact on identity and purpose. Questions can be adapted to each level, intended to influence a person to make changes. Typical questions for the individual levels are:

  • Environment—“Where?” “When?”

  • Behaviour—“What?”

  • Capabilities—“How?”

  • Beliefs and values—“Why?”

  • Identity—“Who?”

  • Purpose—“For whom?”

Owing to these questions, the Dilts Pyramid is presented as a coaching tool (Dilts, 2003).

In assessing this theoretical proposition, first and foremost, we should point out the highly hypothetical explanation given at the physiological level. While the lower levels of the pyramid have an obviously neurophysiological basis, the higher ones, particularly that of purpose, are purely the author’s speculation. The pyramid itself is one manner of ordering a person’s experiences, and can be used in coaching activities, particularly life-coaching. Whether the model is accurate from a theoretical perspective should be determined via empirical study. Unfortunately, databases of scientific papers do not contain any articles on the Dilts Pyramid. As in the case of metaprograms, the Dilts Pyramid is an untested alternative conception in relation to scientific psychology.

NLP—evidence-based consistent framework or colourful marketing packet?

Empirical analysis of the primary assumptions underlying NLP demonstrates that they have no basis in fact. Theories about the existence of systems of representation and the possibility to discover them through analysis of EMs have not found confirmation in psychological studies. Other elements constituting the content of NLP courses, such as presuppositions, metamodel, anchors, metaprograms, and the Dilts Pyramid are either adapted scientific conceptions, or—more frequently—an idea without confirmation in systematic scientific studies. The same is true of other methods not discussed here, such as timelines, the Milton model, or reframing. Each of them features a mix of scientific and subjective content, and at times the weird ideas of authors and practitioners. NLP thus does not constitute a cohesive theory in which fundamental and verified assumptions lead to practical tips for users. It is rather a group of diverse and interesting-looking set of tools based on the subjective experience of users and dressed up in marketing mumbo jumbo. From the perspective of the evidence-based approach, we are looking at a less-than-credible proposition. The question thus arises: where does the popularity of this phenomenon come from?

First, NLP employs language that is attractive for the reader and the participant of development programmes. The term “neurolinguistic programming” suggest a strong grounding in neurobiology and linguistics. From the scientific perspective, all human actions are based in the activity of the nervous system, and are thus neuro. In this respect, NLP is no different from learning a foreign language, dance, eating with chopsticks, or any other activity. Placing the word “neuro” in the name gives it the veneer of science. Apart from the vague, and at times non-scientific considerations of Dilts about the foundation of his pyramid (see the section on the Dilts Pyramid), the creators of NLP do not address the activity of the human nervous system. Things are slightly different with the term “linguistic.” Indeed, NLP tools directly refer to language, and some of them (metamodel, presupposition) are associated with the science of linguistics or psycholinguistics. In turn, the word “programming” is clearly overused. NLP practitioners talk about programming the mind, which in the best case is simply exerting influence, frequently to dubious effect.

The second cause of the popularity of NLP is the promise of quick and spectacular effects. At NLP courses, and particularly in short films on the internet, we are told we will cope with negative emotions, achieve our goals, have better relations with people, get rid of our fears and other psychological problems, and generally attain a higher quality of life. The effectiveness of NLP techniques is promoted primarily by its practitioners and advocates. However, there is precious little by way of documented studies. An exception is one meta-analysis on the application of NLP techniques in psychotherapy (Zaharia et al., 2015).

The third cause is linked to the “discovery” of the secrets of the mind, hidden to the mere mortal human. For example, observing the movements of eyes, one can, according to Grinder and Bandler, understand whether a given situation is recalled or constructed. If constructed, this can mean that someone is lying. The promise of recognition of lies through observation of eyeball movements is exceptionally attractive.

All of these factors contribute to the popularity of NLP. However, from the scientific perspective, we are dealing with a well-promoted set of techniques which come in small part from science, and their remainder has either not been verified at all, or the results have come back negative.

NLP—a practical guide for users

As we wrote in the introduction, the essence of evidence-based practices is the search for not just any evidence, but the best available evidence. In this chapter we have presented the evidence available on both the fundamental theoretical assumptions of NLP and the effectiveness of methods applied, as well as those concerning particular techniques. The majority of available evidence from higher levels of the hierarchy indicates that both the assumptions of NLP and the methods and techniques applied within the approach find no confirmation in empirical science. In opposition to the evidence we have presented is evidence located lower in the hierarchy, that is, subjective experiences of particular practitioners of NLP. At the same time, qualitative analysis of NLP techniques indicates that there are more cohesive and tested methods we may draw on science for.

Managers and engineers seeking to retain an evidence-based approach in working with people, during training exercises, or as part of self-development initiatives should rather look to methods whose effectiveness has been confirmed in multiple studies. This will save them time, as well as provide them with greater effectiveness and coherence in their undertakings.

Some common characteristics of pseudoscientific approaches, which we consider NLP to be, allow practitioners to effectively identify them, and facilitate selecting the most effective. Pseudoscientific methods based on evidence low in the hierarchy or simply without any evidence in support most frequently:

  1. promise rapid effects incongruent with those which are presently applied broadly;

  2. are very frequently characterised as breakthrough methods in a given field of knowledge;

  3. develop primarily outside of mainstream research in a given field, because science rather quickly establishes their usefulness and rejects them as unpromising;

  4. explain the reluctance of scientists to engage them in terms of threat, conservatism, and the absence of sufficient competence to assess “innovative” methods;

  5. as opposed to science, frequently have little or no roots in the past, which is visible in the lack of bibliographies in papers by their proponents;

  6. create an internal jargon that is frequently incomprehensible for outsiders;

  7. create (usually at a cost) systems for education and certification, and their methods are frequently subject to copyrights, patents, and trademarks.

The greater the number of these traits characterise the present approach on the market to trainings, the higher the probability that we are dealing with pseudoscience packed in a colourful, shiny box whose contents will not live up to the promises of its marketing.

References

  1. Baddeley, M. (1989). Neurolinguistic programming: The academic verdict so far. Australian Journal of Clinical Hypnotherapy and Hypnosis, 10, 73–81.

  2. Bandler, R., & Grinder, J. (1979). Frogs into princes, Moab, UT: Real People Press.

  3. Bateson, G. (1979). Mind and nature: A necessary unity (advances in systems theory, complexity, and the human sciences). Cresskill, NJ: Hampton Press.

  4. Baumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D. (2001). Bad is stronger than good. Review of General Psychology, 5, 323–370.

  5. Beyerstein, B. L. (2001). Fringe psychotherapies: The public at risk. The Scientific Review of Alternative Medicine, 5, 70–79.

  6. Brown, N. (2004). What makes a good educator? The relevance of meta programmes. Assessment & Evaluation in Higher Education, 29, 515–533.

  7. Cialdini, R. B. (1980). Full-cycle social psychology. Applied Social Psychology Annual, 1, 21–47.

  8. Devilly, G. J. (2005). Power therapies and possible threats to the science of psychology and psychiatry. Australian and New Zealand Journal of Psychiatry, 39, 437–445.

  9. Dilts, R. (1983). Roots of neurolinguistic programming. Capitola, CA: Meta Publications.

  10. Dilts, R. (1998). Modeling with NLP. Capitola, CA: Meta Publications.

  11. Dilts, R. (2003). From coach to Awakener. Capitola, CA Meta Publications.

  12. Dorn, F. J., Brunson, B. I., Bradfor, I., & Atwater, M. (1983). Assessment of primary representational systems with neurolinguistic programming: Examination of preliminary literature. American Mental Health Counselors Association Journal, 5, 161–168.

  13. Einspruch, E. L., & Forman, B. D. (1988). Neurolinguistic Programming in the treatment of phobias. Psychotherapy in Private Practice, 6, 91–100.

  14. Grinder, J., & Bandler, R. (1976). The structure of magic II. Palo Alto, CA: Science and Behavior Books.

  15. Grinder, J., & Bandler, R. (1981). Transe-formations: Neuro-linguistic ProgrammingTM and the structure of hypnosis. Moab, UT: Real People Press.

  16. Heap, M. (1988). Neurolinguistic programming: An interim verdict. In M. Heap (Ed.), Hypnosis: Current clinical, experimental and forensic practices (pp. 268–280). London, UK: Croom Helm.

  17. Heap, M. (2008). The validity of some early claims of neurolinguistic programming. Skeptical Intelligencer, 11, 1–8.

  18. Hoag, J. D. (2018). NLP meta programs [Blog post]. Retrieved from http://nlpls.com/articles/metaPrograms.php

  19. Horn, L. R. (1996). Presupposition and implicature. In S. Lappin (Ed.), The handbook of contemporary semantic theory (pp. 299–320). Blackwell Handbooks in Linguistics. Oxford: Blackwell.

  20. Korzybski, A. (1933). A non-Aristotelian system and its necessity for rigour in mathematics and physics. In: Science and Sanity: An introduction to non-Aristotelian systems and general semantics (pp. 747–761). Lakeville, CT: International Non-aristotelian Library Publishing Co. www.bibsonomy.org/bibtex/1d8845e1a33fdcf1c6f18b1cb2d37c0c1/voj

  21. Krugman, M., Kirsch, I., Wickless, C., Milling, L., Golicz, H., & Toth, A. (1985). Neuro-Linguistic Programming treatment for anxiety: Magic or myth? Journal of Consulting and Clinical Psychology, 53, 526–530.

  22. Lankton, S. (1980). Practical magic, Cupertino, CA: Meta Publications.

  23. Methods of neuro-linguistic programming. (n.d.). In Wikipedia. Retrieved October 20, 2018, from https://en.wikipedia.org/wiki/Methods_of_neuro-linguistic_programming

  24. Moore, W. J., Manning, S. A., & Smith, W. I. (1978). Conditioning and instrumental learning. New York, NY: McGraw-Hill Book Company, pp. 52–61.

  25. Newbrook, M. (2008). Linguistic aspects of “Neurolinguistic programming”. Skeptical Intelligencer, 11, 27–29.

  26. Ng, C., & Benedetto, U. (2016). Evidence hierarchy. In G. Biondi-Zoccai & G. Biondi-Zoccai (Eds.), Umbrella reviews: Evidence synthesis with overviews of reviews and meta-epidemiologic studies (pp. 11–19). Cham, Switzerland: Springer International Publishing.

  27. Norcross, J. C., Koocher, G. P., & Garofalo, A. (2006). Discredited psychological treatments and tests: A Delphi Poll. Professional Psychology: Research and Practice Copyright, 37, 515–522.

  28. O’Connor, J., & Seymour, J. (1993). Introducing neuro-linguistic programming: Psychological skills for understanding and influencing people. London, UK: Thorsons.

  29. Page, S., & Meerabeau, L. (2004). Hierarchies of evidence and hierarchies of education: Reflections on a multiprofessional education initiative. Learning In Health & Social Care, 3(3), 118–128. doi:10.1111/j.1473–6861.2004.00070.x

  30. Petrisor, B.A, & Bhandari, M. (2007). The hierarchy of evidence: Levels and grades of recommendation. Indian Journal of Orthopaedic, 41(1), 11–15.

  31. Roderique-Davies, G. (2009). Neuro-linguistic programming: Cargo cult psychology? Journal of Applied Research in Higher Education, 1, 57–63.

  32. Sharpley, C. F. (1984). Predicate matching in NLP: A review of research on the preferred representational system. Journal of Counseling Psychology, 31, 238–248.

  33. Sharpley, C. F. (1987). Research findings on neurolinguistic programming: Nonsupportive data or untestable theory? Journal of Counseling Psychology, 34, 103–107.

  34. Sturt, J., Ali, S., Robertson, W., Metcalfe, D., Grove, A., Bourne, C., & Bridle, C. (2012). Neurolinguistic programming: A systematic review of the effects on health outcomes. The British Journal of General Practice, 62(604), e757–e764. doi:10.3399/bjgp12X658287

  35. Swets, J. A., & Bjork, R. A. (1990). Enhancing human performance: An evaluation of “New Age” techniques considered by the U.S. army. Psychological Science, 1, 85–86.

  36. Vaknin, S. (2010). The Big Book of NLP, Expanded: 350+ techniques, patterns & strategies of neuro linguistic programming. Inner Patch Publishing.

  37. Von Bergen, C. W., Soper, B., Rosenthal, L. V., & Wilkinson, L. V. (1997). Selected alternative training techniques in HRD. Human Resource Development Quarterly, 8, 281–294.

  38. Witkowski, T. (2010). Thirty-five years of research on neuro-linguistic programming. NLP research data base. State of the art or pseudoscientific decoration? Polish Psychological Bulletin, 41(2), 58–66.

  39. Witkowski, T. (2012). A review of research findings on neuro-linguistic programming. The Scientific Review of Mental Health Practice, 9(1), 29–40.

  40. Zaharia, C., Reiner, M., & Schütz, P. (2015). Evidence-based neuro linguistic psychotherapy: A meta-analysis. Psychiatria Danubina, 27(4), 355–363.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset