<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJMP</journal-id><journal-title-group><journal-title>Open Journal of Medical Psychology</journal-title></journal-title-group><issn pub-type="epub">2165-9370</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojmp.2017.63015</article-id><article-id pub-id-type="publisher-id">OJMP-76789</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Medicine&amp;Healthcare</subject></subj-group></article-categories><title-group><article-title>
 
 
  Attitudes to Group Assessments: Prospective Psychotherapists’ Experiences of Being Assessed by Fellow Students
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Anette</surname><given-names>Jervelycke</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Billy</surname><given-names>Larsson</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Torsten</surname><given-names>Norlander</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref><xref ref-type="corresp" rid="cor1"><sup>*</sup></xref></contrib></contrib-group><aff id="aff2"><addr-line>Department of Clinical Neuroscience, Karolinska Institute, Solna, Sweden</addr-line></aff><aff id="aff1"><addr-line>Center for Research and Development, Evidens University College, G&amp;amp;#246teborg, Sweden</addr-line></aff><author-notes><corresp id="cor1">* E-mail:<email>torsten.norlander@ki.se(TN)</email>;</corresp></author-notes><pub-date pub-type="epub"><day>09</day><month>06</month><year>2017</year></pub-date><volume>06</volume><issue>03</issue><fpage>179</fpage><lpage>196</lpage><history><date date-type="received"><day>April</day>	<month>3,</month>	<year>2017</year></date><date date-type="rev-recd"><day>Accepted:</day>	<month>June</month>	<year>6,</year>	</date><date date-type="accepted"><day>June</day>	<month>9,</month>	<year>2017</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Background: The guidance of prospective therapists focused on Cognitive Behavioral Therapy (CBT) is most often made by groups of four students. However, learning therapist skills is a sensitive process that will be affected by the processes which occur within the group. 
  Objective: The aim was to examine prospective psychotherapists’ attitudes to group assessments based on the revised version of the Cognitive Therapy Scale (CTS-R). 
  Method: Participants were 56 students with an average age of 45.65 years (
  <em>range</em> = 31 - 64). They were recruited from psychotherapy training at the Gothenburg University and the Evidens University College in Sweden. A questionnaire was constructed in which the questions were answered by check on visual analogue scales (VAS). 
  Results: A majority of students consisting of 38 participants (68%) had a very positive approach to group assessments, while a minority of 18 participants (32%) was more negative. Most crucial for how to answer the question of group assessments was whether they considered themselves as fairly evaluated by their student colleagues within the group and whether or not only the supervisor should make the assessments. The view of group assessments (negative or positive) was not related to age, gender, and level of education in CBT or profession. In addition, both groups had a very positive view of both the CTS-R and the supervisors. Conclusion: It was concluded that more studies with the same focus are needed to determine the extent to which the results are generalizable.
 
</p></abstract><kwd-group><kwd>CBT Competences</kwd><kwd> CTS-R</kwd><kwd> Evaluation Process</kwd><kwd> Group Assessments</kwd><kwd> Prospective Psychotherapists</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The World Health Organization has estimated that about 450 million people worldwide suffer from mental illness and that most of the mentally ill do not get the help and treatment they need [<xref ref-type="bibr" rid="scirp.76789-ref1">1</xref>] . In the West, an estimated 50 percent of those in need have no access to necessary assistance and in developing countries, the figure is 80 percent. Even in a welfare state such as Sweden, public health is a matter of concern due to the increase of mental diagnoses [<xref ref-type="bibr" rid="scirp.76789-ref2">2</xref>] . Stress, anxiety and depression are all substantially increasing and those accounted for the highest number of mental illness are people working in the field of health care, but sick leave is substantially increasing within almost all occupations. In addition, mental diagnoses are also increasing within vulnerable groups such as young women (anxiety and depression), young men (neuropsychiatric diagnoses) and migrants (anxiety, depression and post-traumatic stress).</p><p>Against this background, it becomes obvious that our societies are facing growing challenges and due to the fact that CBT treatments have strong research support and have been proven cost-effective [<xref ref-type="bibr" rid="scirp.76789-ref3">3</xref>] , the demand for these treatments increases [<xref ref-type="bibr" rid="scirp.76789-ref4">4</xref>] . The growing complexity of the mental illness in combination with a growing numbers of new treatment models in CBT [<xref ref-type="bibr" rid="scirp.76789-ref5">5</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref6">6</xref>] now sets a stronger demand also on therapists and trainers. There is now a need for therapists with a deep knowledge in general CBT skills, who also have a good overview on new methods and models. Training therapists is a complicated matter. Besides, being both time and resource intensive for students as well as for educators, the scientific evidence for this task is very limited [<xref ref-type="bibr" rid="scirp.76789-ref7">7</xref>] . The extensive research concerning treatments has not yet provided sufficient evidence and guidelines concerning therapist training [<xref ref-type="bibr" rid="scirp.76789-ref4">4</xref>] . Further there is even less scientific evidence for how these skills and abilities should be operationalized, learned, evaluated and assessed [<xref ref-type="bibr" rid="scirp.76789-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref9">9</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref10">10</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref11">11</xref>] . Bandura [<xref ref-type="bibr" rid="scirp.76789-ref12">12</xref>] argued that psychotherapy is a learning process and, therefore, greater effort should be made to develop treatment methods derived from knowledge of learning and motivation. A central component in Bandura’s social learning theory [<xref ref-type="bibr" rid="scirp.76789-ref13">13</xref>] illustrates the importance of observing and modeling behaviors and a recent study [<xref ref-type="bibr" rid="scirp.76789-ref14">14</xref>] , where 2607 US and Canadian psychotherapists participated, indicates that they largely learned from supervisors and colleagues as it seemed imitated their behavior.</p><p>Although the therapist profession requires extensive theoretical knowledge, the work is largely practical. An important part of the training is therefore to stress that theoretical knowledge must be put into practice, so that students acquire the skills and abilities needed to assess an individual patient’s needs and to select and implement appropriate treatments [<xref ref-type="bibr" rid="scirp.76789-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref10">10</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref15">15</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref16">16</xref>] . Education and training in those moments occur mainly in the tutorial course, where the prospective therapists carry out treatments under the guidance of trained CBT supervisors. According to an extensive survey [<xref ref-type="bibr" rid="scirp.76789-ref4">4</xref>] , research on guiding and supervision of prospective CBT therapists is scarce in literature. However, psychotherapy research has gathered a lot of knowledge about “what works” and “what needs to be done” in treatment [<xref ref-type="bibr" rid="scirp.76789-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref18">18</xref>] . This knowledge has been systematized in manuals and gradually has also instruments assessing fidelity to the manuals been constructed. A continuous effort to systematize and describe the competence, therapists needs for carrying out different treatments has been made over the years. One of the more ambitious attempts in this endeavor has been made under the IAPT project (Improving Access to Psychological Therapies) of scientists and clinicians in the United Kingdom [<xref ref-type="bibr" rid="scirp.76789-ref19">19</xref>] . In this project general therapist competence, CBT specific competence, and diagnosis specific competence have been defined and described. Further research has also examined the relationship between therapists’ behaviors and treatment outcomes [<xref ref-type="bibr" rid="scirp.76789-ref9">9</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref20">20</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref21">21</xref>] , but it has not yet been possible to draw any clear conclusions from those studies.</p><p>How therapeutic skills should be taught is a question that has interested several clinicians and researchers. Padesky [<xref ref-type="bibr" rid="scirp.76789-ref22">22</xref>] as well as Liese and Beck [<xref ref-type="bibr" rid="scirp.76789-ref23">23</xref>] used therapy models as a base for supervision, which is now a common practice ineducational supervision [<xref ref-type="bibr" rid="scirp.76789-ref10">10</xref>] . Bennett-Levy [<xref ref-type="bibr" rid="scirp.76789-ref24">24</xref>] has also made an ambitious attempt to define and describe the knowledge systems used for learning. His model assumes that the learning skills of the therapist are enhanced by declarative as well as procedural and reflexive processes. Declarative processes include conceptual knowledge such as theory and technology and also knowledge of interpersonal functioning, while procedural processes concern interpersonal and technical skills, frameworks, attitudes, as well as rules, plans and procedures. Reflexive processes concern the ability to relate in a curious and reflective way to oneself and to the environment. Bennett-Levy and associates [<xref ref-type="bibr" rid="scirp.76789-ref8">8</xref>] have also evaluated which methods and tools that are most effective for each learning process. This knowledge may now help to strengthen and streamline the learning process in terms of therapist skills, but it should be noted that so far only a few studies examine strategies leading to increased competence [<xref ref-type="bibr" rid="scirp.76789-ref25">25</xref>] . Other and more general models used in supervision are concerned with the role of experience [<xref ref-type="bibr" rid="scirp.76789-ref26">26</xref>] or interactions between learning and development [<xref ref-type="bibr" rid="scirp.76789-ref27">27</xref>] . For the time being there is no generally accepted learning model available [<xref ref-type="bibr" rid="scirp.76789-ref25">25</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref28">28</xref>] , nor any generally accepted models for feedback and assessment of achieved skills [<xref ref-type="bibr" rid="scirp.76789-ref7">7</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref11">11</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref29">29</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref30">30</xref>] . However, it is considered important that tutoring sessions are well prepared and have an agenda [<xref ref-type="bibr" rid="scirp.76789-ref31">31</xref>] .</p><p>A common practice at several educational institutions is the use of rating scales for feedback and for assessing student therapist skills. There are currently a number of tried and tested assessment tools available. One of the earliest developed assessment tools was the Cognitive Therapy Scale (CTS) developed by Beck and Young [<xref ref-type="bibr" rid="scirp.76789-ref32">32</xref>] . The scale measures adherence and competence and have been widely used in psychotherapy research and is considered to have acceptable psychometric properties [<xref ref-type="bibr" rid="scirp.76789-ref33">33</xref>] . A number of other scales reminiscent of the CTS have been developed, as Safran’s Therapy Adherence Scale (STAS) [<xref ref-type="bibr" rid="scirp.76789-ref34">34</xref>] , Cognitive Therapy Adherence and Competence Scale (CTACS) [<xref ref-type="bibr" rid="scirp.76789-ref35">35</xref>] , Assessment of Core CBT Skills (ACCS) [<xref ref-type="bibr" rid="scirp.76789-ref36">36</xref>] , Supervisor Rating Form (SRF) [<xref ref-type="bibr" rid="scirp.76789-ref37">37</xref>] , the Collaborative Case Conceptualization Rating Scale (CCCRS) [<xref ref-type="bibr" rid="scirp.76789-ref38">38</xref>] , and the UCL scale of Structured Observation (USO) [<xref ref-type="bibr" rid="scirp.76789-ref39">39</xref>] .</p><p>The above mentioned scales are often extensive and thus time-consuming for both students and supervisors to learn and to administer which is somewhat of an obstacle when time and resources for guidance are limited. An attempt to improve the efficiency of the original CTS-scale has been made by Blackburn and others, resulting in the CTS-R, Cognitive Therapy Scale, revised version [<xref ref-type="bibr" rid="scirp.76789-ref40">40</xref>] . In the revised version overlapping material from the original CTS has been reduced and furthermore the Dreyfuss learning model [<xref ref-type="bibr" rid="scirp.76789-ref41">41</xref>] was incorporated. This model suggests that adult learning develops in phases. Achieved knowledge is defined by six categories: 1) incompetent, 2) novice, 3) advanced beginner, (d) competent, 4) proficient and 5) expert. CTS-R consists of a total of twelve items tapping different CBT skills. The rating scales run0-6 where adherence and competence are weighed in together. CTS-R has been widely used in research concerning supervising. The scale is considered to have a certain bias toward cognitive dimensions, but the benefits are that it is less time consuming to learn and easier to administer, which enables repeated assessments. In addition, the manual includes [<xref ref-type="bibr" rid="scirp.76789-ref40">40</xref>] detailed descriptions of the scale points for each question and there is also an associated “good-practice guide” with concrete examples. CTS-R is now thoroughly explored in terms of validity and reliability. It is also translated and evaluated in Sweden [<xref ref-type="bibr" rid="scirp.76789-ref42">42</xref>] .</p><p>The most common model for tutoring is that students are supervised in groups of four [<xref ref-type="bibr" rid="scirp.76789-ref4">4</xref>] . According to Kuechler [<xref ref-type="bibr" rid="scirp.76789-ref43">43</xref>] there are many benefits from group tutoring for both supervisors and participants. The benefit for participants may be that a safe base is created with access to mentoring which facilitates reflection and development of a professional identity. Further, group supervision provide good conditions for teaching and learning because students can follow not only their own therapies but also those performed by the colleagues and feedback is given from both colleagues and supervisors [<xref ref-type="bibr" rid="scirp.76789-ref10">10</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref44">44</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref45">45</xref>] . Learning of therapist skills is a sensitive process that can be disturbed if the groups do not work well enough. Group processes consist of factors that are unique to the group environment, which leads to changes in the group and thus affect the group’s functioning [<xref ref-type="bibr" rid="scirp.76789-ref43">43</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref44">44</xref>] . It may for example include individual events, the participants’ personal style, difficulties in therapy sessions, interactions between participants and the alliance between supervisors and participants. Examples of problematic behaviors of individual team members that may affect the group negatively are participants who constantly take up too much space, are constantly critical or silent, seems bored or find it difficult to accept help. There are also supervisor behaviors that are considered to contribute to the negative group processes [<xref ref-type="bibr" rid="scirp.76789-ref25">25</xref>] . Supervisor styles that are too lenient or too authoritarian are described by students as sources of dissatisfaction. In order to create good conditions for learning, the supervisor must establish and maintain a good alliance and observe, assess, support and give constructive feedback. The existence of a good alliance between supervisor and students is described as one of the most important factors that secure cooperation in the group. Students also highlight the importance a goal-oriented behavior from the supervisor as well as a non- judgmental approach towards participants [<xref ref-type="bibr" rid="scirp.76789-ref25">25</xref>] . However, it was not possible to find previous performed studies that analyzed the underlying factors for prospective psychotherapists’ attitudes to group assessments based on the CTS-R.</p><p>Most institutions that trains psychotherapists in CBT uses some form of rating scale of the type already discussed above as a basis for learning and evaluation [<xref ref-type="bibr" rid="scirp.76789-ref42">42</xref>] . The rating scale is introduced early in the training and the aim is that the students should have a scientifically evaluated instrument as the basis for the learning process. Using the rating scale, different therapist skills can be described, practiced, evaluated, and assessed during on-going tutoring. Students are continually assessed and receive frequent feedback from both supervisor and colleague students. As previously noted, occasionally difficulties occur. Sometimes the learning process is hampered when a group develops a destructive way to provide feedback or by participants who become overly cautious or idealizing in their feedbacks. Typically, these situations can be used to strengthen the process and bring about constructive, investigative and reflective discussions. Parallels may also be drawn to difficulties experienced in the treatment process. The aim of the current study was to examine prospective psychotherapists’ attitudes to group assessments based on the revised version of the Cognitive Therapy Scale (CTS-R).</p></sec><sec id="s2"><title>2. Methods</title><sec id="s2_1"><title>2.1. Participants</title><p>Participants were 56 prospective therapists specializing in CBT (7 men, 48 women, and one without data) with an average age of 45.65 years (SD = 7.78, range = 31 to 64). Of the participants 19 individuals attended the basic training in CBT, and 36 individuals attended the psychotherapist program of CBT. The study took place in 2016 and the students were recruited from two educational institutions in Gothenburg, Sweden. The basic training was an undergraduate course of three semesters focused on basic CBT-knowledge in theory and practice, while the psychotherapist program consisted of six semesters which gave full jurisdiction as a licensed therapist. The participants were either in ongoing programs or had just received their diplomas. The basic professional affiliations of the participants allocated as follows: psychologists (15 persons), social workers (17 persons), and other health care staff (24 persons). In light of the purpose of the study, participants were divided in two groups after a specific procedure (see section Data Processing) based on whether or not they perceived it as a good idea to be assessed by their fellow students in the tutoring group. There were 18 participants who experienced this as less good (Negative) and 38 as very good (Positive). Analysis (Chi-Square, 5% level) showed no significant relations (ps &gt; 0.05) between attitudes to group assessment (negative or positive) in terms of gender, level of education in CBT or profession. An Independent Samples t-test (5% level) showed no age difference regarding attitudes to group assessment (p &gt; 0.05).</p></sec><sec id="s2_2"><title>2.2. Instruments</title><p>Questions about the CTS-R and group assessments. A questionnaire was constructed to investigate students’ attitudes to the CTS-R and group assessments. The 36 questions were answered by check marks on Visual Analogue Scales, each with a length of one decimeter (about four inches) which envisioned the scale from 0 to 100. As “anchor points” clearly articulated response alternatives were used such as “not at all-in the highest degree” and “significantly reduced-significantly increased” The questions are presented in <xref ref-type="table" rid="table1">Table 1</xref>.</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> The 36 items in the survey “Questions about the CTS-R and group assessments”</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >1. To what extent are you familiar with the scale?</th></tr></thead><tr><td align="center" valign="middle" >2. To what extent do you think the scale is relevant for describing the practical skills of therapists?</td></tr><tr><td align="center" valign="middle" >3. To what extent do you think the scale is relevant for assessing the practical skills of therapists?</td></tr><tr><td align="center" valign="middle" >4. To what extent have you experienced the assessment sessions as helpful for your learning process?</td></tr><tr><td align="center" valign="middle" >5. To what extent has your self-esteem/self-confidence been affected by the evaluations in the group?</td></tr><tr><td align="center" valign="middle" >6. To what extent has your own learning been affected by estimating your colleagues therapist skills in the group?</td></tr><tr><td align="center" valign="middle" >7. To what extent has your learning been affected by getting your colleagues’ views/evaluations?</td></tr><tr><td align="center" valign="middle" >8. To what extent has your self-esteem/self-confidence been affected by getting your colleagues’ views/evaluations?</td></tr><tr><td align="center" valign="middle" >9. To what extent has your learning been affected by getting your supervisor’s views/evaluations?</td></tr><tr><td align="center" valign="middle" >10. To what extent has your self-esteem/self-confidence been affected by getting your supervisors’ views/evaluations?</td></tr><tr><td align="center" valign="middle" >11. To what extent has the group participants’ learning been affected by group assessments of therapist skills?</td></tr><tr><td align="center" valign="middle" >12. To what extent has the social climate of the group been affected by group assessments?</td></tr><tr><td align="center" valign="middle" >13. To what extent have you during assessment sessions been honest when evaluating yourself?</td></tr><tr><td align="center" valign="middle" >14. If you have not been completely honest, have you under- or overestimated yourself?</td></tr><tr><td align="center" valign="middle" >15. To what extent have you during assessment sessions been honest when evaluating your colleagues?</td></tr><tr><td align="center" valign="middle" >16. If you have not been completely honest, have you under- or overestimated your colleagues?</td></tr><tr><td align="center" valign="middle" >17. To what extent do you think that your colleagues have been honest in their evaluations of you?</td></tr><tr><td align="center" valign="middle" >18. If you think they have not been completely honest, have they then under- or overestimated you?</td></tr><tr><td align="center" valign="middle" >19. To what extent do you think that your supervisor has been honest in his/her evaluation of you?</td></tr><tr><td align="center" valign="middle" >20. If you think that your supervisor has not been completely honest, has he/she then under- or overestimated you?</td></tr><tr><td align="center" valign="middle" >21. To what extent do you think that you have been fairly assessed by your colleagues?</td></tr><tr><td align="center" valign="middle" >22. If you do not feel you have been fairly assessed, to what extent do you think the climate in the group affected the evaluation?</td></tr><tr><td align="center" valign="middle" >23. To what extent do you think that you have been fairly evaluated by your supervisor?</td></tr><tr><td align="center" valign="middle" >24. To what extent have you been able to express your own views to your colleagues if you perceived yourself as unfairly evaluated?</td></tr><tr><td align="center" valign="middle" >25. To what extent have your colleagues listen to your comments when you perceived yourself as unfairly assessed?</td></tr><tr><td align="center" valign="middle" >26. To what extent were you able to express your own views to your supervisor if you perceived yourself as unfairly assessed?</td></tr><tr><td align="center" valign="middle" >27. To what extent have your supervisor listen to your comments when you perceived yourself as unfairly assessed?</td></tr><tr><td align="center" valign="middle" >28. What benefits do you think you have had from the CTS-R scale regarding your own learning process?</td></tr><tr><td align="center" valign="middle" >29. What benefits have you had from your colleagues’ opinions and evaluations regarding your own learning process?</td></tr><tr><td align="center" valign="middle" >30. What benefit have you had from your supervisors’ opinions and evaluations regarding your own learning process?</td></tr><tr><td align="center" valign="middle" >31. How satisfied are you with the education as a whole?</td></tr><tr><td align="center" valign="middle" >32. To what extent do you think the CTS-R is a valuable tool for learning therapist skills?</td></tr><tr><td align="center" valign="middle" >33. To what extent do you think the CTS-R is a valuable tool for evaluating therapist skills?</td></tr><tr><td align="center" valign="middle" >34. To what extent is your view on the CTS-R scale influenced by how you perceive your supervisor?</td></tr><tr><td align="center" valign="middle" >35. To what extent do you think it is a good idea with group assessments?</td></tr><tr><td align="center" valign="middle" >36. To what extent had it been better to be individually assessed only by the supervisor?</td></tr></tbody></table></table-wrap><p>There were three questions about the perception of the CTS-R as a rating scale to describe and assess therapist skills. These questions concerned the extent to which the students were familiar with the CTS-scale and whether they considered it appropriate to describe and assess therapist skills. Further questions were asked about the usefulness of the CTS-R for the students own learning processes, and how they valued the CTS-R as an instrument. Other questions aimed to investigate the students’ experiences and attitudes to group assessments. These questions concerned the extent to which they perceived group evaluations as helpful for their own learning process, and whether or not their own learning and self-esteem were affected by the assessments, as well if they felt that the group participants learning was affected. The study’s main question (To what extent do you think it is a good idea with group assessments?) was embedded as the penultimate item in the survey, followed by a control question as to whether they thought it was better to be individually assessed with only the supervisor. Thereafter an open question followed that gave students the opportunity to comment on their answers. The homogeneity of the instrument was tested by Cronbach’s Alpha which gave a high value (alpha = 0.92).</p><p>Background data. The distributed questionnaire also included demographic data on level of education in CBT, profession, gender, and age.</p></sec><sec id="s2_3"><title>2.3. Procedure</title><p>In order to recruit participants for the study two institutions which train therapists in CBT was approached, namely the Department of Psychology at Gothenburg University and the Evidens University College. These accepted participation and provided addresses to students. The questionnaire, a cover letter, as well as an addressed and stamped envelope for returning were sent to a total of 100 students who attended undergraduate courses in CBT or the therapist program. The cover letter described the study’s purpose and scope, and also gave the information that participation was voluntary and anonymous. The questionnaire was thus answered anonymous and responses were sent directly to one of the authors. Of the 100 sent out questionnaires 56 responses were obtained.</p></sec><sec id="s2_4"><title>2.4. Data Processing</title><p>Descriptive analysis of the distribution of participants’ responses to the question “To what extents do you think it is a good idea with group assessments?” (M = 67.09, SD = 28.00) indicated a natural division (cut point = 64), where participants could be identified who had a very positive view of group assessments (Positive) including a high mean value and a low standard deviation (n = 38, M = 83.29, SD = 9.66) compared to participants (Negative) who experienced assessments from fellow students as less good (n = 18, M = 32.88, SD = 22.55). This categorization was to form the independent variable in comparisons (Attitudes to group assessment), while the original not categorized item was used in correlation and regression analyzes.</p></sec><sec id="s2_5"><title>2.5. Ethical Considerations</title><p>This study followed the ethical standards of the World Medical Association declaration of Helsinki concerning Ethical Principles of Medical Research Involving Human Subjects. The data were collected by a psychologist (first author) as a preparation for a thesis in order to become a qualified specialist in clinical psychology. In addition the questionnaire was answered anonymous and responses were sent directly to the first author. Given these conditions, in accordance with the Swedish rules on ethics, the material contained in the report can be used to compile an article.</p></sec></sec><sec id="s3"><title>3. Results</title><sec id="s3_1"><title>3.1. Comparisons between Groups</title><p>Attitudes to group assessment. Statistical testing (Levene’s Test of Equality of Error variances, 5% level) showed that conditions for multivariate analysis of variance did not exist in comparisons between the independent variable groups for about half of the included items why it was decided to instead use Independent Samples t-tests with correction for inconsistency (equal variances not assumed). Independent variable was the categorized variable Attitudes to group assessment (negative, positive) and dependent variables were the visual analog scales with the exception of item 35 which was the basis for the independent variable. The statistical analyzes yielded significant effects (ps &lt; 0.05) for items with the following numbers: 4, 5, 6, 7, 8, 11, 12, 21, 22, 24, 28, 29, 32, 33, and 36. For means, standard deviations and statistical coefficients at the significant comparisons see <xref ref-type="table" rid="table2">Table 2</xref>.</p><p>Gender. Statistical analysis (Mann-Whitney U-test, 5% level) with all 36 items as dependent variables showed significant differences in regard to Gender for only four items: item 14 [z = −2.22, p = 0.025; Men (M = 47.86, SD = 12.42), Women (M = 35.69, SD = 9.78)], item 17 [z = −2.01, p = 0.043; Men (M = 78.29, SD = 18.16), Women (M = 65.75, SD = 17.96)], item 18 [z = −3.40, p &lt; 0.001; Men (M = 46.57, SD = 9.03), Women (M = 64.02, SD = 11.50)], and item 34 [z = −2.06, p = 0.037; Men (M = 70.86, SD = 16.81), Women (M = 44.55, SD = 31.39)].</p><p>Level of education in CBT. Further analysis using the Mann-Whitney U test (5 % level) with all 36 questions as dependent variables and the two levels of education as independent variable showed no significant differences in terms of educational attainment (ps &gt; 0.05).</p><p>Profession. Statistical analysis (Kruskal-Wallis, 5% level) with all 36 questions as dependent variables and the tree categories of profession as independent variable revealed significant effects concerning items 1, 9, 10, 24, 30, and 31 (ps &lt; 0.05). Multiple comparisons according to Kruskal-Wallis indicated that the psychologists had responded with significantly lower scores on the six items as compared to the other two occupational groups, while the social workers gave significantly the highest score on four of the scales (1, 10, 30, 31) and persons belonging to the category “other health care staff” gave significantly the highest</p><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Means (M) and standard deviations (SD) for items in the survey in regard to attitudes to group assessment (Negative, Positive), coefficients for significant results (t, df, p), and all participants (All)</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  ></th><th align="center" valign="middle"  colspan="2"  >Negative</th><th align="center" valign="middle"  colspan="2"  >Positive</th><th align="center" valign="middle"  colspan="3"  >Coefficients</th><th align="center" valign="middle"  colspan="2"  >All</th></tr></thead><tr><td align="center" valign="middle" >M</td><td align="center" valign="middle" >SD</td><td align="center" valign="middle" >M</td><td align="center" valign="middle" >SD</td><td align="center" valign="middle" >t</td><td align="center" valign="middle" >df</td><td align="center" valign="middle" >p</td><td align="center" valign="middle" >M</td><td align="center" valign="middle" >SD</td></tr><tr><td align="center" valign="middle" >Item 1</td><td align="center" valign="middle" >72.50</td><td align="center" valign="middle" >19.87</td><td align="center" valign="middle" >71.92</td><td align="center" valign="middle" >14.37</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >72.11</td><td align="center" valign="middle" >16.16</td></tr><tr><td align="center" valign="middle" >Item 2</td><td align="center" valign="middle" >69.67</td><td align="center" valign="middle" >15.33</td><td align="center" valign="middle" >73.42</td><td align="center" valign="middle" >13.17</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >72.21</td><td align="center" valign="middle" >13.87</td></tr><tr><td align="center" valign="middle" >Item 3</td><td align="center" valign="middle" >67.33</td><td align="center" valign="middle" >17.19</td><td align="center" valign="middle" >73.89</td><td align="center" valign="middle" >13.79</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >71.79</td><td align="center" valign="middle" >15.13</td></tr><tr><td align="center" valign="middle" >Item 4*</td><td align="center" valign="middle" >56.94</td><td align="center" valign="middle" >24.92</td><td align="center" valign="middle" >76.61</td><td align="center" valign="middle" >15.47</td><td align="center" valign="middle" >−3.62</td><td align="center" valign="middle" >54</td><td align="center" valign="middle" >0.005</td><td align="center" valign="middle" >70.29</td><td align="center" valign="middle" >20.95</td></tr><tr><td align="center" valign="middle" >Item 5*</td><td align="center" valign="middle" >48.65</td><td align="center" valign="middle" >14.40</td><td align="center" valign="middle" >66.29</td><td align="center" valign="middle" >16.64</td><td align="center" valign="middle" >−3.78</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" >60.84</td><td align="center" valign="middle" >17.86</td></tr><tr><td align="center" valign="middle" >Item 6*</td><td align="center" valign="middle" >55.00</td><td align="center" valign="middle" >14.19</td><td align="center" valign="middle" >74.47</td><td align="center" valign="middle" >12.08</td><td align="center" valign="middle" >−5.23</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" >68.45</td><td align="center" valign="middle" >15.56</td></tr><tr><td align="center" valign="middle" >Item 7*</td><td align="center" valign="middle" >52.47</td><td align="center" valign="middle" >12.03</td><td align="center" valign="middle" >76.00</td><td align="center" valign="middle" >12.80</td><td align="center" valign="middle" >−6.42</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" >78.73</td><td align="center" valign="middle" >16.60</td></tr><tr><td align="center" valign="middle" >Item 8*</td><td align="center" valign="middle" >49.82</td><td align="center" valign="middle" >14.23</td><td align="center" valign="middle" >67.61</td><td align="center" valign="middle" >16.35</td><td align="center" valign="middle" >−3.87</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" >62.11</td><td align="center" valign="middle" >17.66</td></tr><tr><td align="center" valign="middle" >Item 9</td><td align="center" valign="middle" >73.67</td><td align="center" valign="middle" >20.76</td><td align="center" valign="middle" >83.11</td><td align="center" valign="middle" >13.76</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >80.07</td><td align="center" valign="middle" >16.75</td></tr><tr><td align="center" valign="middle" >Item 10</td><td align="center" valign="middle" >64.94</td><td align="center" valign="middle" >24.23</td><td align="center" valign="middle" >72.87</td><td align="center" valign="middle" >18.37</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >70.32</td><td align="center" valign="middle" >20.55</td></tr><tr><td align="center" valign="middle" >Item 11*</td><td align="center" valign="middle" >56.00</td><td align="center" valign="middle" >16.60</td><td align="center" valign="middle" >76.00</td><td align="center" valign="middle" >11.43</td><td align="center" valign="middle" >−5.19</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" >69.82</td><td align="center" valign="middle" >16.07</td></tr><tr><td align="center" valign="middle" >Item 12*</td><td align="center" valign="middle" >45.47</td><td align="center" valign="middle" >23.96</td><td align="center" valign="middle" >62.32</td><td align="center" valign="middle" >17.64</td><td align="center" valign="middle" >−2.92</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >0.016</td><td align="center" valign="middle" >57.11</td><td align="center" valign="middle" >21.09</td></tr><tr><td align="center" valign="middle" >Item 13</td><td align="center" valign="middle" >76.72</td><td align="center" valign="middle" >19.80</td><td align="center" valign="middle" >76.32</td><td align="center" valign="middle" >17.79</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >76.45</td><td align="center" valign="middle" >18.28</td></tr><tr><td align="center" valign="middle" >Item 14</td><td align="center" valign="middle" >40.86</td><td align="center" valign="middle" >13.81</td><td align="center" valign="middle" >36.09</td><td align="center" valign="middle" >9.40</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >37.54</td><td align="center" valign="middle" >10.99</td></tr><tr><td align="center" valign="middle" >Item 15</td><td align="center" valign="middle" >68.71</td><td align="center" valign="middle" >24.13</td><td align="center" valign="middle" >76.42</td><td align="center" valign="middle" >13.82</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >74.04</td><td align="center" valign="middle" >17.79</td></tr><tr><td align="center" valign="middle" >Item 16</td><td align="center" valign="middle" >62.71</td><td align="center" valign="middle" >12.52</td><td align="center" valign="middle" >64.89</td><td align="center" valign="middle" >11.78</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >64.28</td><td align="center" valign="middle" >11.90</td></tr><tr><td align="center" valign="middle" >Item 17</td><td align="center" valign="middle" >60.24</td><td align="center" valign="middle" >21.72</td><td align="center" valign="middle" >71.24</td><td align="center" valign="middle" >15.97</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >67.84</td><td align="center" valign="middle" >18.47</td></tr><tr><td align="center" valign="middle" >Item 18</td><td align="center" valign="middle" >57.69</td><td align="center" valign="middle" >14.76</td><td align="center" valign="middle" >63.43</td><td align="center" valign="middle" >11.35</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >61.63</td><td align="center" valign="middle" >12.66</td></tr><tr><td align="center" valign="middle" >Item 19</td><td align="center" valign="middle" >82.78</td><td align="center" valign="middle" >18.39</td><td align="center" valign="middle" >86.82</td><td align="center" valign="middle" >13.77</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >85.52</td><td align="center" valign="middle" >15.36</td></tr><tr><td align="center" valign="middle" >Item 20</td><td align="center" valign="middle" >56.30</td><td align="center" valign="middle" >10.63</td><td align="center" valign="middle" >53.24</td><td align="center" valign="middle" >12.17</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >54.03</td><td align="center" valign="middle" >11.73</td></tr><tr><td align="center" valign="middle" >Item 21*</td><td align="center" valign="middle" >63.53</td><td align="center" valign="middle" >22.77</td><td align="center" valign="middle" >83.71</td><td align="center" valign="middle" >8.77</td><td align="center" valign="middle" >−4.77</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >0.002</td><td align="center" valign="middle" >77.47</td><td align="center" valign="middle" >17.17</td></tr><tr><td align="center" valign="middle" >Item 22*</td><td align="center" valign="middle" >71.00</td><td align="center" valign="middle" >13.32</td><td align="center" valign="middle" >52.18</td><td align="center" valign="middle" >26.05</td><td align="center" valign="middle" >2.30</td><td align="center" valign="middle" >37</td><td align="center" valign="middle" >0.006</td><td align="center" valign="middle" >57.49</td><td align="center" valign="middle" >24.55</td></tr><tr><td align="center" valign="middle" >Item 23</td><td align="center" valign="middle" >78.17</td><td align="center" valign="middle" >24.35</td><td align="center" valign="middle" >85.47</td><td align="center" valign="middle" >12.84</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >83.13</td><td align="center" valign="middle" >17.50</td></tr><tr><td align="center" valign="middle" >Item 24*</td><td align="center" valign="middle" >46.09</td><td align="center" valign="middle" >28.01</td><td align="center" valign="middle" >74.63</td><td align="center" valign="middle" >19.37</td><td align="center" valign="middle" >−3.75</td><td align="center" valign="middle" >41</td><td align="center" valign="middle" >0.008</td><td align="center" valign="middle" >67.33</td><td align="center" valign="middle" >24.95</td></tr><tr><td align="center" valign="middle" >Item 25</td><td align="center" valign="middle" >60.89</td><td align="center" valign="middle" >21.29</td><td align="center" valign="middle" >77.00</td><td align="center" valign="middle" >12.89</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >73.38</td><td align="center" valign="middle" >16.35</td></tr><tr><td align="center" valign="middle" >Item 26</td><td align="center" valign="middle" >71.42</td><td align="center" valign="middle" >18.13</td><td align="center" valign="middle" >75.41</td><td align="center" valign="middle" >22.86</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >74.32</td><td align="center" valign="middle" >21.54</td></tr><tr><td align="center" valign="middle" >Item 27</td><td align="center" valign="middle" >69.83</td><td align="center" valign="middle" >21.51</td><td align="center" valign="middle" >75.23</td><td align="center" valign="middle" >17.47</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >73.72</td><td align="center" valign="middle" >18.58</td></tr><tr><td align="center" valign="middle" >Item 28*</td><td align="center" valign="middle" >57.44</td><td align="center" valign="middle" >24.97</td><td align="center" valign="middle" >80.71</td><td align="center" valign="middle" >11.70</td><td align="center" valign="middle" >−4.78</td><td align="center" valign="middle" >54</td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" >73.23</td><td align="center" valign="middle" >20.12</td></tr><tr><td align="center" valign="middle" >Item 29*</td><td align="center" valign="middle" >44.00</td><td align="center" valign="middle" >21.35</td><td align="center" valign="middle" >78.53</td><td align="center" valign="middle" >11.95</td><td align="center" valign="middle" >−7.68</td><td align="center" valign="middle" >53</td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" >67.85</td><td align="center" valign="middle" >22.19</td></tr><tr><td align="center" valign="middle" >Item 30</td><td align="center" valign="middle" >71.67</td><td align="center" valign="middle" >29.61</td><td align="center" valign="middle" >86.53</td><td align="center" valign="middle" >16.56</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >81.75</td><td align="center" valign="middle" >22.46</td></tr><tr><td align="center" valign="middle" >Item 31</td><td align="center" valign="middle" >77.72</td><td align="center" valign="middle" >25.59</td><td align="center" valign="middle" >87.22</td><td align="center" valign="middle" >8.40</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >84.11</td><td align="center" valign="middle" >16.53</td></tr><tr><td align="center" valign="middle" >Item 32*</td><td align="center" valign="middle" >63.61</td><td align="center" valign="middle" >24.36</td><td align="center" valign="middle" >82.68</td><td align="center" valign="middle" >10.13</td><td align="center" valign="middle" >−4.16</td><td align="center" valign="middle" >54</td><td align="center" valign="middle" >0.005</td><td align="center" valign="middle" >76.55</td><td align="center" valign="middle" >18.26</td></tr><tr><td align="center" valign="middle" >Item 33*</td><td align="center" valign="middle" >60.61</td><td align="center" valign="middle" >23.64</td><td align="center" valign="middle" >80.16</td><td align="center" valign="middle" >10.55</td><td align="center" valign="middle" >−4.30</td><td align="center" valign="middle" >54</td><td align="center" valign="middle" >0.003</td><td align="center" valign="middle" >73.88</td><td align="center" valign="middle" >18.23</td></tr><tr><td align="center" valign="middle" >Item 34</td><td align="center" valign="middle" >38.67</td><td align="center" valign="middle" >33.95</td><td align="center" valign="middle" >53.46</td><td align="center" valign="middle" >28.99</td><td align="center" valign="middle" ></td><td align="center" valign="middle" ></td><td align="center" valign="middle" >&gt;0.05</td><td align="center" valign="middle" >48.62</td><td align="center" valign="middle" >31.18</td></tr><tr><td align="center" valign="middle" >(Item 35)</td><td align="center" valign="middle" >(32.88)</td><td align="center" valign="middle" >(22.55)</td><td align="center" valign="middle" >(83.29)</td><td align="center" valign="middle" >(9.66)</td><td align="center" valign="middle" >-</td><td align="center" valign="middle" >-</td><td align="center" valign="middle" >-</td><td align="center" valign="middle" >(67.09)</td><td align="center" valign="middle" >(28.00)</td></tr><tr><td align="center" valign="middle" >Item 36*</td><td align="center" valign="middle" >73.44</td><td align="center" valign="middle" >27.31</td><td align="center" valign="middle" >35.26</td><td align="center" valign="middle" >25.77</td><td align="center" valign="middle" >5.08</td><td align="center" valign="middle" >54</td><td align="center" valign="middle" >0.001</td><td align="center" valign="middle" >47.54</td><td align="center" valign="middle" >31.64</td></tr></tbody></table></table-wrap><p>Note: Item marked with * indicate significant difference in respect to Group (negative, positive). Note: Item 35 is the basis for the independent variable and is therefore not included in the group comparison.</p><p>score on two of the scales (9, 24).</p><p>Age. Participants were divided into three age groups (Visual Binning: width = 33.33, cut points = 42 and 50), Younger (n = 21, M = 38.10, SD = 3.55), Middle (n = 16, M = 45.06, SD = 2.05) and Older (n = 18, M = 55.00, SD = 3.24). Analysis (Kruskal-Wallis, 5% level) with all 36 items as dependent variables and age group as the independent variable showed no significant effects (ps &gt; 0.05).</p></sec><sec id="s3_2"><title>3.2. Measures of Relations</title><p>Correlations. The 36 items were correlated (Pearson’s r, 5% level) with Item 35 (To what extents do you think it is a good idea with group assessments?) which is reported in <xref ref-type="table" rid="table3">Table 3</xref>.</p><p>Regression Analysis. In order to examine whether different aspects tapped in the visual analogue scales of the survey, affect the variance of the study’s main question, a step-wise linear regression analysis was conducted. Item 35 (To what extent do you think it is a good idea with group assessments) was used as the criterion variable and all the other items were used as predictor variables. The analysis generated five models as follows: item 21 (Step 1: Adj R<sup>2</sup> = 0.64, p &lt; 0.001); items 21 and 36 (Step 2: Adj R<sup>2</sup> = 0.80, p &lt; 0.001); items 21, 36 and 1 (Step 3: Adj R<sup>2</sup> = 0.86, p &lt; 0.001); items 21, 36, 1 and 12 (Step 4: Adj R<sup>2</sup> = 0.88, p &lt; 0.001); and finally items 21, 36, 1, 12 and 17 (Step 5: Adj R<sup>2</sup> = 0.90, p &lt; 0.001). The results showed that item 21 (To what extent do you think that you have been fairly assessed by your colleagues?) alone accounted for a full 64% of the variance in the first step. The second step included not only item 21 but also item 36 (To what extent had it been better to be individually assessed only by the supervisor?), which increased the impact with 16% to 80%. The subsequent steps indicated that the five visual analogue scales together could explain 90% of the variance of the criterion variable.</p></sec><sec id="s3_3"><title>3.3. Comments on the Open Question</title><p>The questionnaire also included an open question where the students were able to justify their positions on how they had responded. Of the participants 38 individuals had commented on their answers where 22 persons (58%) preferred group assessments and 16 (42%) preferred individual assessment with only the supervisor. The students who were in favor of group assessments described the advantage of getting a more extensive feedback and not only from the supervisor. They also considered it instructive to share each other’s strengths and potential mistakes. Further it included feeling less vulnerable to the supervisor. The students who preferred individual assessments highlighted that they felt uncomfortable when evaluated by fellow students. They believed that some colleagues were uneven in their knowledge of the CTS-R and even more common that assessments were influenced by relationships between team members. They also felt that the supervisor in these respects was more knowledgeable and objective. Finally, it was argued that individual evaluation could generate a freer and more in-depth assessment, which was considered to benefit the learning process.</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Correlations (Pearson’s r) between item 35 (To what extent do you think it is a good idea with group assessments?) and the remaining items</title></caption><table><tbody><thead><tr><th align="center" valign="middle"  rowspan="2"  ></th><th align="center" valign="middle"  colspan="2"  >Item 35</th></tr></thead><tr><td align="center" valign="middle" >r</td><td align="center" valign="middle" >p</td></tr><tr><td align="center" valign="middle" >Item 1</td><td align="center" valign="middle" >−0.04</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 2</td><td align="center" valign="middle" >0.13</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 3</td><td align="center" valign="middle" >0.18</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 4</td><td align="center" valign="middle" >0.38</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 5</td><td align="center" valign="middle" >0.54</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 6</td><td align="center" valign="middle" >0.60</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 7</td><td align="center" valign="middle" >0.69</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 8</td><td align="center" valign="middle" >0.46</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 9</td><td align="center" valign="middle" >0.29</td><td align="center" valign="middle" >*</td></tr><tr><td align="center" valign="middle" >Item 10</td><td align="center" valign="middle" >0.15</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 11</td><td align="center" valign="middle" >0.69</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 12</td><td align="center" valign="middle" >0.63</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 13</td><td align="center" valign="middle" >0.21</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 14</td><td align="center" valign="middle" >−0.22</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 15</td><td align="center" valign="middle" >0.33</td><td align="center" valign="middle" >*</td></tr><tr><td align="center" valign="middle" >Item 16</td><td align="center" valign="middle" >−0.04</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 17</td><td align="center" valign="middle" >0.30</td><td align="center" valign="middle" >*</td></tr><tr><td align="center" valign="middle" >Item 18</td><td align="center" valign="middle" >0.09</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 19</td><td align="center" valign="middle" >0.29</td><td align="center" valign="middle" >*</td></tr><tr><td align="center" valign="middle" >Item 20</td><td align="center" valign="middle" >−0.08</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 21</td><td align="center" valign="middle" >0.60</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 22</td><td align="center" valign="middle" >−0.30</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 23</td><td align="center" valign="middle" >0.17</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 24</td><td align="center" valign="middle" >0.70</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 25</td><td align="center" valign="middle" >0.53</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 26</td><td align="center" valign="middle" >0.23</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 27</td><td align="center" valign="middle" >0.28</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 28</td><td align="center" valign="middle" >0.44</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 29</td><td align="center" valign="middle" >0.72</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 30</td><td align="center" valign="middle" >0.25</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 31</td><td align="center" valign="middle" >0.29</td><td align="center" valign="middle" >*</td></tr><tr><td align="center" valign="middle" >Item 32</td><td align="center" valign="middle" >0.46</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 33</td><td align="center" valign="middle" >0.47</td><td align="center" valign="middle" >**</td></tr><tr><td align="center" valign="middle" >Item 34</td><td align="center" valign="middle" >0.23</td><td align="center" valign="middle" ></td></tr><tr><td align="center" valign="middle" >Item 35</td><td align="center" valign="middle" >1</td><td align="center" valign="middle" >-</td></tr><tr><td align="center" valign="middle" >Item 36</td><td align="center" valign="middle" >−0.65</td><td align="center" valign="middle" >**</td></tr></tbody></table></table-wrap><p>Note: **Significant correlations at 0.01 level (double-tailed). *Significant correlations at 0.05 level (double- tailed).</p></sec></sec><sec id="s4"><title>4. Discussion</title><p>The main result of the present study showed that a majority of students consisting of 38 participants (68%) had a very positive approach to group assessments, while a minority of 18 participants (32%) was more skeptical or negative. Both groups generally had a positive view of both the CTS-R and the supervisors.</p><p>The most crucial aspects of the students’ perceptions concerning attitudes to group assessments, was whether they felt that they had been fairly evaluated by their fellow students in the group (64 percent of the variance) and if they preferred an individual assessment with only the supervisor (16 percent of the variance). A full 80 percent of the variance in terms of attitude towards group assessments could thus be explained by only these two aspects! That a majority had a positive view of group assessment is in line with previous research as well as that a minority was more negative [<xref ref-type="bibr" rid="scirp.76789-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref43">43</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref44">44</xref>] . There is an extensive research on the characteristics of good supervision [<xref ref-type="bibr" rid="scirp.76789-ref4">4</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref10">10</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref31">31</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref43">43</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref46">46</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref47">47</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref48">48</xref>] . Many highlight the strength of group supervision and there is a widespread belief that the group format provides the most effective conditions for learning. Among the benefits are, in addition to cost-effectiveness, the notion that the group can be used as a safe base for learning, a platform for developing skills and professional identity. However, there is also an established point of view that the group format is not uncomplicated, as was shown in the results of the present study where a third of the students were skeptical or negative to be assessed by their fellow students in the group. Group processes affects both learning and assessment. Such processes consist of factors that are unique to the group environment and create mechanisms that lead to changes in the group which affect the group’s functioning. It has not been possible to find previously performed studies that analyzed the underlying factors of prospective psychotherapists’ attitudes to group assessments based on the CTS-R.</p><p>The students expressed a firm belief in the CTS-R; they considered themselves familiar with the scale and regarded it as relevant for both describing and assessing therapist skills. Further, it may be worth noting that the students’ views on the CTS-R was positive regardless attitude to group assessments, occupation, education level, gender or age. However, the negative group and the positive group differed in terms of the benefits they believed the scale had on their own learning processes. Correlation analysis indicated that this difference was associated with the experience of the group assessments. Results also showed that it was not the relationship to the supervisor or his/her evaluations that had been problematic. On the contrary, the students in both groups generally had a positive opinion of their supervisor. Instead, it was the extent to which participants considered themselves as fairly judged by their student colleagues that had the greatest impact on how they regarded group assessments, indicating that the question rather concerns the experiences of the group and the way the group functioned during the evaluations.</p><p>There were significant differences in terms of gender for only four items. Concerning the question of how the perception of the CTS-R was influenced by the attitude of the supervisor, male participants experienced to a greater degree than female participants, that their attitude to the supervisor affected how they viewed the instrument. The remaining differences in regard to gender concerned questions of honesty in evaluations. The men were more likely to overestimate themselves compared to women. The men also expressed the opinion that colleagues more often had been honest in their evaluations, however, when this was not the case, the men thought that they had been somewhat underestimated by the colleagues. Contrary to the men, the women expressed that their colleagues to a lesser degree had been honest, and that they rather had been somewhat overrated by the colleagues. These results are in no way surprising, given that a very comprehensive early research has shown that women have a lower degree of self-confidence compared to men [<xref ref-type="bibr" rid="scirp.76789-ref49">49</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref50">50</xref>] .</p><p>There were no differences in terms of educational attainment for any of the 36 scales that is, whether the students attended basic education or the psychotherapist program. That there were no differences with respect to the group assessments is perhaps less surprising, since these attitudes were primarily related to the issue of groups and colleagues. But a difference could have been expected concerning the extent of familiarity for CTS-R, since students at undergraduate level had received less time and experience with the instrument. However there was no such difference and one possible explanation may be that the CTS-R is considered to be relatively easy to learn and to administer in relation to other, more extensive scales.</p><p>Participants who were psychologists rated lower on six of the survey questions as compared to the other professional groups. These questions concerned the familiarity of CTS-R, and questions about the perception of the supervisor and the training. The psychologists were generally less satisfied with the supervisors and the education than the other professions. Psychologists experienced to a lesser extent that the supervisor helped them to enhance their learning and their confidence during the assessments. They also expressed less benefit from the supervisors for their learning processes than the other occupations. The social workers were the professional group that rated themselves most familiar with the CTS-R and most comfortable with the supervisors’ evaluations and comments, which they experienced, helped to strengthen their self-confidence. Social workers were also the professional group who were most satisfied with their education at large. Other health care staff, mainly nurses and physiotherapists, felt to a higher degree than the other professions that the supervisors’ comments helped to strengthen their learning during the assessments. They also rated that they had been able to express their own views, if they thought that they were unfairly underestimated. The reason to the psychologists’ response pattern may be linked to the fact that psychologists have more in-depth knowledge of psychotherapy and the highest status compared to social workers and other health care staff. Psychologists may have the least interest in mixed psychotherapy training. Reports from different programs indicate that fewer psychologists choose this path and rather choose the specialist training or psychotherapy training, only open to psychologists. It may be that social workers and other health care staff are the ones who have the most to benefit and also those with the least prestige to defend.</p><p>The students were divided into three age categories and analyzes showed that there were no significant differences in regard to age. Thus, there was no obvious reason why age would be crucial concerning perception of the CTS-R or the group assessments. Admittedly, it is possible to argue that increased age brings greater life experiences which may be relevant in this context. But recent research suggests [<xref ref-type="bibr" rid="scirp.76789-ref51">51</xref>] that it is primarily a good climate and effective feedback systems on the psychotherapists’ workplaces that have a positive impact on the development of skills rather than general life experience.</p></sec><sec id="s5"><title>5. Conclusion</title><p>One limitation of the current study was that it relies on a small sample. On the other hand, there was a width with respect to professional groups, education level, gender and age. The results also showed that the attitude to group assessments was not related to these factors, but mainly focused on factors related to the evaluation process, and especially the assessments from the fellow students in the group. More studies with the same focus are needed to determine the extent to which the results are generalizable. To further improve the learning process and assessments of therapist skills, it would be of great interest to get more studies from a qualitative perspective, focusing on the students’ own experience of performance evaluations together with the supervisors and student colleagues. Also qualitative studies investigating the interactions between students and their patients [<xref ref-type="bibr" rid="scirp.76789-ref52">52</xref>] [<xref ref-type="bibr" rid="scirp.76789-ref53">53</xref>] may provide a basis for further improvements of tutoring in educational groups. Bieling and colleagues [<xref ref-type="bibr" rid="scirp.76789-ref44">44</xref>] are among the few who both researched and proved that process factors had a significant impact on the outcome in treatment groups. They argue that this area leaves a large potential for development and improvement concerning outcome in treatment groups. The same would apply to training and mentoring of aspiring therapists. Green [<xref ref-type="bibr" rid="scirp.76789-ref54">54</xref>] highlighted the irony that the most empirically studied group, therapy approach (CBT) ignores the group as a “group” and as a potential therapeutic agent in itself. The results of this study support the hypothesis that the group as a “group” is very important for the learning process in CBT tutorial.</p></sec><sec id="s6"><title>Acknowledgements</title><p>All authors had contributed substantially to the design, performance, analysis, and reporting of the work. The authors thank the participants for taking the time to participate in the study.</p></sec><sec id="s7"><title>Conflict of Interest</title><p>The authors confirm that this article content has no conflicts of interest.</p></sec><sec id="s8"><title>Cite this paper</title><p>Jervelycke, A., Larsson, B. and Norlander, T. (2017) Attitudes to Group Assessments: Prospective Psy- chotherapists’ Experiences of Being Assessed by Fellow Students. Open Journal of Me- dical Psychology, 6, 179-196. https://doi.org/10.4236/ojmp.2017.63015</p></sec></body><back><ref-list><title>References</title><ref id="scirp.76789-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">World Health Organization. Mental Health Action Plan, 2013-2020. Geneva. http://apps.who.int/iris/bitstream/10665/89966/1/9789241506021_eng.pdf?ua=1</mixed-citation></ref><ref id="scirp.76789-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Swedish National Board of Health (2016) Nationella riktlinjer f&amp;#246r v&amp;#229rd vid depression och &amp;#229ngestsyndrom. http://www.socialstyrelsen.se/publikationer</mixed-citation></ref><ref id="scirp.76789-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Butler, A.C., Chapman, J.E., Forman, E.M. and Beck, A.T. (2006) The Empirical Status of Cognitive-Behavioral Therapy: A Review of Meta-Analyses. Clinical Psychology Review, 26, 17-31.</mixed-citation></ref><ref id="scirp.76789-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Bates, S. (2013) Handledning ur ett KBT-perspektiv [Supervision from a CBT Perspective]. Natur och Kultur, Stockholm.</mixed-citation></ref><ref id="scirp.76789-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Angantyr, K., Rimner, A., Nordén, T. and Norlander, T. (2015) Primary Care Behavioral Health Model: Perspectives of Outcome, Client Satisfaction, and Gender. Social Behavior and Personality: An International Journal, 43, 287-301. https://doi.org/10.2224/sbp.2015.43.2.287</mixed-citation></ref><ref id="scirp.76789-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Norlander, T., Ernestad, E., Moradiani, Z. and Nordén, T. (2015) Perceived Feeling of Security: A Candidate for Assessing Remission in Borderline Patients? Open Psychology Journal, 8, 146-152. https://doi.org/10.2174/1874350101508010146</mixed-citation></ref><ref id="scirp.76789-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Fairburn, C.G. and Cooper, Z. (2011) Therapist Competence, Therapy Quality, and Therapist Training. Behaviour Research and Therapy, 49, 373-378.</mixed-citation></ref><ref id="scirp.76789-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Bennett-Levy, J., McManus, F., Westling, B.E. and Fennell, M. (2009) Acquiring and Refining CBT Skills and Competencies: Which Training Methods Are Perceived to Be Most Effective? Behavioural and Cognitive Psychotherapy, 37, 571-583. https://doi.org/10.1017/S1352465809990270</mixed-citation></ref><ref id="scirp.76789-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Ranson, A., Shafran, R. and Myles, P. (2015) Investigating the Relationship between Competence and Patient Outcome with CBT. Behaviour Research and Therapy, 68, 19-26.</mixed-citation></ref><ref id="scirp.76789-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Milne, D. (2009) Evidence-Based Clinical Supervision: Principals and Practice. Wiley-Blackwell, Chichester.</mixed-citation></ref><ref id="scirp.76789-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Sharpless, B.A. and Barber, J.P. (2009) A Conceptual and Empirical Review of the Meaning, Measurement, Development, and Teaching of Intervention Competence in Clinical Psychology. Clinical Psychology Review, 29, 47-56.</mixed-citation></ref><ref id="scirp.76789-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Bandura, A. (1961) Psychotherapy as a Learning Process. Psychological Bulletin, 58, 143. https://doi.org/10.1037/h0040672</mixed-citation></ref><ref id="scirp.76789-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Bandura, A. (1977) Social Learning Theory. General Learning Press, New York.</mixed-citation></ref><ref id="scirp.76789-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Cook, J.M., Schnurr, P.P., Biyanova, T. and Coyne, J.C. (2009) Apples Don’t Fall Far from the Tree: Influences on Psychotherapists’ Adoption and Sustained Use of New Therapies. Psychiatric Services, 60, 671-676. https://doi.org/10.1176/ps.2009.60.5.671</mixed-citation></ref><ref id="scirp.76789-ref15"><label>15</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Watkins</surname><given-names> C.E. </given-names></name>,<etal>et al</etal>. (<year>2012</year>)<article-title>Development of the Psychotherapy Supervisor: Review of and Reflections on 30 Years of Theory and Research</article-title><source> American Journal of Psychotherapy</source><volume> 66</volume>,<fpage> 45</fpage>-<lpage>83</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.76789-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Milne, D.L., Reiser, R.P. and Cliffe, T. (2013) An N = 1 Evaluation of Enhanced CBT Supervision. Behavioural and Cognitive Psychotherapy, 41, 210-220. https://doi.org/10.1017/S1352465812000434</mixed-citation></ref><ref id="scirp.76789-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Lilja, J.L., Zelleroth, C., Axberg, U. and Norlander, T. (2016) Mindfulness-Based Cognitive Therapy Is Effective as Relapse Prevention for Patients with Recurrent Depression in Scandinavian Primary Health Care. Scandinavian Journal of Psychology, 57, 464-472. https://doi.org/10.1111/sjop.12302</mixed-citation></ref><ref id="scirp.76789-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Perepletchikova, F., Treat, T.A. and Kazdin, A.E. (2007) Treatment Integrity in Psychotherapy Research: Analysis of the Studies and Examination of the Associated Factors. Journal of Consulting and Clinical Psychology, 75, 829-841. https://doi.org/10.1037/0022-006X.75.6.829</mixed-citation></ref><ref id="scirp.76789-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Clark, D.M., Layard, R., Smithies, R., Richards, D.A., Suckling, R. and Wright, B. (2009) Improving Access to Psychological Therapy: Initial Evaluation of Two UK Demonstration Sites. Behaviour Research and Therapy, 47, 910-920.</mixed-citation></ref><ref id="scirp.76789-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">DeRubeis, R.J., Hollon, S.D., Amsterdam, J.D., Shelton, R.C., Young, P.R., Salomon, R.M., Gallop, R., et al. (2005) Cognitive Therapy vs. Medications in the Treatment of Moderate to Severe Depression. Archives of General Psychiatry, 62, 409-416. https://doi.org/10.1001/archpsyc.62.4.409</mixed-citation></ref><ref id="scirp.76789-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Trepka, C., Rees, A., Shapiro, D.A., Hardy, G.E. and Barkham, M. (2004) Therapist Competence and Outcome of Cognitive Therapy for Depression. Cognitive Therapy and Research, 28, 143-157. https://doi.org/10.1023/B:COTR.0000021536.39173.66</mixed-citation></ref><ref id="scirp.76789-ref22"><label>22</label><mixed-citation publication-type="book" xlink:type="simple">Padesky, C.A. (1996) Developing Cognitive Therapist Competency: Teaching Supervision Models. In: Salkovskis P.M., Ed., Frontiers of Cognitive Therapy, Guilford Press, London, 266-292.</mixed-citation></ref><ref id="scirp.76789-ref23"><label>23</label><mixed-citation publication-type="book" xlink:type="simple">Liese, B.S. and Beck, J.S. (1997) Cognitive Therapy Supervision. In: Watkins, C.E., Ed., Handbook of Psychotherapy Supervision, John Wiley &amp; Sons, Chichester, 114-133.</mixed-citation></ref><ref id="scirp.76789-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Bennett-Levy, J. (2006) Therapist Skills: A Cognitive Model of Their Acquisition and Refinement. Behavioural and Cognitive Psychotherapy, 34, 57-78. https://doi.org/10.1017/s1352465805002420</mixed-citation></ref><ref id="scirp.76789-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Croona Olde, C. (2013) Psykologen i rollen som handledare. Enlitteraturstudie [The Psychologist in the Role of Supervisor. A Review]. Sverigespsykologf&amp;#246rbund, Stockholm.</mixed-citation></ref><ref id="scirp.76789-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Kolb, D. (1984) Experimental Learning: Experience as the Source of Learning and Development. Prentice Hall, Englewood Cliffs.</mixed-citation></ref><ref id="scirp.76789-ref27"><label>27</label><mixed-citation publication-type="book" xlink:type="simple">Vygotskij, L.S. (1978) Interaction between Learning and Development. In: Cole, M., Ed., Mind in Society: The Development of Higher Psychological Processes, Harvard University Press, Cambridge, 79-91.</mixed-citation></ref><ref id="scirp.76789-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">Fahlgren, R. (2008) Hur g&amp;#246r handledare? Centralaaspekteri KBT-Oriented Handledning [How Does a Supervisor Perform? Central Aspects of CBT-Oriented Supervision]. Stockholm University, Stockholm.</mixed-citation></ref><ref id="scirp.76789-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Milne, D.L., Baker, C., Blackburn, I.M., James, I. and Reichelt, K. (1999) Effectiveness of Cognitive Therapy Training. Journal of Behavior Therapy and Experimental Psychiatry, 30, 81-92.</mixed-citation></ref><ref id="scirp.76789-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Shaw, B.F. and Dobson, K.S. (1988) Competency Judgments in the Training and Evaluation of Psychotherapists. Journal of Consulting and Clinical Psychology, 56, 666-672. https://doi.org/10.1037/0022-006X.56.5.666</mixed-citation></ref><ref id="scirp.76789-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Milne, D.L., Reiser, R.P., Cliffe, T., Breese, L., Boon, A., Raine, R. and Scarratt, P. (2011) A Qualitative Comparison of Cognitive-Behavioural and Evidence-Based Clinical Supervision. The Cognitive Behaviour Therapist, 4, 152-166. https://doi.org/10.1017/S1754470X11000092</mixed-citation></ref><ref id="scirp.76789-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Young, J. and Beck, A.T. Cognitive Therapy Scale Rating Manual. University of Pennsylvania, Philadelphia.</mixed-citation></ref><ref id="scirp.76789-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Dobson, K.S., Shaw, B.F. and Vallis, T.M. (1985) Reliability of a Measure of the Quality of Cognitive Therapy. British Journal of Clinical Psychology, 24, 295-300. https://doi.org/10.1111/j.2044-8260.1985.tb00662.x</mixed-citation></ref><ref id="scirp.76789-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">Safran, J.D. and Segal, Z.V. (1990) Therapy Adherence Rating Scale. Interpersonal process in Cognitive Therapy. Basic Books, New York.</mixed-citation></ref><ref id="scirp.76789-ref35"><label>35</label><mixed-citation publication-type="other" xlink:type="simple">Barber, J.P., Liese, B.S. and Abrams, M.J. (2003) Development of the Cognitive Therapy Adherence and Competence Scale. Psychotherapy Research, 13, 205-221. https://doi.org/10.1093/ptr/kpg019</mixed-citation></ref><ref id="scirp.76789-ref36"><label>36</label><mixed-citation publication-type="other" xlink:type="simple">Muse, K., McManus, F., Rakovshik, S. and Thwaites, R. (2016) Development and Psychometric Evaluation of the Assessment of Core CBT Skills (ACCS): An Observation-Based Tool for Assessing Cognitive Behavioral Therapy Competence. Psychological Assessment. https://doi.org/10.1037/pas0000372</mixed-citation></ref><ref id="scirp.76789-ref37"><label>37</label><mixed-citation publication-type="other" xlink:type="simple">Mathieson, F.M., Barnfield, T. and Beaumont, G. (2010) Are We as Good as We Think We Are? Self-Assessment versus Other Forms of Assessment of Competence in Psychotherapy. The Cognitive Behaviour Therapist, 2, 43-50. https://doi.org/10.1017/S1754470X08000081</mixed-citation></ref><ref id="scirp.76789-ref38"><label>38</label><mixed-citation publication-type="other" xlink:type="simple">Padesky, C.A., Kuyken, W. and Dudley, R. (2011) Collaborative Case Conceptualization Rating Scale &amp; Coding Manual. Guilford Publications, New York.</mixed-citation></ref><ref id="scirp.76789-ref39"><label>39</label><mixed-citation publication-type="other" xlink:type="simple">Roth, A.D. (2016) A New Scale for the Assessment of Competences in Cognitive and Behavioural Therapy. Behavioural and Cognitive Psychotherapy, 44, 620-624. https://doi.org/10.1017/S1352465816000011</mixed-citation></ref><ref id="scirp.76789-ref40"><label>40</label><mixed-citation publication-type="other" xlink:type="simple">Blackburn, I.M., James, I.A., Milne, D.L., Baker, C., Standart, S., Garland, A. and Reichelt, F.K. (2001) The Revised Cognitive Therapy Scale (CTS-R): Psychometric Properties. Behavioural and Cognitive Psychotherapy, 29, 431-446. https://doi.org/10.1017/s1352465801004040</mixed-citation></ref><ref id="scirp.76789-ref41"><label>41</label><mixed-citation publication-type="book" xlink:type="simple">Dreyfus, H.L. (1989) The Dreyfus Model of Skill Acquisition. In: Burke, J., Ed., Competency Based Education and Training, Falmer Press, London, 181-183.</mixed-citation></ref><ref id="scirp.76789-ref42"><label>42</label><mixed-citation publication-type="other" xlink:type="simple">Jacobsson, P., Carlsson, J., Lundgren, M. and Ek, H. (2007) Assessing Competence in Cognitive Psychotherapy. A Validation Study of a Swedish Rating Scale. Centrum f&amp;#246r Kognitiv Psykoterapioch Utbildning, Gothenburg.</mixed-citation></ref><ref id="scirp.76789-ref43"><label>43</label><mixed-citation publication-type="other" xlink:type="simple">Kuechler, C.F. (2007) Practitioners’ Voices: Group Supervisors Reflect on Their Practice. The Clinical Supervisor, 25, 83-103. https://doi.org/10.1300/J001v25n01_07</mixed-citation></ref><ref id="scirp.76789-ref44"><label>44</label><mixed-citation publication-type="other" xlink:type="simple">Bieling, P.J., McCabe, R.E. and Antony, M.M. (2006) Cognitive-Behavioral Therapy in Groups. Guilford Press, New York.</mixed-citation></ref><ref id="scirp.76789-ref45"><label>45</label><mixed-citation publication-type="other" xlink:type="simple">K&amp;#229ver, A. (2006) KBT i utveckling. En introduktion till kognitiv beteendeterapi [CBT in Development. An Introduction to Cognitive Behavioral Therapy]. Naturoch Kultur, Stockholm.</mixed-citation></ref><ref id="scirp.76789-ref46"><label>46</label><mixed-citation publication-type="other" xlink:type="simple">Milne, D. and Dunkerley, C. (2010) Towards Evidence-Based Clinical Supervision: The Development and Evaluation of Four CBT Guidelines. The Cognitive Behaviour Therapist, 3, 43-57. https://doi.org/10.1017/S1754470X10000048</mixed-citation></ref><ref id="scirp.76789-ref47"><label>47</label><mixed-citation publication-type="other" xlink:type="simple">Watkins, C.E. (1997) Handbook of Psychotherapy Supervision. John Wiley &amp; Sons, New York.</mixed-citation></ref><ref id="scirp.76789-ref48"><label>48</label><mixed-citation publication-type="journal" xlink:type="simple"><name name-style="western"><surname>Watkins</surname><given-names> C.E. </given-names></name>,<etal>et al</etal>. (<year>2012</year>)<article-title>Educating Psychotherapy Supervisors</article-title><source> American Journal of Psychotherapy</source><volume> 66</volume>,<fpage> 297</fpage>-<lpage>307</lpage>.<pub-id pub-id-type="doi"></pub-id></mixed-citation></ref><ref id="scirp.76789-ref49"><label>49</label><mixed-citation publication-type="other" xlink:type="simple">Spence, J.T., Helmreich, R. and Stapp, J. (1975) Ratings of Self and Peers on Sex Role Attributes and Their Relation to Self-Esteem and Conceptions of Masculinity and Femininity. Journal of Personality and Social Psychology, 32, 29. https://doi.org/10.1037/h0076857</mixed-citation></ref><ref id="scirp.76789-ref50"><label>50</label><mixed-citation publication-type="other" xlink:type="simple">Norlander, T., Erixon, A. and Archer, T. (2000) Psychological Androgyny and Creativity: Dynamics of Gender-Role and Personality Trait. Social Behavior and Personality, 28, 423-435. https://doi.org/10.2224/sbp.2000.28.5.423</mixed-citation></ref><ref id="scirp.76789-ref51"><label>51</label><mixed-citation publication-type="other" xlink:type="simple">Goldberg, S.B., Babins-Wagner, R., Rousmaniere, T., Berzins, S., Hoyt, W.T., Whipple, J.L., Wampold, B.E., et al. (2016) Creating a Climate for Therapist Improvement: A Case Study of an Agency Focused on Outcomes and Deliberate Practice. Psychotherapy, 53, 367. https://doi.org/10.1037/pst0000060</mixed-citation></ref><ref id="scirp.76789-ref52"><label>52</label><mixed-citation publication-type="other" xlink:type="simple">Ingvarsson, T., Nordén, T. and Norlander, T. (2014) Mindfulness-Based Cognitive Therapy: A Case Study on Experiences of Healthy Behaviors by Clients in Psychiatric care. Open Journal of Medical Psychology, 3, 390-402. https://doi.org/10.4236/ojmp.2014.35041</mixed-citation></ref><ref id="scirp.76789-ref53"><label>53</label><mixed-citation publication-type="other" xlink:type="simple">Lilja, J.L., Broberg, M., Norlander, T. and Broberg, A.G. (2015) Mindfulness-Based Cognitive Therapy: Primary Care Patients’ Experiences of Outcomes in Everyday Life and Relapse Prevention. Psychology, 6, 464-477. https://doi.org/10.4236/psych.2015.64044</mixed-citation></ref><ref id="scirp.76789-ref54"><label>54</label><mixed-citation publication-type="book" xlink:type="simple">Greene, L.R. (2000) Process Analysis of Group Interaction in Therapeutic Groups. In: Beck, A. and Lewis, C., Eds., The Process of Group Psychotherapy: Systems for Analyzing Change, American Psychological Association, Washington DC, 23-47. https://doi.org/10.1037/10378-002</mixed-citation></ref></ref-list></back></article>