<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" media="screen" href="/~d/styles/atom10full.xsl"?><?xml-stylesheet type="text/css" media="screen" href="http://feeds.feedburner.com/~d/styles/itemcontent.css"?><feed xmlns="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:thr="http://purl.org/syndication/thread/1.0" xmlns:feedburner="http://rssnamespace.org/feedburner/ext/1.0">
    <title>Will at Work Learning</title>
    
    <link rel="alternate" type="text/html" href="http://www.willatworklearning.com/" />
    <id>tag:typepad.com,2003:weblog-239218</id>
    <updated>2013-05-13T10:09:41-04:00</updated>
    <subtitle>Will Thalheimer's research-based commentary on learning, performance, and the industry thereof.</subtitle>
    <generator uri="http://www.typepad.com/">TypePad</generator>
    <atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="self" type="application/atom+xml" href="http://feeds.feedburner.com/WillAtWorkLearning" /><feedburner:info uri="willatworklearning" /><atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="hub" href="http://pubsubhubbub.appspot.com/" /><feedburner:browserFriendly>This is an XML content feed. It is intended to be viewed in a newsreader or syndicated to another site, subject to copyright and fair use.</feedburner:browserFriendly><entry>
        <title>Rethinking Instructional Objectives</title>
        <link rel="alternate" type="text/html" href="http://www.willatworklearning.com/2013/05/rethinking-instructional-objectives.html" />
        <link rel="replies" type="text/html" href="http://www.willatworklearning.com/2013/05/rethinking-instructional-objectives.html" thr:count="3" thr:updated="2013-05-14T13:02:29-04:00" />
        <id>tag:typepad.com,2003:post-6a00d8341cf01053ef0191021662ba970c</id>
        <published>2013-05-13T10:09:41-04:00</published>
        <updated>2013-05-13T10:57:16-04:00</updated>
        <summary>Clark Quinn (blog, website, Twitter) recently cited some of my thinking about instructional objectives in the instructional technology forum of AECT (ITFORUM). I wrote a long email to Clark in response, thanking him, and going into more detail. I am...</summary>
        <author>
            <name>Will Thalheimer</name>
        </author>
        <category scheme="http://www.sixapart.com/ns/types#category" term="Thoughts on Learning Practice" />
        
        
<content type="xhtml" xml:lang="en-US" xml:base="http://www.willatworklearning.com/">
<div xmlns="http://www.w3.org/1999/xhtml"><p>Clark Quinn (<a href="http://blog.learnlets.com/" target="_blank">blog</a>, <a href="http://www.quinnovation.com/" target="_blank">website</a>, <a href="https://twitter.com/Quinnovator" target="_blank">Twitter</a>)  recently cited some of my thinking about instructional objectives in the instructional technology forum of AECT (<a href="http://itforum.lt.unt.edu/?q=node/14" target="_blank">ITFORUM</a>). I wrote a long email to Clark in response, thanking him, and going into more detail. I am reprising my response to Clark here:</p>
<p>In a recent post to this list, Clark Quinn rightly notes that objectives
for learners and objectives for instructional designers need not be identical.
Indeed, as both Clark and I have previously noted, the probably shouldn’t be
identical. </p>
<p>Here’s the thinking: Objectives are designed to guide behavior. So, how
can it be that identically-worded objectives can adequately guide the behavior
of two disparate groups of individuals (learners and instructional designers)?
It just doesn’t make any sense!!</p>
<p>And indeed, Hamilton (1985) found that presenting learners with learning
objectives in the way Mager suggested, PRODUCES NO BENEFITS AND MAY BE HARMFUL.
Here’s what Hamilton wrote:</p>
<blockquote>
<p><em>“[An instructional] objective that generally
identifies the information to be learned in the text will produce robust effects.
Including other information (per Mager’s, 1962, definition) will not
significantly help and it may hinder the effects of the objectives”</em> </p>
</blockquote>
<p style="text-align: right;">(Hamilton, 1985, p. 78).</p>
<p>Objectives are not only designed to change behavior for a particular set
of individuals, but they are also designed with particular purposes in mind—or they
should be. </p>
<p>So, when we talk of instructional objectives, we also need to think
about what purpose we have for them. </p>
<p>The quote above from Hamilton is focused on how well learning objectives
focus the attention of learners. Interestingly, this is the only area in which
extensive research has been done on learning objectives. You might be surprised
to know that learning objectives help learners focus on the information
targeted by learning objectives, but actually diminish their attention on
information in the learning materials not targeted by learning objectives. For
example, in two experiments using specific objectives, Rothkopf and Billington
(1979) found that when focusing objectives were provided to learners, performance
on material related to the objectives improved by 49% and 47% over situations
when focusing objectives were not used. However, the material not related to
the learning objectives was learned 39% and 33% WORSE than it would have been
if no learning objectives were used!</p>
<p>These types of instructional objectives—presented to learners prior to
subsequent learning—I call “focusing objectives” because they are designed for
the purpose of focusing learner attention on critical learning material. As the
Hamilton (1985) review pointed out, it does NOT help to add Mager’s criterion
information to focusing objectives, because it doesn’t help learners focus on
the critical material. </p>
<p>NOW, here’s an important point (I say to focus your attention):  We don’t necessarily need to use focusing
objectives with learners if we have other means to focus their attention!! We
can use a relevant, gripping story. We can do a shout-out (example, “Here’s an
important point…”). We can have them attempt to answer a relevant
scenario-based question and struggle with it. Etcetera.</p>
<p>Here’s another important point: Focusing objectives are only one type of
objective we might want to utilize. I have a whole list, and I’m sure you can
think of more of them. </p>
<p><strong>Instructional Objectives for Learners:</strong></p>
<ol>
<li><strong>Table-of-Contents
Objectives</strong><br />
To give learners a big picture sense of what will be taught.</li>
<li><strong>Performance
Objectives</strong><br />
To let learners know what performance will be expected of them.</li>
<li><strong>Motivation
Objective</strong><br />
To ensure learners know why they might be motivated to engage the learning or
application of the learning.</li>
<li><strong>Focusing
Objective</strong><br />
To guide learner attention to the most critical information in the learning
material.</li>
</ol>
<p><strong>Instructional Objectives for Developers:</strong></p>
<ol>
<li><strong>Instructional-Design
Objective</strong><br />
To guide developers toward the ultimate goal of the learning intervention.</li>
<li><strong>Evaluation
Objective</strong><br />
To guide developers (and other stakeholders) to the ultimate measurable
outcomes that the learning intervention will be measured by. </li>
<li><strong>Situation
Objectives</strong><br />
To guide developers to the situations that learners must be prepared for.</li>
<li><strong>Organization</strong> <strong>Objective<br /></strong>To guide developers to the organizational effects targeted by the
instruction. </li>
</ol>
<p><strong>Questions:</strong></p>
<p>So, here’s some questions for you:</p>
<p>Is it okay to use the word <strong><em>understand</em></strong> in an “instructional-design
objective”?</p>
<p>How about in a “focusing objective”?</p>
<p>Answer: It’s okay to use the word <strong><em>understand</em></strong> in a focusing objective—because
it does not hurt the learner in setting them up to focus attention on critical
concepts. But it is NOT okay to use the word <strong><em>understand</em></strong> in an
instructional-design objective—because the word “understand” doesn’t have
enough specificity to guide instructional design. </p>
<p>My point in asking these questions is to show that over-simplistic
notions about instructional objectives are likely to be harmful to your
instructional designs. </p>
<p>As usual, the research helps us see things we wouldn’t otherwise have
seen.</p>
<p>Hope this helps!!</p>
<p>= Will</p>
<p> </p>
<p><strong>References</strong></p>
<p>Hamilton, R. J. (1985). A framework for the evaluation of
the effectiveness of adjunct questions and objectives. <em>Review of Educational Research, 55</em>, 47-85.</p>
<p>Mager, R. (1962). <em>Preparing
Instructional Objectives</em>. Palo Alto, CA: Fearon Publishers. </p>
<p>Rothkopf, E. Z., &amp; Billington, M. J. (1979). Goal-guided learning 
from text: Inferring a descriptive processing model from inspection 
times and eye movements. <em>Journal of Educational Psychology, 71</em>(3), 310-327.</p></div>
</content>



    </entry>
    <entry>
        <title>Support Elliott Masie's War on Frivolous LMS Trademarks</title>
        <link rel="alternate" type="text/html" href="http://www.willatworklearning.com/2013/05/support-elliott-masies-war-on-frivolous-lms-trademarks.html" />
        <link rel="replies" type="text/html" href="http://www.willatworklearning.com/2013/05/support-elliott-masies-war-on-frivolous-lms-trademarks.html" thr:count="0" />
        <id>tag:typepad.com,2003:post-6a00d8341cf01053ef01901bfe587d970b</id>
        <published>2013-05-09T12:56:19-04:00</published>
        <updated>2013-05-09T12:57:21-04:00</updated>
        <summary>I urge you to support Elliott Masie's war on frivolous LMS Trademarks. Here's what Elliott wrote in his newsletter: Help! Defend Learning Field from Patent Suit! The learning "patent trolls" are at it again. There is a company called IPLearn...</summary>
        <author>
            <name>Will Thalheimer</name>
        </author>
        <category scheme="http://www.sixapart.com/ns/types#category" term="Industry News" />
        <category scheme="http://www.sixapart.com/ns/types#category" term="Thoughts on Our Industry" />
        
        
<content type="xhtml" xml:lang="en-US" xml:base="http://www.willatworklearning.com/">
<div xmlns="http://www.w3.org/1999/xhtml"><p>I urge you to support Elliott Masie's war on frivolous LMS Trademarks. Here's what Elliott wrote in his newsletter: </p>
<p><span style="color: #82393c;">Help! Defend Learning Field
from Patent Suit! The learning "patent trolls" are at it again. There
is a company called IPLearn that has unfortunately successfully sued over a
dozen learning management system - claiming they have invented many of the core
elements of technology delivered learning.  Sure, they wrote several
clever patents that claim to have created much of the field - and, with an
understaffed patent office, it was approved - though there were many prior
learning and technology implementations.  And, their strategy, which has
worked, is to sue a company - get the discovery and legal costs up and up, and
finally settle for a fee and stock shares.  All, without having invented,
produced or created anything - other than a few patent apps.</span></p>
<p><span style="color: #82393c;">I have worked, without fee,
against their efforts several times and now they are at it again.  They
have brought suits against several major LMS companies - and I am asking
Learning TRENDS readers to help gather any manuals, documents or other
experiences you have had with these earlier corporate learning systems:</span></p>
<ul>
<li><span style="color: #82393c;">Registrar,” by Silton-Bookman
Systems.</span></li>
<li><span style="color: #82393c;">Learning Organization
Information System (LOIS),” by KnowledgeSoft, Inc.</span></li>
<li><span style="color: #82393c;">
Etude,” by Gerald
Hollingsworth and GPU, Inc.</span></li>
<li><span style="color: #82393c;">
Continuous Learning System
(CLS),” by AT&amp;T Global Information Solutions International, Inc.</span></li>
</ul>
<p><span style="color: #82393c;">The lawyers defending against
the IPLearn suit would love to see any samples of anything that describes the
operation or public availability of these systems.  For example: 
user manuals, help files, demonstration videos, brochures, press releases, and
actual program disks/CDs.  </span></p>
<p><span style="color: #82393c;">If you can help, would you send
a note to my office at </span><a href="mailto:emasie@masie.com"><span style="color: #82393c;">emasie@masie.com</span></a><span style="color: #82393c;">
and we will contact you back.  Many thanks!</span></p>
<p><span style="color: #a94a76;"><span style="color: #111111;">While I'm not a trademark expert, and I support people and organizations who truly do create something new and unique, trademarks that aren't deserving hurt our industry and our learners.</span><br /></span></p></div>
</content>



    </entry>
    <entry>
        <title>Measuring Social Media as a Learning Tool</title>
        <link rel="alternate" type="text/html" href="http://www.willatworklearning.com/2013/04/measuring-social-media-as-a-learning-tool.html" />
        <link rel="replies" type="text/html" href="http://www.willatworklearning.com/2013/04/measuring-social-media-as-a-learning-tool.html" thr:count="0" />
        <id>tag:typepad.com,2003:post-6a00d8341cf01053ef017c38528c31970b</id>
        <published>2013-04-03T16:28:51-04:00</published>
        <updated>2013-04-03T16:28:51-04:00</updated>
        <summary>A while back, I wrote an article for the eLearning Guild which was essentially about measuring social media as a learning tool. We called social media "Learning 2.0" but the issue is the same. Here is the article. I'm reprising...</summary>
        <author>
            <name>Will Thalheimer</name>
        </author>
        <category scheme="http://www.sixapart.com/ns/types#category" term="Learning Evaluation &amp; Assessment" />
        <category scheme="http://www.sixapart.com/ns/types#category" term="New Technology for Learning" />
        
        <category scheme="http://sixapart.com/ns/types#tag" term="social media evaluation " />
        
<content type="xhtml" xml:lang="en-US" xml:base="http://www.willatworklearning.com/">
<div xmlns="http://www.w3.org/1999/xhtml"><p>A while back, I wrote an article for the eLearning Guild which was essentially about measuring social media as a learning tool. We called social media "Learning 2.0" but the issue is the same. <a href="http://willthalheimer.typepad.com/files/evaluatinglearning20_finalversion.pdf" target="_blank">Here is the article.</a></p>
<p>I'm reprising that here, because I just read Ettiene Wenger's (2011) <a href="http://www.open.ou.nl/rslmlt/Wenger_Trayner_DeLaat_Value_creation.pdf" target="_blank">article</a> where he talks about measuring social media, and I am once again disappointed that opportunity costs and costs of bad-information are not recognized.</p></div>
</content>



    </entry>
    <entry>
        <title>CEO's Do NOT Successfully Transfer Their Skills to Other Companies!</title>
        <link rel="alternate" type="text/html" href="http://www.willatworklearning.com/2012/09/ceos-do-not-successfully-transfer-their-skills-to-other-companies.html" />
        <link rel="replies" type="text/html" href="http://www.willatworklearning.com/2012/09/ceos-do-not-successfully-transfer-their-skills-to-other-companies.html" thr:count="0" />
        <id>tag:typepad.com,2003:post-6a00d8341cf01053ef017d3c6b0642970c</id>
        <published>2012-09-30T11:54:59-04:00</published>
        <updated>2012-09-30T11:54:59-04:00</updated>
        <summary>In a recent, NY Time Article, GRETCHEN MORGENSON cited a paper (Executive Superstars, Peer Groups and Over-­‐Compensation –Cause, Effect and Solution) by Charles M. Elson and Craig K. Ferrere who compile research from others (see citations below) that basically shows...</summary>
        <author>
            <name>Will Thalheimer</name>
        </author>
        <category scheme="http://www.sixapart.com/ns/types#category" term="Thoughts on Learning" />
        <category scheme="http://www.sixapart.com/ns/types#category" term="Thoughts on Learning Practice" />
        <category scheme="http://www.sixapart.com/ns/types#category" term="Thoughts on Our Industry" />
        
        
<content type="xhtml" xml:lang="en-US" xml:base="http://www.willatworklearning.com/">
<div xmlns="http://www.w3.org/1999/xhtml"><p>In a recent, <a href="http://www.nytimes.com/2012/09/23/business/ceos-and-the-pay-em-or-lose-em-myth-fair-game.html?pagewanted=all" target="_blank">NY Time Article</a>, <a href="http://topics.nytimes.com/top/reference/timestopics/people/m/gretchen_morgenson/index.html" rel="author" title="More Articles by GRETCHEN MORGENSON">GRETCHEN MORGENSON</a> cited a <a href="http://irrcinstitute.org/pdf/Executive-Superstars-Peer-Benchmarking-Study.pdf" target="_blank">paper (Executive Superstars, Peer Groups and Over-­‐Compensation –Cause, Effect and Solution) </a>by Charles M. Elson and Craig K. Ferrere who compile research from others (see citations below) that basically shows that CEO's do NOT successfully transfer their skills from one company to another. CEO's who are hired from within tend to do a much better job than CEO's brought in from the outside.</p>
<p>We in the learning-and-performance field should take note. The reason this is true is because it takes real-world expertise, gained through long bouts of experience in a particular set of situations, to give people the tools they need to be experts.</p>
<p>This we should all know. If you want to be good in calculus as it applies to astronomy, you ought to get practice in applying calculus to astronomy. It is not enough to just learn calculus and learn astromony.</p>
<p> And certainly it is not helpful to learn Latin to learn math, or even to learn other languages. Anybody who has been to graduate school in learning should have learned about how unlikely it is for learning to transfer from one domain to the other. Thorndike anyone?</p>
<p>Donald Clark has a <a href="http://donaldclarkplanb.blogspot.co.uk/2012/04/thorndike-1874-1949-experimental-rigour.html" target="_blank">nice blog post</a> on Thorndike and the uselessness of learning latin.</p>
<p>So, from both a training and on-the-job learning perspective, we should be giving our learners extensive opportunities to learn their areas of expertise.</p>
<p>This doesn't mean they should never dabble in other domains. In fact, creativity research shows that "domain-spanners" are more likely to be creative than those who only learn with a narrow focus. HOWEVER, people who are only domain-spanners (and don't know a field really well) tend to just be good at coming up with ideas--but not generally good ones. Expertise matters!</p>
<p>Those of you in the United States who are thinking about our election in terms of this lack of transfer from one job situation to another could have a field day...or a depression. </p>
<p> </p>
<p><span style="font-size: 11pt;"><strong>Some of Elson and Ferrere's citations showing that CEO's skills don't transfer well:</strong></span></p>
<p>Richard A. Cazier and John M. McInnis, Do Firms Contract Efficiently on Past Performance When Hiring External CEOs? (Working Paper, 2010) (studying 192 external successions from 1993-2005 they find a negative correlation between excess compensation and future performance;; paradoxically the superstars underperformed).</p>
<p>Gregory L. Nagel, William G. Hardin III, The Transferability of CEO Skills, (Working Paper, 2007)</p>
<p>Mark R. Huson, Paul H. Malatesta and Robert Parrino, Managerial succession and firm performance, 74 J. FIN. ECON. 237, 237 (2004) (finding that “the appointment of outside successors [is] not significantly related to post-turnover performance changes in [their] regression analysis.”)</p>
<p>Chuck Lucier, Steven Wheeler, and Rolf Habbel, The Era of the Inclusive Leader, 47 STRATEGY+BUSINESS (2007) (finding that “experienced CEOs”, though hypothesized to bring experience in dealing with stakeholders and shareholders actually underperformed).</p>
<p>James S. Ang and Gregory L. Nagel, The Financial Outcome of Hiring a CEO from Outside the Firm, (Working Paper, 18, 34, 2011) (using a structural self-selection model to estimate counterfactual performance that would have been obtained if the firm hired an insider rather than an outsider and vice-versa, at all target levels of performance internal hires stochastically dominate outsiders).</p></div>
</content>



    </entry>
    <entry>
        <title>A Better Youth Soccer Evaluation Form</title>
        <link rel="alternate" type="text/html" href="http://www.willatworklearning.com/2012/09/a-better-youth-soccer-evaluation-form.html" />
        <link rel="replies" type="text/html" href="http://www.willatworklearning.com/2012/09/a-better-youth-soccer-evaluation-form.html" thr:count="0" />
        <id>tag:typepad.com,2003:post-6a00d8341cf01053ef017ee3cdc30c970d</id>
        <published>2012-09-26T21:35:51-04:00</published>
        <updated>2012-09-26T21:43:25-04:00</updated>
        <summary>As a youth soccer coach for many years I have struggled to evaluate my own players and have seen how my soccer league evaluates players to place them on teams. As a professional learning-and-performance consultant who has focused extensively on...</summary>
        <author>
            <name>Will Thalheimer</name>
        </author>
        <category scheme="http://www.sixapart.com/ns/types#category" term="Learning for Children" />
        <category scheme="http://www.sixapart.com/ns/types#category" term="Learning Measurement" />
        
        
<content type="xhtml" xml:lang="en-US" xml:base="http://www.willatworklearning.com/">
<div xmlns="http://www.w3.org/1999/xhtml"><p>As a youth soccer coach for many years I have struggled to evaluate my own players and have seen how my soccer league evaluates players to place them on teams. As a professional learning-and-performance consultant who has focused extensively on measurement and evaluation, I think we can all do better, me included. To this end, I have spent the last two years creating a series of evaluation tools for use by coaches and youth soccer leagues. I’m sure these forms are not perfect, but I’m absolutely positive that they will be a huge improvement over the typical forms utilized by most youth soccer organizations. I have developed the forms so that they can be modified and they are made available for free to anyone who coaches youth soccer. </p>
<p>At the bottom of this post, I'll include a list of the most common mistakes that are made in youth-soccer evaluation. For my regular blog readers--those who come to me for research-based recommendations on workplace learning-and-performance--you'll see relevance to your own work in this list of evaluation mistakes.</p>
<p>I have developed four separate forms for evaluation. That may seem like a lot until you see how they will help you as a coach (and as a soccer league) meet varied goals you have. I will provide each form as a PDF (so you can see what the form is supposed to look like regardless of your computer configuration) and as a Word Document (so you can make changes if you like).</p>
<p>I've also provided a short set of instructions.</p>
<ul>
<li><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017c322a2406970b"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_evaluations_overview_and_instructions_v2.0.pdf">Instructions and Rationale</a></span></li>
</ul>
<p><span style="font-size: 12pt; color: #525330;"><strong>   <br />The Forms</strong></span></p>
<p><strong>1. </strong><strong> </strong><span style="text-decoration: underline;"><strong> Player Ranking Form:</strong></span>  This form evaluates players on 26 soccer competencies and 4 player-comparison items, giving each player a numerical score based on these items AND an overall rating. This form is intended to provide leagues with ranking information so that they can better place players on teams for the upcoming season. </p>
<ul>
<li><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017c322a2969970b"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_ranking_form_v2.0.pdf">
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c586acd970c"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_ranking_form_v2.0-2.docx">
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c586b1e970c"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_ranking_form_v2.0-1.pdf">PDF---Will's_Youth-Soccer_PLAYER_RANKING_FORM_v2.0</a></span></a></span></a></span></li>
<li><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017c322a2969970b">
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017c322a2ab4970b"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_ranking_form_v2.0.docx" /></span></span>
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017c322a3d53970b"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_ranking_form_v2.0-1.docx">WORD---Will's_Youth-Soccer_PLAYER_RANKING_FORM_v2.0</a></span><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017c322a2969970b"><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017c322a2ab4970b"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_ranking_form_v2.0.docx"><br /></a></span></span></li>
</ul>
<p><strong>   <br />2. <span style="text-decoration: underline;">Player Development Form:</span></strong>  This form evaluates players on the 26 soccer competencies. This form is intended for use by coaches to help support their players in development. Indeed, this form can be shared with players and parents to help players focus on their development needs.</p>
<ul>
<li><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdb622970d"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_development_form_v2.0.pdf" /></span>
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdc5b7970d"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_development_form_v2.0-2.pdf">PDF---Will's_Youth-Soccer_PLAYER_DEVELOPMENT_FORM_v2.0</a></span><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdb622970d"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_development_form_v2.0.pdf" /></span></li>
<li><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdb622970d">
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017c322a2c79970b"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_development_form_v2.0-1.pdf" /></span></span>
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdc645970d"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_development_form_v2.0.docx">WORD---Will's_Youth-Soccer_PLAYER_DEVELOPMENT_FORM_v2.0</a></span><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdb622970d"><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017c322a2c79970b"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_player_development_form_v2.0-1.pdf" /></span></span></li>
</ul>
<p><strong>    <br />3. <span style="text-decoration: underline;">Team Evaluation Form:</span></strong>  This form helps coaches use practices and games to evaluate their players on the 26 key competencies. Specifically, it enables them to use one two-page form to evaluate every player on their team.</p>
<ul>
<li><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c585cab970c"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_team_review_form_v2.0.pdf" /></span>
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c586be7970c"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_team_review_form_v2.0-1.pdf">PDF---Will's_Youth-Soccer_TEAM_REVIEW_FORM_v2.0</a></span><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c585cab970c"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_team_review_form_v2.0.pdf" /></span></li>
<li><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c585cab970c">
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdb99b970d"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_team_review_form_v2.0.docx" /></span></span>
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c586c36970c"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_team_review_form_v2.0-1.docx">WORD---Will's_Youth-Soccer_TEAM_REVIEW_FORM_v2.0</a></span><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c585cab970c"><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdb99b970d"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_team_review_form_v2.0.docx" /></span></span></li>
</ul>
<p>   <br /><strong>4. <span style="text-decoration: underline;">Field Evaluation Form:</span></strong>  This form enables skilled evaluators to judge the performance of players during small-group scrimmages. Like the Player Ranking Form, it provides player-comparison information to leagues (or to soccer clubs).</p>
<ul>
<li>
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c585ee6970c"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_field_evaluation_form_v2.0.pdf" /></span>
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdc8b4970d"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_field_evaluation_form_v2.0-1.pdf">PDF---Will's_Youth-Soccer_FIELD_EVALUATION_FORM_v2.0</a></span><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c585ee6970c"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_field_evaluation_form_v2.0.pdf" /></span></li>
<li><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c585ee6970c">
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdbbec970d"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_field_evaluation_form_v2.0.docx" /></span></span>
<span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c586cdc970c"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_field_evaluation_form_v2.0-1.docx">WORD---Will's_Youth-Soccer_FIELD_EVALUATION_FORM_v2.0</a></span><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017d3c585ee6970c"><span class="asset  asset-generic at-xid-6a00d8341cf01053ef017ee3cdbbec970d"><a href="http://willthalheimer.typepad.com/files/wills_youth-soccer_field_evaluation_form_v2.0.docx" /></span><br /></span></li>
</ul>
<p>   <br /><span style="font-size: 12pt;"><strong>The Most Common Mistakes in Youth-Soccer Evaluation </strong></span></p>
<ol>
<li><strong>When skills evaluated are not clear to evaluators.</strong> So for example, having players rated on their “agility” will not provide good data because “agility” will likely mean different things to different people.</li>
<li><strong>When skills are evaluated along too many dimensions.</strong> So for example, evaluating a player on their “ball-handling skills, speed, and stamina” covers too many dimensions at once—a player could have excellent ball-handling skills but have terrible stamina.</li>
<li><strong>When the rating scales that evaluators are asked to use make it hard to select between different levels of competence.</strong> So for example, while “ball-handling” might reasonably be evaluated, it may be hard for an evaluator to determine whether a player is excellent, very good, average, fair, or poor in ball-handling. Generally, it is better to have clear criteria and ask whether or not a player meets those criteria. Four or Five-Point scales are not recommended.</li>
<li><strong>When evaluators can’t assess skills because of the speed of action, the large number of players involved, or the difficulty of noticing the skills targeted.</strong> For example, evaluations of scrimmages that involve more than four players on a side make it extremely difficult for the evaluators to notice the contributions of each player. </li>
<li><strong>When bias affects evaluators’ judgments.</strong> Because the human mind is always working subconsciously, biases can be easily introduced. So for example, it is bad practice to give evaluators the coaches’ ratings of players before those players take part in a scrimmage-based evaluation.</li>
<li><strong>When bias leads to a generalized positive or negative evaluation.</strong> Because evaluation is difficult and is largely a subconscious process, a first impression can skew an evaluation away from what is valid. For example, when a player is seen as getting outplayed in the first few minutes of a scrimmage, his/her later excellent play may be ignored or downplayed. Similarly, when a player is intimidated early in the season, a coach may not fully notice his/her gritty determination later in the year.</li>
<li><strong>When bias comes from too few observations.</strong> Because evaluation is an inexact process, evaluation results are likely to be more valid if the evaluation utilizes (a) more observations (b) by more evaluators (c) focusing on more varied soccer situations. Coaches who see their players over time and in many soccer situations are less likely to suffer from bias, although they too have to watch out that their first impressions don’t cloud their judgments. And of course, it is helpful to get assessments beyond one or two coaches.</li>
<li><strong>When players are either paired with, or are playing against, players who are unrepresentative of realistic competition.</strong> For example, players who are paired against really weak players may look strong in comparison. Players who are paired as teammates with really good players may look strong because of their teammates’ strong play. Finally, players who only have experience playing weaker players may not play well when being evaluated against stronger players even though they might be expected to improve by moving up and gaining experience with those same players.</li>
<li><strong>When the wrong things are evaluated.</strong> Obviously, it’s critical to evaluate the right soccer skills. So for example, evaluating a player on how well he/she can pass to a stationary player is not as valid as seeing whether good passes are made in realistic game-like situations when players are moving around. The more game-like the situations, the better the evaluation.</li>
<li><strong>When evaluations are done by remembering, not observing.</strong> Many coaches fill out their evaluation forms back home late at night instead of evaluating their players while observing them. The problem with this memory-based approach is that introduces huge biases into the process. First, memory is not perfect, so evaluators may not remember correctly. Second, memory is selective. We remember some things and forget others. Players must be evaluated primarily through observation, not memory.</li>
<li><strong>Encouraging players to compare themselves to others.</strong> As coaches, one of our main goals is to help our players learn to develop their skills as players, as teammates, as people, and as thinkers. Unfortunately, when players focus on how well they are doing in comparison to others, they are less likely to focus on their own skill development. It is generally a mistake to use evaluations to encourage players to compare themselves to others. While players may be inclined to compare themselves to others, coaches can limit the negative effects of this by having each player focus on their own key competencies to improve.</li>
<li><strong>Encouraging players to focus on how good they are overall, instead of having them focus on what they are good at and what they still have to work on.</strong> For our players to get better, they have to put effort into getting better. If they believe their skills are fixed and not easily changed, they will have no motivation to put any effort into their own improvement. Evaluations should be designed NOT to put kids in categories (except when absolutely necessary for team assignments and the like), but rather to show them what they need to work on to get better. As coaches, we should teach the importance of giving effort to deliberate practice, encouraging our players to refine and speed their best skills and improve on their weakest skills. </li>
<li><strong>Encouraging players to focus on too many improvements at once.</strong> To help our players (a) avoid frustration, (b) avoid thinking of themselves as poor players, and (c) avoid overwhelming their ability to focus, we ought to have them only focus on a few major self-improvement goals at one time. </li>
</ol>
<p> </p></div>
</content>



    </entry>
    <entry>
        <title>Feedback for Learners. Learn by Subscription Learning!!</title>
        <link rel="alternate" type="text/html" href="http://www.willatworklearning.com/2012/07/feedback-for-learners-learn-by-subscription-learning.html" />
        <link rel="replies" type="text/html" href="http://www.willatworklearning.com/2012/07/feedback-for-learners-learn-by-subscription-learning.html" thr:count="2" thr:updated="2012-08-20T07:59:17-04:00" />
        <id>tag:typepad.com,2003:post-6a00d8341cf01053ef0177438f252d970d</id>
        <published>2012-07-23T23:21:12-04:00</published>
        <updated>2012-07-23T23:21:12-04:00</updated>
        <summary>Subscription Learning is one way to implement the spacing effect--one of the best ways to help people learn so they don't forget, so that they can actually remember what to do on the job. The best way to experience subscription...</summary>
        <author>
            <name>Will Thalheimer</name>
        </author>
        
        
<content type="xhtml" xml:lang="en-US" xml:base="http://www.willatworklearning.com/">
<div xmlns="http://www.w3.org/1999/xhtml"><p>Subscription Learning is one way to implement the spacing effect--one of the best ways to help people learn so they don't forget, so that they can actually remember what to do on the job.</p>
<p>The best way to experience subscription learning is to sign up for a subscription learning thread. With this in mind, I've created a free subscription-learning thread on how to give learners feedback.</p>
<p><a href="http://www.work-learning.com/subscription-learning-threads.html" target="_blank">You can check it out by clicking here</a>.</p></div>
</content>



    </entry>
    <entry>
        <title>Stop Using Slide Templates</title>
        <link rel="alternate" type="text/html" href="http://www.willatworklearning.com/2012/07/stop-using-slide-templates.html" />
        <link rel="replies" type="text/html" href="http://www.willatworklearning.com/2012/07/stop-using-slide-templates.html" thr:count="2" thr:updated="2012-07-25T13:00:48-04:00" />
        <id>tag:typepad.com,2003:post-6a00d8341cf01053ef0167689c275b970b</id>
        <published>2012-07-19T13:28:02-04:00</published>
        <updated>2012-07-19T13:28:02-04:00</updated>
        <summary>Too many organizations insist on using slide templates (slide decorations) in their training slides and presentations. This is a bad idea, and I've created the following narrated slide deck to make a research-based case against these bedeviling adornments: On YouTube...</summary>
        <author>
            <name>Will Thalheimer</name>
        </author>
        <category scheme="http://www.sixapart.com/ns/types#category" term="Thoughts on Learning Practice" />
        
        
<content type="xhtml" xml:lang="en-US" xml:base="http://www.willatworklearning.com/">
<div xmlns="http://www.w3.org/1999/xhtml"><p>Too many organizations insist on using slide templates (slide decorations) in their training slides and presentations. This is a bad idea, and I've created the following narrated slide deck to make a research-based case against these bedeviling adornments:</p>
<ul>
<li><a href="http://www.youtube.com/watch?v=nyvQf3cuPEs" target="_blank">On YouTube</a></li>
<li><a href="https://vimeo.com/46035533/" target="_blank">On Vimeo</a></li>
</ul></div>
</content>



    </entry>
 
</feed><!-- ph=1 -->
