<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>AEA365</title>
	<atom:link href="https://aea365.org/blog/feed/" rel="self" type="application/rss+xml" />
	<link>https://aea365.org/blog</link>
	<description>A Tip-a-Day by and for Evaluators</description>
	<lastBuildDate>Mon, 24 Aug 2026 15:10:00 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	
	<item>
		<title>OL-ECB TIG Week: When More Precise Data Isn’t Enough: Double-Loop Learning in Evaluation Practice by Elizabeth Devaney</title>
		<link>https://aea365.org/blog/ol-ecb-tig-week-when-more-precise-data-isnt-enough-double-loop-learning-in-evaluation-practice-by-elizabeth-devaney/</link>
					<comments>https://aea365.org/blog/ol-ecb-tig-week-when-more-precise-data-isnt-enough-double-loop-learning-in-evaluation-practice-by-elizabeth-devaney/#respond</comments>
		
		<dc:creator><![CDATA[AEA365 Contributor, Curated by Elizabeth Grim]]></dc:creator>
		<pubDate>Tue, 08 Sep 2026 06:00:00 +0000</pubDate>
				<category><![CDATA[Organizational Learning and Evaluation Capacity Building]]></category>
		<guid isPermaLink="false">https://aea365.org/blog/?p=33884</guid>

					<description><![CDATA[Greetings! I’m Elizabeth Devaney, an organizational learning consultant and evaluator in the San Francisco Bay Area. After 30 years in nonprofit leadership, I returned to school to study how evaluators can better help organizations strengthen their work in times of change. One of the most useful tools I discovered on my doctoral journey was the [&#8230;]]]></description>
										<content:encoded><![CDATA[
<figure class="wp-block-image alignleft size-large is-resized"><img fetchpriority="high" decoding="async" width="1024" height="843" src="https://aea365.org/blog/wp-content/uploads/2026/08/3_Devaney_Professional-Headshot-1024x843.png" alt="Elizabeth Devaney" class="wp-image-33899" style="width:auto;height:250px" srcset="https://aea365.org/blog/wp-content/uploads/2026/08/3_Devaney_Professional-Headshot-1024x843.png 1024w, https://aea365.org/blog/wp-content/uploads/2026/08/3_Devaney_Professional-Headshot-300x247.png 300w, https://aea365.org/blog/wp-content/uploads/2026/08/3_Devaney_Professional-Headshot-768x632.png 768w, https://aea365.org/blog/wp-content/uploads/2026/08/3_Devaney_Professional-Headshot.png 1069w" sizes="(max-width: 1024px) 100vw, 1024px" /></figure>



<p class="wp-block-paragraph">Greetings! I’m <strong>Elizabeth Devaney</strong>, an organizational learning consultant and evaluator in the San Francisco Bay Area. After 30 years in nonprofit leadership, I returned to school to study how evaluators can better help organizations strengthen their work in times of change. One of the most useful tools I discovered on my doctoral journey was the concept of double-loop learning.</p>



<p class="wp-block-paragraph">Consider this scenario. An organization reviews the findings of a program evaluation and responds appropriately: staff adjust their outreach strategies, revise workflows, and improve participant communications. Activities, outputs, and outcomes are monitored according to the program’s logic model and theory of change. However, six months later the program’s results remain poor. Why? Because the organization may have learned from the evaluation, but only within the bounds of its existing assumptions.</p>



<p class="wp-block-paragraph"><a href="https://books.google.com/books?id=3aMoAQAAMAAJ" target="_blank" rel="noopener">Chris Argyris and Donald Schön</a> describe organizational learning as occurring through single- and double-loop pathways. Single-loop learning improves existing actions, while double-loop learning examines whether the assumptions, beliefs, and governing variables behind those actions remain valid. Single-loop learning asks, “Are we doing things right?” while double-loop learning asks, “Are we doing the right things?” Both questions matter. But more precise data will not resolve a problem when the underlying explanation of how change is actually happening becomes invalid.</p>



<figure class="wp-block-image aligncenter size-large is-resized" style="margin-top:var(--wp--preset--spacing--30);margin-right:0;margin-bottom:var(--wp--preset--spacing--30);margin-left:0"><img decoding="async" width="1024" height="501" src="https://aea365.org/blog/wp-content/uploads/2026/08/3_Single-and-Double-Loop-Learning-Color-1024x501.png" alt="Diagram showing two feedback loops connecting actions to results. The inner loop adjusts actions within existing assumptions, and the outer loop tests and modifies those assumptions." class="wp-image-33898" style="width:1024px;height:auto" srcset="https://aea365.org/blog/wp-content/uploads/2026/08/3_Single-and-Double-Loop-Learning-Color-1024x501.png 1024w, https://aea365.org/blog/wp-content/uploads/2026/08/3_Single-and-Double-Loop-Learning-Color-300x147.png 300w, https://aea365.org/blog/wp-content/uploads/2026/08/3_Single-and-Double-Loop-Learning-Color-767x375.png 767w, https://aea365.org/blog/wp-content/uploads/2026/08/3_Single-and-Double-Loop-Learning-Color.png 1067w" sizes="(max-width: 1024px) 100vw, 1024px" /></figure>



<h4 class="wp-block-heading"><strong>Lesson Learned: Every theory of change is a collection of assumptions</strong></h4>



<p class="wp-block-paragraph">A theory of change or logic model shows a precise sequence of activities and outcomes, but each arrow contains an assumptive claim: If we do this, then that will happen. Those claims may take for granted that participants trust the organization, staff possess effective interpersonal skills, or that external conditions remain stable.</p>



<p class="wp-block-paragraph">When results fall short of expectations, we often focus on the boxes: was the activity implemented with fidelity? Did our outreach reach enough people? Were our communications compelling? We check to see if we did everything right. This is single-loop learning.</p>



<p class="wp-block-paragraph">Double-loop learning directs attention to the arrows: what do we believe connects this activity to that outcome, and what evidence could we gather to test that belief? Double-loop learning opens new opportunities for evaluation and, as a result, program improvement.</p>



<h4 class="wp-block-heading"><strong>Hot Tips</strong></h4>



<h5 class="wp-block-heading"><strong>Make assumptions visible before prioritizing them</strong></h5>



<p class="wp-block-paragraph">I invite teams to annotate each connection in their logic model or theory of change by completing this sentence: “We expect A to lead to B because we assume ______.” We then examine the assumptions using three questions:</p>



<ol class="wp-block-list">
<li>How critical is this assumption to achieving the intended outcome?</li>



<li>How certain is it?</li>



<li>What are the consequences if it is incorrect?</li>
</ol>



<p class="wp-block-paragraph">Assumptions that are highly consequential and highly uncertain are strong candidates for testing.</p>



<h5 class="wp-block-heading"><strong>Turn critical assumptions into learning questions</strong></h5>



<p class="wp-block-paragraph">Reframe assumptions as questions the evaluation can investigate. The assumption that “Participants will use the service if we communicate more frequently,” becomes, “What conditions influence whether participants view the service as relevant, accessible, and trustworthy?” The latter question opens inquiry beyond tactics and may reveal barriers in program design, organizational relationships, or the service model itself.</p>



<h5 class="wp-block-heading"><strong>Create a recurring assumption review</strong></h5>



<p class="wp-block-paragraph">A well-designed logic model helps teams make their causal reasoning explicit and offers assumptions to test. For example, evaluators may introduce a set of constituent interviews to investigate how participants’ current experiences might be affecting their responsiveness to the organization’s communications. Ask how the evidence strengthens, weakens, or complicates the leaders’ understandings, and what must be reconsidered as a result.</p>



<p class="wp-block-paragraph">Our challenge as evaluators is rarely convincing organizations to improve performance. Our greater opportunity is helping them identify which measures deserve examination – because sometimes the most useful finding is not a more precise answer, but a better question.<a id="_msocom_1"></a></p>



<hr class="wp-block-separator has-css-opacity"/>



<p class="wp-block-paragraph"><em><em>The American Evaluation Association is hosting Organizational Learning and Evaluation Capacity Building (OL-ECB) Topical Interest Group Week. The contributions all this week to AEA365 come from our OL-ECB TIG members. Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the</em><a href="http://aea365.org/blog/"><em>&nbsp;AEA365 webpage</em></a><em>&nbsp;so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? <em><em>Please do so using&nbsp;<a href="https://aea365.org/blog/submit-a-post/"><strong><em>the form</em></strong></a>&nbsp;on our website.</em></em> AEA365 is sponsored by the</em><a href="http://eval.org/"><em>&nbsp;American Evaluation Association</em></a><em>&nbsp;and provides a Tip-a-Day by and for evaluators.&nbsp;The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.</em></em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://aea365.org/blog/ol-ecb-tig-week-when-more-precise-data-isnt-enough-double-loop-learning-in-evaluation-practice-by-elizabeth-devaney/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>OL-ECB TIG Week: Learning When the Ground Keeps Shifting by Kenneth Chomba, Chris Kif, and Maria Selde</title>
		<link>https://aea365.org/blog/ol-ecb-tig-week-learning-when-the-ground-keeps-shifting-by-kenneth-chomba-chris-kif-and-maria-selde/</link>
					<comments>https://aea365.org/blog/ol-ecb-tig-week-learning-when-the-ground-keeps-shifting-by-kenneth-chomba-chris-kif-and-maria-selde/#respond</comments>
		
		<dc:creator><![CDATA[AEA365 Contributor, Curated by Elizabeth Grim]]></dc:creator>
		<pubDate>Mon, 07 Sep 2026 06:00:00 +0000</pubDate>
				<category><![CDATA[Organizational Learning and Evaluation Capacity Building]]></category>
		<guid isPermaLink="false">https://aea365.org/blog/?p=33885</guid>

					<description><![CDATA[Hi. We&#8217;re Kenneth Chomba, Network Coordinator at the African Coaching Network (ACN); Chris Kif, Co-Director at Sauti Bridge; and Maria Selde of Humanity United, whose team has accompanied ACN’s work as a learning partner. Between us, we support and evaluate social movements across Africa, work that rarely stays still long enough for a tidy programme [&#8230;]]]></description>
										<content:encoded><![CDATA[
<figure class="wp-block-image alignfull size-large"><img decoding="async" width="1024" height="339" src="https://aea365.org/blog/wp-content/uploads/2026/08/Chomba-Chris-Maria-1-1024x339.png" alt="" class="wp-image-33893" srcset="https://aea365.org/blog/wp-content/uploads/2026/08/Chomba-Chris-Maria-1-1024x339.png 1024w, https://aea365.org/blog/wp-content/uploads/2026/08/Chomba-Chris-Maria-1-300x99.png 300w, https://aea365.org/blog/wp-content/uploads/2026/08/Chomba-Chris-Maria-1-767x254.png 767w, https://aea365.org/blog/wp-content/uploads/2026/08/Chomba-Chris-Maria-1-1536x509.png 1536w, https://aea365.org/blog/wp-content/uploads/2026/08/Chomba-Chris-Maria-1-2048x678.png 2048w" sizes="(max-width: 1024px) 100vw, 1024px" /><figcaption class="wp-element-caption"><em>From left to right: Kenneth Chomba, Chris Kif, and Maria Selde</em></figcaption></figure>



<p class="wp-block-paragraph">Hi. We&#8217;re <strong>Kenneth Chomba</strong>, Network Coordinator at the African Coaching Network (ACN); <strong>Chris Kif</strong>, Co-Director at Sauti Bridge; and <strong>Maria Selde</strong> of Humanity United, whose team has accompanied ACN’s work as a learning partner. Between us, we support and evaluate social movements across Africa, work that rarely stays still long enough for a tidy programme cycle.</p>



<p class="wp-block-paragraph">Complexity scientists, systems thinkers, and champions of developmental evaluation have warned us that linear frameworks, like traditional logframes, clash with reality in volatile environments. Movements are complex adaptive systems; they don&#8217;t sit still when programs and data collection are treated as separate, sequential tracks. The work and the meaning of the work happen at the same time, often in the same breath, and a framework built for one doesn&#8217;t always serve the other. Here is a story about what that looks like in practice, from inside our own evaluation.</p>



<p class="wp-block-paragraph">As ACN turns a decade old, we faced the question every long-running network faces: How do you know what a decade of work has meant? A conventional review asks for numbers: trainings delivered, campaigns supported, coaches retained. We had those numbers, but they describe program outputs, and ACN is a living system in thirteen countries spanning five languages, a community of people who found each other doing this work long before it had a name</p>



<p class="wp-block-paragraph">So we evaluated ourselves differently. Instead of a logframe review, we used Roots, Branches, and Fruits, or RBF, a framework that treats a movement&#8217;s life the way a living thing grows rather than the way a project gets delivered. Roots asks what let our coaches tell the truth about what they were living through, often for the first time. Branches asks where that truth travelled once it was safe to speak, into new alliances, new rooms we hadn&#8217;t planned to enter. Fruits asks what became possible only when both had held.</p>



<p class="wp-block-paragraph">What that process surfaced wasn&#8217;t only the wins. It surfaced what we&#8217;ve started calling the Resilience Tax, the toll absorbed, quietly and often unobserved, by whoever holds a network together through repression, funding cycles, and grief.</p>



<h4 class="wp-block-heading"><strong>Lesson Learned: Naming the Hard Truth is What Makes the Next Step Possible</strong><strong></strong></h4>



<p class="wp-block-paragraph">RBF has a name for this part of the work, the Bitter Harvest, the truths a movement must sit with honestly before it can move on. For us, that meant admitting things a funder report never asks about: the burnout carried by a small core of people, the cost of holding a family-style network together for a decade. Naming it honestly didn&#8217;t slow us down. It was what let us imagine our next ten years with clarity.</p>



<p class="wp-block-paragraph">In the fields of peacebuilding evaluation and research in conflict-affected environments, practitioners have long grappled with how standard metrics miss the invisible labor of safety, trauma-informed accompaniment, and social cohesion. Organisations and networks operating in contexts of fragility know that quantitative outputs (like training delivered or documents produced) frequently mask the profound human infrastructure required just to keep a community breathing.</p>



<h4 class="wp-block-heading"><strong>Hot Tip: Shift From Tools to Mindset</strong></h4>



<p class="wp-block-paragraph">Evaluating in unstable conditions requires a shift in mindset over new tools. And more often, the work is not fitting neatly within a programme because of such fragility. This is therefore an invitation to consider understanding change as spiral movement &#8211; where the untidy work and its meaning belong together.</p>



<p class="wp-block-paragraph">So, we leave you with a question: how can your evaluation capture more than the wins, counting what it costs to get there, beyond the money and the budget lines? <strong></strong></p>



<h4 class="wp-block-heading"><strong>Rad Resources</strong></h4>



<ul class="wp-block-list">
<li><a href="https://acn-learning-journey.netlify.app/" target="_blank" rel="noopener">The full ACN learning Journey</a></li>



<li><a href="https://www.participatorymethods.org/2026/07/01/turning-emerging-ideas-into-practice-the-inclusive-rigour-canvas/" target="_blank" rel="noopener">Turning emerging ideas into practice</a> (blog): <a href="https://www.participatorymethods.org/resource/inclusive-rigour-design-workbook/" target="_blank" rel="noopener">the Inclusive Rigor Design Canvas</a> (resource)</li>



<li><a href="https://www.cdacollaborative.org/resources/" target="_blank" rel="noopener">Peacebuilding Evaluation Resources</a></li>
</ul>



<hr class="wp-block-separator has-css-opacity"/>



<p class="wp-block-paragraph"><em><em>The American Evaluation Association is hosting Organizational Learning and Evaluation Capacity Building (OL-ECB) Topical Interest Group Week. The contributions all this week to AEA365 come from our OL-ECB TIG members. Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the</em><a href="http://aea365.org/blog/"><em> AEA365 webpage</em></a><em> so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? <em><em>Please do so using <a href="https://aea365.org/blog/submit-a-post/"><em><strong>the form</strong></em></a> on our website.</em></em> AEA365 is sponsored by the</em><a href="http://eval.org/"><em> American Evaluation Association</em></a><em> and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.</em></em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://aea365.org/blog/ol-ecb-tig-week-learning-when-the-ground-keeps-shifting-by-kenneth-chomba-chris-kif-and-maria-selde/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>OL-ECB TIG Week: Making the Most of Leadership Transitions: Practical Reflections by Michelle Borckardt</title>
		<link>https://aea365.org/blog/ol-ecb-tig-week-making-the-most-of-leadership-transitions-practical-reflections-by-michelle-borckardt/</link>
					<comments>https://aea365.org/blog/ol-ecb-tig-week-making-the-most-of-leadership-transitions-practical-reflections-by-michelle-borckardt/#respond</comments>
		
		<dc:creator><![CDATA[AEA365 Contributor, Curated by Elizabeth Grim]]></dc:creator>
		<pubDate>Sun, 06 Sep 2026 06:00:00 +0000</pubDate>
				<category><![CDATA[Organizational Learning and Evaluation Capacity Building]]></category>
		<guid isPermaLink="false">https://aea365.org/blog/?p=33886</guid>

					<description><![CDATA[Greetings from Wisconsin! My name is Michelle Borckardt, and I am an internal evaluator at Gateway Technical College. I recently completed my Ph.D. in Leadership, Innovation, and Continuous Improvement, where I explored how public and nonprofit organizations can most effectively use evaluation results to support organizational learning and change. While completing my dissertation, I noticed a common pattern: many evaluation projects that led to meaningful improvements occurred during a leadership transition. Whether it was a new K-12 school superintendent, new board of directors, or new nonprofit program director, these transitions offered a unique window for evaluation, learning, and improvement.]]></description>
										<content:encoded><![CDATA[
<p class="has-text-align-center wp-block-paragraph"><em>Welcome AEA365 readers to the 2026 Organizational Learning and Evaluation Capacity Building (OL-ECB) TIG Week! I’m Kathryn Lowerre, Evaluation Section Manager for the Injury and Behavioral Epidemiology Bureau at the New Mexico Department of Health. For the next seven days we’ll be sharing posts from evaluators working across a variety of communities and disciplines, all seeking ways to foster meaningful learning and capacity building in times of change. Please see previous <a href="https://aea365.org/blog/category/organizational-learning-and-evaluation-capacity-building/" target="_blank" rel="noopener">OL-ECB weeks</a> for additional insights into what OL-ECB is, further exploring why and how we practice it. And please consider joining our TIG members for deeper dives and engaged discussion at virtual OL-ECB events throughout the year. Thanks for reading!</em></p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<figure class="wp-block-image alignleft size-large is-resized"><img loading="lazy" decoding="async" width="683" height="1024" src="https://aea365.org/blog/wp-content/uploads/2026/08/1_Borckardt_Headshot-683x1024.jpg" alt="Michelle Borckardt" class="wp-image-33888" style="width:auto;height:250px" srcset="https://aea365.org/blog/wp-content/uploads/2026/08/1_Borckardt_Headshot-683x1024.jpg 683w, https://aea365.org/blog/wp-content/uploads/2026/08/1_Borckardt_Headshot-200x300.jpg 200w, https://aea365.org/blog/wp-content/uploads/2026/08/1_Borckardt_Headshot-767x1151.jpg 767w, https://aea365.org/blog/wp-content/uploads/2026/08/1_Borckardt_Headshot-1024x1536.jpg 1024w, https://aea365.org/blog/wp-content/uploads/2026/08/1_Borckardt_Headshot-1365x2048.jpg 1365w, https://aea365.org/blog/wp-content/uploads/2026/08/1_Borckardt_Headshot-scaled.jpg 1707w" sizes="auto, (max-width: 683px) 100vw, 683px" /></figure>



<p class="wp-block-paragraph">Greetings from Wisconsin! My name is <strong>Michelle Borckardt</strong>, and I am an internal evaluator at Gateway Technical College. I recently completed my Ph.D. in Leadership, Innovation, and Continuous Improvement, where I explored how public and nonprofit organizations can most effectively use evaluation results to support organizational learning and change.</p>



<p class="wp-block-paragraph">While completing my dissertation, I noticed a common pattern: many evaluation projects that led to meaningful improvements occurred during a leadership transition. Whether it was a new K-12 school superintendent, new board of directors, or new nonprofit program director, these transitions offered a unique window for evaluation, learning, and improvement.</p>



<h4 class="wp-block-heading"><strong>Lessons Learned: Leadership Transitions as a Window for Evaluation Use</strong></h4>



<ul class="wp-block-list">
<li><strong>New leaders are less entrenched.</strong> They are often willing to try things that previous leaders may not have considered. Longstanding leaders often have deeply held assumptions about their programs. A new leader is less tied to tradition and is often more open to exploring what the data actually says.</li>



<li><strong>The desire to “make a mark.”</strong> New leaders often want to understand what’s working and what isn’t so they can set a new direction and make their mark on the organization. Evaluation can be an important way to gain this understanding and surface opportunities for improvement.</li>



<li><strong>A shift in organizational culture.</strong> Leadership transitions inherently introduce uncertainty. During this period, the team pays closer attention to the new leader’s priorities and operational methods. If the leader arrives with a passion for evaluation and organizational learning, that helps cultivate a learning culture.</li>
</ul>



<p class="wp-block-paragraph">That said, leadership transitions do not <em>always</em> lead to positive change. I have sadly seen some new leaders erode psychological safety, create confusion, and destabilize team effectiveness. Evaluators must approach these moments with humility, empathy, and close attention to organizational culture.</p>



<h5 class="wp-block-heading"><strong>Hot Tips for Engaging New Leaders</strong></h5>



<ul class="wp-block-list">
<li><strong>Schedule a passion and goals exploration meeting.</strong> Request time to meet the new leader to explore their passions, why they chose to work at this organization, and what they see as the organization’s biggest challenges over the next 3-5 years. Foster their curiosity by showing them how evaluation can help them better achieve their specific mission and goals.</li>



<li><strong>Explore the leader’s prior experience with data and evaluation.</strong> Many leaders value data but may lack the specific skills to analyze and interpret it. Ask how they have seen data used effectively or ineffectively in previous roles. If they lack evaluation experience, offer practical support in framing evaluation questions, collecting data, interpreting findings, and identifying next steps.</li>



<li><strong>Involve the right stakeholders early.</strong> Leadership transitions also provide an opportunity to build <em>shared</em> understanding of the organization’s needs among the entire team. Encourage the leader to engage a diverse range of stakeholders in designing evaluations, interpreting findings, and using the results.</li>



<li><strong>Model the culture.</strong> Leaders shape organizational culture through what they communicate, the behaviors they model, and the behaviors of others they reward or sanction. Encourage the leader to communicate the importance of continuous improvement while establishing a psychologically safe environment. When a leader models and rewards data-informed behaviors, it signals to the rest of the organization that evaluation is a vehicle for learning and excellence, not for blame or punishment.</li>



<li><strong>Focus on professional accountability.</strong> The team may ignore even the best evaluation project if the status quo is more comfortable than change. Encourage the leader to hold the organization accountable to a high degree of excellence by assigning task owners, timelines, and follow-up conversations to track implementation of evaluation findings.</li>
</ul>



<p class="wp-block-paragraph">When the organization has a new leader, embrace this unique opportunity for change! It is a wonderful chance to embed evaluation into the organization’s future.</p>



<hr class="wp-block-separator has-css-opacity"/>



<p class="wp-block-paragraph"><em><em>The American Evaluation Association is hosting Organizational Learning and Evaluation Capacity Building (OL-ECB) Topical Interest Group Week. The contributions all this week to AEA365 come from our OL-ECB TIG members. Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the</em><a href="http://aea365.org/blog/"><em>&nbsp;AEA365 webpage</em></a><em>&nbsp;so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? <em><em>Please do so using&nbsp;<a href="https://aea365.org/blog/submit-a-post/"><strong><em>the form</em></strong></a>&nbsp;on our website.</em></em> AEA365 is sponsored by the</em><a href="http://eval.org/"><em>&nbsp;American Evaluation Association</em></a><em>&nbsp;and provides a Tip-a-Day by and for evaluators.&nbsp;The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.</em></em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://aea365.org/blog/ol-ecb-tig-week-making-the-most-of-leadership-transitions-practical-reflections-by-michelle-borckardt/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>GEDI Week: Connecting Systems Change, Cultural Responsiveness, and Impact in Practice by Nishat Akhi</title>
		<link>https://aea365.org/blog/gedi-week-connecting-systems-change-cultural-responsiveness-and-impact-in-practice-by-nishat-akhi/</link>
					<comments>https://aea365.org/blog/gedi-week-connecting-systems-change-cultural-responsiveness-and-impact-in-practice-by-nishat-akhi/#respond</comments>
		
		<dc:creator><![CDATA[AEA365 Contributor, Curated by Elizabeth Grim]]></dc:creator>
		<pubDate>Sat, 05 Sep 2026 06:00:00 +0000</pubDate>
				<category><![CDATA[Graduate Education Diversity Internship]]></category>
		<guid isPermaLink="false">https://aea365.org/blog/?p=33656</guid>

					<description><![CDATA[Hi! I’m Nishat Akhi, a doctoral student from Bangladesh studying at Boston College and an AEA Graduate Education Diversity Internship (GEDI) scholar. During my internship with Intention 2 Impact (I2I), I expected to learn new methods and better understand how evaluators measure systems change. I did. But my most important learning came from watching how [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p class="wp-block-paragraph">Hi! I’m <strong>Nishat Akhi</strong>, a doctoral student from Bangladesh studying at Boston College and an AEA Graduate Education Diversity Internship (GEDI) scholar. During my internship with <a href="https://intention2impact.com/" target="_blank" rel="noreferrer noopener">Intention 2 Impact</a> (I2I), I expected to learn new methods and better understand how evaluators measure systems change. I did. But my most important learning came from watching how systems thinking, cultural responsiveness, and the idea that <a href="https://intention2impact.com/impact-is-a-verb/" target="_blank" rel="noreferrer noopener">impact is a verb</a> continually shaped one another in practice. That last idea is the one I want to stay with, because it changed what the other two meant to me.</p>



<p class="wp-block-paragraph">Before beginning my GEDI internship, I was already familiar with systems change through my doctoral research. I use systems approaches to examine the conditions that sustain inequities and to make visible the relationships among policies, practices, resources, relationships, power, and mental models.</p>



<p class="wp-block-paragraph">Then, across I2I’s work, I participated in evaluation processes designed not only to measure outcomes but also to support learning and decision-making. Evaluation frameworks examined change across individuals, organizations, portfolios, and broader systems. Theories of change were revisited as strategies developed. This helped me see that evaluating systems change requires more than adding systems-level outcomes to a framework. It also requires an evaluation process that can respond to complexity, emerging information, and changes in context. The focus is not only on what has changed, but also on what people are learning and how that learning informs the next decision.</p>



<p class="wp-block-paragraph"><a href="https://expandingthebench.org/cree-definition/" target="_blank" rel="noreferrer noopener">Culturally responsive and equitable evaluation</a> added another important dimension. A systems approach can help identify the conditions influencing an issue, but it does not automatically address whose knowledge shapes the analysis. Culturally responsive practice asks who defines the problem, whose experiences inform the evaluation questions, what counts as evidence, who interprets the findings, and how the results are communicated. In this way, cultural responsiveness does not sit beside a systems approach. It shapes the analysis a systems approach makes possible.</p>



<h4 class="wp-block-heading"><strong>Lessons Learned</strong></h4>



<p class="wp-block-paragraph"><strong>How we evaluate is already shaping the system. </strong>This is where “impact is a verb” began to mean something different to me. If impact is only a noun, we wait for it to appear in a final report. When impact becomes a verb, it shows up in how we listen, co-create, question, revise, share power, and respond to what we learn. Evaluation does not simply document change. It participates in creating the conditions through which change becomes possible.</p>



<p class="wp-block-paragraph"><strong>The three concepts strengthen one another. </strong>Systems thinking helps evaluators examine the conditions that sustain inequities. Cultural responsiveness helps ensure that culture, context, knowledge, and power are considered throughout that examination. Treating impact as a verb connects both to action by asking how measurement, learning, and communication influence what happens next.</p>



<h4 class="wp-block-heading"><strong>Hot Tips</strong></h4>



<p class="wp-block-paragraph"><strong>Connect each evaluation activity to a use.</strong> For every evaluation question, indicator, sensemaking activity, or product, ask: Who will use this? What decision could it inform? How might it help people adapt their strategy? This shifts evaluation from producing evidence to creating opportunities for evidence to be used.</p>



<p class="wp-block-paragraph"><strong>Look for impact in the present tense.</strong> Ask yourself: What are we practicing now that reflects the future we say we want? Whose knowledge is shaping our decisions? What are we doing differently because of what we learned? If impact exists only in the future tense, our current practices may need another look.</p>



<h4 class="wp-block-heading"><strong>Rad Resources</strong></h4>



<ul class="wp-block-list">
<li>Emily F. Gates and Pablo Vidueira’s <em><a href="https://collegepublishing.sagepub.com/products/evaluative-inquiry-for-systemic-change-1-290068" target="_blank" rel="noreferrer noopener">Evaluative Inquiry for Systemic Change: A Guide to Shift Beyond Fixes to Lasting Value</a> </em>offers guidance for embedding evaluative inquiry within systemic-change efforts. </li>



<li>I2I’s <a href="https://intention2impact.com/impact-is-a-verb/" target="_blank" rel="noreferrer noopener">Impact Is a Verb series</a> provides examples of how measurement, learning, communication, and strategy can work together in practice.</li>
</ul>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p class="wp-block-paragraph"><em>The American Evaluation Association is hosting Graduate Education Diversity Internship (GEDI) Program week. The contributions all this week to AEA365 come from AEA’s GEDI Program and its interns. For more information on GEDI, see their webpage here: </em><a href="http://www.eval.org/GEDI"><em>http://www.eval.org/GEDI</em></a><em>  Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the</em><a href="http://aea365.org/blog/"><em> AEA365 webpage</em></a><em> so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? <em><em><em>Please do so using </em><a href="https://aea365.org/blog/submit-a-post/"><strong><em>the form</em></strong></a><em> on our website.</em></em></em> AEA365 is sponsored by the</em><a href="http://eval.org/"><em> American Evaluation Association</em></a><em> and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.</em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://aea365.org/blog/gedi-week-connecting-systems-change-cultural-responsiveness-and-impact-in-practice-by-nishat-akhi/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>GEDI Week: Cracking the Code: AI, Evaluation Methods, and Human Judgment by Shelita Augustus</title>
		<link>https://aea365.org/blog/gedi-week-cracking-the-code-ai-evaluation-methods-and-human-judgment-by-shelita-augustus/</link>
					<comments>https://aea365.org/blog/gedi-week-cracking-the-code-ai-evaluation-methods-and-human-judgment-by-shelita-augustus/#respond</comments>
		
		<dc:creator><![CDATA[AEA365 Contributor, Curated by Elizabeth Grim]]></dc:creator>
		<pubDate>Fri, 04 Sep 2026 06:00:00 +0000</pubDate>
				<category><![CDATA[Graduate Education Diversity Internship]]></category>
		<guid isPermaLink="false">https://aea365.org/blog/?p=33655</guid>

					<description><![CDATA[Hi! My name is Shelita Hall-Augustus. This summer, I worked with the John D. and Catherine T. MacArthur Foundation through the AEA Graduate Education Diversity Internship (GEDI) to answer a question that affects all of us: can AI identify evaluation methods the way human evaluators do? I tested ChatGPT and Gemini against ten MacArthur Foundation [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p class="wp-block-paragraph">Hi! My name is <strong>Shelita Hall-Augustus</strong>. This summer, I worked with the John D. and Catherine T. MacArthur Foundation through the AEA Graduate Education Diversity Internship (GEDI) to answer a question that affects all of us: can AI identify evaluation methods the way human evaluators do? I tested ChatGPT and Gemini against ten MacArthur Foundation evaluation reports. The work offered practical lessons about what AI can do well, where it falls short, and why human judgment remains essential.</p>



<h4 class="wp-block-heading"><strong>Lessons Learned</strong></h4>



<h5 class="wp-block-heading"><strong>Methods are more than searchable words</strong></h5>



<p class="wp-block-paragraph">Both tools performed well when reports used straightforward language. When a report said &#8220;we conducted semi-structured interviews&#8221; or &#8220;we distributed a survey,&#8221; ChatGPT and Gemini recognized those methods consistently. The challenge came when evaluators embedded methods into narrative, describing how they tracked community sentiment or interpreted program data. The tools struggled to separate a data source from an actual analytical procedure. When writing becomes descriptive instead of clinical, AI gets confused. That&#8217;s when human evaluators come in.</p>



<h5 class="wp-block-heading"><strong>The tool you choose shapes what you find</strong></h5>



<p class="wp-block-paragraph">The two models process text in fundamentally different ways. ChatGPT stays literal, focusing on what is written on the page. Gemini attempts to read between the lines, looking for underlying themes. In one report, Gemini recognized that evaluators were using inductive reasoning based on surrounding context, but ChatGPT missed it because the word &#8220;inductive&#8221; never appeared. If you rely on one platform, you&#8217;re getting a particular kind of extraction, shaped by that tool&#8217;s personality and limitations.</p>



<h4 class="wp-block-heading"><strong>Hot Tips</strong></h4>



<h5 class="wp-block-heading"><strong>Upload strategy changes everything</strong></h5>



<p class="wp-block-paragraph">The most important finding came from something I didn&#8217;t expect. When I uploaded all ten reports to ChatGPT at once, it gave me 95 candidate methods. Using those same reports and the same prompt but uploading them one by one, ChatGPT generated 862 rows. Gemini went from 22 rows to 121. You might think more rows means better work, but it doesn&#8217;t. When AI focuses on a single document, it becomes overzealous, treating simple program metrics as research methods and splitting one survey into twenty rows based on individual questions. Those extra rows may be false positives and fragmented data. More volume may just mean more cleaning.</p>



<h5 class="wp-block-heading"><strong>Prompting is methodology</strong></h5>



<p class="wp-block-paragraph">My original prompt was too broad, asking for a structured table showing what methods were most used. That gave ChatGPT permission to summarize, placing interviews and focus groups in the same cell. The revised prompt restructured the approach. The AI took on the role of an expert evaluator and analyst. Each individual method received its own row. Exact page numbers became non-negotiable for every claim, which helped catch hallucinations. The AI also had to explain how each method was executed, not just name it. How you structure your prompt shapes what data comes back and how much verification work you&#8217;ll need to do.</p>



<h4 class="wp-block-heading"><strong>Rad Resources</strong></h4>



<p class="wp-block-paragraph">Mainstream models miss nuance because they&#8217;re trained on dominant, Western datasets. Tools like Aisha, Latimer, and Cohere&#8217;s Aya recognize linguistic patterns and lived experiences that standard AI overlooks. Running one alongside your workflow offers a second lens on community context.</p>



<p class="wp-block-paragraph">AI works as a strong first-pass tool. It moves through hundreds of pages quickly and flags where methods might be hiding. What happens next is where human judgment takes over. You open the document, go to the page the AI cited, verify what it found, and separate procedures from data sources. Because the goal isn&#8217;t just to move faster or produce bigger spreadsheets. The goal is to make sure the people and communities behind the data are still seen and understood correctly.<a id="_msocom_1"></a></p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p class="wp-block-paragraph"><em>The American Evaluation Association is hosting Graduate Education Diversity Internship (GEDI) Program week. The contributions all this week to AEA365 come from AEA’s GEDI Program and its interns. For more information on GEDI, see their webpage here: </em><a href="http://www.eval.org/GEDI"><em>http://www.eval.org/GEDI</em></a><em>&nbsp; Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the</em><a href="http://aea365.org/blog/"><em> AEA365 webpage</em></a><em> so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? <em><em>Please do so using&nbsp;<a href="https://aea365.org/blog/submit-a-post/"><strong><em>the form</em></strong></a>&nbsp;on our website.</em></em> AEA365 is sponsored by the</em><a href="http://eval.org/"><em> American Evaluation Association</em></a><em> and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.</em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://aea365.org/blog/gedi-week-cracking-the-code-ai-evaluation-methods-and-human-judgment-by-shelita-augustus/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>GEDI Week: The Ripple Effects of Evaluation by Eunji Kong</title>
		<link>https://aea365.org/blog/gedi-week-the-ripple-effects-of-evaluation-by-eunji-kong/</link>
					<comments>https://aea365.org/blog/gedi-week-the-ripple-effects-of-evaluation-by-eunji-kong/#respond</comments>
		
		<dc:creator><![CDATA[AEA365 Contributor, Curated by Elizabeth Grim]]></dc:creator>
		<pubDate>Thu, 03 Sep 2026 06:00:00 +0000</pubDate>
				<category><![CDATA[Graduate Education Diversity Internship]]></category>
		<guid isPermaLink="false">https://aea365.org/blog/?p=33654</guid>

					<description><![CDATA[Hello, world! My name is Eunji Kong, and I am proud to be part of the Sisterhood of Healing Courage (GEDI 22). As a Graduate Education Diversity Internship (GEDI) scholar, I had the privilege of working with the Los Angeles Education Partnership (LAEP), where I supported equity-focused evaluation projects and learned what evaluation can look [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p class="wp-block-paragraph">Hello, world! My name is <strong>Eunji Kong</strong>, and I am proud to be part of the Sisterhood of Healing Courage (GEDI 22). As a Graduate Education Diversity Internship (GEDI) scholar, I had the privilege of working with the Los Angeles Education Partnership (LAEP), where I supported equity-focused evaluation projects and learned what evaluation can look like when it is grounded in community.</p>



<p class="wp-block-paragraph">I made many wonderful memories during my GEDI internship, but one experience left a lasting visual impression on me: the drum circle led by members of the Sankofa Soul Collective during a two-day educational leadership conference hosted by LAEP as part of the 21CSLA program. The entire conference was intentionally centered on care, community, and equity, but the drum circle stayed with me because it allowed me to see care and community come to life.</p>



<p class="wp-block-paragraph">Members of the Sankofa Soul Collective shared how rhythm can foster healing, strengthen community, and even synchronize our heartbeats. They invited everyone to participate through drumming, movement, and reflection. As I looked around the room, I saw educational leaders, facilitators, and even some of their children laughing, dancing, and making music together. For a moment, titles and roles disappeared. The room was filled with connection, joy, and a shared sense of belonging.</p>



<h4 class="wp-block-heading"><strong>Lessons Learned: The Ripple Effect of Our Choices</strong></h4>



<p class="wp-block-paragraph">At first glance, this experience might seem unrelated to evaluation. Yet it had a lasting impact in my thinking of what we evaluate and why it matters. As I watched educational leaders and their children laugh, dance, and build community together, I realized that the impact of a program extends far beyond what we typically measure. Additionally, the choice to attend the conference did not only lead to the leaders gaining professional knowledge, but also building relationships, finding a sense of belonging, and, for some, creating meaningful memories with their children. Those experiences may shape how they lead schools, support educators, and ultimately influence the students and families they serve. The choices that they make ripple outward across classrooms, families, and future generations.</p>



<p class="wp-block-paragraph">This realization also made me think more deeply about the choices we make as evaluators. We decide which questions to ask, whose voices to include, which outcomes to measure, and what falls outside the scope of our evaluation. We cannot examine everything, but those decisions still matter. What we choose to capture, and what we leave unexamined, shapes the story an evaluation tells. That story can then inform decisions made by practitioners, leaders, policymakers, and communities, creating ripple effects of its own. As evaluators, we have both the opportunity and the responsibility to ensure that our work reflects the people and communities it is intended to serve.</p>



<h4 class="wp-block-heading"><strong>Hot Tip: Be Curious, Be Intentional, Be in Community</strong></h4>



<p class="wp-block-paragraph">Stay curious about the community you are learning from and what your evaluation captures, what it might miss, and how the choices you make along the way may shape its impact. Ask, “What might happen because we chose to ask this question, include these voices, or leave something out?” Even choosing not to examine something is a choice.</p>



<p class="wp-block-paragraph">These choices do not have to be made alone. In fact, they are often better made in community. Talk them through with colleagues, community members, and the people most connected to the work. Different perspectives can challenge our assumptions, reveal what we may not see on our own, and help us better understand the potential consequences of our decisions.</p>



<p class="wp-block-paragraph">Staying curious, engaging in dialogue, and making choices in community can help us be more intentional about the stories our evaluations tell and the ripple effects they may have.</p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p class="wp-block-paragraph"><em>The American Evaluation Association is hosting Graduate Education Diversity Internship (GEDI) Program week. The contributions all this week to AEA365 come from AEA’s GEDI Program and its interns. For more information on GEDI, see their webpage here: </em><a href="http://www.eval.org/GEDI"><em>http://www.eval.org/GEDI</em></a><em>&nbsp; Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the</em><a href="http://aea365.org/blog/"><em> AEA365 webpage</em></a><em> so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? <em><em>Please do so using&nbsp;<a href="https://aea365.org/blog/submit-a-post/"><strong><em>the form</em></strong></a>&nbsp;on our website.</em></em> AEA365 is sponsored by the</em><a href="http://eval.org/"><em> American Evaluation Association</em></a><em> and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.</em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://aea365.org/blog/gedi-week-the-ripple-effects-of-evaluation-by-eunji-kong/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>GEDI Week: Following People, Not Just the Protocol: A GEDI Lesson on Culturally Responsive Evaluation by M. Magdalena Jimenez Aguilar</title>
		<link>https://aea365.org/blog/gedi-week-following-people-not-just-the-protocol-a-gedi-lesson-on-culturally-responsive-evaluation-by-m-magdalena-jimenez-aguilar/</link>
					<comments>https://aea365.org/blog/gedi-week-following-people-not-just-the-protocol-a-gedi-lesson-on-culturally-responsive-evaluation-by-m-magdalena-jimenez-aguilar/#respond</comments>
		
		<dc:creator><![CDATA[AEA365 Contributor, Curated by Elizabeth Grim]]></dc:creator>
		<pubDate>Wed, 02 Sep 2026 06:00:00 +0000</pubDate>
				<category><![CDATA[Graduate Education Diversity Internship]]></category>
		<guid isPermaLink="false">https://aea365.org/blog/?p=33657</guid>

					<description><![CDATA[Buenas! My name is M. Magdalena Jimenez Aguilar, but everyone calls me Magda (she/her/ella). I am a fifth-year PhD student and soon-to-be candidate at the University of California, Santa Barbara. I’m a lifelong Californian and University of California student, having received my bachelor&#8217;s degree from UC Davis and my master&#8217;s degree at UCLA. I am [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p class="wp-block-paragraph">Buenas! My name is <strong>M. Magdalena Jimenez Aguilar</strong>, but everyone calls me Magda (she/her/ella). I am a fifth-year PhD student and soon-to-be candidate at the University of California, Santa Barbara. I’m a lifelong Californian and University of California student, having received my bachelor&#8217;s degree from UC Davis and my master&#8217;s degree at UCLA. I am also blessed to have been part of this year’s wonderful GEDI 22 cohort, the Sisterhood of Healing Courage.</p>



<p class="wp-block-paragraph">For this blog post, I wanted to reflect on one of the lessons from my GEDI experience that changed how I think about culturally responsive evaluation (CRE). More specifically, I want to share how my individual project taught me that culturally responsive practice can happen in the small decisions we make throughout an evaluation, sometimes right in the moment.</p>



<h4 class="wp-block-heading"><a></a><strong>Lessons Learned: CRE Can Happen in the Moment</strong></h4>



<p class="wp-block-paragraph">Before my GEDI experience, I often thought about CRE through the larger decisions that go into an evaluation, such as what voices need to be represented, what questions we ask, how we interpret our data, and how findings are shared. One of the biggest lessons I am taking with me from my GEDI experience is that CRE can also happen through the smaller interactions between an evaluator and the people participating in interviews for an evaluation.</p>



<p class="wp-block-paragraph">For my GEDI individual project, I analyzed interviews from an evaluation of a higher education program supporting students from historically underrepresented backgrounds. I did not conduct the interviews myself, but I had several conversations with the interviewer about how she approached them.</p>



<p class="wp-block-paragraph">She shared with me that although she entered each interview with a prewritten protocol, she did not treat that protocol as something she had to rigidly follow. Instead, she adapted her questions in real time based on what each person shared with her. She made room for people to talk about experiences that were important to them, affirmed what they shared, and asked follow-up questions when something came up that the original protocol did not fully capture.</p>



<p class="wp-block-paragraph">What really stuck with me was when she described this to me as CRE in action. Before this, I had never thought about adapting an interview protocol in the moment as a culturally responsive practice.</p>



<h4 class="wp-block-heading"><a></a><strong>Hot Tip: Let Your Protocol Be a Gentle Guide</strong></h4>



<p class="wp-block-paragraph">We all know that interview protocols are important since they help us make sure we are asking the questions needed to answer our evaluation questions and provide consistency across interviews. But one lesson I learned is that consistency does not have to mean rigidity.</p>



<p class="wp-block-paragraph">Sometimes being responsive means recognizing that the person sitting in front of you is telling you something that your protocol did not anticipate. Instead of immediately moving on to the next question, we can stop, listen, and ask ourselves: Is this person telling me something important that I did not think to ask?</p>



<p class="wp-block-paragraph">Making space for those moments can help us better understand someone&#8217;s experience on their own terms.</p>



<h4 class="wp-block-heading"><a></a><strong>Lessons Learned: Responsiveness Is Part of the Method</strong></h4>



<p class="wp-block-paragraph">As I continue growing as an evaluator, this is one lesson from GEDI that I know I will carry with me. CRE does not only live in our evaluation plans, frameworks, or final reports. It also lives in how we listen, how we respond, and how willing we are to adjust when the people we are learning from take us somewhere we did not expect.</p>



<p class="wp-block-paragraph">Sometimes, culturally responsive evaluation can be as simple, and as meaningful, as knowing when to follow the person instead of the protocol.</p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p class="wp-block-paragraph"><em>The American Evaluation Association is hosting Graduate Education Diversity Internship (GEDI) Program week. The contributions all this week to AEA365 come from AEA’s GEDI Program and its interns. For more information on GEDI, see their webpage here: </em><a href="http://www.eval.org/GEDI"><em>http://www.eval.org/GEDI</em></a><em>  Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the</em><a href="http://aea365.org/blog/"><em> AEA365 webpage</em></a><em> so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? <em><em><em>Please do so using </em><a href="https://aea365.org/blog/submit-a-post/"><strong><em>the form</em></strong></a><em> on our website.</em></em></em> AEA365 is sponsored by the</em><a href="http://eval.org/"><em> American Evaluation Association</em></a><em> and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.</em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://aea365.org/blog/gedi-week-following-people-not-just-the-protocol-a-gedi-lesson-on-culturally-responsive-evaluation-by-m-magdalena-jimenez-aguilar/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>GEDI Week: Using Pláticas to Humanize Evaluation by Mariana Hernandes Grassi</title>
		<link>https://aea365.org/blog/gedi-week-using-platicas-to-humanize-evaluation-by-mariana-hernandes-grassi/</link>
					<comments>https://aea365.org/blog/gedi-week-using-platicas-to-humanize-evaluation-by-mariana-hernandes-grassi/#respond</comments>
		
		<dc:creator><![CDATA[AEA365 Contributor, Curated by Elizabeth Grim]]></dc:creator>
		<pubDate>Tue, 01 Sep 2026 06:00:00 +0000</pubDate>
				<category><![CDATA[Graduate Education Diversity Internship]]></category>
		<guid isPermaLink="false">https://aea365.org/blog/?p=33658</guid>

					<description><![CDATA[Olá! My name is Mariana Hernandes Grassi, a Latina doctoral student from Brazil at Loyola University Chicago and an alumna of the GEDI 22 cohort (also known as the Sisterhood of Healing Change). Having recently wrapped up my GEDI (Graduate Education Diversity Internship) fellowship last month, I’m reflecting on how my decade-plus background as a [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p class="wp-block-paragraph">Olá! My name is <strong>Mariana Hernandes Grassi</strong>, a Latina doctoral student from Brazil at Loyola University Chicago and an alumna of the GEDI 22 cohort (also known as the Sisterhood of Healing Change). Having recently wrapped up my GEDI (Graduate Education Diversity Internship) fellowship last month, I’m reflecting on how my decade-plus background as a language educator shapes my emerging evaluation practice. Today, I’m sharing how using<em> pláticas</em>, a methodology more prominent in educational research settings, transformed my recent evaluation work at my GEDI host site, supporting predominantly Chicanx staff at a non-medical home care agency as they prepared for a high-stakes healthcare accreditation survey.</p>



<p class="wp-block-paragraph"><em>Pláticas</em> are informal conversations deeply connected to Hispanic and Latinx oral traditions of sharing stories, emotional support, and wisdom. In the 1970s, Latinx researchers began utilizing <em>pláticas</em> as an effective method to engage marginalized participants and collect data in ways that honored their lived realities, focusing on researcher-participant connection and reciprocity. Seeking to conceptualize<em> pláticas </em>as a methodology that shifts research from an extractive process to a relational space for co-constructing knowledge and equity, <a href="https://www.jstor.org/stable/43941617" target="_blank" rel="noreferrer noopener">Fierros and Delgado Bernal</a> identified five principles among scholars engaging with <em>pláticas</em> in their work.</p>



<h4 class="wp-block-heading"><strong>Lessons Learned: Applying the 5 Principles of Plática Methodology to My GEDI Project</strong></h4>



<p class="wp-block-paragraph">In my GEDI experience, adopting <em>pláticas</em> shifted the work at my host site from an “objective” audit preparation to a tool for empowerment. Here are lessons I learned applying the five principles at my host site:</p>



<p class="wp-block-paragraph"><strong>1. Grounded in Chicana and Latina Feminist Theory:</strong> Preparing for accreditation was a mandate from the host site leadership. Grounding the evaluation approach in critical feminist theory allowed us to center the staff (who are predominantly Chicanx) by valuing their experiences and opinions as essential knowledge to counterbalance that top-down imposition.</p>



<p class="wp-block-paragraph"><strong>2. Honoring Participants as Co-Constructors of Knowledge:</strong> Rather than treating staff as data sources, we created an accreditation preparation committee with members from multiple departments. Our monthly committee meetings invited staff to draw upon their daily expertise to co-design a localized logic model and a strategic accreditation preparation roadmap.</p>



<p class="wp-block-paragraph"><strong>3. Connecting Lived Experiences to Research Inquiry:</strong> By welcoming everyday life into the evaluation, flexible conversations helped us uncover how administrative understaffing impacted staff well-being, directly affecting survey readiness.</p>



<p class="wp-block-paragraph"><strong>4. Providing a Potential Space for Healing:</strong> Grounded in relational care, judgment-free spaces allowed staff to unburden challenges and speak openly about burnout, transforming administrative anxiety into collective relief.</p>



<p class="wp-block-paragraph"><strong>5. Driven by Reflexivity, Reciprocity, and Vulnerability:</strong> Reflecting on my positionality as a Brazilian language educator and emerging evaluator allowed me to identify shared and distinct cultural aspects with Chicanx staff. Sharing food from our respective cultures during our <em>pláticas</em> was an effective strategy that opened space to ground our interactions in mutual care and trust, deepening the understanding of our similarities and differences. Furthermore, showing vulnerability about my own learning curve in the home care industry did not weaken my credibility; it created space for staff to recognize just how indispensable<em> their </em>everyday institutional knowledge was to our evaluation process.</p>



<p class="wp-block-paragraph">Hence, when applying the five principles of a <em>plática</em> methodology to my GEDI work, I found that, by design, I had to reject outsiderness and embrace fluid, relational roles. When we utilize <em>pláticas</em>, we do not just collect data; we honor lived experiences, shift power dynamics, and bring the heart of Culturally Responsive Evaluation to life.</p>



<h4 class="wp-block-heading"><strong>Rad Resources: Some Key Articles to Dive Deeper into <em>Pláticas</em></strong></h4>



<ul class="wp-block-list">
<li>Check out <a href="https://www.jstor.org/stable/43941617" target="_blank" rel="noreferrer noopener">Fierros and Delgado Bernal’s 2016 seminal article</a> on the conceptualization of<em> pláticas </em>as a methodology.</li>



<li>Learn more practical implications of <em>pláticas</em> in different contexts through <a href="https://journals.sagepub.com/doi/10.1177/16094069251353451" target="_blank" rel="noreferrer noopener">Regina Ayala Chavez’s 2025 article</a>.</li>
</ul>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p class="wp-block-paragraph"><em>The American Evaluation Association is hosting Graduate Education Diversity Internship (GEDI) Program week. The contributions all this week to AEA365 come from AEA’s GEDI Program and its interns. For more information on GEDI, see their webpage here: </em><a href="http://www.eval.org/GEDI"><em>http://www.eval.org/GEDI</em></a><em>  Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the</em><a href="http://aea365.org/blog/"><em> AEA365 webpage</em></a><em> so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? <em><em><em>Please do so using </em><a href="https://aea365.org/blog/submit-a-post/"><strong><em>the form</em></strong></a><em> on our website.</em></em></em> AEA365 is sponsored by the</em><a href="http://eval.org/"><em> American Evaluation Association</em></a><em> and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.</em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://aea365.org/blog/gedi-week-using-platicas-to-humanize-evaluation-by-mariana-hernandes-grassi/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>GEDI Week: GEDI: An Opportunity of a Lifetime by Yakubu Wule Sini</title>
		<link>https://aea365.org/blog/gedi-week-gedi-an-opportunity-of-a-lifetime-by-yakubu-wule-sini/</link>
					<comments>https://aea365.org/blog/gedi-week-gedi-an-opportunity-of-a-lifetime-by-yakubu-wule-sini/#respond</comments>
		
		<dc:creator><![CDATA[AEA365 Contributor, Curated by Elizabeth Grim]]></dc:creator>
		<pubDate>Mon, 31 Aug 2026 06:00:00 +0000</pubDate>
				<category><![CDATA[Graduate Education Diversity Internship]]></category>
		<guid isPermaLink="false">https://aea365.org/blog/?p=33651</guid>

					<description><![CDATA[Hello, AEA365 community! I’m Yakubu Wule Sini, a PhD student in Health Promotion at the University of Oklahoma and an emerging evaluator with experience working in international and conflict-affected settings with United Nations International Organization for Migration, Center for Civilians in Conflict and Creatives Associates International. As a Graduate Education Diversity Internship (GEDI) scholar, I [&#8230;]]]></description>
										<content:encoded><![CDATA[
<figure class="wp-block-image alignleft size-full is-resized"><img loading="lazy" decoding="async" width="604" height="570" src="https://aea365.org/blog/wp-content/uploads/2026/08/Yakubu-Wule-Sini.png" alt="Yakubu Wule Sini" class="wp-image-33828" style="width:auto;height:250px" srcset="https://aea365.org/blog/wp-content/uploads/2026/08/Yakubu-Wule-Sini.png 604w, https://aea365.org/blog/wp-content/uploads/2026/08/Yakubu-Wule-Sini-300x283.png 300w" sizes="auto, (max-width: 604px) 100vw, 604px" /></figure>



<p class="wp-block-paragraph">Hello, AEA365 community! I’m <strong>Yakubu Wule Sini</strong>, a PhD student in Health Promotion at the University of Oklahoma and an emerging evaluator with experience working in international and conflict-affected settings with <a href="https://www.iom.int/" target="_blank" rel="noreferrer noopener">United Nations International Organization for Migration,</a> <a href="https://civiliansinconflict.org/" target="_blank" rel="noreferrer noopener">Center for Civilians in Conflict</a> and <a href="https://www.creativeassociatesinternational.com/" target="_blank" rel="noreferrer noopener">Creatives Associates International</a>. As a Graduate Education Diversity Internship (GEDI) scholar, I have had the opportunity to work with <a href="https://www.westat.com/" target="_blank" rel="noreferrer noopener">Westat</a>. Through that experience, I strengthened my evaluation skills while learning lessons that have reshaped how I think about evaluation practice that I would like to share.</p>



<h4 class="wp-block-heading"><strong>Lessons Learned</strong></h4>



<h5 class="wp-block-heading"><strong>Elevating Community Voices Strengthens Evaluation</strong></h5>



<p class="wp-block-paragraph">One of the most important lessons I learned through the <a href="https://www.eval.org/gedi" target="_blank" rel="noreferrer noopener">GEDI program</a> is the value of culturally responsive evaluation. My GEDI experience reinforced that program participants and community members should not be viewed simply as subjects of an evaluation. They are important stakeholders whose experiences, perspectives, and knowledge can strengthen the evaluation process. For me, culturally responsive evaluation means intentionally creating space for the voices of people who are most affected by programs and policies. This is particularly important when working with communities whose perspectives may historically have been overlooked. As evaluators, we can produce more meaningful work when we listen to communities, recognize the context in which programs are implemented, and consider whose voices are represented in our evaluation processes.</p>



<h5 class="wp-block-heading"><strong>Professional Networks Are an Important Part of an Evaluator’s Growth</strong></h5>



<p class="wp-block-paragraph">Through GEDI and the broader <a href="https://www.eval.org/" target="_blank" rel="noreferrer noopener">American Evaluation Association</a> community, I have had opportunities to connect with evaluators with different backgrounds, experiences, and areas of expertise. These relationships have reminded me that professional growth does not happen in isolation. Conversations with experienced evaluators can expose emerging professionals to new approaches, provide mentorship, and create opportunities for collaboration.</p>



<p class="wp-block-paragraph"><strong>Hot Tip:</strong> Emerging evaluators should intentionally build relationships within the evaluation community. Attend professional events, introduce yourself to other evaluators, ask thoughtful questions, and maintain the relationships you develop. Networking is not simply about finding your next opportunity; it is also about creating a community from which you can learn and to which you can contribute.</p>



<h5 class="wp-block-heading"><strong>Connecting Evaluation Theory to Real-World Decisions</strong></h5>



<p class="wp-block-paragraph">Through my work with <a href="https://www.westat.com/" target="_blank" rel="noreferrer noopener">Westat</a>, I contributed to evaluation-related activities, including comprehensive document reviews and the development of monitoring and evaluation tools. Through this experience I was able to synchronize academic concepts with real world evaluation practice. Evaluation tools and findings are not simply project products; they meant to inform decisions about how programs are implemented and improved.</p>



<p class="wp-block-paragraph"><strong>Hot Tip:</strong> When gaining practical evaluation experience, look beyond completing the assigned task. Ask yourself: <em>Who will use this information? How might it influence a program or community? Whose perspective might be missing?</em> These questions can help us remain focused on the people and decisions our evaluations are intended to serve.</p>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p class="wp-block-paragraph"><em>The American Evaluation Association is hosting Graduate Education Diversity Internship (GEDI) Program week. The contributions all this week to AEA365 come from AEA’s GEDI Program and its interns. For more information on GEDI, see their webpage here: </em><a href="http://www.eval.org/GEDI"><em>http://www.eval.org/GEDI</em></a><em>&nbsp; Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the</em><a href="http://aea365.org/blog/"><em> AEA365 webpage</em></a><em> so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? <em><em>Please do so using&nbsp;<a href="https://aea365.org/blog/submit-a-post/"><strong><em>the form</em></strong></a>&nbsp;on our website.</em></em> AEA365 is sponsored by the</em><a href="http://eval.org/"><em> American Evaluation Association</em></a><em> and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.</em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://aea365.org/blog/gedi-week-gedi-an-opportunity-of-a-lifetime-by-yakubu-wule-sini/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
		<item>
		<title>GEDI Week: Navigating Uncertainty as Emerging Evaluators: Lessons from Community and Care by Caitlin Ng</title>
		<link>https://aea365.org/blog/gedi-week-navigating-uncertainty-as-emerging-evaluators-lessons-from-community-and-care-by-caitlin-ng/</link>
					<comments>https://aea365.org/blog/gedi-week-navigating-uncertainty-as-emerging-evaluators-lessons-from-community-and-care-by-caitlin-ng/#respond</comments>
		
		<dc:creator><![CDATA[AEA365 Contributor, Curated by Elizabeth Grim]]></dc:creator>
		<pubDate>Sun, 30 Aug 2026 06:00:00 +0000</pubDate>
				<category><![CDATA[Graduate Education Diversity Internship]]></category>
		<guid isPermaLink="false">https://aea365.org/blog/?p=33659</guid>

					<description><![CDATA[Hi, my name is Caitlin Ng, and I am a doctoral candidate at the University of California, Santa Barbara, pursuing my PhD in Education with an emphasis in program evaluation, policy, and research methods. As I approach the final stages of my doctoral journey and transition into a new chapter as a Graduate Education Diversity [&#8230;]]]></description>
										<content:encoded><![CDATA[
<p class="wp-block-paragraph">Hi, my name is <strong>Caitlin Ng</strong>, and I am a doctoral candidate at the University of California, Santa Barbara, pursuing my PhD in Education with an emphasis in program evaluation, policy, and research methods. As I approach the final stages of my doctoral journey and transition into a new chapter as a Graduate Education Diversity Internship (GEDI) alumna, I’ve been reflecting on what it means to navigate uncertainty while remaining grounded in community, purpose, and care.</p>



<p class="wp-block-paragraph">As a doctoral candidate who is entering another year of uncertainty (losing contracts, not knowing what funding will be available, witnessing jobs being lost across industries), it is more apparent than ever that power is not equal. It&#8217;s crucial for those in positions of greater influence to critically consider their responsibilities and the impact of their positionality.</p>



<p class="wp-block-paragraph">I reflect on my own position, as a GEDI alumna. Through my experience in the GEDI program, I have been afforded the opportunities to learn from and with trailblazers at the Annual American Evaluation Association (AEA) Conference in Portland, OR. There, we were constantly reminded of the potential impact emerging evaluators can have, and that shaping our influence in the field of evaluation is in our hands.</p>



<p class="wp-block-paragraph">Since getting to learn with my colleagues in Portland, there has been one apparent impact that my fellow GEDI (SOULTICE) members have left me: the power of community. As we all navigate these uncertain times, it is our responsibility not only to uplift each other, but also to take care of ourselves. This is something that culturally responsive evaluation continues to remind me of: that people’s lived experiences, contexts, and needs are not a “one-size-fits-all,” and neither are the ways we show up for one another. Care, just like evaluation, has to be responsive. Although I am still learning, I would like to share some valuable tips for those navigating similar journeys.</p>



<h4 class="wp-block-heading"><strong>Hot Tips</strong></h4>



<ol class="wp-block-list">
<li><strong>Lean on your community. </strong>Throughout my experience as a GEDI, the power of community and the importance of relationships has been demonstrated time and time again. Whether it was checking in on one-another, sharing resources, or simply holding space during overwhelming moments, I was reminded that we are not meant to navigate uncertainty alone. Community does not always mean having all the answers but it can look like sending a quick message, asking for advice, or even just being in the presence of people who understand your journey.</li>



<li><strong>Advocate and stay informed. </strong>When things feel uncertain, it can be tempting to disconnect, but this is actually when staying engaged matters most. Staying informed about institutional changes, funding shifts, and broader societal trends allows us to make intentional decisions and support one another more effectively. Advocacy can take many forms: asking questions, sharing opportunities (something my fellow GEDI members have done for me throughout this process), or pushing for transparency in spaces where decisions are being made. Even small acts of advocacy contribute to a larger culture of accountability and care.</li>



<li><strong>Celebrate Small Wins. </strong>When the bigger picture feels unstable, it becomes even more important to acknowledge all stages of the process even in its smallest forms. Completing a task, sending an email, showing up to a meeting, or simply getting through a difficult day, are all wins worth recognizing. Celebrating small moments helps us maintain momentum and reminds us that growth is still happening, even when outcomes feel uncertain.</li>



<li><strong>Self-care if not optional. </strong>I say this as a reminder to myself just as much as anyone else. It’s easy to push through and put everything else first, especially in academic and professional spaces that reward productivity. But we can’t pour from an empty cup. Self-care doesn’t have to be anything extreme but it can be going for a walk, getting enough rest, stepping away when needed, or doing something that helps you feel like yourself again. Taking care of yourself is <em>essential </em>to keep doing the work we are doing.</li>
</ol>



<hr class="wp-block-separator has-alpha-channel-opacity"/>



<p class="wp-block-paragraph"><em>The American Evaluation Association is hosting Graduate Education Diversity Internship (GEDI) Program week. The contributions all this week to AEA365 come from AEA’s GEDI Program and its interns. For more information on GEDI, see their webpage here: </em><a href="http://www.eval.org/GEDI"><em>http://www.eval.org/GEDI</em></a><em>&nbsp; Do you have questions, concerns, kudos, or content to extend this AEA365 contribution? Please add them in the comments section for this post on the</em><a href="http://aea365.org/blog/"><em> AEA365 webpage</em></a><em> so that we may enrich our community of practice. Would you like to submit an AEA365 Tip? <em><em>Please do so using&nbsp;<a href="https://aea365.org/blog/submit-a-post/"><strong><em>the form</em></strong></a>&nbsp;on our website.</em></em> AEA365 is sponsored by the</em><a href="http://eval.org/"><em> American Evaluation Association</em></a><em> and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.</em></p>
]]></content:encoded>
					
					<wfw:commentRss>https://aea365.org/blog/gedi-week-navigating-uncertainty-as-emerging-evaluators-lessons-from-community-and-care-by-caitlin-ng/feed/</wfw:commentRss>
			<slash:comments>0</slash:comments>
		
		
			</item>
	</channel>
</rss>
