Tag Archives: impact

A bottom up perspective on results measurement

Thanks to my engagement in the ‘Systemic M&E’ initiative of the SEEP Network (where M&E stands for monitoring and evaluation but we really have been mainly looking into monitoring), I have been  discussing quite a bit with practitioners on monitoring and results measurement and how to make monitoring systems more systemic. For me this bottom up perspective is extremely revealing in how conscious these practitioners are about the complexities of the systems they work in and how they intuitively come up with solutions that are in line with what we could propose based on complexity theory and systems thinking. Nevertheless, practitioners are often still strongly entangled in the overly formalistic and data-driven mindset of the results agenda. This mindset is based on a mechanistic view of systems with clear cause-and-effect relationships and a bias for objectively obtained data that is stripped from its context and by that rendered largely meaningless for improving implementation. Continue reading

Flipping through my RSS feeds

Google ReaderAfter three weeks of more or less constant work, I’m finally having some time to have a look at my RSS feeds. After the first shock of seeing more than 3000 new entries, containing over 100 unread blog posts, I just started reading from the top. Here a couple of things I found interesting (not related to any specific topic):

SciDevNet: App to help rice farmers be more productive – I don’t know about the Philippines, but I haven’t seen many rice farmers in Bangladesh carrying a smartphone (nor any extension workers for that matter).

Owen abroad: What are result agenda? – An interesting post about the different meanings of following a ‘results agenda’ for different people, i.e., politicians, aid agency managers, practitioners, and (what I call) ‘complexity dudes’. I’m not very satisfied with Owen’s assessment, though, because I think he is not giving enough weight to the argument that results should be used to manage complexity. I think to manage complexity, we don’t need rigorous impact studies, but much more quality focused results regarding the change we can achieve in a system and the direction our intervention makes the system move.

xkcd: Backward in time – an all time favorite cartoon of mine, here describing how to make long waits pass quickly.

Aid on the Edge: on state fragility as wicked problem and Facebook, social media and the complexity of influence – Ben Ramalingam seems to be back in the bloggosphere with two posts on one of my favorite blogs on complexity science and international development. In the first post, he explores the notion of looking at fragile states as so called ‘wicked problems’, i.e., problems that are ill defined, highly interdependent and multi-causal, without any clear solution, etc. (see definition in the blog post). Ben concludes that the way aid agencies work in fragile states needs to undergo fundamental change. He presents some principles on how this change could look like from a paper he published together with SFI’s Bill Frej last year.

In the second piece Ben looks into the complex matter of how socioeconomic systems can be influenced, and how this can be measured, by giving an example of Facebook trying to calculate its influence on the European economy and why its calculations are flawed. The basic argument is that one’s decision to do something is extremely difficult to analyze and even more difficult to trace back to an individual influencer. Also our decisions and, indeed, our behavior, are complex systems. One of the interesting quotes from the post: “Influentials don’t govern person-to-person communication. We all do. If society is ready to embrace a trend, almost anyone can start one – and if it isn’t, then almost no one can.”

Now, to make the link back to Owen’s post mentioned above on rigorous impact analyses: how can we ever attribute impacts on a large scale to individual development programs or donors if we cannot measure the influentials’ impact on an individual’s behavior? I rather like to think of a development program as an agent poking into the right spots, the spots where the system is ready to embrace a – for us – favorable trend. But then to attribute all the change to the program would be preposterous.

Enough reading for today, even though there are still 86 unread blog posts in my RSS reader, not the least 45 from the power bloggers Duncan Green and Chris Blattman. I’ll go and watch some videos now of the new class I recently started on Model Thinking, a free online class by Scott E Page, Professor of Complex Systems, Political Science, and Economics at the University of Michigan. Check it out: http://www.modelthinking-class.org/
For people with less time, a couple of participants are tweeting using #modelthinkingcourse