Good Measurement Needs Good Leadership
Every morning, I run through Emory University. The evolution of this institution over time has been incredible. From a small Methodist college in a small town in Georgia, Emory has emerged as a major international university in the largest city in the southeast. The undergraduate, law, medical, and business schools attract students from literally around the world, and speakers like the Dalai Lama and President Carter have spoken at the university.
So it was with a heavy heart that I read the article in the Atlanta Journal Constitution this weekend that Emory may have been misreporting student data for over a decade. It appears they have been falsely inflating its test scores by reporting data for admitted students instead of enrolled students, cutting off the bottom 10% of the class, and other data shenanigans. Why would they do something like this? Because the stakes at the level Emory plays are high -- you're either a top 20 school or not, and for the past 10 years, Emory has straddled that line.
According to the investigation, there's no evidence that the president, provost, or any of the deans had any knowledge of the cheating, but at the end of the day, that's not the point. Just like in Atlanta Public Schools, this is fundamentally a failure of leadership. The job of leadership is to put in place a system that pushes people to the best possible job they can do, not find ways to cheat or short-cut their way to results.
The lesson here is not a new one. People are people, and there will always be someone looking for a shortcut. But organizations need to build a culture and environment where shortcuts are not accepted or tolerated. Typically, these organizations are also ones that are extremely open and transparent -- after all, it's really hard to hide in a house with glass walls.
So, my advice to Emory (and other universities around the country): Use this as a wake-up call. Think about the measures you have in place and how they could be gamed. Run the "black hat" risk management scenarios to understand how someone could hack the measure. And fix the short-term problem so it can't reoccur.
But patching the hole is not enough. We also need to fix the conditions where punching a hole in the wall is considered okay and could be overlooked for 10 years. So, let's understand the behaviors that drove gaming the measure. Understand the culture of the admissions office. Engage the entire campus in the conversation on how to fix it. And then fix it.
June 2021
S | M | T | W | T | F | S |
---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | ||
6 | 7 | 8 | 9 | 10 | 11 | 12 |
13 | 14 | 15 | 16 | 17 | 18 | 19 |
20 | 21 | 22 | 23 | 24 | 25 | 26 |
27 | 28 | 29 | 30 |
Monthly Archive
June 2014 (1)
May 2014 (2)
March 2014 (1)
February 2014 (2)
January 2014 (1)
December 2013 (1)
October 2013 (2)
September 2013 (1)
July 2013 (2)
June 2013 (2)
April 2013 (1)
March 2013 (3)
February 2013 (4)
January 2013 (7)
December 2012 (4)
November 2012 (8)
October 2012 (9)
September 2012 (5)
August 2012 (6)
July 2012 (5)
June 2012 (7)
May 2012 (8)
April 2012 (5)
March 2012 (5)
February 2012 (6)
January 2012 (6)
December 2011 (7)
November 2011 (9)
October 2011 (9)
September 2011 (2)
August 2011 (8)
July 2011 (6)
June 2011 (8)
May 2011 (12)
April 2011 (5)
March 2011 (1)
February 2011 (2)
January 2011 (4)
December 2010 (6)
November 2010 (3)
October 2010 (5)
September 2010 (4)
August 2010 (3)
July 2010 (2)
June 2010 (1)
May 2010 (2)
April 2010 (1)
March 2010 (3)
January 2010 (4)
December 2009 (1)
November 2009 (1)
October 2009 (1)
September 2009 (3)
August 2009 (2)
July 2009 (3)
June 2009 (3)
May 2009 (6)
April 2009 (5)
March 2009 (3)
February 2009 (2)
January 2009 (2)
December 2008 (2)
November 2008 (2)
October 2008 (4)
September 2008 (6)
August 2008 (5)
July 2008 (4)
June 2008 (9)
May 2008 (5)
April 2008 (6)
March 2008 (8)