{"id":12086,"date":"2014-06-11T11:40:13","date_gmt":"2014-06-11T15:40:13","guid":{"rendered":"http:\/\/n2value.com\/blog\/?p=12086"},"modified":"2014-06-11T11:57:09","modified_gmt":"2014-06-11T15:57:09","slug":"the-danger-of-choosing-the-wrong-metric-the-va-scandal","status":"publish","type":"post","link":"https:\/\/n2value.com\/blog\/the-danger-of-choosing-the-wrong-metric-the-va-scandal\/","title":{"rendered":"The danger of choosing the wrong metric : The VA Scandal"},"content":{"rendered":"

The Veteran\u2019s affair scandal has been newsworthy lately. \u00a0The facts about the VA scandal will be forthcoming in August, but David Brooks made some smart inferences back on May 16th on NPR\u2019s Week In Politics<\/a>:<\/span><\/p>\n

BROOKS: Yeah, he’s (Shinkseki) in hot water. He’s been there since the beginning. So I don’t know if I’d necessarily want to bet on him. But, you know, I do have some sympathy for the VA. It’s obviously not a good thing to doctor and cook the books, but you – there is a certain fundamental reality here, which is the number of primary care visits over the last three years at this place rose 50 percent. The number of primary care physicians rose nine percent.<\/span>
\nAnd so there’s just a backlog, and if you put a sort of standard in place that you have to see everybody in 14 days but you don’t provide enough physicians to actually do that, well, people are going to start cheating. And so there is a more fundamental problem here than just the cheating.<\/span><\/p><\/blockquote>\n

An administrative failure was made by mandating patients be seen within 14 days but not providing the staffing capabilities to do so.\u00a0 The rule designed to promote a high level of care had ‘unintended consequences.’\u00a0 However, I do have some sympathy for an institution which depends on procurement from congress for funding in a political process where funds can be yanked, redistributed, or earmarked based on political priorities.<\/span><\/p>\n

More concerning, multiple centers may have been complicit<\/a> with the impossibility of fulfilling the mandate, and whistleblowers were actively retaliated against.<\/a><\/span><\/p>\n

I need to disclaim here that I both trained and worked at the VA as a physician. \u00a0I have tremendous respect for the veterans who seek care there, and I had great pride working there and in being in a place to give service to these men and women who gave service to us.\u00a0 The level of care in the VA system is generally thought to be good, by myself and others.<\/a><\/span><\/p>\n

As I\u2019ve written before in The Measure is the Metric<\/a> and Productivity in Medicine – what\u2019s real and what\u2019s fake<\/a>?, the selection of metrics is important because those metrics will be followed by the organization, particularly if performance evaluations and bonuses are tied to the metrics. \u00a0Ben Horowitz, partner at Andreessen Horowitz, astutely notes the following from his experience as CEO at Opsware and an employee at HP (1):<\/span><\/p>\n

At a basic level, metrics are incentives. \u00a0By measuring quality, features, and schedule and discussing them at every staff meeting, my people focused intensely on those metrics to the exclusion of other goals. \u00a0The metrics did not describe the real goals and I distracted the team as a result.<\/span><\/p><\/blockquote>\n

And if he didn\u2019t get the point across clearly enough (2):<\/span><\/p>\n

Some things that you will want to encourage will be quantifiable, and some will not. \u00a0If you report on the quantitative goals and ignore the qualitative onces, you won\u2019t get the qualitative goals, which may be the most important ones. \u00a0Management purely by numbers is sort of like painting by numbers – it\u2019s strictly for amateurs.<\/span>
\nAt HP, the company wanted high earnings now and in the future. \u00a0By focusing entirely on the numbers, HP got them now by sacrificing the future\u2026<\/span>
\nBy managing the organization as though it were a black box, some divisions at HP optimized the present at the expense of their downstream competitiveness. \u00a0The company rewarded managers for achieving short-term objectives in a manner that was bad for the company. \u00a0It would have been better to take into account the white box. \u00a0The white box goes beyond the numbers and gets into how the organization produced the numbers. \u00a0It penalizes managers who sacrifice the future for the short-term and rewards those who invest in the future even if that investment cannot be easily measured.<\/span><\/p><\/blockquote>\n

I\u2019ll have to wait until the official report on the VA scandal is released before commenting on why the failure occurred. \u00a0However, it does seem to me as a case of failure of the black box, as Ben Horowitz explained so adeptly. \u00a0His writing is recommended.<\/span><\/p>\n

1.\u00a0 Ben Horowitz, The Hard Thing about Hard Things, HarperCollins 2014, p.132<\/p>\n

2. IBID p.132-133<\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

The Veteran\u2019s affair scandal has been newsworthy lately. \u00a0The facts about the VA scandal will be forthcoming in August, but David Brooks made some smart inferences back on May 16th on NPR\u2019s Week In Politics: BROOKS: Yeah, he’s (Shinkseki) in hot water. He’s been there since the beginning. So I don’t know if I’d necessarily […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"New N2Value Blog Post: The danger of choosing the wrong metric : The #VA Scandal http:\/\/wp.me\/p4mtfP-38W","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[2,7,6],"tags":[],"class_list":["post-12086","post","type-post","status-publish","format-standard","hentry","category-healthcare","category-leadership","category-process-analytics"],"jetpack_publicize_connections":[],"aioseo_notices":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p4mtfP-38W","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/n2value.com\/blog\/wp-json\/wp\/v2\/posts\/12086","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/n2value.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/n2value.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/n2value.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/n2value.com\/blog\/wp-json\/wp\/v2\/comments?post=12086"}],"version-history":[{"count":8,"href":"https:\/\/n2value.com\/blog\/wp-json\/wp\/v2\/posts\/12086\/revisions"}],"predecessor-version":[{"id":12094,"href":"https:\/\/n2value.com\/blog\/wp-json\/wp\/v2\/posts\/12086\/revisions\/12094"}],"wp:attachment":[{"href":"https:\/\/n2value.com\/blog\/wp-json\/wp\/v2\/media?parent=12086"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/n2value.com\/blog\/wp-json\/wp\/v2\/categories?post=12086"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/n2value.com\/blog\/wp-json\/wp\/v2\/tags?post=12086"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}