tag:blogger.com,1999:blog-32053362.post3364921190791089850..comments2024-03-29T06:37:18.029-04:00Comments on Not Running a Hospital: Surgical Gag OrderPaul Levyhttp://www.blogger.com/profile/17065446378970179507noreply@blogger.comBlogger27125tag:blogger.com,1999:blog-32053362.post-9004035361827667422008-01-05T21:45:00.000-05:002008-01-05T21:45:00.000-05:00"The American College of Surgeons, the preeminent ..."The American College of Surgeons, the preeminent surgical organization in the country, has developed a superb program to measure the relative quality of surgical outcomes in hospital programs. It is called NSQIP (National Surgical Quality Improvement Program)...." <BR/><BR/>Technically, the ACS did not develop NSQIP. It was the VA.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-17102395862446676582007-04-09T23:24:00.000-04:002007-04-09T23:24:00.000-04:00Thanks for all your comments. I tend to be a bit ...Thanks for all your comments. I tend to be a bit simplistic, but maybe because it is because I am relatively new to the field.<BR/><BR/>Here is the highly simplified dilemma for a patient: I want to pick a great surgeon or at least a great surgical hospital. Without published information about comparative performance, I will rely on anecdotal information, which has little or no foundation in analysis or rigor. <BR/><BR/>So, I want to have some data that would be helpful. But the doctors and hospitals tell me that there is no accurate methodology. Oh wait, the ACS tells me it has a great methodology that it shares with its members, but apparently I am not smart/worthy/ready enough to be granted access to it.<BR/><BR/>How disrespectful would this feel to you?<BR/><BR/>Folks, we are trying to help the public understand why academic medical centers are important parts of our future health care system -- and why they are worthy of public investment and other special treatment. As Anon 2:03 states, if the people in the field don't start to self-report, they will find themselves subject to mandates over which they have little control.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-48664625003335422952007-04-09T14:48:00.000-04:002007-04-09T14:48:00.000-04:00Perhaps if hospitals like BIDMC are in possession ...Perhaps if hospitals like BIDMC are in possession of data that suggest a particular surgeon is sub-par or whose statistics fall below some minimum threshold of competence, he or she could be denied practice privileges at the hospital. If all hospitals in a region could agree on such metrics, that might be one way to weed out the less competent practitioners. Conversely, if a surgeon has especially good statistics that suggest his skills are well above average, he could be designated an "All Star" which would identify him to the public as among the best in the field.<BR/><BR/>If there are doctors whose peers would not go to them for treatment and would not refer a family member to them, I would love to know that so I could avoid them too. At the same time, let's clearly identify the stars. As a patient, I would also like to be able to infer that the very fact that a given doc has practice privileges at a hospital, especially an academic medical center, means the patient can expect a level of competence that the hospital's own staff would find acceptable if they needed treatment themselves. In the investment world, we call that eating our own cooking.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-11890809427721855322007-04-09T14:03:00.000-04:002007-04-09T14:03:00.000-04:00Further comment from anon 8:40, regarding Paul's 9...Further comment from anon 8:40, regarding Paul's 9:06 challenge. Where I DO fault my profession is in not being more proactive in proposing and refining outcome statistics and testing them out internally within hospitals/surgery centers, and then voluntarily reporting them publicly before they are inevitably mandated to. The ACS is missing a golden opportunity to (gasp) apply its criteria to individual surgeons and see how they work or what must be honed - before some government clerk or Congress comes up with its own statistics which will certainly be invalid. We need to get our heads out of the sand.<BR/><BR/>But consider the law of unintended consequences - given that surgical outcome statistics of the surgeon and hospital are usually intertwined (due to differences in equipment, staff competence level, etc.), could public reporting of surgeons' outcome statistics result in their refusal to operate at, say, an inner city hospital with inferior equipment? What would this do to our health care system? I can't even think of the many other unintended consequences that should be considered.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-73223372882383924672007-04-09T13:54:00.000-04:002007-04-09T13:54:00.000-04:00PaulI am anon 8:40. Thanks for giving me the oppor...Paul<BR/><BR/>I am anon 8:40. Thanks for giving me the opportunity to clarify. I detect a wee bit of frustration in your 9:06 response. (: I hope my reply doesn't run on too long.<BR/><BR/>First, let me say that I am also the person who posted the earlier comments citing the NEJM article on the public report cards, so I actually agree with you that there should be public reporting of outcome statistics. But you asked for comment about why someone might "pad" their statistics, so I am trying to give you some insight into the psyche of today's physician.<BR/>Please reread my sentence, "...we fear that the data may not accurately measure how we perform..." This is the crux, I believe, of docs' reluctance to see public outcome data - certainly NOT that we feel we shouldn't be "judged by society for our clinical expertise." And I acknowledge your statement that there has been good work to normalize for clinical severity, etc. I have been pondering how best to get my point across, and the only way I know is to give you a couple examples of statistics from my own practice - although not surgery, just as important to the patient's outcome.<BR/> One of the quality assurance statistics my group of 5 collected was "correlation between pathologist diagnosis and outside consultation diagnosis". This encompassed all cases diagnosed by us and then sent out to a different center for confirmation. It so happened that another member of our group had the highest number of cases sent out for consultation, and the highest concordance between his/her diagnosis and the outside one. I, on the other hand, had the lowest number of cases sent out, but the lowest concordance. The other group members were somewhere in the middle on both counts. So did that mean he was the best pathologist and I was the worst? Certainly the public might conclude so from that statistic. What one should ask, however, is, how many of his/her cases were sent out by his request (versus the patient's or treating doctor's) versus mine? Turns out he/she sent out more cases himself, so as to be sure of his diagnosis, whereas my approach was to only send out the "harder" ones in which I was truly unsure of the correct diagnosis - thus ensuring a higher discrepancy rate. (Keep in mind it costs $$ to send out cases)<BR/><BR/>My next example is a little "quiz", if you will play along with me.<BR/>Another statistic we collected was "correlation between frozen section diagnosis and permanent section diagnosis". As you know, a frozen section is a piece of tissue sent to the pathologist during surgery, with a question like, "is this malignant or not?" We are expected to make a diagnosis within 20 minutes, and the frozen section is always of technically inferior quality to a permanent section due to compromises necessary for a quick preparation.<BR/><BR/>So - pretend (God forbid) your daughter has an ovarian mass which, by clinical and imaging exams, may be either benign or malignant. The surgeon tells her he will send a frozen section during surgery and, if it's malignant, take out both ovaries and her uterus (thus, no children ever again). This is a real life clinical scenario. You, being aware of the importance of the pathologist in this procedure, consult our publicly reported statistics. You discover that Pathologist A has an 85% correlation between his frozen and permanents, and Pathologist B has an 100% correlation. Assuming you could choose the pathologist, which one would you choose and why?<BR/><BR/>Now remember, you are just the public here, so you may NOT ask anyone at your hospital about this, least of all any pathologist! I am not trying to play with you here, simply illustrate what could be a realistic scenario should public outcome reporting ensue. I will comment further when you reply.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-50569087416349351222007-04-09T09:06:00.000-04:002007-04-09T09:06:00.000-04:00Thanks anon 8:40,Please explain. Why do so many d...Thanks anon 8:40,<BR/><BR/>Please explain. Why do so many doctors think they should not be judged by society for their clinical expertise? You call it feeling "beseiged" and even retired because of that. What is is about medial training that makes people think they should not be held accountable by something other than anecdotal evidence? I have yet to see a metric that most doctors think is fair, notwithstanding excellent work by IHI and other places to create statistically valid approaches. You folks need to get past that and understand that society has a right to ask these questions. With the government paying about 40% of health care costs, you should also expect legislators to ask them. Sure, it will not always be fair, but who promised that life would be fair?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-66495453485141092002007-04-09T08:40:00.000-04:002007-04-09T08:40:00.000-04:00Paul;I am offering my opinion as a retired patholo...Paul;<BR/>I am offering my opinion as a retired pathologist, not a surgeon, but I am married to one, interacted with many, and served many years on medical executive committees, etc. where these issues are discussed. I think all docs (myself included) are wary of being judged by statistical outcome data, mainly because we fear that the data may not accurately measure how we perform, or will be somehow skewed to "get" us by insurance companies, government, etc. Surgeons, in particular, are heavily anecdote-biased - in that, to them, each case is unique and its details are important for an understanding of how it unfolded and how a particular outcome was achieved. This is captured in the typical morbidity/mortality conference, where all details of cases are aired - but not in dry statistics.<BR/>And not all negative outcomes are anyone's fault - some patients just have complications which are statistically predictable in a population of patients undergoing that procedure.<BR/>However, I have been involved in cases where a surgeon was clearly a (negative) statistical outlier compoared to his peers within a given hospital. Everyone "knew" that he was a substandard performer, but it took the statistics to give the medical staff the courage to finally officially confront him. So clearly, these statistics have their place.<BR/>So yes, I could see surgeons cherry-picking cases to improve their numbers, particularly if they perform few cases of a given procedure or their practices are marginally successful for other reasons anyway. And I could see this happening more in private practice than in an academic setting such as yours. But, I can't see this happening on a widespread basis once the publication of these statistics becomes the national norm. Right now, it represents "change", always threatening and especially so in the current beseiged mentality of all physicians. (And that mentality is justified in my opinion, I might add - one reason I retired at age 52).Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-59556018807663588932007-04-09T07:11:00.000-04:002007-04-09T07:11:00.000-04:00Paul, BIDMC surgeons are excellent. But humans mak...Paul, BIDMC surgeons are excellent. But humans make decisions for reasons that, many times, are beyond our and their comprehension.<BR/><BR/>JMAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-48121274794204096512007-04-08T19:37:00.000-04:002007-04-08T19:37:00.000-04:00Jon and Domenico have now brought up this issue of...Jon and Domenico have now brought up this issue of surgeons not taking on difficult cases for fear that their bad numbers will be driven up. What is this all about? Our surgeons at BIDMC take pride in taking on the more difficult cases and also view it as part of their professional responsibility. Are they that different from the norm? Comments please.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-82489688278438607462007-04-08T19:27:00.000-04:002007-04-08T19:27:00.000-04:00I think sharing of this data would be useful and v...I think sharing of this data would be useful and valid, but I hold the belief that the entire health care system should be much more transparent (even more so when it comes to health care economics).<BR/><BR/>I do worry that the numbers are valid vis-a-vis risk-adjusting for different patient types. I have heard rumors of transplant surgeons who cherry pick patients to maintain extremely good outcome results and thus maintain funding/credibility. The ethics of that aside, unless the risk-adjusting is perfectly done, what would stop people from only taking easier cases to keep their numbers up?Jonhttps://www.blogger.com/profile/04715761776674144257noreply@blogger.comtag:blogger.com,1999:blog-32053362.post-29858919398920641282007-04-08T06:06:00.000-04:002007-04-08T06:06:00.000-04:00I agree. I buy it. We, surgeons, feel ultimately r...I agree. I buy it. We, surgeons, feel ultimately responsible for our surgeries and our patients. With all due respect, I am going to use an expression that I learnt at the BI some years ago, SO WHAT?<BR/><BR/>I am human, I err, with the patient, with the team and overestimating my capacity to control and judge others' actions. <BR/><BR/>Somehow, these argument reminds me of the cross-examination scene between Colonel Natham Jessep (aka Jack Nicholson) and defense attorney, Tom Cruise, in A Few Good Men:<BR/><BR/>If I am a good surgeon and I feel responsible for my patients and I demand the best from my team, complications would be unavoidable and, thus, there would be no need to measure them...<BR/><BR/>No offense.<BR/><BR/>Anyway, I am only worried by the internal and external validity of the tools to identify the source of errors and adverse events and by the impact of its potential misuse. <BR/><BR/>As a surgeon, I have a personal commitment with my patients and I am more than happy to disclose relevant information to the best of my knowledge (mortality, morbidity,5-year survival, SSI rates...). However, in order to have more precise data about my postoperative mortality, it would be necessary to know where, when, how and why it occurred in every case...With all that information, I am sure we'll all learn.<BR/><BR/>Julio MayolAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-51348586126620428902007-04-07T09:49:00.000-04:002007-04-07T09:49:00.000-04:00As a surgeon who works at BIDMC I can tell you tha...As a surgeon who works at BIDMC I can tell you that I always feel ultimately responsible for the results of my surgeries. Part of being a surgeon is being a leader, and leaders are always responsible for the results of their team or organization. To feel any other way abdicates your responsibility to your patients. It also gives you the moral authority to demand the best from all members of the care team, and the responsibility to take the lead in correcting mistakes or deficiencies. No person or organization is perfect and even the best surgeons have complications and bad outcomes from time to time. Admitting them, learning from them and taking appropriate corrective action makes you a better surgeon and leads to better outcomes. Whether or not your personal actions caused the bad outcome is irrelevant. All good surgeons adhere to these principles. It's fundamental to our learning and teaching proccess.<BR/>I have no problem with the public being made aware of the NSQIP data.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-42294561146693871402007-04-07T01:58:00.000-04:002007-04-07T01:58:00.000-04:00Although it is certainly true that outcomes depend...Although it is certainly true that outcomes depend on a team, a demanding surgeon will not tolerate a post-operative team that does not meet his or her standards.Elliotthttps://www.blogger.com/profile/08947512500100910895noreply@blogger.comtag:blogger.com,1999:blog-32053362.post-13115817001655697872007-04-06T22:51:00.000-04:002007-04-06T22:51:00.000-04:00Expanding on my previous comment, the reference fo...Expanding on my previous comment, the reference for the state public report cards is: Steinbrook, Robert, M.D.; "Public report cards - Cardiac Surgery and Beyond"; New England Journal of Medicine 355:1847-1849, 2006. I risk a small quote referring to NY State, for those without a subscription.<BR/><BR/> "Patients who picked a top-performing hospital or surgeon were about half as likely to die as those who picked a hospital or surgeon with a ranking near the bottom. Surgeons whose CABG operations were associated with the highest mortality rates were much more likely than other surgeons to stop performing CABG surgery in the state within 2 years after the release of each report card...."<BR/>"Public report cards are not going away. Indeed, they are likely to become more common and to cover both physicians and institutions, as well as additional surgeries, other procedures, and medical conditions."<BR/>The ACS has an opportunity to be ahead of the curve, or to be behind it.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-80365696135812057272007-04-06T22:32:00.000-04:002007-04-06T22:32:00.000-04:00I am gathering that this tool is a relatively new ...I am gathering that this tool is a relatively new development. It would seem that a period of internal validation of the tool by hospitals would not be unreasonable, prior to public reporting. I do not, however, understand the comment that its validity for individual surgeons is "illusory". Given several surgeons performing the same procedure in the same hospital, with presumably the same equipment and staff, comparison of outcome data between surgeons should be valid over time - unless I am missing something?<BR/><BR/>I believe that New York State has a public report card on cardiovascular surgery outcomes (30 day mortality), including surgeon-specific data. As I understand it, most surgeons who were distinct outliers either ceased doing those procedures or left the state (I think this was in the New England J. of Medicine within past year)<BR/>Also, the Cleveland Clinic heart center provides public outcome data on many of its cardiac procedures (see its website), although I do not believe it is surgeon-specific - yet.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-350450865048232492007-04-06T16:10:00.000-04:002007-04-06T16:10:00.000-04:00Paul,This is a good post.As you know I am a surgeo...Paul,<BR/>This is a good post.<BR/>As you know I am a surgeon who publishes my data and am as open as possible with patients.<BR/><BR/>The problem with these statistics from a surgeons perspective is how it will change practice habits if they are published. Although there is an attempt to adjust for results based on patient risk factors, this will unlikely be accurate.<BR/><BR/>For example, in my practice a straightforward robotic prostatectomy is an easy operation with predictable results. A robotic cystoprostectomy for bladder cancer is a more complex operation with a much higher complication rate with a more unpredictable postoperative course. My results for these have not been great despite having no problems with the surgery.<BR/>if my results were scrutinized to the extent everything was published on a web site, I would no longer do this operation on high risk patients.Domenico Savatta, M.D.https://www.blogger.com/profile/04342924413784465246noreply@blogger.comtag:blogger.com,1999:blog-32053362.post-21451193468056704602007-04-06T14:09:00.000-04:002007-04-06T14:09:00.000-04:00My pleasure. I find your blog very stimulating. Mo...My pleasure. I find your blog very stimulating. <BR/><BR/>Moreover, the BIDMC is very dear to me. I was a research fellow in Surgery in 96, when my son was born at the BI. So I share some BI culture values. <BR/><BR/>Anyway, I am trying to act as devil's advocate. <BR/><BR/>Every human decision always hides a dark side... <BR/><BR/>Julio MayolAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-29950442007901643322007-04-06T13:36:00.000-04:002007-04-06T13:36:00.000-04:00Estimado Julio,I really appreciate your regular pa...Estimado Julio,<BR/><BR/>I really appreciate your regular participation in these discussions! Perhaps someday we will meet in person.<BR/><BR/>I don't see this a finding a culprit. There IS a difference among surgeons, no? I know that surgeons talk among themselves as to who is better or worse than the other. I know surgeons, too, have no problem taking ownership and talking about their patients' mortality rate when it is better than average.<BR/><BR/>I absolutely agree with you, though, that the "rest of the hospital" can make a difference in outcomes. The NSQIP hospital-wide metric captures that.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-40136611158664024562007-04-06T13:12:00.000-04:002007-04-06T13:12:00.000-04:00"Ultimately responsible" means surgeons accept acc..."Ultimately responsible" means surgeons accept accountability for the outcome, but it does not mean that "the" surgeon is the one not performing at the highest level. A surgeon may be a "star" surgically speaking, but others in the team may not...<BR/><BR/>My point is that surgical outcomes reflect the "hospital's outcomes", which includes the surgeon factor as one of the variables, of course.<BR/><BR/>In this imperfect world, best hospitals will consistently have better outcomes. But with a limited number of "best hospitals" these data will only remind patients that there are "fortunate people" who always do better, even if they are sick.<BR/><BR/>Safety is a major concern for all of us, but raw data is not information. And information without accurate interpretation is not knowledge.<BR/><BR/>Data can be misleading. And when people is misled, they usually aim their anger at the wrong target. Then, surgeons feel unfairly treated and defend themselves... A very bad vicious circle (defensive medicine) that increases costs and decreases safety...<BR/><BR/>There must be smarter ways to increase safety without picking out a culprit...<BR/><BR/><BR/>Julio MayolAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-40781634460676793532007-04-06T11:07:00.000-04:002007-04-06T11:07:00.000-04:00Emily,"Ultimately responsible" means what it says....Emily,<BR/><BR/>"Ultimately responsible" means what it says. The surgeon has responsibility for the care of his or her patients. Ask any surgeon. Rest assured that they view the world this way. Ask any patient. You will get the same answer.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-71361907570920527102007-04-06T11:05:00.000-04:002007-04-06T11:05:00.000-04:00Emily,The key measure is straightforward: 30-day ...Emily,<BR/><BR/>The key measure is straightforward: 30-day post-operative mortality, observed versus expected ratio, based on the risk adjusted mix of patients.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-5996080626442003842007-04-06T11:01:00.000-04:002007-04-06T11:01:00.000-04:00Anon 1);23,Yes, we are in it, but you have to abid...Anon 1);23,<BR/><BR/>Yes, we are in it, but you have to abide by the rules to get access to their national data base.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-994380573784928232007-04-06T10:23:00.000-04:002007-04-06T10:23:00.000-04:00Is BIDMC a participant in the ACS program? If so,...Is BIDMC a participant in the ACS program? If so, how is BIDMC gagged? These professional organizations aren't government agencies. Who gave them such power? Take it back.<BR/><BR/>It would be very interesting to see some progressive hospitals, such as BIDMC, publish their own data. After all, the information is likely a result of your own work product, is it not?<BR/><BR/>Also, if I were a patient with my outcome fed into the data stream, I ought to have a say where it goes.<BR/>So I'd want the results available to the public, not a bunch of stuffed suits who use it to wield power and assure each others' wealth.<BR/><BR/>Are these "colleges" working for the best interests of the public? I rather doubt it in this case.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-32053362.post-60265271406420474832007-04-06T10:11:00.000-04:002007-04-06T10:11:00.000-04:00Paul, can you give more information on the measure...Paul, can you give more information on the measures they use? I think it's important to distinguish between those that are surgeon-specific and those that are more general for the hospital. The quote you posted has a point - patient outcomes are more closely linked to the number of procedures a hospital has done than to the number an individual surgeon has done (as suggested by Dr. Mayol's questions). This reflects the team effect that you've discussed before. <BR/><BR/>Just because a surgeon is at the sharp end of the scalpel, as it were, doesn't mean that many other characteristics of the hospital and OR environment and staff don't have a big effect on surgical outcomes. <BR/><BR/>And regarding quality improvement vs. public reporting of hospital-wide measures - as with infection rates, there are probably some technical aspects to adjusting risk that can lead to difficulties in interpretation for outsiders, or even nastiness for the hospital. Not that I'm advocating defensive medicine, I'm just saying it's likely to be a problem given the unfortunate climate we still live in.<BR/><BR/>Finally (and sorry to be so wordy today) what does "ultimately responsible" really mean anyway, and why does it so often come down to an individual?Emily DeVoto, Ph.D.,https://www.blogger.com/profile/15360761251097036916noreply@blogger.comtag:blogger.com,1999:blog-32053362.post-54170939363855159932007-04-06T08:33:00.000-04:002007-04-06T08:33:00.000-04:00I wonder how surgeons view the quality of the indi...I wonder how surgeons view the quality of the individual risk scoring mechanism as it relates to accepting or trying to avoid the highest risk patients. If surgeons themselves view the overall risk scoring mechanism as credible and fair, the data, at least at the hospital level, should be disclosed. For individual surgeons, perhaps that data should only be disclosed once he or she has performed the procedure enough times to reach a minimum threshhold number. If his or her cumulative number of procedures is below the threshhold, that, in itself, is valuable information that the patient should be aware of.Anonymousnoreply@blogger.com