How can we improve the use of past performance in contracting?
Steve Kelman responds to Jaime Gracia's comments on problems with the current system.
Jaime Gracia, CEO of Seville Government Consulting, is one of the most thoughtful commenters around on government contracting issues as seen from a progressive contractor perspective -- i.e., one that is also mindful of the interests of the government and the taxpayer. I don't always agree with everything he writes, but I always take his views very seriously.
Jaime and I also share an interest in making government past performance evaluations a more meaningful part of the contracting process. Speaking for myself, I remain convinced that there is no single step the government could take to improve the performance of the contracting system than to make past performance an effective differentiator between excellent, acceptable and poor performance. We should penalize poor performers but also, importantly, reward the good ones. Customer decisions about whom to do business with based on a supplier's past performance are absolutely essential in the commercial market to making the free market work to satisfy customers.
Jaime has written an interesting FCW op-ed called "Why past performance must be part of acquisition reform," and I urge all blog readers to take a look.
Let me start with the parts of Jaime's column with which I agree. He urges that past performance evaluations to the extent possible be based on objective data about cost, schedule and performance rather than the subjective judgments of government officials. I strongly agree with this in general, though I assume Jaime would agree there are limits. There are situations where it is difficult to develop good objective measures at all (particularly of performance), and also those where changes in the original baseline make the evaluation of even objective performance information more subjective. At a minimum, we should recognize the validity of "inter-subjective data" -- the subjective judgments of a larger number of people, e.g. customer satisfaction surveys -- in judging past performance.
I also thought Jamie made a very interesting suggestion about greater public disclosure of project management information already provided the government. I would love to hear the reaction of both government people and contractors to this suggestion. Perhaps this at least could be done on a voluntary basis by the government -- with an agency disclosing its intention to do so in an RFP? How often would such information be considered proprietary?
However, Jaime and I continue to differ somewhat on the justification of the current level of "due process" protections for contractors in the past performance system. He is concerned about subjective or ill-willed negative judgments by government officials, particularly in the current "lowest price technically acceptable" contracting environment. My own reaction is that the bigger danger in the system is grade inflation, not unjustified dinging of contractors.
To some extent, this is an objectively testable proposition -- have we seen an increase in negative past performance ratings in recent LPTA years? (Of course, even if the answer is yes, this may be because performance has gotten worse. Though Jaime would counter, probably correctly, that this is the government's own fault. But if negative ratings aren't going up, this would argue that the system definitely suffers from grade inflation.)
At any rate, I continue to believe that the ability of contractor to contest ratings drives grade inflation, and that a sufficient due process protection is to allow the contractor to put their version of events in the past performance file.
Jaime -- and others -- let's continue this dialogue. I would love to see our community make improving the past performance system a high priority.