The Office of Cost Assessment and Program Evaluation was established to perform a broad set of cost analysis duties related to major defense acquisition programs. Subsequent laws have mandated additional duties. But the personnel, data, expertise, and other resources to fulfill these additional duties are not always available. The authors examine the requirements and offer recommendations for obtaining the resources to complete required analyses.
- What are the legal requirements for CAPE and the military departments regarding O&S ICEs and ICAs?
- What is CAPE's O&S cost-estimating workload due to these requirements?
- What resources (personnel, data, time, etc.) are available to perform these duties?
- What required duties related to O&S costs can CAPE not accomplish because of resource constraints?
- How can CAPE improve its ability to meet the requirements?
The Weapon System Acquisition Reform Act of 2009 established the Office of Cost Assessment and Program Evaluation (CAPE) in the Office of the Secretary of Defense and mandated a broad set of cost analysis duties, including conducting independent cost estimates (ICEs) and independent cost assessments (ICAs) for major defense acquisition programs at key acquisition milestones. Subsequent laws have mandated additional duties, especially related to program operating and support (O&S) costs, including requirements to conduct or approve life-cycle cost estimates early in acquisition, identify risk drivers in estimates at milestone decisions, and examine alternatives that may reduce O&S costs. The authors assessed the cost analysis requirements for O&S costs by reviewing relevant laws and U.S. Department of Defense (DoD) guidance; assessed the resources available to conduct the analyses, including numbers of cost-estimating personnel, the data typically available to inform cost analyses, and cost-estimating processes and timelines; interviewed government and industry subject-matter experts to understand past and current DoD cost-analysis activities; reviewed the literature; and developed recommendations to improve weapon system O&S cost analysis during the acquisition phase. The authors found that CAPE lacks sufficient personnel and data to perform all the cost activities mandated by law or to do them with rigor. Recommendations include steps to match CAPE personnel levels with the workload and provide cost analysts access to the relevant data, including expertise in product-support activities, needed to inform cost estimates.
O&S costs are often underestimated, especially in early phases
- Over time, constant-dollar estimates sometimes double or triple.
- Information is usually initially extrapolated from data for previous systems; later, experience with actual, fielded systems improves the data on which estimates are based.
Many newer systems are not meeting reliability and availability goals
- Fewer systems are meeting their reliability and availability goals when tested.
- This reflects a declining trend in the reliability and suitability of recently tested systems compared with those tested decades ago.
- All this affects the ultimate cost of O&S.
CAPE's O&S cost workload and resources are mismatched, making it difficult to do all it has been tasked to do
- Legislation has, at various times, established or added to what CAPE is supposed to accomplish. Staffing and related resources have not kept pace.
- Not all the information required to do these assessments is readily available to CAPE. This includes information held in various service systems. Data on contractor costs are also lacking. And CAPE needs more access to subject-matter expertise in many areas.
- As a result of such resource constraints, CAPE is not able to fully accomplish some of its duties.
- Augment CAPE staff.
- Continue management support of existing efforts to address data gaps and make additional data available to support O&S cost analyses.
- Strengthen the OSD role to encourage improved O&S cost and logistics outcomes.
- Make OSD subject-matter experts available continuously to the program.
Table of Contents
The U.S. Department of Defense Cost Analysis Ecosystem and the Office of Cost Assessment and Program Eval
Legal Requirements for CAPE O&S Cost Activities
CAPE Operating and Support Cost-Estimating Activities, Workload, and Processes
CAPE Resources for O&S Cost Activities
Assessment of CAPE's Compliance with Recent Laws Regarding O&S Cost- Estimating Activities
Recommendations for Meeting CAPE's Statutory Responsibilities for O&S Cost Analysis
Recommendations for Improving O&S Outcomes in DoD
O&S Cost Estimates in Selected Acquisition Reports
Visibility and Management of Operating and Support Costs Systems
Synopsis of CAPE's Organizational Predecessors, Role, and Functions