TY - JOUR
T1 - Enhancing the Noise Robustness of the Optimal Computing Budget Allocation Approach
AU - Choi, Seon Han
AU - Kim, Tag Gon
N1 - Funding Information:
This work was supported by the Agency for Defense Development(ADD) of ROK under Grant number LIGNEX1-2019-0409(00).
Publisher Copyright:
© 2013 IEEE.
PY - 2020
Y1 - 2020
N2 - Since an optimal computing budget allocation (OCBA) approach maximizes the efficiency of the simulation budget allocation to correctly find the optimal solutions, various OCBA-based procedures, such as OCBA, OCBAm+, and MOCBA+, have been widely applied to solve simulation-based optimization problems. Recently, it has been found that the stochastic noise in a simulation model increases due to the increasing complexity of modern industrial systems. However, the OCBA approach may be inefficient for these practical problems. That is, it is very likely to waste a lot of budget on other candidates that are not truly optimal due to the abnormal simulation results, which occurs frequently in noisy environments. In this paper, we intuitively analyze the causes of this efficiency deterioration of the OCBA approach, and then a simple heuristic adjustment is proposed to enhance the noise robustness of the OCBA approach based on our analysis results. The proposed adjustment allows the OCBA approach to further consider the precision of the simulation results, thereby significantly reducing the wasted budget and increasing the efficiently. In addition, it can be applied to the existing allocation rules without modification and does not require additional computational costs. Many experimental results for the eight OCBA-based procedures clearly demonstrate the effectiveness of this adjustment. In particular, the results of practical problems emphasize its necessity.
AB - Since an optimal computing budget allocation (OCBA) approach maximizes the efficiency of the simulation budget allocation to correctly find the optimal solutions, various OCBA-based procedures, such as OCBA, OCBAm+, and MOCBA+, have been widely applied to solve simulation-based optimization problems. Recently, it has been found that the stochastic noise in a simulation model increases due to the increasing complexity of modern industrial systems. However, the OCBA approach may be inefficient for these practical problems. That is, it is very likely to waste a lot of budget on other candidates that are not truly optimal due to the abnormal simulation results, which occurs frequently in noisy environments. In this paper, we intuitively analyze the causes of this efficiency deterioration of the OCBA approach, and then a simple heuristic adjustment is proposed to enhance the noise robustness of the OCBA approach based on our analysis results. The proposed adjustment allows the OCBA approach to further consider the precision of the simulation results, thereby significantly reducing the wasted budget and increasing the efficiently. In addition, it can be applied to the existing allocation rules without modification and does not require additional computational costs. Many experimental results for the eight OCBA-based procedures clearly demonstrate the effectiveness of this adjustment. In particular, the results of practical problems emphasize its necessity.
KW - Discrete-event system
KW - high robustness to noise
KW - optimal computing budget allocation
KW - ranking and selection
KW - simulation-based optimization
KW - stochastic simulation
UR - http://www.scopus.com/inward/record.url?scp=85079591105&partnerID=8YFLogxK
U2 - 10.1109/ACCESS.2020.2970864
DO - 10.1109/ACCESS.2020.2970864
M3 - Article
AN - SCOPUS:85079591105
SN - 2169-3536
VL - 8
SP - 25749
EP - 25763
JO - IEEE Access
JF - IEEE Access
M1 - 8977536
ER -