Verification and Validation of Agent-based Models
Verification and validation (V&V) of simulation models is extremely important. Verification involves the model being debugged to ensure it works correctly, whereas validation ensures that the right model has been built. Verification and validation can be seen in the social sciences domain, and validation seen in Computational Economics Face validation, sensitivity analysis, calibration and statistical validation have also been demonstrated. Discrete-Event Simulation Framework approach for the validation of Agent-Based systems has been proposed in. A comprehensive resource on empirical validation of agent-based models is
As an example of V&V technique, consider VOMAS (Virtual Overlay Multi-Agent System), a software engineering based approach, where a virtual overlay Multi-agent system is developed alongside the agent-based model. The agents in the Multi-Agent System are able to gather data by generation of logs as well as provide run-time validation and verification support by watch agents and also agents to check any violation of invariants at run-time. These are set by the Simulation Specialist with help from the SME (Subject Matter Expert). Muazi et al. also provide an example of using VOMAS for Verification and Validation of a Forest Fire simulation model.
VOMAS provides a formal way of Validation and Verification. If you want to develop a VOMAS, you need to start by designing VOMAS agents along with the agents in the actual simulation preferably from the start. So, in essence, by the time your simulation model is complete, you essentially can consider to have one model which contains two models:
- An Agent Based Model of the intended system
- An Agent Based Model of the VOMAS
Unlike all previous work on Verification and Validation, VOMAS agents ensure that the simulations are validated in-simulation i.e. even during execution. In case of any exceptional situations, which are programmed on the directive of the Simulation Specialist (SS), the VOMAS agents can report them. In addition, the VOMAS agents can be used to log key events for the sake of debugging and subsequent analysis of simulations. In other words, VOMAS allows for a flexible use of any given technique for the sake of Verification and Validation of an Agent-based Model in any domain.
Details of Validated agent-based modeling using VOMAS along with several case studies are given in. This thesis also gives details of "Exploratory Agent-based Modeling", "Descriptive Agent-based Modeling" in addition to "Validated Agent-based Modeling" using several worked case study examples.
Read more about this topic: Agent-based Model
Famous quotes containing the words verification and/or models:
“A fact is a proposition of which the verification by an appeal to the primary sources of our knowledge or to experience is direct and simple. A theory, on the other hand, if true, has all the characteristics of a fact except that its verification is possible only by indirect, remote, and difficult means.”
—Chauncey Wright (1830–1875)
“Grandparents can be role models about areas that may not be significant to young children directly but that can teach them about patience and courage when we are ill, or handicapped by problems of aging. Our attitudes toward retirement, marriage, recreation, even our feelings about death and dying may make much more of an impression than we realize.”
—Eda Le Shan (20th century)