Verification and Validation of Agent-based Models
Verification and validation (V&V) of simulation models is extremely important. Verification involves the model being debugged to ensure it works correctly, whereas validation ensures that the right model has been built. Verification and validation can be seen in the social sciences domain, and validation seen in Computational Economics Face validation, sensitivity analysis, calibration and statistical validation have also been demonstrated. Discrete-Event Simulation Framework approach for the validation of Agent-Based systems has been proposed in. A comprehensive resource on empirical validation of agent-based models is
As an example of V&V technique, consider VOMAS (Virtual Overlay Multi-Agent System), a software engineering based approach, where a virtual overlay Multi-agent system is developed alongside the agent-based model. The agents in the Multi-Agent System are able to gather data by generation of logs as well as provide run-time validation and verification support by watch agents and also agents to check any violation of invariants at run-time. These are set by the Simulation Specialist with help from the SME (Subject Matter Expert). Muazi et al. also provide an example of using VOMAS for Verification and Validation of a Forest Fire simulation model.
VOMAS provides a formal way of Validation and Verification. If you want to develop a VOMAS, you need to start by designing VOMAS agents along with the agents in the actual simulation preferably from the start. So, in essence, by the time your simulation model is complete, you essentially can consider to have one model which contains two models:
- An Agent Based Model of the intended system
- An Agent Based Model of the VOMAS
Unlike all previous work on Verification and Validation, VOMAS agents ensure that the simulations are validated in-simulation i.e. even during execution. In case of any exceptional situations, which are programmed on the directive of the Simulation Specialist (SS), the VOMAS agents can report them. In addition, the VOMAS agents can be used to log key events for the sake of debugging and subsequent analysis of simulations. In other words, VOMAS allows for a flexible use of any given technique for the sake of Verification and Validation of an Agent-based Model in any domain.
Details of Validated agent-based modeling using VOMAS along with several case studies are given in. This thesis also gives details of "Exploratory Agent-based Modeling", "Descriptive Agent-based Modeling" in addition to "Validated Agent-based Modeling" using several worked case study examples.
Read more about this topic: Agent-based Model
Famous quotes containing the words verification and/or models:
“A fact is a proposition of which the verification by an appeal to the primary sources of our knowledge or to experience is direct and simple. A theory, on the other hand, if true, has all the characteristics of a fact except that its verification is possible only by indirect, remote, and difficult means.”
—Chauncey Wright (1830–1875)
“The parents who wish to lead a quiet life I would say: Tell your children that they are very naughty—much naughtier than most children; point to the young people of some acquaintances as models of perfection, and impress your own children with a deep sense of their own inferiority. You carry so many more guns than they do that they cannot fight you. This is called moral influence and it will enable you to bounce them as much as you please.”
—Samuel Butler (1835–1902)