Verification, Validation and Uncertainty Quantification in Scientific Computing

Engineering systems must increasingly rely on computational simulation for predicted performance, reliability, and safety. Computational analysts, designers, decision makers, and project managers who rely on simulation must have practical techniques and methods for assessing simulation credibility. This short course presents modern terminology and effective procedures for verification of numerical simulations, validation of mathematical models, and uncertainty quantification of nondeterministic simulations.

The techniques presented in this course are applicable to a wide range of engineering and science applications, including fluid dynamics, heat transfer, solid mechanics, and structural dynamics. The mathematical models considered are given in terms of partial differential or integral equations, formulated as initial and boundary value problems. The computer codes that implement the mathematical models can use any type of numerical method (e.g., finite volume, finite element) and can be developed by commercial, corporate, government, or research organizations. A framework is provided for incorporating a wide range error and uncertainty sources identified during the modeling, verification, and validation processes with the goal of estimating the total prediction uncertainty of the simulation.

While the focus of the course is on modeling and simulation, experimentalists will benefit from a detailed discussion of techniques for designing and conducting high quality validation experiments. Application examples are primarily taken from the fields of fluid dynamics and heat transfer, but the techniques and procedures apply to all application areas in engineering and science. The course closely follows the course instructors’ book, Verification and Validation in Scientific Computing, Cambridge University Press (2010).

Upon completion of this course, attendees will be able to:

• Define the objectives of verification, validation, and uncertainty quantification
• Implement procedures for code verification and software quality assurance
• Implement procedures for solution verification, i.e., numerical error estimation
• Plan and design validation experiments
• Understand procedures for model accuracy assessment
• Comprehend the concepts and procedures for non-deterministic simulation
• Identify sources of uncertainty, such as aleatory and epistemic uncertainties
• Recognize the goals of model parameter calibration/updating
• Interpret local and global sensitivity analyses
• Recognize the practical difficulties in implementing VVUQ technologies

Course Materials Provided

Course attendees will be provided with a copy of the book Verification and Validation in Scientific Computing, Cambridge University Press (2010). Registrants outside of the United States will receive an e-book version. The 780-page book provides a comprehensive and systematic development of the basic concepts, principles, and procedures for verification, validation, and uncertainty quantification for models and simulations. The book contains several examples of the most common procedures in VVUQ, including an example of the design and execution of a high quality validation experiment.

Course Program

The contents are presented in eight lectures, tentatively organized as shown. The schedule allows for ample discussion and interaction with the instructors and other attendees. The instructors reserve the right to modify the contents to address the audience’s needs and preferences.

Lecture 1. Introduction, Background, and Motivation

Lecture 2. Terminology and Fundamental Concepts

• Brief history of terminology
• Present definitions and interpretations
• Alternate definitions used by related communities
• Additional important terms
• Who should conduct verification, validation, and uncertainty quantification?

Lecture 3: Code Verification

• Software engineering
• Criteria and definitions–Order of accuracy
• Traditional exact solutions
• Method of manufactured solutions

Lecture 4: Solution Verification

• Round-off error
• Iterative convergence
• Iterative error estimation
• Discretization error estimation
• Reliability of discretization error estimators
• Discretization error and uncertainty estimation
• Solution adaptation procedures

Lecture 5: Validation Experiments

• Validation fundamentals
• Validation experiment hierarchy
• Validation experiments vs. traditional experiments
• Six characteristics of validation experiments
• Detailed example of a wind tunnel validation experiment

Lecture 6: Model Accuracy Assessment

• What are validation metrics?
• Various approaches to validation metrics
• Recommended characteristics for validation metrics
• Identification of model discrepancy
• Cumulative distribution function approach

Lecture 7: Predictive Capability of Modeling and Simulation

• Identify all sources of uncertainty
• Characterize each source of uncertainty
• Estimate solution error in system responses of interest
• Estimate total uncertainty in system responses of interest
• Procedures for updating model parameters
• Types of sensitivity analysis

Lecture 8: Final Topics

• Planning and prioritization in modeling and simulation
• Maturity assessment of modeling and simulation
• Practical difficulties in implementing VVUQ technologies

Who Should Attend?

Model developers, computational analysts, code developers, software engineers, and experimentalists working with computational analysts. Managers directing simulation work and project engineers relying on computational simulations for decision-making will also find this course beneficial.

Interested?

Get in touch to discuss your next steps with our experienced training team. We can work closely with you to understand your specific requirements, cater for your specific industry sector or analysis type, and produce a truly personalised training solution for your organisation.

All NAFEMS training courses are entirely code independent, meaning they are suitable for users of any software package.

Courses are available to both members and non-members of NAFEMS, although member organisations will enjoy a significant discount on all fees.

NAFEMS course tutors enjoy a world-class reputation in the engineering analysis community, and with decades of experience between them, will deliver tangible benefits to you, your analysis team, and your wider organisation.