Valueofinformation
Also see Introduction to risk analysis, Risk management introduction, What are risks and opportunities
What is Valueofinformation?
Valueofinformation (VOI) methods determine the worth of acquiring extra information to help the decisionmaker. From a decision analysis perspective, acquiring extra information is only useful if it has a significant probability of changing the decisionmaker's currently preferred strategy. The penalty of acquiring more information is usually valued as the cost of that extra information, and sometimes also the delay incurred in waiting for the information.
VOI techniques are based on analyzing the revised estimates of model inputs that come with extra data, together with the costs of acquiring the extra data and a decision rule that can be converted into a mathematical formula to analyze whether the decision would alter. The ideas are welldeveloped (see the reference list below) but the probability algebra can be somewhat complex, and simulation is more flexible and a lot easier for most VOI calculations.
The usual starting point of a VOI analysis is to consider the value of perfect information (VOPI), i.e. answering the question 'What would be the benefit, in terms we are focusing on (usually money, but it could be lives saved, etc.), of being able to know some parameter(s) perfectly?' If perfect knowledge would not change a decision, the extra information is worthless, and if it does change a decision then the value is the difference between the expected net benefit of the new selected option compared to that previously favoured. VOPI is a useful limiting tool, because it tells us the maximum value that any data may have in better evaluating the input parameter of concern. If the information costs more than that maximum value, we know not to pursue it any further.
After a VOPI check, one then looks at the value of imperfect information (VOII). Usually, the collection of more data will decrease, not eliminate, uncertainty about an input parameter, so VOII focuses on whether the decrease in uncertainty is worth the cost of collecting extra information. In fact, if new data are inconsistent with previous data or beliefs that were used to estimate the parameter, new data may even increase the uncertainty.
If the data being used are n random observations (e.g. survey or experimental results) the uncertainty about the value of a parameter has a width (roughly) proportional to 1/SQRT(n). So if you already have n observations and would like to halve the uncertainty, you will need a total of 4n observation (an increase of 3n). If you want to decrease uncertainty by a factor of 10 you will need a total of 100n observations (an increase of 99n). In other words a decrease in uncertainty about a parameter value becomes exponentially more expensive the closer the uncertainty gets to zero. Thus, if a VOPI analysis shows that it is economically justified to collect more information before making a decision, there will certainly be a point in the data collection where the cost of collecting data will outweigh their benefit.
VOPI analysis method

Consider the range of possible values for the parameter(s) for which you could collect more information;

Determine whether there are possible values for these parameters that, if known, would make the decisionmaker select a different option from the one currently deemed to be best; and

Calculated the extra value (e.g. expected profit) that the more informed decision would give. This is the VOPI.
VOII analysis method

Start with a prior belief about a parameter (or parameters), based on data or opinion.

Model what observations might be made with new data using the prior belief;

Determine the decision rule that would be affected by these new data;

Calculate any improvement in the decision capability given the new data: the measure of improvement requires some valuation and comparison of possible outcomes, which is usually taken to be expected monetary or utility value though this is rather restrictive; and

Determine whether any improvement in the decision capability exceeds the cost of the extra information.
An example
Your company wants to develop a new cosmetic but there is some concern that people will have a minor adverse skin reaction to the product. The cost of development of the product to market is $1.8 million. The revenue NPV (including the cost of development) if the product is of the required quality is $3.7 million.
Cosmetic regulations state that you will have to withdraw the product if 2% or more of consumers have an adverse reaction to your product. You have already performed some preliminary trails on 200 random people selected from the target demographic, at a cost/person of $500. Three of those people had an adverse reaction to the product.
Management decide the product will only be developed if they can be 85% confident that the product will affect less than the required 2% of the population. Decision question: Should we test more people or just abandon the product development now? If we should test more people, then how many more?
VOPI analysis
Having observed 3 affected people out of 200 our prior belief about the probability a random person has an adverse reaction p can be modelled as Beta(3+1,2003+1) = Beta(4,198) which gives a 57.24% confidence that 2% or less of the target demographic will be affected (seen in the Markers statistics on the right of the image below, or directly calculated as VoseBetaProb(2%,4,198,1)):
Thus, the current level of information means that management would not pursue development of the product, with no resultant cost or revenue, i.e. a net revenue of $0. However, the Beta distribution shows that it is quite possible that p is less than 2%, and we could be losing a good opportunity by quitting now. If this was known for sure the company would get a profit of $3.7 million, so the VOPI = $3.7 million * 57.24% + $0 million * 42.76% = $2.12 million, and each test only costs $500, so it is certainly possible that more information could be worth the expense.
VOII analysis
The solution is provided in this example model.
The model performs the VOII steps described above:

The parameter of concern is the fraction of people (prevalence) p in the target demographic (women 1865) who would have an adverse reaction, with a prior uncertainty described by Beta(4,198), cell C17.

The people in the study are randomly sampled from this demographic so if we test m extra people (cell C27) we can assume the number of people who would be adversely affected s would follow a Binomial(m,p) distribution (cell C29);

The revised estimate for p would then become Beta(4+s,198+(ms)). The confidence we then have that p is < 2% is given by VoseBetaProb(2%,4+s,198+(ms),1), cell C32. If this confidence exceeds 85% management would take the decision to develop the product (cells C36:C37);

The model simulates different possible values of p from the prior. It models various possible numbers of extra tests m, and simulates the extra data generated (s out of m), then evaluates the expected return of the resultant decision. Of course, although one may have reached the required confidence for p, the true value for p doesn't change and a bad decision may still be taken. The value of information is calculated for each sample, and the Mean function used to calculate the expected value of information.
Note that for this example, the question being posed is how many more people to test in one go. A more optimal strategy would be to test a smaller number, review the results, and perform another VOII analysis. This iterative process will either achieve the required confidence at a smaller test cost, or lead one to abandon further testing because one is fairly sure that the required performance will not be achieved.
It might at first seem that we are getting something for nothing here. After all, we don't actually know anything more until we perform the extra tests. However, the decision that would be made would depend on the results of those extra tests, and those results depend on what the true value of p actually is. Thus, the analysis is based on our prior for p (i.e. what we know to date about p) and the decision rule. When the model generates a scenario it selects a value from the prior for p. It is saying: 'Let's imagine that this is the true value for p'. If that value is <2% we should develop the product of course, but we'll never know the value of p (until we have launched the product and have enough customer history to know its value). However, extra tests will get us closer to knowing its true value and so we end up taking less of a gamble. When the model picks a small value for p, it will probably generate a small number of affected people in our new tests, and our interpretation of this small number as meaning p is small will often be correct. The danger is that a high p value could by chance result in an unrepresentatively small fraction of m being affected, which will be misinterpreted as a small p, and lead management to make the wrong decision. However, as m gets bigger so that risk diminishes. The balance that needs to be made is that the tests cost money. The model simulates twenty scenarios where m is varied between 100 and 3000, with the following results:
It tells us that the optimal strategy, i.e. with the greatest expected VOII, is to perform about another 700 tests. The sawtooth effect in these plots occurs because of the discrete nature of the extra number affected one would observe in the new data. Note that if the tests had no cost, the graph above would look very different:
Now it is continually worth collecting more information (providing it is feasible to actually do) because there is no penalty to be paid in running more tests (except perhaps time which is not included as part of this problem). In this case the value of information asymptotically approaches the VOPI (= $2.12million) as the number of people tested approaches infinity.
Further reading
The following texts provide good explanations on VOI principles and practices:

Clemen RT and Reilly T (2001). Making Hard Decisions. Duxbury, CA.

Goodwin P and Wright G (1998). Decision Analysis for Management Judgment. Wiley, NY.
ModelRisk
Monte Carlo simulation in Excel. Learn more
Tamara
Adding risk and uncertainty to your project schedule. Learn more
Navigation
 Risk management
 Risk management introduction
 What are risks and opportunities?
 Planning a risk analysis
 Clearly stating risk management questions
 Evaluating risk management options
 Introduction to risk analysis
 The quality of a risk analysis
 Using risk analysis to make better decisions
 Explaining a models assumptions
 Statistical descriptions of model outputs
 Simulation Statistical Results
 Preparing a risk analysis report
 Graphical descriptions of model outputs
 Presenting and using results introduction
 Statistical descriptions of model results
 Mean deviation (MD)
 Range
 Semivariance and semistandard deviation
 Kurtosis (K)
 Mean
 Skewness (S)
 Conditional mean
 Custom simulation statistics table
 Mode
 Cumulative percentiles
 Median
 Relative positioning of mode median and mean
 Variance
 Standard deviation
 Interpercentile range
 Normalized measures of spread  the CofV
 Graphical descriptionss of model results
 Showing probability ranges
 Overlaying histogram plots
 Scatter plots
 Effect of varying number of bars
 Sturges rule
 Relationship between cdf and density (histogram) plots
 Difficulty of interpreting the vertical scale
 Stochastic dominance tests
 Riskreturn plots
 Second order cumulative probability plot
 Ascending and descending cumulative plots
 Tornado plot
 Box Plot
 Cumulative distribution function (cdf)
 Probability density function (pdf)
 Crude sensitivity analysis for identifying important input distributions
 Pareto Plot
 Trend plot
 Probability mass function (pmf)
 Overlaying cdf plots
 Cumulative Plot
 Simulation data table
 Statistics table
 Histogram Plot
 Spider plot
 Determining the width of histogram bars
 Plotting a variable with discrete and continuous elements
 Smoothing a histogram plot
 Risk analysis modeling techniques
 Monte Carlo simulation
 Monte Carlo simulation introduction
 Monte Carlo simulation in ModelRisk
 Filtering simulation results
 Output/Input Window
 Simulation Progress control
 Running multiple simulations
 Random number generation in ModelRisk
 Random sampling from input distributions
 How many Monte Carlo samples are enough?
 Probability distributions
 Distributions introduction
 Probability calculations in ModelRisk
 Selecting the appropriate distributions for your model
 List of distributions by category
 Distribution functions and the U parameter
 Univariate continuous distributions
 Beta distribution
 Beta Subjective distribution
 Fourparameter Beta distribution
 Bradford distribution
 Burr distribution
 Cauchy distribution
 Chi distribution
 Chi Squared distribution
 Continuous distributions introduction
 Continuous fitted distribution
 Cumulative ascending distribution
 Cumulative descending distribution
 Dagum distribution
 Erlang distribution
 Error distribution
 Error function distribution
 Exponential distribution
 Exponential family of distributions
 Extreme Value Minimum distribution
 Extreme Value Maximum distribution
 F distribution
 Fatigue Life distribution
 Gamma distribution
 Generalized Extreme Value distribution
 Generalized Logistic distribution
 Generalized Trapezoid Uniform (GTU) distribution
 Histogram distribution
 HyperbolicSecant distribution
 Inverse Gaussian distribution
 Johnson Bounded distribution
 Johnson Unbounded distribution
 Kernel Continuous Unbounded distribution
 Kumaraswamy distribution
 Kumaraswamy Fourparameter distribution
 Laplace distribution
 Levy distribution
 Lifetime TwoParameter distribution
 Lifetime ThreeParameter distribution
 Lifetime Exponential distribution
 LogGamma distribution
 Logistic distribution
 LogLaplace distribution
 LogLogistic distribution
 LogLogistic Alternative parameter distribution
 LogNormal distribution
 LogNormal Alternativeparameter distribution
 LogNormal base B distribution
 LogNormal base E distribution
 LogTriangle distribution
 LogUniform distribution
 Noncentral Chi squared distribution
 Noncentral F distribution
 Normal distribution
 Normal distribution with alternative parameters
 Maxwell distribution
 Normal Mix distribution
 Relative distribution
 Ogive distribution
 Pareto (first kind) distribution
 Pareto (second kind) distribution
 Pearson Type 5 distribution
 Pearson Type 6 distribution
 Modified PERT distribution
 PERT distribution
 PERT Alternativeparameter distribution
 Reciprocal distribution
 Rayleigh distribution
 Skew Normal distribution
 Slash distribution
 SplitTriangle distribution
 Studentt distribution
 Threeparameter Student distribution
 Triangle distribution
 Triangle Alternativeparameter distribution
 Uniform distribution
 Weibull distribution
 Weibull Alternativeparameter distribution
 ThreeParameter Weibull distribution
 Univariate discrete distributions
 Discrete distributions introduction
 Bernoulli distribution
 BetaBinomial distribution
 BetaGeometric distribution
 BetaNegative Binomial distribution
 Binomial distribution
 Burnt Finger Poisson distribution
 Delaporte distribution
 Discrete distribution
 Discrete Fitted distribution
 Discrete Uniform distribution
 Geometric distribution
 HypergeoM distribution
 Hypergeometric distribution
 HypergeoD distribution
 Inverse Hypergeometric distribution
 Logarithmic distribution
 Negative Binomial distribution
 Poisson distribution
 Poisson Uniform distribution
 Polya distribution
 Skellam distribution
 Step Uniform distribution
 Zeromodified counting distributions
 More on probability distributions
 Multivariate distributions
 Multivariate distributions introduction
 Dirichlet distribution
 Multinomial distribution
 Multivariate Hypergeometric distribution
 Multivariate Inverse Hypergeometric distribution type2
 Negative Multinomial distribution type 1
 Negative Multinomial distribution type 2
 Multivariate Inverse Hypergeometric distribution type1
 Multivariate Normal distribution
 More on probability distributions
 Approximating one distribution with another
 Approximations to the Inverse Hypergeometric Distribution
 Normal approximation to the Gamma Distribution
 Normal approximation to the Poisson Distribution
 Approximations to the Hypergeometric Distribution
 Stirlings formula for factorials
 Normal approximation to the Beta Distribution
 Approximation of one distribution with another
 Approximations to the Negative Binomial Distribution
 Normal approximation to the Studentt Distribution
 Approximations to the Binomial Distribution
 Normal_approximation_to_the_Binomial_distribution
 Poisson_approximation_to_the_Binomial_distribution
 Normal approximation to the Chi Squared Distribution
 Recursive formulas for discrete distributions
 Normal approximation to the Lognormal Distribution
 Normal approximations to other distributions
 Approximating one distribution with another
 Correlation modeling in risk analysis
 Common mistakes when adapting spreadsheet models for risk analysis
 More advanced risk analysis methods
 SIDs
 Modeling with objects
 ModelRisk database connectivity functions
 PK/PD modeling
 Value of information techniques
 Simulating with ordinary differential equations (ODEs)
 Optimization of stochastic models
 ModelRisk optimization extension introduction
 Optimization Settings
 Defining Simulation Requirements in an Optimization Model
 Defining Decision Constraints in an Optimization Model
 Optimization Progress control
 Defining Targets in an Optimization Model
 Defining Decision Variables in an Optimization Model
 Optimization Results
 Summing random variables
 Aggregate distributions introduction
 Aggregate modeling  Panjer's recursive method
 Adding correlation in aggregate calculations
 Sum of a random number of random variables
 Moments of an aggregate distribution
 Aggregate modeling in ModelRisk
 Aggregate modeling  Fast Fourier Transform (FFT) method
 How many random variables add up to a fixed total
 Aggregate modeling  compound Poisson approximation
 Aggregate modeling  De Pril's recursive method
 Testing and modeling causal relationships
 Stochastic time series
 Time series introduction
 Time series in ModelRisk
 Autoregressive models
 Thiel inequality coefficient
 Effect of an intervention at some uncertain point in time
 Log return of a Time Series
 Markov Chain models
 Seasonal time series
 Bounded random walk
 Time series modeling in finance
 Birth and death models
 Time series models with leading indicators
 Geometric Brownian Motion models
 Time series projection of events occurring randomly in time
 Simulation for six sigma
 ModelRisk's Six Sigma functions
 VoseSixSigmaCp
 VoseSixSigmaCpkLower
 VoseSixSigmaProbDefectShift
 VoseSixSigmaLowerBound
 VoseSixSigmaK
 VoseSixSigmaDefectShiftPPMUpper
 VoseSixSigmaDefectShiftPPMLower
 VoseSixSigmaDefectShiftPPM
 VoseSixSigmaCpm
 VoseSixSigmaSigmaLevel
 VoseSixSigmaCpkUpper
 VoseSixSigmaCpk
 VoseSixSigmaDefectPPM
 VoseSixSigmaProbDefectShiftLower
 VoseSixSigmaProbDefectShiftUpper
 VoseSixSigmaYield
 VoseSixSigmaUpperBound
 VoseSixSigmaZupper
 VoseSixSigmaZmin
 VoseSixSigmaZlower
 Modeling expert opinion
 Modeling expert opinion introduction
 Sources of error in subjective estimation
 Disaggregation
 Distributions used in modeling expert opinion
 A subjective estimate of a discrete quantity
 Incorporating differences in expert opinions
 Modeling opinion of a variable that covers several orders of magnitude
 Maximum entropy
 Probability theory and statistics
 Probability theory and statistics introduction
 Stochastic processes
 Stochastic processes introduction
 Poisson process
 Hypergeometric process
 The hypergeometric process
 Number in a sample with a particular characteristic in a hypergeometric process
 Number of hypergeometric samples to get a specific number of successes
 Number of samples taken to have an observed s in a hypergeometric process
 Estimate of population and subpopulation sizes in a hypergeometric process
 The binomial process
 Renewal processes
 Mixture processes
 Martingales
 Estimating model parameters from data
 The basics
 Probability equations
 Probability theorems and useful concepts
 Probability parameters
 Probability rules and diagrams
 The definition of probability
 The basics of probability theory introduction
 Fitting probability models to data
 Fitting time series models to data
 Fitting correlation structures to data
 Fitting in ModelRisk
 Fitting probability distributions to data
 Fitting distributions to data
 Method of Moments (MoM)
 Check the quality of your data
 KolmogorovSmirnoff (KS) Statistic
 AndersonDarling (AD) Statistic
 Goodness of fit statistics
 The ChiSquared GoodnessofFit Statistic
 Determining the joint uncertainty distribution for parameters of a distribution
 Using Method of Moments with the Bootstrap
 Maximum Likelihood Estimates (MLEs)
 Fitting a distribution to truncated censored or binned data
 Critical Values and Confidence Intervals for GoodnessofFit Statistics
 Matching the properties of the variable and distribution
 Transforming discrete data before performing a parametric distribution fit
 Does a parametric distribution exist that is well known to fit this type of variable?
 Censored data
 Fitting a continuous nonparametric secondorder distribution to data
 Goodness of Fit Plots
 Fitting a second order Normal distribution to data
 Using Goodnessof Fit Statistics to optimize Distribution Fitting
 Information criteria  SIC HQIC and AIC
 Fitting a second order parametric distribution to observed data
 Fitting a distribution for a continuous variable
 Does the random variable follow a stochastic process with a wellknown model?
 Fitting a distribution for a discrete variable
 Fitting a discrete nonparametric secondorder distribution to data
 Fitting a continuous nonparametric firstorder distribution to data
 Fitting a first order parametric distribution to observed data
 Fitting a discrete nonparametric firstorder distribution to data
 Fitting distributions to data
 Technical subjects
 Comparison of Classical and Bayesian methods
 Comparison of classic and Bayesian estimate of Normal distribution parameters
 Comparison of classic and Bayesian estimate of intensity lambda in a Poisson process
 Comparison of classic and Bayesian estimate of probability p in a binomial process
 Which technique should you use?
 Comparison of classic and Bayesian estimate of mean "time" beta in a Poisson process
 Classical statistics
 Bayesian
 Bootstrap
 The Bootstrap
 Linear regression parametric Bootstrap
 The Jackknife
 Multiple variables Bootstrap Example 2: Difference between two population means
 Linear regression nonparametric Bootstrap
 The parametric Bootstrap
 Bootstrap estimate of prevalence
 Estimating parameters for multiple variables
 Example: Parametric Bootstrap estimate of the mean of a Normal distribution with known standard deviation
 The nonparametric Bootstrap
 Example: Parametric Bootstrap estimate of mean number of calls per hour at a telephone exchange
 The Bootstrap likelihood function for Bayesian inference
 Multiple variables Bootstrap Example 1: Estimate of regression parameters
 Bayesian inference
 Uninformed priors
 Conjugate priors
 Prior distributions
 Bayesian analysis with threshold data
 Bayesian analysis example: gender of a random sample of people
 Informed prior
 Simulating a Bayesian inference calculation
 Hyperparameters
 Hyperparameter example: Microfractures on turbine blades
 Constructing a Bayesian inference posterior distribution in Excel
 Bayesian analysis example: Tigers in the jungle
 Markov chain Monte Carlo (MCMC) simulation
 Introduction to Bayesian inference concepts
 Bayesian estimate of the mean of a Normal distribution with known standard deviation
 Bayesian estimate of the mean of a Normal distribution with unknown standard deviation
 Determining prior distributions for correlated parameters
 Improper priors
 The Jacobian transformation
 Subjective prior based on data
 Taylor series approximation to a Bayesian posterior distribution
 Bayesian analysis example: The Monty Hall problem
 Determining prior distributions for uncorrelated parameters
 Subjective priors
 Normal approximation to the Beta posterior distribution
 Bayesian analysis example: identifying a weighted coin
 Bayesian estimate of the standard deviation of a Normal distribution with known mean
 Likelihood functions
 Bayesian estimate of the standard deviation of a Normal distribution with unknown mean
 Determining a prior distribution for a single parameter estimate
 Simulating from a constructed posterior distribution
 Bootstrap
 Comparison of Classical and Bayesian methods
 Analyzing and using data introduction
 Data Object
 Vose probability calculation
 Bayesian model averaging
 Miscellaneous
 Excel and ModelRisk model design and validation techniques
 Using range names for model clarity
 Color coding models for clarity
 Compare with known answers
 Checking units propagate correctly
 Stressing parameter values
 Model Validation and behavior introduction
 Informal auditing
 Analyzing outputs
 View random scenarios on screen and check for credibility
 Split up complex formulas (megaformulas)
 Building models that are efficient
 Comparing predictions against reality
 Numerical integration
 Comparing results of alternative models
 Building models that are easy to check and modify
 Model errors
 Model design introduction
 About array functions in Excel
 Excel and ModelRisk model design and validation techniques
 Monte Carlo simulation
 RISK ANALYSIS SOFTWARE
 Risk analysis software from Vose Software
 ModelRisk  risk modeling in Excel
 ModelRisk functions explained
 VoseCopulaOptimalFit and related functions
 VoseTimeOptimalFit and related functions
 VoseOptimalFit and related functions
 VoseXBounds
 VoseCLTSum
 VoseAggregateMoments
 VoseRawMoments
 VoseSkewness
 VoseMoments
 VoseKurtosis
 VoseAggregatePanjer
 VoseAggregateFFT
 VoseCombined
 VoseCopulaBiGumbel
 VoseCopulaBiClayton
 VoseCopulaBiNormal
 VoseCopulaBiT
 VoseKendallsTau
 VoseRiskEvent
 VoseCopulaBiFrank
 VoseCorrMatrix
 VoseRank
 VoseValidCorrmat
 VoseSpearman
 VoseCopulaData
 VoseCorrMatrixU
 VoseTimeSeasonalGBM
 VoseMarkovSample
 VoseMarkovMatrix
 VoseThielU
 VoseTimeEGARCH
 VoseTimeAPARCH
 VoseTimeARMA
 VoseTimeDeath
 VoseTimeAR1
 VoseTimeAR2
 VoseTimeARCH
 VoseTimeMA2
 VoseTimeGARCH
 VoseTimeGBMJDMR
 VoseTimePriceInflation
 VoseTimeGBMMR
 VoseTimeWageInflation
 VoseTimeLongTermInterestRate
 VoseTimeMA1
 VoseTimeGBM
 VoseTimeGBMJD
 VoseTimeShareYields
 VoseTimeYule
 VoseTimeShortTermInterestRate
 VoseDominance
 VoseLargest
 VoseSmallest
 VoseShift
 VoseStopSum
 VoseEigenValues
 VosePrincipleEsscher
 VoseAggregateMultiFFT
 VosePrincipleEV
 VoseCopulaMultiNormal
 VoseRunoff
 VosePrincipleRA
 VoseSumProduct
 VosePrincipleStdev
 VosePoissonLambda
 VoseBinomialP
 VosePBounds
 VoseAIC
 VoseHQIC
 VoseSIC
 VoseOgive1
 VoseFrequency
 VoseOgive2
 VoseNBootStdev
 VoseNBoot
 VoseSimulate
 VoseNBootPaired
 VoseAggregateMC
 VoseMean
 VoseStDev
 VoseAggregateMultiMoments
 VoseDeduct
 VoseExpression
 VoseLargestSet
 VoseKthSmallest
 VoseSmallestSet
 VoseKthLargest
 VoseNBootCofV
 VoseNBootPercentile
 VoseExtremeRange
 VoseNBootKurt
 VoseCopulaMultiClayton
 VoseNBootMean
 VoseTangentPortfolio
 VoseNBootVariance
 VoseNBootSkewness
 VoseIntegrate
 VoseInterpolate
 VoseCopulaMultiGumbel
 VoseCopulaMultiT
 VoseAggregateMultiMC
 VoseCopulaMultiFrank
 VoseTimeMultiMA1
 VoseTimeMultiMA2
 VoseTimeMultiGBM
 VoseTimeMultBEKK
 VoseAggregateDePril
 VoseTimeMultiAR1
 VoseTimeWilkie
 VoseTimeDividends
 VoseTimeMultiAR2
 VoseRuinFlag
 VoseRuinTime
 VoseDepletionShortfall
 VoseDepletion
 VoseDepletionFlag
 VoseDepletionTime
 VosejProduct
 VoseCholesky
 VoseTimeSimulate
 VoseNBootSeries
 VosejkProduct
 VoseRuinSeverity
 VoseRuin
 VosejkSum
 VoseTimeDividendsA
 VoseRuinNPV
 VoseTruncData
 VoseSample
 VoseIdentity
 VoseCopulaSimulate
 VoseSortA
 VoseFrequencyCumulA
 VoseAggregateDeduct
 VoseMeanExcessP
 VoseProb10
 VoseSpearmanU
 VoseSortD
 VoseFrequencyCumulD
 VoseRuinMaxSeverity
 VoseMeanExcessX
 VoseRawMoment3
 VosejSum
 VoseRawMoment4
 VoseNBootMoments
 VoseVariance
 VoseTimeShortTermInterestRateA
 VoseTimeLongTermInterestRateA
 VoseProb
 VoseDescription
 VoseCofV
 VoseAggregateProduct
 VoseEigenVectors
 VoseTimeWageInflationA
 VoseRawMoment1
 VosejSumInf
 VoseRawMoment2
 VoseShuffle
 VoseRollingStats
 VoseSplice
 VoseTSEmpiricalFit
 VoseTimeShareYieldsA
 VoseParameters
 VoseAggregateTranche
 VoseCovToCorr
 VoseCorrToCov
 VoseLLH
 VoseTimeSMEThreePoint
 VoseDataObject
 VoseCopulaDataSeries
 VoseDataRow
 VoseDataMin
 VoseDataMax
 VoseTimeSME2Perc
 VoseTimeSMEUniform
 VoseTimeSMESaturation
 VoseOutput
 VoseInput
 VoseTimeSMEPoisson
 VoseTimeBMAObject
 VoseBMAObject
 VoseBMAProb10
 VoseBMAProb
 VoseCopulaBMA
 VoseCopulaBMAObject
 VoseTimeEmpiricalFit
 VoseTimeBMA
 VoseBMA
 VoseSimKurtosis
 VoseOptConstraintMin
 VoseSimProbability
 VoseCurrentSample
 VoseCurrentSim
 VoseLibAssumption
 VoseLibReference
 VoseSimMoments
 VoseOptConstraintMax
 VoseSimMean
 VoseOptDecisionContinuous
 VoseOptRequirementEquals
 VoseOptRequirementMax
 VoseOptRequirementMin
 VoseOptTargetMinimize
 VoseOptConstraintEquals
 VoseSimVariance
 VoseSimSkewness
 VoseSimTable
 VoseSimCofV
 VoseSimPercentile
 VoseSimStDev
 VoseOptTargetValue
 VoseOptTargetMaximize
 VoseOptDecisionDiscrete
 VoseSimMSE
 VoseMin
 VoseMin
 VoseOptDecisionList
 VoseOptDecisionBoolean
 VoseOptRequirementBetween
 VoseOptConstraintBetween
 VoseSimMax
 VoseSimSemiVariance
 VoseSimSemiStdev
 VoseSimMeanDeviation
 VoseSimMin
 VoseSimCVARp
 VoseSimCVARx
 VoseSimCorrelation
 VoseSimCorrelationMatrix
 VoseOptConstraintString
 VoseOptCVARx
 VoseOptCVARp
 VoseOptPercentile
 VoseSimValue
 VoseSimStop
 Precision Control Functions
 VoseAggregateDiscrete
 VoseTimeMultiGARCH
 VoseTimeGBMVR
 VoseTimeGBMAJ
 VoseTimeGBMAJVR
 VoseSID
 Generalized Pareto Distribution (GPD)
 Generalized Pareto Distribution (GPD) Equations
 ThreePoint Estimate Distribution
 ThreePoint Estimate Distribution Equations
 VoseCalibrate
 ModelRisk interfaces
 Integrate
 Data Viewer
 Stochastic Dominance
 Library
 Correlation Matrix
 Portfolio Optimization Model
 Common elements of ModelRisk interfaces
 Risk Event
 Extreme Values
 Select Distribution
 Combined Distribution
 Aggregate Panjer
 Interpolate
 View Function
 Find Function
 Deduct
 Ogive
 AtRISK model converter
 Aggregate Multi FFT
 Stop Sum
 Crystal Ball model converter
 Aggregate Monte Carlo
 Splicing Distributions
 Subject Matter Expert (SME) Time Series Forecasts
 Aggregate Multivariate Monte Carlo
 Ordinary Differential Equation tool
 Aggregate FFT
 More on Conversion
 Multivariate Copula
 Bivariate Copula
 Univariate Time Series
 Modeling expert opinion in ModelRisk
 Multivariate Time Series
 Sum Product
 Aggregate DePril
 Aggregate Discrete
 Expert
 ModelRisk introduction
 Building and running a simple example model
 Distributions in ModelRisk
 List of all ModelRisk functions
 Custom applications and macros
 ModelRisk functions explained
 Tamara  project risk analysis
 Introduction to Tamara project risk analysis software
 Launching Tamara
 Importing a schedule
 Assigning uncertainty to the amount of work in the project
 Assigning uncertainty to productivity levels in the project
 Adding risk events to the project schedule
 Adding cost uncertainty to the project schedule
 Saving the Tamara model
 Running a Monte Carlo simulation in Tamara
 Reviewing the simulation results in Tamara
 Using Tamara results for cost and financial risk analysis
 Creating, updating and distributing a Tamara report
 Tips for creating a schedule model suitable for Monte Carlo simulation
 Random number generator and sampling algorithms used in Tamara
 Probability distributions used in Tamara
 Correlation with project schedule risk analysis
 Pelican  enterprise risk management
 ModelRisk Cloud system
 ModelRisk Cloud introduction
 Getting your software ready
 Starting ModelRisk Cloud
 Uploading a risk analysis model
 Creating a new scenario for the risk analysis model
 Running a Monte Carlo simulation of the model
 Uploading a SID (Simulation Imported Data file)
 Building a risk analysis model that uses SIDs
 Viewing the Monte Carlo results from a simulation run
 Administrator's use of ModelRisk Cloud
 Preparing a risk analysis model for upload to ModelRisk Cloud
 ModelRisk Result Viewer