Features of Software Solutions in the Field of Verification and Validation of Numerical Models
The numerical modeling increasingly replaces expensive experiments and physical prototypes in engineering and research, but the practical value of simulations depends on the demonstrated credibility of results. This study systematizes contemporary approaches and software capabilities for verificatio...
Saved in:
| Date: | 2025 |
|---|---|
| Main Authors: | , |
| Format: | Article |
| Language: | Ukrainian |
| Published: |
Інститут проблем реєстрації інформації НАН України
2025
|
| Subjects: | |
| Online Access: | https://drsp.ipri.kiev.ua/article/view/354592 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Journal Title: | Data Recording, Storage & Processing |
Institution
Data Recording, Storage & Processing| _version_ | 1862315021744209920 |
|---|---|
| author | Гейко, О. О. Варава , І. А. |
| author_facet | Гейко, О. О. Варава , І. А. |
| author_sort | Гейко, О. О. |
| baseUrl_str | http://drsp.ipri.kiev.ua/oai |
| collection | OJS |
| datestamp_date | 2026-04-12T15:36:33Z |
| description | The numerical modeling increasingly replaces expensive experiments and physical prototypes in engineering and research, but the practical value of simulations depends on the demonstrated credibility of results. This study systematizes contemporary approaches and software capabilities for verification and validation (V&V) of numerical models in the context of widely used industry standards and guidance. The discussion considers standardization of the model life cycle and evidence requirements for V&V, including NASA practices (NASA-STD-7009), U.S. Department of Defense VV&A guidance, and the ASME V&V /VVUQ family, which also introduces uncertainty quantification (UQ) as an integral element of decision-grade modeling. There are summarized the core functions implemented in modern V&V-oriented software solutions: (1) libraries of verification test problems, including benchmarks with reference solutions and systematic grid/time refinement studies; (2) support for the Method of Manufactured Solutions (MMS) to uncover implementation errors when exact analytical solutions for real problems are unavailable; (3) repositories of validation datasets and workflows for comparison with experiments, including statistical metrics of agreement; (4) automation of regression checks and “continuous validation” integrated into development pipelines (CI/CD), enabling repeatable pass/fail criteria across code versions and computing environments; (5) UQ and sensitivity analysis modules (e.g., Monte Carlo-based propagation, confidence intervals, and multidimensional validation indicators) to separate model-form inadequacy from input and numerical uncertainties; and (6) risk-informed planning of V&V depth based on model criticality, including emerging scenarios of digital twins where models are updated and validated using operational data streams. Based on this synthesis, the investigation proposes a practical set of selection criteria for V&V tools and outlines requirements for a modular V&V subsystem integrated with numerical solvers and project infrastructure. Key requirements include provenance management for traceability and reproducibility (inputs, solver settings, code/environment versions, logs, artifacts), scalable orchestration of test campaigns locally and on HPC resources, standardized reporting suitable for audit, and formalized acceptance thresholds aligned with the intended use of the model. The contribution of the work is a consolidated view of functional requirements and an implementation template that helps teams build evidence-based, maintainable V&V processes for modern computational models. Tabl.: 1. Fig.: 2. Refs: 10 titles. |
| doi_str_mv | 10.35681/1560-9189.2025.27.3.354592 |
| first_indexed | 2026-04-13T01:00:05Z |
| format | Article |
| id | drspiprikievua-article-354592 |
| institution | Data Recording, Storage & Processing |
| keywords_txt_mv | keywords |
| language | Ukrainian |
| last_indexed | 2026-04-13T01:00:05Z |
| publishDate | 2025 |
| publisher | Інститут проблем реєстрації інформації НАН України |
| record_format | ojs |
| spelling | drspiprikievua-article-3545922026-04-12T15:36:33Z Features of Software Solutions in the Field of Verification and Validation of Numerical Models Особливості програмних рішень в області верифікації і валідації чисельних моделей Гейко, О. О. Варава , І. А. software, verification, validation, modeling, process modeling, information technology, quality control, analysis програмне забезпечення, верифікація, валідація, моделювання, моделювання процесів, інформаційні технології, контроль якос-ті, аналіз The numerical modeling increasingly replaces expensive experiments and physical prototypes in engineering and research, but the practical value of simulations depends on the demonstrated credibility of results. This study systematizes contemporary approaches and software capabilities for verification and validation (V&V) of numerical models in the context of widely used industry standards and guidance. The discussion considers standardization of the model life cycle and evidence requirements for V&V, including NASA practices (NASA-STD-7009), U.S. Department of Defense VV&A guidance, and the ASME V&V /VVUQ family, which also introduces uncertainty quantification (UQ) as an integral element of decision-grade modeling. There are summarized the core functions implemented in modern V&V-oriented software solutions: (1) libraries of verification test problems, including benchmarks with reference solutions and systematic grid/time refinement studies; (2) support for the Method of Manufactured Solutions (MMS) to uncover implementation errors when exact analytical solutions for real problems are unavailable; (3) repositories of validation datasets and workflows for comparison with experiments, including statistical metrics of agreement; (4) automation of regression checks and “continuous validation” integrated into development pipelines (CI/CD), enabling repeatable pass/fail criteria across code versions and computing environments; (5) UQ and sensitivity analysis modules (e.g., Monte Carlo-based propagation, confidence intervals, and multidimensional validation indicators) to separate model-form inadequacy from input and numerical uncertainties; and (6) risk-informed planning of V&V depth based on model criticality, including emerging scenarios of digital twins where models are updated and validated using operational data streams. Based on this synthesis, the investigation proposes a practical set of selection criteria for V&V tools and outlines requirements for a modular V&V subsystem integrated with numerical solvers and project infrastructure. Key requirements include provenance management for traceability and reproducibility (inputs, solver settings, code/environment versions, logs, artifacts), scalable orchestration of test campaigns locally and on HPC resources, standardized reporting suitable for audit, and formalized acceptance thresholds aligned with the intended use of the model. The contribution of the work is a consolidated view of functional requirements and an implementation template that helps teams build evidence-based, maintainable V&V processes for modern computational models. Tabl.: 1. Fig.: 2. Refs: 10 titles. Систематизовано сучасні підходи та програмні можливості для верифікації і валідації (V&V) чисельних моделей у контексті актуальних галузевих стандартів і настанов. Розглянуто стандартизацію життєвого циклу моделі та вимоги до доказовості V&V (зокрема практики NASA, DoD і серію ASME V&V/VVUQ), а також узагальнено ключові функції, що реалізуються в сучасних програмних рішеннях: бібліотеки тестових задач і метод виготовлених рішень (MMS), репозиторії валідаційних даних і зіставлення з експериментом, автоматизація регресійних перевірок і «безперервна» валідація, статистичні методи та кількісна оцінка невизначеності (UQ), ризик-орієнтоване планування глибини V&V і підтримка сценаріїв цифрових двійників. Запропоновано практичний набір критеріїв вибору інструментів і вимоги до модульної V&V-підсистеми, інтегрованої з чисельними розв’язувачами та процесами CI/CD, що забезпечує відтворюваність, трасованість артефак-тів і формалізовані критерії прийнятності результатів. Інститут проблем реєстрації інформації НАН України 2025-12-23 Article Article application/pdf https://drsp.ipri.kiev.ua/article/view/354592 10.35681/1560-9189.2025.27.3.354592 Data Recording, Storage & Processing; Vol. 27 No. 3 (2025); 67-76 Регистрация, хранение и обработка данных; Том 27 № 3 (2025); 67-76 Реєстрація, зберігання і обробка даних; Том 27 № 3 (2025); 67-76 1560-9189 uk https://drsp.ipri.kiev.ua/article/view/354592/343182 Авторське право (c) 2025 Реєстрація, зберігання і обробка даних |
| spellingShingle | software verification validation modeling process modeling information technology quality control analysis Гейко, О. О. Варава , І. А. Features of Software Solutions in the Field of Verification and Validation of Numerical Models |
| title | Features of Software Solutions in the Field of Verification and Validation of Numerical Models |
| title_alt | Особливості програмних рішень в області верифікації і валідації чисельних моделей |
| title_full | Features of Software Solutions in the Field of Verification and Validation of Numerical Models |
| title_fullStr | Features of Software Solutions in the Field of Verification and Validation of Numerical Models |
| title_full_unstemmed | Features of Software Solutions in the Field of Verification and Validation of Numerical Models |
| title_short | Features of Software Solutions in the Field of Verification and Validation of Numerical Models |
| title_sort | features of software solutions in the field of verification and validation of numerical models |
| topic | software verification validation modeling process modeling information technology quality control analysis |
| topic_facet | software verification validation modeling process modeling information technology quality control analysis програмне забезпечення верифікація валідація моделювання моделювання процесів інформаційні технології контроль якос-ті аналіз |
| url | https://drsp.ipri.kiev.ua/article/view/354592 |
| work_keys_str_mv | AT gejkooo featuresofsoftwaresolutionsinthefieldofverificationandvalidationofnumericalmodels AT varavaía featuresofsoftwaresolutionsinthefieldofverificationandvalidationofnumericalmodels AT gejkooo osoblivostíprogramnihríšenʹvoblastíverifíkacííívalídacííčiselʹnihmodelej AT varavaía osoblivostíprogramnihríšenʹvoblastíverifíkacííívalídacííčiselʹnihmodelej |