diff --git a/schema/iguana.owl b/schema/iguana.owl index 296947e0..9cdd819f 100644 --- a/schema/iguana.owl +++ b/schema/iguana.owl @@ -30,7 +30,7 @@ Iguana results ontology 4.0.0 2020/09/18 - 2022/11/07 + 2024/03/20 Iguana results ontology The Iguana results ontology explains the rdf results of an Iguana benchmark. @@ -38,122 +38,134 @@ - - Experiment - An experiment is a collection of Connections executed against one dataset. - - Suite - A suite is a collection of Experiments. + A suite is a collection of benchmarks. Worker - A worker is one thread executing a set of queries against a Connection, thus simulating one user. + A Worker is a thread that executes a set of queries against a Connection. It simulates a user. - An ExecutedQuery is a query which was executed one or more times against a Connection using either one Worker or the aggregation of several ExecutedQueries which is assigned to a Task. It provides several Metric results. The ExecutedQuery is assigned to a worker. + An ExecutedQuery is a query which was executed one or more times against a Connection using either one Worker or the aggregation of several ExecutedQueries which are assigned to a Task. It provides several Metric results. The ExecutedQuery is assigned to a worker or a Task. ExecutedQuery - A Query is the query string of a given query (most likely a sparql query) together with a collection of statistics. The query is Suite independent. + A Query is the query string of a given query (most likely a sparql query) together with a collection of statistics. The query is Suite independent. Query Metric - A Metric is the abstract Class providing a result metric. + A Metric is the abstract class providing a result metric. Task - A Task is an abstract Class providing results for one Connection using one Dataset. + Abstract class for various tasks. Stresstest - The Stresstest is the Task which executes a stresstest. + The Stresstest Task benchmarks a system by stresstesting it. Connection - A Connection is a connection used in a Task, basically providing just a label and ID. + A Connection represents a benchmarked endpoint. + Dataset - A Dataset is a dataset used in a Task, basically providing just a label and ID. + A Dataset represents the dataset used for a benchmarked endpoint. + + - - QPS Metric - Queries Per Second Metric. Annotates a Task or Worker if they use this metric. + + QPS Metric + Queries Per Second Metric. - - QMPH Metric - Query Mixes Per Hour. Annotates a Task or Worker if they use this metric. + QMPH Metric + Query Mixes Per Hour. - - NoQPH Metric - Number of Queries Per Hour. Annotates a Task or Worker if they use this metric. + NoQPH Metric + Number of Queries Per Hour. - - Average QPS Metric - Average Queries Per Second Metric. Annotates a Task or Worker if they use this metric. + Average QPS Metric + Average Queries Per Second. - NoQ Metric - Number of Queries successfully executed Metric. Annotates a Task or Worker if they use this metric. + NoQ Metric + Number of successfully executed Queries. - + + + NoQ Metric + Aggregated Execution Statistics. + + + + + NoQ Metric + Each query execution statistics. + + + + + NoQ Metric + Penalized Queries Per Second. + + + + + NoQ Metric + Penalized Average Queries Per Second. + + + - connection - Assigns a Connection to a Task. - + connection + Assigns a Connection to a Worker. + - dataset - Assigns a Dataset to a Task. - + dataset + Assigns a Dataset to a Connection. + - - - experiment - Assigns an Experiment to a Suite. - - - - task - Assigns a Task to an Experiment. - + task + Assigns a Task to an Suite. + - workerResult + workerResult Assigns a Worker to an Task. (mostly a Stresstest) @@ -161,24 +173,25 @@ - metric - Annotates a Task or Worker with a Metric. The Metric itself is provided using the Property, this just annotates the task/worker to provide these results. - - + metric + Annotates a Task, Worker or ExecutedQuery with a Metric. The Metric itself is provided using the Property, this just annotates the subject to provide these results. + + + - query - Assigns an ExecutedQuery to a Worker or Task. The ExecutedQuery provides further metrics for example. + query + Assigns an ExecutedQuery to a Worker or Task. The ExecutedQuery provides further metrics and statistics. - queryID - Assigns a Query and its statistics, as well as the query string to an ExecutedQuery. + queryID + Assigns a Query and its statistics, as well as the string of the query to an ExecutedQuery. @@ -187,248 +200,249 @@ version - Version of the triple store tested. + Version of the triplestore tested. timeLimit - Time Limit after the Stresstest ends in milliseconds. - - + The time limit after which a Worker stops its execution of queries. + + - - + noOfQueryMixes - The number of query mixes executed after the Stresstest ends. - + The number of query mixes a Worker has to execute. + noOfWorkers - Number of total Workers the Stresstest simulated. + The number of Workers the stresstest utilized. - + startDate - The date and time the Task was started. + The date and time at which the Task or Worker started. + - + endDate - The date and time the Task was ended. + The date and time at which the Task or Worker ended. + - workerID + workerID The worked ID assigned to the worker - workerType + workerType The worker class name. - noOfQueries - The number of Queries in the benchmark query set assigned to the worker. + noOfQueries + The number of queries assigned to the worker. - - timeOutMS - The timeout in ms set to this worker. + + timeOut + The timeout set for this worker. - + - optional + optional Tells if the the query contains an OPTIONAL element - union + union Tells if the the query contains a UNION element - orderBy + orderBy Tells if the the query contains an ORDER BY element - offset + offset Tells if the the query contains an OFFSET element - triples + triples The number of triples in a Query. - optional + optional Tells if the the query contains a HAVING element - filter + filter Tells if the the query contains a FILTER element - aggregations + aggregations Tells if the the query contains an AGGREGATION element - groupBy + groupBy Tells if the the query contains a GROUP BY element - ID + ID The query ID. - totalTime + totalTime The summed up execution time of all executions of the ExecutedQuery in milliseconds. - + - QPS + QPS The queries per second value. - + - penalizedQPS + penalizedQPS The queries per second value where failed queries are rated using a penalty (default is the timeOut of a Task). - + - failed + failed The number of failed executions of the ExecutedQuery. - + - succeeded + succeeded The number of succeeded executions of the ExecutedQuery. - + - - unknownException + + unknownExceptions The number of failed executions of the ExecutedQuery whereas the Reason was unknown. - + - resultSize + resultSize The result size of a ExecutedQuery. - + - wrongCodes + wrongCodes The number of failed executions of the ExecutedQuery whereas the Reason was a wrong result code (e.g 400) - + - timeOuts + timeOuts The number of failed executions of the ExecutedQuery whereas the Reason was a time out - + - QMPH + QMPH The query mixes per hour value - + - NoQPH + NoQPH The number of queries per hour value. - + - AvgQPS + AvgQPS The average number of queries answered successfully per second value. - + - penalizedAvgQPS - The average number of queries answered successfully per second value using the penaltyQPS. + penalizedAvgQPS + The average number of queries answered successfully per second value using the penaltyQPS. - + - NoQ + NoQ The number of successfully executed queries value - +