Minimal algorithms for knowledge representation in clinical decision support systems research: a theoretical and empirical analysis =================================================================================================================================== * Anderson A. Eduardo * Rafael M. Loureiro * Adriano Tachibana * Pedro V. Netto * Tatiana F. de Almeida * Luiz Henrique Alves Monteiro * AndrΓ© P. dos Santos ## Abstract Clinical decision support systems (CDSS) figures out as one of the most promising technologies for data-centered and AI-prompted healthcare. Its current developments are mainly guided by two disparate mindsets, namely a machine learning-centered framework and a classical rule-based framework. These respective approaches presents contrastive pros and cons. In the present study we provide an analysis showing that these two mindsets are actually related to each other, and straightforward algorithms are feasible by combining current standards for machine learning and classic decision tables algorithms. A theoretical analysis are provided, as well a computational implementation (in python). A real case scenario on radiological immaging exam prescription is used to ilustrate the successfully application of our results. Future work on benchmarking the proposed algorithms embodied in a fully operational clinical decision support system could extend our findings towards daily used systems. Keywords * Artificial intelligence * machine learning * decision table * digital health * health informatics ## 1 Introduction In the last decade, modern digital technology become pervasive in healthcare and medical systems. In terms of intellectual historical evolution, the ongoing disruption by the emergence of the so called fourth scientific paradigm reverbered in advancing health sciences, existing a long and apparent road of technological advances ahead [6, 8]. In this context, clinical decision support systems (CDSS) have transvased academic circles to daily life, with large operational systems affecting thousand of patients and professionals per day [7]. Today, CDSS is perceived by many authors as one of the most promising concept among emergent technologies in healthcare [5, 2, 7, 1]. In practical terms, CDSS are implemented as a software, generally integrated as a service in previously existing local systems [7]. The software is kept runing under the rotinetely use of a local system. But, internally, prescription of medical exams are processed by the CDSS and some type of signalization is shown to the user, sugesting the best options given patient information [7]. There are different and specific modes of implementation and operationalization of CDSS [4, 7]. Despite of that, they are built upon a same system architecture, comprising [7]: (i) an interface layer, where the user inputs patient data, receive prescription suggestions and queries are parsed; and (ii) the knowledge base, being an algorithm capable of modeling expert knowledge regarding a specific problem or intellectual domain. The literature on the knowledge base component of CDSS discusses a variety of algorithms, from explicit IF-ELSE rules to deep learning. Naturally, every approach to knowledge modeling will have its pros and cons. But, in our interpretation, research advances have largelly been internally biased for each one of the respective lines of approach, with loosely interaction for theoretical synthesis and integrative developments. Interpretability of knowledge representation is a relevant example, with, on one hand, classic IF-ELSE approaches having clearer representation of internal extructure (directaly affecting the interpretability of systems suggestions), but at a high cost of implementation and maintainance, and, on the other hand, machine learning approaches, having low (or very low) internal interpretability, but with a lesser cost of implementation and maintainence and, importantly, with inherent uncertainity in outputs [7]. Thus, in present study we provide an analysis showing that straightforward algorithms are feasible, combining current standards in massive dataset formation for machine learning and classic decision tables algorithms. We show that there are place for mathematical theory bridging classic and modern approaches for knowledge representation in CDSS and we ilustrate it providing β€œwhite-box”, graph-based minimal algorithms, with experimental results for real radiological imaging data. ## 2 The decision table formalism Strictly speacking, a decision table is a table representing the exhaustive set of mutual exclusive conditional expressions, within a predefined problem area (see [9]). There are two fundamental sets for a decision table, π’ž and π’œ, namely the *condition set* and the *action set* [9]. The condition set is defined as follows (definition (2.1)). Definition 2.1. The Condition set, π’ž, consists of *n* elements *c**i*, 1 ≀ *i* ≀ *n*, which are, in turn, formed by the tuple (*c*⟨*S*⟩, *C*⟨*T*⟩)*i*, with ![Graphic][1] and ![Graphic][2], such that ![Formula][3] where π’ž ⟨*S*⟩ are the condition subjects, with each *i**th* subject having a domain ![Graphic][4] is the set of possible logical states for the *i**th* subject, being stated in terms of ![Graphic][5] and mapping to a one and only one item of the cartesian product π’œβŸ¨*V*⟩ Γ— π’œβŸ¨*V*⟩ (which is definied bellow). For a set ![Graphic][6], its condition states follows the definition below (definition (2.2)). Definition 2.2. Each set of condition state, ![Graphic][7], defines a subset ![Graphic][8], such that ![Graphic][9] and ![Formula][10] Regarding the action set, it is defined as follows (definition (2.3)). Definition 2.3. Similarlly to the Condition set, the Action set, π’œ, is formed of *m* actions *a**j*, 1 ≀ *j* ≀ *m*, being *a**j* = (*a*⟨*S*⟩, *A*⟨*V*⟩)*j*, with ![Graphic][11] the set of possible values for the *j**th* action of π’œ, and ![Graphic][12] the *j**th* action item, such that ![Formula][13] In order to illustrate such concepts in the context of the present paper, we provide the following example. **Example**. *Consider a decision table in a simplifyied context of medical immage prescription. The Condition set, in terms of* π’žβŸ¨*S*⟩ = {*age, clinical indication*}, π’žβŸ¨*D*⟩ = {{0, 1, 2, …}, {*Indication* 1, *Indication* 2}}, π’žβŸ¨*T*⟩ = {{*age* ≀ 17 β†’ *children, age >* 17 ∧ *age* ≀ 50 β†’ *adult, age >* 50 β†’ *senior*}, {*Indication* 1, *Indication* 2}}, *and* π’žβŸ¨*T* ⟩* = {{{1, 2, …, 17}, {18, 19, …, 50}, {51, 52, …}}, {{*Indication* 1}, {*Indication* 2}}} *is defined as* ![Formula][14] *The Action set, in terms of* π’œβŸ¨*S*⟩ = {*clinical exam*} *and* π’œβŸ¨*V*⟩ = {*exam* 1, *exam* 2, *exam* 3} *is defined as* ![Formula][15] Given a decision table for which these definitions completely holds, we got a decision table function, as stated by the following theorem (theorem (2.1)). Theorem 2.1. *(Decision table function) Considering the cartesian products* ![Graphic][16] *and* ![Graphic][17], *there is such a function* ![Formula][18] *mapping each action in* π’œβŸ¨*R*⟩ *from one or more conditions in* π’žβŸ¨*R*⟩. *Proof*. Let 𝒳 = {𝒳 | *x* ∈ π’žβŸ¨*R*⟩} and 𝒴 = {*y* | *y* ∈ π’œβŸ¨*R*⟩}. Consider a relation *R* βŠ‚ {(*x, y*) | *x* ∈ 𝒳 *y* ∈ 𝒴}. As π’žβŸ¨*R*⟩ is defined in terms of π’žβŸ¨*T*⟩, the definitions (2.1) and (2.2) holds for any element or subset of π’žβŸ¨*R*⟩. Thus ![Formula][19] meaning that *R* is a function with domain 𝒳 and image in 𝒴. Consequently, 𝒳 βŠ‚ π’žβŸ¨*R*⟩ and 𝒴 βŠ‚ π’œβŸ¨*R*⟩ implies that *F**DT* *is a function*. Traditionally, a decision table is represented in a (row-driven) augmented matrix, as follows (equations (1), (2) and ![Formula][20] ![Formula][21] ![Formula][22] Here, *c*(*i,l*) ∈ π’žβŸ¨*T*⟩, with *i* ∈ {1, 2, …, *n*} and *l* ∈ {1, 2, …, *o*} refer to condition state values for the *i**th* condition subject and *l**th* rule. The values *a*(*j,l*) ∈ π’œβŸ¨*V*⟩ with *j* ∈ {1, 2, …, *m*} and *l* ∈ {1, 2, …, *o*}, refer to actions for the *j**th* action subject and *l**th* rule. ## 3 Linking decision tables and statistical machine learning datasets Despite of both decision tables and machine learning be cirscunsribed whithin the wide field of artificial intelligence, these subjects has been, conceptually and temporally, relatively far from each other. The decision table formalism were developed in the age of symbolic approaches to artificial intelligence modelling. Machine learning, on the other hand, emerged as a broad theoretical mindset, which became in vogue in the recent decades, becaming the dominant paradigm for the current generation of artificial intelligence researchers and practioners. Despite of such historical bias, mathematical formalisms in the machine learning field and the decision table formalism are not disparate from each other, having place for theoretical synthesis and synergistic developments. By the current formalism of statistical learning theory for supervised learning, a machine learning problem can be definied as follows (definition 3.1) (see [3]). Definition 3.1. A machine learning problem consists of finding a function capable of mapping a random variable ***Y*** ∈ ℝ from a vector of ***x*** ∈ ***X***, with ***X*** βŠ‚ ℝ*n*. Such a function, defined here as *h*(*x*) : ***X*** β†’ ***Y***, belongs to a hipothetical space of functions, β„‹, and can be computed by the means of minimizing a loss function *L*(*h*(Β·), *S*) with respect to a parameterized hypothesis, *h*, and considering *S*, a collection of observed instances of ***X*** and ***Y***. By definition, and as stated by the definition (3.1), a machine learning problem explicitly depends on a collection of empirical observations. Thus, we state a more specific definition for *S*, as follows (definition 3.2). Definition 3.2. Let *Z* be the catesian product ***X*** Γ—***Y***Β·A collection of empirical observations, *S*, is a statistical sample over the unknown probability distribution of *Z*, being constituted by tuples (***x*** ⟨*observed*⟩, *y*⟨*observed*⟩)*i*, 1 ≀ *i* ≀ *o*, with the vector ![Graphic][23], observing that βˆ€*X**i* βŠ‚ ***X*** : βˆͺ*i*(*X**i*) = ***X*** ⟨*observed*⟩; and with ![Graphic][24] Β· *S* is parsed by a learning algorithm which implements *L*(*h*(Β·), *S*) and is capable of returning *h*(Β·)*S*, which refers to a parameterized function regarding a particular sample dataset, *S*. Thus, the parameterization found by the algorithm is fundamentally determined by the sample dataset. In terms of tabular datasets, ***X*** ⟨*observed*⟩ and ***Y*** ⟨*observed*⟩ can be represented in a matricial form, as shown below (equations (4) and (5)). ![Formula][25] ![Formula][26] Thus, *S* can be represented by the augmented matrix given below (equation (6)). ![Formula][27] The matricial representation of decision tables is structuturally equivalent to such matricial representation of *S*, **M***S*, as stated by the theorem (3.1). Theorem 3.1. *(The equivalency theorem for* **M**(*DT*) *and* **M**(*S*)*) A matricial representation of a decision table*, **M**(*DT*), *given by equation (1), is equivalent to a matricial representation of a statistical machine learning dataset*, **M**(*S*), *given by equation (4), if* **M**(*DT*) *is transposed, such as* ![Formula][28] *Proof*. Considering definitions (2.1), (2.2) and (2.3), each one of the *n* subjects in ![Graphic][29] have a domain ![Graphic][30], being assigned in a row-driven fashion in the matrix **M***C*, given by equations (1) and (3). Each column *l* in **M***C* can be conveniently represented as a *n*-size tuple ***t*** *l* composed by state values *v**i*, 1 ≀ *i* ≀ *n*, each one row-wise assigned to its respective subjects, ![Graphic][31]. Clearly, the *o*-columns in **M***C* is relative to the number of decision rules embeded in a decision table and, in turn, informing the number of such tuples, ***t*** *l*. Now, consider that each row in **M***S* groups the values of the *n* features (or traits, or variables, or dimensions) for each empirical observation,![Graphic][32]. Necessarily, each feature, *X**i*, have a proper domain, **dom**(*X**i*) βŠ‚ ℝ, and each vector![Graphic][33], being an empirical observation, by definition, can also be represented as a tuple ***t*** *l* of observed state values *v**i*, column-wise assigned to its respective feature *X**i*, and showing that condition subjects are equivalent of features, or ![Formula][34] Thus, any hypothetical subject, *C**a*, with its own domain **dom**(*C**a*), can have its state value imputed in a tuple, *t**C*, comprised of *n* state values, along other *n* βˆ’ 1 state values for other subjects, such as *C**b*, *C**c*, *C**d*, …, *C**z*. An arbitrary number of such tuples can be stacked either in a row-oriented fashion, forming a matrix **M**1, or in a column-oriented fashion, forming a matrix **M**2, without any loss of generality. It can be easilly seen that ![Formula][35] Naturally, ![Formula][36] The application of this same rationale for equations (2) and (5) is trivial, proving the theorem (3.1). β–‘ Thus, any dataset as typically arranged in current machine learning practioning is ready to be used for a decision table implementation, as long as it is in accordance with definitions (2.1), (2.2 and (2.3)). An interesting consequence of theorem (3.1) is stated by the following corollary. Corollary 3.1. *Given a hypothesis h* ∈ β„‹, *any machine learning algorithm, in terms of the definitions (3.1) and (3.2), can learn and furnish a computational representation of any particular decision table function, as stated at theorem (2.1), provided that the loss function tends to zero. This is expressed by* ![Formula][37] *Proof*. Let a dataset *D* be definied in terms of the equations (4), (5) and (6). Let a function *g**Error* : ℝ*n* β†’ ℝ be an error function, i.e., a function able to compute an arbitrary degree of correctedness for the output of functions *f**i* ∈ β„±, being β„± a set of particular functions. Now, consider a function *f**DT* ∈ β„±, which is specified in terms of the definitions (2.1), (2.2) and (2.3). Also, consider a function *f**ML* ∈ β„±, specified in terms of definitions (3.1) and (3.2). By the definitions, we have *g**Error* (*f**DT*, *D*) = 0, i.e., when applying *f**DT* to the dataset *D*. Also by the definitions, we have that, for any situations in which *L*(*f**ML*, *D*) β‰ˆ 0 is achievable, we have ![Formula][38] In this cases, ![Formula][39] This result makes *f**DT* and *f**ML* equivalent in the representation of *D*, or ![Formula][40] As *f**DT* is defined is the same terms of *F**DT* and *f**ML* is defined in the same terms of *h* ∈ β„‹, we got ![Formula][41] Corollary (3.1) pave the way for applying current machine learning algorithms in computational representation of decision tables in a straightforward fashion. This shows that, as we argued before, these are not rival formalisms, existing potential for theoretical and practical synthesis. Despite of corollary (3.1), we would like to remark that representing a decision table in terms of *h* ∈ β„‹ (see definition (3.1)) impels loss of interpretability of internal decision structure, being contingent to algorithm features. ## 4 Flexible decision tables In the previous section we have shown that decision tables have a good fit with machine learning datasets, making them adherent to the canonical structure for modern datasets, widely used by machine learning practioners. Such result may help to bring it closer to the most palatable algorithms routinely used for artificial intelligence modelling. However, as stated in the furnished definitions, only one output decision should be expected for any inputted query in a decision table model. Unfortunatelly, it can be too restrictive for many pratical applications. As an example, this is the case for prescription of radiology image exams. Profissionals in this field commonly ends up with more than only one well appropriate radiological immaging options for a same patient condition. So, in order to make simpler algorithms really usefull and adequate in suporting such cases, we should flexibilize decision table formalism. Here we propose that a more flexible or generalizable background for decision tables can be obtained through a minor changing in the basal definitions at decision table formalism, as stated in the following definition (definition 4.1). Definition 4.1. A decision table can be defined as a ordered triple (π’žβŸ¨*R*⟩, π’œβŸ¨*R*⟩, *G*(*V, E*)), with π’žβŸ¨*R*⟩ = π’žβŸ¨*T*⟩ Γ— π’žβŸ¨*T*⟩, π’œβŸ¨*R*⟩ = π’œβŸ¨*V*⟩ Γ— π’œβŸ¨*V*⟩ and *G*(*V, E*) being a directed graph, with vertices *V* βŠ† π’žβŸ¨*R*⟩ βˆͺ π’œβŸ¨*R*⟩ and edges *E* βŠ† π’žβŸ¨*R*⟩ Γ— π’œβŸ¨*R*⟩, mapping from π’žβŸ¨*R*⟩ to π’œβŸ¨*R*⟩. In such terms, a decision table consists in the binary relation, *R**DT*, over sets π’žβŸ¨*R*⟩ and π’œβŸ¨*R*⟩, being defined as ![Formula][42] Theorem 4.1. *(Flexible decision table) Given definition (4.1), F**DT* *is a special case of R**DT*. *Proof*. The proof naturally emerge from the fact that *F**DT* is a function and *R**DT* is a mathematical relation. So, ![Formula][43] being *P*1, *P*2 and *P*3 the predicate symbol for *is a mathematical function, is a mathematical relation* and *is a special case*, respectivelly. β–‘ With the definition (4.1), we are generalizing definition (2.1) and, consequently, we provide that *F**DT* (see theorem (2.1)) naturally be a particular case of *R**DT* (definition (4.1) and theorem (4.1)). This is a subtle change from the classic definition of decision tables, but with consequences making them more interesting for modern practical use, such as decision support systems for radiology exam prescription. Also, it is important to note that, in the terms of definition (4.1) and theorem (4.1), any results obtained considering decision tables strictly as a mathematical function do not apply to *R**DT*. Here, the corollary (3.1) is the most relevant example. Fortunately, in modeling a decision table as a mathematical relation and representing it as a graph object, we circunscribe our focal problem in the sound grounds of graph theory. This is very convenient, because algorithms and computational tools specific for such abstract objects are well developed and β€œwhite box” models are feasible. In the next sextion, we explore the simpler algorithms for computing *R**DT*. ## 5 Algorithms In this section, we provide algorithms for the decision table graphs, in accordance to definition (4.1). It is assumed that the input dataset is structured in accordance to definitions (3.1), (3.2) and (4.1), as well as the theorem (3.1). Given the nature of the dataset for a flexible decision table, it is very convenient to entirely load each vector of condition states and action values (i.e., the rows of **M**(*S*)), representing it as a single computational object (e.g., a *n*-tuple). By our definition of flexible decision table, such vectors constitute the paths of a graph *G* for the relation *R**DT*, thus the proper paths of the decision table. The algorithm (1) shows that paths can be readly obtained from data arranged in terms of equation (6), providing a straightforward computational representation of *G* and, by definition, the relation *R**DT* for a given decision table. Algorithm 1 ### The *Load data as graph paths* algorithm ![Figure1](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F1.medium.gif) [Figure1](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F1) In the context of algorithm (1), *read* is a method for obtaining data in computer physical memmory through a pointer object, and *split* is a method to split a string at specific positions (given by *c*). These methods are commonly provided on most of currently used programming languages for artificial intelligence implementation (e.g., python). Following, given a graph *G*, represented acconding to algorithm (1), querying for actions, *a*⟨*V*⟩ ∈ π’œβŸ¨*V*⟩, given a particular set of condition states, ![Graphic][44], should be possible. In algorithm (2), we show how a set of paths to actions, constrained to inputted condition states, can be efficiently maped. Algorithm 2 ### The *Find paths* algorithm ![Figure2](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F2.medium.gif) [Figure2](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F2) Finally, our representation of *G*, in order to achieve a straightforward representation of *R**DT*, can easilly be rearranged into the classical representation for graph objects. This is especially relevant for the treatment of decision tables within the scope of long standing computational tools available for mathematical operations on graphs. Thus, in algorithm (3) we show that an edge list is readily obtainable for *G*. Algorithm 3 ### The *From paths to edges* algorithm ![Figure3](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F3.medium.gif) [Figure3](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F3) It is easy to see that the temporal complexity of both algorithm (1) and algorithm (2) is *O*(*n*). For algorithm (3), temporal complexity is *O*(*n* Γ— *m*), being ![Graphic][45]. ## 6 Experiments In order to subdue our theoretical arguments to the scrutiny of reality, in this section we carry out an experiment exploring an application for a clinical decision support system. Focusing on a medical radiological context, we compiled a decision support dataset for immaging exams for head and neck situations (see Supplementary Material). Our data were obtained from *Appropriateness Criteria* of American College of radiology (ACR), available online at [https://acsearch.acr.org/list](https://acsearch.acr.org/list). Thealgorithms (1), (2) and (3) were implemented in pure python programming language (version 3.9). Complementarily, we used the package networkx (version 2.6.3) to explore the output of algorithm (3). Bellow, python coding for the mentioned algorithms are shown. ![Listing 1:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F4.medium.gif) [Listing 1:](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F4) Listing 1: Python implementation of algorithm (1). ![Listing 2:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F5.medium.gif) [Listing 2:](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F5) Listing 2: Python implementation of algorithm (2). ![](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F6/graphic-30.medium.gif) [](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F6/graphic-30) ![](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F6/graphic-31.medium.gif) [](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F6/graphic-31) Listing 3: Python implementation of algorithm (3). The complete implementation of our experiments is provided in Supplementary Material. Bellow, we provide the main results. ## Experiment 1: *obtaining a representation of G for the experimental dataset* Using the algorithm (1), implemented as the method load_graph_paths, the obtained output is shown in listing (4). ![Listing 4:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F7.medium.gif) [Listing 4:](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F7) Listing 4: Output for Experiment 1. ## Experiment 2: *maping paths to actions, given input constrains* Now, with the implementation find_paths for algorithm (2), the obtained output for the query find_paths([β€˜Vertigem’, β€˜Vertigem episodica(vertigem periferica)’]) is shown in listing (5). ![](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F8/graphic-33.medium.gif) [](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F8/graphic-33) ![](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F8/graphic-34.medium.gif) [](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F8/graphic-34) Listing 5: Output obtained for Experiment 2. **Experiment 3: *obtaining canonical representation of graphs*** With the implementation from\_paths\_to_edges for algorithm (3), the obtained output is depicted on listing (6). This output were succefully parsed by networkx methods, being a renderization of *G* provided in figure (6). ![Listing 6:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F9.medium.gif) [Listing 6:](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F9) Listing 6: Output obtained for Experiment 3. ## 7 Conclusion In this study we have explored an integrative approach bridging aspects of classical decision tables and modern machine learning, yielding simpler and sound approach to knowledge modeling for clinical decision support systems. We provide straightfoward mathematical results and computational algorithms, enforcing that valuable theoretical and practical findings can be obtained by intersectioning well-maturated artificial intelligence research and current machine learning formalisms. Through a python implementation, a real case scenario is used to ilustrate the application of our results in a knowledge modeling problem for medical radiology immaging exam prescription based on guidelines data. Future work on benchmarking the proposed algorithms embodied in a fully operational clinical decision support system could extend our findings towards daily used systems. ## Data Availability All data produced in the present study are available upon reasonable request to the authors. [https://acsearch.acr.org/list](https://acsearch.acr.org/list) ![Figure 1:](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2022/04/21/2022.04.20.22274099/F10.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2022/04/21/2022.04.20.22274099/F10) Figure 1: Graph representation for our experimental decision table, obtained using networkx package for the output of *from paths to edges*. * Received April 20, 2022. * Revision received April 20, 2022. * Accepted April 21, 2022. * Β© 2022, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial 4.0 International), CC BY-NC 4.0, as described at [http://creativecommons.org/licenses/by-nc/4.0/](http://creativecommons.org/licenses/by-nc/4.0/) ## References 1. [1]. Cemal Akturk. β€œBibliometric analysis of clinical decision support systems”. In: Acta Informatica Pragensia 10 (1 2021), pp. 61–74. doi: 10.18267/J.AIP.146. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.18267/J.AIP.146&link_type=DOI) 2. [2]. Joseph Doyle et al. β€œClinical decision support for high-cost imaging: A randomized clinical trial”. In: PLOS ONE 14 (3 2019), e0213373. doi: 10.1371/journal.pone.0213373. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0213373&link_type=DOI) 3. [3]. Rafael Izbicki and Tiago MendonΓ§a dos Santos. Aprendizado de mΓ‘quina: uma abordagem estatΓ­stica. Rafael Izbicki, 2020. isbn: 6500024109. 4. [4]. Ajit Kumar. β€œStakeholder’s Perspective of Clinical Decision Support Sys-tem”. In: Open Journal of Business and Management 04 (01 2016), pp. 45–50. doi: 10.4236/ojbm.2016.41005. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4236/ojbm.2016.41005&link_type=DOI) 5. [5]. Vaishali Parsania and Nalin Jani. β€œReviewing and Modeling Clinical Decision Support System”. In: International Journal of Technology and Science 7 (Dec. 2015), pp. 15–17. 6. [6]. Md Ileas Pramanik et al. β€œHealthcare informatics and analytics in big data”. In: Expert Systems with Applications 152 (2020), p. 113388. doi: 10.1016/J.ESWA.2020.113388. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/J.ESWA.2020.113388&link_type=DOI) 7. [7]. Reed T. Sutton et al. β€œAn overview of clinical decision support systems: benefits, risks, and strategies for success”. In: npj Digital Medicine 3 (1 2020), p. 17. doi: 10.1038/s41746-020-0221-y. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41746-020-0221-y&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32047862&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F04%2F21%2F2022.04.20.22274099.atom) 8. [8]. K M Tolle, D S W Tansley, and A J G Hey. β€œThe Fourth Paradigm: Data-Intensive Scientific Discovery [Point of View]”. In: Proceedings of the IEEE 99 (8 2011), pp. 1334–1337. doi: 10.1109/JPROC.2011.2155130. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1109/JPROC.2011.2155130&link_type=DOI) 9. [9]. J A N Vanthienen and Elke Dries. Developments in decision tables: Evolution, applications and a proposed standard. 1992, pp. 1–41. [1]: /embed/inline-graphic-1.gif [2]: /embed/inline-graphic-2.gif [3]: /embed/graphic-1.gif [4]: /embed/inline-graphic-3.gif [5]: /embed/inline-graphic-4.gif [6]: /embed/inline-graphic-5.gif [7]: /embed/inline-graphic-6.gif [8]: /embed/inline-graphic-7.gif [9]: /embed/inline-graphic-8.gif [10]: /embed/graphic-2.gif [11]: /embed/inline-graphic-9.gif [12]: /embed/inline-graphic-10.gif [13]: /embed/graphic-3.gif [14]: /embed/graphic-4.gif [15]: /embed/graphic-5.gif [16]: /embed/inline-graphic-11.gif [17]: /embed/inline-graphic-12.gif [18]: /embed/graphic-6.gif [19]: /embed/graphic-7.gif [20]: /embed/graphic-8.gif [21]: /embed/graphic-9.gif [22]: /embed/graphic-10.gif [23]: /embed/inline-graphic-13.gif [24]: /embed/inline-graphic-14.gif [25]: /embed/graphic-11.gif [26]: /embed/graphic-12.gif [27]: /embed/graphic-13.gif [28]: /embed/graphic-14.gif [29]: /embed/inline-graphic-15.gif [30]: /embed/inline-graphic-16.gif [31]: /embed/inline-graphic-17.gif [32]: /embed/inline-graphic-18.gif [33]: /embed/inline-graphic-19.gif [34]: /embed/graphic-15.gif [35]: /embed/graphic-16.gif [36]: /embed/graphic-17.gif [37]: /embed/graphic-18.gif [38]: /embed/graphic-19.gif [39]: /embed/graphic-20.gif [40]: /embed/graphic-21.gif [41]: /embed/graphic-22.gif [42]: /embed/graphic-23.gif [43]: /embed/graphic-24.gif [44]: /embed/inline-graphic-20.gif [45]: /embed/inline-graphic-21.gif