1 Introduction
One of the main problems in systems biology is revealing the relationship between functions and components (proteins, nucleic acids, polysaccharides) as well as their interactions in biological networks [
1-
4]. With the contribution of experimental physiologists, the precise details of components, interactions, and full map of the biological regulatory network have been presented. To analyze the function of the network, many mathematical methods have been introduced, such as master equations model, the Monte Carlo method [
5], the stochastic model [
6-
8], ordinary differential equation (ODE) model [
9-
13], and the Boolean network method [
14-
19]. These mathematical models not only help us understand how the biological components work, but also provide many useful and precise predictions [
20,
21].
An important application of the mathematical models is to investigate how the biological network is robustly designed for realizing its function. Creatures should be well adapted to the environment after the long process of evolution. Sometimes, the adaptability is expressed as the high robustness of the function and structure against perturbations [
22-
24]. One of the well-studied examples is the research on the cell-cycle network that describes the metabolic process [
25-
27]. Li
et al. have investigated the global dynamical property and stability of the cell-cycle network of budding yeast in the Boolean network model [
15] and the ODE model [
28], and revealed that the cell-cycle pathway is an attracting trajectory of the dynamics and rather stable against perturbations. They have also studied the robustness of the network in the stochastic model from the potential landscape perspective [
8]. Wang
et al. have also carried out many works from the potential landscape perspective in the study of the cell-cycle network using the stochastic model and the ODE model [
17-
19]. Their results have demonstrated that the network has the least dissipation cost design for its robustness. These studies that use various models help us understand the biological network’s robustness further.
The biological network is robustly designed as a whole, but the functional role of local edges would be diverse. Several works of Wang
et al., on the basis of the Boolean network model, have revealed that the functional backbone motif structures of the cell-cycle network of budding and fission yeast, where the functional backbone motif is the minimal subnetwork (with the fewest edges) that can maintain the main function of the full network [
17-
19,
29]. Afterward, Yang
et al. constructed a simple cell-cycle network of cancer cells and found that the backbone motif structure also exists in this network [
30]. From this perspective, a biological network can be viewed as the combination of two components: the functional backbone motif (backbone network), which carries out the main function of the network; and the remaining edges (supplementary edges), which can enhance the robustness of the network. This classification could not only help us understand why a network still works normally after some regulatory edges are removed, but also provide us considerable information to control the network or even design a new artificial network in further experiments. Therefore, finding the backbone network is a very important task.
The method used by Wang et al. is rather good in finding the backbone network, but it has some limitations. The method is process based: firstly, the Boolean network equations can be established and simplified with the known biological process; then, the simplified equations are solved by enumeration, and all the solutions are called the possible networks of the biological process; and finally, the backbone network is selected from the possible networks with the known biological network. However, this method can be applied only to the Boolean network model, and is not adaptable to the other models previously mentioned. Moreover, the process of solving equations by enumeration may cost considerable time in many situations. Therefore, just as in the case of studies on the robustness of the cell-cycle network, an efficient method that can be applied to determine the backbone network in different models is considered to be very necessary.
In this paper, we suggest a new method to determine the backbone network of the biological network based on the idea of tinkering. The idea of tinkering was firstly used in evolution by François Jacob, who considered the process of evolution as a tinker’s tinkering [
31]. Then, Alon
et al. proposed that the tinker is a good engineer for some biological networks’ motifs, which are well designed to enhance the network robustness [
2,
32-
34]. Here, based on the idea of tinkering, we propose a simple algorithm, the tinker algorithm, with which the backbone network of a given network can be determined by tinkering the edges of the network one by one. We apply it to different models such as the Boolean network model, stochastic model, and ODE method. Simulation results show that the algorithm works satisfactorily.
The paper is organized as follows. In Section 2, the description of the tinker algorithm is provided. In Section 3, the simulation results of the tinker algorithm applied in the Boolean network model, stochastic model, and ODE method are presented in detail. Finally, our conclusion and discussions are given.
2 Methods
A biological network with N interacting molecules can be expressed as an adjacency matrix , where each node denotes a molecule. The value of can be positive, negative, or zero, depending on whether node j activates, inhibits, or does not interact with node i, respectively. The value of can also be positive, negative, or zero, representing that node i has self-degradation, self-stimulation, or no action back on itself, respectively. We use to denote the concentration or state of the ith molecule at the moment t, where for all the molecules. Here, the function of a network is expressed as a special time series of , say ; we call it the functional sequences. To determine the backbone network, two basic assumptions are necessary: the full network and functional sequences should be known from experiments or database in advance; and every node is indispensable in maintaining the function of the network, and cannot be removed.
The basic idea of the tinker algorithm is to identify the functional role by tinkering each edge. We check whether the functional sequences are still maintained under the remaining network after removing an edge. If this is true, this edge is a supplementary edge and can be removed; otherwise, the edge is a backbone edge, and should be retained. For discrete models, such as the Boolean network model and the stochastic model, the function being maintained means that the new time series (after an edge is removed) is completely in accordance with the functional sequences, namely, . Obviously, each node’s functional sequence is influenced only by its neighbors. Therefore, we can construct a local network for each node: the target node and its entry regulations. In addition, there must be a minimal subnetwork of the local network under which the functional sequence of the node is maintained, and we call it the subbackbone network. Then, the backbone network of the full network can be viewed as the combination of subbackbone networks of all nodes. The schematic showing how to determine the subbackbone network of each node is in Fig. 1. For the full network [Fig. 1(a)], we arbitrarily select a node and construct its local network [Fig. 1(b)]. Then, we check its subnetworks in the order of the subnetwork containing edges [Figs. 1(c), (d), (e), (f)] to identify which subnetwork is the subbackbone network. With this idea, the code of the tinker algorithm can be written as follows:
Next, we analyze the computational complexity of this algorithm. For a node i with entry degree di, the subnetworks of its local network can be organized as shown in Fig. 1. For each case of k and l, and , we update the network and use the subroutine to check whether the functional sequences can be maintained under the new network. This process will cost most time in running the program since the number of cases that we have to check is
Actually, the program may stop in the middle of the loop (if the check is true); thus, less than mi cases are needed to be considered in practical conditions. Moreover, for a network with degree distribution , we consider cases at most. Since , the computational time in which we determine the backbone network of a network with N nodes is less than the order of ), where is the largest degree of the nodes.
We also compare the efficiency of the tinker algorithm with that of the algorithm in the previous reference. To find all the possible networks of the functional sequences, most of the time for the algorithm used in reference [
17] is spent in solving the Boolean network equations by enumerating the types of regulation between any two nodes. Because the types of regulation can be activation, inhibition, or no regulation, the time needed to solve the equations (not simplified) is of the order of
. If the equations are simplified, the time would be less. For the tinker algorithm, the running time of finding the backbone network is determined by
. For many biological networks, the average degree of each network is approximately between 2 and 4, where
usually [
15,
35-
38]. Obviously,
is much smaller than
, indicating that the tinker algorithm is more efficient.
The tinker algorithm is more efficient mostly because it makes full use of the given network. Once the full network is given, in order to identify the functional role of an edge, only two cases (keeping or removing the edge) are needed to be checked. On the other hand, for the algorithm in reference [
17], the full network is not required at first. To identify the type of regulation between any two nodes, three cases (activation, inhibition, or no regulation) should be checked. This leads to the computational complexity of
versus
for the tinker algorithm and the previous algorithm. However, we can do nothing with the tinker algorithm if the full network is not given in advance. Therefore, it should be noted that the tinker algorithm is preferred only for the task of finding the backbone network of a given full network. We will focus our attention on this task in the following sections.
3 Simulation results
In this paper, we take the cell-cycle networks as our examples [
15]. The full process of the cell cycle consists of four phases: G1, S, G2, and M. In the G1 phase, the cell grows, and undergoes division under appropriate conditions. Then, in the S phase, DNA is synthesized and chromosomes are replicated. The G2 phase is a “gap” phase between S and M. The final phase M corresponds to mitosis, in which chromosomes are separated and the cell is divided into two. Eventually, after the M stage, the cell enters G1, thereby completing a “cycle.” The cell-cycle networks of budding yeast and fission yeast are shown in Fig. 2(a) and Fig. 2(c), respectively [
15,
20]. The network for budding yeast consists of eleven (
) proteins: Cln3, MBF, SBF, Cln1,-2, Cdh1, Swi5, Cdc20/Cdc14, Clb5,-6, Sic1, Clb1,-2, and Mcm1/SFF, whereas the network for fission yeast includes nine (
N=9) proteins: SK, Cdc2/Cdc13, Ste9, Rum1, Slp1, Cdc2/Cdc13
*, Wee1/Mik1, Cdc25, and PP. We use
to express the biological process (the functional sequences) of the cell cycle. The functional sequences
for these two types of yeast are shown in Table 1.
3.1 Tinker algorithm applied in the Boolean network model
In the Boolean network model, each node
i has only two states,
or 0, representing the “on” (active) or “off” (inactive) state of the molecule, respectively. Therefore, there are
possible states of the networked system. The general dynamical rule, based on which the molecular states in the next time step can be determined by the molecular states in the current time step, is described as follows [
15]:
where
hi is the threshold. Here,
,
take the value −1, 1, or 0, and
take the value −
γ, 1, or 0 for
j≠
i. In the dominant inhibition model, where inhibition is dominant over stimulation for other types of interactions, namely,
, Eq. (5) can be simplified into a logical equation [
17]:
where represents a putative inhibitory edge and stands for a putative stimulatory edge from node j to i. The addition, multiplication, and bar in the equation represent the Boolean operators OR, AND, and NOT, respectively. In this model, the subroutine is described as follows:
Based on the tinker algorithm and the subroutine of the dominant inhibition Boolean network model, the backbone networks of the cell-cycle networks of budding and fission yeast are determined and shown in Fig. 2(b) and Fig. 2(d), respectively. Through careful comparison, we find that they are identical to those shown in reference [
17]. This verifies that the tinker algorithm is effective.
Furthermore, we apply the tinker algorithm to find the backbone network of a larger network. As shown in Fig. 3(a), the regulatory network that controls the differentiation process of the T helper cell contains 22 nodes: IL-18, IL-12, IFNr, IL-4, IL-10, NFAT, IL-18R, IL-12R, IFN-rR, IL-4R, IL-10R, IFN-
β, IRAK, STAT4, JAK1, STAT6, STAT3, IFN-
βR, SOCS1, T-bet, STAT1, and GATA3 [
39]. In addition, the time course shown in Table 2 is chosen to be the functional sequences
of the nodes. As one can see, the largest degree of the nodes is 7 (
), which is much smaller than the network size. According to the theoretical result in Section 2, very short time would be enough to determine the backbone network with the tinker algorithm. In fact, our simulation result shows that we can obtain the backbone network [Fig. 3(b)] of the regulatory network in
seconds. This demonstrates that the tinker algorithm is really efficient.
Although the backbone network of a full network can be found accurately with the tinker algorithm, it should be mentioned that the obtained backbone network may not be unique because of the existence of structure symmetry. From Fig. 2(c) and Table 1(b), one can see that the role of Ste9 and Rum1 in the cell-cycle network of fission yeast share high similarities. In Fig. 2(d), if the edge from Ste9 to Cdc2/Cdc13 is substituted by the edge from Rum1 to Cdc2/Cdc13, the new network is also a backbone network. As our algorithm is based on determining the subbackbone network of each node just according to the main function sequence, structure symmetry is a global property and it may not be expressed. For the network with high structure symmetry, it is not easy to find all the backbone networks for it may greatly increase the computational complexity. Hence, we do not expand this topic further.
3.2 Tinker algorithm applied in the stochastic model
In the stochastic model, which is based on the Boolean network model, it is assumed that the transition of the states of the molecules is a stochastic process with the Markov property [
8]. In the Boolean network model, the next state
from the present state S(t) is exactly determined. However, in the stochastic model, the next state
can be an arbitrary state of the
states, but with a different transition probability to each state. The transition probability is described as follows:
where is the conditional probability that the state of the ith node is at moment t+1, and it is expressed as
if , ; if , then
The values of
and
are identical to those used in the Boolean network model.
α and
β are two parameters, whose robustness has been analyzed in reference [
8]. Here, we set
α=5,
β=6, and
.
Next, we will show the details of the subroutine in this model. Although the next state can be an arbitrary state of the states, there is a state such that
and we call it the most probable transition state. Naturally, the state for each i satisfies , namely,
In this model, the function of the network being maintained means that . Then, the subroutine is described as follows:
We still take the cell-cycle network of budding and fission yeast as examples. Their backbone networks can be determined with this algorithm, and it turns out that they are the same as those found in the dominant Boolean network model [Figs. 2(b) and (d)].
We also compare the importance of backbone network edges with supplementary edges (the edges belonging to the full network but not in the backbone network). For the budding yeast, there are 34 edges in the full network and 23 edges in the backbone network. We define the trajectory transition probability as
Prt is calculated under the following networks: the backbone network with one edge removed (23 cases), the backbone network, the backbone network with one of the supplementary edges added (11 cases), and the full network [Fig. 4(a)]. The probability is nearly zero for the backbone network with one edge removed, indicating that the network can barely carry out the function if even one edge is lost. For the other cases, is much larger, and it is the largest for the full network case. It demonstrates that the supplementary edges really can enhance the robustness of the network. We carry out the same process in the cell-cycle network of fission yeast and find similar phenomena [Fig. 4(b)].
3.3 Tinker algorithm applied in the ordinary differential equation (ODE) model
The ordinary differential equation (ODE) model is a time continuous model. It is one of the most useful and effective models, as it can exactly give the concentration of each molecule, which can be compared with experimental results. Therefore, we expect to determine the functional backbone network in the ODE model with the tinker algorithm.
Compared to the previous two models, determining the backbone network using the tinker algorithm is slightly different in the ODE model. In the Boolean network model, to determine whether the function is maintained, we check whether the new is equal to after removing some edges of the network. If we still apply this standard to the ODE model, the results of the check will always be false. Because for the ODE model, the functional sequence is the continuous solution of the ODE equations under the full network. If an arbitrary edge of the full network is removed, the new solution under the new network would always be different from . However, a very small difference between and is actually inconsequential for the function. Thus, the original standard is not appropriate for the ODE model. Therefore, we give a more reasonable standard: (i) the Pearson correlation coefficient (Ri) between and the new is larger than R0, namely, , for ; (ii) the difference between the period of and is less than T0, namely, , for , where is a proper time translation of . If the new standard is achieved with the proper thresholds R0 and T0, the basic trends of and would be identical except for small deviations. Then we can say that the function of the network is maintained. Under the new standard, the network should be treated as a whole and each node cannot be treated locally anymore, necessitating some modifications of the tinker algorithm. The details of the tinker algorithm, as well as the subroutine , for the ODE model can be seen in Appendix A.
Here, we take the cell-cycle network of fission yeast as an example to show the results. Many ODE models for the cell-cycle network of fission yeast have been introduced [
11,
40-
42]; here we use the model in Refs. [
10] and [
43] as it can well explain the variation in concentration of the proteins during the process of the cell cycle. The network for this ODE model is shown in Fig. 5(a). We use
to represent the concentrations or values of Cdc13
T1, preMPF
1, Ste9
1, Slp
, Slp1
1, IEP
1, Rum
, SK
1, M, TF
1, k
, k
, MPF
1, and Trimer
1, respectively; the subscript 1 marks the rescaled variables with maximum 1. The equations for
are described as follows:
where
is the matrix element of the regulatory network [Fig. 5(a)], , takes the value 0 or 1 and denotes the presence or absence of interaction from protein j to i. The values of the parameters in the equations can be seen in Table 3. Moreover, the cell mass M represented by S9, increases exponentially before cell division. We divide the cell mass by two () at the end of mitosis; the time (MPF) decreases through 0.1 when a cell splits itself into two daughter cells.
Based on the modified tinker algorithm and the new standard, the backbone network can be found. During our simulation, the functional sequence of the network, , is defined as the solution of the ODE equations under the full cell-cycle network. Since the values of R0 and T0 should not be too critical or too weak, we set and , where . Accordingly, we determine the backbone network and show it in Fig. 5(b). The solutions of the ODE equations under the full network and the backbone network are compared in Fig. 6. One can see that they are well matched, indicating that the backbone network can really maintain the function of the full cell-cycle network, further demonstrating that the tinker algorithm is adoptable to determine the backbone network in the ODE model.
4 Conclusion and discussion
We have proposed a new algorithm, the tinker algorithm, with which the backbone network can be determined accurately and efficiently in different models. In the dominant inhibition Boolean network model, the functional backbone networks determined in the cell-cycle networks of the two yeasts match well the results in previous works, verifying that the tinker algorithm is effective. In the stochastic model, the functional backbone networks could also be determined easily. At the same time, the importance of the backbone network edges and the supplementary edges has been tested. In addition, we found that the network loses its function if an arbitrary backbone network edge is removed, while the supplementary edges enhance the robustness of the network. Furthermore, this method has also been applied to the ODE model, and the backbone network of the cell-cycle network of fission yeast was determined.
The tinker algorithm is quite different from the method used in previous research papers. In reference [
17], the method is mainly based on the idea of reverse engineering and makes full use of the message of the biological process; the goal is to determine all possible networks just from the biological process according to the basic rules of the dominant inhibition Boolean network model. Nevertheless, the requirement of basic rules restricts it to only determine the backbone networks in the dominant inhibition Boolean network model. In contrast, the tinker algorithm is based on the idea of tinkering and makes use of the messages of both the network structure and the biological process. The purpose is to remove the supplementary edges that have little impact on the biological process. This method is more general and can be applied in various mathematical models as shown in our simulation results.
With this advantage, the backbone networks obtained from different models can be compared with each other. From previous results, we know that the backbone networks in the dominant inhibition Boolean network model and the stochastic model are identical. Next, we discuss the difference between the backbone networks in the Boolean network model and the ODE model. In the previous section, the backbone network of the fission yeast cell-cycle network has been found in the ODE model. As a special coarse-grained limit of this ODE model, a Boolean model can be formulated [
43], whose details can be seen in Appendix B. We determine the backbone network in this Boolean model and compare it with the backbone network found in the ODE model (Fig. 7). Interestingly, we find that they are almost identical except that one edge is mismatched: the regulation from k25 to preMPF in the ODE model is replaced by the regulation from Ste9 to Cdc13
T in the Boolean network model [Figs. 7(c) and (d)]. By analyzing the interaction coefficients and time series associated with these four proteins, we find that the mismatch may be attributed to the following fact: the regulations between any two proteins can be strong or weak in the ODE model, while they are all the same in the Boolean model. This indicates that the interaction strength affects the importance of the interaction (edge), and hence influences the backbone network structure.
Our aim of proposing this algorithm is to find the most important interactions in the complex biological processes. It is easy to find that the perturbation on the backbone structure rather than the supplementary edges can make a much more important effect on the dynamic process. As the evolutionary process goes on, the mutations on the supplementary structure may cause an effective process and help the creatures to adapt to the change of environment, whereas the mutation on the backbone structure usually causes the process to be terminated and adversely affects the survival and evolution. The tinker algorithm helps us distinguish the backbone network and supplementary edges, and it may give us a preliminary conclusion about the most important interactions of the network. In addition to determining the backbone network, we notice that many researchers are working to detect the core or the skeleton network of a complex network, which is defined as a network that has only a few nodes and its dynamic trajectory qualitatively approaches the full network [
44-
46]. This skeleton or core network has much in common with the backbone network for they both maintain the main function of the full network. Since the tinker algorithm is a general method, we look forward to it being put into practical use in future studies.
Higher Education Press and Springer-Verlag Berlin Heidelberg 2017