Startseite Effects of anisotropic diffusion in a two-dimensional unstirred chemostat
Artikel Open Access

Effects of anisotropic diffusion in a two-dimensional unstirred chemostat

  • Hongqiang Yu und Jianhua Wu EMAIL logo
Veröffentlicht/Copyright: 1. Oktober 2025
Advanced Nonlinear Studies
Aus der Zeitschrift Advanced Nonlinear Studies

Abstract

We investigate an unstirred chemostat model in which two species compete in a two-dimensional environment. The populations are assumed to disperse anisotropically, with distinct probabilities assigned to horizontal and vertical movements, which are interpreted as dispersal strategies. First, we analyze the dynamics of the single-species model and identify the conditions for the existence of positive steady states. Then, we classify the dynamical behavior of the two-species model into three scenarios based on the diffusion strategies: (i) extinction; (ii) competitive exclusion; and (iii) coexistence. Next, we provide sufficient conditions for the existence of coexistence steady states. Finally, our numerical simulations provide visual validation of our theoretical results and offer valuable insights for future researches.

MSC 2020: 35A01; 35A02; 35B32; 35B35

1 Introduction

The chemostat is a widely employed laboratory apparatus for continuous microbial cultures, with significant applications in fields such as fermentation engineering and wastewater treatment. Moreover, it is often used as a simplified model to study more intricate microbial ecosystems, including ponds and lakes. Consequently, various mathematical models have been developed to characterize the interactions between nutrients and microorganisms in chemostats, integrating factors such as species growth, diffusion, and interspecies interactions; see, e.g., [1].

Initial formulations of chemostat dynamics were based on the premise of complete mixing within the culture vessel, thereby maintaining uniform nutrient dispersion. Under this assumption, the system is commonly modeled by ordinary differential equations that describe spatially homogeneous concentrations of nutrients and microbial populations; see, e.g., [2]. However, substantial discrepancies remain between these idealized chemostat models and the complexities of real natural environments. To bridge this gap and enhance ecological realism, subsequent research has led to substantial modifications of classical chemostat models, yielding a wide array of generalized formulations. Prominent examples encompass models incorporating periodic temporal variations [3], [4], [5], delayed responses [6], and the presence of inhibitors [7], [8].

Diffusion is a widespread natural process, which has led to considerable interest in the analysis of unstirred chemostat models. Hsu and Waltman [9] introduced random diffusion into the chemostat model and derived results concerning the coexistence of two competing populations. Their findings revealed that diffusion plays a crucial role in population coexistence. In the context of unstirred chemostat models, Wu [10] studied the existence of coexistence states using global bifurcation theory. Subsequently, Wu and collaborators extended this line of research to unstirred chemostat models incorporating inhibitors [11], as well as models involving two resources [12], [13]. Furthermore, it is also noted in ref. [9] that assuming nutrients and microorganisms have identical diffusion rates is biologically unrealistic. Previous studies have presented various results for different random diffusion rates; see, e.g., [14], [15], [16], [17].

However, population dispersal is often non-random due to heterogeneity in resource distribution, variability in topography and climate, and anthropogenic modifications, leading to directional movement biases. Anisotropic diffusion is one such form that captures these complexities. Bouin et al. [18] proposed a scenario where the population moves horizontally with probability θ 2 and vertically with probability 1 θ 2 , where θ ∈ [0, 1]. Moreover, they showed that in a model of two competing populations in two-dimensional heterogeneous environments, the optimal dispersal strategy for both populations is to migrate preferentially in the direction exhibiting lower variability in resource distribution. For more advanced theoretical studies concerning anisotropy or other diffusion mechanisms, the reader is referred to refs. [19], [20], [21].

Biologically, anisotropic diffusion may offer more adaptive possibilities for populations, enabling them to better align with available resources. This can enhance the likelihood of coexistence. Exploring the evolution of anisotropic diffusion in more biologically plausible environments would be both intriguing and significant.

Motivated by the works of refs. [9], [10], [18], we investigate in this study an unstirred chemostat model incorporating anisotropic diffusion.

(1.1) S t = D 0 Δ S f 1 ( S ) u f 2 ( S ) v , u t = D ( p ) u x x + D ( 1 p ) u y y + f 1 ( S ) u , v t = D ( q ) v x x + D ( 1 q ) v y y + f 2 ( S ) v in  Ω × R + ,

subject to the boundary conditions

(1.2) D 0 S ν + b ( x , y ) S = H ( x , y ) , ( D ( p ) u x , D ( 1 p ) u y ) ν + b ( x , y ) u = 0 , ( D ( q ) v x , D ( 1 q ) v y ) ν + b ( x , y ) v = 0 on  Ω × R + ,

and the initial conditions

(1.3) S ( x , y , 0 ) = S 0 ( x , y ) 0 , u ( x , y , 0 ) = u 0 ( x , y ) , 0 , v ( x , y , 0 ) = v 0 ( x , y ) , 0 on  Ω ̄ .

Here, Δ 2 x 2 + 2 y 2 is the Laplace operator and ∇ ⋅ ν is the normal derivative on the boundary, where ν = (ν x , ν y ) denotes the outward unit normal vector. S(x, y, t) represents the nutrient concentration, while u(x, y, t) and v(x, y, t) denote the population densities of two competitors within the unstirred chemostat. Ω is a strictly convex, open, bounded subset of R 2 with a smooth boundary ∂Ω. The function D ( θ ) D ̲ + ( D ̄ D ̲ ) θ for any θ ∈ [0, 1], where 0 < D ̲ < D ̄ to avoid the degeneracy [18]. In particular, we assume that

D 0 = D 1 2 = 1 2 D ̲ + D ̄ .

The functions

f i ( S ) = m i S a i + S , i = 1,2 ,

where m i , a i > 0. Here, the constants m i > 0, i = 1, 2, represent the maximal growth rates, and the constants a i > 0, i = 1, 2, denote the Michaelis-Menten constants. The nutrients are supplied at the rate of H(x, y) at position (x, y), where H(x, y) ≥ 0. The mixture of nutrients and microorganisms is withdrawn at a spatially dependent rate b(x, y) at location (x, y), leading to the Robin boundary conditions. The functions b(x, y), H(x, y) ∈ C2+α(∂Ω) and b(x, y), H(x, y) ≥, ≢0 on ∂Ω. We assume that ∂Ω is partitioned into two non-empty, pairwise disjoint subsets Γ i , i = 1, 2, with ∂Ω = Γ1 ∩ Γ2, where Γ1 ≔ {(x, y) ∈ ∂Ω : b(x, y) = 0} and H(x, y) ≥, ≢0 on Γ1. The boundary conditions (1.2) are intuitive and appropriate for this type of equations; see [9], [16], [22] for the derivation and explanation. Moreover, the initial values ( S 0 , u 0 , v 0 ) [ C ( Ω ̄ ) ] 3 . For simplicity, the parameters not explicitly specified are treated as constants throughout this paper.

If the initial condition v0(x, y) ≡ 0, formally equivalent to setting v(x, y, t) ≡ 0 in system (1.1)(1.3), then this system can be reduced to

(1.4) S t = D 0 Δ S f 1 ( S ) u , u t = D ( p ) u x x + D ( 1 p ) u y y + f 1 ( S ) u in  Ω × R + , D 0 S ν + b ( x , y ) S = H ( x , y ) , D ( p ) u x , D ( 1 p ) u y ν + b ( x , y ) u = 0 on  Ω × R + , S ( x , y , 0 ) = S 0 ( x , y ) 0 , u ( x , y , 0 ) = u 0 ( x , y ) , 0 on  Ω ̄ .

Similarly, we obtain another single-species model

(1.5) S t = D 0 Δ S f 2 ( S ) v , v t = D ( q ) v x x + D ( 1 q ) v y y + f 2 ( S ) v in  Ω × R + , D 0 S ν + b ( x , y ) S = H ( x , y ) , ( D ( q ) v x , D ( 1 q ) v y ) ν + b ( x , y ) v = 0 on  Ω × R + , S ( x , y , 0 ) = S 0 ( x , y ) 0 , v ( x , y , 0 ) = v 0 ( x , y ) , 0 on  Ω ̄ .

Furthermore, it is well known that in the absence of species in this chemostat, the nutrient concentration S(x, y, t) approaches a unique equilibrium, denoted by z; see Lemma 2.5.

Inspired by the seminal contribution of Bouin et al. [18], which established the concavity property of the principal eigenvalue for a certain class of elliptic operators with respect to the anisotropic diffusion parameter (denoted by either p or q), we significantly broaden this result. In particular, we establish the concavity property for a substantially wider class of elliptic eigenvalue problems encompassing more general functional response terms and boundary conditions in reaction-diffusion equations; see Lemma 2.1 for the precise statement.

By introducing anisotropic diffusion, where random diffusion can be seen as a special case when p = q = 1 2 (e.g., [9]), we face several technical challenges. One such challenges is the failure of the conservation law in the chemostat, which prevents us from simplifying the models. As a result, we are compelled to work with higher-dimensional operators. Another challenge arises from the necessity of simultaneously considering both the average diffusion rate, 1 2 ( D ̲ + D ̄ ) (i.e., D0), and the diffusion strategies, p and q, within these models.

Interestingly, our findings reveal a more intricate structure than that observed in the case of isotropic diffusion. To illustrate this, we examine the steady states of the single-species model (1.4). In the isotropic diffusion setting, the corresponding results (see, e.g., [9] or Lemma 2.7) are represented by the slice p = 1 2 in the schematic bifurcation diagrams shown in Figure 1. From this figure, we observe that regardless of whether positive steady states exist in the isotropic case, variations in the anisotropic diffusion parameter p can induce the emergence or disappearance of such steady states.

Figure 1: 
Schematic bifurcation diagrams of (S, u) for system (3.8); see Theorems 3.7–3.9.
Figure 1:

Schematic bifurcation diagrams of (S, u) for system (3.8); see Theorems 3.73.9.

We derive several key results concerning the dynamics of systems (1.1)(1.5) are summarized briefly as follows.

  1. There exists a unique connected open interval I p ⊂ [0, 1] such that the steady state (z, 0) of system (1.4) is globally asymptotically stable for pI p (see Theorem 3.3), and system (1.4) is uniformly persistent for p [ 0,1 ] \ I p ̄ (see Theorem 3.4). Moreover, system (1.4) admits at least one positive steady state for p [ 0,1 ] \ I p ̄ , and the positive steady state is locally asymptotically stable when the parameter p is near the outer boundary of the interval I p (see Theorems 3.73.9 and Remarks there).

  2. Similarly, there exists a unique connected open interval I q ⊂ [0, 1] such that the steady state (z, 0) of system (1.5) is globally asymptotically stable for pI q , and system (1.5) is uniformly persistent for q [ 0,1 ] \ I q ̄ (see Theorem 3.5). Moreover, system (1.5) admits at least one positive steady state for q [ 0,1 ] \ I q ̄ , and the positive steady state is locally asymptotically stable when the parameter q is near the outer boundary of the interval I q (see Theorem 3.11 and Remark there).

  3. There exists a unique connected region Σ0 ⊂ [0, 1]2 such that the steady state (z, 0, 0) of system (1.1)(1.3) is globally asymptotically stable for (p, q) ∈ Σ0 (see Theorem 4.2).

  4. Competitive exclusion between the two species u, v in system (1.1)(1.3) may occur if the average rate of anisotropic diffusion 1 2 ( D ̲ + D ̄ ) (i.e., D0) is relatively low (see Theorem 4.3), where (p, q) ∈ [0, 1]20.

  5. There may exist a region Σ1 ⊂ [0, 1]2 located on the boundary of [0, 1]2 such that system (1.1)(1.3) is uniformly persistent for (p, q) ∈ Σ1 (see Theorem 4.4). Moreover, we derive the conditions for the linear stability of several special solutions (see Theorem 5.1). Additionally, we conclude that under certain additional conditions, system (1.1)(1.3) admits at least one positive steady state when (p, q) lies within a specific region of Σ1 (see Theorems 5.8 and 5.10), and the positive steady state is locally asymptotically stable when (p, q) is located in a very small region of Σ1 (see Lemmas 5.5 and 5.6).

  6. Moreover, we investigate the impact of anisotropic diffusion on system (1.1)(1.3) using numerical simulations, with the goal of providing insights and support (see Section 6).

Based on the above analysis of the models, we found that it is more advantageous for the species to disperse in a single direction. This is because our conclusion shows that the diffusion strategies leading to extinction or competitive exclusion are typically positioned in the middle of their feasible area, exhibiting no distinct directional bias. In contrast, anisotropic diffusion can significantly enhance the potential for species coexistence, which is consistent with the conclusions drawn in ref. [18].

The organization of this paper is as follows. In Section 2, we present several findings that will be utilized in the subsequent analysis. Section 3 analyzes the dynamical behavior of the single-species models (1.4) and (1.5), and examines the existence and local stability of their positive steady states. The aim of Section 4 is to investigate the dynamic behavior of the two-species model (1.1)(1.3). In Section 5, we further study the structure of coexistence steady states of system (1.1)(1.3) using bifurcation theory. Furthermore, we discuss the local stability of some coexistence steady states using perturbation theory. Section 6 presents numerical simulations examining the effects of dispersal strategies. Finally, a brief discussion is provided in Section 7.

2 Preliminaries

In this section, we present some preliminary results that will be useful for the subsequent analysis.

Consider the following linear elliptic eigenvalue problem

(2.1) D ( p ) φ x x + D ( 1 p ) φ y y + h ( x , y ) φ + λ φ = 0 in  Ω , D ( p ) φ x , D ( 1 p ) φ y ν + b ( x , y ) φ = 0 on  Ω ,

where hL(Ω). This problem admits a unique principal eigenvalue [23], denoted by λ1(p, h), with a positive eigenfunction φ1(p, h). The corresponding eigenfunction φ1(p, h) is unique up to a scalar multiple. We can normalize the positive eigenfunction φ1(p, h) by enforcing the condition Ω φ 1 2 = 1 . The variational characterization of λ1(p, h) could be given by

(2.2) λ 1 ( p , h ) = inf φ H 1 ( Ω ) φ 0 Ω D ( p ) ( φ x ) 2 + D ( 1 p ) ( φ y ) 2 h φ 2 + Ω b ( x , y ) φ 2 Ω φ 2 .

Furthermore, if φ1H1(Ω), then in fact φ1W2,r(Ω) for any r ∈ (1, ∞); see, e.g., [24], Theorem 2.1 and Remarks there].

It is well known that λ1(p, h) varies smoothly with p. The implicit function theorem further implies that the corresponding principal eigenfuntion φ1(p, h) > 0 on Ω ̄ also depends continuously and differentiably on p; see, e.g., [24]. For convenience, we write λ 1 ( p , h ) p and 2 λ 1 ( p , h ) p 2 as λ 1 and λ 1 , respectively. Similarly, we denote φ 1 ( p , h ) p by φ 1 . In particular, when h satisfies the following assumption, the principal eigenvalue λ1(p, h) exhibits more special properties. Recalling that Γ1 = {(x, y) ∈ ∂Ω : b(x, y) = 0} and H(x, y) ≥, ≢0 on Γ1, we introduce the following assumption.

  1. There does not exist an non-empty subset Ω Γ 1 Ω , where Γ 1 Ω Γ 1 ̄ , such that h is constant on Ω Γ 1 ̄ .

Motivated by ref. [18], Lemma 4.4], we have the following results.

Lemma 2.1.

The mapping pλ1(p, h) is concave on the interval [0, 1]. Furthermore, under the assumption (A), if there exists p0 ∈ [0, 1] such that λ 1 ( p 0 , h ) = 0 , then λ 1 ( p 0 , h ) < 0 .

Proof.

Differentiating eigenvalue problem (2.1) with respect to p, we obtain

(2.3) D ( p ) ( φ 1 ) x x ' + D ( 1 p ) ( φ 1 ) y y ' + h φ 1 ' + λ 1 φ 1 ' + ( D ̄ D ̲ ) ( φ 1 ) x x ( φ 1 ) y y + λ 1 ' φ 1 = 0 in  Ω , D ( p ) ( φ 1 ) x ' + ( D ̄ D ̲ ) ( φ 1 ) x , D ( p ) ( φ 1 ) y ' ( D ̄ D ̲ ) ( φ 1 ) y ν + b ( x , y ) φ 1 ' = 0 on  Ω .

By multiplying the first equation of (2.1) by φ 1 and integrating the result by parts over Ω, and then applying the second equation of (2.1), we obtain

Ω b ( x , y ) φ 1 φ 1 Ω D ( p ) ( φ 1 ) x ( φ 1 ) x + D ( 1 p ) ( φ 1 ) y ( φ 1 ) y + Ω h φ 1 φ 1 + λ 1 Ω φ 1 φ 1 = 0 .

Similarly, by multiplying the first equation of (2.3) by φ1, integrating the result by parts over Ω, and applying the second equation of (2.3), we derive

Ω b ( x , y ) φ 1 φ 1 Ω D ( p ) ( φ 1 ) x ( φ 1 ) x + D ( 1 p ) ( φ 1 ) y ( φ 1 ) y + Ω h φ 1 φ 1 + λ 1 Ω φ 1 φ 1 ( D ̄ D ̲ ) Ω ( φ 1 ) x 2 ( φ 1 ) y 2 + λ 1 Ω φ 1 2 = 0

Subtracting the above two equalities, we have

λ 1 Ω φ 1 2 = ( D ̄ D ̲ ) Ω ( φ 1 ) x 2 ( φ 1 ) y 2 .

Since the eigenspace corresponding to λ1 is one-dimensional, we can normalize the eigenfunction φ1 by imposing Ω φ 1 2 = 1 , so that it is uniquely determined. Then we obtain

(2.4) λ 1 = ( D ̄ D ̲ ) Ω ( φ 1 ) x 2 ( φ 1 ) y 2 .

Differentiating equation (2.4) with respect to p yields

λ 1 = 2 ( D ̄ D ̲ ) Ω ( φ 1 ) x ( φ 1 ) x ( φ 1 ) y ( φ 1 ) y .

Multiplying the first equation of (2.3) by φ 1 , integrating the result by parts over Ω, and applying the second equation of (2.3), we have

              ( D ̄ D ̲ ) Ω ( φ 1 ) x ( φ 1 ) x ' ( φ 1 ) y ( φ 1 ) y ' = Ω b ( x , y ) ( φ 1 ' ) 2 Ω D ( p ) φ 1 ' x 2 + D ( 1 p ) φ 1 ' y 2 + Ω h φ 1 φ 1 '               + λ 1 Ω φ 1 ' 2 + λ 1 ' Ω φ 1 φ 1 ' .

Here the last term in the right-hand side vanishes due to the normalisation condition Ω φ 1 2 = 1 , which implies that Ω φ 1 φ 1 = 0 . By the variational characterization of λ1(p, h) (see, e.g., equation (2.2)), we obtain

( D ̄ D ̲ ) Ω ( φ 1 ) x ( φ 1 ) x ( φ 1 ) y ( φ 1 ) y 0 .

It then follows that λ 1 0 , with the equality holding if and only if φ 1 is a scalar multiple of φ1. Since Ω φ 1 φ 1 = 0 and φ1 > 0 in Ω, we have that φ 1 0 in Ω when λ 1 = 0 .

Now we show that if there exists p0 ∈ [0, 1] such that λ 1 ( p 0 , h ) = 0 , then λ 1 ( p 0 , h ) < 0 by contradiction arguments. Otherwise, λ 1 ( p 0 , h ) = 0 , then problem (2.3) reduces to

( φ 1 ) x x ( φ 1 ) y y = 0 in  Ω , φ 1 x ν x φ 1 y ν y = 0 on  Ω .

In view of the boundary condition for φ in problem (2.1), we further have

( φ 1 ) x ν x = ( φ 1 ) y ν y = b φ 1 D ̄ + D ̲ = 0 on  Γ 1 , < 0 in  Γ 2 .

Under the assumption of strict convexity for the domain Ω, the components ν x and ν y of the outward normal vector ν are non-zero on the boundary ∂Ω, except possibly on a set of measure zero. Since φ 1 C 1 ( Ω ̄ ) , we have ∇φ1 = 0 on Γ1. Set η = x + y, ζ = xy and Z(η, ζ) ≔ φ1(x, y). The function Z(η, ζ) then satisfies

(2.5) Z η ζ = 0 in  Ω ' , Z η , Z ζ = ( 0,0 ) on  Γ 1 ' ,

where Ω′ and Γ 1 are the images of Ω and Γ1 under the homeomorphic map (x, y) ↦ (η, ζ), respectively. It follows from the first equation of (2.5) that Z(η, ζ) = f(η) + g(ζ), where the functions f and g are to be determined. Moreover, the second equation of (2.5) implies that f′(η) = g′(ζ) = 0 for all ( η , ζ ) Γ 1 . Consequently, there exists a non-empty open subset Ω 0 Ω such that Z is constant on Ω 0 , where Γ 1 Ω 0 . Hence, φ1 is constant on Ω 0 ̄ , where Ω0 is the preimage of Ω 0 . Using the first equation of (2.1), we obtain that h + λ1(p0, h) ≡ 0 in Ω0, which contradicts the assumption (A). This completes the proof. □

For any given hL(Ω), we define a function

(2.6) F ( p ; h ) Ω φ 1 ( p , h ) x 2 ( φ 1 ( p , h ) y ) 2

for p ∈ [0, 1]. Based on the proof of Lemma 2.1, it is straightforward to observe that F′(p; h) ≤ 0 in (0, 1). This function is closely aligned with the formulation in ref. [18], Theorem 2.1] and underpins the core arguments of the subsequent investigation. It quantifies the difference between the resource variations in horizontal and vertical directions. For F > 0, the resource distribution exhibits greater spatial variations in the horizontal direction, while for F < 0, the variation is more pronounced in the vertical direction.

Next, we summarize several results on λ1(p, h) obtained in prior studies, while the proofs are not repeated here.

Lemma 2.2

([24]). The following statements on eigenvalue λ1(p, h) hold true.

  1. h n h in C ( Ω ̄ ) implies λ1(p, h n ) → λ1(p, h).

  2. h1h2 implies λ1(p, h1) ≤ λ1(p, h2), and the equality holds if and only if h1h2.

Lemma 2.3.

Assume that p = 1 2 . Then eigenvalue problem (2.1) degenerates into

D 0 Δ φ + h ( x , y ) φ + λ φ = 0 in  Ω , D 0 φ ν + b ( x , y ) φ = 0 on  Ω .

The principal eigenvalue λ 1 1 2 , h is strictly increasing with respect to D0 in (0, +∞). Moreover,

lim D 0 0 + λ 1 1 2 , h = max ( x , y ) Ω ̄ h ( x , y ) and lim D 0 + λ 1 1 2 , h = 1 | Ω | Ω b ( x , y ) Ω h ( x , y ) .

Therefore, if max ( x , y ) Ω ̄ h ( x , y ) > 0 and ∫Ωh(x, y) < ∫∂Ωb(x, y), then there exists a unique D*(h) ∈ (0, +∞) such that

λ 1 1 2 , h < 0 if  0 < D 0 < D * ( h ) , λ 1 1 2 , h = 0 if  D 0 = D * ( h ) , λ 1 1 2 , h > 0 if  D 0 > D * ( h ) .

Remark 2.4.

If the assumption ∫Ωh(x, y) < ∫∂Ωb(x, y) does not hold, then it follows that λ 1 1 2 , h < 0 for any D0 ∈ (0, +∞), implying the nonexistence of D*(h). This observation considerably simplifies the subsequent analysis. Therefore, in the following, we focus on the case where ∫Ωh(x, y) < ∫∂Ωb(x, y). A similar but simpler analysis can be carried out for the case where ∫Ωh(x, y) ≥ ∫∂Ωb(x, y).

The monotonicity of the principal eigenvalue λ 1 1 2 , h with respect to D0 can be established through its variational formulation; see, e.g., equation (2.2). By employing techniques similar to those used in the proofs of ref. [25], Propositions 1.3.16 and 1.3.19], we can prove the asymptotic behavior of λ 1 1 2 , h in the limits D0 → 0+ and D0 → +∞, respectively.

Then we restate some conclusions for certain degenerate cases without providing the proof.

Lemma 2.5

([9], [10]). The following system

(2.7) S ̄ t = D 0 Δ S ̄ in  Ω × R + , D 0 S ̄ ν + b ( x , y ) S ̄ = H ( x , y ) on  Ω × R + , S ̄ ( x , y , 0 ) = S 0 ( x , y ) 0 on  Ω ̄

admits a unique globally attractive positive steady state, denoted by z.

Remark 2.6.

In view of the boundary condition in system (2.7), we conclude that there does not exist an non-empty subset Ω Γ 1 Ω , where Γ 1 Ω Γ 1 ̄ , such that z is constant on Ω Γ 1 ̄ .

For the sake of simplicity, unless otherwise specified, we shall assume that the following assumptions hold throughout the remainder of this paper:

max Ω f 1 ( z ) , Ω f 2 ( z ) < Ω b ( x , y ) .

If p = 1 2 , then system (1.4) becomes

(2.8) S t = D 0 Δ S f 1 ( S ) u , u t = D 0 Δ u + f 1 ( S ) u in  Ω × R + , D 0 S ν + b ( x , y ) S = H ( x , y ) , D 0 u ν + b ( x , y ) u = 0 on  Ω × R + , S ( x , y , 0 ) = S 0 ( x , y ) 0 , u ( x , y , 0 ) = u 0 ( x , y ) , 0 on  Ω ̄ .

Let D 1 * D * f 1 ( z ) , where D* is defined in Lemma 2.3. We have the following results.

Lemma 2.7

([26]). The following statements on system (2.8) are valid.

  1. If 0 < D 0 < D 1 * , then system (2.8) admits a unique globally attractive positive steady state (zθ1, θ1), where θ1 is the unique positive solution to

    (2.9) D 0 Δ θ + f 1 ( z θ ) θ = 0 in  Ω , D 0 θ ν + b ( x , y ) θ = 0 on  Ω .
  2. If D 0 D 1 * , then the semi-trivial steady state (z, 0) is globally attractive.

Recall that λ1(p, f1(z)) is the principal eigenvalue of problem

(2.10) D ( p ) φ x x + D ( 1 p ) φ y y + f 1 ( z ) φ + λ φ = 0 in  Ω , D ( p ) φ x , D ( 1 p ) φ y ν + b ( x , y ) φ = 0 on  Ω

with eigenfunction φ1(p, f1(z)), and F p ; f 1 ( z ) = Ω φ 1 p , f 1 ( z ) x 2 φ 1 p , f 1 ( z ) y 2 . It follows that once the parameters p, m1, a1, b(x, y), and the domain Ω are specified, the value of F(p; f1(z)) is uniquely determined. For convenience, we write

F 1 F 1 2 ; f 1 ( z ) = Ω φ 1 1 2 , f 1 ( z ) x 2 φ 1 1 2 , f 1 ( z ) y 2 .

By Lemmas 2.1 and 2.3, we obtain the following results. The proofs are similar to that of ref. [18], Theorem 5.2], thus we omit them here.

Proposition 2.8.

Assume that D 0 = D 1 * . Then one of the following statements is valid.

  1. If F1 = 0, then λ1(p, f1(z)) < 0 for p [ 0,1 ] \ { 1 2 } .

  2. If F1 < 0, then there exists p * 0 , 1 2 such that λ1(p, f1(z)) < 0 for p [ 0,1 ] \ p * , 1 2 and λ1(p, f1(z)) > 0 for p p * , 1 2 , where p* = 0 if λ 1 0 , f 1 ( z ) 0 .

  3. If F1 > 0, then there exists p * 1 2 , 1 such that λ1(p, f1(z)) < 0 for p [ 0,1 ] \ 1 2 , p * and λ1(p, f1(z)) > 0 for p 1 2 , p * , where p* = 1 if λ 1 1 , f 1 ( z ) 0 .

Proposition 2.9.

Assume that D 0 > D 1 * . Then there exist 0 p 0 * < 1 2 < p 1 * 1 such that λ1(p, f1(z)) > 0 for p p 0 * , p 1 * and λ1(p, f1(z)) < 0 for p [ 0,1 ] \ p 0 * , p 1 * , where p 0 * = 0 if λ 1 0 , f 1 ( z ) 0 and p 1 * = 1 if λ 1 1 , f 1 ( z ) 0 .

Proposition 2.10.

Assume that 0 < D 0 < D 1 * . Then one of the following statements is valid.

  1. If F1 = 0, then λ1(p, f1(z)) < 0 for p ∈ [0, 1].

  2. If F1 < 0, then λ1(p, f1(z)) < 0 for p 1 2 ϵ , 1 , where ϵ > 0 is small enough. In particular, there may exist two points, 0 p * p + * < 1 2 , such that λ1(p, f1(z)) < 0 for p [ 0,1 ] \ p * , p + * and λ1(p, f1(z)) > 0 for p p * , p + * , where p * = 0 if λ 1 0 , f 1 ( z ) 0 .

  3. If F1 > 0, then λ1(p, f1(z)) < 0 for p 0 , 1 2 + ϵ , where ϵ > 0 is small enough. In particular, there may exist two points, 1 2 < p * p + * 1 , such that λ1(p, f1(z)) < 0 for p [ 0,1 ] \ p * , p + * and λ1(p, f1(z)) > 0 for p p * , p + * , where p + * = 1 if λ 1 1 , f 1 ( z ) 0 .

For convenience, we summarize the conclusions on the sign of λ1(p, f1(z)) in Table 1. Here D0, D1 > 0. The symbol “*” indicates that no specific requirements are imposed on the related parameters. In this table, the set [ 0,1 ] \ p 0 * , p 1 * is empty when p 0 * = 0 and p 1 * = 1 , and the set p * , p + * is empty when p * = p + * or when p * , p + * do not exist. All other sets are non-empty.

Table 1:

The results on the sign of λ1(p, f1(z)).

D 0 D 1 * F 1 p λ1(p, f1(z))
+ * p 0 * , p 1 * , 0 p 0 * < 1 2 < p 1 * 1 +
[ 0,1 ] \ p 0 * , p 1 *
0 + 1 2 , p * , 1 2 < p * 1 +
[ 0,1 ] \ 1 2 , p *
0 [ 0,1 ] \ 1 2
p * , 1 2 , 0 p * < 1 2 +
[ 0,1 ] \ p * , 1 2
+ p * , p + * , 1 2 < p * p + * 1 +
[ 0,1 ] \ p * , p + *
0 [0, 1]
p * , p + * , 0 p * p + * < 1 2 +
[ 0,1 ] \ p * , p + *

Set D 2 * D * f 2 ( z ) and F 2 F 1 2 ; f 2 ( z ) . Similarly, Table 2 can be derived, which provides essential structural insights into the analysis of system (1.1)(1.3).

Table 2:

The results on the sign of λ1(q, f2(z)).

D 0 D 2 * F 2 q λ1(q, f2(z))
+ * q 0 * , q 1 * , 0 q 0 * < 1 2 < q 1 * 1 +
[ 0,1 ] \ q 0 * , q 1 *
0 + 1 2 , q * , 1 2 < q * 1 +
[ 0,1 ] \ 1 2 , q *
0 [ 0,1 ] \ 1 2
q * , 1 2 , 0 q * < 1 2 +
[ 0,1 ] \ q * , 1 2
+ q * , q + * , 1 2 < q * q + * 1 +
[ 0,1 ] \ q * , q + *
0 [0, 1]
q * , q + * , 0 q * q + * < 1 2 +
[ 0,1 ] \ q * , q + *

3 Single-species model

To gain insight into the population dynamics in the absence of interspecific interactions, we examine the single-species models (1.4) and (1.5), aiming to determine the conditions for population persistence in the unstirred chemostat.

3.1 Dynamical behavior

In this subsection, we investgate the dynamical behavior of system (1.4). The local existence and uniqueness of its solution are established in refs. [27], [28], [29], [30]. Recalling that the initial values ( S 0 , u 0 ) [ C ( Ω ̄ ) ] 2 are nonnegative, we have the following conclusions.

Lemma 3.1

(local existence, [31]). System (1.4) admits a unique nonnegative classical solution S , u in Ω ̄ × ( 0 , T max ) , where T max 0 , + . Specifically, the solution satisfies

S , u C Ω ̄ × 0 , T max C 2,1 Ω ̄ × ( 0 , T max ) 2 .

Moreover, if Tmax < +∞, then

lim sup t T max S ( , , t ) L ( Ω ) + u ( , , t ) L ( Ω ) = + .

Based on the approach used in the proof of ref. [32], Lemma 4.1], we demonstrate that the solution (S(x, y, t), u(x, y, t)) to system (1.4) is well-defined for all t > 0 and is bounded.

Lemma 3.2.

System (1.4) admits a unique solution (S(x, y, t), u(x, y, t)) for all ( x , y ) Ω ̄ and t > 0. Moreover, there exist positive constants K1, K2, which depend on the initial values S0(x, y), u0(x, y), such that for all ( x , y ) Ω ̄ and t > 0,

0 < S ( x , y , t ) K 1 , 0 < u ( x , y , t ) K 2 .

In particular, the solution (S(x, y, t), u(x, y, t)) is ultimately bounded.

Proof.

The local existence and uniqueness of the solution to system (1.4) are shown in Lemma 3.1. We only need to establish the global existence and boundedness of the solution to system (1.4). Firstly, it follows from the maximum principle for parabolic equations that S(x, y, t) > 0, u(x, y, t) > 0 for all ( x , y ) Ω ̄ and t ∈ (0, Tmax). Then we have

S t D 0 Δ S in  Ω × R + .

Recall that S ̄ ( x , y , t ) is the solution to system (2.7). The comparison principle for parabolic equations implies that S ( x , y , t ) S ̄ ( x , y , t ) for all ( x , y ) Ω ̄ and t > 0. Moreover, S ̄ ( , , t ) z uniformly on Ω ̄ as t → +∞. Hence, there exists a positive constant K1, depending on the initial values S0(x, y), such that 0 < S(x, y, t) ≤ K1 for all ( x , y ) Ω ̄ and t > 0.

Consequently,

u t D ( p ) u x x + D ( 1 p ) u y y + f 1 ( K 1 ) u in  Ω × R + .

Let φ ̃ C 1 + α ( Ω ̄ ) be the unit norm positive principal eigenfunction of problem (2.1) with h = f1(K1), corresponding to the principal eigenvalue λ ̃ λ 1 p , f 1 ( K 1 ) ; see Section 2. Note that u ̄ = c 1 φ ̃ e λ ̃ t is a solution to

u ̄ t = D ( p ) u ̄ x x + D ( 1 p ) u ̄ y y + f 1 ( K 1 ) u ̄ in  Ω × R + , D ( p ) u ̄ x , D ( 1 p ) u ̄ y ν + b ( x , y ) u ̄ = 0 on  Ω × R + . u ̄ ( x , y , 0 ) = c 1 φ ̃ > 0 on  Ω ̄ .

By choosing a sufficiently large positive constant c1 such that c 1 φ ̃ > u 0 on Ω ̄ , the comparison principle for parabolic equations implies that u ( x , y , t ) u ̄ ( x , y , t ) for all ( x , y ) Ω ̄ and t > 0. Hence, system (1.4) admits a unique solution (S(x, y, t), u(x, y, t)) for all ( x , y ) Ω ̄ and t > 0.

In the following, we demonstrate that for all ( x , y ) Ω ̄ and t > 0, the solution u(x, y, t) is uniformly bounded. Let φ 0 C 1 + α ( Ω ̄ ) be the unit norm positive principal eigenfunction of problem (2.1) with h = 0, corresponding to the principal eigenvalue λ 0 λ 1 p , 0 . Multiplying the equation for u in system (1.4) by φ0 and integrating over Ω by parts, we obtain

(3.1) d d t Ω u φ 0 = Ω f 1 ( S ) λ 0 u φ 0 for all  t > 0 .

Set G(t) = ∫Ω(S + c20), where 0 < c 2 ( max ( x , y ) Ω ̄ φ 0 ) 1 . By integrating the first equation of system (1.4) over Ω by parts, and subsequently adding c2 times equation (3.1), we obtain that for all t > 0,

d d t G ( t ) + λ 0 G ( t ) = Ω ( H b S ) + Ω f 1 ( S ) c 2 φ 0 1 u + λ 0 Ω S Ω H + λ 0 | Ω | K 1 .

By Gronwall’s inequality, we get the L1 estimates

G ( t ) G ( 0 ) e λ 0 t + Ω H + λ 0 | Ω | K 1 λ 0 1 e λ 0 t for all  t > 0 .

Clearly, φ0 is independent of t. Moreover, λ0 > 0 by the variational characterization; see, e.g., equation (2.2). Hence, there exists a positive constant κ such that

(3.2) Ω u < κ for all  t > 0 .

Let U ( t ) = max ( x , y ) Ω ̄ , τ [ 0 , t ] u ( x , y , τ ) . Clearly, U(t) is nondecreasing. There exists a sequence t n → +∞ such that U ( t n ) = max ( x , y ) Ω ̄ u ( x , y , t n ) . Suppose, by contradiction, that U(t) → +∞ as t → +∞, i.e., U(t n ) → +∞ as n → +∞. Assume without loss of generality that t n > 1 for all n ≥ 1. Define u ̃ n ( x , y , t ) = u x , y , t + t n 1 U ( t n ) . It then follows that u ̃ n ( x , y , t ) satisfies

( u ̃ n ) t = D ( p ) ( u ̃ n ) x x + D ( 1 p ) ( u ̃ n ) y y + f 1 S x , y , t + t n 1 u ̃ n in  Ω × R + , ( D ( p ) ( u ̃ n ) x , D ( 1 p ) ( u ̃ n ) y ) ν + b ( x , y ) u ̃ n = 0 on  Ω × R + , 0 < u ̃ n ( x , y , 0 ) 1 on  Ω ̄ .

In view of 0 < f 1 S x , y , t + t n 1 f 1 ( K 1 ) for all ( x , y ) Ω ̄ and t > 0, the comparison principle for parabolic equations implies that 0 < u ̃ n ( x , y , t ) e f 1 ( K 1 ) t for all ( x , y ) Ω ̄ and t > 0. It follows from the standard parabolic regularity theory that { u ̃ n } is bounded in C 1 + α , α Ω ̄ × 1 2 , 2 for any α ∈ (0, 1). By passing to a subsequence if necessary, we get that u ̃ n u ̃ in C 1,0 Ω ̄ × 1 2 , 2 . Noting max ( x , y ) Ω ̄ u ̃ n ( x , y , 1 ) = 1 for any n ≥ 1, we have max ( x , y ) Ω ̄ u ̃ ( x , y , 1 ) = 1 . Due to the continuous differentiability of u ̃ ( x , y , 1 ) with respect to (x, y) and the maximum principle for parabolic equations, we have Ω u ̃ ( x , y , 1 ) δ > 0 . This implies that Ω u ̃ n x , y , 1 δ 2 for all large n. Hence,

Ω u ( x , y , t n ) = Ω u ̃ n x , y , 1 U ( t n ) δ 2 U ( t n ) | Ω | + as  n + ,

which contradicts (3.2). This implies that u(x, y, t) is bounded for all ( x , y ) Ω ̄ and t > 0. Consequently, there exists a positive constant K2, depending on the initial data u0(x, y), such that 0 < u(x, y, t) ≤ K2 for all ( x , y ) Ω ̄ and t > 0. This completes the proof. □

Then we have the following conclusions on system (1.4).

Theorem 3.3.

Assume that λ1(p, f1(z)) > 0; see Table 1. Then the steady state (z, 0) of system (1.4) is globally asymptotically stable.

Proof.

It follows from Lemma 3.2 that the solution (S(x, y, t), u(x, y, t)) satisfies S(x, y, t) > 0, u(x, y, t) > 0 for all (x, y) ∈ Ω and t > 0. Hence, we have

S t D 0 Δ S in  Ω × R + .

The comparison principle for parabolic equations implies that

(3.3) lim sup t + S ( , , t ) z uniformly on  Ω ̄ ,

where z is the unique globally attractive positive steady state of system (2.7). This implies that for any ϵ > 0, there exists t1 > 0 such that S < z + ϵ for all ( x , y ) Ω ̄ and t > t1. By arguments similar to those in the proof of ref. [9], Theorem 3.1], we conclude that if λ1(p, f1(z)) > 0, then

(3.4) lim t + u ( , , t ) = 0 uniformly on  Ω ̄  in an exponential manner .

In view of (3.4), we conclude that for any ϵ > 0, there exists t2 > t1 such that u(x, y, t) < ϵ for all ( x , y ) Ω ̄ and t > t2. It follows from arguments similar to those in the proof of ref. [26], Theorem 1.1] that

(3.5) lim inf t + S ( , , t ) z uniformly on  Ω ̄ .

Inequalities (3.3) and (3.5) imply that limt→+∞S(⋅, ⋅, t) = z uniformly on Ω ̄ . The proof is completed. □

Theorem 3.4.

Assume that λ1(p, f1(z)) < 0; see Table 1. Then system (1.4) is uniformly persistent in the sense that there exists ϵ > 0 such that the solution (S(x, y, t), u(x, y, t)) of system (1.4) satisfying

lim inf t + S ( , , t ) ϵ  and  lim inf t + u ( , , t ) ϵ uniformly on Ω ̄ .

Proof.

We first claim that there exists ϵ1 > 0 such that lim inft→+∞S(⋅, ⋅, t) ≥ϵ1. It follows from Lemma 3.2 that

S t D 0 Δ S K 2 f 1 ( S ) in  Ω × R + .

The comparison principle for parabolic equations implies that S ( x , y , t ) S ̃ ( x , y , t ) for all ( x , y ) Ω ̄ and t > 0, where S ̃ ( x , y , t ) is the solution to

(3.6) S ̃ t = D 0 Δ S ̃ x x K 2 f 1 ( S ̃ ) in  Ω × R + , D 0 S ̃ ν + b ( x , y ) S ̃ = H ( x , y ) on  Ω × R + , S ̃ ( x , y , 0 ) = S 0 ( x , y ) on  Ω ̄ .

By arguments similar to those in ref. [33], Lemmas 2.2 and 4.2], we conclude that S ̃ ( , , t ) z K 2 uniformly on Ω ̄ as t → +∞, where z K 2 is the unique positive steady state of system (3.6). Hence, we have that lim inft→+∞S(⋅, ⋅, t) ≥ ϵ1, where ϵ 1 = min Ω ̄ z K 2 .

Next, we aim to apply the abstract persistence theory in refs. [34], [35]. With this in mind, we let

P 1 = ( S , u ) C ( Ω ̄ ) × C ( Ω ̄ ) : S 0 , u 0  on  Ω ̄ , P 1 0 = ( S , u ) P 1 : u 0 , P 1 0 = P 1 \ P 1 0 = ( S , u ) P 1 : u 0 .

Clearly, P 1 0 contains the steady state (z, 0). Define Φ t as the solution semiflow generated by system (1.4) on P1. It follows from the standard parabolic regularity theory that Φ t is compact for any t > 0. By Lemma 3.2, we have that Φ t is point dissipative. Then it follows from ref. [36], Theorem 2.6] that Φ t has a global compact attractor that attracts each bounded set in P1.

Let M = ( S 0 , u 0 ) P 1 0 : Φ t ( S 0 , u 0 ) P 1 0 , t 0 and ω1((S0, u0)) be the omega limit set of the forward orbit γ 1 + ( ( S 0 , u 0 ) ) Φ t ( S 0 , u 0 ) : t 0 . We then claim that

( S 0 , u 0 ) M ω 1 ( ( S 0 , u 0 ) ) = ( z , 0 ) .

In fact, for any ( S 0 , u 0 ) M , we have Φ t ( S 0 , u 0 ) P 1 0 for all t ≥ 0. Hence, u(x, y, t) ≡ 0 on Ω ̄ for all t ≥ 0. Then S(x, y, t) satisfies system (2.7). It follows that limt→+∞S(⋅, ⋅, t) = z uniformly on Ω ̄ . This claim is valid.

We now show that (z, 0) is a uniform weak repeller. That is, there exists δ0 > 0 such that for all ( S 0 , u 0 ) P 1 0 ,

lim sup t + Φ t ( S 0 , u 0 ) ( z , 0 ) δ 0 .

If not, then for any δ > 0, there exists ( S 0 , u 0 ) P 1 0 such that lim supt→+∞‖Φ t (S0, u0) − (z, 0)‖ < δ. This implies that there exists t0 > 0 such that for t > t0,

(3.7) S ( , , t ) z < δ , u ( , , t ) < δ .

By the continuity of function f1(S), we can choose ϵ > 0 small such that for all ( x , y ) Ω ̄ and tt0, f1(S) > f1(z) − ϵ. Thus, we obtain

u t D ( p ) u x x + D ( 1 p ) u y y + f 1 ( z ) ϵ u in  Ω × ( t 0 , + ) .

In view of ( S 0 , u 0 ) P 1 0 , it follows from the maximum principle that u(x, y, t0) > 0 for all ( x , y ) Ω ̄ . Hence, there exists κ > 0 such that u(⋅, ⋅, t0) ≥ κφ1, where φ1φ1(p, f1(z)) is the principal eigenfunction of problem (2.10) corresponding to the principal eigenvalue λ1λ1(p, f1(z)). Let u ̃ ( x , y , t ) = κ e ( λ 1 + ϵ ) ( t 0 t ) φ 1 ( x , y ) for all ( x , y ) Ω ̄ and tt0. Then u ̃ satisfies

u ̃ t = D ( p ) u ̃ x x + D ( 1 p ) u ̃ y y + f 1 ( z ) ϵ u ̃ in  Ω × ( t 0 , + ) , D ( p ) u ̃ x , D ( 1 p ) u ̃ y ν + b ( x , y ) u ̃ = 0 on  Ω × ( t 0 , + ) , u ̃ ( x , y , t 0 ) = κ φ 1 ( x , y ) on  Ω ̄ .

By the comparison principle for parabolic equations, we conclude that u ( x , y , t ) u ̃ ( x , y , t ) for all ( x , y ) Ω ̄ and tt0. Since λ1(p, f1(z)) < 0, we can choose ϵ > 0 small such that λ1(p, f1(z)) + ϵ < 0. This implies that limt→+∞u(⋅, ⋅, t) = +∞, which contradicts (3.7). Hence, (z, 0) is a uniform weak repeller and ( z , 0 ) is an isolated invariant set in P1.

Define a continuous function D 1 : P 1 0 , + by D 1 ( S , u ) min Ω ̄ u ( x , y ) for any (S, u) ∈ P1. It is easy to see that D 1 1 ( 0 , + ) P 1 0 , and D 1 satisfies the condition that if D 1 ( ( S , u ) ) > 0 or ( S , u ) P 1 0 with D 1 ( ( S , u ) ) = 0 , then D 1 ( Φ t ( S , u ) ) > 0 for all t > 0. Thus D 1 is a generalized distance function for the semiflow Φ t : P1P1 [35]. Moreover, the stable set W s ( { ( z , 0 ) } ) D 1 1 ( 0 , + ) = . Therefore, no subset of ( z , 0 ) forms a cycle in M . It follows from [ref. 35, Theorem 3] that there exists ϵ2 > 0 such that

min ( S , u ) ω 1 ( ( S 0 , u 0 ) ) D 1 ( ( S , u ) ) > ϵ 2 ,

which implies that for any ( S 0 , u 0 ) P 1 0 , lim inft→+∞u(⋅, ⋅, t) ≥ ϵ2 uniformly on Ω ̄ . Set ϵ = min ϵ 1 , ϵ 2 . This completes the proof. □

For another single-species model (1.5), analogous results can be obtained by similar arguments.

Theorem 3.5.

For system (1.5), one of the following statements is valid.

  1. Assume that λ1(q, f2(z)) > 0; see Table 2. Then the steady state (z, 0) of system (1.5) is globally asymptotically stable.

  2. Assume that λ1(q, f2(z)) < 0; see Table 2. Then system (1.5) is uniformly persistent.

3.2 Further study on positive steady states

In order to better understand the coexistence states of system (1.4), we further study the following steady-state system.

(3.8) D 0 Δ S f 1 ( S ) u = 0 , D ( p ) u x x + D ( 1 p ) u y y + f 1 ( S ) u = 0 in  Ω , D 0 S ν + b ( x , y ) S = H ( x , y ) , D ( p ) u x , D ( 1 p ) u y ν + b ( x , y ) u = 0 on  Ω .

We first derive a priori estimates for the positive solutions to system (3.8).

Lemma 3.6.

Assume that (S, u) is a nonnegative solution to system (3.8) with S ≢ 0 and u ≢ 0. Then

  1. λ1(p, f1(z)) < 0;

  2. 0 < S < z, and there exists a positive constant C such that 0 < u < C on Ω ̄ .

Proof.

It is easy to see that S > 0, u > 0 on Ω ̄ by the strong maximum principle. By the equation for S, we have

0 = D 0 Δ S f 1 ( S ) u < D 0 Δ S .

Noting that z is the unique positive steady state of system (2.7), we conclude that S < z by the upper and lower solution method.

By the equation for u, we have λ1(p, f1(S)) = 0. In view of Lemma 2.2(ii) and 0 < S < z, we have

λ 1 ( p , f 1 ( z ) ) < λ 1 ( p , f 1 ( S ) ) = 0 .

By applying integration by parts to the first two equations of system (3.8) over Ω, we obtain

Ω b u = Ω H b S .

Clearly, there exist a constant ϵ > 0 and a non-empty subset Γ 2 ϵ Γ 2 (recall that b(x, y) > 0 in Γ2) such that b(x, y) ≥ ϵ on Γ 2 ϵ ̄ . Thus, we have

ϵ Γ 2 ϵ u Ω b u = Ω H b S Ω H .

This implies that there exists C0 > 0 such that min Ω ̄ u min Γ 2 ϵ ̄ u C 0 . Note that the domain Ω R 2 is assumed to be bounded and strictly convex, and its boundary ∂Ω is a C2+α smooth curve. The Harnack inequality implies the existence of a constant C1 > 0 such that max Ω ̄ u C 1 min Ω ̄ u . Therefore, there exists a constant C > 0 satisfying 0 < u < C throughout Ω ̄ . □

Next, we analyze the structure and linear stability of the nonnegative solutions to the steady-state system (3.8) using a bifurcation approach; see, e.g., [32], [37]. Taking p as the bifurcation parameter, we construct a positive solution branch that bifurcates from the semi-trivial branch Γ p ( p , z , 0 ) : p [ 0,1 ] . By Proposition 2.8, we have that for D 0 = D 1 * , the critical value p* satisfies p * 0 , 1 2 if F1 < 0, and p * 1 2 , 1 if F1 > 0. We define

p ̲ min p * , 1 2 , p ̄ max p * , 1 2 .

To facilitate the understanding of the bifurcation phenomena described in Theorems 3.73.9, we present schematic bifurcation diagrams illustrating two representative scenarios for the solutions (S, u) of system (3.8), with respect to the parameters p and D0; see Figure 1.

Theorem 3.7.

Assume that D 0 = D 1 * and F1 ≠ 0. Then one of the following statements is valid.

  1. If p* = 0 (respectively, p* = 1), then system (3.8) admits a continuum of positive solutions that bifurcates from the semi-trivial solution branch Γ p at 1 2 , z , 0 . This continuum can be extended to the plane { ( 1 , S , u ) : S > 0 , u > 0  on  Ω ̄ } (respectively, { ( 0 , S , u ) : S > 0 , u > 0  on  Ω ̄ } ).

  2. If 0 < p* < 1, then there exist two continua of positive solutions to system (3.8), bifurcating from the semi-trivial solution branch Γ p at the points ( p ̲ , z , 0 ) and p ̄ , z , 0 , respectively. Each of these continua can be extended to the planes { ( 0 , S , u ) : S > 0 , u > 0  on  Ω ̄ } and { ( 1 , S , u ) : S > 0 , u > 0  on  Ω ̄ } , respectively.

That is, system (3.8) has at least one positive solution if and only if p [ 0,1 ] \ [ p ̲ , p ̄ ] . Furthermore, if p ∈ [0, 1] is sufficiently close to 1 2 or p*, then the positive solution is linearly stable.

Remark 3.8.

If F1 = 0, then p ̲ = p ̄ = 1 2 , and consequently, λ1(p, f1(z)) < 0 for any p [ 0,1 ] \ { 1 2 } ; see Table 1. Since system (3.8) is continuous in all parameters within the specified range, it can be concluded that system (3.8) admits at least one positive solution if and only if p [ 0,1 ] \ { 1 2 } , and the positive solution is linearly stable if p is sufficiently close to 1 2 .

Proof of Theorem 3.7.

It is easy to see that F1 ≠ 0 implies that p * 1 2 , and if 0 < p* < 1, then λ1(p*, f1(z)) = 0. By Lemma 2.1, we deduce that necessarily F p * ; f 1 ( z ) 0 . Hence, we can prove that both 1 2 , z , 0 and p * , z , 0 are bifurcation points with respect to Γ p . For brevity, we present the proof only for 1 2 , z , 0 , as the case of p * , z , 0 can be treated analogously. To enhance clarity, the proof is structured in three distinct steps.

Step 1. Local bifurcation. Let w = zS. Then system (3.8) is equivalent to

(3.9) D 0 Δ w + f 1 ( z w ) u = 0 , D ( p ) u x x + D ( 1 p ) u y y + f 1 ( z w ) u = 0 in  Ω , D 0 w ν + b ( x , y ) w = 0 , D ( p ) u x , D ( 1 p ) u y ν + b ( x , y ) u = 0 on  Ω .

Here w and u in the boundary conditions are interpreted as the traces of wW2,r(Ω) and uW2,r(Ω) on ∂Ω; see, e.g., [24], Theorem 1.6] and Remarks there. Define T 1 : ( 0,1 ) × X 1 Y 1 × W 1 , r ( Ω ) 2 by

(3.10) T 1 ( p , w , u ) = D 0 Δ w + f 1 ( z w ) u D ( p ) u x x + D ( 1 p ) u y y + f 1 ( z w ) u D 0 w ν + b ( x , y ) w ( D ( p ) u x , D ( 1 p ) u y ) ν + b ( x , y ) u ,

where X 1 = W 2 , r ( Ω ) 2 and Y 1 = L r ( Ω ) 2 with r ∈ (1, ∞). Then W2,r(Ω) embeds compactly in C ( Ω ̄ ) ; see, e.g., [24], Theorem 1.7]. Let D(w,u)T1(p, 0, 0) be the Fréchet derivative of T1(p, w, u) with respect to (w, u) at (0, 0). It is easy to see that D(w,u)T1(p, 0, 0) is a Fredholm operator with index zero.

Set D ( w , u ) T 1 ( 1 2 , 0,0 ) ( ϕ , ψ ) = 0 with (ϕ, ψ) ≠ (0, 0), i.e.,

D 0 Δ ϕ + f 1 ( z ) ψ = 0 , D 0 Δ ψ + f 1 ( z ) ψ = 0 in  Ω , D 0 ϕ ν + b ( x , y ) ϕ = 0 , D 0 ψ ν + b ( x , y ) ψ = 0 on  Ω .

By Lemma 2.3, we have λ 1 1 2 , f 1 ( z ) = 0 . Thus, the kernal of D ( w , u ) T 1 1 2 , 0,0 is

N D ( w , u ) T 1 1 2 , 0,0 = span ( ϕ 0 , ψ 0 ) .

Here ψ0 is a positive principal eigenfunction of problem (2.1) with p = 1 2 and h = f1(z). The variational characterization of λ 1 1 2 , 0 (see, e.g., equation (2.2)) implies that λ 1 1 2 , 0 > 0 . Thus, we have ϕ 0 = D 0 Δ 1 f 1 ( z ) ψ 0 with the boundary conditions D0ϕ0ν + b(x, y)ϕ0 = 0, and ϕ0 > 0 on Ω ̄ by the general maximum principle [38].

We next claim that the rangle of D w , u T 1 1 2 , 0,0 is

R D ( w , u ) T 1 1 2 , 0,0 = ϕ * , ψ * , ξ 1 , ξ 2 Y 1 × W 1 , r ( Ω ) 2 : l 1 ϕ * , ψ * , ξ 1 , ξ 2 = 0 ,

where l 1 : Y 1 × W 1 , r ( Ω ) 2 R is a linear functional in Y 1 × W 1 , r ( Ω ) 2 * defined by

l 1 ϕ * , ψ * , ξ 1 , ξ 2 = Ω ψ * ψ 0 Ω ξ 2 ψ 0 .

In order to prove this claim, we need to consider the following problem

(3.11) D 0 Δ ϕ + f 1 ( z ) ψ = ϕ * , D 0 Δ ψ + f 1 ( z ) ψ = ψ * in  Ω , D 0 ϕ ν + b ( x , y ) ϕ = ξ 1 , D 0 ψ ν + b ( x , y ) ψ = ξ 2 on  Ω .

We begin by examining the problem

(3.12) D 0 Δ ψ + f 1 ( z ) ψ = ψ * in  Ω , D 0 ψ ν + b ( x , y ) ψ = ξ 2 on  Ω .

Clearly, there exists a constant M > 0 such that Mf1(z) > 0 on Ω ̄ . Problem (3.12) is equivalent to

D 0 Δ ψ + M f 1 ( z ) ψ = M ψ ψ * in  Ω , D 0 ψ ν + b ( x , y ) ψ = ξ 2 on  Ω .

It follows from the standard elliptic regularity theory (see, e.g., [24], Theorem 1.6]) that for any ξ2W1,r(∂Ω), the following problem

D 0 Δ ψ + M f 1 ( z ) ψ = 0 in  Ω , D 0 ψ ν + b ( x , y ) ψ = ξ 2 on  Ω

has a unique solution ψW2,r(Ω), denoted by ψ1. Setting ψ ̃ ψ ψ 1 , we have

(3.13) D 0 Δ ψ ̃ + M f 1 ( z ) ψ ̃ = M ψ ψ * in  Ω , D 0 ψ ̃ ν + b ( x , y ) ψ ̃ = 0 on  Ω .

Denote

K M D 0 Δ + M f 1 ( z ) 1  and  Ψ M ( ψ ̃ + ψ 1 ) ψ * ,

where K : L r (Ω) → W2,r(Ω) with r ∈ (1, ∞). The Rellich–Kondrachov theorem implies that for any r, W1,r(Ω) embeds compactly in L r (Ω); see, e.g., [39], Theorem 9.16]. Thus, K is compact on L r (Ω). Then problem (3.13) is equivalent to

(3.14) ( I K ) Ψ = M ψ 1 ψ * .

Note that ψ0 satisfies

(3.15) D 0 Δ ψ 0 + f 1 ( z ) ψ 0 = 0 in  Ω , D 0 ψ 0 ν + b ( x , y ) ψ 0 = 0 on  Ω .

By direct computation, we have that with the boundary conditions D0ψν + b(x, y)ψ = 0,

N ( I K * ) = N D 0 Δ f 1 ( z ) * = span ψ 0 .

It follows from the Fredholm alternative theorem (see, e.g., [39], Theorem 6.6]) that equation (3.14) has a solution if and only if

ψ 0 , M ψ 1 ψ * = Ω M ψ 1 ψ * ψ 0 = 0 ,

where ⟨, ⟩ denotes the scalar product in the duality pairing. Here

Ω M ψ 1 ψ 0 = Ω D 0 Δ ψ 1 + f 1 ( z ) ψ 1 ψ 0 = Ω ξ 2 ψ 0 .

Therefore, problem (3.12) has a solution ψ = ψ ̃ + ψ 1 if and only if ∫Ωψ*ψ0 − ∫∂Ωξ2ψ0 = 0. By the standard elliptic regularity theory, we conclude that for any ϕ* ∈ L r (Ω), ψW2,r(Ω) and ξ1W1,r(∂Ω), the following problem

D 0 Δ ϕ = ϕ * f 1 ( z ) ψ in  Ω , D 0 ϕ ν + b ( x , y ) ϕ = ξ 1 on  Ω

has a unique solution ϕW2,r(Ω). This completes the proof of the claim.

We then check the transversality condition

D p ( w , u ) T 1 1 2 , 0,0 ϕ 0 , ψ 0 R D ( w , u ) T 1 1 2 , 0,0 .

Direct computation gives

D p ( w , u ) T 1 1 2 , 0,0 ϕ 0 , ψ 0 = 0 D ̄ D ̲ ( ψ 0 ) x x ( ψ 0 ) y y 0 D ̄ D ̲ ( ψ 0 ) x , ( ψ 0 ) y ν .

and

l 1 D p ( w , u ) T 1 1 2 , 0,0 ϕ 0 , ψ 0 = D ̄ D ̲ Ω ( ψ 0 ) x 2 ( ψ 0 ) y 2 .

If F1 ≠ 0, then

l 1 D p ( w , u ) T 1 1 2 , 0,0 ϕ 0 , ψ 0 0 .

Thus, the transversality condition is satisfied.

Let

Z 1 = ( Φ , Ψ ) X 1 : Ω Ψ ψ 0 = 0 .

Then span ( ϕ 0 , ψ 0 ) Z 1 = X 1 . By applying the standard bifurcation theorem from a simple eigenvalue [40], we conclude that there exist s0 > 0 and C1 curve

p ( s ) , Φ ( s ) , Ψ ( s ) : s 0 , s 0 R × Z 1 ,

such that (i) p ( 0 ) = 1 2 , (ii) Φ(0) = 0, Ψ(0) = 0, (iii) T 1 p ( s ) , w ( s ) , u ( s ) = 0 for |s| < s0, where

p ( s ) , w ( s ) , u ( s ) = p ( s ) , s ϕ 0 + Φ ( s ) , s ψ 0 + Ψ ( s ) .

Let S(s) = zw(s). Noting that ϕ0, ψ0 > 0 on Ω ̄ , we conclude that the bifurcation branch

Γ 1 + = p ( s ) , S ( s ) , u ( s ) : 0 < s < s 0

is exactly the positive solution to system (3.8).

Lemma 3.6(i) implies that there is no positive solution to system (3.8) when λ1(p, f1(z)) ≥ 0. Thus, we conclude that for 0 < s < s0, the derivative p′(s) < 0 when F 1 2 ; f 1 ( z ) > 0 , and p′(s) > 0 when F 1 2 ; f 1 ( z ) < 0 . This implies that

  1. if F 1 2 ; f 1 ( z ) > 0 , then the positive solution branch Γ 1 + lies to the left, which implies that there exists σ > 0 small such that system (3.8) has at least one positive solution when p 1 2 σ , 1 2 ;

  2. if F 1 2 ; f 1 ( z ) < 0 , then the positive solution branch Γ 1 + lies to the right, which implies that there exists σ+ > 0 small such that system (3.8) has at least one positive solution when p 1 2 , 1 2 + σ + .

Step 2. Local stability. We then investigate the linear stability of the bifurcation solutions lying on the local branch Γ 1 + . Based on Step 1 of this proof, it is easy to see that 0 is an I0-simple eigenvalue of D ( w , u ) T 1 1 2 , 0,0 , where the map I 0 : X 1 Y 1 × W 1 , r Ω 2 is defined by I0(ϕ, ψ) = (ϕ, ψ, 0, 0). Then by [41], Corollary 1.13], there exist continuously differentiable functions

p ( ρ 1 ( p ) , u 1 ( p ) ) , s ( ϱ 1 ( s ) , v 1 ( s ) )

defined on the eighborhoods of p = 1 2 and s = 0, respectively, mapping onto R × X 1 , such that

ρ 1 1 2 = 0 , u 1 1 2 = ϕ 0 , ψ 0 , ϱ 1 ( 0 ) = 0 , v 1 ( 0 ) = ϕ 0 , ψ 0 ,

and

D ( w , u ) T 1 ( p , 0,0 ) u 1 ( p ) = ( ρ 1 ( p ) u 1 ( p ) , 0 ) for  p 1 2 1 , D ( w , u ) T 1 ( p ( s ) , w ( s ) , u ( s ) ) v 1 ( s ) = ( ϱ 1 ( s ) v 1 ( s ) , 0 ) for  | s | 1 .

It follows from ref. [41], Theorem 1.16] that ρ 1 1 2 0 . Furthermore, for |s| ≪ 1, if ϱ1(s) ≠ 0, then ϱ1(s) has the same sign as s p ( s ) ρ 1 1 2 .

Noting that u1(p) = (ϕ(p), ψ(p)) satisfies

(3.16) D 0 Δ ϕ ( p ) + f 1 ( z ) ψ ( p ) = ρ 1 ( p ) ϕ ( p ) , D ( p ) ψ ( p ) x x + D ( 1 p ) ψ ( p ) y y + f 1 ( z ) ψ ( p ) = ρ 1 ( p ) ψ ( p ) in  Ω , D 0 ϕ ( p ) ν + b ( x , y ) ϕ ( p ) = 0 , D ( p ) ( ψ ( p ) ) x , D ( 1 p ) ( ψ ( p ) ) y ν + b ( x , y ) ψ ( p ) = 0 on  Ω ,

we have ψ(p) > 0 for | p 1 2 | 1 since ψ 1 2 = ψ 0 > 0 . Hence, ρ1(p) is the principal eigenvalue of the second equation in (3.16), i.e., ρ1(p) = −λ1(p, f1(z)) when | p 1 2 | 1 . Recalling equation (2.4), we have that

ρ 1 1 2 = λ 1 ( p , f 1 ( z ) ) p p = 1 2 = D ̄ D ̲ F 1 2 ; f 1 ( z ) .

It follows from Step 1 of this proof that for 0 < s < s0, the derivative p′(s) < 0 when F 1 2 ; f 1 ( z ) > 0 , and p′(s) > 0 when F 1 2 ; f 1 ( z ) < 0 . We then conclude that for 0 < s < s0,

  1. if F 1 2 ; f 1 ( z ) > 0 , then ρ 1 1 2 < 0 and p′(s) < 0, which implies ϱ1(s) < 0;

  2. if F 1 2 ; f 1 ( z ) < 0 , then ρ 1 1 2 > 0 and p′(s) > 0, which implies ϱ1(s) < 0.

Therefore, the bifurcation solutions to system (3.8) that lie on the local branch Γ 1 + are linearly stable.

Step 3. Global bifurcation. By invoking the global bifurcation framework for Fredholm operators [42], the local branch Γ 1 + is extended to a global branch.

By [40], Theorem 3.3], we conclude that for any (p, w, u) ∈ (0, 1) × X1, the Fréchet derivative D(w,u)T1(p, w, u) is a Fredholm operator with index zero and T 1 : ( 0,1 ) × X 1 Y 1 × W 1 , r Ω 2 is C1 smooth. Similar to the definition in ref. [42], Theorem 1.2], let C 0 be the component of the set of nontrivial solutions to T1(p, w, u) = 0, such that 1 2 , 0,0 C 0 . Set

C 1 = ( p , S , u ) : S = z w , ( p , w , u ) C 0 .

Let C 1 + be the connected component of C 1 \ { p ( s ) , S ( s ) , u ( s ) : s 1 < s < 0 } . Then Γ 1 + C 1 + . It follows from ref. [42], Theorem 1.2] that C 1 + satisfies one of the following alternatives:

  1. it is not compact in (0, 1) × X1;

  2. it contains a point ( p ̃ , z , 0 ) with p ̃ 1 2 ;

  3. it contains a point (p, z + Φ, Ψ), where (Φ, Ψ) ≢ (0, 0) and (Φ, Ψ) ∈ Z1.

We define

X 1 + = ( S , u ) X 1 : S > 0 , u > 0  on  Ω ̄ .

Consequently, we have C 1 ( ( 0,1 ) × X 1 + ) . Let C 1 * = C 1 ( ( 0,1 ) × X 1 + ) . Then C 1 * consists of the local positive solution branch Γ 1 + near the bifurcation point 1 2 , z , 0 and C 1 * C 1 + .

Suppose (iii) holds. For any (p, z + Φ, Ψ) C 1 + with (Φ, Ψ) ≢ (0, 0), we have (p, z + Φ, Ψ) C 1 * , which implies that Ψ > 0 on Ω ̄ . Hence, ∫ΩΨψ0 > 0, which contradicts (Φ, Ψ) ∈ Z1. Therefore, (iii) is impossible.

Suppose (ii) holds. Then there exists a sequence of points { ( p n , S n , u n ) } C 1 * , which converges to ( p ̃ , z , 0 ) on ( 0,1 ) × X 1 + ̄ . By the equation for u n in system (3.8), we have λ1(p n , f1(S n )) = 0. Letting n → ∞, we get λ 1 ( p ̃ , f 1 ( z ) ) = 0 by continuity. Recall that λ 1 1 2 , f 1 ( z ) = 0 . Without loss of generality, we assume p ̃ > 1 2 . It follows from Lemma 2.1 that λ1(p, f1(z)) > 0 for all p 1 2 , p ̃ . However, by Lemma 3.6(i), we have that if there exists p 0 1 2 , p ̃ such that ( p 0 , S , u ) C 1 * , then λ1(p0, f1(z)) < 0, which is a contradiction. Hence, the component C 1 + cannot connect 1 2 , z , 0 and ( p ̃ , z , 0 ) in (0, 1) × X1, meaning that ( p ̃ , z , 0 ) C 1 + . Thus, (ii) can not occur.

The alternative (i) for C 1 + is equivalent to “the closure of C 1 + intersects ( ( 0,1 ) × X 1 + ) or is unbounded in norm of ( 0,1 ) × X 1 + ”. It follows from Lemma 3.6 and the standard elliptic regularity theory that any positive solution (S, u) to system (3.8) remains bounded in X 1 + uniformly for all p ∈ [0, 1]. Thus, (i) implies that there exists a point ( p ̃ , S ̃ , u ̃ ) C 1 * ̄ \ { 1 2 , z , 0 } ( 0,1 ) × X 1 + , which is the limit of a sequence { ( p n , S n , u n ) } C 1 * . We only consider the case where F1 > 0, i.e.,

F 1 = 1 D ̄ D ̲ λ 1 ( p , f 1 ( z ) ) p p = 1 2 > 0 .

A similar analysis can be applied to another case where F1 < 0. If F1 > 0, then there exists ϵ > 0 such that λ1(p, f1(z)) > 0 for all p 1 2 , 1 2 + ϵ . This implies that there is no point ( p , S , u ) C 1 * for p 1 2 , 1 2 + ϵ , and that p ̃ satisfies 0 p ̃ < 1 2 , which in turn implies that λ 1 ( p ̃ , f 1 ( z ) ) < 0 . Hence, ( p ̃ , S ̃ , u ̃ ) ( 0,1 ) × X 1 + implies that:

  1. S ̃ 0 and S ̃ ( x 0 , y 0 ) = 0 for a point ( x 0 , y 0 ) Ω ̄ ; or

  2. u ̃ 0 and u ̃ ( x 1 , y 1 ) = 0 for a point ( x 1 , y 1 ) Ω ̄ ; or

  3. p ̃ = 0 and S ̃ > 0 , u ̃ > 0 on Ω ̄ , i.e., ( S ̃ , u ̃ ) X 1 + .

It follows from the strong maximum principle that S ̃ > 0 on Ω ̄ . Hence, (1) is impossible. By applying the strong maximum principle again, we conclude that (2) implies u ̃ 0 , which leads to ( S ̃ , u ̃ ) = ( z , 0 ) .

Suppose ( S ̃ , u ̃ ) = ( z , 0 ) . Then the sequence {(p n , S n , u n )} satisfies p n p ̃ and (S n , u n ) → (z, 0) in X1 as n → ∞. By the equation for u n in system (3.8), we have λ1(p n , f1(S n )) = 0. Letting n → ∞, we get λ 1 ( p ̃ , f 1 ( z ) ) = 0 by continuity, which contradicts λ 1 ( p ̃ , f 1 ( z ) ) < 0 .

The remainning possibility is p ̃ = 0 with S ̃ > 0 , u ̃ > 0 on Ω ̄ , which implies that the global bifurcation branch C 1 + meets the plane { ( 0 , S , u ) : S > 0 , u > 0  on  Ω ̄ } at the point ( 0 , S ̃ , u ̃ ) as p → 0. This completes the proof. □

By arguments similar to those in the proof of Theorem 3.7, and recalling Propositions 2.9 and 2.10 (or Table 1), we derive the following conclusions.

Theorem 3.9.

One of the following statements is valid.

  1. Assume that D 0 > D 1 * and 0 p 0 * < 1 2 < p 1 * 1 . Then system (3.8) has at least one positive solution if and only if p [ 0,1 ] \ p 0 * , p 1 * . Furthermore, if p is sufficiently close to p 0 * or p 1 * , then the positive solution is linearly stable.

  2. Assume that 0 < D 0 < D 1 * , and that there exist p * and p + * such that either 0 p * < p + * < 1 2 or 1 2 < p * < p + * 1 . Then system (3.8) has at least one positive solution if and only if p [ 0,1 ] \ p * , p + * . Furthermore, if p is sufficiently close to p * or p + * , then the positive solution is linearly stable. In particular, if p = 1 2 , then (zθ1, θ1) is the unique globally attractive positive solution, as stated in Lemma 2.7.

Remark 3.10.

In case (i) where D 0 > D 1 * , if p 0 * = 0 and p 1 * = 1 , then the set [ 0,1 ] \ p 0 * , p 1 * is empty. Consequently, system (3.8) admits no positive solution for any p ∈ (0, 1). By arguments similar to those in Remark 3.8, in case (ii) where 0 < D 0 < D 1 * , if there exists p ± * 0 , 1 2 1 2 , 1 such that p ± * = p * = p + * , then system (3.8) admits at least one positive solution if and only if p [ 0,1 ] \ p ± * , and the positive solution is linearly stable if p is sufficiently close to p ± * .

Consider another single-species steady state model

(3.17) D 0 Δ S f 2 ( S ) v = 0 , D ( q ) v x x + D ( 1 q ) v y y + f 2 ( S ) v = 0 in  Ω , D 0 S ν + b ( x , y ) S = H ( x , y ) , ( D ( q ) v x , D ( 1 q ) v y ) ν + b ( x , y ) v = 0 on  Ω .

As shown in Table 2, when D 0 = D 2 * , the critical value q* satisfies q * 0 , 1 2 if F2 < 0, and q * 1 2 , 1 if F2 > 0. We define

q ̲ min q * , 1 2 , q ̄ max q * , 1 2 .

Then we can derive the following results in a similar manner.

Theorem 3.11.

One of the following statements is valid.

  1. Assume that D 0 = D 2 * and F2 ≠ 0. Then system (3.17) has at least one positive solution if and only if q [ 0,1 ] \ [ q ̲ , q ̄ ] . Furthermore, if q ∈ [0, 1] is sufficiently close to 1 2 or q*, then the positive solution is linearly stable.

  2. Assume that D 0 > D 2 * and 0 q 0 * < 1 2 < q 1 * 1 . Then system (3.17) has at least one positive solution if and only if q [ 0,1 ] \ q 0 * , q 1 * . Furthermore, if q is sufficiently close to q 0 * or q 1 * , then the positive solution is linearly stable.

  3. Assume that 0 < D 0 < D 2 * , and that there exist q * and q + * such that either 0 q * < q + * < 1 2 or 1 2 < q * < q + * 1 . Then system (3.17) has at least one positive solution if and only if q [ 0,1 ] \ q * , q + * . Furthermore, if q is sufficiently close to q * or q + * , then the positive solution is linearly stable. In particular, if q = 1 2 , then (zθ2, θ2) is the unique globally attractive positive solution.

Remark 3.12.

In case (i) where D 0 = D 2 * , if F2 = 0, then q ̲ = q ̄ = 1 2 . Consequently, system (3.17) admits at least one positive solution if and only if q [ 0,1 ] \ { 1 2 } , and the positive solution is linearly stable if q is sufficiently close to 1 2 . In case (ii) where D 0 > D 2 * , if q 0 * = 0 and q 1 * = 1 , then the set [ 0,1 ] \ q 0 * , q 1 * is empty. Thus, system (3.17) admits no positive solution for any q ∈ (0, 1). In case (iii) where 0 < D 0 < D 2 * , if there exists q ± * 0 , 1 2 1 2 , 1 such that q ± * = q * = q + * , then system (3.17) admits at least one positive solution if and only if q [ 0,1 ] \ q ± * , and the positive solution is linearly stable if q is sufficiently close to q ± * .

4 Dynamics of the two-species model

This section is devoted to investigating the dynamic behavior of system (1.1)(1.3). With this in mind, we first show that this system has a unique solution (S(x, y, t), u(x, y, t), v(x, y, t)), which is defined for all t > 0 and is bounded. The proof is similar to that of Lemma 3.2, we thus omit it here.

Lemma 4.1.

System (1.1)(1.3) admits a unique solution (S(x, y, t), u(x, y, t), v(x, y, t)) for all ( x , y ) Ω ̄ and t > 0. Moreover, there exist positive constants ρ1, ρ2 depending on the initial values S0(x, y), u0(x, y), v0(x, y), such that for all ( x , y ) Ω ̄ and t > 0,

0 < S ( x , y , t ) ρ 1 , 0 < u ( x , y , t ) ρ 2 , 0 < v ( x , y , t ) ρ 2 .

In particular, the solution (S(x, y, t), u(x, y, t), v(x, y, t)) is ultimately bounded.

The proof of the following result is similar to that of Theorem 3.3, and thus, we omit it here.

Theorem 4.2.

Assume that λ1(p, f1(z)) > 0 and λ1(q, f2(z)) > 0; see Tables 1 and 2. Then the steady state (z, 0, 0) of system (1.1)(1.3) is globally asymptotically stable.

Recalling Lemma 2.7 and D 2 * = D * f 2 ( z ) , we conclude that if 0 < D 0 < D 2 * and q = 1 2 , then system (1.5) admits a unique globally attractive positive steady state (zθ2, θ2), where θ2 is the unique positive solution to system (2.9) with f1 replaced by f2. Recalling Tables 1 and 2, we have the following conclusions.

Theorem 4.3.

The following statements is valid.

  1. Assume that 0 < D 0 < D 1 * and p = 1 2 , and that there exist q * and q + * such that either 0 q * < q + * < 1 2 or 1 2 < q * < q + * 1 . Then the positive steady state (zθ1, θ1, 0) of system (1.1)(1.3) is globally asymptotically stable for q q * , q + * .

  2. Assume that 0 < D 0 < D 2 * and q = 1 2 , and that there exist p * and p + * such that either 0 p * < p + * < 1 2 or 1 2 < p * < p + * 1 . Then the positive steady state (zθ2, 0, θ2) of system (1.1)(1.3) is globally asymptotically stable for p p * , p + * .

Proof.

By Lemma 4.1, the solution (S(x, y, t), u(x, y, t), v(x, y, t)) of system (1.1)(1.3) satisfies S(x, y, t) > 0, u(x, y, t) > 0, v(x, y, t) > 0 for all (x, y) ∈ Ω and t > 0. Hence, we have

(4.1) S t D 0 Δ S f 1 ( S ) u u t = D 0 Δ u + f 1 ( S ) u in  Ω × R + .

Let w(x, y, t) = S(x, y, t) + u(x, y, t). The comparison principle for parabolic equations implies that w ( x , y , t ) w ̄ ( x , y , t ) for all ( x , y ) Ω ̄ and t > 0, where w ̄ is the solution to

(4.2) w ̄ t = D 0 Δ w ̄ in  Ω × R + , D 0 w ̄ ν + b ( x , y ) w ̄ = H ( x , y ) on  Ω × R + , w ̄ ( x , y , 0 ) = S 0 ( x , y ) + u 0 ( x , y ) 0 on  Ω ̄ .

Thus, for all ( x , y ) Ω ̄ and t > 0, we have S ( x , y , t ) + u ( x , y , t ) w ̄ ( x , y , t ) , or equivalently, S ( x , y , t ) w ̄ ( x , y , t ) u ( x , y , t ) . It follows from Lemma 2.5 that w ̄ ( , , t ) z uniformly on Ω ̄ as t → +∞. This implies that for any ϵ > 0, there exists T1 > 0 such that S < z + ϵu for all ( x , y ) Ω ̄ and t > T1. The comparison principle for parabolic equations implies that v ( x , y , t ) v ̄ ( x , y , t ) for all ( x , y ) Ω ̄ and t > T1, where v ̄ is the solution to

(4.3) v ̄ t = D ( q ) v ̄ x x + D ( 1 q ) v ̄ y y + f 2 ( z + ϵ u ) v ̄ in  Ω × ( T 1 , + ) , D ( q ) v ̄ x , D ( 1 q ) v y ν + b ( x , y ) v ̄ = 0 on  Ω × ( T 1 , + ) , v ̄ ( x , y , T 1 ) = v 1 ( x , y , T 1 ) on  Ω ̄ .

Note that if there exist q * and q + * such that either 0 q * < q + * < 1 2 or 1 2 < q * < q + * 1 , then λ1(q, f2(z)) > 0 for q q * , q + * ; see Table 2. By Lemma 2.2(i), one may select ϵ sufficiently small so that λ1(q, f2(zϵ)) > 0. Consequently, it follows from Lemma 2.2(ii) that

λ 1 q , f 2 ( z + ϵ u ) > λ 1 q , f 2 ( z ϵ ) > 0 .

By applying the separation of variables to system (4.3), we conclude that v ̄ ( , , t ) 0 uniformly on Ω ̄ as t → +∞ in an exponential manner, which implies

(4.4) lim t + v ( , , t ) = 0 uniformly on  Ω ̄  in an exponential manner .

Substituting S w ̄ u into the equation for u in system (1.1)(1.3), we obtain that

u t D 0 Δ u + f 1 ( w ̄ u ) u in  Ω × ( 0 , + ) .

By applying the comparison principle for parabolic equations again, we conclude that u ( x , y , t ) u ̄ ( x , y , t ) for all ( x , y ) Ω ̄ and t > 0, where u ̄ is the solution to

(4.5) u ̄ t = D 0 Δ u ̄ + f 1 ( w ̄ u ̄ ) u ̄ in  Ω × R + , D 0 u ̄ ν + b ( x , y ) u ̄ = 0 on  Ω × R + , u ̄ ( x , y , 0 ) = u 0 ( x , y ) 0 on  Ω ̄ .

Note that w ̄ ( , , t ) z uniformly on Ω ̄ as t → +∞, and that θ1 is the unique positive solution to system (2.9). Then by arguments similar to those in the proof of ref. [9], Theorem 3.2], we deduce that if 0 < D 0 < D 1 * , i.e., λ 1 1 2 , f 1 ( z ) < 0 , then θ1 is the unique globally attractive positive steady state of system (4.5). Hence,

(4.6) lim sup t + u ( , , t ) θ 1 uniformly on  Ω ̄ .

In view of (4.4), we have that for any ϵ > 0, there exists T2 > 0 such that v(x, y, t) < ϵ for all ( x , y ) Ω ̄ and t > T2. It follows from Lemma 4.1 that

S t D 0 Δ S f 1 ( S ) u f 2 ( ρ 1 ) ϵ in  Ω × ( T 2 , + ) .

Recall that w = S + u. The comparison principle for parabolic equations implies that w(x, y, t) ≥ w ϵ (x, y, t) for all ( x , y ) Ω ̄ and t > T2, where w ϵ is the solution to

(4.7) ( w ϵ ) t = D 0 Δ w ϵ f 2 ( ρ 1 ) ϵ in  Ω × ( T 2 , + ) , D 0 w ϵ ν + b ( x , y ) w ϵ = H ( x , y ) on  Ω × ( T 2 , + ) , w ϵ ( x , y , T 2 ) = S ( x , y , T 2 ) + u ( x , y , T 2 ) 0 on  Ω ̄ .

Hence, S(x, y, t) ≥ w ϵ (x, y, t) − u(x, y, t) for all ( x , y ) Ω ̄ and t > T2. Substituting it into the equation for u in system (1.1)(1.3), we obtain that

u t D 0 Δ u + f 1 ( w ϵ u ) u in  Ω × ( T 2 , + ) .

By the comparison principle for parabolic equations, we conclude that u ( x , y , t ) u ̲ ( x , y , t ) for all ( x , y ) Ω ̄ and t > T2, where u ̲ is the solution to

u ̲ t = D 0 Δ u ̲ + f 1 ( w ϵ u ̲ ) u ̲ in  Ω × ( T 2 , + ) , D 0 u ̲ ν + b ( x , y ) u ̲ = 0 on  Ω × ( T 2 , + ) , u ̲ ( x , y , T 2 ) = u ( x , y , T 2 ) on  Ω ̄ .

By arguments similar to those in ref. [33], Lemmas 2.2 and 4.2], we conclude that w ϵ (⋅, ⋅, t) → z ϵ uniformly on Ω ̄ as t → +∞, where z ϵ is the unique positive steady state of system (4.7). Moreover, it follows from the standard elliptic regularity theory that limϵ→0z ϵ = z uniformly on Ω ̄ . By applying arguments similar to those presented above, we conclude

(4.8) lim inf t + u ( , , t ) θ 1 uniformly on  Ω ̄ .

Inequalities (4.6) and (4.8) imply that limt→+∞u(⋅, ⋅, t) = θ1 uniformly on Ω ̄ . Similarly, we deduce that limt→+∞S(⋅, ⋅, t) = zθ1 uniformly on Ω ̄ . The proof is completed. □

Theorems 3.73.11 and the corresponding Remarks imply that for all other parameters fixed, there exist semi-trivial steady states S p i , u p i , 0 for i = 1, …, k1, where k1 ≥ 1, if and only if p satisfies λ 1 p , f 1 ( z ) < 0 . Similarly, there exist semi-trivial steady states S q j , 0 , v q j for j = 1, …, k2, where k2 ≥ 1, if and only if q satisfies λ1(q, f2(z)) < 0. In particular, if q = 1 2 , then k1 = 1 and S p 1 , u p 1 , 0 = ( z θ 1 , θ 1 , 0 ) ; if p = 1 2 , then k2 = 1 and S q 1 , 0 , v q 1 = ( z θ 2 , 0 , θ 2 ) . Moreover, it follows from Lemma 3.6 that all of S p i , S q j < z on Ω ̄ . Hence, by Lemma 2.2(ii), λ 1 p , f 1 ( z ) < λ 1 p , f 1 S q j and λ 1 q , f 2 ( z ) < λ 1 q , f 2 S p i for any (p, q) ∈ [0, 1]2 and 1 ≤ ik1, 1 ≤ jk2.

Theorem 4.4.

Assume that λ 1 q , f 2 S p i < 0 for any i = 1, …, k1 and λ 1 p , f 1 S q j < 0 for any j = 1, …, k2. Then system (1.1)(1.3) is uniformly persistent in the sense that there exists σ > 0 such that the solution (S(x, y, t), u(x, y, t), v(x, y, t)) of system (1.1)(1.3) satisfying

lim inf t + S ( , , t ) σ , lim inf t + u ( , , t ) σ , and lim inf t + v ( , , t ) σ uniformly on Ω ̄ .

Proof.

This proof is similar to that of Theorem 3.4, so we only sketch it here. By the comparison principle for parabolic equations, Lemma 4.1 and [33], Lemmas 2.2 and 4.2], there exists σ1 > 0 such that lim inft→+∞S(⋅, ⋅, t) ≥ σ1. Let

P = ( S , u , v ) C ( Ω ̄ ) × C ( Ω ̄ ) × C ( Ω ̄ ) : S 0 , u 0 , v 0  on  Ω ̄ , P 0 = ( S , u , v ) P : u 0  and  v 0 , P 0 = P \ P 0 = ( S , u , v ) P : u 0  or  v 0 .

Define Ψ t as the solution semiflow generated by system (1.1)(1.3) on P, where Ψ t is compact and point dissipative. By [36], Theorem 2.6], we conclude that Ψ t has a global compact attractor that attracts each bounded set in P.

Set Θ S 0 , u 0 , v 0 . Define M Θ P 0 : Ψ t Θ P 0 , t 0 , and let ω Θ denote the omega limit set of the forward orbit γ + Θ Ψ t Θ : t 0 . It is easily observed that

Θ M ω Θ = ( z , 0,0 ) , S p i , u p i , 0 , S q j , 0 , v q j , i = 1 , , k 1  and  j = 1 , , k 2  with  k 1 , k 2 1 .

Similar to the proof of Theorem 3.4, we conclude by contradiction that if λ 1 p , f 1 ( z ) < 0 or λ 1 q , f 2 ( z ) < 0 , then (z, 0, 0) is a uniform weak repeller for P0. We now claim that if λ 1 q , f 2 S p 1 < 0 , then S p 1 , u p 1 , 0 is a uniform weak repeller for P0. That is, there exists δ1 > 0 such that for all (S0, u0, v0) ∈ P0,

lim sup t + Ψ t ( S 0 , u 0 , v 0 ) S p 1 , u p 1 , 0 δ 1 .

If not, then for any δ > 0, there exists (S0, u0, v0) ∈ P0 such that lim sup t + Ψ t ( S 0 , u 0 , v 0 ) S p 1 , u p 1 , 0 < δ . This implies that there exists T0 > 0 such that for t > T0,

(4.9) S ( , , t ) S p 1 < δ , u ( , , t ) u p 1 < δ , v ( , , t ) < δ .

By the continuity of function f1(S), we can choose ϵ > 0 small such that for all ( x , y ) Ω ̄ and tT0, f 1 ( S ) > f 1 S p 1 ϵ . Thus, we obtain

v t D 0 Δ v + f 1 S p 1 ϵ v in  Ω × ( T 0 , + ) .

In view of (S0, u0, v0) ∈ P0, it follows from the maximum principle that v(⋅, ⋅, T0) > 0. Hence, there exists κ > 0 such that v ( , , T 0 ) κ φ 1 q , f 2 S p 1 , where φ 1 q , f 2 S p 1 is the principal eigenfunction corresponding to the principal eigenvalue λ 1 q , f 2 S p 1 . Let v ̲ ( x , y , t ) = κ e λ 1 q , f 2 S p 1 + ϵ T 0 t φ 1 q , f 2 S p 1 for all ( x , y ) Ω ̄ and tT0. Then v ̲ satisfies

v ̲ t = D 0 Δ v ̲ + f 2 S p 1 ϵ v ̲ in  Ω × ( T 0 , + ) , D 0 v ̲ ν + b ( x , y ) v ̲ = 0 on  Ω × ( T 0 , + ) , v ̲ ( x , y , T 0 ) = κ φ 1 q , f 2 S p 1 on  Ω ̄ .

By the comparison principle for parabolic equations, we conclude that v ( x , y , t ) v ̲ ( x , y , t ) for all ( x , y ) Ω ̄ and tT0. Since λ 1 q , f 2 S p 1 < 0 , there exists a sufficiently small ϵ > 0 such that λ 1 q , f 2 S p 1 + ϵ < 0 . This implies that limt→+∞v(⋅, ⋅, t) = +∞, which contradicts (4.9). This claim is valid. Similarly, we deduce that if λ 1 q , f 2 S p i < 0 and λ 1 p , f 1 S q j < 0 for all i = 1, …, k1 and j = 1, …, k2 with k1, k2 ≥ 1, then all of S p i , u p i , 0 and S q j , 0 , v q j are uniform weak repellers for P0.

Define a continuous function D : P [ 0 , + ) by D ( S , u , v ) min Ω ̄ u ( x , y ) , min Ω ̄ v ( x , y ) for any (S, u, v) ∈ P. It is easy to see that D 1 ( 0 , + ) P 0 , and D satisfies that if D ( ( S , u , v ) ) > 0 or (S, u, v) ∈ P0 with D ( ( S , u , v ) ) = 0 , then D ( Ψ t ( S , u , v ) ) > 0 for all t > 0. Thus D is a generalized distance function for the semiflow Ψ t : PP [35].

Denote E E 0 i = 1 k 1 E p i j = 1 k 2 E q j , where E 0 = ( z , 0,0 ) , E p i = S p i , u p i , 0 and E q j = S q j , 0 , v q j . By arguments presented above, we conclude that all of the sets E 0 , E p i , E q j , where i = 1, …, k1 and j = 1, …, k2 with k1, k2 ≥ 1, are isolated in P. Moreover, the stable set W s ( E ) D 1 ( 0 , + ) = W s E p i D 1 ( 0 , + ) = W s E q j D 1 ( 0 , + ) = , where i = 1, …, k1 and j = 1, …, k2 with k1, k2 ≥ 1. Therefore, no subset of E forms a cycle in M . It follows from ref. [35], Theorem 3] that there exists σ2 > 0 such that

min ( S , u , v ) ω a ( ( S 0 , u 0 , v 0 ) ) D ( ( S , u , v ) ) > σ 2 ,

which implies that for any (S0, u0, v0) ∈ P0, lim inft→+∞u(⋅, ⋅, t) ≥ σ2 and lim inft→+∞v(⋅, ⋅, t) ≥ σ2 uniformly on Ω ̄ . Set σ = min σ 1 , σ 2 . This completes the proof. □

5 Further study on coexistence of the two-species model

In this section, we aim to further investigate the structure and stability of the positive steady states of system (1.1)(1.3). Hence, we focus on the positive solutions to the following steady-state system

(5.1) D 0 Δ S f 1 ( S ) u f 2 ( S ) v = 0 , D ( p ) u x x + D ( 1 p ) u y y + f 1 ( S ) u = 0 , D ( q ) v x x + D ( 1 q ) v y y + f 2 ( S ) v = 0 in  Ω , D 0 S ν + b ( x , y ) S = H ( x , y ) , ( D ( p ) u x , D ( 1 p ) u y ) ν + b ( x , y ) u = 0 , ( D ( q ) v x , D ( 1 q ) v y ) ν + b ( x , y ) v = 0 on  Ω .

It is easy to see that system (5.1) has the following three types nonnegative solutions.

  1. There always exists the trivial solution (z, 0, 0).

  2. There exists at least one semi-trivial solution of the form (S p , u p , 0), where S p > 0, u p > 0 on Ω ̄ , if and only if p satisfies λ1(p, f1(z)) < 0 with all other parameters fixed; see Theorems 3.73.9. Moreover, there exists at least one semi-trivial solution of the form (S q , 0, v q ), where S q > 0, v q > 0 on Ω ̄ , if and only if q satisfies λ1(q, f2(z)) < 0 with all other parameters fixed; see Theorem 3.11. In particular, (1) if p = 1 2 and 0 < D 0 < D 1 * , then the semi-trivial solution (S p , u p , 0) = (zθ1, θ1, 0) is unique; (2) if q = 1 2 and 0 < D 0 < D 2 * , then the semi-trivial solution (S q , 0, v q ) = (zθ2, 0, θ2) is unique.

  3. The existence of positive solutions (S, u, v), where S, u, v > 0 on Ω ̄ , is to be determined.

We can readily analyze the linear stability of (z, 0, 0), (zθ1, θ1, 0) and (zθ2, 0, θ2) using eigenvalue analysis.

Theorem 5.1.

The following statements is valid.

  1. (z, 0, 0) is linearly stable if λ1(p, f1(z)) > 0 and λ1(q, f2(z)) > 0, and it is unstable if λ1(p, f1(z)) < 0 or λ1(q, f2(z)) < 0; see Tables 1 and 2.

  2. Assume that p = 1 2 and 0 < D 0 < D 1 * . Then (zθ1, θ1, 0) is linearly stable if λ1(q, f2(zθ1)) > 0, and it is unstable if λ1(q, f2(zθ1)) < 0.

  3. Assume that q = 1 2 and 0 < D 0 < D 2 * . Then (zθ2, 0, θ2) is linearly stable if λ1(p, f1(zθ2)) > 0, and it is unstable if λ1(p, f1(zθ2)) < 0.

Proof.

The proof of part (i) is standard and omitted here. We present the proof for part (ii) only, as part (iii) follows similarly. Let w = zS. Then system (5.1) is equivalent to

(5.2) D 0 Δ w + f 1 ( z w ) u + f 2 ( z w ) v = 0 , D 0 Δ u + f 1 ( z w ) u = 0 , D ( q ) v x x + D ( 1 q ) v y y + f 2 ( z w ) v = 0 in  Ω , D 0 w ν + b ( x , y ) w = 0 , D 0 u ν + b ( x , y ) u = 0 , D ( q ) v x , D ( 1 q ) v y ν + b ( x , y ) v = 0 on  Ω .

Consider the following linearized eigenvalue problem for system (5.2) at (θ1, θ1, 0),

D 0 Δ ζ f 1 ' ( z θ 1 ) θ 1 ζ + f 1 ( z θ 1 ) η + f 2 ( z θ 1 ) ϑ + λ ζ = 0 , D 0 Δ η + f 1 ( z θ 1 ) η f 1 ' ( z θ 1 ) θ 1 ζ + λ η = 0 , D ( q ) ϑ x x + D ( 1 q ) ϑ y y + f 2 ( z θ 1 ) ϑ + λ ϑ = 0 in  Ω ,

subject to the homogeneous boundary conditions. Let χ = ζη. Then (ζ, χ, ϑ) satisfies

(5.3) D 0 Δ ζ f 1 ' ( z θ 1 ) θ 1 ζ + f 1 ( z θ 1 ) η + f 2 ( z θ 1 ) ϑ + λ ζ = 0 , D 0 Δ χ f 2 ( z θ 1 ) ϑ + λ χ = 0 , D ( q ) ϑ x x + D ( 1 q ) ϑ y y + f 2 ( z θ 1 ) ϑ + λ ϑ = 0 in  Ω

subject to the homogeneous boundary conditions. It is easy to see that λ is an eigenvalue of problem (5.3) if and only if λ is an eigenvalue of the following three operators,

I 1 D 0 Δ f 1 ( z θ 1 ) θ 1 , I 2 D 0 Δ , I 3 D ( q ) x x + D ( 1 q ) y y + f 2 ( z θ 1 ) .

It follows from the variational characterization of the principal eigenvalue (see, e.g., equation (2.2)) that the principal eigenvalues of I1 and I2 are positive. Moreover, the principal eigenvalue of I3 is equal to λ1(q, f2(zθ1)). This completes the proof. □

Then we derive a priori estimates for the positive solutions to system (5.1). The proof is similar to that of Lemma 3.6, we thus omit it here.

Lemma 5.2.

Assume that (S, u, v) is a nonnegative solution to system (5.1) with S ≢ 0, u ≢ 0 and v ≢ 0. Then

  1. λ1(p, f1(z)) < 0 and λ1(q, f1(z)) < 0;

  2. 0 < S < z, and there exist positive constants C u , C v such that 0 < u < C u and 0 < v < C v on Ω ̄ .

Next, by taking q as the bifurcation parameter, we derive the corresponding branches of positive solutions; see, e.g., [17], [43], [44], [45].

5.1 Local bifurcation and stability

We begin by examining the branch of positive solutions to system (5.1) that bifurcates from the semi-trivial branch Γ u = {(q, zθ1, θ1, 0) : q ∈ [0, 1]}. For technical reasons, we need to impose the following conditions.

  1. p = 1 2 and 0 < D 0 < D 1 * , which ensures that Γ u ≠ ∅.

  2. There exists q ̂ ( 0,1 ) such that λ 1 ( q ̂ , f 2 ( z θ 1 ) ) = 0 .

  3. F ( q ̂ ; f 2 ( z θ 1 ) ) 0 , where F is defined in (2.6).

Lemma 5.3.

Assume that (H1)–(H3) hold. Then there exists a C1 curve

Γ u ± = ( q ( s ) , S ( s ) , u ( s ) , v ( s ) ) : s ( s 1 , s 1 ) ,

such that ((q(s), S(s), u(s), v(s))) is a solution to system (5.1) for any s ∈ (−s1, s1), and the solution is positive for any s ∈ (0, s1), where

S ( s ) = z θ 1 s ( ζ 0 + W ( s ) ) , u ( s ) = θ 1 + s ( η 0 + U ( s ) )  and  v ( s ) = s ( ϑ 0 + V ( s ) ) .

Here,

q ( 0 ) = q ̂ , W ( 0 ) = 0 , U ( 0 ) = 0 , V ( 0 ) = 0  and  ( W ( s ) , U ( s ) , V ( s ) ) Z ,

where Z = {(W, U, V) ∈ X : ∫Ω0 = 0} with ϑ0 being a positive principal eigenfunction corresponding λ 1 ( q ̂ , f 2 ( z θ 1 ) ) , and (ζ0, η0) satisfies

D 0 Δ ζ 0 f 1 ' ( z θ 1 ) θ 1 ζ 0 + f 1 ( z θ 1 ) η 0 + f 2 ( z θ 1 ) ϑ 0 = 0 , D 0 Δ η 0 + f 1 ( z θ 1 ) η 0 f 1 ' ( z θ 1 ) θ 1 ζ 0 = 0 in  Ω , D 0 ζ 0 ν + b ( x , y ) ζ 0 = 0 , D 0 η 0 ν + b ( x , y ) η 0 = 0 on  Ω .

Remark 5.4.

The concavity of λ1(q, f2(zθ1)) with respect to q implies that there exist at most two bifurcation points of positive solutions bifurcating from the semi-trivial branch Γ u .

Proof of Lemma 5.3.

Let X = W 2 , r ( Ω ) 3 and Y = L r ( Ω ) 3 with r ∈ (1, ∞). Then W2,r(Ω) embeds compactly in C ( Ω ̄ ) . In system (5.2), w, u, v in the boundary condition are interpreted as the traces of w, u, vW2,r(Ω) on ∂Ω; see, e.g., [24], Theorem 1.6] and Remarks there. Define T : ( 0,1 ) × X Y × W 1 , r ( Ω ) 3 by

(5.4) T ( q , w , u , v ) = D 0 Δ w + f 1 ( z w ) u + f 2 ( z w ) v D 0 Δ u + f 1 ( z w ) u D ( q ) v x x + D ( 1 q ) v y y + f 2 ( z w ) v D 0 w ν + b ( x , y ) w D 0 u ν + b ( x , y ) u ( D ( q ) v x , D ( 1 q ) v y ) ν + b ( x , y ) v .

Let D(w,u,v)T(q, θ1, θ1, 0) be the Fréchet derivative of T(q, w, u, v) with respect to (w, u, v) at (θ1, θ1, 0). It is easy to see that D(w,u,v)T(q, θ1, θ1, 0) is a Fredholm operator with index zero.

Set D ( w , u , v ) T ( q ̂ , θ 1 , θ 1 , 0 ) ( ζ , η , ϑ ) = 0 with (ζ, η, ϑ) ≠ (0, 0, 0), i.e.,

D 0 Δ ζ f 1 ' ( z θ 1 ) θ 1 ζ + f 1 ( z θ 1 ) η + f 2 ( z θ 1 ) ϑ = 0 , D 0 Δ η + f 1 ( z θ 1 ) η f 1 ' ( z θ 1 ) θ 1 ζ = 0 , D ( q ̂ ) ϑ x x + D ( 1 q ̂ ) ϑ y y + f 2 ( z θ 1 ) ϑ = 0 in  Ω , D 0 ζ ν + b ( x , y ) ζ = 0 , D 0 η ν + b ( x , y ) η = 0 , D ( q ̂ ) ϑ x , D ( 1 q ̂ ) ϑ y ν + b ( x , y ) ϑ = 0 on  Ω ,

where the function f 1 ( z θ 1 ) = m 1 a 1 ( a 1 + z θ 1 ) 2 . Suppose ϑ ≡ 0 on Ω ̄ . Then (ζ, η) satisfies

D 0 Δ ζ f 1 ' ( z θ 1 ) θ 1 ζ + f 1 ( z θ 1 ) η = 0 , D 0 Δ η f 1 ' ( z θ 1 ) θ 1 ζ + f 1 ( z θ 1 ) η = 0 in  Ω , D 0 ζ ν + b ( x , y ) ζ = 0 , D 0 η ν + b ( x , y ) η = 0 on  Ω .

Let χ = ζη. Then χ satisfies

Δ χ = 0 in  Ω , D 0 χ ν + b ( x , y ) χ = 0 on  Ω .

The strong maximum principle implies that χ = 0, i.e., ζ = η on Ω ̄ . Hence, ζ satisfies

D 0 Δ ζ + f 1 ( z θ 1 ) f 1 ' ( z θ 1 ) θ 1 ζ = 0 in  Ω , D 0 ζ ν + b ( x , y ) ζ = 0 on  Ω .

It follows from Lemma 2.2(ii) and the equation for u in system (5.1) that

λ 1 1 2 , f 1 ( z θ 1 ) f 1 ( z θ 1 ) θ 1 > λ 1 1 2 , f 1 ( z θ 1 ) = 0 .

The general maximum principle [38] implies that ζ = η = 0 on Ω ̄ . This contradicts the condition (ζ, η, ϑ) ≠ (0, 0, 0). Hence, ϑ ≢ 0 on Ω ̄ . Moreover, based on the analysis above, we conclude that the operator

A D 0 Δ f 1 ( z θ 1 ) θ 1 f 1 ( z θ 1 ) f 1 ( z θ 1 ) θ 1 D 0 Δ + f 1 ( z θ 1 )

is invertible with the boundary conditions D0ζν + b(x, y)ζ = 0, D0ην + b(x, y)η = 0 on ∂Ω. Note that λ 1 ( q ̂ , f 2 ( z θ 1 ) ) = 0 . We then deduce that the kernel

N D ( w , u , v ) T q ̂ , θ 1 , θ 1 , 0 = span ζ 0 , η 0 , ϑ 0 ,

where ϑ0 is a positive principal eigenfunction of problem (2.1) with p = q ̂ , h = f2(zθ1), and (ζ0, η0) is the unique solution to

A ( ζ 0 , η 0 ) = ( f 2 ( z θ 1 ) ϑ 0 , 0 ) in  Ω , D 0 ζ 0 ν + b ( x , y ) ζ 0 = 0 , D 0 η 0 ν + b ( x , y ) η 0 = 0 on  Ω .

We next claim that the rangle of D ( w , u , v ) T ( q ̂ , θ 1 , θ 1 , 0 ) is

R ( D ( w , u , v ) T ( q ̂ , θ 1 , θ 1 , 0 ) ) = ζ * , η * , ϑ * , ξ 1 , ξ 2 , ξ 3 Y × W 1 , r ( Ω ) 3 : l ( ζ * , η * , ϑ * , ξ 1 , ξ 2 , ξ 3 ) = 0 ,

where l : Y × W 1 , r ( Ω ) 3 R is a linear functional in Y × W 1 , r ( Ω ) 3 * defined by

l ( ζ * , η * , ϑ * , ξ 1 , ξ 2 , ξ 3 ) = Ω ϑ * ϑ 0 Ω ξ 3 ϑ 0 .

In order to prove this claim, we need to consider the following problem

(5.5) D 0 Δ ζ f 1 ' ( z θ 1 ) θ 1 ζ + f 1 ( z θ 1 ) η + f 2 ( z θ 1 ) ϑ = ζ * , D 0 Δ η + f 1 ( z θ 1 ) η f 1 ' ( z θ 1 ) θ 1 ζ = η * , D ( q ̂ ) ϑ x x + D ( 1 q ̂ ) ϑ y y + f 2 ( z θ 1 ) ϑ = ϑ * in  Ω , D 0 ζ ν + b ( x , y ) ζ = ξ 1 , D 0 η ν + b ( x , y ) η = ξ 2 , D ( q ̂ ) ϑ x , D ( 1 q ̂ ) ϑ y ν + b ( x , y ) ϑ = ξ 3 on  Ω .

By arguments similar to those in the proof of Theorem 3.7, we conclude that the problem

D ( q ̂ ) ϑ x x + D ( 1 q ̂ ) ϑ y y + f 2 ( z θ 1 ) ϑ = ϑ * in  Ω , D ( q ̂ ) ϑ x , D ( 1 q ̂ ) ϑ y ν + b ( x , y ) ϑ = ξ 3 on  Ω

has a solution, denoted by ϑ1, if and only if ∫Ωϑ*ϑ0 − ∫∂Ωξ3ϑ0 = 0. It follows from the standard elliptic regularity theory that for any constant c < 0 and ξ1, ξ2W1,r(∂Ω), the problem

D 0 Δ ζ + c ζ = 0 , D 0 Δ η + c η = 0 in  Ω , D 0 ζ ν + b ( x , y ) ζ = ξ 1 , D 0 η ν + b ( x , y ) η = ξ 2 on  Ω

has a unique solution, denoted by (ζ1, η1). Substituting ϑ = ϑ1 into problem (5.5) and setting ζ ̃ = ζ ζ 1 , η ̃ = η η 1 , we obtain

(5.6) A ( ζ ̃ , η ̃ ) = ( g 1 , g 2 ) in  Ω , D 0 ζ ̃ ν + b ( x , y ) ζ ̃ = 0 , D 0 η ̃ ν + b ( x , y ) η = 0 ̃ on  Ω ,

where

g 1 = ζ * + f 1 ( z θ 1 ) θ 1 + c ζ 1 f 1 ( z θ 1 ) η 1 f 2 ( z θ 1 ) ϑ 1 , g 2 = η * + f 1 ( z θ 1 ) θ 1 ζ 1 + c f 1 ( z θ 1 ) η 1 .

Since the operator A is invertible with the boundary conditions D 0 ζ ̃ ν + b ( x , y ) ζ ̃ = 0 , D 0 η ̃ ν + b ( x , y ) η ̃ = 0 on ∂Ω, we conclude that for any ζ*, η* ∈ L r (Ω), ζ1, η1, ϑ1W2,r(Ω), problem (5.6) always have a unique solution. Therefore, ζ * , η * , ϑ * , ξ 1 , ξ 2 , ξ 3 Y × W 1 , r ( Ω ) 3 is in the range R D ( w , u , v ) T ( q ̂ , θ 1 , θ 1 , 0 ) if and only if ∫Ωϑ*ϑ0 − ∫∂Ωξ3ϑ0 = 0.

We then check the transversality condition

(5.7) D q ( w , u , v ) T ( q ̂ , θ 1 , θ 1 , 0 ) ( ζ 0 , η 0 , ϑ 0 ) R ( D ( w , u , v ) T ( q ̂ , θ 1 , θ 1 , 0 ) ) .

By direct computation, we have

D q ( w , u , v ) T ( q ̂ , θ 1 , θ 1 , 0 ) ( ζ 0 , η 0 , ϑ 0 ) = 0 0 ( D ̄ D ̲ ) ( ϑ 0 ) x x ( ϑ 0 ) y y 0 0 ( D ̄ D ̲ ) ( ϑ 0 ) x , ( ϑ 0 ) y ν ,

and

l D q ( w , u , v ) T ( q ̂ , θ 1 , θ 1 , 0 ) ( ζ 0 , η 0 , ϑ 0 ) = ( D ̄ D ̲ ) Ω ϑ 0 ( ϑ 0 ) x x ( ϑ 0 ) y y ( D ̄ D ̲ ) Ω ϑ 0 ( ϑ 0 ) x , ( ϑ 0 ) y ν = ( D ̄ D ̲ ) Ω ( ϑ 0 ) x 2 ( ϑ 0 ) y 2 .

If F ( q ̂ ; f 2 ( z θ 1 ) ) 0 , then

l D p ( w , u ) T q ̂ , θ 1 , θ 1 , 0 ζ 0 , η 0 , ϑ 0 0 .

This implies that the transversality condition is satisfied.

Let

Z = ( W , U , V ) X : Ω V ϑ 0 = 0 .

Then span ( ζ 0 , η 0 , ϑ 0 ) Z = X . By applying the standard bifurcation theorem from a simple eigenvalue [40], we conclude that there exist s1 > 0 and C1 curve

q ( s ) , W ( s ) , U ( s ) , V ( s ) : s 1 , s 1 R × Z ,

such that (i) q ( 0 ) = q ̂ , (ii) W(0) = 0, U(0) = 0, V(0) = 0, (iii) T q ( s ) , w ( s ) , u ( s ) , v ( s ) = 0 for |s| < s1, where

q ( s ) , w ( s ) , u ( s ) , v ( s ) = q ( s ) , θ 1 + s ( ζ 0 + W ( s ) ) , θ 1 + s ( η 0 + U ( s ) ) , s ( ϑ 0 + V ( s ) ) .

Let S(s) = zw(s) = zθ1s(ζ0 + W(s)). Noting that ϑ0 > 0 on Ω ̄ , we conclude that the bifurcation branch

Γ u + = q ( s ) , S ( s ) , u ( s ) , v ( s ) : 0 < s < s 1

is exactly the positive solution to system (5.1). The non-trivial nonnegative solutions to system (5.1) near ( q ̂ , z θ 1 , θ 1 , 0 ) lie on either the branch {(q, zθ1, θ1, 0) : q ∈ [0, 1]} or the branch Γ u + . This completes the proof. □

We then investigate the linear stability of the bifurcation solution near the bifurcation point ( q ̂ , z θ 1 , θ 1 , 0 ) .

Lemma 5.5.

Assume that (H1)–(H3) hold. If Ω f 2 ( z θ 1 ) ζ 0 ϑ 0 2 > 0 , then the bifurcation solutions to system (5.1) that lie on the local branch Γ u + are linearly stable.

Proof.

According to the proof of Lemma 5.3, it is clear that 0 is an I Y -simple eigenvalue of D ( w , u , v ) T ( q ̂ , θ 1 , θ 1 , 0 ) , where the map I Y : X Y × W 1 , r ( Ω ) 3 is defined by I Y (ζ, η, ϑ) = (ζ, η, ϑ, 0, 0, 0). Then by [41], Corollary 1.13], there exist continuously differentiable functions

q ( ρ ( q ) , u ( q ) ) , s ( ϱ ( s ) , v ( s ) )

defined on the eighborhoods of q ̂ and 0, respectively, mapping onto R × X , such that

ρ ( q ̂ ) = 0 , u ( q ̂ ) = ( ζ 0 , η 0 , ϑ 0 ) , ϱ ( 0 ) = 0 , v ( 0 ) = ( ζ 0 , η 0 , ϑ 0 ) ,

and

D ( w , u , v ) T ( q , θ 1 , θ 1 , 0 ) u ( q ) = ( ρ ( q ) u ( q ) , 0 ) for  q ̂ 1 2 1 , D ( w , u , v ) T ( q ( s ) , w ( s ) , u ( s ) , v ( s ) ) v ( s ) = ( ϱ ( s ) v ( s ) , 0 ) for  | s | 1 .

It follows from ref. [41], Theorem 1.16] that ρ ( q ̂ ) 0 and ϱ(s) has the same sign with s q ( s ) ρ ( q ̂ ) if ϱ(s) ≠ 0 and |s| ≪ 1.

Noting that u(q) = (ζ(q), η(q), ϑ(q)) satisfies

(5.8) D 0 Δ ζ ( q ) f 1 ' ( z θ 1 ) θ 1 ζ ( q ) f 1 ( z θ 1 ) η ( q ) + f 2 ( z θ 1 ) ϑ ( q ) = ρ ( q ) ζ ( q ) , D 0 Δ η ( q ) + f 1 ( z θ 1 ) η ( q ) + f 1 ' ( z θ 1 ) θ 1 ζ ( q ) = ρ ( q ) η ( q ) , D ( q ) ϑ ( q ) x x + D ( 1 q ) ϑ ( q ) y y + f 2 ( z θ 1 ) ϑ ( q ) = ρ ( q ) ϑ ( q ) in  Ω , D 0 ζ ( q ) ν + b ( x , y ) ζ ( q ) = 0 , D 0 η ( q ) ν + b ( x , y ) η ( q ) = 0 , D ( q ) ϑ ( q ) x , D ( 1 q ) ϑ ( q ) y ν + b ( x , y ) ϑ ( q ) = 0 on  Ω ,

we have ϑ(q) > 0 for | q q ̂ | 1 since ϑ ( q ̂ ) = ϑ 0 > 0 on Ω ̄ . Hence, ρ(q) is the principal eigenvalue of the third equation in (5.8), i.e., ρ(q) = −λ1(q, f2(zθ1)) when | q q ̂ | 1 . Recalling equation (2.4), we conclude that

ρ ( q ̂ ) = λ 1 ( q , f 2 ( z θ 1 ) ) q q = q ̂ = ( D ̄ D ̲ ) F ( q ̂ ; f 2 ( z θ 1 ) ) 0 .

Then we compute q′(0) by the formula [46], equation (4.5)],

q ( 0 ) = l , D ( w , u , v ) 2 T ( q ̂ , θ 1 , θ 1 , 0 ) ( ζ 0 , η 0 , ϑ 0 ) , ( ζ 0 , η 0 , ϑ 0 ) 2 l , D q ( w , u , v ) T ( q ̂ , θ 1 , θ 1 , 0 ) ( ζ 0 , η 0 , ϑ 0 ) ,

where l : Y × W 1 , r ( Ω ) 3 R is a linear functional in Y × W 1 , r ( Ω ) 3 * (see the proof of Lemma 5.3) defined by

l ( ζ * , η * , ϑ * , ξ 1 , ξ 2 , ξ 3 ) = Ω ϑ * ϑ 0 Ω ξ 3 ϑ 0 .

To this end, we compute

D ( w , u , v ) 2 T ( q ̂ , θ 1 , θ 1 , 0 ) ( ζ 0 , η 0 , ϑ 0 ) , ( ζ 0 , η 0 , ϑ 0 ) = f 1 ( z θ 1 ) θ 1 ζ 0 2 2 f 1 ( z θ 1 ) ζ 0 η 0 2 f 2 ( z θ 1 ) ζ 0 ϑ 0 f 1 ( z θ 1 ) θ 1 ζ 0 2 2 f 1 ( z θ 1 ) ζ 0 η 0 2 f 2 ( z θ 1 ) ζ 0 ϑ 0 0 0 0 .

Hence, we have

q ( 0 ) = Ω f 2 ( z θ 1 ) ζ 0 ϑ 0 2 ( D ̄ D ̲ ) Ω ( ϑ 0 ) x 2 ( ϑ 0 ) y 2 .

The denominator on the right-hand side of this equation has the same sign as F ( q ̂ ; f 2 ( z θ 1 ) ) . Under the assumption that Ω f 2 ( z θ 1 ) ζ 0 ϑ 0 2 > 0 , we conclude that for 0 < s ≪ 1,

  1. if F ( q ̂ ; f 2 ( z θ 1 ) ) > 0 , then ρ q ̂ < 0 and q′(s) < 0, which implies ϱ(s) < 0;

  2. if F ( q ̂ ; f 2 ( z θ 1 ) ) < 0 , then ρ q ̂ > 0 and q′(s) > 0, which implies ϱ(s) < 0.

Therefore, the bifurcation solutions to system (5.1) that lie on the local branch Γ u + are linearly stable. □

Similarly, we conclude that there is a branch of positive solutions to system (5.1) bifurcating from the semi-trivial branch Γ v = {(p, zθ2, 0, θ2): p ∈ [0, 1]}. For technical reasons, we need to impose the following additional conditions.

  1. q = 1 2 and 0 < D 0 < D 2 * , which ensures that Γ v ≠ ∅.

  2. There exists p ̂ ( 0,1 ) such that λ 1 ( p ̂ , f 1 ( z θ 2 ) ) = 0 .

  3. F ( p ̂ ; f 1 ( z θ 2 ) ) 0 , where F is defined in (2.6).

Lemma 5.6.

Assume that (H1*)–(H3*) hold. Then there exists a C1 curve

Γ v ± = { ( p ( s ) , S ( s ) , u ( s ) , v ( s ) ) : s ( s 2 , s 2 ) } ,

such that ((p(s), S(s), u(s), v(s))) is a solution to system (5.1) for any s ∈ (−s2, s2), and the solution is positive for any s ∈ (0, s2), where

S ( s ) = z θ 2 s ( ζ ̂ 0 + W ̂ ( s ) ) , u ( s ) = s ( η ̂ 0 + U ̂ ( s ) )  and  v ( s ) = θ 2 + s ( ϑ ̂ 0 + V ̂ ( s ) ) .

Here,

p ( 0 ) = p ̂ , W ̂ ( 0 ) = 0 , U ̂ ( 0 ) = 0 , V ̂ ( 0 ) = 0  and  ( W ̂ ( s ) , U ̂ ( s ) , V ̂ ( s ) ) Z ̂ ,

where Z ̂ = { ( W ̂ , U ̂ , V ̂ ) X : Ω U ̂ η ̂ 0 = 0 } with η ̂ 0 being a positive principal eigenfunction corresponding λ 1 ( p ̂ , f 1 ( z θ 2 ) ) , and ( ζ ̂ 0 , ϑ ̂ 0 ) satisfies

D 0 Δ ζ ̂ 0 f 2 ' ( z θ 2 ) θ 2 ζ ̂ 0 + f 2 ( z θ 2 ) ϑ ̂ 0 + f 1 ( z θ 2 ) η ̂ 0 = 0 , D 0 Δ ϑ ̂ 0 + f 2 ( z θ 2 ) ϑ ̂ 0 f 2 ' ( z θ 2 ) θ 2 ζ ̂ 0 = 0 in  Ω , D 0 ζ ̂ 0 ν + b ( x , y ) ζ ̂ 0 = 0 , D 0 ϑ ̂ 0 ν + b ( x , y ) ϑ ̂ 0 = 0 on  Ω .

Moreover, if Ω f 1 ( z θ 2 ) ζ ̂ 0 η ̂ 0 2 > 0 , then the bifurcation solutions to system (5.1) that lie on the local branch Γ v + = ( p ( s ) , S ( s ) , u ( s ) , v ( s ) ) Γ v ± : s ( 0 , s 2 ) are linearly stable.

Remark 5.7.

The concavity of λ1(p, f1(zθ2)) with respect to p implies that there exist at most two bifurcation points of positive solutions bifurcating from the semi-trivial branch Γ v .

5.2 Global bifurcation

In this subsection, we extend the local solution branches Γ u + and Γ v + in Lemmas 5.3 and 5.6 by applying the global bifurcation results for Fredholm operators.

Initially, we extend the local solution branches Γ u + . Before proceeding, we first introduce a few additional assumptions. Consider

f 1 ( z ) f 2 ( z ) = m 1 a 1 z ( a 1 + z ) ( a 2 + z ) m 1 m 2 z m 1 a 1 + a 2 a 1 m 2 m 1 .

It is easy to see that if one of the following condition holds, then f1(z) ≤, ≢f2(z) on Ω ̄ .

  1. m 1 > m 2 , a 2 a 1 < m 2 m 1 , 0 < z , m 2 a 1 m 1 a 2 m 1 m 2 on Ω ̄ .

  2. m 1 = m 2 , a 2 a 1 < m 2 m 1 .

  3. m 1 < m 2 , a 2 a 1 m 2 m 1 .

  4. m 1 < m 2 , a 2 a 1 > m 2 m 1 , z , m 2 a 1 m 1 a 2 m 1 m 2 on Ω ̄ .

We now present two additional conditions.

  1. max q [ 0,1 ] λ 1 ( q , f 2 ( z ) ) = λ 1 q m , f 2 ( z ) 0 .

  2. (1) m1 = m2, a1 > a2; or (2) m1 < m2, a 2 a 1 m 2 m 1 .

Here, (H5) implies that f1(h) < f2(h) for any h > 0 on Ω ̄ . Define

ϒ q = ( q , S , u , v ) R × X : S > 0 , u > 0 , v > 0 , ( q , S , u , v )  satisfies system  ( 5.1 )  with  p = 1 2 .

Theorem 5.8.

Assume that (H1)–(H5) hold. If (i) q ̂ 1 2 and F ( q ̂ ; f 2 ( z θ 1 ) ) > 0 , or (ii) q ̂ 1 2 and F ( q ̂ ; f 2 ( z θ 1 ) ) < 0 , then there exists a continuum C q * of ϒ q bifurcating from Γ u at ( q ̂ , z θ 1 , θ 1 , 0 ) and meeting another semi-trivial branch ( q , S q , 0 , v q ) : λ 1 ( q , f 2 ( z ) ) < 0 at the point ( q ̃ , S q ̃ , 0 , v q ̃ ) , where q ̃ satisfies λ 1 1 2 , f 1 ( S q ̃ ) = 0 . In particular, system (5.1) has at least one positive solution for any q between q ̂ and q ̃ .

Proof.

In view of ref. [40], Theorem 3.3], we conclude that for any (q, w, u, v) ∈ (0, 1) × X, the Fréchet derivative D(w,u,v)T(q, w, u, v) is a Fredholm operator with index zero; recall (5.4) for the definition of operator T. Moreover, T : ( 0,1 ) × X Y × W 1 , r ( Ω ) 3 is C1 smooth. Similar to the definition in ref. [42], Theorem 1.2], let C ̃ q be the component of the set of nontrivial solutions to T(q, w, u, v) = 0 with ( q ̂ , θ 1 , θ 1 , 0 ) C ̃ q . Set

C q = ( q , S , u , v ) : S = z w , ( q , w , u , v ) C ̃ q .

Let C q + be the connected component of C q \ { ( q ( s ) , S ( s ) , u ( s ) , v ( s ) ) : s 1 < s < 0 } . Then Γ u + C q + . It follows from ref. [42], Theorem 1.2] that C q + satisfies one of the following alternatives:

  1. it is not compact in (0, 1) × X;

  2. it contains a point ( q ̃ , z θ 1 , θ 1 , 0 ) with q ̃ q ̂ ;

  3. it contains a point (q, zθ1 + W, θ1 + U, V), where (W, U, V) ≢ (0, 0, 0) and (W, U, Z) ∈ Z.

We set

X + = ( S , u , v ) X : S > 0 , u > 0 , v > 0  on  Ω ̄ .

Consequently, C q ( ( 0,1 ) × X + ) . Let C q * = C q ( ( 0,1 ) × X + ) . Then C q * consists of the local positive solution branch Γ u + near the bifurcation point ( q ̂ , z θ 1 , θ 1 , 0 ) and C q * C q + .

Suppose (iii) holds. For any ( q , z θ 1 + W , θ 1 + U , V ) C q + with (W, U, V) ≢ (0, 0, 0), we have ( q , z θ 1 + W , θ 1 + U , V ) C q * , which implies that V > 0 on Ω ̄ . Hence, ∫Ω0 > 0, which contradicts (W, U, V) ∈ Z.

Suppose (ii) holds. Then we may construct a sequence { ( q n , S n , u n , v n ) } C q * converging to ( q ̃ , z θ 1 , θ 1 , 0 ) in ( 0,1 ) × X + ̄ . By the equation for v n in system (5.1), we have λ1(q n , f2(S n )) = 0. Letting n → ∞, we get λ 1 ( q ̃ , f 2 ( z θ 1 ) ) = 0 by continuity. (H2) implies that λ 1 ( q ̂ , f 2 ( z θ 1 ) ) = 0 . Without loss of generality, we assume q ̂ < q ̃ . It follows from Lemma 2.1 that λ1(q, f2(zθ1)) ≤ 0 for all q [ 0,1 ] \ ( q ̂ , q ̃ ) . Note that maxq∈[0,1]λ1(q, f2(z)) = λ1(qm, f2(z)) ≥ 0 and λ1(q, f2(z)) < λ1(q, f2(zθ1)) ≤ 0 for all q [ 0,1 ] \ ( q ̂ , q ̃ ) ; see Lemma 2.2(ii) and (H4). From this, we deduce that q m ( q ̂ , q ̃ ) . However, Lemma 5.2(i) implies that if λ1(qm, f2(z)) ≥ 0, then system (5.1) has no nonnegative solution (S, u, v) such that ( q m , S , u , v ) C q * . Hence, the component C q + cannot connect ( q ̂ , z θ 1 , θ 1 , 0 ) and ( q ̃ , z θ 1 , θ 1 , 0 ) in (0, 1) × X, meaning that ( q ̃ , z θ 1 , θ 1 , 0 ) C q + . Thus, (ii) can not occur.

The alternative (i) for C q + is equivalent to “the closure of C q + intersects ∂((0, 1) × X+) or is unbounded in norm of (0, 1) × X+”; see, e.g., the proof of ref. [40], Theorem 4.7]. It follows from Lemma 5.2 and the standard elliptic regularity theory that any positive solution (S, u, v) to system (5.1) is bounded in X+ uniformly for all q ∈ [0, 1]. Thus, (i) implies that there exists a point ( q ̃ , S ̃ , u ̃ , v ̃ ) ( C q * ̄ \ { ( q ̂ , z θ 1 , θ 1 , 0 ) } ) ( ( 0,1 ) × X + ) , which is the limit of a sequence { ( q n , S n , u n , v n ) } C q * .

We only consider the case where q ̂ 1 2 and F ( q ̂ ; f 2 ( z θ 1 ) ) > 0 , i.e., λ 1 ( q , f 2 ( z θ 1 ) ) q | q = q ̂ > 0 . The same analytical framework can be applied to other cases. In view of Lemma 2.1 and (H4), λ1(q, f2(z)) attains a unique maximum at a point q m ( q ̂ , 1 ] such that λ1(qm, f2(z)) ≥ 0. However, Lemma 5.2(i) implies that if λ1(qm, f2(z)) ≥ 0, then system (5.1) has no nonnegative solution (S, u, v) such that ( q m , S , u , v ) C q * . Hence, we conclude that the component C q + cannot intersect with the plane ( 1 , S , u , v ) : S , u , v > 0  on  Ω ̄ . Thus, ( q ̃ , S ̃ , u ̃ , v ̃ ) ( ( 0,1 ) × X + ) implies that

  1. S ̃ 0 and S ̃ ( x 0 , y 0 ) = 0 for a point ( x 0 , y 0 ) Ω ̄ ; or

  2. u ̃ 0 and u ̃ ( x 1 , y 1 ) = 0 for a point ( x 1 , y 1 ) Ω ̄ ; or

  3. v ̃ 0 and v ̃ ( x 2 , y 2 ) = 0 for a point ( x 2 , y 2 ) Ω ̄ ; or

  4. q ̃ = 0 and S ̃ > 0 , u ̃ > 0 , v ̃ > 0 on Ω ̄ , i.e., ( S ̃ , u ̃ , v ̃ ) X + .

It follows from the strong maximum principle that S ̃ > 0 on Ω ̄ . Hence, (1) is impossible.

(4) implies that the bifurcation branch C q + meet the plane { ( 0 , S , u , v ) : S , u , v > 0  on  Ω ̄ } at the point ( 0 , S ̃ , u ̃ , v ̃ ) as q → 0. By the equations for u and v in system (5.1), we have λ 1 1 2 , f 1 ( S ) = λ 1 ( 0 , f 2 ( S ) ) = 0 . In view of Lemma 2.2(ii) and (H5), we have λ 1 1 2 , f 2 ( S ) < λ 1 1 2 , f 1 ( S ) = 0 . It follows from Lemma 5.2(ii) and (H4) that λ1(qm, f2(S)) > λ1(qm, f2(z)) ≥ 0. By the concavity of λ1(q, f2(S)) with respect to q on [0, 1], we deduce that 0 < q m < 1 2 . However, in the case where q ̂ 1 2 and F ( q ̂ ; f 2 ( z θ 1 ) ) > 0 , i.e., λ 1 ( q , f 2 ( z θ 1 ) ) q | q = q ̂ > 0 , noting that λ1(qm, f2(zθ1)) > λ1(qm, f2(z)) ≥ 0, we deduce q m > q ̂ 1 2 , which is a contradiction.

By applying the strong maximum principle again, we conclude that (2) and (3) imply u ̃ 0 or v ̃ 0 , which leads to the following three alternatives: (a) ( S ̃ , u ̃ , v ̃ ) = ( z , 0,0 ) ; (b) ( S ̃ , u ̃ , v ̃ ) = ( z θ 1 , θ 1 , 0 ) ; (c) ( S ̃ , u ̃ , v ̃ ) = ( S q ̃ , 0 , v q ̃ ) .

Suppose ( S ̃ , u ̃ , v ̃ ) = ( z , 0,0 ) . Then the sequence {(q n , S n , u n , v n )} satisfies q n q ̃ and (S n , u n , v n ) → (z, 0, 0) in X as n → ∞. By the equation for u n in system (5.1), we have λ 1 1 2 , f 1 ( S n ) = 0 . Letting n → ∞, we get λ 1 1 2 , f 1 ( z ) = 0 by continuity. In view of Lemma 2.3 and (H1), we have λ 1 1 2 , f 1 ( z ) < 0 , a contradiction.

Suppose ( S ̃ , u ̃ , v ̃ ) = ( z θ 1 , θ 1 , 0 ) . Then using similar arguments as those in the analysis of case (ii), we obtain that λ 1 ( q ̃ , f 2 ( z θ 1 ) ) = 0 and if q ̃ q ̂ , then ( q ̃ , z θ 1 , θ 1 , 0 ) C q + , which leads to a contradiction.

The remainning possibility is ( S ̃ , u ̃ , v ̃ ) = ( S q ̃ , 0 , v q ̃ ) , which implies that the global bifurcation branch C q + meet another semi-trivial branch ( q , S q , 0 , v q ) : λ 1 ( q , f 2 ( z ) ) < 0 at the point ( q ̃ , S q ̃ , 0 , v q ̃ ) , where q ̃ satisfies λ 1 1 2 , f 1 ( S q ̃ ) = 0 . This completes the proof. □

Remark 5.9.

Theorem 5.8 implies that ( q ̃ , S q ̃ , 0 , v q ̃ ) is a bifurcation point from the semi-trivial branch ( q , S q , 0 , v q ) : λ 1 ( q , f 2 ( z ) ) < 0 .

Similarly, we extend the local solution branches Γ v + . For technical reasons, we need to impose the following additional conditions.

  1. max p [ 0,1 ] λ 1 ( p , f 1 ( z ) ) = λ 1 p m , f 1 ( z ) 0 .

  2. (1) m1 = m2, a1 < a2; or (2) m1 > m2, a 2 a 1 m 2 m 1 .

Here, (H5*) implies that f1(h) < f2(h) for any h > 0 on Ω ̄ . Define

ϒ p = ( p , S , u , v ) R × X : S > 0 , u > 0 , v > 0 , ( p , S , u , v )  satisfies system  ( 5.1 )  with  q = 1 2 .

Theorem 5.10.

Assume that (H1*)–(H5*) hold. Then if (i) p ̂ 1 2 and F ( p ̂ ; f 1 ( z θ 2 ) ) > 0 , or (ii) p ̂ 1 2 and F ( p ̂ ; f 1 ( z θ 2 ) ) < 0 , then there exists a continuum C p * of ϒ p bifurcating from Γ u at ( p ̂ , z θ 2 , 0 , θ 2 ) and meeting another semi-trivial branch ( p , S p , u p , 0 ) : λ 1 ( p , f 1 ( z ) ) < 0 at the point ( p ̃ , S p ̃ , u p ̃ , 0 ) , where p ̃ satisfies λ 1 1 2 , f 2 ( S p ̃ ) = 0 . In particular, system (5.1) has at least one positive solution for any p between p ̂ and p ̃ .

Remark 5.11.

Theorem 5.10 implies that ( p ̃ , S p ̃ , u p ̃ , 0 ) is a bifurcation point from the semi-trivial branch ( p , S p , u p , 0 ) : λ 1 ( p , f 1 ( z ) ) < 0 .

6 Numerical simulation

We perform numerical experiments in this section to enhance the qualitative understanding of the results and to gain further insights. The computations are primarily executed with FreeFEM++, an open-source finite element software [47]. We first assume that the domain Ω is fixed and defined as a disk of radius 2 centered at the origin. Specifically, ∂Ω = {(x, y) : x = 2 cos θ, y = 2 sin θ, θ ∈ [0, 2π)}. Moreover, we assume that

Γ b = ( x , y ) Ω : x = 2 cos θ , y = 2 sin θ , θ π 4 , π 4 , Γ H = ( x , y ) Ω : x = 2 cos θ , y = 2 sin θ , θ 3 π 4 , 5 π 4 .

For x = 2 cos θ, y = 2 sin θ, we take

b ( x , y ) = 1 2 1 + cos 4 θ , ( x , y ) Γ b , 0 , ( x , y ) Ω \ Γ b , H ( x , y ) = 3 2 1 + cos 4 θ , ( x , y ) Γ H , 0 , ( x , y ) Ω \ Γ H .

6.1 The principal eigenvalue

We first consider λ1(p, f1(z)), which is the principal eigenvalue of problem (2.1) with h = f1(z). The parameter values are given in this subsection as follows

D ̲ = 0.1 , D ̄ = 10 , a 1 = 5 .

Figure 2 displays numerical results for the principal eigenvalue λ1(p, f1(z)), where p ∈ [0, 1] and m1 = 0.2, 0.25, 0.3. From this figure, we observe that λ1(p, f1(z)) is a concave function with respect to p. Moreover, for all p ∈ [0, 1], λ1(p, f1(z)) decreases uniformly as m1 increases. This observation aligns with the conclusions of Lemmas 2.1 and 2.2(ii).

Figure 2: 
The principal eigenvalue λ1(p, f1(z)), where p ∈ [0, 1] and m1 = 0.2, 0.25, 0.3.
Figure 2:

The principal eigenvalue λ1(p, f1(z)), where p ∈ [0, 1] and m1 = 0.2, 0.25, 0.3.

6.2 The two-species model

Now we investigate system (1.1)(1.3). In this subsection, we fix the parameter values as follows

D ̲ = 0.1 , D ̄ = 10 , m 1 = 0.2 , m 2 = 0.3 , a 1 = 4 , a 2 = 5 , S 0 = 0 , u 0 = 3 , v 0 = 3 .

Figure 3 displays numerical results for the evolution of S ( , , t ) L ( Ω ) , u ( , , t ) L ( Ω ) and v ( , , t ) L ( Ω ) for system (1.1)(1.3), where (p, q) = (0.7, 0.05), (0.7, 0.5), (0.15, 0.5), (0.0948, 1). In both subfigures (a)–(b), v ( , , t ) L ( Ω ) reaches a steady state, while u ( , , t ) L ( Ω ) diminishes asymptotically to zero. By comparing subfigures (a)–(b), we observe that when (p, q) = (0.7, 0.05), the value of v ( , , t ) L ( Ω ) at equilibrium is significantly higher than when (p, q) = (0.7, 0.5). This suggests that as the anisotropic diffusion of the surviving population v becomes stronger, the population distribution tends to become more concentrated. This implies that anisotropic diffusion may benefit the survival of the population. In subfigure (c), u ( , , t ) L ( Ω ) reaches a steady state, while v ( , , t ) L ( Ω ) gradually approaches zero. In subfigure (d), both curves progressively stabilize to steady states. The numerical simulations shown in Figure 3 have the same parameters except for the diffusion strategies (p, q). This indicates that variations in the diffusion strategies can have complex and diverse effects on the dynamics of system (1.1)(1.3).

Figure 3: 
The evolution of 


‖
S

(

⋅
,
⋅
,
t

)



‖




L


∞



(

Ω

)




${\Vert}S\left(\cdot ,\cdot ,t\right){{\Vert}}_{{L}^{\infty }\left({\Omega}\right)}$


, 


‖
u

(

⋅
,
⋅
,
t

)



‖




L


∞



(

Ω

)




${\Vert}u\left(\cdot ,\cdot ,t\right){{\Vert}}_{{L}^{\infty }\left({\Omega}\right)}$


 and 


‖
v

(

⋅
,
⋅
,
t

)



‖




L


∞



(

Ω

)




${\Vert}v\left(\cdot ,\cdot ,t\right){{\Vert}}_{{L}^{\infty }\left({\Omega}\right)}$


 for system (1.1)–(1.3), where (p, q) = (0.7, 0.05), (0.7, 0.5), (0.15, 0.5), (0.0948, 1). The thicker parts of the curves in this figure are caused by dense oscillations.
Figure 3:

The evolution of S ( , , t ) L ( Ω ) , u ( , , t ) L ( Ω ) and v ( , , t ) L ( Ω ) for system (1.1)(1.3), where (p, q) = (0.7, 0.05), (0.7, 0.5), (0.15, 0.5), (0.0948, 1). The thicker parts of the curves in this figure are caused by dense oscillations.

Figure 4 depicts the spatiotemporal dynamics of (S, u, v) for system (1.1)(1.3). The simulation parameters are identical to those in Figure 3(d). The figure shows points on the curves in Figure 3(d) in the xy plane. It can be observed from the figure that the diffusion patterns of the two populations are not identical. Furthermore, based on Figures 3(d) and 4, it can be observed that the single-directional diffusion strategy leads to the aggregation of the population within localized regions. This suggests that anisotropic diffusion provides more possibilities for species coexistence.

Figure 4: 
The solution (S, u, v) for system (1.1)–(1.3) at different moments, where (p, q) = (0.0948, 1).
Figure 4:

The solution (S, u, v) for system (1.1)(1.3) at different moments, where (p, q) = (0.0948, 1).

Then we further study the steady states of system (1.1)(1.3). All parameters remain unchanged except for (p, q). Figure 5 displays numerical results for the bifurcation diagrams of steady states for system (1.1)(1.3), where q = 0.5 and the bifurcation parameter p ranging from 0 to 1. This figure shows that when q = 0.5 and p ∈ [0, 1]\[0.13, 0.18], the two populations undergo competitive exclusion, whereas when q = 0.5, p ∈ (0.13, 0.18), both populations coexist. By comparing the values m 1 a 1 < m 2 a 2 , it is clear that the population u has lower survival capability than v. However, when p takes smaller values, the population u can still survive as one of the competitors in competitive exclusion or coexist with the population v. This once again demonstrates that anisotropic diffusion introduces a rich variety of changes to the dynamics behavior of this system.

Figure 5: 
Bifurcation diagrams of steady states for system (1.1)–(1.3), where q = 0.5 and p ∈ [0, 1].
Figure 5:

Bifurcation diagrams of steady states for system (1.1)(1.3), where q = 0.5 and p ∈ [0, 1].

6.3 The rectangular model

Finally, we present numerical simulations for some scenarios with Ω = [0, 1]2, a setting that has not yet been addressed in the theoretical analysis. These simulations could be valuable in guiding future research and exploration.

For ease of comparison, the parameters used in Figures 6 and 7, except for Ω, b, H, are the identical to those employed in the previous numerical simulations. Here, we first assume that

Γ ̂ b = ( x , y ) Ω : x = 1,0 y 1 , Γ ̂ H = ( x , y ) Ω : x = 0,0 y 1 .

Take

b ( x , y ) = 1 2 1 + cos ( 2 y 1 ) π , ( x , y ) Γ ̂ b , 0 , ( x , y ) Ω \ Γ ̂ b , H ( x , y ) = 3 2 1 + cos ( 2 y 1 ) π , ( x , y ) Γ ̂ H , 0 , ( x , y ) Ω \ Γ ̂ H .
Figure 6: 
The solution (S, u, v) for system (1.1)–(1.3) at different moments, where (p, q) = (0.0948, 1).
Figure 6:

The solution (S, u, v) for system (1.1)(1.3) at different moments, where (p, q) = (0.0948, 1).

Figure 7: 
The solution (S, u, v) for system (1.1)–(1.3) at different moments, where (p, q) = (0.0948, 1).
Figure 7:

The solution (S, u, v) for system (1.1)(1.3) at different moments, where (p, q) = (0.0948, 1).

Figure 6 displays the spatiotemporal dynamics of (S, u, v) obtained under the prescribed parameter setting. We find that the system appears to reach equilibrium more quickly. However, unlike the case when Ω is a disk, both populations u and v tend to approach very small values, which seems to suggest that both populations may eventually go extinct.

We then consider another scenario where

Γ ̃ b 1 = ( x , y ) Ω : x = 1,0 y 1 , Γ ̃ b 2 = ( x , y ) Ω : 0 x 1 , y = 1 , Γ ̃ H 1 = ( x , y ) Ω : x = 0,0 y 1 , Γ ̃ H 2 = ( x , y ) Ω : 0 x 1 , y = 0 .

Take

b ( x , y ) = 1 2 1 + cos ( 2 y 1 ) π , ( x , y ) Γ ̃ b 1 , 1 2 1 + cos ( 2 x 1 ) π , ( x , y ) Γ ̃ b 2 , 0 , ( x , y ) Ω \ Γ ̃ b 1 Γ ̃ b 2 , H ( x , y ) = 3 2 1 + cos ( 2 y 1 ) π , ( x , y ) Γ ̃ H 1 , 3 2 1 + cos ( 2 x 1 ) π , ( x , y ) Γ ̃ H 2 , 0 , ( x , y ) Ω \ Γ ̃ H 1 Γ ̃ H 2 .

Figure 7 displays the spatiotemporal dynamics of (S, u, v) obtained under the prescribed parameter setting. Similarly, the system appears to reach equilibrium more quickly, with both populations u and v approaching near-zero levels, indicating a potential trajectory toward extinction for both species.

Furthermore, we also identified coexistence of the two species by varying other parameters, as illustrated in Figures 8 and 9. The time required to reach equilibrium is comparable to that observed when Ω is a disk. The parameter values used in the numerical simulation shown in Figure 8 are

D ̲ = 0.1 , D ̄ = 10 , m 1 = 0.2 , m 2 = 0.3 , a 1 = 4 , a 2 = 6.07 , S 0 = 0 , u 0 = 3 , v 0 = 3 ,

and

b ( x , y ) = 1 10 1 + cos ( 2 y 1 ) π , ( x , y ) Γ ̂ b , 0 , ( x , y ) Ω \ Γ ̂ b , H ( x , y ) = 1 2 1 + cos ( 2 y 1 ) π , ( x , y ) Γ ̂ H , 0 , ( x , y ) Ω \ Γ ̂ H ,

while those used in Figure 9 are

D ̲ = 0.1 , D ̄ = 10 , m 1 = 0.2 , m 2 = 0.3 , a 1 = 2.4243 , a 2 = 5 , S 0 = 0 , u 0 = 3 , v 0 = 3 ,

and

b ( x , y ) = 1 20 1 + cos ( 2 y 1 ) π , ( x , y ) Γ ̃ b 1 , 1 20 1 + cos ( 2 x 1 ) π , ( x , y ) Γ ̃ b 2 , 0 , ( x , y ) Ω \ Γ ̃ b 1 Γ ̃ b 2 , H ( x , y ) = 1 4 1 + cos ( 2 y 1 ) π , ( x , y ) Γ ̃ H 1 , 1 4 1 + cos ( 2 x 1 ) π , ( x , y ) Γ ̃ H 2 , 0 , ( x , y ) Ω \ Γ ̃ H 1 Γ ̃ H 2 .
Figure 8: 
The solution (S, u, v) for system (1.1)–(1.3) at different moments, where (p, q) = (0.01, 1).
Figure 8:

The solution (S, u, v) for system (1.1)(1.3) at different moments, where (p, q) = (0.01, 1).

Figure 9: 
The solution (S, u, v) for system (1.1)–(1.3) at different moments, where (p, q) = (0.01, 1).
Figure 9:

The solution (S, u, v) for system (1.1)(1.3) at different moments, where (p, q) = (0.01, 1).

A comparison between the parameter settings in Figures 6 and 8 suggests that coexistence of the two populations occurs only when both b(x, y) and H(x, y) are relatively small. By comparing the parameters used in Figures 8 and 9, it can be observed that although the values of b(x, y) differ, their integrals over ∂Ω are identical. The same holds true for H(x, y). Consequently, the non-zero regions of b(x, y) and H(x, y) in Figure 9 are larger than those in Figure 8, which results in relatively smaller maximum values for b(x, y) and H(x, y).

7 Discussion

In this paper, we investigate an unstirred chemostat model for two competing populations in a bounded two-dimensional domain. Population dispersal is assumed to be anisotropic, with direction-specific probabilities interpreted as strategies.

We initially investigated the single-species models (1.4) and (1.5). Our findings demonstrate that there exists a unique continuous open interval contained within [0, 1] such that the steady state (z, 0) is globally asymptotically stable when the dispersal strategy is located in the interval; see Theorems 3.3 and 3.5(i). Moreover, the single-species model is uniformly persistent when the dispersal strategy is outside the interval; see Theorems 3.4 and 3.5(ii). Moreover, we found that the single-species model admits at least one positive steady state when the conditions for uniform persistence in the model are satisfied; see Theorems 3.73.11. Additionally, the positive steady state is locally asymptotically stable when the dispersal strategy is near the outer boundary of the interval; see Theorems 3.73.11.

Then we investigated the two-species model (1.1)(1.3). We classified the dynamical behavior of the model into three scenarios based on the diffusion strategies: (i) extinction (see Theorem 4.2); (ii) competitive exclusion (see Theorem 4.3); (iii) coexistence (see Theorem 4.4). Before studying the coexistence steady states of the model, we deduced the conditions for the linear stability of several special solutions; see Theorem 5.1. This provided a reference for selecting bifurcation points in the following. In the bifurcation analysis, we observed that the solution structure of the model is more complex. Furthermore, the parameter conditions constructed to classify the dynamic behavior of the model cannot be directly applied to the bifurcation analysis, necessitating the development of new parameter conditions; see Lemmas 5.3, 5.5 and 5.6. Additionally, we further studied the linear stability of the positive steady states when (p, q) is located in a very small part in [0, 1]2; see Lemmas 5.5 and 5.6. Finally, we provide sufficient conditions for the coexistence steady states in the two-species model; see Theorems 5.8 and 5.10.

Based on the analysis of the models above, we found that it is more beneficial for the species to choose one direction only. Because our conclusion shows that the diffusion strategies leading to extinction or competitive exclusion are often positioned in the middle of their feasible area, with no distinct directional bias. This finding is in agreement with the results of ref. [18]. Therefore, anisotropic diffusion provides more possibilities for species coexistence.

This paper raises several interesting questions. One of the key questions is whether more precise conditions can be established for the existence of coexistence equilibria in system (1.1)(1.3), and how the structure of all possible equilibria can be comprehensively and accurately characterized.


Corresponding author: Jianhua Wu, School of Mathematics and Statistics, Shaanxi Normal University, Xi’an 710119, People’s Republic of China, E-mail: 

The work is supported by the National Natural Science Foundation of China (12171296, 12461097).


Acknowledgments

The authors are grateful to anonymous referees for valuable comments and suggestions which led to great improvement of this paper.

  1. Research ethics: Not applicable.

  2. Informed consent: Not applicable.

  3. Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.

  4. Use of Large Language Models, AI and Machine Learning Tools: We use ChatGPT to improve language.

  5. Conflict of interest: The authors state no conflict of interest.

  6. Research funding: The research is supported by the National Natural Science Foundation of China (12171296, 12461097).

  7. Data availability: Not applicable.

References

[1] H. L. Smith and P. Waltman, The Theory of the Chemostat, ser. Cambridge Studies in Mathematical Biology, vol. 13, Cambridge, Cambridge University Press, 1995.Suche in Google Scholar

[2] S. B. Hsu, S. Hubbell, and P. Waltman, “A mathematical theory for single-nutrient competition in continuous cultures of micro-organisms,” SIAM J. Appl. Math., vol. 32, no. 2, pp. 366–383, 1977. https://doi.org/10.1137/0132030.Suche in Google Scholar

[3] G. J. Butler, S. B. Hsu, and P. Waltman, “A mathematical model of the chemostat with periodic washout rate,” SIAM J. Appl. Math., vol. 45, no. 3, pp. 435–449, 1985. https://doi.org/10.1137/0145025.Suche in Google Scholar

[4] S. B. Hsu, “A competition model for a seasonally fluctuating nutrient,” J. Math. Biol., vol. 9, no. 2, pp. 115–132, 1980. https://doi.org/10.1007/BF00275917.Suche in Google Scholar

[5] H. L. Smith, “Competitive coexistence in an oscillating chemostat,” SIAM J. Appl. Math., vol. 40, no. 3, pp. 498–522, 1981. https://doi.org/10.1137/0140042.Suche in Google Scholar

[6] H. I. Freedman, J. W.-H. So, and P. Waltman, “Coexistence in a model of competition in the chemostat incorporating discrete delays,” SIAM J. Appl. Math., vol. 49, no. 3, pp. 859–870, 1989. https://doi.org/10.1137/0149050.Suche in Google Scholar

[7] S. B. Hsu and P. Waltman, “Analysis of a model of two competitors in a chemostat with an external inhibitor,” SIAM J. Appl. Math., vol. 52, no. 2, pp. 528–540, 1992. https://doi.org/10.1137/0152029.Suche in Google Scholar

[8] B. Levin, “Frequency-dependent selection in bacterial populations,” Phil. Trans. Roy. Soc. B, vol. 319, no. 1196, pp. 459–472, 1988, https://doi.org/10.1098/rstb.1988.0059.Suche in Google Scholar PubMed

[9] S. B. Hsu and P. Waltman, “On a system of reaction-diffusion equations arising from competition in an unstirred chemostat,” SIAM J. Appl. Math., vol. 53, no. 4, pp. 1026–1044, 1993. https://doi.org/10.1137/0153051.Suche in Google Scholar

[10] J. H. Wu, “Global bifurcation of coexistence state for the competition model in the chemostat,” Nonlinear Anal., vol. 39, no. 7, pp. 817–835, 2000. https://doi.org/10.1016/S0362-546X(98)00250-8.Suche in Google Scholar

[11] J. Wu, H. Nie, and G. S. K. Wolkowicz, “The effect of inhibitor on the plasmid-bearing and plasmid-free model in the unstirred chemostat,” SIAM J. Math. Anal., vol. 38, no. 6, pp. 1860–1885, 2007. https://doi.org/10.1137/050627514.Suche in Google Scholar

[12] J. Wu, H. Nie, and G. S. K. Wolkowicz, “A mathematical model of competition for two essential resources in the unstirred chemostat,” SIAM J. Appl. Math., vol. 65, no. 1, pp. 209–229, 2004. https://doi.org/10.1137/S0036139903423285.Suche in Google Scholar

[13] J. Wu and G. S. K. Wolkowicz, “A system of resource-based growth models with two resources in the unstirred chemostat,” J. Differ. Equ., vol. 172, no. 2, pp. 300–332, 2001. https://doi.org/10.1006/jdeq.2000.3870.Suche in Google Scholar

[14] M. Ballyk, L. Dung, D. A. Jones, and H. L. Smith, “Effects of random motility on microbial growth and competition in a flow reactor,” SIAM J. Appl. Math., vol. 59, no. 2, pp. 573–596, 1999. https://doi.org/10.1137/S0036139997325345.Suche in Google Scholar

[15] L. Dung, H. L. Smith, and P. Waltman, “Growth in the unstirred chemostat with different diffusion rates,” in Differential Equations with Applications to Biology (Halifax, NS, 1997), ser. Fields Inst. Commun. Amer. Math. Soc., vol. 21, Providence, RI, 1999, pp. 131–142.10.1090/fic/021/11Suche in Google Scholar

[16] L. Dung and H. L. Smith, “A parabolic system modeling microbial competition in an unmixed bio-reactor,” J. Differ. Equ., vol. 130, no. 1, pp. 59–91, 1996. https://doi.org/10.1006/jdeq.1996.0132.Suche in Google Scholar

[17] D. Jiang, H. Nie, and J. Wu, “Crowding effects on coexistence solutions in the unstirred chemostat,” Appl. Anal., vol. 96, no. 6, pp. 1016–1046, 2017. https://doi.org/10.1080/00036811.2016.1171319.Suche in Google Scholar

[18] E. Bouin, G. Legendre, Y. Lou, and N. Slover, “Evolution of anisotropic diffusion in two-dimensional heterogeneous environments,” J. Math. Biol., vol. 82, no. 5, 2021, Art. no. 36. https://doi.org/10.1007/s00285-021-01579-1.Suche in Google Scholar PubMed

[19] P. Blanc, F. Charro, J. J. Manfredi, and J. D. Rossi, “Asymptotic mean-value formulas for solutions of general second-order elliptic equations,” Adv. Nonlinear Stud., vol. 22, no. 1, pp. 118–142, 2022. https://doi.org/10.1515/ans-2022-0007.Suche in Google Scholar

[20] L. Chen, L. Desvillettes, and E. Latos, “On a class of reaction-diffusion equations with aggregation,” Adv. Nonlinear Stud., vol. 21, no. 1, pp. 119–133, 2021. https://doi.org/10.1515/ans-2020-2092.Suche in Google Scholar

[21] F. Ortegón Gallego, M. Rhoudaf, and H. Talbi, “Increase of power leads to a bilateral solution to a strongly nonlinear elliptic coupled system,” Adv. Nonlinear Stud., vol. 24, no. 3, pp. 637–656, 2024. https://doi.org/10.1515/ans-2023-0133.Suche in Google Scholar

[22] J. W.-H. So and P. Waltman, “A nonlinear boundary value problem arising from competition in the chemostat,” Appl. Math. Comput., vol. 32, nos. 2–3, pp. 169–183, 1989. https://doi.org/10.1016/0096-3003(89)90092-1.Suche in Google Scholar

[23] M. G. Krein and M. A. Rutman, “Linear operators leaving invariant a cone in a Banach space,” Uspehi Matem. Nauk (N. S.), vol. 3, no. 1, pp. 3–95, 1948.Suche in Google Scholar

[24] R. S. Cantrell and C. Cosner, Spatial Ecology via Reaction-Diffusion Equations, ser. Wiley Series in Mathematical and Computational Biology, Chichester, John Wiley & Sons, Ltd., 2003.10.1002/0470871296Suche in Google Scholar

[25] K.-Y. Lam and Y. Lou, Introduction to Reaction-Diffusion Equations: Theory and Applications to Spatial Ecology and Evolutionary Biology, Berlin, Springer, 2022.10.1007/978-3-031-20422-7Suche in Google Scholar

[26] H. Nie, Y. Shi, and J. Wu, “The effect of diffusion on the dynamics of a predator-prey chemostat model,” SIAM J. Appl. Math., vol. 82, no. 3, pp. 821–848, 2022. https://doi.org/10.1137/21M1432090.Suche in Google Scholar

[27] H. Amann, “Dynamic theory of quasilinear parabolic systems. III. Global existence,” Math. Z., vol. 202, no. 2, pp. 219–250, 1989. https://doi.org/10.1007/BF01215256.Suche in Google Scholar

[28] H. Amann, “Dynamic theory of quasilinear parabolic equations. II. Reaction-diffusion systems,” Differ. Integr. Equ., vol. 3, no. 1, pp. 13–75, 1990, https://doi.org/10.57262/die/1371586185.Suche in Google Scholar

[29] R. H. MartinJr. and H. L. Smith, “Abstract functional-differential equations and reaction-diffusion systems,” Trans. Am. Math. Soc., vol. 321, no. 1, pp. 1–44, 1990. https://doi.org/10.2307/2001590.Suche in Google Scholar

[30] J. Smoller, Shock Waves and Reaction-Diffusion Equations, ser. Grundlehren der Mathematischen Wissenschaften, vol. 258, New York-Berlin, Springer-Verlag, 1983.10.1007/978-1-4684-0152-3Suche in Google Scholar

[31] Y. Tao and M. Winkler, “Boundedness vs. blow-up in a two-species chemotaxis system with two chemicals,” Discrete Contin. Dyn. Syst. Ser. B, vol. 20, no. 9, pp. 3165–3183, 2015. https://doi.org/10.3934/dcdsb.2015.20.3165.Suche in Google Scholar

[32] H. Nie, B. Wang, and J. Wu, “Invasion analysis on a predator-prey system in open advective environments,” J. Math. Biol., vol. 81, nos. 6–7, pp. 1429–1463, 2020, https://doi.org/10.1007/s00285-020-01545-3.Suche in Google Scholar PubMed

[33] H. Nie and J. Wu, “A system of reaction-diffusion equations in the unstirred chemostat with an inhibitor,” Int. J. Bifurcat. Chaos Appl. Sci. Eng., vol. 16, no. 4, pp. 989–1009, 2006. https://doi.org/10.1142/S0218127406015246.Suche in Google Scholar

[34] J. K. Hale and P. Waltman, “Persistence in infinite-dimensional systems,” SIAM J. Math. Anal., vol. 20, no. 2, pp. 388–395, 1989. https://doi.org/10.1137/0520025.Suche in Google Scholar

[35] H. L. Smith and X.-Q. Zhao, “Robust persistence for semidynamical systems,” Nonlinear Anal., vol. 47, no. 9, pp. 6169–6179, 2001. https://doi.org/10.1016/S0362-546X(01)00678-2.Suche in Google Scholar

[36] P. Magal and X.-Q. Zhao, “Global attractors and steady states for uniformly persistent dynamical systems,” SIAM J. Math. Anal., vol. 37, no. 1, pp. 251–275, 2005. https://doi.org/10.1137/S0036141003439173.Suche in Google Scholar

[37] J. Shi, Y. Wu, and X. Zou, “Coexistence of competing species for intermediate dispersal rates in a reaction-diffusion chemostat model,” J. Dynam. Differ. Equ., vol. 32, no. 2, pp. 1085–1112, 2020. https://doi.org/10.1007/s10884-019-09763-0.Suche in Google Scholar

[38] J. López-Gómez, “Classifying smooth supersolutions for a general class of elliptic boundary value problems,” Adv. Differ. Equ., vol. 8, no. 9, pp. 1025–1042, 2003, https://doi.org/10.57262/ade/1355926578.Suche in Google Scholar

[39] H. Brezis, Functional Analysis, Sobolev Spaces and Partial Differential Equations, ser. Universitext, New York, Springer, 2011.10.1007/978-0-387-70914-7Suche in Google Scholar

[40] J. Shi and X. Wang, “On global bifurcation for quasilinear elliptic systems on bounded domains,” J. Differ. Equ., vol. 246, no. 7, pp. 2788–2812, 2009. https://doi.org/10.1016/j.jde.2008.09.009.Suche in Google Scholar

[41] M. G. Crandall and P. H. Rabinowitz, “Bifurcation, perturbation of simple eigenvalues and linearized stability,” Arch. Ration. Mech. Anal., vol. 52, pp. 161–180, 1973, https://doi.org/10.1007/BF00282325.Suche in Google Scholar

[42] J. López-Gómez, “Global bifurcation for Fredholm operators,” Rend. Istit. Mat. Univ. Trieste, vol. 48, pp. 539–564, 2016, https://doi.org/10.13137/2464-8728/13172.Suche in Google Scholar

[43] Y. Du and T. Ouyang, “Bifurcation from infinity induced by a degeneracy in semilinear equations,” Adv. Nonlinear Stud., vol. 2, no. 2, pp. 117–132, 2002. https://doi.org/10.1515/ans-2002-0202.Suche in Google Scholar

[44] S. Li and J. Wu, “Global bifurcation of coexistence states for a prey-predator model with prey-taxis/predator-taxis,” Adv. Nonlinear Stud., vol. 23, no. 1, 2023, Art. no. 20220060. https://doi.org/10.1515/ans-2022-0060.Suche in Google Scholar

[45] R. Ma, Z. Zhao, and X. Su, “Global structure of positive and sign-changing periodic solutions for the equations with Minkowski-curvature operator,” Adv. Nonlinear Stud., vol. 24, no. 3, pp. 775–792, 2024. https://doi.org/10.1515/ans-2023-0130.Suche in Google Scholar

[46] J. Shi, “Persistence and bifurcation of degenerate solutions,” J. Funct. Anal., vol. 169, no. 2, pp. 494–531, 1999. https://doi.org/10.1006/jfan.1999.3483.Suche in Google Scholar

[47] F. Hecht, “New development in FreeFem++,” J. Numer. Math., vol. 20, nos. 3–4, pp. 251–265, 2012. https://doi.org/10.1515/jnum-2012-0013.Suche in Google Scholar

Received: 2025-07-01
Accepted: 2025-09-12
Published Online: 2025-10-01

© 2025 the author(s), published by De Gruyter, Berlin/Boston

This work is licensed under the Creative Commons Attribution 4.0 International License.

Heruntergeladen am 13.11.2025 von https://www.degruyterbrill.com/document/doi/10.1515/ans-2023-0201/html
Button zum nach oben scrollen