1 Introduction
The Universe probed by gravitational methods looks very different from that appears optically. Thanks to a large number of observational windows on the gravitational side, the difference can be classified and explained by two additional components in our Universe: a component behaves as cold particles dubbed cold dark matter, and a component without significant dynamics dubbed dark energy. Both components bring great challenges to our current understanding of physics.
Here we focus on dark energy [
1–
8]. Whereas observational evidence of dark energy emerges within the past 15 years, theoretical considerations of dark energy began almost a century ago. Those theoretical considerations are known as the “cosmological constant problem”.
In 1917, the early days of general relativity, Einstein [
9] added a cosmological constant to his field equations to obtain a static Universe
†. Soon in the 1920s, Pauli realized that the quantum zero point energy of a radiation field is too large to gravitate. Pauli’s statement is already surprisingly close to the modern understanding of the cosmological constant problem, considering the fact that now we understand fundamental physics much better than a century ago.
After that, the cosmological constant problem was largely ignored (or it was too hard to push forward) for a long time until the 1960s. In 1967, Zeldovich considered the cosmological constant problem as a fine tuning problem [
10,
11]. This is known as the old cosmological constant problem. Since then, a lot of early efforts have been made to eliminate the too large cosmological constant, as reviewed in Ref. [
12].
In 1998, supernova observations eventually shed light on this hard problem [
14], and in an unexpected way. Data suggests that dark energy, an energy component probably coming from the cosmological constant, dominates the current Universe. The percentage of dark energy density is around 70% – not small nor too large. The Universe is now accelerating due to the presence of dark energy.
In this essay we review the problem of dark energy, a.k.a. the cosmological constant problem. We first review the problem in the viewpoint of theoretical physics in logic order, from the aspects of symmetry, anthropic principle, tuning mechanisms, modified gravity, quantum cosmology, holographic principle, back-reaction and phenomenological models. Then we review the observational topics, including cosmic probes, dark energy related projects, observational constraints on theoretical models and model independent reconstructions.
2 Theoretical aspects
The theoretical challenge for dark energy can be observed from the Einstein equations:
where is the bare cosmological constant, as an input parameter from the theory.
On the right hand side, the energy-momentum tensor is to be determined by a given matter configuration. Note that a perturbative matter state is built up from the vacuum state. Also our Universe looks not very far from the vacuum state. Thus to see the problem, it suffices to consider a vacuum stress tensor.
For the vacuum, Lorentz invariance forces the stress tensor to take the form:
where . Thus behaves as a renormalization of . The quantum correction to the vacuum energy density can be calculated as (taking a bosonic field as an example)
where V is the volume of space and in the last step we have used a UV cutoff λ to evaluate the divergent integral. If an effective field theory were applicable up to the energy scale λ, and natural, we could expect the following facts:
(i) The energy density gravitates. This is hard to avoid in a local field theory because the current test of equivalence principle has been far more precise than the quantum contribution to the mass of matter. And a local graviton cannot observe a difference between a vacuum loop and a loop diagram with external legs.
(ii) The effective field theory contribution to energy density is not canceled by the high energy modes above the cutoff. This is again hard to avoid unless there are some nontrivial (and yet unknown) UV-IR correlations.
(iii) The energy density is not canceled by contribution from other fields. If there was supersymmetry (SUSY), the bosonic vacuum energy is actually canceled by its fermionic counterpart. However SUSY, if exists, is broken on energy scales below GeV. Thus below GeV there is no known cancellation between fields.
(iv) The energy density , together with contributions from other fields, are not canceled by the bare energy cosmological constant . Those two do not seem to be able to cancel each other unless gravity is modified to fit matter in a more dynamical way.
Given the above “facts”, our observed vacuum energy density should be of order , which is GeV4 if , or GeV4 if GeV. However, the dynamics of our Universe suggests a vacuum energy density cannot be much greater than the critical energy GeV4. This is either 117 or 52 orders of magnitude smaller than the theoretically natural one. This is the old cosmological constant problem:
(a) Why the cosmological constant is small?
Moreover, recent observations show there indeed exists a component of dark energy, with energy density indeed of order GeV4. The observation made the old cosmological constant problem harder to solve. Because a small yet non-zero number is even more difficult to explain than an unexpected zero. Also, as dark energy has different dynamics (dilution rate from cosmic expansion) from matter or radiation, another problem emerges:
(b) Why dark energy density is the same order as matter density today?
The cosmological constant problems (a) (b) are so hard that some people gave up a fundamental explanation of the cosmological constant and treat it as an environmental variable; On the other hand, the problem is also so inspiring that numerous models have been built seeking for an explanation. In the remainder of this section, we shall overview eight classes of those attempts.
2.1 Symmetry
Symmetry has been promoted to a first principle in modern physics. It could not be better if the cosmological constant problem could be solved by a symmetry principle directly. SUSY [
15] gets near in this aspect [
16]. But unfortunately SUSY has to be broken on large distance scales.
Nevertheless, there are a few proposals to apply symmetry principles to the cosmological constant problem. For example, ’t Hooft and Nobbenhuis [
17] (see also Ref. [
18]) proposed that one could consider the following transformation for coordinate and momentum:
A massless scalar field or an Abelian gauge field has this symmetry. On the other hand a cosmological constant is forbidden. However, the mass of a scalar is not allowed either (a positive mass squire transforms into a tachyon). Also a non-Abliean gauge theory does not have such a symmetry. There could be issues about boundary conditions in quantum mechanics after the above transformation as well.
Instead of transforming coordinate, one could as well change the sign of the metric. In a theory with
symmetry [
19], the cosmological constant is absent. Unfortunately it is hard to realize this symmetry in four dimension spacetime. As another attempt [
20,
21], one could as well scale the metric instead of changing its sign. But there is an instability in such a theory.
As another class of approaches, Kaplan and Sundrum [
22] considered a counter term for the cosmological constant as
where the Lagrangian for matter field ψ and have the same function form. Again there is an issue of ghost instability considering the ψ and fields are coupled by gravity.
2.2 Anthropic principle
It is hopeless, if not impossible, to explain every parameter in nature from the first principles. For example, one cannot hope to calculate the temperature on the earth from any theory of everything. There are a vast number of other planets in our Universe, whose surface temperatures are hugely different from that of the earth. And from the viewpoint of a theory of everything, the earth is not too special from any other planets to have a special temperature.
However, a natural explanation of the earth temperature emerges, from the fact that there are intelligence livings on the earth, who could ask any question. This fact makes the earth special. Thus the temperature should fit for intelligent beings. This explanation is known as the anthropic principle [
23] (of the weak sense [
24] due to Weinberg’s classification [
12]). Such an anthropic explanation of a parameter in nature makes sense if:
(i) The parameter could vary in different parts of the Universe. On the one hand, this makes room for an anthropic explanation. On the other hand, this implies that the value of the parameter cannot be calculated from the first principles (although its distribution may be calculated).
(ii) The existence of intelligence is sensitive to this parameter, and the observed value (at the time of observation) prefers such an existence.
(iii) Additionally, to relate an intelligent observer to us humans, one has to assume we are typical observers, and propose a measure to define the typicality in a probably infinite Universe.
The above are the general considerations of the anthropic principle. Those considerations may be applied to the cosmological constant problem. This is because:
(i) There might be different cosmological constants in different parts of the Universe, in space scopes beyond our observable Universe. This statement is (so far) not testable by the (current) definition of observable Universe. However, fundamental theories suggest such a possibility. Especially, in string theory, in the past decade a landscape of (semi-classical) meta-stable vacua solutions are discovered [
25,
28]. The number of such vacua in string theory may be of order
[
29], considering one could use different Calabi–Yau manifolds to compactify the extra dimensions, and add different branes and fluxes [
30]. Moreover, the theory of eternal inflation [
31,
32], as well as the quantum mechanical many world conjecture, open up possibilities to populate the string landscape. If the above picture holds, the cosmological constant indeed ends up as an environmental variable.
(ii) The existence of intelligence is indeed sensitive to the cosmological constant. This is because a large and positive cosmological constant will dilute the structure of the Universe before useful structures (like galaxies) are formed [
33,
34]. Whereas a large (in absolute value) and negative cosmological constant will drive an early collapse of the Universe. However, it is still too early to conclude that our observed value at the time of observation is most suitable for intelligence. For example, there is a Boltzmann brain problem [
35], indicating that a (nearly) pure de Sitter Universe may be more suitable for intelligence, of a thermal fluctuation type.
(iii) Finally, it is in debate if we can typically consider ourselves as typical observers, and consider the observed Universe as a typical one in the multiverse. Moreover, the measure problem [
36–
39] is still severe. Currently several measures coincide with each other and a few other measures are ruled out. Thus it seems that different efforts converge in the right direction. However, no guiding principle is available so far for the measure construction thus the problem should not be marked as solved.
2.3 Tuning mechanisms
Another direction for dark energy is to introduce a field, which could dynamically cancel the cosmological constant, no matter how large it was originally. Such kind of a scenario is called tuning mechanism. For example, for the old cosmological constant problem, one may have expected to have a scalar field
ϕ, which is related to the stress tensor as [
40]
If also depends on ϕ and drives ϕ to some stable value , the equilibrium state at will have a vanishing Ricci scalar thus a vanishing cosmological constant.
Unfortunately, Weinberg [
12] showed that it is difficult to realize such a mechanism. The above conditions are proven to be equivalent to the statement that the matter Lagrangian takes the form
Thus unless one fine tunes , there will not be a stationary point for ϕ. Also, if asymptotically rolls to , the effective Newton’s constant GN vanishes, because can be viewed as a redefinition of GN. Neither of the above possibilities is satisfactory.
There are some recent attempts trying to get around the above problem. For example, one can consider a non-trivial extra dimension and then Weinberg’s proof no longer applies [
41–
44]. However, attempts in this direction also encounter problems such as a singularity in the bulk, or violation of the Lorentz symmetry.
2.4 Modified gravity
Dark energy (as well as dark matter) is identified via gravitational probes. Thus once one meets difficulties in the explanation of dark energy, it is a natural idea to step back and question if the current gravity theory can be applied to cosmological scales (or even galactic scales).
There have been a large number of theories of modified gravity, and a large proportion of which has been used as models of dark energy. An incomplete list of which include
gravity [
45–
48], MOND [
49] and TeVes [
50], DGP [
51], scalar-tensor theories [
52,
53], Gauss–Bonnet [
54,
55] and Lovelock [
56] gravities, Horava–Lifshitz gravity [
57],
gravity [
58,
59], conformal gravity [
60], fat graviton and so on. Those scenarios open up a huge variety of possibilities for dark energy.
The attempts of modifying gravity starts as early as the early 1960s, known as the Brans–Dicke gravity [
52]. In Brans–Dicke gravity, a scalar field is added into the gravitational action
Instead of inserting a scalar field, one could also modify the Einstein–Hilbert action by using an alternative curvature invariant. As an example, gravity modifies the Einstein–Hilbert action as
To make specific predictions one has to specify
f. For instance, one could choose
, where
μ is a constant [
46].
Along this direction, one could also construct more general curvature invariants. For example, the Gauss-Bonnet term
In 4 spacetime dimensions
is a total derivative thus does not modify the local dynamics of gravity. However, one could couple
to a scalar field as
as a model of dark energy [
55].
The DGP scenario is another popular possibility of modifying gravity [
51]. In the DGP scenario, two gravity theories are considered at the same time: one located on a 3+1 dimensional brane, and another on a 4+1 dimensional brane, with their own Einstein–Hilbert actions (while the two gravity theories share the same metric: the 3+1 metric is the 4+1 metric restricted on the 3-brane). The existence of the 4+1 brane leads to large scale modifications of gravity.
2.5 Quantum cosmology
The cosmological constant problem is a problem from the energy of quantum fluctuations, which gravitate. Thus it is not surprising if the solution could have something to do with quantum gravity, even though the problem mainly affects extremely large scales.
For example, Hawking [
61,
62] provided a mechanism to show that the cosmological constant is probably zero. He constructed a 4-form field strength, which could vary and change the cosmological constant. Then the wave function of the Universe indicates a probability distribution of the effective cosmological constant
(before normalization of the probability distribution) to be
Thus from above is the most probable value of the cosmological constant when the Universe is created via the Hartle–Hawking wave function. Unfortunately, this scenario produces an empty Universe, with only a vanishing cosmological constant. On the one hand, there is no radiation or matter in this approach, and on the other hand, our present accelerating Universe (if not coming from another source) falsifies the mechanism.
Later, the probability is corrected by considering the decoherence effects [
63,
64]. In this case the Universe could be born at the string scale. However, in this case this mechanism is no longer very related to the cosmological constant problem. Instead, the mechanism is used as a program to select the original Universe.
As another quantum approach to dark energy, Tye [
65,
66] considered a possibility that the vacuum of our Universe may experience fast tunnelings through the string landscape, until settling down at a place with a small cosmological constant. The idea is supported by the resonant tunneling effect in quantum mechanics. Resonant tunneling is a well established effect in quantum mechanics. Recent development also shows evidence that resonant tunneling can exist in quantum field theory [
67–
70].
One could also relate quantum features of cosmology to dark energy from a cosmological seesaw mechanism [
71,
72]. It is interesting to notice that if SUSY is broken at the TeV scale, there is a hierarchy of scales
And the SUSY scale could also be replaced by any scale that stabilizes Higgs mass. It is argued that the hierarchy could be resolved by a seesaw mechanism relating two interacting Universes. The coupling is introduced through the wave function of the Universe [
73]. It is so far not clear yet how to introduce such a coupling at a more fundamental level.
2.6 Holographic principle
Effective field theory is one of the most important concepts in high energy physics. The cosmological constant problem, as a problem of renormalizing the cosmological constant, can also be thought of as a problem in the sense of effective field theory. However, the application regime for effective field theory seems not as well understood as people thought years ago: Not only an increase of energy scale, but also an increase of the number of relevant degrees of freedom, seems to lead to a break down of effective field theory.
There are quite a few examples for the above observation. Here we only consider the most relevant one for our purpose: Consider the vacuum energy within a volume with radius
L [
74]. The volume under consideration should not form a black hole thus the effective field theory should have a cutoff
satisfying
where the very right hand side is the energy of a black hole of the same size. This inequality can be recast in terms of energy density as
where
c is a parameter introduced in Ref. [
75], which is naturally a constant of order one.
As pointed out in Ref. [
75], when
L is chosen the event horizon of our Universe,
ρ behaves as a component of dark energy, dubbed the holographic dark energy (HDE). The equation of state for this component is
where is the relative energy density of HDE. Thus when HDE subdominates, it behaves as curvature; and when it dominates the Universe, the Universe behaves as quasi-de Sitter for reasonable c.
Eq. (14) can also be understood in several other ways. For example, as shown in Refs. [
76,
77], the Casimir energy in de Sitter space has a quadratic divergence. Thus the Casimir energy takes the form (14) and de Sitter expansion may be self-driven. Alternatively, if one considers the event horizon of our Universe as a holographic screen, the acceleration of Universe behaves as an entropic force [
78], or a consequence of quantum information [
79]. Also, if non-perturbative gravitational excitations behaves as a gas component with holographic dispersion relation, one could also arrive at Eq. (14) [
80].
The event horizon is a natural choice, but not the unique logical possibility. It is also proposed that the Ricci scalar [
81,
82], or the time of the Universe [
83,
84], could be used as the IR cutoff as well. Also the parameter
c could be a function of time or redshift [
85].
2.7 Back-reaction
The Einstein equations are non-linear. The non-linearity brings a great amount of difficulties as well as challenges to applications of the theory of gravity.
One of the distinguishing features of a non-linear theory is that the time evolution and the operation of averaging may not commute. In the conventional approach of cosmology, we first approximate our Universe to be homogeneous and isotropic. This may be true only on large scales. We are averaging over smaller structures before considering time evolution of the scale factor. Thus there will be a correction from the non-commutivity of averaging and time evolution. The correction is dubbed back-reaction [
86], and the question is if the correction could become large and accelerate our Universe.
The back-reaction term appears in the cosmological equations as [
87]
where R3 is the spatial curvature, and is defined as a combination of the variances of the expansion scalar θ and the shear σ as
It is still an open question if could be large enough to drive the cosmic expansion. Also, in this approach, one still has to solve the old cosmological constant problem, to have a not-too-large original cosmological constant.
One could also consider whether super-Hubble inhomogeneities could back-react the evolution of our Universe. This is a more ambitious approach. Because if there is a screening effect of cosmological constant form the back-reaction, one can solve the old cosmological constant problem together. One can prove [
88,
89] that if there is only curvature fluctuation, the super-Hubble inhomogeneities cannot back-react onto our Hubble scale dynamics. When there is isocurvature fluctuation, the effect of super-Hubble back-reaction is still in debate [
90–
93].
Another interesting approach to study the effect of inhomogeneous universe on the cosmic acceleration is the so-called LTB models, which can also explain the cosmic acceleration without introducing dark energy. The key idea is based on the assumption that the universe should be described by the spherically symmetric, inhomogeneous Lemaitre–Tolman–Bondi (LTB) metric [
94–
96], rather than the homogeneous, isotropic Friedmann–Lemaitre–Robertson–Walker (FLRW) metric. In the simplest class of such models, we live close to the center of a spherically symmetric Gpc scale void, and our local region has a larger Hubble parameter than the outer region due to the spatial gradients of the metric.
2.8 Phenomenological models
As another huge class of attempts, dark energy could as well be a simple fluid component, for example, a scalar field. The simplest example of this class is a quintessence field with a conventional scalar [
97,
98]:
At the homogeneous and isotropic background level, the energy density and the pressure takes the form:
When the potential V is flatter than
an accelerating solution for our Universe is admitted. In the limit when the potential V is completely flat, the scenario returns to a massless scalar field, plus a decoupled non-dynamical cosmological constant. A quintessence field always has equation of state .
The quintessence scenario could be modified in various ways. For example, one could consider a scenario of phantom, which introduces a quintessence field with a wrong-sign kinetic term [
99]. In this case, one gets a field with
as dark energy. The phantom field is unstable when coupled to matter (even gravitationally). Even worse, in a Lorentz invariant theory, the decay rate of phantom is divergent [
100]. Recently, it is argued that a dynamical breaking of Lorentz invariance due to the decay of phantom itself may avoid this problem [
101]. The combination of quintessence and phantom fields also makes a scenario of quintom [
102,
103].
As another direction, one could generalize the standard kinetic term as [
104–
106]
where
P is a general function of its two arguments. This generalization is known as k-essence. The scenario can be further generalized to ghost condensation [
107,
108] and kinetic gravity braiding [
109–
112].
The field theoretic approach of dark energy can also be generalized to spinor fields [
113–
116], vector fields [
117,
118], and
p-form fields [
119,
120]. Also, dark energy could be particles with exotic properties [
80,
121,
122].
As another class of phenomenological models, dark energy may as well be a fluid with a modified equation of state. For example, Chaplygin gas [
123,
124] is a model in this direction. Chaplygin gas, originally introduced to model the air flow around the wing of an aircraft, is a fluid with equation of state
Later, the scenario is generalized to [
125,
126]
to better fit the data and to unify dark matter and dark energy.
As another example of fluid dark energy, dark energy might be a fluid with viscosity [
127,
128]
There are two generic features for most phenomenological models of dark energy. Theoretically, one still need to worry about the cosmological constant problem because the large vacuum zero point energy is not canceled in a natural way. Phenomenologically, one should consider dark energy perturbations as well in those models, because dark energy has local degrees of freedoms in those cases. The latter could be a window to distinguish field, fluid, particle scenarios of dark energy between a simple cosmological constant.
3 Observational aspects
3.1 Cosmic probes of dark energy
The most common approach to probe dark energy is through its effect on the expansion history of the Universe. This effect can be detected via the luminosity distance
and the angular diameter distance
. In addition, the growth of large-scale structure can also provide useful constraints on dark energy. In this section, we briefly review some mainstream cosmological probes of dark energy. For a more detailed review on current mainstream observational probes, see Ref. [
129].
3.1.1 Type Ia supernoave
A white dwarf star can accrete mass from its companion star; as it approaches the Chandrasekhar mass, the thermonuclear explosion will occur, representing itself as a type Ia supernoave (SNIa). This mechanism implies that SNIa can be used as standard candles to measure the luminosity distance , which takes the form . Clearly, contains the information of the cosmic expansion history through an integration.
In 1998, using the SNIa data from the Hubble space telescope (HST) observations, Riess
et al. [
13] first discovered that the expansion rate of our Universe is accelerating. Soon after, the result was confirmed by Perlmutter
et al. [
14] based on the analysis of 42 SNIa. The discovery of the Universe accelerating expansion was named “Breakthrough of the Year” by Science Magazine in 1998. After that, the surveys of SNIa has drawn lots of attention. Famous teams focusing on this field include the High-
z team [
130], the Supernova Legacy Survey (SNLS) [
131], the ESSENCE [
132], the Sloan Digital Sky Survey (SDSS) Supernova (SN) Survey [
133], and so on. Recent SNIa dataset includes the three-year SNLS dataset [
134] consisting of 472 SN and the Supernovae Cosmology Project (SCP)’s Union 2.1 dataset [
135,
136] consisting of 580 SN. When combined with other cosmological probes, these data could reduce the (1
σ) error of the dark energy EoS to less than 0.1.
For a SNIa, once its redshift zi, absolute magnitude Mi and apparent magnitude mi are determined, one can construct the theoretical (assuming specific dark energy) and observational distance modulus,
and the
for the SNIa data can be constructed as
In this procedure, people often analytically marginalize the nuisance Hubble constant
H0 [
137]. For more complete and detailed analysis, see Refs. [
138,
139].
Due to the absence of the knowledge of their detailed explosion mechanism, SNIas are not intrinsically standard candles. Other systematic errors of the SNIa come from the photometry, the identification of SNIa, the host-galaxy extinction, the gravitational lensing, and so on. These systematic errors are now the major factors that confine the precision of SNIa data. To enhance the precision, improvements on the photometric technique, as well as better understandings of the dust absorption and the SN explosions, are needed.
3.1.2 Cosmic microwave background
As the legacy of the cosmic recombination epoch, the cosmic microwave background (CMB) contains abundant information of the early Universe. Current CMB experiments include the well-known Wilkinson Microwave Anisotropy Probe (WMAP) [
140,
141], the Planck satellite [
142], and so on.
From the CMB observations, some distance priors can be extracted to constrain dark energy. For example, the “shift parameter” [
143] defined at the decoupling epoch
takes the form
, where the angular diameter distance
. This parameter nicely describes the full CMB leverage on the cosmic expansion history, and is a good approximation for models not deviating too much from
CDM. Another distance ratio is the “acoustic scale”
lA, defined as
(
rs is the sound horizon). This quantity represents the CMB multipole of the acoustic peak location. As high redshift distance indicators,
R and
lA are especially useful in breaking the degeneracies between cosmological parameters when combined with other cosmological probes.
The first acoustic peak of the CMB spectrum is a good indication of the existence of dark energy. In addition, the CMB data could also be used to probe dark energy through the Integrated Sachs Wolfe (ISW) effect [
144,
145]. This large scale anisotropy effect is caused by the variation of the gravitational potential during the epoch of the cosmic acceleration, and has been detected through the cross relation between CMB and the large scale structure (LSS) at about 4
σ [
146].
3.1.3 Baryon acoustic oscillations
Baryon acoustic oscillations (BAO) refers to overdensities or clusterings of baryonic matter at certain length scales (
150 Mpc in today’s Universe) due to acoustic waves which propagated in the early Universe [
147,
148]. It provides a “standard ruler” for cosmological observations, and can be measured at low redshifts
through galaxy surveys. Famous BAO measurements include the Two-degree-Field Galaxy Redshift Survey (2dFGRS) [
149], the SDSS [
150], the WiggleZ dark energy survey [
151], and so on. When combined with the SNIa and CMB data, the latest BAO data from the WiggleZ survey yields a result
[
152].
From galaxy observations, the BAO scales in both transverse and line-of-sight directions are obtained, corresponding to the quantities ( is the comoving distance; zd is the “drag epoch”) and . Widely used BAO distance measurements include the A parameter, the distance , the distance ratio , and so on. Current measurements are distributed in the redshift region .
Since the BAO measurement only requires the determination of the three dimensional positions of galaxies, they are less affected by astronomical uncertainties.
3.1.4 Weak lensing
Weak lensing (WL) is the slight distortions of distant objects’ images, due to the gravitational bending of light by structures in the Universe. The mass and positions of the lens depend on the matter distribution on the light cone, while the distances to the objects and lens are determined by the geometry of the spacetime. So WL probes dark energy through its effects on both the cosmic expansion and growth history of the strucuture. Current WL projects include the Canada–France–Hawaii legacy survey (CFHTLS) [
153], and so on.
The effect of WL on the distance objects represent on the distortions of the shapes of the galaxies [
154]
†, with typical scale
0.01. This signal is much smaller than the typical scale of the intrinsic deviation in the galaxy shape (about 0.3–0.4), and can be detected only from a large number of galaxies. The most commonly used method is the cosmic shear statistics. In 2005, based on the cosmic shear data of CFHTLS, Hoekstra
et al. [
156] reported a constraint of
at the 68% CL.
Although current WL data are not powerful enough compared with SNIa and BAO, WL is a very promising probe to detect dark energy. The underlying WL data are rich, while the observational and statistical techniques of the WL probe are under continually improvement.
3.1.5 Other dark energy probes
Galaxy clusters: Their distribution marks the LSS. Since the comoving volume of the Universe is affected by the geometry, the cluster abundance also encodes the information of the expansion history [
157–
159].
Gamma-ray bursts: As the most luminous electromagnetic events in the Universe, gamma-ray bursts (GRBs) may help us to extend the Hubble diagram to
[
160,
161]. However, due to the large errors and calibration problem, current GRB data are not able to provide extensive and reliable probe to dark energy.
X-ray observations: Like the SNIa and BAO data, the X-ray
(defined as
) measurements can also probe the redshift-distance relation, with the dependence
. In 2008, based on the Chandra X-ray data, Allen
et al. [
162] reported
.
Hubble parameter measurements: Precision measurements of
H0 can help to break the degeneracies, and are thus widely used in dark energy constraints. In Ref. [
163], Riess
et al. reported
. Besides, the direct measurement of
from the differential ages of passively evolving galaxies can also provide valuable constraints [
170].
Cosmic age test: Cosmic age problem is a “smoking-gun” of evidence for the existence of dark energy
†. However, the existence of some extremely old globular clusters and quasars shows that the cosmic age problem has not been completely removed by the introduction of dark energy [
164–
169]. In addition, the “look back time-redshift” [
170] data obtained from the age of old passive galaxies can be included into the
analysis and constrain dark energy.
Growth factor data: The growth factor defined by
can be measured from the redshift distortions and Lyman-
α Forest data. Current growth factor data [
171–
173] have large errors and are still less powerful.
3.2 Dark energy projects
According to the DETF report [
174], the dark energy projects can be classified into four stages: completed projects are Stage I; on-going projects, either taking data or soon to be taking data, are Stage II; intermediate-scale, near-future projects belong to Stage III; larger-scale, longer-term future projects belong to Stage IV. In this paper, we will introduce some mainstream Stage IV projects. For a comprehensive list of the dark energy experiments, see Refs. [
175,
176].
3.2.1 Large synoptic survey telescope
A most ambitious ground-based dark energy survey project is the Large Synoptic Survey Telescope LSST [
176], which is an USA NSF/DOE collaboration program. Its design is an 8.4-meter ground-based optical telescope to be sited in Cerro Pachon of Chile. Over a 10-year lifetime, LSST will obtain a database including 10 billion galaxies and a similar number of stars, studying dark energy through a combination of the BAO, SN and WL techniques. Because of its compelling scientific capacity and relatively low technical risk, LSST was selected as the top priority large-scale ground-based project for the next decade of astronomy in the Astro2010 report [
178]. The project is scheduled to have first light in 2016 and the beginning of survey operations in 2018.
3.2.2 Square kilometer array
Another ambitious large-scale ground-based telescope is the Square Kilometer Array (SKA) [
179], an international collaboration program. SKA has a collecting area of order one square kilometer and is capable to operate at a wide frequency range (60 MHz – 35 GHz). It will be built in the southern hemisphere (either in Australia or in South Africa), and the specific site will be determined in 2012. SKA will probe dark energy by BAO and WL techniques via the measurements of the Hydrogen line (HI) 21-cm emission in normal galaxies at high redshift. Its construction is scheduled to begin in 2016 for initial observations by 2020 and full operation by 2024.
3.2.3 Wide field infrared survey telescope
A most exciting space-based dark energy project is the Wide Field Infrared Survey Telescope (WFIRST) [
180], which is an USA NASA/DOE collaboration program. WFIRST is a 1.5-meter wide-field near-infrared space telescope, orders of magnitude more sensitive than any previous project. It will determine the nature of dark energy by measuring the expansion history and the growth rate of large scale structure. A combination of the BAO, SN and WL techniques will be used. Because of its compelling scientific capacity and relatively low technical risk, WFIRST was selected as the top priority large-scale ground-based project for the next decade of astronomy in the Astro2010 report [
178]. The project is scheduled to launch in 2020 and has a 10-years lifetime.
3.2.4 Euclid
Another exciting space-based dark energy project is the Euclid [
181], which is an ESA project. Euclid is 1.2 m Korsch telescope, with optical and near-infrared (NIR) observational branch. It will also make use of several secondary cosmological probes such as the ISW, CL and redshift space distortions to provide additional measurements of the cosmic geometry and structure growth. After 5 years’ survey, Euclid will measure the DE EoS parameters
w0 and
wa to a precision of
and
, respectively, and will measure the growth factor exponent
γ with a precision of
.
3.2.5 International X-ray observatory
The last Stage IV project is the International X-ray Observatory (IXO) [
182], which is a partnership among the NASA, ESA, and the Japan Aerospace Exploration Agency (JAXA). It is a powerful X-ray space telescope that features a single large X-ray mirror assembly and an extendable optical bench with a focal length of
m. With more than an order of magnitude improvement in capabilities, IXO will study dark energy through the WL technique. It was selected as the fourth-priority large-scale ground-based project in the Astro2010 report [
178], and is scheduled to launch in 2021.
3.3 Observational constraints on theoretical models
In this section we briefly review some research work concerning the cosmological constraints on various theoretical models.
3.3.1 Scalar field models
As the most popular phenomenological dark energy models, scalar field models can mimic a dark energy component with arbitrary properties (e.g., arbitrary w). So the issue of the observational constraints on the scalar field models is somewhat similar to the observational probe of the dynamical behavior of dark energy.
Different classes of scalar field dark energy models have different properties. For quintessence or phantom,
or
, while for quintom
w can cross
†. Current observations still can not determine whether dark energy is quintessence, phantom or quintom. For example, the Seven-year WMAP measurements [
184] gave
, with all the possibilities existing.
Another popular issue often discussed in the literature of the scalar field models is possible interactions between dark energy and dark matter [
185,
186]. Phenomenologically, interaction can be introduced in the form
where
Q is the interaction term. Current data have put tight constraints on interactions between the dark sectors. In Ref. [
187], based on the analysis of the SNIa+BAO+ CMB data, Het
et al. considered the form
, and obtained
for the cases of
and
. Similar results were obtained in e.g. Refs. [
188–
191].
3.3.2 Chaplygin gas models
The standard Chaplygin gas model with
has been ruled out by the SNIa, BAO and CMB observations at more than 99% confidence level (CL) [
192–
195].
The generalized Chaplygin gas model with is once believed as a promising candidate to unify dark matter and dark energy (hereafter noted as “UDM”). The evolution of its energy density takes the form:
where is the effective matter ratio determined by A and and integration constant. The model can nicely fit the observations of the cosmic expansion history when . Especially, the case of the CDM model corresponds to .
However, it is later proved that [
196] this UDM scenario could produce oscillations or exponential blowup of the matter power spectrum, which is inconsistent with observations. In this way, the parameter space is confined to
[
197], extremely close to the
CDM case. So the generalized Chaplygin gas model as a UDM has been effectively ruled out.
3.3.3 Holographic dark energy models
In Ref. [
75], Li proposed the HDE model with the future event horizon as the IR cutoff. Thereafter, a lot of studies have been performed testing this model using the observational data of SNIa, BAO, CMB, WL, and so on. These research all show that the HDE model can provide a good fit to the data. For example, in Ref. [
198], by using the Consitution+BAO+CMB data, Li
et al. found that
and
, implying that HDE is a competitive dark energy candidate [
199].
Numerical studies of the HDE model show that the data favor
[
200–
206]. Recent studies have obtained the constraints
at the 95% CL. The data also put tight constraints on possible interactions between HDE and dark matter. Generally speaking, for an interaction term with the form
(where
ρ can be
,
,
, and so on), a constraint of
can be obtained based on the analysis of the SNIa+BAO+CMB data [
207–
210].
As mentioned above, the Ricci scalar [
81,
82] and the time of the Universe [
83,
84] have also been proposed as the IR cutoff. However, later research showed that these two models are not favored by the data. Compared with the original HDE model, the
of these models can be 15–30 larger [
198,
204,
206] based on the analysis of the SNIa+BAO+CMB data.
3.3.4 DGP model
Although it is a simple mechanism for the cosmic acceleration without introducing the dark energy component, the DGP model [
211] cannot provide a satisfactory fit to the data. First of all, the expansion history predicted by the DGP model leads to apparent inconsistency between the SNIa, BAO and CMB data [
195], implying that this model is not acceptable. In Ref. [
212], by using the Union+BAO+CMB data Rubin
et al. showed that the DGP model leads to a
compared with the
CDM model. Secondly, the history of the structure formation in the DGP model is also disfavored by observations [
213,
214]. In Ref. [
215], Fang
et al. showd that this model over predicts the low-
l anisotropies of the CMB temperature power spectrum. Compared with the
CDM, DGP is excluded at 4.9
σ (with curvature) and 5.8
σ (without curvature) levels. Thus, the situation of the DGP model is far from optimistic when confronted with cosmological observations [
216–
220].
3.3.5 Other modified gravity models
The
models can mimic expansion histories which are indistinguishable from those of
CDM model, so to test them we need to get help from the cosmic growth history observations [
221–
223]. In Refs. [
224,
225], Song
et al. parametrized the
model by the “Compton wavelength parameter”
B †, and found that the model predicts a lower large-scale CMB anisotropies by reducing the ISW effect. So far, tightest constraints on the
models come from the observations of the galaxy clusters. In Ref. [
226], Lombriser
et al. revisited the model studied in and reported
at the 2
σ CL, mainly due to the inclusion of the cluster abundance data.
Gauss–Bonnet gravity predicts strong growth of perturbations on smaller scales, incompatible with the observed galaxy spectrum, unless the deviation from the Einstein gravity is very small [
227,
228]. Thus this model has been effectively ruled out.
Based on the constraints on the PPN parameter
γ from the solar system and binary pulsar observations [
229–
231], the Brans–Dicke theory has been tightly constrained to the level that its cosmological effects are insignificant.
3.3.6 LTB models
LTB models are the most commonly considered inhomogeneous scenarios to explain the cosmic acceleration without introducing dark energy. These models can successfully explain the dimming of the distant supernovae, providing a nice fit to the SNIa data [
232,
233], comparable with the
CDM model.
In Ref. [
234], Alnes
et al. pointed out that, if it happened that we do not live precisely near (less than
20 Mpc [
235]) the center of the void, the observed CMB dipole would become much larger than that allowed by observations. So there is a fine-tuning problem in the void models. What is worse is that, even if we happen to live very close to the void center, the existence of the off-center galaxy clusters will lead to an observationally kinetic Sunyaev–Zeldovich effect due to their relative motion between the CMB frame. In Ref. [
236], Bellido
et al. demonstrated that the limited observations of only 9 clusters with large error bars already rule out LTB models with void sizes greater than 1.5 Gpc and a significant underdensity.
There have been many other interesting methods proposed to test the LTB models, including the Hubble constant measurement [
163], the redshift drift [
237,
238], the ionized Universe mirror [
239], the cosmic age test [
240], the constant curvature condition [
241], and so on. The test of the LTB models is related to the test of the Copernican principle, and this issue has drawn a lot of interest in recent years.
3.3.7 Comparison of dark energy models
The
analysis alone cannot provide an effective way to make a comparison among dark energy models. To enforce a comparison, a general way is to employ the information criteria (IC) [
242–
244]. The most frequently used IC are the Bayesian information criterion (BIC) [
245] and the Akaike information criterion (AIC) [
246], defined as
where is the maximum likelihood (satisfying under the Gaussian assumption), k is the number of the parameters of the considered model, and N is the number of data points used in the fit. Clearly, these statistics favor models that give a good fit with fewer parameters. Generally speaking, a ΔBIC of more than 2 (or 6) could be considered as positive (or strong) evidence against a model.
In Ref. [
195], based on the joint analysis of the SNIa+BAO+CMB data, Davis
et al. systematically studied a number of dark energy models and made a comparison among them. Utilizing their AIC and BIC values, the “rank” of these models are determined. The
CDM model achieves the best of all the models due to its nice fit to the data and the economy of parameters. A series of models, including the constant
w model, the CPL parametrization and the Cardessian expansion, can also provide comparably good fits but have more free parameters, thus are less favored by the ICs. Moreover, the dynamical behavior of these models all tend to collapse to the
CDM. The DGP and the standard Chaplygin gas models are clearly disfavored. More studies on the comparison among dark energy models have been performed with similar results obtained [
204,
206,
212,
233,
247–
251].
In all, although some dark energy models have been ruled out (or shown to be less optimistic) based on the current cosmological observations, we still need more observational data with higher precision to distinguish the various dark energy models.
3.4 Model-independent dark energy reconstructions
In addition to the cosmological constraints on specific dark energy models, another route of numerical studies, i.e., the model-independent dark energy reconstructions, has also drawn more and more attentions.
The dark energy reconstruction is a classic statistical inverse problem for the Hubble parameter
where is the dark energy density function. Different reconstruction method will give different . The main target of a dark energy reconstruction is to detect the dynamical property of dark energy. It is widely believed that the EOS of dark energy holds essential clues for the nature of DE, because it is related with through an integration
The model-independent dark energy reconstructions can be divided into four classes: (i) Specific Ansatz: assuming a specific parameterized form for and estimating the associated parameters. (ii) Binned Parametrization: dividing the redshift range into different bins and using a simple local basis representation for or . (iii) Polynomial Fitting: treating the dark energy density function as a free function of redshift and representing it by using the polynomial. (iv) Gaussian Process modeling: using a distribution over functions that can represent and estimating the statistical properties thereof. These four classes of reconstruction methods and the related research work will be introduced in the following.
3.4.1 Specific ansatz
The “specific ansatz” is the most popular approach currently. The key idea is assuming a specific parameterized form for and estimating the associated parameters. A simple and widely used ansatz is the XCDM ansatz, in which the EOS of dark energy is a constant, i.e., . This yields a simple form of
In Ref. [
252], by combining the WMAP5 observations with BAO and SN data, Komatsu
et al. obtained
at the 1
σ CL, while in Ref. [
184], a combination analysis of WMAP7+BAO+SN gave
. A more recent constraint on
by the SCP team [
135,
136] also presented the consistent result. So the current observations still favor
(i.e., cosmological constant).
Besides, one can also assume that the EOS of dark energy is not a constant. The most popular parametrization with dynamical
is the Chevallier–Polarski–Linder (CPL) parameterization [
253,
254], which assumes
. The corresponding
is given by [
252,
254]
Here
w0 denotes the value of the present EOS, while
wa denotes the variation of the EOS. The current observational data, such as the Union2 SNIa dataset [
135,
136] and the WMAP7 data [
184], still favor the result of
and
, which is consistent with the cosmological constant.
In addition, some other ansatzs have also been proposed, such as
[
256],
[
257],
[
257], and
[
259–
261]. For more research works of various parametrization forms, see Refs. [
262–
272] and references therein.
3.4.2 Binned parametrization
In addition to the specific ansatz, another popular approach is the binned parametrization. The binned parametrization was first proposed by Huterer and Starkman [
273] based on the principal component analysis (PCA) [
273,
274]. The key idea is dividing the redshift range into different bins and picking a simple local basis representation for
. The simplest way is setting
as piecewise constant in redshift, thus
can be written as [
275,
276]
where wi is the EOS parameter in the i-th redshift bin defined by an upper boundary at zi.
The optimal choice of redshift bins is still in debate. In Ref. [
277], Riess
et al. proposed a uniform, unbiased binning method, in which the number of SNIa in each bin times the width of each bin is a constant (i.e.,
). In Ref. [
278], Wang argued that one should choose a constant
for redshift slices, to ensure the variation of
H and
in each redshift slice remain roughly constant with
z. In Ref. [
279], we presented a new binned parametrization method, which treats
zi as models parameters and let them run freely in the redshift region of SNIa samples. This binning method can obtain smaller
and tighter error bars [
280,
281]. It should be mentioned that, since the current observational data at high redshifts (i.e.,
) are very rare, for the binned parametrization, only two parameters of EOS
can be constrained well [
282].
In addition to the piecewise constant parametrization, some other local basis representations for
are also proposed, such as wavelet [
283] and numerical derivatives [
284,
285].
3.4.3 Polynomial fitting
The third approach is the polynomial fitting method. The key idea is treating the dark energy density function as a free function of redshift and representing it by using the polynomial. Compared with the binned parametrization, the advantage of the polynomial fitting parametrization is that the dark energy density function can be reconstructed as a continuous function in the redshift range covered by the observational data.
A simple polynomial fit to
was proposed by Alam
et al. [
286], which is a truncated Taylor expansion
This ansatz has only three free parameters (
) since
for a flat Universe. Using this ansatz, Alam
et al. [
287] argued that the Tonry/Barris SNIa sample [
288,
289] appears to favor dark energy which evolves in time
†. Another interesting polynomial fit is the polynomial interpolation, which was proposed by Wang [
292]. It chooses different redshift points
, and interpolates
by using its own values at these redshift points. This yields
Here
and
. Based on the relation
, one parameter can be fixed directly, and only
model parameters need to be determined by the data. For more research work of this polynomial interpolation method, see Refs. [
293–
297].
3.4.4 Gaussian process modeling
The fourth approach is the Gaussian Process (GP) modeling, which is proposed by Holsclaw
et al. [
298,
299]. GP is a stochastic process indexed by
z. The defining property of a GP is that the vector that corresponds to the process at any finite collection of points follows a multivariate Gaussian distribution [
300,
301]. GPs are elements of an infinite dimensional space, and can be used as the basis for a nonparametric reconstruction method. They are characterized by a mean and a covariance function, defined by a small number of hyperparameters [
300–
302].
Based on the definition of a GP, one can assume that, for any collection , follows a multivariate Gaussian distribution with a constant negative mean and exponential covariance function written as
The hyperparameters and κ, and the parameters defining the likelihood, are determined by the data. The value of influences the smoothness of the GP realizations: for , the realizations are smooth with infinitely many derivatives, while leads to rougher realizations suited to modeling continuous non-(mean-squared)-differentiable functions. Moreover, one can set up the following GP for
Making use of the Eq. (39), one can take advantage of the particular integral structure of luminosity distance
expressed by
(see Refs. [
298,
299] for details).
4 Concluding remarks
We have reviewed theoretical models as well as observational and numerical studies of dark energy. Numerous work and papers have been done and written since the discovery of the accelerating expansion of the Universe, and it is impossible to cover even a small part of the heroic endeavors of our community in any review article.
However, the problem of understanding the nature of dark energy is as daunting as ever, or perhaps some already hold the key to this understanding without being commonly accepted yet. Clearly, there is a long long way to go for both theorists and experimentalists.
It is without any doubt that the process of detecting the nature of dark energy and understanding its origin will prove to be one of the most exciting stories in modern science.
© Higher Education Press and Springer-Verlag Berlin Heidelberg 2013