| Commit message (Collapse) | Author | Age |
|---|
| |
|
|
| |
This parameter defines the maximum number of time levels that a variable can have when being used for time prolongation. This allows using more time levels than prolongation_order_time+1.
|
| | |
|
| |
|
|
|
|
| |
Introduce global variable timelevel_offset in Carpet.
Pass timelevel_offset from Carpet to Requirements.
Use timelevel_offset when determining which timelevels are accessed.
|
| |
|
|
|
|
| |
* This can be used for determining which mode, or which refinement level or map, is taking up a lot of time in a simulation
* Add parameters to control whether local mode and each map are timed
* Time the transitions between modes
|
| |
|
|
|
|
| |
* Introduce a TimerTree class which contains a pointer to the root and current TimerNodes of that tree
* Adapt TimerNode and Timer classes to use TimerTrees rather than static variables
* Declare a main_timer_tree variable, which is the default tree to use if you don't specify one in Timer timer("timername")
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
This patch provides a function interface for accelerator (GPU) devices
to be called at certain points when Carpet traverses the schedule
tree. This can be used to copy data between the host (CPU) and the
device (GPU) as it is needed.
---
Carpet/Carpet/interface.ccl | 28 ++++++++++++++++++++++++++++
Carpet/Carpet/param.ccl | 6 ++++++
Carpet/Carpet/src/CallFunction.cc | 12 ++++++++++++
Carpet/Carpet/src/Comm.cc | 8 ++++++++
Carpet/Carpet/src/Cycle.cc | 4 ++++
Carpet/Carpet/src/Evolve.cc | 2 ++
Carpet/Carpet/src/Initialise.cc | 2 ++
Carpet/Carpet/src/Requirements.cc | 34 ++++++++++++++++++++++------------
Carpet/Carpet/src/variables.cc | 3 +++
Carpet/Carpet/src/variables.hh | 3 +++
10 files changed, 90 insertions(+), 12 deletions(-)
|
| | |
|
| | |
|
| | |
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Store the current Cactus time (and not a fake Carpet time) in the th
"time hiearchy". This removes the now redundant "leveltimes" data
structure in Carpet.
Add past time levels to th, so that it can store the time for past
time levels instead of assuming the time step size is constant. This
allows changing the time step size during evolution.
Share the time hierarchy between all maps, instead of having one time
hierarchy per map.
Simplify the time level cycling and time stepping code used during
evolution.
Improve structure of the code that loops over time levels for certain
schedule bins. Introduce a new Carpet variable "timelevel", similar
to "reflevel".
This also makes it possible to avoid time interpolation for the past
time levels during regridding. The past time levels of the fine grid
then remain aligned (in time) with the past time levels of the coarse
grid. This is controlled by a new parameter
"time_interpolation_during_regridding", which defaults to "yes" for
backwards compatibility.
Simplify the three time level initialisation. Instead of initialising
all three time levels by taking altogether three time steps (forwards
and backwards), initialise only one past time level by taking one time
step backwards. The remaining time level is initialised during the
first time step of the evolution, which begins by cycling time levels,
which drops the non-initialised last time level anyway.
Update Carpet and the mode handling correspondingly.
Update the CarpetIOHDF5 checkpoint format correspondingly.
Update CarpetInterp, CarpetReduce, and CarpetRegrid2 correspondingly.
Update CarpetJacobi and CarpetMG correspondingly.
|
| |
|
|
| |
Ignore-this: 309b4dd613f4af2b84aa5d6743fdb6b3
|
| |
|
|
| |
Remove include file defines.hh in Carpet.
|
| |
|
|
|
|
| |
Add new modes meta_early, meta_late, global_early, and global_late, which
execute like meta mode or global mode, but execut either as early or as
late as possible in the schedule.
|
| |
|
|
| |
darcs-hash:20071003194633-dae7b-3458d13967795174c30cfda376a825e3f251d95e.gz
|
| |
|
|
| |
darcs-hash:20070809202205-dae7b-baa50974f8519fcde0b1351b6bb3ea72606a6388.gz
|
| |
|
|
|
|
|
| |
Certain scheduling bins do not allow accessing past time levels. Set
the grid function pointers to past time levels to null in these.
darcs-hash:20070606203504-dae7b-df075bdeb5bea053b84d9e6f162796a5aac50540.gz
|
| |
|
|
| |
darcs-hash:20070112222609-dae7b-3384ff0d596d5c35a2dd3e2b26a2302cc0b84dc6.gz
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
| |
When looping over maps and components, remember whether to loop over
grid arrays or grid functions. Grid arrays have 1 map and nprocs
components, while grid functions can have many maps are many
components per map.
Add a corresponding grouptype argument to the mode handling functions
and macros.
Update all callers.
darcs-hash:20061003233704-dae7b-d0d0bf914405821ceddfd0339fac7a640b23c42b.gz
|
| |
|
|
|
|
|
|
|
| |
Store the domain specification that is used to set up the coarse grid.
This can be used later instead of querying the coordinate systems,
since querying them may be complicated in multi-block setups, and is
impossible before the coordinate thorn has been initialised.
darcs-hash:20060622023155-dae7b-914667c8c11a273df3f2674d0835be1ccace17e0.gz
|
| |
|
|
|
|
|
|
|
| |
The scheduler allocates global storage for grid functions piecewise.
It may allocate first some time levels, then some later. Do not check
whether there are sufficient time levels until the scheduler has
finished initialising.
darcs-hash:20060513224820-dae7b-0b409e7da1260d85ac39983072cb71787ac0078f.gz
|
| |
|
|
|
|
|
| |
Store the number of active time levels explicitly for each refinement
level and convergence level.
darcs-hash:20060413192937-dae7b-579ddb7ae741d73bb8bf6e0c87a4bff1c18f7c46.gz
|
| |
|
|
|
|
|
|
|
|
| |
Store the coarse grid spacing per individual map instead of globally.
Set and unset the grid spacing when entering or leaving singlemap
mode, not global mode. This breaks code that tries to access the
coarse grid spacing in the cGH in global mode.
darcs-hash:20060304173810-dae7b-2ee5d6bf3e9344b4a952d939ca0b97d120eecfdf.gz
|
| |
|
|
|
|
|
|
|
|
| |
Store the coarse grid spacing per individual map instead of globally.
Set and unset the grid spacing when entering or leaving singlemap
mode, not global mode. This breaks code that tries to access the
coarse grid spacing in the cGH in global mode.
darcs-hash:20051119212129-dae7b-ca0ccee9a08c988e44b9024b69e17da2d78d8cba.gz
|
| |
|
|
|
|
|
|
|
|
| |
Store the coarse grid spacing per individual map instead of globally.
Set and unset the grid spacing when entering or leaving singlemap
mode, not global mode. This breaks code that tries to access the
coarse grid spacing in the cGH in global mode.
darcs-hash:20051119212129-dae7b-2bfe457a182d4e7e3229ede412aad8ecf450417a.gz
|
| |
|
|
|
|
|
|
|
|
| |
Split MPI_COMM_WORLD according to a new parameter Carpet::model into
different sets, and evolve these sets independently.
Add aliased functions to query the MPI communicators for this
simulation and for all models.
darcs-hash:20050825084739-891bb-7f102b46ec495f884be5197eaf077eef93f89dac.gz
|
| |
|
|
|
|
|
|
|
| |
CarpetLib's comm_state class (actually, it's still just a struct) has been
extended to handle collective buffer communications for all possible C datatypes
at the same time. This makes it unnecessary for the higher-level communication
routines to loop over each individual datatype separately.
darcs-hash:20050815150023-776a0-dddc1aca7ccaebae872f9f451b2c3595cd951fed.gz
|
| |
|
|
|
|
|
|
| |
#define CARPET_NEW_REFFACT to indicate that the variable reffact does
not exist any more, so that code can work with both the old and the
new version of Carpet.
darcs-hash:20050502143429-891bb-f80074f9b95074f38b2542889519769c0143df77.gz
|
| |
|
|
|
|
|
|
|
|
| |
Add support for varying refinement factors. The spatial refinement
factors can be different in different directions, can be different
from the time refinement factor, and can be different on each level.
(However, the underlying spatial transport operators do currently not
handle any factors except two.)
darcs-hash:20050501205010-891bb-8d3a74abaad55ee6c77ef18d51fca2a2b69740de.gz
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Collective buffers are used to gather all components' data on a processor
before it gets send off to other processors in one go. This minimizes the
number of outstanding MPI communications down to O(N-1) and thus improves
overall efficiency as benchmarks show.
Each processor allocates a pair of single send/recv buffers to communicate
with all other processors. For this the class (actually, the struct) comm_state
was extended by 3 more states:
state_get_buffer_sizes: accumulates the sizes for the send/recv buffers
state_fill_send_buffers: gathers all the data into the send buffers
state_empty_recv_buffers: copies the data from the recv buffer back into
the processor's components
Send/recv buffers are exchanged during state_fill_send_buffers and
state_empty_recv_buffers. The constructor for a comm_state struct now takes
an argument <datatype> which denotes the CCTK datatype to use for the
attached collective buffers. If a negative value is passed here then it falls
back to using the old send/recv/wait communication scheme. The datatype
argument has a default value of -1 to maintain backwards compatibility to
existing code (which therefore will keep using the old scheme).
The new communication scheme is chosen by setting the parameter
CarpetLib::use_collective_communication_buffers to "yes". It defaults to "no"
meaning that the old send/recv/wait scheme is still used.
So far all the comm_state objects in the higher-level routines in thorn Carpet
(restriction/prolongation, regridding, synchronization) have been enabled to
use collective communication buffers.
Other thorns (CarpetInterp, CarpetIO*, CarpetSlab) will follow in separate
commits.
darcs-hash:20050330152811-776a0-51f426887fea099d1a67b42bd79e4f786979ba91.gz
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Change the way in which the grid hierarchy is stored. The new hierarchy is
map
mglevel
reflevel
component
timelevel
i.e., mglevel moved from the bottom to almost the top. This is
because mglevel used to be a true multigrid level, but is now meant to
be a convergence level.
Do not allocate all storage all the time. Allow storage to be
switched on an off per refinement level (and for a single mglevel,
which prompted the change above). Handle storage management with
CCTK_{In,De}creaseGroupStorage instead of
CCTK_{En,Dis}ableGroupStorage.
darcs-hash:20050201225827-891bb-eae3b6bd092ae8d6b5e49be84c6f09f0e882933e.gz
|
| |
|
|
| |
darcs-hash:20050128113401-891bb-51eae41cd181ee8fbce59f429906046c131ba1b0.gz
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Turn most of the templates in CarpetLib, which used to have the form
template<int D> class XXX
into classes, i.e., into something like
class XXX
by setting D to the new global integer constant dim, which in turn is set to 3.
The templates gf and data, which used to be of the form
template<typename T, int D> class XXX
are now of the form
template<typename T> class XXX
The templates vect, bbox, and bboxset remain templates.
This change simplifies the code somewhat.
darcs-hash:20050101182234-891bb-c3063528841f0d078b12cc506309ea27d8ce730d.gz
|
| |
|
|
| |
darcs-hash:20050101162121-891bb-ac9d070faecc19f91b4b57389d3507bfc6c6e5ee.gz
|
| |
|
|
|
|
| |
Replace all CVS header tags with the standard "$Header:$".
darcs-hash:20040918132147-891bb-dea889bdd94a479ec412d14d08e9efca63e5c24d.gz
|
| |
|
|
|
|
|
| |
Make Carpet ready for multiple patches.
Make the patch index available in a GH extension.
darcs-hash:20040521161623-07bb3-4f3148f677aff087d62828ed4b480fe8b412bc76.gz
|
| |
|
|
|
|
|
|
|
|
| |
Move checksum information variables into Checksum.cc, making them
private.
Introduce a helper type to break up the long names of mangled STL
types.
darcs-hash:20040324164451-07bb3-a5164039f45baa0b24b49555452a5074756a8220.gz
|
| |
|
|
| |
darcs-hash:20040323173829-07bb3-f0c6ed300fa4d6a86c64873fb58a17d61f76c95a.gz
|
| |
|
|
| |
darcs-hash:20040323114027-07bb3-1ac44b7b144e8936307942bc999d54ecb579719f.gz
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Import the recently announced changes:
1. Carpet has now an infrastructure for multiple maps (aka "grid
patches"). Instead of a single grid hierarchy there can now be
several. This is largely untested, because the remainder of Cactus
cannot handle multiple coordinate systems.
2. The order in which the schedule bins are called has changed. As Ian
Hawke pointed out, the previous order during time evolution was
inconsistent. The initial data ordering did not allow for recovering
and was not usable for progressively solving elliptic equations for
initial data.
3. Carpet now supports convergence levels. The convergence level
specifies by how many factors of two the resolution in the parameter
file should be coarsened (or refined, if negative). This should make
convergence tests and test runs much easier. It is, in principle, also
possible to run several convergence levels at once. This has not been
tested because the remainder of Cactus cannot handle multiple
resolutions. This will be necessary for a multigrid solver, and also
for having a shadow hierarchy to determine where to refine adaptively.
4. Carpet works together with the new CoordBase domain specification
parameters. Without these, using convergence levels will lead to very
strange results.
5. The "modes" have changed. There are now:
meta mode: the whole simulation
global mode: one convergence level
level mode: one refinement level
singlemap mode: one map on one refinement level
local mode: as previously
The whole mode handling has been cleaned up.
6. The regridding thorn has been cleaned up.
7. The kind of prolongation stencil is now determined in Carpet, i.e. at
a fairly hight level, instead of in CarpetLib.
8. The low-order prolongation operators have been made much more
efficient (as have previously the higher-order ones).
9. Assorted smaller changes.
For Carpet users, there should be no major incompatibilities. The major
improvements are 3 and 4 combined. Here is an example:
CoordBase::domainsize = extent
CoordBase::spacing = gridspacing
CoordBase::zero_origin_x = yes
CoordBase::zero_origin_y = yes
CoordBase::zero_origin_z = yes
CoordBase::xextent = 20.0
CoordBase::yextent = 20.0
CoordBase::zextent = 20.0
CoordBase::dx = 1.0
CoordBase::dy = 1.0
CoordBase::dz = 1.0
CoordBase::boundary_shiftout_x_lower = 1
CoordBase::boundary_shiftout_y_lower = 1
CoordBase::boundary_shiftout_z_lower = 1
Carpet::domain_from_coordbase = yes
Carpet::convergence_level = 0
grid::type = coordbase
grid::domain = octant
grid::avoid_origin = no
This gives you a grid that extends from the origin ("zero_origin") up to
20.0 with a grid spacing of 1.0. Symmetry zones and boundary zones are
added automatically. The "shiftout" says that there is no boundary
point on the origin. The staggering parameters (not shown) default to
"no". In order to change the resolution, only the convergence level
has to be adjusted. Note that the old way of specifying the domain
extent still works.
For Carpet developers, one major change is the new mode handling. As
described in 5, the looping macros (that loop over all refinement
levels, or all components) have changed.
darcs-hash:20040125135727-07bb3-51c9647c1b5080e7e180b52a1b81fa155cfd19e9.gz
|
|
|
darcs-hash:20010301114010-f6438-12fb8a9ffcc80e86c0a97e37b5b0dae0dbc59b79.gz
|
