Added release notes

Implements (partly) Cactus/937


git-svn-id: http://svn.cactuscode.org/flesh/trunk@2975 17b73243-c579-4c4c-a9d2-2d5706c11dac

1 files changed, 2965 insertions, 0 deletions

diff --git a/doc/ReleaseNotes b/doc/ReleaseNotes
new file mode 100644
index 00000000..50abe055
--- /dev/null
+++ b/doc/ReleaseNotes
@@ -0,0 +1,2965 @@
+Cactus Release Notices
+CVS Version: $Header: /mnt/data2/cvs2svn/cvs-repositories/Cactus/doc/ReleaseNotes,v 1.1 2002-08-20 13:29:32 allen Exp $
+
+These notices can also be found on the Cactus web pages
+http://www.cactuscode.org/Development/ReleaseNotices.html
+
+==============================================================================
+==============================================================================
+
+Release Notices for Cactus 4.0 beta 12
+======================================
+Date: June 7, 2002
+
+Released modules:
+================
+      Cactus
+      CactusBase
+      CactusBench
+      CactusConnect
+      CactusEinstein
+      CactusElliptic
+      CactusExamples
+      CactusExternal
+      CactusIO
+      CactusPUGH
+      CactusPUGHIO
+      CactusTest
+      CactusUtils
+      CactusWave
+
+New thorns:
+==========
+      CactusPUGHIO/IOHDF5           (formerly in AlphaThorns)
+      CactusPUGHIO/IOHDF5Util       (formerly in BetaThorns)
+      CactusPUGHIO/IOStreamedHDF5   (formerly in BetaThorns)
+      CactusPUGHIO/IOPanda          (formerly in AlphaThorns)
+      CactusExamples/HelloWorld
+      CactusExamples/SampleIO
+      CactusExamples/DemoInterp     (former CactusTest/TestInterp)
+      CactusConnect/Socket          (formerly in BetaThorns)
+      CactusBase/LocalInterp        (formerly in BetaThorns)
+      CactusTest/TestInterp         (replaced by new version)
+      CactusEinstein/ADMAnalysis
+      CactusEinstein/ADMBase
+      CactusEinstein/ADMConstraints
+      CactusEinstein/CoordGauge
+      CactusEinstein/EvolSimple
+      CactusEinstein/IDSimple
+      CactusEinstein/SpaceMask
+      CactusEinstein/StaticConformal
+
+Removed thorns:
+==============
+      CactusPUGHIO/IOHDF5 (replaced by new version from AlphaThorns arrangement
+      CactusElliptic/EllTest
+      CactusEinstein/Einstein
+
+Deprecated thorns:
+=================
+
+New supported architectures / operating systems
+===============================================
+
+Fujitsu VPP300, VPP700, VPP5000
+IA32/OpenBSD 3.0 and 3.1
+IA32/Windows XP
+
+CVS Tag:
+
+Cactus_4_0_Beta_12
+
+==============================================================================
+
+
+CHANGES FOR BETA 12
+===================
+
+Utilities
+=========
+
+Testsuites:
+      New scripts for running and comparing testsuites with more options
+      and output.
+
+Flesh
+=====
+
+Key/value tables:
+      A standard API to store, query and, pass around key/value tables.
+      A table holds a set of key/value pairs, where the key is a character
+      string and the value may be a scalar or 1-dimensional array of any
+      Cactus data type (character, integer, real number, or complex number).
+      The table API will be used by other Cactus APIs such as hyperslabbing,
+      reduction, interpolation, and I/O thorns to pass optional information.
+      (There's a new chapter in the User's Guide on how to use the table API.)
+
+Vector groups:
+      Can have a group of variables which appears as a one
+      dimensional array of the sources, with the number of GVs in
+      this group decided at run time.
+
+Additions of array sizes:
+      can specify sizes by integer constants or parameters (from
+      same thorn or shared parameter) which may be used in arithmetic
+      operations (using *,+,/,-,%,^)
+
+Scheduler:
+      STORAGE lines in the schedule.ccl file must now indicate how
+      many timelevels to use, for grid variables with more than one
+      timelevel.
+
+Array parameters:
+      A parameters can now be an array of values instead of just a
+      single number.
+
+Accumulator parameters:
+      A parameter value can now be automatically built from the
+      values of other parameters.
+
+Parameter aliasing:
+      Parameters can now be given a different name from their
+      original definition in the sources, or other thorns which
+      use them.  This can be used to prevent conflicts when
+      using or extending a parameter from another implementation.
+
+TAGS on groups:
+      Groups can now have an optional tags table (a set of key value
+      pairs) associated with them.  These can be queried and
+      manipulated through the standard table interface.
+
+
+Util Thorns
+===========
+
+CactusBase/LocalInterp:
+      This thorn provides interpolation local to a processor.  It includes
+      the former PUGHInterp CCTK_InterpLocal() interpolator, and a new
+      CCTK_InterpLocalUniform() interpolator.
+
+CactusConnect/Socket:
+      This thorn provides platform-independent socket I/O functionality
+      which can be used by other thorns.
+      Thorns CactusConnect/HTTPD and CactusPUGHIO/IOStreamedHDF5 now inherit
+      from thorn Socket.
+
+New I/O thorns:
+      IOHDF5, IOHDF5Util, IOStreamedHDF5, and IOPanda were moved from their
+      development arrangements into production mode. They provide new I/O
+      methods for output of arbitrary grid variables (and hyperslabs thereof)
+      in HDF5 and IEEEIO file format.
+
+Reorganization of I/O Parameters:
+      Some I/O parameter names changed in order to make the naming scheme
+      consistent between all I/O thorns. The old parameter names are still
+      there and can be used. A perl script is provided to rename the changed
+      I/O parameters in your parameter files automatically:
+
+        http://www.cactuscode.org/Development/Release/FixParametersForBETA13.pl
+
+CactusBase/IOUtil:
+      The new filenaming scheme for output files is now the default.
+      This effects all existing testsuites because the output filenames
+      changed.
+      The old scheme can be selected by setting IO::new_filename_scheme = "no".
+
+CactusBase/IOASCII:
+CactusIO/IOJpeg:
+CactusPUGHIO/IOHDF5:
+CactusPUGHIO/IOStreamedHDF5:
+CactusPUGHIO/IOFlexIO:
+CactusPUGHIO/IOPanda:
+CactusExamples/SampleIO:
+      The option 'out_every' can be set in an option string of the 'out_vars'
+      I/O parameter to set the output frequency for individual variables.
+
+CactusPUGHIO/IOHDF5:
+CactusPUGHIO/IOStreamedHDF5:
+CactusPUGHIO/IOFlexIO:
+CactusPUGHIO/IOPanda:
+      The options 'origin', 'direction', 'extent', and 'downsample' can be
+      set as hyperslab parameters in an option string of the 'out_vars' I/O
+      parameter to specify a hyperslab selection for individual variables.
+
+
+Einstein Thorns
+===============
+
+The Einstein thorns were reworked for Beta 12, essentially breaking up
+the former CactusEinstein/Einstein into more modular components. Much
+more documentation for the Einstein thorns is now available in the
+ThornGuide.
+
+Refer to the web pages at
+
+      www.cactuscode.org/Community/Relativity.html
+
+for a complete description.
+
+Test Thorns
+===========
+
+CactusTest/TestInterp
+      This is a new test driver for interpolators, which tests 3 different
+      interpolator APIs: CCTK_InterpGV(), CCTK_InterpLocal(), and
+      CCTK_InterpLocalUniform().
+
+
+==============================================================================
+
+
+KNOWN BUGS IN BETA 12
+=====================
+(See Cactus bug tracking system for a complete list)
+
+ * The testsuite test_wavef90_zero.par from CactusWave/WaveToyF90 doesn't
+   pass on most platforms because of uninitialized boundaries.
+
+ * The testsuite test_maximal_1.par from CactusEinstein/Maximal doesn't
+   pass on multiple processors.
+
+ * Recovering and file reading from chunked files doesn't work because
+   of a bug in the I/O and hyperslabbing code.
+   You should recombine the files into a single unchunked fike and restart
+   from that one instead.
+
+ * Some testsuites from thorn CactusTest/TestInterp are reported as failing
+   on a few platforms although the created output files only differ in
+   machine precision. This is because the Cactus testsuite script cannot
+   be configured yet to use different precisions when comparing individual
+   output files in the same testsuite.
+
+
+==============================================================================
+
+
+WHAT TO EXPECT IN BETA 13
+=========================
+
+Improved interfaces for Interpolation and Reduction
+
+==============================================================================
+
+
+TEST MACHINES NOTES
+===================
+
+ Notes:
+
+ 1. CactusElliptic/EllPETSc only tested on Linux IA32 and SGI 64 bit
+ 2. CactusPUGHIO/IOPanda only tested with MPI configurations
+ 3. On Cray T3E, SP3, and Fujitsu systems the ThornList had to be split into
+    two separate lists because the bindings library wouldn't build otherwise
+    (argument line to ar command too long).
+
+
+  * Intel IA32 (Linux Redhat 7.2, LAM/MPICH)
+
+     o gullveig.aei.mgp.de w/wo MPI (Intel ifc/icc 6.0)
+       - testsuites failing
+         CactusWave/WaveToyF90 (test_wavef90_zero.par)
+
+     o gullveig.aei.mgp.de w/wo MPI (Absoft f90, gcc 2.76)
+       - testsuites failing
+         CactusWave/WaveToyF90 (test_wavef90_zero.par)
+
+     o platinum.ncsa.uiuc.edu w/wo MPI (Portland C/C++/Fortran compilers 3.3-2)
+       - testsuites failing
+         CactusWave/WaveToyF90 (test_wavef90_zero.par)
+         CactusEinstein/IDBrillData (test_wsor.par)
+
+
+  * Intel IA64 (Linux ia64 2.4.16)
+
+     o titan.ncsa.uiuc.edu  Intel C/C++/F90 wo MPI
+       - testsuites failing
+         CactusWave/WaveToyF90 (test_wavef90_zero.par)
+
+
+ * Intel IA32 (Windows XP/Windows NT, Digital Fortran 6.0, MSVC++ ??)
+
+    o gullveig.aei-potsdam.mpg.de wo MPI
+      - not compiling (HDF5 not installed)
+          CactusPUGHIO/IOHDF5Util
+          CactusPUGHIO/IOHDF5
+          CactusPUGHIO/IOStreamedHDF5
+
+      - testsuites failing
+          CactusEinstein/ADM (test_ADMadj.par)
+          CactusEinstein/ADMConstraints (ADMConstraints_Shift.par)
+
+
+ * SGI 64 bit (Irix 6.5, MIPSPro f90/cc/CC (7.3.1.2m), Native MPI)
+
+    o origin.aei-potsdam.mpg.de, w/wo MPI
+
+
+ * SGI 32 bit (Irix 6.5, MIPSpro f90/cc/CC (7.2.1))
+
+    o lux.aei-potsdam.mpg.de w native compilers wo MPI
+      - not compiling
+          CactusEinstein/TimeGeodesic
+
+      - testsuites failing
+          CactusEinstein/ADMConstraints (ADMConstraints_Shift.par)
+
+
+ * Dec Alpha (OSF1 V5.1, Compaq cc(6.4-014) C++(6.3-008) f90 (5.5-1877),
+              Elan MPI)
+
+    o lemieux.psc.edu, w/wo MPI
+      - testsuites failing
+          with MPI some testsuites are failing but it looks like a transient
+          file problem
+
+
+ * Dec Alpha (OSF1 V4.0, c++(gcc version 2.8.1) DIGITAL Fortran 90 V5.2-705,
+              w/wo MPI)
+
+    o holodec19.aei-potsdam.mpg.de
+      - testsuites failing
+          CactusWave/WaveToyF90 (test_wavef90_zero.par)
+
+
+ * IBM SP3 (AIX 4.3.3.0)
+
+    o seaborg.nersc.gov with native compilers, native MPI
+      - testsuites failing
+        CactusWave/WaveToyF90 (test_wavef90_zero.par)
+
+
+ * Cray T3E (Unicos 2.0.5.54)
+
+    o pc.rzg.mpg.de with native MPI
+      - testsuites failing
+          CactusEinstein/ADMConstraints (ADMConstraints_Shift.par)
+          CactusEinstein/AHFinder (test_AHF_1.par)
+          CactusEinstein/IDBrillData (test_wsor.par)
+          CactusEinstein/Maximal (test_maximal_1.par)
+          BetaThorns/Cartoon2D (test_cartoon_3.par)
+
+
+ * Sun Sparc II (SunOS 5.7)
+
+    o pitcairn.mcs.anl.gov with native compilers, no MPI
+      - not compiling:
+        CactusEinstein/TimeGeodesic (internal compiler error on exa_dt.F)
+
+      - testsuites failing
+        CactusWave/WaveToyF90 (test_wavef90_zero.par)
+        BetaThorns/Cartoon2D (test_cartoon_3.par)
+
+
+ * MacOS X (Darwin Kernal Version 5.4)
+
+    o seidelg4.aei-potsdam.mpg.de
+      [Absoft F90, Apple C/C++ (gcc 2.95.2), MPICH or LAM]
+
+
+ * Hitachi SR8000-F1 (HI-UX/MPP)
+
+    o sr8000.lrz-muenchen.de with native compilers, native MPI
+      - not compiling:
+        CactusTest/TestInterp (C++ compiler doesn't know name spaces)
+
+      - testsuites failing
+        CactusWave/WaveToyF90 (test_wavef90_zero.par)
+        CactusEinstein/IDBrillData (test_brilldata_1.par)
+        CactusEinstein/IDBrillData (test_brilldata_2.par)
+
+
+ * Fujitsu VPP700
+
+    o vpp1.lrz-muenchen.de with native compilers, native MPI
+      - not compiling:
+        CactusTest/TestInterp (C++ compiler doesn't know name spaces)
+        The configuration with all CactusEinstein thorns couldn't be
+        built (linker command line too long).
+
+      - testsuites failing
+        CactusWave/WaveToyF90 (test_wavef90_zero.par)
+
+
+==============================================================================
+==============================================================================
+
+Release Notices for Cactus 4.0 beta 11
+======================================
+Date: January 28, 2002
+
+Released modules:
+================
+      Cactus
+      CactusBase
+      CactusBench
+      CactusConnect
+      CactusEinstein
+      CactusElliptic
+      CactusExamples
+      CactusExternal
+      CactusIO
+      CactusPUGH
+      CactusPUGHIO
+      CactusTest
+      CactusUtils
+      CactusWave
+
+New thorns:
+==========
+      CactusExamples/FleshInfo
+      CactusExamples/TimerInfo
+      CactusEinstein/Maximal
+      CactusTest/TestStrings
+      CactusTest/TestTimers
+
+Removed thorns:
+==============
+      CactusPUGH/Interp (replaced in beta10 by CactusPUGH/PUGHInterp)
+   
+Deprecated thorns:
+=================
+      None
+
+CVS Tag: Cactus_4_0_Beta_11
+
+==============================================================================
+
+
+CHANGES FOR BETA 11
+===================
+
+Flesh
+=====
+
+Interface:
+	Initial support for vector grid variables
+
+	Array sizes can be specified by expressions
+
+Configuration:
+	Re-configuration with same extra options (e.g. MPI or HDF5) no longer
+	rebuilds whole configuration.
+
+        Implemented user defaults for configuration contained in the file
+        $HOME/.cactus/config or $CACTUSRC/.cactus/config
+
+        Changed order of precedence for configuration options, now command line
+        options override all others
+
+Compilation:
+	New architecture: Fujitsu VPP700
+ 
+	Can now have thorns with no source files.
+
+        Less recompilation necessary eg with HDF5, MPI
+
+Makefile:
+	New targets to display configuration information
+	gmake configinfo
+	gmake <config>-configinfo
+
+Thorn Activation:
+	The ActiveThorns parameter is now checked for self-consistency 
+	and you are no longer able to incorrectly activate a thorn
+	without activating thorns providing implementations a thorn inherits
+	from or has declared itself a friend of.
+
+New Utility Functions:
+	StringList routines - routines which deal with a fixed-sized
+                              sorted list of strings
+	Util_asprintf,Util_asnprintf,Util_snprintf,Util_vsnprintf
+	added to allow people to use these functions portably.
+
+        Key-value table routines (the Cactus equivalent of perl hash tables).
+        (The general API is Util_Table****)
+
+        New chapter added to User Guide for Utility functions, including
+        complete description of Key-value routines.
+        
+Driver:
+	Added flesh support for grid arrays to be specified with given 
+        integer dimensions, in addition to parameter values. Parameters
+        and integers can also be combined with a +/-
+
+        Grid scalars should now be activated with the STORAGE tag in the
+        schedule.ccl files. (This influencing their treatment by thorns,
+        for example initialisation in drivers and output by IO methods).
+
+	API for some Fortran driver subroutine calls changed to include
+	a (missing) integer error argument ierr:
+
+	CCTK_Barrier(ierr, <as before>)
+        CCTK_SyncGroup(ierr, <as before>)
+	CCTK_SyncGroupI(ierr, <as before>)
+	CCTK_SyncGroupWithVar(ierr, <as before>)
+	CCTK_SyncGroupWithVarI(ierr, <as before>)
+ 
+	[NOTE for those using CCTK_SyncGroup routines:
+	 Please check whether you really need to sync directly, or 
+	 whether if it can be moved into the schedule.ccl
+         enabling the scheduler do control ghostzone syncronisation. 
+	 This will be the only way Cactus can guarantee your code to work 
+	 with techniques such as AMR and automatic cache-aware subblocking 
+	 once those are available.]
+
+Coordinates:
+	New API to allow thorns providing functions to register and
+	obtain the extent of the physical grid (using indices).
+	
+	CCTK_CartRegisterRangePhysIndex
+	CCTK_CartRangePhysIndex
+
+Termination:
+	There is now a keyword parameter "terminate" to decide whether
+	to terminate the evolution loop by "iteration", "time", "either",
+	"both" or "never".
+
+Timers:
+	Fortran wrappers and documentation added for using Cactus timers
+
+Checkpointing:
+	The very first POSTSTEP schedule bin is now before 
+	RECOVER_VARIABLES, so that POSTSTEP routines no longer run twice 
+	on the same timestep after recovery.
+
+New functions:
+	There are several new functions for obtaining information from
+	the flesh about IO methods, reduction operators, interpolation
+	operators and coordinate systems. An example of using these 
+	functions is provided in the new thorn CactusExamples/FleshInfo
+ 
+Util Thorns
+===========
+
+CactusBase/IOUtil:
+	Parameters added to copy a parameter file to the output directory,
+	or to generate one sorted by thorns (see IO::parfile_write and 
+	IO::parfile_name)
+
+CactusBase/Time:
+	Negative timesteps are now supported.
+
+CactusBase/IOASCII:
+        New parameters out1D_style, out1D_style (deprecating out_style) 
+        to specify the type of output to perform for xgraph, gnuplot.
+	Diagonal output added for non-cubic grids
+	IOASCII now outputs all relevent slabs of data from 1D, 2D or 
+        3D grid arrays
+
+CactusBase/Boundary:
+	Robin boundary conditions added
+
+CactusPUGH/PUGH:
+	Implementation of integer specified grid array sizes
+	Respect storage for grid scalars
+	New debugging function PUGH_PrintStorage(cctkGH) prints the
+	variables with storage allocated to screen
+
+CactusUtil/NaNChecker
+	Now has an API for calling the NaNChecker directly from thorns,
+	and for setting the grid variables to NaNs. The NaNChecker can
+	also be used for chosen timelevels.
+
+
+Einstein Thorns
+===============
+
+CactusEinstein/AHFinder:
+	Improved IO layer of AHFinder
+	AHFinder is now scheduled at ANALYSIS
+
+CactusEinstein/Einstein
+	Isotropic Schwarzschild initial lapse added
+
+
+==============================================================================
+
+
+KNOWN BUGS IN BETA 11
+=====================
+(See Cactus bug tracking system for a complete list)
+
+==============================================================================
+
+
+WHAT TO EXPECT IN BETA 12
+=========================
+
+Improved interfaces for Interpolation and Reduction
+Thorn LocalInterp for interpolation local to a processor
+
+==============================================================================
+
+
+TEST MACHINES NOTES
+===================
+
+[Note: CactusElliptic/EllPETSc only tested on Linux IA32 and SGI 64 bit]
+
+           * MacOS X (Darwin Kernal Version 5.2)
+                o seidelg4.aei-potsdam.mpg.de 
+	          [Absoft F90, gcc 2.95.2, MPICH or LAM]
+
+	        - not compiling because of buggy C preprocessor
+			CactusBase/Boundary (fix available on Cactus web pages)
+		- notes
+			CactusEinstein/ADM and CactusEinstein/AHFinder can only
+			be compiled without optimisation
+
+           * SGI 64 bit (Irix 6.5)
+                o origin.aei-potsdam.mpg.de, w/wo native MPI
+		- testsuites failing
+			CactusEinstein/IDBrillData
+
+           * SGI 32 bit (Irix 6.5)
+                o nott.aei-potsdam.mpg.de w native compilers wo MPI 
+
+           * Cray T3E (Unicos mk2.0.5.X)
+                o berte.zib.de w/wo native MPI
+                - failing testsuites
+			CactusEinstein/AHFinder
+			CactusEinstein/IDBrillData (on multiprocessors)
+
+           * Sun Sparc II (SunOS 5.7)
+                o pitcairn.mcs.anl.gov with native compilers, no MPI
+		- not compiling
+			CactusEinstein/TimeGeodesic
+
+	   * IBM SP2 (AIX 4.3.3.0)
+                o seaborg.nersc.gov with native compilers, MPI
+
+           * Intel IA64 (Linux ia64 2.4.13)
+                o  ia64.osc.edu  Intel C/C++/F90 w/wo MPICH Myrinet
+	
+	   * Intel IA32 (Linux Redhat 6.2)
+		o xeon01.aei.mpg.de w/wo MPICH (shmem device)
+
+                Fortran compiler: Intel icc/F90
+
+                o bifrost.aei-potsdam.mpg.de w/wo MPICH (p4 and shmem devices)
+
+	        Fortran compiler: Absoft F90
+
+	        Fortran compiler: Lahey F90
+
+	        Fortran compiler: Vast F90
+                - not compiling: 
+			CactusEinstein/AHFinder
+
+	        Fortran compiler: g77 F77
+		- not compiling
+			Fortran77/90 thorns
+
+                o bifrost.aei-potsdam.mpg.de w LAM
+
+	        Fortran compiler: Absoft F90
+                - not compiling: 
+			CactusEinstein/TimeGeodesic (compiles without LAM MPI)
+
+           * Intel IA32 (Windows 2000)
+                o gullveig.aei-potsdam.mpg.de wo MPI
+		- not compiling
+			CactusConnect/HTTPDExtra
+			CactusUtils/NaNChecker
+
+           * Dec Alpha (OSF1 V4.0 1229 alpha)
+                 o holodec01.aei.mpg.de wo MPI
+
+	   * Hitachi SR8000-F1 (HI-UX/MPP)
+                o sr8000.lrz-muenchen.de with native MPI and compilers
+                - failing testsuites
+			CactusEinstein/AHFinder
+			CactusEinstein/IDBrillWave
+
+           * Fujitsu VPP700
+                o vpp1.lrz-muenchen.de with native compilers, native MPI
+                - not compiling because of peculiar fortran compiler
+			CactusEinstein/AHFinder 
+			(minval, maxval, trim not recognized as 
+			 intrinsic functions)
+
+
+==============================================================================
+==============================================================================
+
+Release Notices for Cactus 4.0 beta 10
+======================================
+Date: May 15th 2001
+
+Released modules:
+================
+      Cactus
+      CactusBase
+      CactusBench
+      CactusConnect
+      CactusEinstein
+      CactusElliptic
+      CactusExamples
+      CactusExternal
+      CactusIO
+      CactusPUGH
+      CactusPUGHIO
+      CactusTest
+      CactusUtils
+      CactusWave
+
+New thorns:
+==========
+   
+CactusUtils/NaNChecker
+CactusPUGH/PUGHInterp
+
+Deprecated thorns:
+=================
+
+CactusPUGH/Interp (removed for next release)
+
+CVS Tag: Cactus_4_0_Beta_10
+
+==============================================================================
+
+
+CHANGES FOR BETA 10
+===================
+
+Flesh
+=====
+
+Timelevels:
+	Changed the calling order in default Evolve routines so that
+	timelevels are rotated before the evolution step. See
+
+	www.cactuscode.org/Development/Specs/TimeLevels.txt for details.
+
+	The naming convention for different timelevels also changed, so that
+        e.g. phi, phi_p, phi_p_p is used instead of phi_n, phi, phi_p
+
+        Also, the current timelevel always has the index 0.
+
+Interpolation:
+	Made needed changes to the interpolation interface, and also 
+	removed some unnecessary APIs. Since rather a lot has changed
+	we refer you to the Interpolation and Function Reference section of 
+	the Users Guide and also to the documentation of the new thorn
+	CactusPUGH/PUGHInterp. 
+
+Parameters:
+	Re-worked the parameter checking section of the flesh, everything
+	should be the same, apart from by default Cactus will stop with
+	an error if you have a parameter in your parameter file which isn't
+	found despite being from an active thorn.
+
+	There is a new command line option -parameter-level which can be
+	set to relaxed, normal (default), or strict to give more or less
+	parameter checking. 
+
+Compilation:
+	New architecture: MacOSX. At the moment we don't have access
+        to a fortran compiler, or MPI with MacOSX, but single processor
+        C thorns are working.
+
+	Added cache information and standard optimisation flags for 
+	Hitachi SR-8000, now Cactus runs a lot quicker there!
+
+        Libraries are now only updated, and the executable rebuilt if
+        code has actually changed.
+	
+Configuration:
+        Added USE_RANLIB option to have the make system use ranlib to 
+        generate the index of each library.  Thus the configuration line
+        or the known-architecture file can now set USE_RANLIB=yes.
+
+Function Aliasing:
+	Added first implementation of Function Aliasing for thorn functions.
+	At the moment working for C functions which have Cactus arguement
+	and return types, and the aliased functions can be called from
+	C or Fortran thorns.
+
+Fortran Strings:
+	Tidied up the fortran string macros to make them more consistent,
+        now they are
+
+	ONE_FORTSTRING_ARG
+	TWO_FORTSTRING_ARG
+	THREE_FORTSTRING_ARG
+	ONE_FORTSTRING_CREATE(arg1)
+	TWO_FORTSTRING_CREATE(arg1,arg2)
+	THREE_FORTSTRING_CREATE(arg1,arg2,arg3)
+	ONE_FORTSTRING_PTR(arg1)
+	TWO_FORTSTRING_PTR(arg1, arg2)
+	THREE_FORTSTRING_PTR(arg1, arg2, arg3)
+
+	The old ones (which have "s"s in seemingly random places), are
+	deprecated. Also fixed up the documentation for these in the 
+	Users Guide.
+
+Documentation:
+	Added new gmake target
+	
+	gmake ThornGuide
+
+	which gathers together the documentation,  provided in each thorn,
+        and parses the configuration files to produce documentation for 
+        all the thorns in the arrangements directory. The documentation
+        is placed in ThornGuide.ps in the home Cactus directory.
+
+        gmake <config>-ThornGuide 
+
+        will produce documentation for just the thorns in <config>, and
+        place it is ThornGuide-<config>.ps in the home Cactus directory.
+
+Util Thorns
+===========
+
+CactusBase/Boundary: 
+	Added directional boundary conditions 
+	(see documentation.tex in thorn)
+
+CactusPUGH/PUGH
+	The parameter enable_all_storage works again.
+        The parameter initialize_memory was added, when cactus allocatates
+        memory it can be uninitialised (default), NaN (useful for debugging),
+        or zeroed (if you're a little lazy). The NaN option is useful 
+        in conjuction with the NaNChecker thorn
+
+CactusPUGH/PUGHInterp:
+	New C version of standard interpolator to replace the old Fortran
+	version. This version should also be about twice as fast as the old
+	version. The main change for users from before is that there is 
+        no parameter in PUGHInterp to set the order of interpolation, 
+	instead 1st, 2nd and 3rd order interpolation are registered as 
+	different interpolation operators. This allows users to choose from
+	an application thorn which order to use, and does not force all 
+	calls to the interpolator to have the same order.
+
+	New names for interpolation operations are:
+		* first-order uniform cartesian
+		* second-order uniform cartesian
+		* third-order uniform cartesian
+
+        The old thorn CactusPUGH/Interp will be removed in the next 
+        release, so please move over to PUGHInterp.
+
+CactusUtils/NaNChecker:
+       New simple thorn, very useful for debugging to find NaNs in 
+       Cactus variables.
+
+HDF5 Tools:
+	Recombiner
+
+Einstein Thorns
+===============
+
+==============================================================================
+
+
+KNOWN BUGS IN BETA 10
+=====================
+(See Cactus bug tracking system for a complete list)
+
+==============================================================================
+
+
+WHAT TO EXPECT IN BETA 11
+=========================
+
+==============================================================================
+
+
+TEST MACHINES NOTES
+===================
+
+           * MacOS X (Darwin Kernal Version 1.3)
+                o g4.aei-potsdam.mpg.de with gcc 2.95.2 
+	        - not compiling
+			Fortran77/90 thorns (no Fortran compiler installed)
+	
+	   * Intel IA32 (Linux Redhat 6.2)
+                o bifrost.aei-potsdam.mpg.de w/wo MPICH (p4 and shmem devices)
+
+	        Fortran compiler: Absoft F90
+                - not compiling: 
+			CactusElliptic/EllPETSc (compiles with MPI)
+
+	        Fortran compiler: Lahey F90
+                - not compiling: 
+			CactusElliptic/EllPETSc (compiles with MPI)
+
+	        Fortran compiler: Vast F90
+                - not compiling: 
+			CactusElliptic/EllPETSc (compiles with MPI)
+			CactusEinstein/AHFinder
+
+	        Fortran compiler: g77 F77
+		- not compiling
+			Fortran77/90 thorns
+
+                o bifrost.aei-potsdam.mpg.de w LAM
+
+	        Fortran compiler: Absoft F90
+                - not compiling: 
+			CactusEinstein/TimeGeodesic (compiles without LAM MPI)
+			CactusElliptic/EllPETSc     (PETSc compiled for MPICH)
+			
+           * Cray T3E (Unicos mk2.0.5.X)
+                o berte.zib.de w/wo native MPI
+                - not compiling:
+			CactusElliptic/EllPETSc (PETSc not installed)
+                - failing testsuites
+			test_AHF_1
+                 
+           * Dec Alpha (OSF1 V4.0 1229 alpha)
+                 o holodec05.aei.mpg.de with gcc 2.8.1, 
+                   HDF5, and MPICH (ch_shmem)
+                 - not compiling
+			Cactus/Elliptic/EllPETSc (PETSc not installed)
+                 - failing testsuites
+			test_AHF_1
+			test_AHF_2
+
+	   * IBM SP2 (AIX 4.2.0.0)
+                o quad.mcs.anl.gov with native compilers, MPI
+	        - not compiling
+      	          CactusElliptic/EllPETSc (PETSc not installed)
+
+           * SGI 64 bit (Irix 6.5)
+                o origin.aei-potsdam.mpg.de, w/wo native MPI
+		- not compiling
+			CactusElliptic/EllPETSc (PETSc not installed)
+                  
+           * SGI 32 bit (Irix 6.5)
+                o bug.aei-potsdam.mpg.de w native compilers wo MPI 
+		- not compiling
+			CactusElliptic/EllPETSc (PETSc not installed)
+
+           * Intel IA64 (TurboLinux Frontier 2.3.99-pre6-000501-18)
+                o  SGI gcc and f90 wo MPI
+		- not tested
+
+           * Intel IA32 (Windows NT 4.0)
+                o ntsc-ts1.ncsa.uiuc.edu w/wo MPI (HPVM)
+		- not tested
+
+           * Intel IA32 (Windows 2000)
+                o ctclogin1.tc.cornell.edu w/wo MPI (MPIPro)
+                - system change has broken CST, workaround in beta11
+
+           * Intel IA32 (Windows 2000)
+                o VM on fandango.aei-potsdam.mpg.de wo MPI
+		- not compiling
+			CactusElliptic/EllPETSc (PETSc not installed)
+			CactusPUGHIO/IOHDF5 (HDF5 not installed)
+			CactusUtils/NanChecker (no isnan function)
+		- failing testsuites
+			test_WaveToy2D
+
+           * Sun Sparc II (SunOS 5.7)
+                o pitcairn.mcs.anl.gov with native compilers, no MPI
+		- not compiling
+			CactusElliptic/EllPETSc (PETSc not installed)
+			CactusEinstein/TimeGeodesics
+
+	   * Hitachi SR8000-F1 (HI-UX/MPP)
+                o sr8000.lrz-muenchen.de with native MPI and compilers
+                - not compiling:
+			CactusElliptic/EllPETSc (PETSc not installed)
+			CactusEinstein/TimeGeodesic 
+                        (gmake and MPI installation problem)
+                - could only test on 1 processor (no more procs available)
+                  AHFinder output has spaces in a single fp number which
+                  is treated as an error by Runtest.pl
+
+
+==============================================================================
+==============================================================================
+
+Release Notices for Cactus 4.0 beta 9
+=====================================
+Date: 21st December 2000
+
+Released modules:
+================
+      Cactus
+      CactusBase
+      CactusBench
+      CactusConnect
+      CactusEinstein
+      CactusElliptic
+      CactusExamples
+      CactusIO
+      CactusPUGH
+      CactusPUGHIO
+      CactusTest
+      CactusWave
+      CactusExternal
+
+New thorns:
+==========
+   
+      CactusConnect arrangement
+      CactusIO arrangement
+      CactusExternal arrangement
+
+      CactusConnect/HTTPD
+      CactusConnect/HTTPDExtra
+      CactusExternal/FlexIO
+      CactusExternal/jpeg6b
+      CactusIO/IOJpeg
+      CactusPUGH/PUGHReduce
+      
+
+Removed thorns:
+==============
+
+      external arrangement
+      external/IEEEIO (moved to CactusExternal/FlexIO)
+      external/TCPXX
+      external/RemoteIO
+      external/jpeg6b (moved to CactusExternal/jpeg6b)
+
+CVS Tag: Cactus_4_0_Beta_9
+=======
+
+
+==============================================================================
+
+
+CHANGES FOR BETA 9
+==================
+
+Flesh
+=====
+
+1) New functions:
+	CCTK_RunTime - number of seconds since simulation started
+	CCTK_CurrentTime - string with current time
+	CCTK_CurrentData - string with current date
+        CCTK_ParameterFilename - returns full name of parameter file used
+	Util_SplitFilename - returns directory and filename from full name
+
+2) Running:
+
+	The parameter file can now be read from standard input by adding
+        a "-" at the end of the executable line, e.g.
+
+	 ./exe/cactus_myconfig -
+
+3) Compilation:
+
+	CST will no longer stop for duplicate thorn names in the ThornList
+	which are in the same arrangement
+
+	The thorn list can be specified on the compile line with the new
+	argument THORNS. This can be used in conjunction with THORNLIST
+
+	  gmake myconfig-config THORNS="Fancy/NewOne" THORNLIST="OldOne.th"
+
+        (Note that the notation for this will probably change slightly 
+         for the next release)
+
+        CST now accept USES without a range block in the param.ccl
+
+        CST no longer accepts deprecated keyword LOGICAL for BOOLEAN
+
+4) Deprecated:
+
+	CCTK_GetInterpHandle        -> CCTK_InterpHandle
+	CCTK_RegisterInterpOperator -> CCTK_InterpRegisterOperator
+	CCTK_mkdir                  -> CCTK_CreateDirectory
+	FMODIFIER                   -> CCTK_FCALL
+	FORTRAN_NAME                -> CCTK_FNAME
+
+5) Removed deprecated macros
+
+	GROUP_SCALAR -> CCTK_SCALAR
+	GROUP_GF     -> CCTK_GF
+	GROUP_ARRAY  -> CCTK_ARRAY
+
+	GROUP_PRIVATE   -> CCTK_PRIVATE
+	GROUP_PROTECTED -> CCTK_PROTECTED
+	GROUP_PUBLIC    -> CCTK_PUBLIC
+
+6) Changed names
+
+        DISTRIB_CONSTANT -> CCTK_DISTRIB_CONSTANT
+	DISTRIB_DEFAULT  -> CCTK_DISTRIB_DEFAULT
+
+7) Coordinates
+
+	Fixed bug in CCTK_CoordLocalRange
+
+8) CYGWIN/Windows compilation updates
+
+        Works with latest Cygwin (1.1.6)
+        Works with Intel icl and ifl compilers
+        Picks up INCLUDE environment variable when making dependencies
+        LIBS and LIBDIRS may now be set in the make.config.defn file
+        Tested under Windows 2000
+        Preliminary configuration support for HPVM
+             MPI=HPVM HPVM_DIR='...'
+        Preliminary configuration support for MPIPro
+             MPI=MPIPro
+
+        (See README.NT for specific details of Cactus on the Windows platform.)
+
+9) AIX
+
+        Free format F90 now works.
+
+Util Thorns
+===========
+
+1) CactusBase/Time: Added fixed timestep and changed some parameter names
+                 to be more consistent:
+
+		 courant_method -> method
+
+		 options:	given
+				courant_static (was standard)
+				courant_speed  (was courant)
+				courant_time
+
+		 courant_outevery -> timestep_outevery
+
+2) CactusBase/Boundary,CartGrid3D: Deprecated functions
+
+	ConstantBCVar
+	ConstantBCVarI
+	ConstantBCGroup
+	ConstantBCGroupI
+	ApplyConstantBC
+	CopyBCGroup
+	CopyBCGroupI
+	CopyBCVar
+	CopyBCVarI
+	FlatBCGroupI
+	FlatBCGroup
+	FlatBCVarI
+	FlatBCVar
+
+3) CactusBase/IOUtil
+
+   The utility routine to parse variable names in a parameter file string
+   IOUtil_ParseVarsForOutput has now been generalised and moved to the
+   Flesh. It is now called CCTK_TraverseString. 
+
+4) CactusPUGH/PUGH
+
+   No longer parallelises on directions with less than or equal to 
+   2*ghostsize+1 points.
+
+   Reduction operators have been removed from CactusPUGH/PUGH and moved 
+   into the new thorn CactusPUGH/PUGHReduce
+
+5) CactusConnect
+
+   New arrangement with thorns to add a web server to the simulation, which
+   can be accessed via any web browser to access information and basic
+   visualisation for the simulation, as well as providing steering 
+   capabilities. See the WebServer-HOWTO for more details
+
+6) CactusIO/IOJpeg
+
+   IO method providing 2D images in jpeg format
+
+Einstein Thorns
+===============
+
+CactusEinstein/ADM:
+	bound = radiation -> bound = radiative
+
+
+
+==============================================================================
+
+
+KNOWN BUGS IN BETA 9
+====================
+(See Cactus bug tracking system for a complete list)
+
+==============================================================================
+
+
+WHAT TO EXPECT IN BETA 10
+=========================
+
+1) Function definitions in CCL files
+
+2) CCL file with configuration information
+
+3) Full hyperslabbing interface
+
+4) C version of Interp
+
+5) More documentation
+
+6) More bug fixes
+
+==============================================================================
+
+
+TEST MACHINES NOTES
+===================
+
+	   * Intel IA32 (Linux Redhat 6.2)
+                o bifrost.aei-potsdam.mpg.de w/wo MPICH (p4 and shmem devices)
+
+	        Fortran compiler: Absoft F90
+                - not compiling: 
+			CactusElliptic/EllPETSc (compiles with MPI)
+
+	        Fortran compiler: Vast F90
+                - not compiling: 
+			CactusElliptic/EllPETSc (compiles with MPI)
+			CactusEinstein/AHFinder
+                - failing testsuite
+			test_extract.par (file handle problem)
+
+	        Fortran compiler: g77 F77
+                - not compiling: 
+			CactusBench/BenchADM
+			CactusEinstein/ADM
+			CactusEinstein/ADMConstraints
+			CactusEinstein/AHFinder
+			CactusEinstein/Extract
+			CactusEinstein/IDAxiBrillBH
+			CactusEinstein/IDBrillData
+			CactusEinstein/IDLinearWaves
+			CactusEinstein/PsiKadelia
+			CactusEinstein/TimeGeodesic
+			CactusElliptic/EllPETSc
+			CactusElliptic/EllSOR
+			CactusElliptic/EllTest
+			CactusPUGH/Interp
+			CactusTest/TestArrays
+			CactusTest/TestCoordinates
+			CactusTest/TestInclude1
+			CactusTest/TestInclude2
+			CactusTest/TestComplex
+			CactusTest/TestInterp
+			CactusTest/TestReduce
+			CactusWave/WaveToyF90
+			CactusWave/WaveToyFreeF90
+			
+	   * Intel IA32 (Linux Redhat 6.2)
+                o loslobos.alliance.unm.edu 
+                - not compiling: 
+			CactusElliptic/EllPETSc (PETSc not installed)
+			
+           * Cray T3E (Unicos mk2.0.5.X)
+                o berte.zib.de w/wo native MPI
+                - not compiling:
+			CactusElliptic/EllPETSc (PETSc not installed)
+		- failing testsuites
+                        test_AHF_1
+                        test_AHF_2
+                
+           * Dec Alpha (osf4.0f, gcc 2.95.2)
+                o jalapeno.cactuscode.org wo MPICH 
+		- not compiling
+			Cactus/Elliptic/EllPETSc (PETSc not installed)
+		- failing testsuites
+			test_ADM_2
+		- comments:
+			compiles with MPICH (p4, shmem), but didn't get
+			to run testsuite
+
+	   * IBM SP2 (AIX 4.2.0.0)
+                o quad.mcs.anl.gov w/wo native MPI
+                - not compiling:
+			CactusElliptic/EllPETSc (PETSc not configured 
+			for this machine)
+
+           * SGI 64 bit (Irix 6.5)
+                o origin.aei-potsdam.mpg.de, w/wo native MPI
+		- not compiling:
+			CactusElliptic/EllPETSc (compiles with MPI)
+	
+           * SGI 32 bit (Irix 6.5)
+                o nott.aei-potsdam.mpg.de wo MPI
+		- not compiling:
+			CactusElliptic/EllPETSc (compiles with MPI)
+			CactusPUGHIO/IOHDF5 (HDF5 not installed)
+
+           * Intel IA32 (Windows NT 4.0)
+                o ntsc-ts1.ncsa.uiuc.edu w/wo MPI (HPVM)
+                - not compiling:
+			CactusElliptic/EllPETSc (PETSc not installed)
+			CactusPUGHIO/IOHDF5 (HDF5 not installed)
+		- failing testsuites
+                        test_ADM_4
+                        test_extract
+                        test_WaveToy2D
+		- comments: 
+                  MPI configured with MPI=HPVM HPVM_DIR='d:\apps\hpvm'
+                  Test suite not run on MPI compilation due to batch system
+
+           * Intel IA32 (Windows 2000)
+                o ctclogin1.tc.cornell.edu w/wo MPI (MPIPro)
+                - not compiling:
+			CactusElliptic/EllPETSc (PETSc not installed)
+			CactusPUGHIO/IOHDF5 (HDF5 not installed)
+		- failing testsuites
+                        test_extract
+                        test_WaveToy2D
+		- comments: 
+                  MPI configured with MPI=MPIPro
+                  Test suite not run on MPI compilation due to batch system
+
+           * Sun Sparc II (SunOS 5.7)
+                o pitcairn.mcs.anl.gov  (no MPI)
+		- not compiling
+			CactusEinstein/TimeGeodesics
+
+	   * Hitachi SR8000-F1 (HI-UX/MPP)
+		o contact cactusmaint@cactuscode.org for status
+                o sr8000.lrz-muenchen.de w/wo native MPI
+                - not compiling:
+			CactusElliptic/EllPETSc (PETSc not installed)
+			CactusEinstein/TimeGeodesic with MPI
+
+
+==============================================================================
+==============================================================================
+
+Release Notices for Cactus 4.0 beta 8
+=====================================
+Date: 28th July 2000
+
+Released modules:
+================
+      Cactus
+      CactusBase
+      CactusBench
+      CactusEinstein
+      CactusElliptic
+      CactusExamples
+      CactusPUGH
+      CactusPUGHIO
+      CactusTest
+      CactusWave
+      external
+
+New thorns:
+==========
+      CactusPUGH/PUGHSlab
+      CactusBase/IOASCII
+      CactusWave/WaveBinarySource
+
+Removed thorns:
+==============
+      CactusPUGHIO/IOASCII	
+      CactusWave/IDBinarySource
+      CactusNet/*
+
+New supported architectures
+===========================
+      Solaris
+      Intel IA64
+      Hitachi SR8000-F1 (partial)
+      
+CVS Tag: Cactus_4_0_Beta_8
+=======
+
+
+==============================================================================
+
+
+CHANGES FOR BETA 8
+==================
+
+Infrastructure
+==============
+
+Flesh
+=====
+
+1) Calling Fortran routines
+   FMODIFIER is deprecated (removed in beta 9)
+   FMODIFIER -> CCTK_FCALL
+   FORTRAN_NAME is deprecated (removed in beta 9)
+   FORTRAN_NAME -> CCTK_FNAME
+
+2) Fixed bug in CCTK_SyncGroups which could have affected anyone 
+   synchronising from the scheduler
+
+3) Added new function 
+
+   CCTK_CreateDirectory(pathname, mode)
+
+   which creates a new directory (including any parent directories
+   needed). This function replaces CCTK_mkdir, which will be removed
+   in beta 9.  This new function doesn't use the 'system' call, so
+   has resolved a long-standing problem with the myrinet libraries.
+
+4) Some routine name changes and extra arguements added (needed for 
+   handling coordinate systems for different dimensions). Now as well 
+   as registering coordinate names, coordinate systems are also registered.
+   See the Users Guide for details of the new routines.
+
+   Removed routines
+
+   CCTK_RegisterCoordI
+   CCTK_CoordOrigin
+   CCTK_RegisterCoord
+   CCTK_RegisterCoordRange
+
+   New routines/Changed argument lists
+
+   CCTK_CoordRegisterRange
+   CCTK_CoordRange
+   CCTK_CoordSystemDim
+   CCTK_CoordDir
+   CCTK_CoordIndex
+   CCTK_CoordRegisterData
+
+   Be warned, these could change again slightly, as we realise what
+   the coordinate functions have to be capable of handling.
+
+5) Changed names of interpolation calls to fit standard notation
+
+   CCTK_GetInterpHandle -> CCTK_InterpHandle
+   CCTK_RegisterInterpOperator -> CCTK_InterpRegisterOperator
+
+   Old names will be removed in beta 9
+
+6) Removed deprecated include files 
+
+   cctk_arguments.h -> cctk_Arguments.h
+   cctk_parameters.h -> cctk_Parameters.h
+
+7) Arguments changed to exit calls
+
+   CCTK_Exit(int retval, cctkGH *GH) -> CCTK_Exit(cctkGH *GH, int retval)
+   CCTK_Abort(cctkGH *GH)            -> CCTK_Abort(cctkGH *GH, int retval)
+
+   The first change is just for consistency, the second because MPI_Abort
+   takes an exit code. Driver thorn writers should change any overloaded 
+   functions.
+
+8) Building include files
+
+   The notation for building include files has changed, to make a distinction
+   between executable source code and header files. This is so that 
+   executable source code can be wrapped by a call to CCTK_IsThornActive.
+   See the documentation for details. The old notation will still work
+   but will be removed in Beta 9.
+
+9) Reduction operators
+
+   Registered reduction operators should now return an int, rather than a void.
+
+10) The GNU regex and getopt libraries are only compiled if they, or the
+    equivalent, are not available on the system already.  This solved a
+    long-standing bug when compiling with the Portland C compiler.
+
+Util Thorns
+===========
+
+1) CactusBase/CartGrid3D
+
+   Removed deprecated routines:
+
+	SetCartSymmetry
+	SetCartSymVN
+	CartSymBCGroupI
+	CartSymBCVar
+	CartSymBCVarI
+	CartSymBCGroup
+	SetCartSymBCVar
+	CartSymBCGroup
+	ApplySymmetry
+	RadiativeBCVar
+	RadiativeBCVarI
+	RadiativeBCGroup
+	RadiativeBCGroupI
+
+
+  Replaced by:
+
+	SetCartSymGN 
+	SetCartSymGI
+	SetCartSymVN
+	SetCartSymVI
+	CartSymGN
+	CartSymGI
+	CartSymVN
+	CartSymVI
+
+   Note that all the Fortran calls now have an integer error code as the 
+   first argument
+
+2) CactusPUGH/PUGHSlab: This is a new thorn which returns data from a 
+   hyperslab of a given grid function. This functionality makes writing 
+   IO thorns a lot easier, and will give them much more functionality.
+
+3) CactusBase/IOASCII: CactusPUGHIO/IOASCII now make use of thorn 
+   PUGHSlab to obtain it's data, this means that it no longer makes 
+   use of PUGH, and so has moved arrangements. To compile 
+   CactusBase/IOASCII you should have CactusPUGH/PUGHSlab (or any other 
+   implementation of hyperslab) in your active thorns list.
+
+4) CactusBase/Boundary: 
+
+   The following functions are deprecated, and will be removed in beta 9
+
+   ConstantBCVar
+   ConstantBCVarI
+   ConstantBCGroup
+   ConstantBCGroupI
+   ApplyConstantBC
+   CopyBCGroup
+   CopyBCGroupI
+   CopyBCVar
+   CopyBCVarI
+   FlatBCGroupI
+   FlatBCGroup
+   FlatBCVarI
+   FlatBCVar
+
+   the routines for applying constant boundary conditions now follow 
+   the standard notation
+
+   BndScalarVI (by variable index)
+   BndScalarVN (by variable name)
+   BndScalarGI (by group index)
+   BndScalarGN (by group name)
+
+   BndCopyVI   
+   BndCopyVN   
+   BndCopyGI   
+   BndCopyGN   
+
+   BndRadiativeVI
+   BndRadiativeVN
+   BndRadiativeGI
+   BndRadiativeGN
+
+   BndFlatVI
+   BndFlatVN
+   BndFlatGI
+   BndFlatGN
+
+5) CactusBase/IOASCII:
+
+   Now can do 2D output of ASCII data from 3D grid functions
+
+6) CactusBase/IOUtil, CactusBase/IOASCII, CactusBase/IOFlexIO
+
+   Changed and added parameters for the way that 1D and 2D slices are
+   selected for output. The symmetry parameters (e.g. octant) from CartGrid3D
+   are no longer used, instead there are now parameters for specifying 
+   the slice by a physical coordinate or by a grid index. These parameters
+   default to the parameters in IOUtil, but can be overriden by parameters
+   for the individual methods. The order of choosing the data by parameters
+   in the parameter file is
+
+   * if an index is set for a method that is used or
+   * if an index is set for IOUtil that is used or
+   * if a coordinate value is set for a method that is used or
+   * if a coordinate value is set for IOUtil that is used
+
+   if nothing is set in the parameter file you get the same output as 
+   before EXCEPT for a full grid the lines/planes will move to index 0 
+   rather than being at the center of the grid.
+
+7) CactusBase/IOUtil
+
+   The utility routine to parse variable names in a parameter file string
+   for IO is now called 
+
+   IOUtil_ParseVarsForOutput
+
+   changed from ParseVarsForOutput
+
+8) CactusWave/WaveBinarySource
+
+   New thorn which evolves orbiting scalar sources, this is useful since
+   it provides a constant wave stream for testing.
+
+9) CactusTest: New Arrangement
+
+   Thorns for testing different parts of the Cactus infrastructure
+
+10) CactusExamples: New Arrangement
+
+    Example applications ... the WaveToy example in 1D and 2D, defining
+    coordinates etc.
+
+11) CactusNet
+
+    This is still available, but due to the very active development of the
+    thorns in this arrangement we decided to not include it in the set of
+    tested thorns for this release.
+
+==============================================================================
+
+
+KNOWN BUGS IN BETA 8
+====================
+(See Cactus bug tracking system for a complete list)
+
+1) Output for DISTRIB=CONSTANT arrays isn't supported yet.
+2) Deletion of a thorn which was in the ThornList of a
+   configuration requires the user to manually delete
+   make.thornlist in <config>/config-data
+3) No warning for unreachable schedule points.
+4) Activation doesn't check that all parent and friend 
+   implementations are activated.
+ 
+==============================================================================
+
+
+WHAT TO EXPECT IN BETA 9
+========================
+
+1) More sophisticated method to incorporate external libraries
+2) Function aliasing
+3) Directional syncing policies in the schedule.ccl
+4) gmake bugreport, gmake <config>-bugreport
+
+... and, as normal, more documentation and bug fixes.
+
+==============================================================================
+
+
+TEST MACHINES NOTES
+===================
+
+	   * Intel IA32 (Linux Redhat 6.2)
+                o bifrost.aei-potsdam.mpg.de w/wo MPICH (p4 and shmem devices)
+
+	        Fortran compiler: Portland, Absoft F90
+                - not compiling: 
+			CactusElliptic/EllPETSc (compiles with MPI)
+
+	        Fortran compiler: Vast F90
+                - not compiling: 
+			CactusElliptic/EllPETSc (compiles with MPI)
+			CactusEinstein/AHFinder
+
+	        Fortran compiler: g77 F77
+                - not compiling: 
+			CactusBench/BenchADM
+			CactusEinstein/ADM
+			CactusEinstein/ADMConstraints
+			CactusEinstein/AHFinder
+			CactusEinstein/Extract
+			CactusEinstein/IDAxiBrillBH
+			CactusEinstein/IDBrillData
+			CactusEinstein/IDLinearWaves
+			CactusEinstein/PsiKadelia
+			CactusEinstein/TimeGeodesic
+			CactusElliptic/EllPETSc
+			CactusElliptic/EllSOR
+			CactusElliptic/EllTest
+			CactusPUGH/Interp
+			CactusTest/TestArrays
+			CactusTest/TestCoordinates
+			CactusTest/TestInclude1
+			CactusTest/TestInclude2
+			CactusTest/TestComplex
+			CactusTest/TestInterp
+			CactusWave/WaveToyF90
+			CactusWave/WaveToyFreeF90
+			
+
+	   * Intel IA32 Cluster (Linux Redhat 6.2)
+                o roadrunner.alliance.unm.edu w/wo MPICH (gm device)
+		- not compiling:
+			CactusElliptic/EllPETSc (should work) 
+			CactusPUGHIO/IOHDF5 (HDF5 not installed)
+
+			
+           * Cray T3E (Unicos mk2.0.5.X)
+                o berte.zib.de w/wo native MPI
+                - not compiling:
+			CactusElliptic/EllPETSc (PETSc not installed)
+			CactusPUGHIO/IsoSurfacer
+			external/RemoteIO
+			external/TCPXX
+		- failing testsuite
+			CactusEinstein/IDAxiBrillBH
+
+
+           * Dec Alpha (osf4.0f, gcc 2.95.2)
+                o jalapeno.cactuscode.org w/wo MPICH (shmem and p4 devices)
+		- not compiling:
+			CactusElliptic/EllPETSc (not installed)
+			external/RemoteIO
+			external/TCPXX
+
+
+	   * HP Exemplar (HPUX 10.01)
+		We no longer have access to a HP Exemplar for testing
+
+
+	   * IBM SP2 (AIX 4.2.0.0)
+                o quad.mcs.anl.gov w/wo native MPI
+		- not compiling:
+			CactusElliptic/EllPETSc (not installed)
+			CactusPUGHIO/IOHDF5 
+			CactusPUGHIO/IsoSurfacer
+			CactusWave/WaveToyFreeF90
+			external/RemoteIO,
+			external/TCPXX,
+	        - comments:
+			Free format fortran isn't supported yet
+
+           * SGI 64 bit (Irix 6.5)
+                o origin.aei-potsdam.mpg.de, w/wo native MPI
+		- not compiling:
+			CactusElliptic/EllPETSc (compiles with MPI)
+
+	
+           * SGI 32 bit (Irix 6.5)
+                o nott.aei-potsdam.mpg.de wo MPI
+		- not compiling
+			CactusElliptic/EllPETSc (not installed)
+			CactusPUGHIO/IOHDF5 (not installed)
+
+
+           * Intel IA64 (TurboLinux Frontier 2.3.99-pre6-000501-18)
+                o  SGI gcc and f90  crosscompiler wo MPI
+                - not compiling
+			CactusElliptic/EllPETSc (PETSc not installed)
+			CactusPUGHIO/IOHDF5 (HDF5 not installed)
+			CactusPUGHIO/IsoSurfacer (compiles with native compiler)
+			external/RemoteIO (compiles with native compiler)
+			external/TCPXX (compiles with native compiler)
+
+
+           * Intel IA32 (Windows NT 4.0)
+                o saraband.aei-potsdam.mpg.de (VM) wo MPI
+                - not compiling
+			CactusElliptic/EllPETSc (not installed)
+			CactusPUGHIO/IOHDF5 (not installed)
+			CactusPUGHIO/IsoSurfacer
+			external/RemoteIO
+			external/TCPXX
+		- failing testsuite
+			CactusEinstein/ADM
+			CactusEinstein/AHFinder
+			CactusExamples/WaveToy2D
+			CactusPUGHIO/IOFlexIO
+		- comments: 
+                        *** Need to use beta 5 version of IEEEIO ***
+                            > cd arrangements/external/IEEEIO
+                            > cvs update -r Cactus_4_0_Beta_5
+
+
+           * Intel IA32 (Windows NT 4.0)
+                o ntsc-ts1.ncsa.uiuc.edu w/wo MPI (HPVM)
+                - not compiling
+			CactusElliptic/EllPETSc (not installed)
+			CactusPUGHIO/IOHDF5 (not installed)
+			CactusPUGHIO/IsoSurfacer
+			external/RemoteIO
+			external/TCPXX
+		- failing testsuite
+			CactusEinstein/ADM
+			CactusEinstein/AHFinder
+			CactusExamples/WaveToy2D
+			CactusPUGHIO/IOFlexIO
+		- comments: 
+                        *** Need to use beta 5 version of IEEEIO ***
+                            > cd arrangements/external/IEEEIO
+                            > cvs update -r Cactus_4_0_Beta_5
+			Maybe problems with MPI (but probably just
+			this machine)
+
+
+           * Sun Sparc II (SunOS 5.7)
+                o ufer.zib.de (VM) w/wo MPICH (p4 device)
+                - not compiling
+			CactusEinstein/IDAxiBrillBH 
+			CactusElliptic/EllPETSc (PETSc not installed)
+			CactusPUGHIO/IOFlexIO
+			CactusPUGHIO/IOHDF5 (HDF5 not installed)
+			CactusPUGHIO/IsoSurfacer
+			external/IEEEIO
+		- comments: 
+			need to compile with gmake -k
+			and no optimisation (for TimeGeodesic)
+
+
+	   * Hitachi SR8000-F1 (HI-UX/MPP)
+		o contact cactusmaint@cactuscode.org for status
+
+
+==============================================================================
+==============================================================================
+
+Release Notices for Cactus 4.0 beta 7
+=====================================
+Date: April 20th 2000
+
+Released modules:
+================
+
+      Cactus
+      CactusBase
+      CactusBench
+      CactusEinstein
+      CactusElliptic
+      CactusNet
+      CactusPUGH
+      CactusPUGHIO
+      CactusWave
+      external
+
+New thorns:
+==========
+	
+      CactusBench/BenchADM
+      CactusWave/IDScalarWaveC
+
+
+CVS Tag: Cactus_4_0_Beta_7
+=======
+
+
+==============================================================================
+
+
+CHANGES FOR BETA 7
+==================
+
+Infrastructure
+==============
+
+1) Added script "GetCactus" which, given a thorn list with CVS repository
+   information, will checkout the thorns. It is also possible to embed
+   parameter files in the thorn list, which will be automatically 
+   extracted. The script and sample parameter files are available from 
+   the web pages. 
+
+Flesh
+=====
+
+1) Added configuration options DEBUG and OPTIMISE
+   Added build option WARN.  
+
+2) Now can use CCTK_ARGUMENTS and DECLARE_CCTK_ARGUMENTS 
+   rather than specifying CCTK_FARGUMENTS, CCTK_CARGUMENTS,
+   DECLARE_CCTK_FARGUMENTS or DECLARE_CCTK_CARGUMENTS
+
+3) Changed gmake doc to 
+	gmake UsersGuide -> produces UsersGuide.ps (manual for users)
+	gmake MaintGuide -> produces MaintGuide.ps (manual for maintainers)
+
+4) Added new make targets 
+	gmake cvsstatus
+	-> processes information from CVS on the status of your checked 
+	   out code
+	gmake cvsdiff
+	-> reports the differences between your checked out code and the 
+	   version in the CVS repository
+
+5) Added new make option PROMPT=no, which should complete the compilation
+   without giving you any further prompts. Use this in conjunction from
+   the THORNLIST option to build a new configuration in one step.
+
+6) Changed name of 
+	gmake <config>-thornparfiles 
+   to
+	gmake <config>-examples 
+
+7) Added the capability to specify that an array should have a constant
+   size on each processor. This is specified in the interface.ccl by 
+   assigning
+	DISTRIB=CONSTANT 
+   the default value is 
+	DISTRIB=DEFAULT
+
+8) External packages, such as MPI, recognised by the flesh now define e.g.
+	#define CCTK_MPI 
+   instead of 
+	#define MPI
+   Both will continue to work for the next release as this is made
+   consistent, and the work on including external packages is completed.
+
+9) New Architectures: 
+   Cactus port to IBM SP2 finished (should work out of the box with native 
+   MPI). Tested on SP2s at Argonne, NERSC and MHPCC. The default compiler 
+   on the SP2 is xlc.
+   Initial port to Hitachi SR8000.
+
+
+10) Added support for the Lahey/Fujitsu Fortran Compiler. This should be 
+    treated as experimental, since we don't have our own version. (Thanks 
+    to Erik Schnetter for the known architectures file).
+
+11) rfrTraverse has been removed, and is replaces by CCTK_Traverse
+
+12) Memory tracing added. 
+
+13) Added support for MPICH 1.2.0
+
+
+Util Thorns
+===========
+
+1) Removed deprecated routines in CactusBase/Boundary
+
+2) CactusPUGH/PUGH - Added manual decomposition (donated by 
+   Matei Ripeneau), and changed parameter names for manual processor 
+   topology. See the README in PUGH/doc for more information.
+
+3) CactusPUGH/PUGH - Major changes to remove the old pGF and implement 
+   grid functions as a special case of a grid array.
+
+4) CactusPUGH/PUGH - Implemented support for constant sized arrays on
+   each processor
+
+5) CactusBase/IOUtil - Append to output data files after restarting
+   from a checkpoint file 
+
+6) CactusBase/IOUtil - can now recover from the latest checkpoint file 
+   in a given directory (so you can submit several consecutive jobs to 
+   a queue without editing the parameter file)
+
+7) Added CactusBench arrangement to contain benchmarking thorns. 
+   Currently there is just BenchADM which contains the staggered leapfrog
+   evolution method for CactusEinstein/ADM with the macros expanded, and
+   some optimisations.
+
+8) New thorn: IDScalarWaveC, initial data for the scalar wave equation all
+   in C
+
+==============================================================================
+
+
+KNOWN BUGS IN BETA 7
+====================
+(See Cactus bug tracking system for a complete list)
+
+
+==============================================================================
+
+
+WHAT TO EXPECT IN BETA 8
+========================
+
+1) Fixes for all known bugs in Beta 7.
+
+2) Full support for Hitachi and Exemplar machines.
+
+3) Support for Intel C/C++ compiler with NT.
+
+4) Compiling on DEC Alphas with native MPI
+
+5) Function aliasing
+
+6) New infrastructure for compiling with external packages (e.g.  
+   HDF5, PETSc,...)
+
+7) Example 1D and 2D applications, extensions of computational infrastructure
+   to support 1D and 2D.
+
+==============================================================================
+
+
+TEST MACHINES NOTES
+===================
+
+	   * Intel IA32 (Linux Redhat 6.2)
+                o bifrost.aei-potsdam.mpg.de
+                  compiler, w/wo MPICH
+                - not compiling: 
+			CactusElliptic/EllPETSc (wo MPICH)
+		- failing testsuite:
+			CactusEinstein/AHFinder,
+		- comments:	
+			Absoft, Portland and Pacific-Sierra
+			F90 compilers (CactusEinstein/AHFinder will not 
+			compile with the Pacific-Sierra compiler)
+			
+			
+           * Cray T3E (Unicos mk2.0.5.X)
+                o berte.zib.de w/wo native MPI
+                - not compiling Remove:
+			CactusElliptic/EllPETSc,
+			CactusNet,
+			CactusPUGHIO/IsoSurfacer,
+			external/RemoteIO,
+			external/TCPXX
+		- failing testsuite
+			CactusEinstein/AHFinder,
+
+
+           * Dec Alpha (osf4.0f, gcc 2.95.2)
+                o jalapeno.cactuscode.org w/wo MPICH
+		- not compiling:
+			CactusNet,
+			CactusPUGHIO/IOFlexIO,
+			CactusPUGHIO/IsoSurfacer,
+			external/IEEEIO,
+			external/RemoteIO,
+			external/TCPXX
+		- failing testsuite:
+			CactusEinstein/AHFinder,
+
+
+	   * HP Exemplar (HPUX 10.01)
+                o neptune.npaci.edu wo MPI
+		- not compiling:
+			CactusNet,
+			CactusPUGHIO/IsoSurfacer,
+			external/RemoteIO,
+			external/TCPXX,
+			CactusEinstein/TimeGeodesic,
+			CactusPUGHIO/IOHDF5
+		- failing testsuite:
+			CactusEinstein/AHFinder,
+	        - comments:
+			compiling failing in preprocessing, but you
+			just need to type gmake <config> again
+
+
+	   * IBM SP2 (AIX 4.2.0.0)
+                o quad.mcs.anl.gov w/wo native MPI
+		- not compiling:
+			CactusElliptic/EllPETSc,
+			CactusNet,
+			CactusPUGHIO/IOHDF5,
+			CactusPUGHIO/IsoSurfacer,
+			external/RemoteIO,
+			external/TCPXX,
+			CactusWave/WaveToyFreeF90
+		- failing testsuite:
+			CactusEinstein/AHFinder,
+	        - comments:
+			Free format fortran won't compile yet
+
+
+           * SGI 64 bit (Irix 6.5)
+                o origin.aei-potsdam.mpg.de, w/wo native MPI
+		- not compiling:
+			CactusElliptic/EllPETSc
+		- failing testsuite
+			CactusEinstein/AHFinder
+
+	
+           * SGI 32 bit (Irix 6.5)
+                o nott.aei-potsdam.mpg.de wo MPI
+		- not compiling
+			CactusElliptic/EllPETSc
+			CactusPUGHIO/IOHDF5,
+		- failing testsuite
+			CactusEinstein/AHFinder
+
+
+           * Intel IA32 (Windows NT 4.0)
+                o saraband.aei-potsdam.mpg.de (VM) wo MPI
+                - not compiling
+			CactusElliptic/PETSc, 
+			CactusNet/http, 
+			CactusNet/NetGeometry,
+			CactusPUGHIO/IOHDF5,
+			CactusPUGHIO/IsoSurfacer, 
+			external/RemoteIO,
+			external/TCPXX,
+		- failing testsuite
+			CactusEinstein/AHFinder
+			CactusEinstein/IDAnalyticBH
+		- comments: 
+                        *** Need to use beta 5 version of IEEEIO ***
+                            > cd arrangements/external/IEEEIO
+                            > cvs update -r Cactus_4_0_Beta_5
+
+
+==============================================================================
+==============================================================================
+
+Release Notices for Cactus 4.0 beta 6
+=====================================
+
+Date: 8th February 2000
+
+Released modules:
+================
+
+      Cactus
+      CactusBase
+      CactusEinstein
+      CactusElliptic
+      CactusNet
+      CactusPUGH
+      CactusPUGHIO
+      CactusWave
+      external
+
+New thorns:
+==========
+
+	CactusEinstein/AHFinder
+
+Main Changes:
+============
+
+
+CVS Tag: Cactus_4_0_Beta_6
+=======
+
+
+==============================================================================
+
+
+CHANGES FOR BETA 6
+==================
+
+Flesh
+=====
+
+1) Support for free form Fortran 90 (with file extension F90 for
+   preprocessed or f90 for no preprocessing)
+
+2) CCTK_BOUND schedule point removed since it is no longer needed
+
+3) Support for Complex grid variables in both C and Fortran. Complex
+   variables can be defined in the configuration (ccl) files, and 
+   manipulated in C with the same functionality as is provided by 
+   standard fortran by the CCTK functions:
+
+     CCTK_Cmplx 
+     CCTK_CmplxReal
+     CCTK_CmplxImag 
+     CCTK_CmplxConjg
+     CCTK_CmplxAbs
+     CCTK_CmplxAdd
+     CCTK_CmplxSub
+     CCTK_CmplxMul
+     CCTK_CmplxDiv
+     CCTK_CmplxSqrt *
+     CCTK_CmplxSin  *
+     CCTK_CmplxCos  *
+     CCTK_CmplxLog  *
+     CCTK_CmplxExp  *
+
+   (The functions marked with a * still need to be filled out). Complex
+   grid variables are supported by CactusPugh/Interp, but as yet are
+   not supported by the IO routines.
+
+4) For better name consistency the following name changes have been made
+
+   CCTK_RegisterCoordI     -> CCTK_CoordRegisterI
+   CCTK_RegisterCoord      -> CCTK_CoordRegister
+   CCTK_RegisterCoordRange -> CCTK_CoordRegisterRange 
+
+   The old names are now deprecated.
+
+5) New CCTK functions include
+
+   CCTK_CoordDir
+   CCTK_CoordLocalRange
+
+6) The function used by driver thorns
+
+   CCTK_GroupData 
+
+   has been rewritten to return a structure containing the group 
+   information (to allow us to add new information easily). The new 
+   function is 
+
+   cGroup *CCTK_GroupData(int group)
+
+   where the cGroup structure is
+
+   typedef struct
+   {
+     int grouptype;
+     int variabletype;
+     int staggertype;
+     int dim;
+     int numvariables;
+     int numtimelevels;
+   } cGroup;
+
+   the old deprecated function remains with the new name 
+
+   CCTK_OldGroupData
+
+7) Added a new option for building configurations
+
+gmake <target> THORNLIST=<thorn_file> THORNLIST_DIR=<directory> uses the file directory/thorn_file as the list of thorns for the configuration   
+
+8) Communication (ghostzone swapping) is now automatically enabled for all
+   variables which have storage assigned in the schedule.ccl. This means 
+   that a call to CCTK_SyncGroup will always syncronise the ghostzones.
+
+9) The include files for thorns using Cactus parameters or argument lists 
+   have been renamed, to follow the same naming convention as the rest of 
+   the Cactus include files 
+
+	cctk_parameters.h  -> cctk_Parameters.h
+	cctk_arguments.h   -> cctk_Arguments.h 
+
+   the old names will still work, but are depreciated.
+
+10) Removed warnings for unused variables (parameters and grid variables)
+    on the origin. 
+
+11) Continued to add features needed for AMR
+    - schedule global functions
+    - can now schedule synchronisation of groups in the schedule.ccl
+    - CCTK_rfrTraverse is now replaced by CCTK_Traverse
+
+12) Added staggering capabilities for grid functions, see the documentation
+    for details. Staggering is still being tested and should be treated
+    as developmental. 
+
+13)
+    Removed redundant src/rfr directory.  If you do an update rather than a
+    fresh checkout you'll need to edit src/CVS/Entries to remove the line
+    referencing this directory.
+
+Util Thorns
+===========
+
+1) Bug fix in recovering grid scalars from checkpointing data
+
+2) CactusPUGH/PUGH: Many changes to PUGH to add multidimensional 
+   arrays. [If you are using any PUGH infrastructure please make 
+   sure you keep up to date with CVS commit messages for the thorn
+   since this thorn will now be revised and tidied]
+   Multidimensional arrays (1D, 2D, 3D) are now working. Arrays can
+   be set to have any size, and any ghostzone size in a thorn's
+   interface.ccl. At the moment the sizes must be specified with parameters.
+   Currently Sychronising of ghostzones works for 1D and 3D, but not for
+   2D. This will go in as PUGH is revised for the next beta release.
+
+Relativity Thorns
+=================
+
+1) CactusEinstein/AHFinder: New thorn, locates apparent horizons on a 
+   timeslice
+
+2) CactusEinstein/Extract: Fixed bug on multiprocessors
+
+3) CactusEinstein/IDAxiBrillBH: Fixed bug which prevented 
+   compilation/linking/running on some architectures.
+
+==============================================================================
+
+
+KNOWN BUGS IN BETA 6
+====================
+(See Cactus bug tracking system for a complete list)
+
+1) Free format Fortran 90 doesn't work on the SP2
+
+==============================================================================
+
+
+WHAT TO EXPECT IN BETA 7
+========================
+
+1) Fixes for all known bugs in Beta 6
+
+2) Individual thorn configuration scripts
+
+3) Function declarations in the interface.ccl
+
+
+==============================================================================
+
+
+TEST MACHINES NOTES
+===================
+	   * Intel Linux
+                o bifrost.aei-potsdam.mpg.de Redhat 6.0, Absoft
+                  compiler, w/wo MPI
+                     + Remove: 
+			CactusElliptic/EllPETSc
+			CactusPUGHIO/IOHDF5,
+                     + Notes: CactusElliptic/EllPETSc compiled with
+                       MPICH
+                o saraband.aei-potsdam.mpg.de Redhat 6.1, Absoft
+                  compiler, wo MPI
+                     + Remove: 
+			CactusElliptic/EllPETSc
+
+           * Dec Alpha
+                o skadi.aei-potsdam.mpg.de wo MPI
+                     + Remove: 
+			CactusEinstein/IDAxiBrillBH
+			CactusElliptic/EllPETSc,
+			CactusPUGHIO/HDF5, 
+
+           * SGI 64 bit 
+                o kvasir.aei-potsdam.mpg.de Irix 6.5, w/wo native
+                  MPI
+                     + Remove: 
+			CactusElliptic/EllPETSc
+                     + Configure: HDF5=yes MPI=NATIVE
+                       HDF5_DIR=/usr/local/apps/hdf5
+                       Notes: fails testsuite for AHFinder 	
+		      
+           * SGI 32 bit
+                o nott.aei-potsdam.mpg.de Irix 6.5 wo MPI
+                     + Remove: 
+			CactusElliptic/EllPETSc
+			CactusPUGHIO/IOHDF5,
+                     + Notes: Problem with output for PsiKadelia
+                       test
+
+           * T3E
+                o berte.zib.de w/wo native MPI
+                     + Remove:
+			CactusElliptic/EllPETSc,
+			CactusPUGHIO/IOHDF5,
+	             + Notes: 
+			fails testsuite for AHFinder 	
+			and IDAxiBrillBH
+
+           * Windows NT
+                o ntsc-ts1.ncsa.uiuc.edu w/wo HPVM MPI
+                     + Remove: 
+			CactusElliptic/PETSc, 
+			CactusNet/http, 
+			CactusNet/NetGeometry,
+			CactusPUGHIO/IOHDF5,
+			CactusPUGHIO/IsoSurfacer, 
+			CactusWave/IDScalarWaveCXX,
+			CactusWave/IDWaveToyCXX
+			external/RemoteIO,
+			external/TCPXX,
+	             + Configure: MPI=CUSTOM MPI_LIBS="mpi.lib fm.lib
+                       advapi32.lib kernel32.lib wsock32.lib" MPI_INC_DIRS
+                       ="d:/apps/hpvm/include"
+	             + Notes: testsuite checking technology doesn't
+                              work here with MPI because of batch queues
+                              Need to use beta 5 version of IEEEIO
+                                - cd arrangements/external/IEEEIO
+                                  cvs update -r Cactus_4_0_Beta_5
+                              AHFinder test fails.
+
+           * HP
+                o exemplar.npaci.edu wo MPI, HP-UX 10.01
+                     + Remove: 
+			CactusElliptic/PETSc, 
+			CactusNet/http, 
+			CactusNet/NetGeometry
+			CactusPUGHIO/IsoSurfacer,
+			CactusPUGHIO/IOHDF5
+			external/RemoteIO,
+			external/TCPXX
+
+	   * SP2
+		o quad.mcs.anl.gov wo MPI
+		     + Remove: 
+			CactusElliptic/EllPETSc, 
+			CactusNet/http, 
+			CactusNet/NetGeometry, 
+			CactusPUGHIO/IsoSurfacer,
+			CactusPUGHIO/IOHDF5
+			CactusWave/WaveToyFreeF90
+			external/RemoteIO,
+			external/TCPXX
+	             + Notes: dependencies broken for IEEEIO, can ignore
+                              and continue
+
+
+==============================================================================
+==============================================================================
+
+Release Notices for Cactus 4.0 beta 5
+=====================================
+Friday November 12th 1999
+
+(Super Computing 1999 Release)
+
+Released modules:
+================
+
+      Cactus
+      CactusBase
+      CactusEinstein
+      CactusElliptic
+      CactusNet
+      CactusPUGH
+      CactusPUGHIO
+      CactusWave
+      external
+
+New thorns:
+==========
+      CactusEinstein/TimeGeodesic
+      CactusEinstein/AHFinder
+
+Main Changes:
+============
+      Faster compilation times (Cactus)
+      Initial implementation of timing information (Cactus)   
+
+CVS Tag: Cactus_4_0_Beta_5
+=======
+
+
+==============================================================================
+
+
+CHANGES FOR BETA 5
+==================
+
+Utils
+=====
+
+1) Recompilation times faster. Now adding or removing thorns does not involve
+   a complete rebuild
+
+2) Initial implementation of timing information, use parameter Cactus::timing_
+
+
+Util Thorns
+===========
+
+1) CactusBase/Boundary: Robin boundary conditions added
+
+2) CactusPUGHIO/IsoSurfacer: Now works correctly for data from analysis routines
+
+
+Relativity Thorns
+=================
+
+1) CactusEinstein/TimeGeodesic: New thorn: Tracks timelike geodesics 
+   with given initial positions and velocities.
+
+2) CactusEinstein/AHFinder: New thorn: locates apparent horizons on a 
+   slice
+
+==============================================================================
+
+
+KNOWN BUGS IN BETA 5
+====================
+(See Cactus bug tracking system for a complete list)
+
+1) CactusNet/http, external/TCPXX, external/RemoteIO still not compiling
+   on all platforms
+
+2) EllPETSc only compiles with MPI, but doesn't tell you this
+
+3) AxiBrillBH has problems on some platforms
+
+
+==============================================================================
+
+
+WHAT TO EXPECT IN BETA 6
+========================
+
+1) Fixes for all known bugs in Beta 5
+
+2) Finished implementation of 1D, 2D, 3D arrays
+
+3) Maximal slicing
+
+4) Generic implementation of parameter choice for elliptic slicings 
+
+
+==============================================================================
+
+
+TEST MACHINES NOTES
+===================
+
+           * Intel Linux
+                o bifrost.aei-potsdam.mpg.de Redhat 6.0, Absoft
+                  compiler, wo MPI
+                     + Remove: 
+			CactusElliptic/EllPETSc
+			CactusPUGHIO/IOHDF5,
+                     + Notes: CactusElliptic/EllPETSc compiled with
+                       MPICH
+                o gullveig.aei-potsdam.mpg.de Redhat 6.0, Absoft
+                  compiler, MPI LAM
+                     + Remove: 
+			CactusPUGHIO/IOHDF5,
+			CactusElliptic/EllPETSc
+
+           * Dec Alpha
+                o galar.aei-potsdam.mpg.de wo MPI
+                     + Remove: 
+			CactusEinstein/IDAxiBrillBH
+			CactusElliptic/EllPETSc,
+			CactusNet/http, 
+			CactusPUGHIO/HDF5, 
+			external/RemoteIO,
+
+           * SGI 64 bit 
+                o kvasir.aei-potsdam.mpg.de Irix 6.5, w/wo native
+                  MPI
+                     + Remove: 
+			CactusElliptic/EllPETSc
+                     + Configure: HDF5=yes MPI=NATIVE
+                       HDF5_DIR=/usr/local/apps/hdf5
+
+           * SGI 32 bit
+                o nott.aei-potsdam.mpg.de Irix 6.5 wo MPI
+                     + Remove: 
+			CactusElliptic/EllPETSc
+			CactusPUGHIO/IOHDF5,
+                     + Notes: Problem with output for PsiKadelia
+                       test
+
+           * T3E
+                o pc.rzg.mpg.de w/wo native MPI
+                     + Remove:
+			CactusEinstein/IDAxiBrillBH
+			CactusElliptic/EllPETSc,
+			CactusPUGHIO/IOHDF5,
+
+           * Windows NT
+                o ntsc-ts1.ncsa.uiuc.edu w/wo HPVM MPI
+                     + Remove: 
+			CactusElliptic/PETSc, 
+			CactusNet/http, 
+			CactusNet/NetGeometry,
+			CactusPUGHIO/IOHDF5,
+			CactusPUGHIO/IsoSurfacer, 
+			CactusWave/IDScalarWaveCXX,
+			CactusWave/IDWaveToyCXX
+			external/RemoteIO,
+			external/TCPXX,
+	             + Configure: MPI=CUSTOM MPI_LIBS="mpi.lib fm.lib
+                       advapi32.lib kernel32.lib wsock32.lib" MPI_INC_DIRS
+                       ="d:/apps/hpvm/include"
+	             + Notes: testsuite checking technology doesn't
+                              work here with MPI because of batch queues
+
+           * HP
+                o exemplar.npaci.edu wo MPI, HP-UX 10.01
+                     + Remove: 
+			CactusElliptic/PETSc, 
+			CactusNet/http, 
+			CactusNet/NetGeometry
+			CactusPUGHIO/IsoSurfacer,
+			CactusPUGHIO/IOHDF5
+			external/RemoteIO,
+			external/TCPXX,
+
+	   * SP2
+		o quad.mcs.anl.gov wo MPI
+		     + Remove: 
+			CactusEinstein/IDAxiBrillBH, 
+			CactusElliptic/EllPETSc, 
+			CactusNet/http, 
+			CactusNet/NetGeometry, 
+			CactusPUGHIO/IsoSurfacer,
+			CactusPUGHIO/IOHDF5
+			external/RemoteIO,
+			external/TCPXX,
+	             + Notes: dependencies broken for IEEEIO, can ignore
+                              and continue
+
+
+==============================================================================
+==============================================================================
+
+Release Notices for Cactus 4.0 beta 4
+=====================================
+Monday November 1st 1999
+
+
+Released modules:
+================
+
+      Cactus
+      CactusBase
+      CactusEinstein
+      CactusElliptic
+      CactusNet
+      CactusPUGH
+      CactusPUGHIO
+      CactusWave
+      external
+
+
+New thorns:
+==========
+      CactusEinstein/IDAxiBrillBH
+      CactusEinstein/Extract
+      CactusNet/NetGeometry
+
+Main Changes:
+============
+      Faster compilation times (Cactus)
+      
+
+CVS Tag: Cactus_4_0_Beta_4
+=======
+
+
+==============================================================================
+
+
+CHANGES FOR BETA 4
+==================
+
+
+Utils
+=====
+
+1) CST: The perl part of the compilation has been optimised, and
+   is now much faster
+
+2) Compilation for thorns with large numbers of grid variables fixed
+   on origin
+
+3) Testsuite checking technology fixed for NT
+
+
+Util Thorns
+===========
+
+1) CactusBase/Boundary: Bugs fixed in radiation boundary conditions.
+   Copying boundary conditions added. ConstantBC conditions
+   renamed to ScalarBC. ConstantBC will be removed in next beta release.
+
+2) CactusPUGHIO/IOASCII: Memory bugs fixed
+
+3) CactusPUGHIO/IsoSurfacer: Now works on T3E
+
+4) CactusNet/NetGeometry: Generic interface for data streaming via
+   a TCP socket connection to viz clients
+
+Relativity Thorns
+=================
+
+1) CactusEinstein/IDAxiBrillBH: New thorn: Constructs initial data for a 
+   black hole with an even parity perturbation. This thorn still has a little
+   trouble on a few platforms, see below for details
+
+2) CactusEinstein/Extract: New thorn: Extracts gauge invariant waveforms
+   from a spacetime with approximate spherical symmetry
+ 
+
+==============================================================================
+
+
+KNOWN BUGS IN BETA 4
+====================
+(See Cactus bug tracking system for a complete list)
+
+1) CactusNet/http, external/TCPXX, external/RemoteIO still not compiling
+   on all platforms
+
+2) EllPETSc only compiles with MPI, but doesn't tell you this
+
+3) AxiBrillBH has problems on some platforms
+
+
+==============================================================================
+
+
+WHAT TO EXPECT IN BETA 5
+========================
+
+1) Fixes for all known bugs in Beta 4
+
+2) Implementation of 1D, 2D, 3D arrays
+
+3) Maximal slicing
+
+4) Generic implementation of parameter choice for elliptic slicings 
+
+5) Apparent horizon finding thorn
+
+
+==============================================================================
+
+
+TEST MACHINES NOTES
+===================
+
+           * Intel Linux
+                o bifrost.aei-potsdam.mpg.de Redhat 6.0, Absoft
+                  compiler, wo MPI
+                     + Remove: CactusPUGHIO/IOHDF5,
+                       CactusElliptic/EllPETSc
+                     + Notes: CactusElliptic/EllPETSc compiled with
+                       MPICH
+                o gullveig.aei-potsdam.mpg.de Redhat 6.0, Absoft
+                  compiler, MPI LAM
+                     + Remove: CactusPUGHIO/IOHDF5,
+                       CactusElliptic/EllPETSc
+
+           * Dec Alpha
+                o galar.aei-potsdam.mpg.de wo MPI
+                     + Remove: CactusElliptic/EllPETSc,
+                       CactusPUGHIO/HDF5, external/RemoteIO,
+                       CactusNet/http, CactusEinstein/IDAxiBrillBH
+
+           * SGI 64 bit
+                o origin.aei-potsdam.mpg.de Irix 6.5, w/wo native
+                  MPI
+                     + Remove: CactusElliptic/EllPETSc
+                     + Configure: HDF5=yes MPI=NATIVE
+                       HDF5_DIR=/usr/local/apps/hdf5
+
+           * SGI 32 bit
+                o nott.aei-potsdam.mpg.de Irix 6.5 wo MPI
+                     + Remove: CactusPUGHIO/IOHDF5,
+                       CactusElliptic/EllPETSc
+                     + Notes: Problem with output for PsiKadelia
+                       test
+                o null.wustl.edu Irix 6.2 wo MPI
+                     + Remove: CactusNet/http, CactusPUGHIO/IOHDF5,
+                       CactusElliptic/EllPETSc, external/TCPXX,
+                       external/RemoteIO
+                     + Notes: Gives a lot of warnings about data
+                       alignment
+
+           * T3E
+                o pc.rzg.mpg.de w/wo native MPI
+                     + Remove:
+                       CactusElliptic/EllPETSc,CactusPUGHIO/IOHDF5,
+		       CactusEinstein/IDAxiBrillBH
+
+           * Windows NT
+                o saraband.aei-potsdam.mpg.de wo MPI
+                     + Remove: CactusNet/http, external/RemoteIO,
+                       CactusElliptic/PETSc,
+                       CactusPUGHIO/IsoSurfacer, external/TCPXX,
+                       CactusWave/IDScalarWaveCXX,
+                       CactusWave/IDWaveToyCXX
+                o ntsc-ts1.ncsa.uiuc.edu w/wo HPVM MPI
+                     + Remove: CactusNet/http, external/RemoteIO,
+                       CactusElliptic/PETSc, CactusPUGHIO/IOHDF5,
+                       CactusPUGHIO/IsoSurfacer, external/TCPXX,
+                       CactusWave/IDScalarWaveCXX,
+                       CactusWave/IDWaveToyCXX
+	             + Configure: MPI=CUSTOM MPI_LIBS="mpi.lib fm.lib
+                       advapi32.lib kernel32.lib wsock32.lib" MPI_INC_DIRS
+                       ="d:/apps/hpvm/include"
+	             + Notes: testsuite checking technology doesn't
+                              work here with MPI because of batch queues
+
+           * HP
+                o exemplar.npaci.edu wo MPI, HP-UX 10.01
+                     + Remove: CactusNet/http, external/RemoteIO,
+                       CactusPUGHIO/IsoSurfacer,
+                       CactusElliptic/PETSc, external/TCPXX,
+		       CactusNet/NetGeometry
+
+	   * SP2
+		o quad.mcs.anl.gov wo MPI
+		     + Remove: CactusNet/http, external/RemoteIO,
+		       CactusPUGHIO/IsoSurfacer,
+		       CactusNet/NetGeometry, external/TCPXX,
+		       CactusEinstein/IDAxiBrillBH, 
+	               CactusElliptic/EllPETSc, CactusPUGHIO/IOHDF5
+	             + Notes: dependencies broken for IEEEIO, can ignore
+                              and continue
+
+
+==============================================================================
+==============================================================================
+
+Release Notices for Cactus 4.0 beta 3
+=====================================
+Sunday October 24th 1999
+
+
+Released modules:
+================
+
+      Cactus
+      CactusBase
+      CactusEinstein
+      CactusElliptic
+      CactusNet
+      CactusPUGH
+      CactusPUGHIO
+      CactusWave
+      external
+
+
+Main Changes:
+============
+      Initial implementation of general dimension grid functions
+                                             (CactusPUGH/PUGH)
+      Dynamic courant condition (CactusBase/Time)
+      Ghostzone generality (CactusPUGH/PUGH)
+      Faster compilation times (Cactus)
+
+
+CVS Tag: Cactus_4_0_Beta_3
+=======
+
+
+==============================================================================
+
+
+CHANGES FOR BETA 3
+==================
+
+Utils
+=====
+
+1) The perl processing part of the compilation process
+   now only replaces files which have actually changed,
+   so that compilation times are now much quicker (after
+   the first time).
+
+2) The test suite checker doesn't report a failed test if 
+   thorns needed are missing. 
+
+Util Thorns
+===========
+
+1) The names of boundary condition routines in 
+   CactusBase/Boundary have been standardised and 
+   renamed to make a distinction between groups and
+   variables. The old names remain, but will be removed
+   in Beta 4. See the documentation in this thorn for
+   details.
+
+2) Thorn CactusBase/Time now contains a routine for 
+   using a dynamic courant condition to set the timestep.
+   This is implemented in CactusEinstein/Einstein for 
+   the relativity thorns ... see the documentation in 
+   Time for details.
+
+3) The standard PUGH driver now supports different 
+   numbers of ghostzones in different directions.
+   Also, there is a now a parameter for setting 
+   the number of grid points on each local processor.
+
+4) The standard PUGH driver now supports 1D grid functions.
+
+5) The IsoSurfacer now supports display from Linux machines.
+
+
+Relativity Thorns
+=================
+
+1) Einstein now uses thorn CactusBase/Time to set the
+   timestep (previously Einstein set it itself). This
+   means that you now have to compile Time and add it 
+   to your active thorns, and the parameter einstein::dtfac
+   should be changed to time::dtfac in parameter files.
+
+2) Bugs in misner data and Brill Lindquist data have
+   been fixed
+
+
+==============================================================================
+
+
+KNOWN BUGS IN BETA 3 
+====================
+(See Cactus bug tracking system for a complete list)
+
+1) thorns CactusNet/http, external/TCPXX and external/RemoteIO
+   are not compiling under most platforms other than SGI or
+   Intel Linux
+
+2) Cactus fails to compile for thorns with many grid variables
+   on the origin due to a problem with the C preprocessor.
+
+3) There is a memory bug occuring occasionally in 1D ASCII IO
+
+4) EllPETSc only compiles with MPI, but it doesn't tell you this
+
+5) The testsuite checking technology isn't working under NT
+
+
+==============================================================================
+
+
+WHAT TO EXPECT IN BETA 4
+========================
+
+1) Fixes for all known bugs in Beta 3
+
+2) A mechanism to get rid of all the warnings for unused
+   variables seen with Irix 6.5
+
+3) Fuller implementation of 1D and 2D grid functions
+
+4) Initial implementation of 1D, 2D and 3D arrays
+
+5) Generic implementation of parameter choices for
+   elliptic slicings
+
+6) Maximal slicing properly integrated into ADM
+
+ 
+==============================================================================
+
+
+TEST MACHINES NOTES
+===================
+
+           * Intel Linux
+                o bifrost.aei-potsdam.mpg.de Redhat 6.0, Absoft
+                  compiler, wo MPI
+                     + Remove: CactusPUGHIO/IOHDF5,
+                       CactusElliptic/EllPETSc
+                     + Notes: CactusElliptic/EllPETSc compiled with
+                       MPICH
+                o gullveig.aei-potsdam.mpg.de Redhat 6.0, Absoft
+                  compiler, MPI LAM
+                     + Remove: CactusPUGHIO/IOHDF5,
+                       CactusElliptic/EllPETSc
+           * Dec Alpha
+                o galar.aei-potsdam.mpg.de wo MPI
+                     + Remove: CactusElliptic/EllPETSc,
+                       CactusPUGHIO/HDF5, external/RemoteIO,
+                       CactusNet/http
+           * SGI 64 bit
+                o origin.aei-potsdam.mpg.de Irix 6.5, w/wo native
+                  MPI
+                     + Remove: CactusElliptic/EllPETSc
+                     + Configure: HDF5=yes
+                       HDF5_DIR=/usr/local/apps/hdf5
+           * SGI 32 bit
+                o nott.aei-potsdam.mpg.de Irix 6.5 wo MPI
+                     + Remove: CactusPUGHIO/IOHDF5,
+                       CactusElliptic/EllPETSc
+                     + Notes: Problem with output for PsiKadelia
+                       test
+                o null.wustl.edu Irix 6.2 wo MPI
+                     + Remove: CactusNet/http, CactusPUGHIO/IOHDF5,
+                       CactusElliptic/EllPETSc, external/TCPXX,
+                       external/RemoteIO
+                     + Notes: Gives a lot of warnings about data
+                       alignment
+           * T3E
+                o pc.rzg.mpg.de w/wo native MPI
+                     + Remove:
+                       CactusElliptic/EllPETSc,CactusPUGHIO/IOHDF5,
+                       CactusNet/http, external/RemoteIO
+                     + Notes: dependencies went funny in IEEEIO,
+                       problem with output for PsiKadelia test
+           * Windows NT
+                o saraband.aei-potsdam.mpg.de wo MPI
+                     + Remove: CactusNet/http, external/RemoteIO,
+                       CactusElliptic/PETSc,
+                       CactusPUGHIO/IsoSurfacer, external/TCPXX,
+                       CactusWave/IDScalarWaveCXX,
+                       CactusWave/IDWaveToyCXX
+	             + Notes: tested compilation only, problem with
+                       perl testsuite runner
+                o ntsc-ts1.ncsa.uiuc.edu w/wo HPVM MPI
+                     + Remove: CactusNet/http, external/RemoteIO,
+                       CactusElliptic/PETSc,
+                       CactusPUGHIO/IsoSurfacer, external/TCPXX,
+                       CactusWave/IDScalarWaveCXX,
+                       CactusWave/IDWaveToyCXX
+	             + Configure: MPI=CUSTOM MPI_LIBS="mpi.lib fm.lib
+                       advapi32.lib kernel32.lib wsock32.lib" MPI_INC_DIRS
+                       ="d:/apps/hpvm/include"
+                     + Notes: tested compilation only, problem with
+                       perl testsuite runner
+           * HP
+                o exemplar.npaci.edu wo MPI, HP-UX 10.01
+                     + Remove: CactusNet/http, external/RemoteIO,
+                       CactusPUGHIO/IsoSurfacer,
+                       CactusElliptic/PETSc, external/TCPXX
+                     + Notes: dependencies went funny in TCPXX
+
+