path: root/doc/ReleaseNotes

Cactus Release Notices
CVS Version: $Header: /mnt/data2/cvs2svn/cvs-repositories/Cactus/doc/ReleaseNotes,v 1.2 2002-09-22 13:35:20 allen Exp $

Cactus Release Dates:
  Beta 12 June 7 2002
  Beta 11 January 28 2002
  Beta 10 May 15 2001
  Beta  9 December 21 2000
  Beta  8 July 28 2000
  Beta  7 April 20 2000
  Beta  6 February 8 2000
  Beta  5 November 12 1999
  Beta  4 November 1 1999
  Beta  3 October 24 1999
  Beta  2
  Beta  1

These notices can also be found on the Cactus web pages
http://www.cactuscode.org/Development/ReleaseNotices.html

==============================================================================
==============================================================================

Release Notices for Cactus 4.0 beta 12
======================================
Date: June 7, 2002

Released modules:
================
      Cactus
      CactusBase
      CactusBench
      CactusConnect
      CactusEinstein
      CactusElliptic
      CactusExamples
      CactusExternal
      CactusIO
      CactusPUGH
      CactusPUGHIO
      CactusTest
      CactusUtils
      CactusWave

New thorns:
==========
      CactusPUGHIO/IOHDF5           (formerly in AlphaThorns)
      CactusPUGHIO/IOHDF5Util       (formerly in BetaThorns)
      CactusPUGHIO/IOStreamedHDF5   (formerly in BetaThorns)
      CactusPUGHIO/IOPanda          (formerly in AlphaThorns)
      CactusExamples/HelloWorld
      CactusExamples/SampleIO
      CactusExamples/DemoInterp     (former CactusTest/TestInterp)
      CactusConnect/Socket          (formerly in BetaThorns)
      CactusBase/LocalInterp        (formerly in BetaThorns)
      CactusTest/TestInterp         (replaced by new version)
      CactusEinstein/ADMAnalysis
      CactusEinstein/ADMBase
      CactusEinstein/ADMConstraints
      CactusEinstein/CoordGauge
      CactusEinstein/EvolSimple
      CactusEinstein/IDSimple
      CactusEinstein/SpaceMask
      CactusEinstein/StaticConformal

Removed thorns:
==============
      CactusPUGHIO/IOHDF5 (replaced by new version from AlphaThorns arrangement
      CactusElliptic/EllTest
      CactusEinstein/Einstein

Deprecated thorns:
=================

New supported architectures / operating systems
===============================================

Fujitsu VPP300, VPP700, VPP5000
IA32/OpenBSD 3.0 and 3.1
IA32/Windows XP

CVS Tag:

Cactus_4_0_Beta_12

==============================================================================


CHANGES FOR BETA 12
===================

Utilities
=========

Testsuites:
      New scripts for running and comparing testsuites with more options
      and output.

Flesh
=====

Key/value tables:
      A standard API to store, query and, pass around key/value tables.
      A table holds a set of key/value pairs, where the key is a character
      string and the value may be a scalar or 1-dimensional array of any
      Cactus data type (character, integer, real number, or complex number).
      The table API will be used by other Cactus APIs such as hyperslabbing,
      reduction, interpolation, and I/O thorns to pass optional information.
      (There's a new chapter in the User's Guide on how to use the table API.)

Vector groups:
      Can have a group of variables which appears as a one
      dimensional array of the sources, with the number of GVs in
      this group decided at run time.

Additions of array sizes:
      can specify sizes by integer constants or parameters (from
      same thorn or shared parameter) which may be used in arithmetic
      operations (using *,+,/,-,%,^)

Scheduler:
      STORAGE lines in the schedule.ccl file must now indicate how
      many timelevels to use, for grid variables with more than one
      timelevel.

Array parameters:
      A parameters can now be an array of values instead of just a
      single number.

Accumulator parameters:
      A parameter value can now be automatically built from the
      values of other parameters.

Parameter aliasing:
      Parameters can now be given a different name from their
      original definition in the sources, or other thorns which
      use them.  This can be used to prevent conflicts when
      using or extending a parameter from another implementation.

TAGS on groups:
      Groups can now have an optional tags table (a set of key value
      pairs) associated with them.  These can be queried and
      manipulated through the standard table interface.


Util Thorns
===========

CactusBase/LocalInterp:
      This thorn provides interpolation local to a processor.  It includes
      the former PUGHInterp CCTK_InterpLocal() interpolator, and a new
      CCTK_InterpLocalUniform() interpolator.

CactusConnect/Socket:
      This thorn provides platform-independent socket I/O functionality
      which can be used by other thorns.
      Thorns CactusConnect/HTTPD and CactusPUGHIO/IOStreamedHDF5 now inherit
      from thorn Socket.

New I/O thorns:
      IOHDF5, IOHDF5Util, IOStreamedHDF5, and IOPanda were moved from their
      development arrangements into production mode. They provide new I/O
      methods for output of arbitrary grid variables (and hyperslabs thereof)
      in HDF5 and IEEEIO file format.

Reorganization of I/O Parameters:
      Some I/O parameter names changed in order to make the naming scheme
      consistent between all I/O thorns. The old parameter names are still
      there and can be used. A perl script is provided to rename the changed
      I/O parameters in your parameter files automatically:

        http://www.cactuscode.org/Development/Release/FixParametersForBETA13.pl

CactusBase/IOUtil:
      The new filenaming scheme for output files is now the default.
      This effects all existing testsuites because the output filenames
      changed.
      The old scheme can be selected by setting IO::new_filename_scheme = "no".

CactusBase/IOASCII:
CactusIO/IOJpeg:
CactusPUGHIO/IOHDF5:
CactusPUGHIO/IOStreamedHDF5:
CactusPUGHIO/IOFlexIO:
CactusPUGHIO/IOPanda:
CactusExamples/SampleIO:
      The option 'out_every' can be set in an option string of the 'out_vars'
      I/O parameter to set the output frequency for individual variables.

CactusPUGHIO/IOHDF5:
CactusPUGHIO/IOStreamedHDF5:
CactusPUGHIO/IOFlexIO:
CactusPUGHIO/IOPanda:
      The options 'origin', 'direction', 'extent', and 'downsample' can be
      set as hyperslab parameters in an option string of the 'out_vars' I/O
      parameter to specify a hyperslab selection for individual variables.


Einstein Thorns
===============

The Einstein thorns were reworked for Beta 12, essentially breaking up
the former CactusEinstein/Einstein into more modular components. Much
more documentation for the Einstein thorns is now available in the
ThornGuide.

Refer to the web pages at

      www.cactuscode.org/Community/Relativity.html

for a complete description.

Test Thorns
===========

CactusTest/TestInterp
      This is a new test driver for interpolators, which tests 3 different
      interpolator APIs: CCTK_InterpGV(), CCTK_InterpLocal(), and
      CCTK_InterpLocalUniform().


==============================================================================


KNOWN BUGS IN BETA 12
=====================
(See Cactus bug tracking system for a complete list)

 * The testsuite test_wavef90_zero.par from CactusWave/WaveToyF90 doesn't
   pass on most platforms because of uninitialized boundaries.

 * The testsuite test_maximal_1.par from CactusEinstein/Maximal doesn't
   pass on multiple processors.

 * Recovering and file reading from chunked files doesn't work because
   of a bug in the I/O and hyperslabbing code.
   You should recombine the files into a single unchunked fike and restart
   from that one instead.

 * Some testsuites from thorn CactusTest/TestInterp are reported as failing
   on a few platforms although the created output files only differ in
   machine precision. This is because the Cactus testsuite script cannot
   be configured yet to use different precisions when comparing individual
   output files in the same testsuite.


==============================================================================


WHAT TO EXPECT IN BETA 13
=========================

Improved interfaces for Interpolation and Reduction

==============================================================================


TEST MACHINES NOTES
===================

 Notes:

 1. CactusElliptic/EllPETSc only tested on Linux IA32 and SGI 64 bit
 2. CactusPUGHIO/IOPanda only tested with MPI configurations
 3. On Cray T3E, SP3, and Fujitsu systems the ThornList had to be split into
    two separate lists because the bindings library wouldn't build otherwise
    (argument line to ar command too long).


  * Intel IA32 (Linux Redhat 7.2, LAM/MPICH)

     o gullveig.aei.mgp.de w/wo MPI (Intel ifc/icc 6.0)
       - testsuites failing
         CactusWave/WaveToyF90 (test_wavef90_zero.par)

     o gullveig.aei.mgp.de w/wo MPI (Absoft f90, gcc 2.76)
       - testsuites failing
         CactusWave/WaveToyF90 (test_wavef90_zero.par)

     o platinum.ncsa.uiuc.edu w/wo MPI (Portland C/C++/Fortran compilers 3.3-2)
       - testsuites failing
         CactusWave/WaveToyF90 (test_wavef90_zero.par)
         CactusEinstein/IDBrillData (test_wsor.par)


  * Intel IA64 (Linux ia64 2.4.16)

     o titan.ncsa.uiuc.edu  Intel C/C++/F90 wo MPI
       - testsuites failing
         CactusWave/WaveToyF90 (test_wavef90_zero.par)


 * Intel IA32 (Windows XP/Windows NT, Digital Fortran 6.0, MSVC++ ??)

    o gullveig.aei-potsdam.mpg.de wo MPI
      - not compiling (HDF5 not installed)
          CactusPUGHIO/IOHDF5Util
          CactusPUGHIO/IOHDF5
          CactusPUGHIO/IOStreamedHDF5

      - testsuites failing
          CactusEinstein/ADM (test_ADMadj.par)
          CactusEinstein/ADMConstraints (ADMConstraints_Shift.par)


 * SGI 64 bit (Irix 6.5, MIPSPro f90/cc/CC (7.3.1.2m), Native MPI)

    o origin.aei-potsdam.mpg.de, w/wo MPI


 * SGI 32 bit (Irix 6.5, MIPSpro f90/cc/CC (7.2.1))

    o lux.aei-potsdam.mpg.de w native compilers wo MPI
      - not compiling
          CactusEinstein/TimeGeodesic

      - testsuites failing
          CactusEinstein/ADMConstraints (ADMConstraints_Shift.par)


 * Dec Alpha (OSF1 V5.1, Compaq cc(6.4-014) C++(6.3-008) f90 (5.5-1877),
              Elan MPI)

    o lemieux.psc.edu, w/wo MPI
      - testsuites failing
          with MPI some testsuites are failing but it looks like a transient
          file problem


 * Dec Alpha (OSF1 V4.0, c++(gcc version 2.8.1) DIGITAL Fortran 90 V5.2-705,
              w/wo MPI)

    o holodec19.aei-potsdam.mpg.de
      - testsuites failing
          CactusWave/WaveToyF90 (test_wavef90_zero.par)


 * IBM SP3 (AIX 4.3.3.0)

    o seaborg.nersc.gov with native compilers, native MPI
      - testsuites failing
        CactusWave/WaveToyF90 (test_wavef90_zero.par)


 * Cray T3E (Unicos 2.0.5.54)

    o pc.rzg.mpg.de with native MPI
      - testsuites failing
          CactusEinstein/ADMConstraints (ADMConstraints_Shift.par)
          CactusEinstein/AHFinder (test_AHF_1.par)
          CactusEinstein/IDBrillData (test_wsor.par)
          CactusEinstein/Maximal (test_maximal_1.par)
          BetaThorns/Cartoon2D (test_cartoon_3.par)


 * Sun Sparc II (SunOS 5.7)

    o pitcairn.mcs.anl.gov with native compilers, no MPI
      - not compiling:
        CactusEinstein/TimeGeodesic (internal compiler error on exa_dt.F)

      - testsuites failing
        CactusWave/WaveToyF90 (test_wavef90_zero.par)
        BetaThorns/Cartoon2D (test_cartoon_3.par)


 * MacOS X (Darwin Kernal Version 5.4)

    o seidelg4.aei-potsdam.mpg.de
      [Absoft F90, Apple C/C++ (gcc 2.95.2), MPICH or LAM]


 * Hitachi SR8000-F1 (HI-UX/MPP)

    o sr8000.lrz-muenchen.de with native compilers, native MPI
      - not compiling:
        CactusTest/TestInterp (C++ compiler doesn't know name spaces)

      - testsuites failing
        CactusWave/WaveToyF90 (test_wavef90_zero.par)
        CactusEinstein/IDBrillData (test_brilldata_1.par)
        CactusEinstein/IDBrillData (test_brilldata_2.par)


 * Fujitsu VPP700

    o vpp1.lrz-muenchen.de with native compilers, native MPI
      - not compiling:
        CactusTest/TestInterp (C++ compiler doesn't know name spaces)
        The configuration with all CactusEinstein thorns couldn't be
        built (linker command line too long).

      - testsuites failing
        CactusWave/WaveToyF90 (test_wavef90_zero.par)


==============================================================================
==============================================================================

Release Notices for Cactus 4.0 beta 11
======================================
Date: January 28, 2002

Released modules:
================
      Cactus
      CactusBase
      CactusBench
      CactusConnect
      CactusEinstein
      CactusElliptic
      CactusExamples
      CactusExternal
      CactusIO
      CactusPUGH
      CactusPUGHIO
      CactusTest
      CactusUtils
      CactusWave

New thorns:
==========
      CactusExamples/FleshInfo
      CactusExamples/TimerInfo
      CactusEinstein/Maximal
      CactusTest/TestStrings
      CactusTest/TestTimers

Removed thorns:
==============
      CactusPUGH/Interp (replaced in beta10 by CactusPUGH/PUGHInterp)
   
Deprecated thorns:
=================
      None

CVS Tag: Cactus_4_0_Beta_11

==============================================================================


CHANGES FOR BETA 11
===================

Flesh
=====

Interface:
	Initial support for vector grid variables

	Array sizes can be specified by expressions

Configuration:
	Re-configuration with same extra options (e.g. MPI or HDF5) no longer
	rebuilds whole configuration.

        Implemented user defaults for configuration contained in the file
        $HOME/.cactus/config or $CACTUSRC/.cactus/config

        Changed order of precedence for configuration options, now command line
        options override all others

Compilation:
	New architecture: Fujitsu VPP700
 
	Can now have thorns with no source files.

        Less recompilation necessary eg with HDF5, MPI

Makefile:
	New targets to display configuration information
	gmake configinfo
	gmake <config>-configinfo

Thorn Activation:
	The ActiveThorns parameter is now checked for self-consistency 
	and you are no longer able to incorrectly activate a thorn
	without activating thorns providing implementations a thorn inherits
	from or has declared itself a friend of.

New Utility Functions:
	StringList routines - routines which deal with a fixed-sized
                              sorted list of strings
	Util_asprintf,Util_asnprintf,Util_snprintf,Util_vsnprintf
	added to allow people to use these functions portably.

        Key-value table routines (the Cactus equivalent of perl hash tables).
        (The general API is Util_Table****)

        New chapter added to User Guide for Utility functions, including
        complete description of Key-value routines.
        
Driver:
	Added flesh support for grid arrays to be specified with given 
        integer dimensions, in addition to parameter values. Parameters
        and integers can also be combined with a +/-

        Grid scalars should now be activated with the STORAGE tag in the
        schedule.ccl files. (This influencing their treatment by thorns,
        for example initialisation in drivers and output by IO methods).

	API for some Fortran driver subroutine calls changed to include
	a (missing) integer error argument ierr:

	CCTK_Barrier(ierr, <as before>)
        CCTK_SyncGroup(ierr, <as before>)
	CCTK_SyncGroupI(ierr, <as before>)
	CCTK_SyncGroupWithVar(ierr, <as before>)
	CCTK_SyncGroupWithVarI(ierr, <as before>)
 
	[NOTE for those using CCTK_SyncGroup routines:
	 Please check whether you really need to sync directly, or 
	 whether if it can be moved into the schedule.ccl
         enabling the scheduler do control ghostzone syncronisation. 
	 This will be the only way Cactus can guarantee your code to work 
	 with techniques such as AMR and automatic cache-aware subblocking 
	 once those are available.]

Coordinates:
	New API to allow thorns providing functions to register and
	obtain the extent of the physical grid (using indices).
	
	CCTK_CartRegisterRangePhysIndex
	CCTK_CartRangePhysIndex

Termination:
	There is now a keyword parameter "terminate" to decide whether
	to terminate the evolution loop by "iteration", "time", "either",
	"both" or "never".

Timers:
	Fortran wrappers and documentation added for using Cactus timers

Checkpointing:
	The very first POSTSTEP schedule bin is now before 
	RECOVER_VARIABLES, so that POSTSTEP routines no longer run twice 
	on the same timestep after recovery.

New functions:
	There are several new functions for obtaining information from
	the flesh about IO methods, reduction operators, interpolation
	operators and coordinate systems. An example of using these 
	functions is provided in the new thorn CactusExamples/FleshInfo
 
Util Thorns
===========

CactusBase/IOUtil:
	Parameters added to copy a parameter file to the output directory,
	or to generate one sorted by thorns (see IO::parfile_write and 
	IO::parfile_name)

CactusBase/Time:
	Negative timesteps are now supported.

CactusBase/IOASCII:
        New parameters out1D_style, out1D_style (deprecating out_style) 
        to specify the type of output to perform for xgraph, gnuplot.
	Diagonal output added for non-cubic grids
	IOASCII now outputs all relevent slabs of data from 1D, 2D or 
        3D grid arrays

CactusBase/Boundary:
	Robin boundary conditions added

CactusPUGH/PUGH:
	Implementation of integer specified grid array sizes
	Respect storage for grid scalars
	New debugging function PUGH_PrintStorage(cctkGH) prints the
	variables with storage allocated to screen

CactusUtil/NaNChecker
	Now has an API for calling the NaNChecker directly from thorns,
	and for setting the grid variables to NaNs. The NaNChecker can
	also be used for chosen timelevels.


Einstein Thorns
===============

CactusEinstein/AHFinder:
	Improved IO layer of AHFinder
	AHFinder is now scheduled at ANALYSIS

CactusEinstein/Einstein
	Isotropic Schwarzschild initial lapse added


==============================================================================


KNOWN BUGS IN BETA 11
=====================
(See Cactus bug tracking system for a complete list)

==============================================================================


WHAT TO EXPECT IN BETA 12
=========================

Improved interfaces for Interpolation and Reduction
Thorn LocalInterp for interpolation local to a processor

==============================================================================


TEST MACHINES NOTES
===================

[Note: CactusElliptic/EllPETSc only tested on Linux IA32 and SGI 64 bit]

           * MacOS X (Darwin Kernal Version 5.2)
                o seidelg4.aei-potsdam.mpg.de 
	          [Absoft F90, gcc 2.95.2, MPICH or LAM]

	        - not compiling because of buggy C preprocessor
			CactusBase/Boundary (fix available on Cactus web pages)
		- notes
			CactusEinstein/ADM and CactusEinstein/AHFinder can only
			be compiled without optimisation

           * SGI 64 bit (Irix 6.5)
                o origin.aei-potsdam.mpg.de, w/wo native MPI
		- testsuites failing
			CactusEinstein/IDBrillData

           * SGI 32 bit (Irix 6.5)
                o nott.aei-potsdam.mpg.de w native compilers wo MPI 

           * Cray T3E (Unicos mk2.0.5.X)
                o berte.zib.de w/wo native MPI
                - failing testsuites
			CactusEinstein/AHFinder
			CactusEinstein/IDBrillData (on multiprocessors)

           * Sun Sparc II (SunOS 5.7)
                o pitcairn.mcs.anl.gov with native compilers, no MPI
		- not compiling
			CactusEinstein/TimeGeodesic

	   * IBM SP2 (AIX 4.3.3.0)
                o seaborg.nersc.gov with native compilers, MPI

           * Intel IA64 (Linux ia64 2.4.13)
                o  ia64.osc.edu  Intel C/C++/F90 w/wo MPICH Myrinet
	
	   * Intel IA32 (Linux Redhat 6.2)
		o xeon01.aei.mpg.de w/wo MPICH (shmem device)

                Fortran compiler: Intel icc/F90

                o bifrost.aei-potsdam.mpg.de w/wo MPICH (p4 and shmem devices)

	        Fortran compiler: Absoft F90

	        Fortran compiler: Lahey F90

	        Fortran compiler: Vast F90
                - not compiling: 
			CactusEinstein/AHFinder

	        Fortran compiler: g77 F77
		- not compiling
			Fortran77/90 thorns

                o bifrost.aei-potsdam.mpg.de w LAM

	        Fortran compiler: Absoft F90
                - not compiling: 
			CactusEinstein/TimeGeodesic (compiles without LAM MPI)

           * Intel IA32 (Windows 2000)
                o gullveig.aei-potsdam.mpg.de wo MPI
		- not compiling
			CactusConnect/HTTPDExtra
			CactusUtils/NaNChecker

           * Dec Alpha (OSF1 V4.0 1229 alpha)
                 o holodec01.aei.mpg.de wo MPI

	   * Hitachi SR8000-F1 (HI-UX/MPP)
                o sr8000.lrz-muenchen.de with native MPI and compilers
                - failing testsuites
			CactusEinstein/AHFinder
			CactusEinstein/IDBrillWave

           * Fujitsu VPP700
                o vpp1.lrz-muenchen.de with native compilers, native MPI
                - not compiling because of peculiar fortran compiler
			CactusEinstein/AHFinder 
			(minval, maxval, trim not recognized as 
			 intrinsic functions)


==============================================================================
==============================================================================

Release Notices for Cactus 4.0 beta 10
======================================
Date: May 15th 2001

Released modules:
================
      Cactus
      CactusBase
      CactusBench
      CactusConnect
      CactusEinstein
      CactusElliptic
      CactusExamples
      CactusExternal
      CactusIO
      CactusPUGH
      CactusPUGHIO
      CactusTest
      CactusUtils
      CactusWave

New thorns:
==========
   
CactusUtils/NaNChecker
CactusPUGH/PUGHInterp

Deprecated thorns:
=================

CactusPUGH/Interp (removed for next release)

CVS Tag: Cactus_4_0_Beta_10

==============================================================================


CHANGES FOR BETA 10
===================

Flesh
=====

Timelevels:
	Changed the calling order in default Evolve routines so that
	timelevels are rotated before the evolution step. See

	www.cactuscode.org/Development/Specs/TimeLevels.txt for details.

	The naming convention for different timelevels also changed, so that
        e.g. phi, phi_p, phi_p_p is used instead of phi_n, phi, phi_p

        Also, the current timelevel always has the index 0.

Interpolation:
	Made needed changes to the interpolation interface, and also 
	removed some unnecessary APIs. Since rather a lot has changed
	we refer you to the Interpolation and Function Reference section of 
	the Users Guide and also to the documentation of the new thorn
	CactusPUGH/PUGHInterp. 

Parameters:
	Re-worked the parameter checking section of the flesh, everything
	should be the same, apart from by default Cactus will stop with
	an error if you have a parameter in your parameter file which isn't
	found despite being from an active thorn.

	There is a new command line option -parameter-level which can be
	set to relaxed, normal (default), or strict to give more or less
	parameter checking. 

Compilation:
	New architecture: MacOSX. At the moment we don't have access
        to a fortran compiler, or MPI with MacOSX, but single processor
        C thorns are working.

	Added cache information and standard optimisation flags for 
	Hitachi SR-8000, now Cactus runs a lot quicker there!

        Libraries are now only updated, and the executable rebuilt if
        code has actually changed.
	
Configuration:
        Added USE_RANLIB option to have the make system use ranlib to 
        generate the index of each library.  Thus the configuration line
        or the known-architecture file can now set USE_RANLIB=yes.

Function Aliasing:
	Added first implementation of Function Aliasing for thorn functions.
	At the moment working for C functions which have Cactus arguement
	and return types, and the aliased functions can be called from
	C or Fortran thorns.

Fortran Strings:
	Tidied up the fortran string macros to make them more consistent,
        now they are

	ONE_FORTSTRING_ARG
	TWO_FORTSTRING_ARG
	THREE_FORTSTRING_ARG
	ONE_FORTSTRING_CREATE(arg1)
	TWO_FORTSTRING_CREATE(arg1,arg2)
	THREE_FORTSTRING_CREATE(arg1,arg2,arg3)
	ONE_FORTSTRING_PTR(arg1)
	TWO_FORTSTRING_PTR(arg1, arg2)
	THREE_FORTSTRING_PTR(arg1, arg2, arg3)

	The old ones (which have "s"s in seemingly random places), are
	deprecated. Also fixed up the documentation for these in the 
	Users Guide.

Documentation:
	Added new gmake target
	
	gmake ThornGuide

	which gathers together the documentation,  provided in each thorn,
        and parses the configuration files to produce documentation for 
        all the thorns in the arrangements directory. The documentation
        is placed in ThornGuide.ps in the home Cactus directory.

        gmake <config>-ThornGuide 

        will produce documentation for just the thorns in <config>, and
        place it is ThornGuide-<config>.ps in the home Cactus directory.

Util Thorns
===========

CactusBase/Boundary: 
	Added directional boundary conditions 
	(see documentation.tex in thorn)

CactusPUGH/PUGH
	The parameter enable_all_storage works again.
        The parameter initialize_memory was added, when cactus allocatates
        memory it can be uninitialised (default), NaN (useful for debugging),
        or zeroed (if you're a little lazy). The NaN option is useful 
        in conjuction with the NaNChecker thorn

CactusPUGH/PUGHInterp:
	New C version of standard interpolator to replace the old Fortran
	version. This version should also be about twice as fast as the old
	version. The main change for users from before is that there is 
        no parameter in PUGHInterp to set the order of interpolation, 
	instead 1st, 2nd and 3rd order interpolation are registered as 
	different interpolation operators. This allows users to choose from
	an application thorn which order to use, and does not force all 
	calls to the interpolator to have the same order.

	New names for interpolation operations are:
		* first-order uniform cartesian
		* second-order uniform cartesian
		* third-order uniform cartesian

        The old thorn CactusPUGH/Interp will be removed in the next 
        release, so please move over to PUGHInterp.

CactusUtils/NaNChecker:
       New simple thorn, very useful for debugging to find NaNs in 
       Cactus variables.

HDF5 Tools:
	Recombiner

Einstein Thorns
===============

==============================================================================


KNOWN BUGS IN BETA 10
=====================
(See Cactus bug tracking system for a complete list)

==============================================================================


WHAT TO EXPECT IN BETA 11
=========================

==============================================================================


TEST MACHINES NOTES
===================

           * MacOS X (Darwin Kernal Version 1.3)
                o g4.aei-potsdam.mpg.de with gcc 2.95.2 
	        - not compiling
			Fortran77/90 thorns (no Fortran compiler installed)
	
	   * Intel IA32 (Linux Redhat 6.2)
                o bifrost.aei-potsdam.mpg.de w/wo MPICH (p4 and shmem devices)

	        Fortran compiler: Absoft F90
                - not compiling: 
			CactusElliptic/EllPETSc (compiles with MPI)

	        Fortran compiler: Lahey F90
                - not compiling: 
			CactusElliptic/EllPETSc (compiles with MPI)

	        Fortran compiler: Vast F90
                - not compiling: 
			CactusElliptic/EllPETSc (compiles with MPI)
			CactusEinstein/AHFinder

	        Fortran compiler: g77 F77
		- not compiling
			Fortran77/90 thorns

                o bifrost.aei-potsdam.mpg.de w LAM

	        Fortran compiler: Absoft F90
                - not compiling: 
			CactusEinstein/TimeGeodesic (compiles without LAM MPI)
			CactusElliptic/EllPETSc     (PETSc compiled for MPICH)
			
           * Cray T3E (Unicos mk2.0.5.X)
                o berte.zib.de w/wo native MPI
                - not compiling:
			CactusElliptic/EllPETSc (PETSc not installed)
                - failing testsuites
			test_AHF_1
                 
           * Dec Alpha (OSF1 V4.0 1229 alpha)
                 o holodec05.aei.mpg.de with gcc 2.8.1, 
                   HDF5, and MPICH (ch_shmem)
                 - not compiling
			Cactus/Elliptic/EllPETSc (PETSc not installed)
                 - failing testsuites
			test_AHF_1
			test_AHF_2

	   * IBM SP2 (AIX 4.2.0.0)
                o quad.mcs.anl.gov with native compilers, MPI
	        - not compiling
      	          CactusElliptic/EllPETSc (PETSc not installed)

           * SGI 64 bit (Irix 6.5)
                o origin.aei-potsdam.mpg.de, w/wo native MPI
		- not compiling
			CactusElliptic/EllPETSc (PETSc not installed)
                  
           * SGI 32 bit (Irix 6.5)
                o bug.aei-potsdam.mpg.de w native compilers wo MPI 
		- not compiling
			CactusElliptic/EllPETSc (PETSc not installed)

           * Intel IA64 (TurboLinux Frontier 2.3.99-pre6-000501-18)
                o  SGI gcc and f90 wo MPI
		- not tested

           * Intel IA32 (Windows NT 4.0)
                o ntsc-ts1.ncsa.uiuc.edu w/wo MPI (HPVM)
		- not tested

           * Intel IA32 (Windows 2000)
                o ctclogin1.tc.cornell.edu w/wo MPI (MPIPro)
                - system change has broken CST, workaround in beta11

           * Intel IA32 (Windows 2000)
                o VM on fandango.aei-potsdam.mpg.de wo MPI
		- not compiling
			CactusElliptic/EllPETSc (PETSc not installed)
			CactusPUGHIO/IOHDF5 (HDF5 not installed)
			CactusUtils/NanChecker (no isnan function)
		- failing testsuites
			test_WaveToy2D

           * Sun Sparc II (SunOS 5.7)
                o pitcairn.mcs.anl.gov with native compilers, no MPI
		- not compiling
			CactusElliptic/EllPETSc (PETSc not installed)
			CactusEinstein/TimeGeodesics

	   * Hitachi SR8000-F1 (HI-UX/MPP)
                o sr8000.lrz-muenchen.de with native MPI and compilers
                - not compiling:
			CactusElliptic/EllPETSc (PETSc not installed)
			CactusEinstein/TimeGeodesic 
                        (gmake and MPI installation problem)
                - could only test on 1 processor (no more procs available)
                  AHFinder output has spaces in a single fp number which
                  is treated as an error by Runtest.pl


==============================================================================
==============================================================================

Release Notices for Cactus 4.0 beta 9
=====================================
Date: 21st December 2000

Released modules:
================
      Cactus
      CactusBase
      CactusBench
      CactusConnect
      CactusEinstein
      CactusElliptic
      CactusExamples
      CactusIO
      CactusPUGH
      CactusPUGHIO
      CactusTest
      CactusWave
      CactusExternal

New thorns:
==========
   
      CactusConnect arrangement
      CactusIO arrangement
      CactusExternal arrangement

      CactusConnect/HTTPD
      CactusConnect/HTTPDExtra
      CactusExternal/FlexIO
      CactusExternal/jpeg6b
      CactusIO/IOJpeg
      CactusPUGH/PUGHReduce
      

Removed thorns:
==============

      external arrangement
      external/IEEEIO (moved to CactusExternal/FlexIO)
      external/TCPXX
      external/RemoteIO
      external/jpeg6b (moved to CactusExternal/jpeg6b)

CVS Tag: Cactus_4_0_Beta_9
=======


==============================================================================


CHANGES FOR BETA 9
==================

Flesh
=====

1) New functions:
	CCTK_RunTime - number of seconds since simulation started
	CCTK_CurrentTime - string with current time
	CCTK_CurrentData - string with current date
        CCTK_ParameterFilename - returns full name of parameter file used
	Util_SplitFilename - returns directory and filename from full name

2) Running:

	The parameter file can now be read from standard input by adding
        a "-" at the end of the executable line, e.g.

	 ./exe/cactus_myconfig -

3) Compilation:

	CST will no longer stop for duplicate thorn names in the ThornList
	which are in the same arrangement

	The thorn list can be specified on the compile line with the new
	argument THORNS. This can be used in conjunction with THORNLIST

	  gmake myconfig-config THORNS="Fancy/NewOne" THORNLIST="OldOne.th"

        (Note that the notation for this will probably change slightly 
         for the next release)

        CST now accept USES without a range block in the param.ccl

        CST no longer accepts deprecated keyword LOGICAL for BOOLEAN

4) Deprecated:

	CCTK_GetInterpHandle        -> CCTK_InterpHandle
	CCTK_RegisterInterpOperator -> CCTK_InterpRegisterOperator
	CCTK_mkdir                  -> CCTK_CreateDirectory
	FMODIFIER                   -> CCTK_FCALL
	FORTRAN_NAME                -> CCTK_FNAME

5) Removed deprecated macros

	GROUP_SCALAR -> CCTK_SCALAR
	GROUP_GF     -> CCTK_GF
	GROUP_ARRAY  -> CCTK_ARRAY

	GROUP_PRIVATE   -> CCTK_PRIVATE
	GROUP_PROTECTED -> CCTK_PROTECTED
	GROUP_PUBLIC    -> CCTK_PUBLIC

6) Changed names

        DISTRIB_CONSTANT -> CCTK_DISTRIB_CONSTANT
	DISTRIB_DEFAULT  -> CCTK_DISTRIB_DEFAULT

7) Coordinates

	Fixed bug in CCTK_CoordLocalRange

8) CYGWIN/Windows compilation updates

        Works with latest Cygwin (1.1.6)
        Works with Intel icl and ifl compilers
        Picks up INCLUDE environment variable when making dependencies
        LIBS and LIBDIRS may now be set in the make.config.defn file
        Tested under Windows 2000
        Preliminary configuration support for HPVM
             MPI=HPVM HPVM_DIR='...'
        Preliminary configuration support for MPIPro
             MPI=MPIPro

        (See README.NT for specific details of Cactus on the Windows platform.)

9) AIX

        Free format F90 now works.

Util Thorns
===========

1) CactusBase/Time: Added fixed timestep and changed some parameter names
                 to be more consistent:

		 courant_method -> method

		 options:	given
				courant_static (was standard)
				courant_speed  (was courant)
				courant_time

		 courant_outevery -> timestep_outevery

2) CactusBase/Boundary,CartGrid3D: Deprecated functions

	ConstantBCVar
	ConstantBCVarI
	ConstantBCGroup
	ConstantBCGroupI
	ApplyConstantBC
	CopyBCGroup
	CopyBCGroupI
	CopyBCVar
	CopyBCVarI
	FlatBCGroupI
	FlatBCGroup
	FlatBCVarI
	FlatBCVar

3) CactusBase/IOUtil

   The utility routine to parse variable names in a parameter file string
   IOUtil_ParseVarsForOutput has now been generalised and moved to the
   Flesh. It is now called CCTK_TraverseString. 

4) CactusPUGH/PUGH

   No longer parallelises on directions with less than or equal to 
   2*ghostsize+1 points.

   Reduction operators have been removed from CactusPUGH/PUGH and moved 
   into the new thorn CactusPUGH/PUGHReduce

5) CactusConnect

   New arrangement with thorns to add a web server to the simulation, which
   can be accessed via any web browser to access information and basic
   visualisation for the simulation, as well as providing steering 
   capabilities. See the WebServer-HOWTO for more details

6) CactusIO/IOJpeg

   IO method providing 2D images in jpeg format

Einstein Thorns
===============

CactusEinstein/ADM:
	bound = radiation -> bound = radiative



==============================================================================


KNOWN BUGS IN BETA 9
====================
(See Cactus bug tracking system for a complete list)

==============================================================================


WHAT TO EXPECT IN BETA 10
=========================

1) Function definitions in CCL files

2) CCL file with configuration information

3) Full hyperslabbing interface

4) C version of Interp

5) More documentation

6) More bug fixes

==============================================================================


TEST MACHINES NOTES
===================

	   * Intel IA32 (Linux Redhat 6.2)
                o bifrost.aei-potsdam.mpg.de w/wo MPICH (p4 and shmem devices)

	        Fortran compiler: Absoft F90
                - not compiling: 
			CactusElliptic/EllPETSc (compiles with MPI)

	        Fortran compiler: Vast F90
                - not compiling: 
			CactusElliptic/EllPETSc (compiles with MPI)
			CactusEinstein/AHFinder
                - failing testsuite
			test_extract.par (file handle problem)

	        Fortran compiler: g77 F77
                - not compiling: 
			CactusBench/BenchADM
			CactusEinstein/ADM
			CactusEinstein/ADMConstraints
			CactusEinstein/AHFinder
			CactusEinstein/Extract
			CactusEinstein/IDAxiBrillBH
			CactusEinstein/IDBrillData
			CactusEinstein/IDLinearWaves
			CactusEinstein/PsiKadelia
			CactusEinstein/TimeGeodesic
			CactusElliptic/EllPETSc
			CactusElliptic/EllSOR
			CactusElliptic/EllTest
			CactusPUGH/Interp
			CactusTest/TestArrays
			CactusTest/TestCoordinates
			CactusTest/TestInclude1
			CactusTest/TestInclude2
			CactusTest/TestComplex
			CactusTest/TestInterp
			CactusTest/TestReduce
			CactusWave/WaveToyF90
			CactusWave/WaveToyFreeF90
			
	   * Intel IA32 (Linux Redhat 6.2)
                o loslobos.alliance.unm.edu 
                - not compiling: 
			CactusElliptic/EllPETSc (PETSc not installed)
			
           * Cray T3E (Unicos mk2.0.5.X)
                o berte.zib.de w/wo native MPI
                - not compiling:
			CactusElliptic/EllPETSc (PETSc not installed)
		- failing testsuites
                        test_AHF_1
                        test_AHF_2
                
           * Dec Alpha (osf4.0f, gcc 2.95.2)
                o jalapeno.cactuscode.org wo MPICH 
		- not compiling
			Cactus/Elliptic/EllPETSc (PETSc not installed)
		- failing testsuites
			test_ADM_2
		- comments:
			compiles with MPICH (p4, shmem), but didn't get
			to run testsuite

	   * IBM SP2 (AIX 4.2.0.0)
                o quad.mcs.anl.gov w/wo native MPI
                - not compiling:
			CactusElliptic/EllPETSc (PETSc not configured 
			for this machine)

           * SGI 64 bit (Irix 6.5)
                o origin.aei-potsdam.mpg.de, w/wo native MPI
		- not compiling:
			CactusElliptic/EllPETSc (compiles with MPI)
	
           * SGI 32 bit (Irix 6.5)
                o nott.aei-potsdam.mpg.de wo MPI
		- not compiling:
			CactusElliptic/EllPETSc (compiles with MPI)
			CactusPUGHIO/IOHDF5 (HDF5 not installed)

           * Intel IA32 (Windows NT 4.0)
                o ntsc-ts1.ncsa.uiuc.edu w/wo MPI (HPVM)
                - not compiling:
			CactusElliptic/EllPETSc (PETSc not installed)
			CactusPUGHIO/IOHDF5 (HDF5 not installed)
		- failing testsuites
                        test_ADM_4
                        test_extract
                        test_WaveToy2D
		- comments: 
                  MPI configured with MPI=HPVM HPVM_DIR='d:\apps\hpvm'
                  Test suite not run on MPI compilation due to batch system

           * Intel IA32 (Windows 2000)
                o ctclogin1.tc.cornell.edu w/wo MPI (MPIPro)
                - not compiling:
			CactusElliptic/EllPETSc (PETSc not installed)
			CactusPUGHIO/IOHDF5 (HDF5 not installed)
		- failing testsuites
                        test_extract
                        test_WaveToy2D
		- comments: 
                  MPI configured with MPI=MPIPro
                  Test suite not run on MPI compilation due to batch system

           * Sun Sparc II (SunOS 5.7)
                o pitcairn.mcs.anl.gov  (no MPI)
		- not compiling
			CactusEinstein/TimeGeodesics

	   * Hitachi SR8000-F1 (HI-UX/MPP)
		o contact cactusmaint@cactuscode.org for status
                o sr8000.lrz-muenchen.de w/wo native MPI
                - not compiling:
			CactusElliptic/EllPETSc (PETSc not installed)
			CactusEinstein/TimeGeodesic with MPI


==============================================================================
==============================================================================

Release Notices for Cactus 4.0 beta 8
=====================================
Date: 28th July 2000

Released modules:
================
      Cactus
      CactusBase
      CactusBench
      CactusEinstein
      CactusElliptic
      CactusExamples
      CactusPUGH
      CactusPUGHIO
      CactusTest
      CactusWave
      external

New thorns:
==========
      CactusPUGH/PUGHSlab
      CactusBase/IOASCII
      CactusWave/WaveBinarySource

Removed thorns:
==============
      CactusPUGHIO/IOASCII	
      CactusWave/IDBinarySource
      CactusNet/*

New supported architectures
===========================
      Solaris
      Intel IA64
      Hitachi SR8000-F1 (partial)
      
CVS Tag: Cactus_4_0_Beta_8
=======


==============================================================================


CHANGES FOR BETA 8
==================

Infrastructure
==============

Flesh
=====

1) Calling Fortran routines
   FMODIFIER is deprecated (removed in beta 9)
   FMODIFIER -> CCTK_FCALL
   FORTRAN_NAME is deprecated (removed in beta 9)
   FORTRAN_NAME -> CCTK_FNAME

2) Fixed bug in CCTK_SyncGroups which could have affected anyone 
   synchronising from the scheduler

3) Added new function 

   CCTK_CreateDirectory(pathname, mode)

   which creates a new directory (including any parent directories
   needed). This function replaces CCTK_mkdir, which will be removed
   in beta 9.  This new function doesn't use the 'system' call, so
   has resolved a long-standing problem with the myrinet libraries.

4) Some routine name changes and extra arguements added (needed for 
   handling coordinate systems for different dimensions). Now as well 
   as registering coordinate names, coordinate systems are also registered.
   See the Users Guide for details of the new routines.

   Removed routines

   CCTK_RegisterCoordI
   CCTK_CoordOrigin
   CCTK_RegisterCoord
   CCTK_RegisterCoordRange

   New routines/Changed argument lists

   CCTK_CoordRegisterRange
   CCTK_CoordRange
   CCTK_CoordSystemDim
   CCTK_CoordDir
   CCTK_CoordIndex
   CCTK_CoordRegisterData

   Be warned, these could change again slightly, as we realise what
   the coordinate functions have to be capable of handling.

5) Changed names of interpolation calls to fit standard notation

   CCTK_GetInterpHandle -> CCTK_InterpHandle
   CCTK_RegisterInterpOperator -> CCTK_InterpRegisterOperator

   Old names will be removed in beta 9

6) Removed deprecated include files 

   cctk_arguments.h -> cctk_Arguments.h
   cctk_parameters.h -> cctk_Parameters.h

7) Arguments changed to exit calls

   CCTK_Exit(int retval, cctkGH *GH) -> CCTK_Exit(cctkGH *GH, int retval)
   CCTK_Abort(cctkGH *GH)            -> CCTK_Abort(cctkGH *GH, int retval)

   The first change is just for consistency, the second because MPI_Abort
   takes an exit code. Driver thorn writers should change any overloaded 
   functions.

8) Building include files

   The notation for building include files has changed, to make a distinction
   between executable source code and header files. This is so that 
   executable source code can be wrapped by a call to CCTK_IsThornActive.
   See the documentation for details. The old notation will still work
   but will be removed in Beta 9.

9) Reduction operators

   Registered reduction operators should now return an int, rather than a void.

10) The GNU regex and getopt libraries are only compiled if they, or the
    equivalent, are not available on the system already.  This solved a
    long-standing bug when compiling with the Portland C compiler.

Util Thorns
===========

1) CactusBase/CartGrid3D

   Removed deprecated routines:

	SetCartSymmetry
	SetCartSymVN
	CartSymBCGroupI
	CartSymBCVar
	CartSymBCVarI
	CartSymBCGroup
	SetCartSymBCVar
	CartSymBCGroup
	ApplySymmetry
	RadiativeBCVar
	RadiativeBCVarI
	RadiativeBCGroup
	RadiativeBCGroupI


  Replaced by:

	SetCartSymGN 
	SetCartSymGI
	SetCartSymVN
	SetCartSymVI
	CartSymGN
	CartSymGI
	CartSymVN
	CartSymVI

   Note that all the Fortran calls now have an integer error code as the 
   first argument

2) CactusPUGH/PUGHSlab: This is a new thorn which returns data from a 
   hyperslab of a given grid function. This functionality makes writing 
   IO thorns a lot easier, and will give them much more functionality.

3) CactusBase/IOASCII: CactusPUGHIO/IOASCII now make use of thorn 
   PUGHSlab to obtain it's data, this means that it no longer makes 
   use of PUGH, and so has moved arrangements. To compile 
   CactusBase/IOASCII you should have CactusPUGH/PUGHSlab (or any other 
   implementation of hyperslab) in your active thorns list.

4) CactusBase/Boundary: 

   The following functions are deprecated, and will be removed in beta 9

   ConstantBCVar
   ConstantBCVarI
   ConstantBCGroup
   ConstantBCGroupI
   ApplyConstantBC
   CopyBCGroup
   CopyBCGroupI
   CopyBCVar
   CopyBCVarI
   FlatBCGroupI
   FlatBCGroup
   FlatBCVarI
   FlatBCVar

   the routines for applying constant boundary conditions now follow 
   the standard notation

   BndScalarVI (by variable index)
   BndScalarVN (by variable name)
   BndScalarGI (by group index)
   BndScalarGN (by group name)

   BndCopyVI   
   BndCopyVN   
   BndCopyGI   
   BndCopyGN   

   BndRadiativeVI
   BndRadiativeVN
   BndRadiativeGI
   BndRadiativeGN

   BndFlatVI
   BndFlatVN
   BndFlatGI
   BndFlatGN

5) CactusBase/IOASCII:

   Now can do 2D output of ASCII data from 3D grid functions

6) CactusBase/IOUtil, CactusBase/IOASCII, CactusBase/IOFlexIO

   Changed and added parameters for the way that 1D and 2D slices are
   selected for output. The symmetry parameters (e.g. octant) from CartGrid3D
   are no longer used, instead there are now parameters for specifying 
   the slice by a physical coordinate or by a grid index. These parameters
   default to the parameters in IOUtil, but can be overriden by parameters
   for the individual methods. The order of choosing the data by parameters
   in the parameter file is

   * if an index is set for a method that is used or
   * if an index is set for IOUtil that is used or
   * if a coordinate value is set for a method that is used or
   * if a coordinate value is set for IOUtil that is used

   if nothing is set in the parameter file you get the same output as 
   before EXCEPT for a full grid the lines/planes will move to index 0 
   rather than being at the center of the grid.

7) CactusBase/IOUtil

   The utility routine to parse variable names in a parameter file string
   for IO is now called 

   IOUtil_ParseVarsForOutput

   changed from ParseVarsForOutput

8) CactusWave/WaveBinarySource

   New thorn which evolves orbiting scalar sources, this is useful since
   it provides a constant wave stream for testing.

9) CactusTest: New Arrangement

   Thorns for testing different parts of the Cactus infrastructure

10) CactusExamples: New Arrangement

    Example applications ... the WaveToy example in 1D and 2D, defining
    coordinates etc.

11) CactusNet

    This is still available, but due to the very active development of the
    thorns in this arrangement we decided to not include it in the set of
    tested thorns for this release.

==============================================================================


KNOWN BUGS IN BETA 8
====================
(See Cactus bug tracking system for a complete list)

1) Output for DISTRIB=CONSTANT arrays isn't supported yet.
2) Deletion of a thorn which was in the ThornList of a
   configuration requires the user to manually delete
   make.thornlist in <config>/config-data
3) No warning for unreachable schedule points.
4) Activation doesn't check that all parent and friend 
   implementations are activated.
 
==============================================================================


WHAT TO EXPECT IN BETA 9
========================

1) More sophisticated method to incorporate external libraries
2) Function aliasing
3) Directional syncing policies in the schedule.ccl
4) gmake bugreport, gmake <config>-bugreport

... and, as normal, more documentation and bug fixes.

==============================================================================


TEST MACHINES NOTES
===================

	   * Intel IA32 (Linux Redhat 6.2)
                o bifrost.aei-potsdam.mpg.de w/wo MPICH (p4 and shmem devices)

	        Fortran compiler: Portland, Absoft F90
                - not compiling: 
			CactusElliptic/EllPETSc (compiles with MPI)

	        Fortran compiler: Vast F90
                - not compiling: 
			CactusElliptic/EllPETSc (compiles with MPI)
			CactusEinstein/AHFinder

	        Fortran compiler: g77 F77
                - not compiling: 
			CactusBench/BenchADM
			CactusEinstein/ADM
			CactusEinstein/ADMConstraints
			CactusEinstein/AHFinder
			CactusEinstein/Extract
			CactusEinstein/IDAxiBrillBH
			CactusEinstein/IDBrillData
			CactusEinstein/IDLinearWaves
			CactusEinstein/PsiKadelia
			CactusEinstein/TimeGeodesic
			CactusElliptic/EllPETSc
			CactusElliptic/EllSOR
			CactusElliptic/EllTest
			CactusPUGH/Interp
			CactusTest/TestArrays
			CactusTest/TestCoordinates
			CactusTest/TestInclude1
			CactusTest/TestInclude2
			CactusTest/TestComplex
			CactusTest/TestInterp
			CactusWave/WaveToyF90
			CactusWave/WaveToyFreeF90
			

	   * Intel IA32 Cluster (Linux Redhat 6.2)
                o roadrunner.alliance.unm.edu w/wo MPICH (gm device)
		- not compiling:
			CactusElliptic/EllPETSc (should work) 
			CactusPUGHIO/IOHDF5 (HDF5 not installed)

			
           * Cray T3E (Unicos mk2.0.5.X)
                o berte.zib.de w/wo native MPI
                - not compiling:
			CactusElliptic/EllPETSc (PETSc not installed)
			CactusPUGHIO/IsoSurfacer
			external/RemoteIO
			external/TCPXX
		- failing testsuite
			CactusEinstein/IDAxiBrillBH


           * Dec Alpha (osf4.0f, gcc 2.95.2)
                o jalapeno.cactuscode.org w/wo MPICH (shmem and p4 devices)
		- not compiling:
			CactusElliptic/EllPETSc (not installed)
			external/RemoteIO
			external/TCPXX


	   * HP Exemplar (HPUX 10.01)
		We no longer have access to a HP Exemplar for testing


	   * IBM SP2 (AIX 4.2.0.0)
                o quad.mcs.anl.gov w/wo native MPI
		- not compiling:
			CactusElliptic/EllPETSc (not installed)
			CactusPUGHIO/IOHDF5 
			CactusPUGHIO/IsoSurfacer
			CactusWave/WaveToyFreeF90
			external/RemoteIO,
			external/TCPXX,
	        - comments:
			Free format fortran isn't supported yet

           * SGI 64 bit (Irix 6.5)
                o origin.aei-potsdam.mpg.de, w/wo native MPI
		- not compiling:
			CactusElliptic/EllPETSc (compiles with MPI)

	
           * SGI 32 bit (Irix 6.5)
                o nott.aei-potsdam.mpg.de wo MPI
		- not compiling
			CactusElliptic/EllPETSc (not installed)
			CactusPUGHIO/IOHDF5 (not installed)


           * Intel IA64 (TurboLinux Frontier 2.3.99-pre6-000501-18)
                o  SGI gcc and f90  crosscompiler wo MPI
                - not compiling
			CactusElliptic/EllPETSc (PETSc not installed)
			CactusPUGHIO/IOHDF5 (HDF5 not installed)
			CactusPUGHIO/IsoSurfacer (compiles with native compiler)
			external/RemoteIO (compiles with native compiler)
			external/TCPXX (compiles with native compiler)


           * Intel IA32 (Windows NT 4.0)
                o saraband.aei-potsdam.mpg.de (VM) wo MPI
                - not compiling
			CactusElliptic/EllPETSc (not installed)
			CactusPUGHIO/IOHDF5 (not installed)
			CactusPUGHIO/IsoSurfacer
			external/RemoteIO
			external/TCPXX
		- failing testsuite
			CactusEinstein/ADM
			CactusEinstein/AHFinder
			CactusExamples/WaveToy2D
			CactusPUGHIO/IOFlexIO
		- comments: 
                        *** Need to use beta 5 version of IEEEIO ***
                            > cd arrangements/external/IEEEIO
                            > cvs update -r Cactus_4_0_Beta_5


           * Intel IA32 (Windows NT 4.0)
                o ntsc-ts1.ncsa.uiuc.edu w/wo MPI (HPVM)
                - not compiling
			CactusElliptic/EllPETSc (not installed)
			CactusPUGHIO/IOHDF5 (not installed)
			CactusPUGHIO/IsoSurfacer
			external/RemoteIO
			external/TCPXX
		- failing testsuite
			CactusEinstein/ADM
			CactusEinstein/AHFinder
			CactusExamples/WaveToy2D
			CactusPUGHIO/IOFlexIO
		- comments: 
                        *** Need to use beta 5 version of IEEEIO ***
                            > cd arrangements/external/IEEEIO
                            > cvs update -r Cactus_4_0_Beta_5
			Maybe problems with MPI (but probably just
			this machine)


           * Sun Sparc II (SunOS 5.7)
                o ufer.zib.de (VM) w/wo MPICH (p4 device)
                - not compiling
			CactusEinstein/IDAxiBrillBH 
			CactusElliptic/EllPETSc (PETSc not installed)
			CactusPUGHIO/IOFlexIO
			CactusPUGHIO/IOHDF5 (HDF5 not installed)
			CactusPUGHIO/IsoSurfacer
			external/IEEEIO
		- comments: 
			need to compile with gmake -k
			and no optimisation (for TimeGeodesic)


	   * Hitachi SR8000-F1 (HI-UX/MPP)
		o contact cactusmaint@cactuscode.org for status


==============================================================================
==============================================================================

Release Notices for Cactus 4.0 beta 7
=====================================
Date: April 20th 2000

Released modules:
================

      Cactus
      CactusBase
      CactusBench
      CactusEinstein
      CactusElliptic
      CactusNet
      CactusPUGH
      CactusPUGHIO
      CactusWave
      external

New thorns:
==========
	
      CactusBench/BenchADM
      CactusWave/IDScalarWaveC


CVS Tag: Cactus_4_0_Beta_7
=======


==============================================================================


CHANGES FOR BETA 7
==================

Infrastructure
==============

1) Added script "GetCactus" which, given a thorn list with CVS repository
   information, will checkout the thorns. It is also possible to embed
   parameter files in the thorn list, which will be automatically 
   extracted. The script and sample parameter files are available from 
   the web pages. 

Flesh
=====

1) Added configuration options DEBUG and OPTIMISE
   Added build option WARN.  

2) Now can use CCTK_ARGUMENTS and DECLARE_CCTK_ARGUMENTS 
   rather than specifying CCTK_FARGUMENTS, CCTK_CARGUMENTS,
   DECLARE_CCTK_FARGUMENTS or DECLARE_CCTK_CARGUMENTS

3) Changed gmake doc to 
	gmake UsersGuide -> produces UsersGuide.ps (manual for users)
	gmake MaintGuide -> produces MaintGuide.ps (manual for maintainers)

4) Added new make targets 
	gmake cvsstatus
	-> processes information from CVS on the status of your checked 
	   out code
	gmake cvsdiff
	-> reports the differences between your checked out code and the 
	   version in the CVS repository

5) Added new make option PROMPT=no, which should complete the compilation
   without giving you any further prompts. Use this in conjunction from
   the THORNLIST option to build a new configuration in one step.

6) Changed name of 
	gmake <config>-thornparfiles 
   to
	gmake <config>-examples 

7) Added the capability to specify that an array should have a constant
   size on each processor. This is specified in the interface.ccl by 
   assigning
	DISTRIB=CONSTANT 
   the default value is 
	DISTRIB=DEFAULT

8) External packages, such as MPI, recognised by the flesh now define e.g.
	#define CCTK_MPI 
   instead of 
	#define MPI
   Both will continue to work for the next release as this is made
   consistent, and the work on including external packages is completed.

9) New Architectures: 
   Cactus port to IBM SP2 finished (should work out of the box with native 
   MPI). Tested on SP2s at Argonne, NERSC and MHPCC. The default compiler 
   on the SP2 is xlc.
   Initial port to Hitachi SR8000.


10) Added support for the Lahey/Fujitsu Fortran Compiler. This should be 
    treated as experimental, since we don't have our own version. (Thanks 
    to Erik Schnetter for the known architectures file).

11) rfrTraverse has been removed, and is replaces by CCTK_Traverse

12) Memory tracing added. 

13) Added support for MPICH 1.2.0


Util Thorns
===========

1) Removed deprecated routines in CactusBase/Boundary

2) CactusPUGH/PUGH - Added manual decomposition (donated by 
   Matei Ripeneau), and changed parameter names for manual processor 
   topology. See the README in PUGH/doc for more information.

3) CactusPUGH/PUGH - Major changes to remove the old pGF and implement 
   grid functions as a special case of a grid array.

4) CactusPUGH/PUGH - Implemented support for constant sized arrays on
   each processor

5) CactusBase/IOUtil - Append to output data files after restarting
   from a checkpoint file 

6) CactusBase/IOUtil - can now recover from the latest checkpoint file 
   in a given directory (so you can submit several consecutive jobs to 
   a queue without editing the parameter file)

7) Added CactusBench arrangement to contain benchmarking thorns. 
   Currently there is just BenchADM which contains the staggered leapfrog
   evolution method for CactusEinstein/ADM with the macros expanded, and
   some optimisations.

8) New thorn: IDScalarWaveC, initial data for the scalar wave equation all
   in C

==============================================================================


KNOWN BUGS IN BETA 7
====================
(See Cactus bug tracking system for a complete list)


==============================================================================


WHAT TO EXPECT IN BETA 8
========================

1) Fixes for all known bugs in Beta 7.

2) Full support for Hitachi and Exemplar machines.

3) Support for Intel C/C++ compiler with NT.

4) Compiling on DEC Alphas with native MPI

5) Function aliasing

6) New infrastructure for compiling with external packages (e.g.  
   HDF5, PETSc,...)

7) Example 1D and 2D applications, extensions of computational infrastructure
   to support 1D and 2D.

==============================================================================


TEST MACHINES NOTES
===================

	   * Intel IA32 (Linux Redhat 6.2)
                o bifrost.aei-potsdam.mpg.de
                  compiler, w/wo MPICH
                - not compiling: 
			CactusElliptic/EllPETSc (wo MPICH)
		- failing testsuite:
			CactusEinstein/AHFinder,
		- comments:	
			Absoft, Portland and Pacific-Sierra
			F90 compilers (CactusEinstein/AHFinder will not 
			compile with the Pacific-Sierra compiler)
			
			
           * Cray T3E (Unicos mk2.0.5.X)
                o berte.zib.de w/wo native MPI
                - not compiling Remove:
			CactusElliptic/EllPETSc,
			CactusNet,
			CactusPUGHIO/IsoSurfacer,
			external/RemoteIO,
			external/TCPXX
		- failing testsuite
			CactusEinstein/AHFinder,


           * Dec Alpha (osf4.0f, gcc 2.95.2)
                o jalapeno.cactuscode.org w/wo MPICH
		- not compiling:
			CactusNet,
			CactusPUGHIO/IOFlexIO,
			CactusPUGHIO/IsoSurfacer,
			external/IEEEIO,
			external/RemoteIO,
			external/TCPXX
		- failing testsuite:
			CactusEinstein/AHFinder,


	   * HP Exemplar (HPUX 10.01)
                o neptune.npaci.edu wo MPI
		- not compiling:
			CactusNet,
			CactusPUGHIO/IsoSurfacer,
			external/RemoteIO,
			external/TCPXX,
			CactusEinstein/TimeGeodesic,
			CactusPUGHIO/IOHDF5
		- failing testsuite:
			CactusEinstein/AHFinder,
	        - comments:
			compiling failing in preprocessing, but you
			just need to type gmake <config> again


	   * IBM SP2 (AIX 4.2.0.0)
                o quad.mcs.anl.gov w/wo native MPI
		- not compiling:
			CactusElliptic/EllPETSc,
			CactusNet,
			CactusPUGHIO/IOHDF5,
			CactusPUGHIO/IsoSurfacer,
			external/RemoteIO,
			external/TCPXX,
			CactusWave/WaveToyFreeF90
		- failing testsuite:
			CactusEinstein/AHFinder,
	        - comments:
			Free format fortran won't compile yet


           * SGI 64 bit (Irix 6.5)
                o origin.aei-potsdam.mpg.de, w/wo native MPI
		- not compiling:
			CactusElliptic/EllPETSc
		- failing testsuite
			CactusEinstein/AHFinder

	
           * SGI 32 bit (Irix 6.5)
                o nott.aei-potsdam.mpg.de wo MPI
		- not compiling
			CactusElliptic/EllPETSc
			CactusPUGHIO/IOHDF5,
		- failing testsuite
			CactusEinstein/AHFinder


           * Intel IA32 (Windows NT 4.0)
                o saraband.aei-potsdam.mpg.de (VM) wo MPI
                - not compiling
			CactusElliptic/PETSc, 
			CactusNet/http, 
			CactusNet/NetGeometry,
			CactusPUGHIO/IOHDF5,
			CactusPUGHIO/IsoSurfacer, 
			external/RemoteIO,
			external/TCPXX,
		- failing testsuite
			CactusEinstein/AHFinder
			CactusEinstein/IDAnalyticBH
		- comments: 
                        *** Need to use beta 5 version of IEEEIO ***
                            > cd arrangements/external/IEEEIO
                            > cvs update -r Cactus_4_0_Beta_5


==============================================================================
==============================================================================

Release Notices for Cactus 4.0 beta 6
=====================================

Date: 8th February 2000

Released modules:
================

      Cactus
      CactusBase
      CactusEinstein
      CactusElliptic
      CactusNet
      CactusPUGH
      CactusPUGHIO
      CactusWave
      external

New thorns:
==========

	CactusEinstein/AHFinder

Main Changes:
============


CVS Tag: Cactus_4_0_Beta_6
=======


==============================================================================


CHANGES FOR BETA 6
==================

Flesh
=====

1) Support for free form Fortran 90 (with file extension F90 for
   preprocessed or f90 for no preprocessing)

2) CCTK_BOUND schedule point removed since it is no longer needed

3) Support for Complex grid variables in both C and Fortran. Complex
   variables can be defined in the configuration (ccl) files, and 
   manipulated in C with the same functionality as is provided by 
   standard fortran by the CCTK functions:

     CCTK_Cmplx 
     CCTK_CmplxReal
     CCTK_CmplxImag 
     CCTK_CmplxConjg
     CCTK_CmplxAbs
     CCTK_CmplxAdd
     CCTK_CmplxSub
     CCTK_CmplxMul
     CCTK_CmplxDiv
     CCTK_CmplxSqrt *
     CCTK_CmplxSin  *
     CCTK_CmplxCos  *
     CCTK_CmplxLog  *
     CCTK_CmplxExp  *

   (The functions marked with a * still need to be filled out). Complex
   grid variables are supported by CactusPugh/Interp, but as yet are
   not supported by the IO routines.

4) For better name consistency the following name changes have been made

   CCTK_RegisterCoordI     -> CCTK_CoordRegisterI
   CCTK_RegisterCoord      -> CCTK_CoordRegister
   CCTK_RegisterCoordRange -> CCTK_CoordRegisterRange 

   The old names are now deprecated.

5) New CCTK functions include

   CCTK_CoordDir
   CCTK_CoordLocalRange

6) The function used by driver thorns

   CCTK_GroupData 

   has been rewritten to return a structure containing the group 
   information (to allow us to add new information easily). The new 
   function is 

   cGroup *CCTK_GroupData(int group)

   where the cGroup structure is

   typedef struct
   {
     int grouptype;
     int variabletype;
     int staggertype;
     int dim;
     int numvariables;
     int numtimelevels;
   } cGroup;

   the old deprecated function remains with the new name 

   CCTK_OldGroupData

7) Added a new option for building configurations

gmake <target> THORNLIST=<thorn_file> THORNLIST_DIR=<directory> uses the file directory/thorn_file as the list of thorns for the configuration   

8) Communication (ghostzone swapping) is now automatically enabled for all
   variables which have storage assigned in the schedule.ccl. This means 
   that a call to CCTK_SyncGroup will always syncronise the ghostzones.

9) The include files for thorns using Cactus parameters or argument lists 
   have been renamed, to follow the same naming convention as the rest of 
   the Cactus include files 

	cctk_parameters.h  -> cctk_Parameters.h
	cctk_arguments.h   -> cctk_Arguments.h 

   the old names will still work, but are depreciated.

10) Removed warnings for unused variables (parameters and grid variables)
    on the origin. 

11) Continued to add features needed for AMR
    - schedule global functions
    - can now schedule synchronisation of groups in the schedule.ccl
    - CCTK_rfrTraverse is now replaced by CCTK_Traverse

12) Added staggering capabilities for grid functions, see the documentation
    for details. Staggering is still being tested and should be treated
    as developmental. 

13)
    Removed redundant src/rfr directory.  If you do an update rather than a
    fresh checkout you'll need to edit src/CVS/Entries to remove the line
    referencing this directory.

Util Thorns
===========

1) Bug fix in recovering grid scalars from checkpointing data

2) CactusPUGH/PUGH: Many changes to PUGH to add multidimensional 
   arrays. [If you are using any PUGH infrastructure please make 
   sure you keep up to date with CVS commit messages for the thorn
   since this thorn will now be revised and tidied]
   Multidimensional arrays (1D, 2D, 3D) are now working. Arrays can
   be set to have any size, and any ghostzone size in a thorn's
   interface.ccl. At the moment the sizes must be specified with parameters.
   Currently Sychronising of ghostzones works for 1D and 3D, but not for
   2D. This will go in as PUGH is revised for the next beta release.

Relativity Thorns
=================

1) CactusEinstein/AHFinder: New thorn, locates apparent horizons on a 
   timeslice

2) CactusEinstein/Extract: Fixed bug on multiprocessors

3) CactusEinstein/IDAxiBrillBH: Fixed bug which prevented 
   compilation/linking/running on some architectures.

==============================================================================


KNOWN BUGS IN BETA 6
====================
(See Cactus bug tracking system for a complete list)

1) Free format Fortran 90 doesn't work on the SP2

==============================================================================


WHAT TO EXPECT IN BETA 7
========================

1) Fixes for all known bugs in Beta 6

2) Individual thorn configuration scripts

3) Function declarations in the interface.ccl


==============================================================================


TEST MACHINES NOTES
===================
	   * Intel Linux
                o bifrost.aei-potsdam.mpg.de Redhat 6.0, Absoft
                  compiler, w/wo MPI
                     + Remove: 
			CactusElliptic/EllPETSc
			CactusPUGHIO/IOHDF5,
                     + Notes: CactusElliptic/EllPETSc compiled with
                       MPICH
                o saraband.aei-potsdam.mpg.de Redhat 6.1, Absoft
                  compiler, wo MPI
                     + Remove: 
			CactusElliptic/EllPETSc

           * Dec Alpha
                o skadi.aei-potsdam.mpg.de wo MPI
                     + Remove: 
			CactusEinstein/IDAxiBrillBH
			CactusElliptic/EllPETSc,
			CactusPUGHIO/HDF5, 

           * SGI 64 bit 
                o kvasir.aei-potsdam.mpg.de Irix 6.5, w/wo native
                  MPI
                     + Remove: 
			CactusElliptic/EllPETSc
                     + Configure: HDF5=yes MPI=NATIVE
                       HDF5_DIR=/usr/local/apps/hdf5
                       Notes: fails testsuite for AHFinder 	
		      
           * SGI 32 bit
                o nott.aei-potsdam.mpg.de Irix 6.5 wo MPI
                     + Remove: 
			CactusElliptic/EllPETSc
			CactusPUGHIO/IOHDF5,
                     + Notes: Problem with output for PsiKadelia
                       test

           * T3E
                o berte.zib.de w/wo native MPI
                     + Remove:
			CactusElliptic/EllPETSc,
			CactusPUGHIO/IOHDF5,
	             + Notes: 
			fails testsuite for AHFinder 	
			and IDAxiBrillBH

           * Windows NT
                o ntsc-ts1.ncsa.uiuc.edu w/wo HPVM MPI
                     + Remove: 
			CactusElliptic/PETSc, 
			CactusNet/http, 
			CactusNet/NetGeometry,
			CactusPUGHIO/IOHDF5,
			CactusPUGHIO/IsoSurfacer, 
			CactusWave/IDScalarWaveCXX,
			CactusWave/IDWaveToyCXX
			external/RemoteIO,
			external/TCPXX,
	             + Configure: MPI=CUSTOM MPI_LIBS="mpi.lib fm.lib
                       advapi32.lib kernel32.lib wsock32.lib" MPI_INC_DIRS
                       ="d:/apps/hpvm/include"
	             + Notes: testsuite checking technology doesn't
                              work here with MPI because of batch queues
                              Need to use beta 5 version of IEEEIO
                                - cd arrangements/external/IEEEIO
                                  cvs update -r Cactus_4_0_Beta_5
                              AHFinder test fails.

           * HP
                o exemplar.npaci.edu wo MPI, HP-UX 10.01
                     + Remove: 
			CactusElliptic/PETSc, 
			CactusNet/http, 
			CactusNet/NetGeometry
			CactusPUGHIO/IsoSurfacer,
			CactusPUGHIO/IOHDF5
			external/RemoteIO,
			external/TCPXX

	   * SP2
		o quad.mcs.anl.gov wo MPI
		     + Remove: 
			CactusElliptic/EllPETSc, 
			CactusNet/http, 
			CactusNet/NetGeometry, 
			CactusPUGHIO/IsoSurfacer,
			CactusPUGHIO/IOHDF5
			CactusWave/WaveToyFreeF90
			external/RemoteIO,
			external/TCPXX
	             + Notes: dependencies broken for IEEEIO, can ignore
                              and continue


==============================================================================
==============================================================================

Release Notices for Cactus 4.0 beta 5
=====================================
Friday November 12th 1999

(Super Computing 1999 Release)

Released modules:
================

      Cactus
      CactusBase
      CactusEinstein
      CactusElliptic
      CactusNet
      CactusPUGH
      CactusPUGHIO
      CactusWave
      external

New thorns:
==========
      CactusEinstein/TimeGeodesic
      CactusEinstein/AHFinder

Main Changes:
============
      Faster compilation times (Cactus)
      Initial implementation of timing information (Cactus)   

CVS Tag: Cactus_4_0_Beta_5
=======


==============================================================================


CHANGES FOR BETA 5
==================

Utils
=====

1) Recompilation times faster. Now adding or removing thorns does not involve
   a complete rebuild

2) Initial implementation of timing information, use parameter Cactus::timing_


Util Thorns
===========

1) CactusBase/Boundary: Robin boundary conditions added

2) CactusPUGHIO/IsoSurfacer: Now works correctly for data from analysis routines


Relativity Thorns
=================

1) CactusEinstein/TimeGeodesic: New thorn: Tracks timelike geodesics 
   with given initial positions and velocities.

2) CactusEinstein/AHFinder: New thorn: locates apparent horizons on a 
   slice

==============================================================================


KNOWN BUGS IN BETA 5
====================
(See Cactus bug tracking system for a complete list)

1) CactusNet/http, external/TCPXX, external/RemoteIO still not compiling
   on all platforms

2) EllPETSc only compiles with MPI, but doesn't tell you this

3) AxiBrillBH has problems on some platforms


==============================================================================


WHAT TO EXPECT IN BETA 6
========================

1) Fixes for all known bugs in Beta 5

2) Finished implementation of 1D, 2D, 3D arrays

3) Maximal slicing

4) Generic implementation of parameter choice for elliptic slicings 


==============================================================================


TEST MACHINES NOTES
===================

           * Intel Linux
                o bifrost.aei-potsdam.mpg.de Redhat 6.0, Absoft
                  compiler, wo MPI
                     + Remove: 
			CactusElliptic/EllPETSc
			CactusPUGHIO/IOHDF5,
                     + Notes: CactusElliptic/EllPETSc compiled with
                       MPICH
                o gullveig.aei-potsdam.mpg.de Redhat 6.0, Absoft
                  compiler, MPI LAM
                     + Remove: 
			CactusPUGHIO/IOHDF5,
			CactusElliptic/EllPETSc

           * Dec Alpha
                o galar.aei-potsdam.mpg.de wo MPI
                     + Remove: 
			CactusEinstein/IDAxiBrillBH
			CactusElliptic/EllPETSc,
			CactusNet/http, 
			CactusPUGHIO/HDF5, 
			external/RemoteIO,

           * SGI 64 bit 
                o kvasir.aei-potsdam.mpg.de Irix 6.5, w/wo native
                  MPI
                     + Remove: 
			CactusElliptic/EllPETSc
                     + Configure: HDF5=yes MPI=NATIVE
                       HDF5_DIR=/usr/local/apps/hdf5

           * SGI 32 bit
                o nott.aei-potsdam.mpg.de Irix 6.5 wo MPI
                     + Remove: 
			CactusElliptic/EllPETSc
			CactusPUGHIO/IOHDF5,
                     + Notes: Problem with output for PsiKadelia
                       test

           * T3E
                o pc.rzg.mpg.de w/wo native MPI
                     + Remove:
			CactusEinstein/IDAxiBrillBH
			CactusElliptic/EllPETSc,
			CactusPUGHIO/IOHDF5,

           * Windows NT
                o ntsc-ts1.ncsa.uiuc.edu w/wo HPVM MPI
                     + Remove: 
			CactusElliptic/PETSc, 
			CactusNet/http, 
			CactusNet/NetGeometry,
			CactusPUGHIO/IOHDF5,
			CactusPUGHIO/IsoSurfacer, 
			CactusWave/IDScalarWaveCXX,
			CactusWave/IDWaveToyCXX
			external/RemoteIO,
			external/TCPXX,
	             + Configure: MPI=CUSTOM MPI_LIBS="mpi.lib fm.lib
                       advapi32.lib kernel32.lib wsock32.lib" MPI_INC_DIRS
                       ="d:/apps/hpvm/include"
	             + Notes: testsuite checking technology doesn't
                              work here with MPI because of batch queues

           * HP
                o exemplar.npaci.edu wo MPI, HP-UX 10.01
                     + Remove: 
			CactusElliptic/PETSc, 
			CactusNet/http, 
			CactusNet/NetGeometry
			CactusPUGHIO/IsoSurfacer,
			CactusPUGHIO/IOHDF5
			external/RemoteIO,
			external/TCPXX,

	   * SP2
		o quad.mcs.anl.gov wo MPI
		     + Remove: 
			CactusEinstein/IDAxiBrillBH, 
			CactusElliptic/EllPETSc, 
			CactusNet/http, 
			CactusNet/NetGeometry, 
			CactusPUGHIO/IsoSurfacer,
			CactusPUGHIO/IOHDF5
			external/RemoteIO,
			external/TCPXX,
	             + Notes: dependencies broken for IEEEIO, can ignore
                              and continue


==============================================================================
==============================================================================

Release Notices for Cactus 4.0 beta 4
=====================================
Monday November 1st 1999


Released modules:
================

      Cactus
      CactusBase
      CactusEinstein
      CactusElliptic
      CactusNet
      CactusPUGH
      CactusPUGHIO
      CactusWave
      external


New thorns:
==========
      CactusEinstein/IDAxiBrillBH
      CactusEinstein/Extract
      CactusNet/NetGeometry

Main Changes:
============
      Faster compilation times (Cactus)
      

CVS Tag: Cactus_4_0_Beta_4
=======


==============================================================================


CHANGES FOR BETA 4
==================


Utils
=====

1) CST: The perl part of the compilation has been optimised, and
   is now much faster

2) Compilation for thorns with large numbers of grid variables fixed
   on origin

3) Testsuite checking technology fixed for NT


Util Thorns
===========

1) CactusBase/Boundary: Bugs fixed in radiation boundary conditions.
   Copying boundary conditions added. ConstantBC conditions
   renamed to ScalarBC. ConstantBC will be removed in next beta release.

2) CactusPUGHIO/IOASCII: Memory bugs fixed

3) CactusPUGHIO/IsoSurfacer: Now works on T3E

4) CactusNet/NetGeometry: Generic interface for data streaming via
   a TCP socket connection to viz clients

Relativity Thorns
=================

1) CactusEinstein/IDAxiBrillBH: New thorn: Constructs initial data for a 
   black hole with an even parity perturbation. This thorn still has a little
   trouble on a few platforms, see below for details

2) CactusEinstein/Extract: New thorn: Extracts gauge invariant waveforms
   from a spacetime with approximate spherical symmetry
 

==============================================================================


KNOWN BUGS IN BETA 4
====================
(See Cactus bug tracking system for a complete list)

1) CactusNet/http, external/TCPXX, external/RemoteIO still not compiling
   on all platforms

2) EllPETSc only compiles with MPI, but doesn't tell you this

3) AxiBrillBH has problems on some platforms


==============================================================================


WHAT TO EXPECT IN BETA 5
========================

1) Fixes for all known bugs in Beta 4

2) Implementation of 1D, 2D, 3D arrays

3) Maximal slicing

4) Generic implementation of parameter choice for elliptic slicings 

5) Apparent horizon finding thorn


==============================================================================


TEST MACHINES NOTES
===================

           * Intel Linux
                o bifrost.aei-potsdam.mpg.de Redhat 6.0, Absoft
                  compiler, wo MPI
                     + Remove: CactusPUGHIO/IOHDF5,
                       CactusElliptic/EllPETSc
                     + Notes: CactusElliptic/EllPETSc compiled with
                       MPICH
                o gullveig.aei-potsdam.mpg.de Redhat 6.0, Absoft
                  compiler, MPI LAM
                     + Remove: CactusPUGHIO/IOHDF5,
                       CactusElliptic/EllPETSc

           * Dec Alpha
                o galar.aei-potsdam.mpg.de wo MPI
                     + Remove: CactusElliptic/EllPETSc,
                       CactusPUGHIO/HDF5, external/RemoteIO,
                       CactusNet/http, CactusEinstein/IDAxiBrillBH

           * SGI 64 bit
                o origin.aei-potsdam.mpg.de Irix 6.5, w/wo native
                  MPI
                     + Remove: CactusElliptic/EllPETSc
                     + Configure: HDF5=yes MPI=NATIVE
                       HDF5_DIR=/usr/local/apps/hdf5

           * SGI 32 bit
                o nott.aei-potsdam.mpg.de Irix 6.5 wo MPI
                     + Remove: CactusPUGHIO/IOHDF5,
                       CactusElliptic/EllPETSc
                     + Notes: Problem with output for PsiKadelia
                       test
                o null.wustl.edu Irix 6.2 wo MPI
                     + Remove: CactusNet/http, CactusPUGHIO/IOHDF5,
                       CactusElliptic/EllPETSc, external/TCPXX,
                       external/RemoteIO
                     + Notes: Gives a lot of warnings about data
                       alignment

           * T3E
                o pc.rzg.mpg.de w/wo native MPI
                     + Remove:
                       CactusElliptic/EllPETSc,CactusPUGHIO/IOHDF5,
		       CactusEinstein/IDAxiBrillBH

           * Windows NT
                o saraband.aei-potsdam.mpg.de wo MPI
                     + Remove: CactusNet/http, external/RemoteIO,
                       CactusElliptic/PETSc,
                       CactusPUGHIO/IsoSurfacer, external/TCPXX,
                       CactusWave/IDScalarWaveCXX,
                       CactusWave/IDWaveToyCXX
                o ntsc-ts1.ncsa.uiuc.edu w/wo HPVM MPI
                     + Remove: CactusNet/http, external/RemoteIO,
                       CactusElliptic/PETSc, CactusPUGHIO/IOHDF5,
                       CactusPUGHIO/IsoSurfacer, external/TCPXX,
                       CactusWave/IDScalarWaveCXX,
                       CactusWave/IDWaveToyCXX
	             + Configure: MPI=CUSTOM MPI_LIBS="mpi.lib fm.lib
                       advapi32.lib kernel32.lib wsock32.lib" MPI_INC_DIRS
                       ="d:/apps/hpvm/include"
	             + Notes: testsuite checking technology doesn't
                              work here with MPI because of batch queues

           * HP
                o exemplar.npaci.edu wo MPI, HP-UX 10.01
                     + Remove: CactusNet/http, external/RemoteIO,
                       CactusPUGHIO/IsoSurfacer,
                       CactusElliptic/PETSc, external/TCPXX,
		       CactusNet/NetGeometry

	   * SP2
		o quad.mcs.anl.gov wo MPI
		     + Remove: CactusNet/http, external/RemoteIO,
		       CactusPUGHIO/IsoSurfacer,
		       CactusNet/NetGeometry, external/TCPXX,
		       CactusEinstein/IDAxiBrillBH, 
	               CactusElliptic/EllPETSc, CactusPUGHIO/IOHDF5
	             + Notes: dependencies broken for IEEEIO, can ignore
                              and continue


==============================================================================
==============================================================================

Release Notices for Cactus 4.0 beta 3
=====================================
Sunday October 24th 1999


Released modules:
================

      Cactus
      CactusBase
      CactusEinstein
      CactusElliptic
      CactusNet
      CactusPUGH
      CactusPUGHIO
      CactusWave
      external


Main Changes:
============
      Initial implementation of general dimension grid functions
                                             (CactusPUGH/PUGH)
      Dynamic courant condition (CactusBase/Time)
      Ghostzone generality (CactusPUGH/PUGH)
      Faster compilation times (Cactus)


CVS Tag: Cactus_4_0_Beta_3
=======


==============================================================================


CHANGES FOR BETA 3
==================

Utils
=====

1) The perl processing part of the compilation process
   now only replaces files which have actually changed,
   so that compilation times are now much quicker (after
   the first time).

2) The test suite checker doesn't report a failed test if 
   thorns needed are missing. 

Util Thorns
===========

1) The names of boundary condition routines in 
   CactusBase/Boundary have been standardised and 
   renamed to make a distinction between groups and
   variables. The old names remain, but will be removed
   in Beta 4. See the documentation in this thorn for
   details.

2) Thorn CactusBase/Time now contains a routine for 
   using a dynamic courant condition to set the timestep.
   This is implemented in CactusEinstein/Einstein for 
   the relativity thorns ... see the documentation in 
   Time for details.

3) The standard PUGH driver now supports different 
   numbers of ghostzones in different directions.
   Also, there is a now a parameter for setting 
   the number of grid points on each local processor.

4) The standard PUGH driver now supports 1D grid functions.

5) The IsoSurfacer now supports display from Linux machines.


Relativity Thorns
=================

1) Einstein now uses thorn CactusBase/Time to set the
   timestep (previously Einstein set it itself). This
   means that you now have to compile Time and add it 
   to your active thorns, and the parameter einstein::dtfac
   should be changed to time::dtfac in parameter files.

2) Bugs in misner data and Brill Lindquist data have
   been fixed


==============================================================================


KNOWN BUGS IN BETA 3 
====================
(See Cactus bug tracking system for a complete list)

1) thorns CactusNet/http, external/TCPXX and external/RemoteIO
   are not compiling under most platforms other than SGI or
   Intel Linux

2) Cactus fails to compile for thorns with many grid variables
   on the origin due to a problem with the C preprocessor.

3) There is a memory bug occuring occasionally in 1D ASCII IO

4) EllPETSc only compiles with MPI, but it doesn't tell you this

5) The testsuite checking technology isn't working under NT


==============================================================================


WHAT TO EXPECT IN BETA 4
========================

1) Fixes for all known bugs in Beta 3

2) A mechanism to get rid of all the warnings for unused
   variables seen with Irix 6.5

3) Fuller implementation of 1D and 2D grid functions

4) Initial implementation of 1D, 2D and 3D arrays

5) Generic implementation of parameter choices for
   elliptic slicings

6) Maximal slicing properly integrated into ADM

 
==============================================================================


TEST MACHINES NOTES
===================

           * Intel Linux
                o bifrost.aei-potsdam.mpg.de Redhat 6.0, Absoft
                  compiler, wo MPI
                     + Remove: CactusPUGHIO/IOHDF5,
                       CactusElliptic/EllPETSc
                     + Notes: CactusElliptic/EllPETSc compiled with
                       MPICH
                o gullveig.aei-potsdam.mpg.de Redhat 6.0, Absoft
                  compiler, MPI LAM
                     + Remove: CactusPUGHIO/IOHDF5,
                       CactusElliptic/EllPETSc
           * Dec Alpha
                o galar.aei-potsdam.mpg.de wo MPI
                     + Remove: CactusElliptic/EllPETSc,
                       CactusPUGHIO/HDF5, external/RemoteIO,
                       CactusNet/http
           * SGI 64 bit
                o origin.aei-potsdam.mpg.de Irix 6.5, w/wo native
                  MPI
                     + Remove: CactusElliptic/EllPETSc
                     + Configure: HDF5=yes
                       HDF5_DIR=/usr/local/apps/hdf5
           * SGI 32 bit
                o nott.aei-potsdam.mpg.de Irix 6.5 wo MPI
                     + Remove: CactusPUGHIO/IOHDF5,
                       CactusElliptic/EllPETSc
                     + Notes: Problem with output for PsiKadelia
                       test
                o null.wustl.edu Irix 6.2 wo MPI
                     + Remove: CactusNet/http, CactusPUGHIO/IOHDF5,
                       CactusElliptic/EllPETSc, external/TCPXX,
                       external/RemoteIO
                     + Notes: Gives a lot of warnings about data
                       alignment
           * T3E
                o pc.rzg.mpg.de w/wo native MPI
                     + Remove:
                       CactusElliptic/EllPETSc,CactusPUGHIO/IOHDF5,
                       CactusNet/http, external/RemoteIO
                     + Notes: dependencies went funny in IEEEIO,
                       problem with output for PsiKadelia test
           * Windows NT
                o saraband.aei-potsdam.mpg.de wo MPI
                     + Remove: CactusNet/http, external/RemoteIO,
                       CactusElliptic/PETSc,
                       CactusPUGHIO/IsoSurfacer, external/TCPXX,
                       CactusWave/IDScalarWaveCXX,
                       CactusWave/IDWaveToyCXX
	             + Notes: tested compilation only, problem with
                       perl testsuite runner
                o ntsc-ts1.ncsa.uiuc.edu w/wo HPVM MPI
                     + Remove: CactusNet/http, external/RemoteIO,
                       CactusElliptic/PETSc,
                       CactusPUGHIO/IsoSurfacer, external/TCPXX,
                       CactusWave/IDScalarWaveCXX,
                       CactusWave/IDWaveToyCXX
	             + Configure: MPI=CUSTOM MPI_LIBS="mpi.lib fm.lib
                       advapi32.lib kernel32.lib wsock32.lib" MPI_INC_DIRS
                       ="d:/apps/hpvm/include"
                     + Notes: tested compilation only, problem with
                       perl testsuite runner
           * HP
                o exemplar.npaci.edu wo MPI, HP-UX 10.01
                     + Remove: CactusNet/http, external/RemoteIO,
                       CactusPUGHIO/IsoSurfacer,
                       CactusElliptic/PETSc, external/TCPXX
                     + Notes: dependencies went funny in TCPXX