source: tags/release-1.1.11/CHANGES

Last change on this file was 819, checked in by MatthewWhiting, 13 years ago

Final updates to documentation.

File size: 38.2 KB
Line 
1Duchamp version 1.1.11 (2011/03/01)
2-------------------------------------
3
4Improvements:
5
6* The largest changes in this release involved improving the
7  efficiency of the code, resulting in further speed-ups. The code
8  affected was the low-level object-handling code, with the merging
9  stages in particular showing good speed-ups.
10
11* The default value for the beam size, when the beam parameters are
12  not in the FITS header, has been dropped. Now the default behaviour
13  is to simply not make any beam corrections if the beam is not
14  specified by either the FITS file or the input parameters. Thanks to
15  Tobias Westemeier for the suggestion.
16
17* The reporting of the beam size has changed slightly to provide a bit
18  more information.
19
20Bug Fixes:
21
22* The statistics section (statSec) could be larger than the image
23  subsection (if provided), yet the pixels required would never be
24  read in from the FITS file. The behaviour has been changed so that
25  the statSec, if requested, is trimmed to be wholly within the image
26  section.
27
28* It was possible to request, for instance, spectral smoothing on a 2D
29  image. This resulted in a blank smoothed array, which led to
30  problems in the calculations of statistics (and hence the
31  threshold), as well as subsequent calculations. This has been fixed,
32  so that in cases like this the smoothing is turned off (and a
33  warning message is displayed).
34
35* There was a problem with using a MW range and subsectioning when
36  growing objects, as a result of changes in 1.1.10. This has been
37  fixed.
38
39* Inversion was failing when no array was allocated (not a problem for
40  standard Duchamp, but affected its use as a library by other code).
41
42* Writing text spectra would only occur when PGPlot output was enabled
43  in the build (it was combined with the plotting of the spectral
44  graphs). This has been changed so that this output can be requested
45  without requiring PGPlot.
46
47* The equation for the beam size in Sec.4.2 of the User Guide was
48  incorrect and has been fixed.
49
50* Minor change to the configure script to improve the detection of the
51  PGPlot library.
52
53Code development notes:
54
55* The main work has been additions and improvements to the interfaces
56  for the Param and the Section classes, as well as new classes to
57  manage the beam information. The efficiency changes mentioned above
58  also affected the internals of some of the PixelInfo classes, and
59  provided additional functions for judging the closeness of
60  neighbouring objects.
61
62Duchamp version 1.1.10 (2010/11/15)
63-------------------------------------
64
65Improvements:
66
67* The major change for this release is a greatly improved growing
68  algorithm. The previous incarnation was very inefficient (testing
69  all pixels in an object, most of which only have neighbours that are
70  already in the object), and could take an unnecessarily large amount
71  of time in the case of extended sources. The improved algorithm
72  makes use of voxel flags to quickly identify those voxels not yet in
73  an object and only examines them. For a certain test case
74  (observations of extended Galactic HI), the time required reduced
75  from about a day to about a minute! (Note that compact sources, such
76  as HI galaxies, will not show this degree of speedup...) Many thanks
77  to Tara Murphy for pointing out this bug and her help in
78  diagnosing/fixing the problem.
79
80* There have been a number of further improvements to the code to
81  speed it up, based on some profiling. The most important was the
82  function to add pixels to a 2D object, but there were several other
83  minor changes as well.
84
85* The minimum size of the detections can now also be specified in
86  terms of the total number of voxels (in addition or instead of
87  specifying the minimum spatial pixels or channels).
88
89* The way memory is allocated when reading the image has been
90  streamlined. The amount of memory being allocated is also now
91  reported - this is in an effort to allow users to identify problems
92  with running out of memory.
93
94* The version number is now reported in the results and log files.
95
96* Only the filename of the input image (ie. not the leading
97  directories) is now shown on the detection and moment-0 maps. This
98  is to avoid problems with large directory paths being too wide for
99  the plot.
100
101* The verification script was improved for readability (although no
102  functional change was made).
103
104Bug fixes:
105
106* Growing was not being done when a single source was found. Now
107  fixed.
108
109* For particular WCS setups, the RA can be interpreted as being
110  negative, which corrupted the Source ID (ie. the IAU-format
111  string). This has been fixed.
112
113* When the flux units were changed, problems had been seen when
114  writing a reconstructed cube to a FITS file. Any unit change is now
115  undone prior to writing and there should now be no problem.
116
117* Filenames with spaces in them were not handled well. New functions
118  were included and moved to a more obvious location. These filenames
119  now work as expected.
120
121* Spectral axes of type FREQ that had a rest frequency were not being
122  put into velocity units. Now fixed.
123
124* Improvements to the output to screen, making sure everything is
125  covered by the verbose flag.
126
127* Better management of the allocation of arrays.
128
129* The minSize parameter in Image was never initialised, leading to
130  unpredictable behaviour. Now fixed.
131
132Code development notes:
133
134* New functionality includes: a function to return a vector list of
135  voxels in an Object3D or Detection; a new generic Search function
136  (basically a front-end to each of the individual functions); more
137  complete copy constructors for the DataArray classes; new methods
138  for finding the velocity widths.
139
140Duchamp version 1.1.9 (2010/03/26)
141-------------------------------------
142
143Improvements:
144
145* There is now the ability to save the moment-0 map as a FITS
146  file. This is controlled by the parameters flagOutputMomentMap and
147  fileOutputMomentMap, which work in the same way for the mask file.
148
149* There is a new parameter flagRejectBeforeMerge that, when true,
150  rejects sources according to the minPix/minChannels requirements
151  before the merging and growing is done. This defaults to false (so
152  default behaviour is as before). Thanks to Tobias Westmeier for
153  suggesting this and the above improvement.
154
155* There is also a new parameter flagTwoStageMerging. When true (the
156  default), newly-detected objects are merged with the first close
157  object in the list. When false, they are simply added to the end of
158  the list. In both cases, a second round of merging is done to pick
159  up all close matches.
160
161* The way the beam is specified in the absence of the BMAJ/BMIN/BPA
162  parameters has been slightly changed. The use of "beamSize" was
163  somewhat ambiguous (it meant the number of pixels covered by the
164  beam, not the FWHM), so new parameters have been introduced. The
165  beam can be specified by beamArea (which replaces beamSize), or
166  beamFWHM (the FWHM of the beam in pixels). If beamFWHM is provided,
167  it will be used, else the beamArea will be.
168
169* There is a new parameter searchType that allows the user to choose
170  how the searching is done. The behaviour up till now has been to
171  search the 2D channel maps one at a time to build up the 3D
172  detections. This is the default, and can be obtained by setting
173  searchType=spatial. Alternatively, you can set searchType=spectral
174  to do the searching in the 1D spectra.
175
176* Profiling of the code has led to a few changes that have sped up
177  some calculations, particularly those involving the median. Rather
178  than using std::sort, the code now simply uses std::nth_element,
179  which shows a substantial speedup factor.
180
181* When using the objectList parameter, the maps will now only show the
182  selected objects, rather than all detected objects.
183
184* There is a new verification test that looks at the "growing"
185  functionality.
186
187Bug fixes:
188
189* When saving a mask FITS file, there was an occasional memory leak
190  that caused Duchamp to crash (only when the cube was suitably
191  large). This has been fixed.
192
193* The median calculation had a bug that led to an incorrect value
194  being reported. The difference will not be great (the element of an
195  array being reported as the median was out by one), but could be
196  noticeable depending on the dataset.
197
198* The MW range parameters did not respond to the use of a
199  subsection. They should refer to channel ranges in the original
200  cube, and changes have been made to the code to reflect this.
201
202* There was an occasional error in writing out FITS keywords, due to
203  the way comment strings were intialised. This has been improved and
204  made more robust.
205
206* Testing with gcc-4.3.2 showed a number of compilation warnings &
207  errors, which have been fixed.
208
209* The Gaussian smoothing kernel was too small - it is now made big
210  enough to encompass all possible values. It was also being
211  incorrectly scaled. This had no functional effect on the detection
212  of objects, but for other uses was incorrect. This has been
213  rectified.
214
215* Some outputs that weren't caught by the verbose flag now are.
216
217
218Code development notes:
219
220  The following notes only apply if you want to use the code as a
221  library, rather than the stand-alone package. These have generally
222  come out of the ASKAP software development. If you just use the
223  stand-alone package, they won't be a concern.
224
225* The API for storing detected objects has changed, making it more
226  robust from a programming point of view.
227
228* Additional versions of some functions (and the Gaussian smoothing
229  class) have been added - this has come out of the ASKAP development
230  work.
231
232* A number of instances of "unsigned int" being used for loops have
233  been changed to iterators or "size_t". There shouldn't be any
234  functional change from this -- the code should just build more
235  cleanly.
236
237* The Detection class now records whether the parameters have been
238  set, and unsets that flag when objects are merged. This allows
239  external programs to track which objects have been merged and deal
240  with them appropriately.
241
242
243Duchamp version 1.1.8 (2009/07/20)
244----------------------------------
245
246Improvements:
247
248* The final source list can now be sorted on one of a range of object
249  parameters: x-value, y-value, z-value, ra, dec, vel, w50, iflux,
250  pflux (integrated and peak flux respectively), or snr. Simply use
251  the new input parameter sortingParam. Its default value is vel, so
252  the default behaviour stays the same.
253
254* The FDR method involves calculating how many pixels are
255  correlated. This previously involved multiplying the beam area by 2,
256  implying that 2 neighbouring channels were correlated. This factor
257  is now a user-selectable parameter, so that if you know how many
258  spectral channels should be correlated, you can set the parameter
259  FDRnumCorChan and the FDR calculation will be done correctly.
260
261* Screen output now has more information on the growing threshold when
262  the cube statistics are printed.
263
264
265Bug fixes:
266
267* When reading in previous detections, there was a bug causing a
268  segmentation fault. This has been fixed and made more robust.
269
270* There was an apparent bug when writing out the reconstructed cubes
271  to a FITS file that caused the new file to be very large. Changing
272  the cfitsio function used has fixed this.
273
274* Using NCP projections near the equator could result in a large
275  stream of error messages, due to coordinate transformations being
276  done in blank regions outside of the acceptable range of world
277  coordinates. This has been fixed.
278
279* The function that grows objects had a major bug, that stopped it
280  working when flagAdjacent=false. This has been fixed and should work
281  fine.
282
283* The input parameter spectraTextFile was not being read
284  properly. This has been remedied.
285
286* The units for the integrated flux were wrong for some types of pixel
287  flux units. This has been fixed.
288
289* A minor bug caused incorrect calculation of the 20% widths.
290
291* All calls to uint were changed to unsigned int, as some compilers
292  had problems recognising that they were the same thing.
293
294* src/fitsHeader.cc was missing an include statement for stdlib.h,
295  again causing some compilers to fail.
296
297
298Duchamp version 1.1.7 (2009/01/16)
299----------------------------------
300
301Improvements:
302
303* The mask file that can be created with flagMask can now specify
304  which object a given detected pixel belongs to, by taking the object
305  ID as its value. This applies if you set flagMaskWithObjectNum=true
306  (it defaults to false, which means each detected pixel has the value
307  1). Non-detected pixels still have the value 0.
308
309* The names of the output FITS files are now able to be specified
310  directly by input parameters. These will override the default names
311  that Duchamp provides.
312
313* The Karma annotation file now specifies a font - previously it did
314  not and so was at the mercy of whatever was specified in other
315  annotation files being viewed at the same time. Please let me know
316  if the font I've chosen (lucidasans-12) is not suitable.
317
318* The default flag, used in the absence of 'E', 'S' or 'N', is now '-'
319  rather than blank. This will ensure that each column in the results
320  file has something in it.
321
322* The configure script is somewhat more robust to non-standard
323  systems, particularly when the X11 libraries are in unusual
324  places. It can also deal with the slightly different way that
325  wcslib-4.3 installs itself.
326
327* The installation part of the Makefile was altered so that the
328  symbolic link Duchamp that points to Duchamp-1.1.7 does not have the
329  absolute path encoded in it. This will enable the files to be moved
330  around at a later date.
331
332Bug Fixes:
333
334* Fixed a bug that caused problems when the flux units were less than
335  5 characters long (e.g. 'K')
336
337* The new velocity width values were not getting proper headers in the
338  VOTable output. This has been remedied.
339
340* Minor improvements to help non-pgplot use
341
342* Minor fix in WCS functionality.
343
344* Minor fixes to the FitsHeader class.
345
346* Improved FITS data reading, that doesn't require a nullarray
347  array. This will reduce memory usage.
348
349* Improved subsection parsing, particularly for non-standard WCS
350  systems.
351
352* Improving the memory allocation of the Cube class.
353
354* Fixed a bug that meant the growthThreshold values were sometimes
355  being lost.
356
357* Improving the way the growing and merging is done, particularly in
358  the case of non-adjacent merging.
359
360* Fixed a scaling bug in the GaussSmooth function.
361
362Other:
363
364* Numerous changes to the code that do not affect how Duchamp itself
365  runs, but were necessary for code development with the Duchamp
366  libraries (primarily as a part of the ASKAP code development).
367
368
369Duchamp version 1.1.6 (2008/09/08)
370----------------------------------
371
372New features:
373
374* The velocity widths can now be quoted in two additional ways: the
375  full width at 50% of the peak flux (ie. the FWHM) and the full width
376  at 20% of the peak flux (w_50 and w_20 respectively). The w_50
377  parameter is now quoted in the results printed to the screen
378  (instead of w_VEL), but all three are written to the results file.
379
380* The facility now exists to bypass the searching step and go straight
381  to the output stage using a list of previously detected objects. The
382  list is extracted from a previously-created log file. The user can
383  change the way the spectra are plotted (e.g. choose to plot
384  integrated rather than peak spectra), and select a subset of the
385  detected objects to be printed to individual postscript files. Use
386  the input parameter usePrevious (set to true) to use this facility,
387  and provide a list of objects using the objectList parameter
388  (eg. 1,2,4,7-10,15)
389
390* A new parameter "growthThreshold" has been created, that goes with
391  "threshold". If you manually specify a threshold, and you wish to
392  grow detections, you need to manually specify a growthThreshold (in
393  flux units).
394
395Bug fixes:
396
397* Cubes that do not have a spectral axis (such as Stokes cubes) were
398  causing memory leaks and crashing, due to some assumptions of the
399  existence of the spectral axis. These bugs have been fixed, so that
400  Duchamp will run on such cubes, although the WCS transforms may not
401  always work appropriately. Please let me know via bug reports of
402  difficulties you encounter!
403
404* The growing function has had a few bugs fixed and is now more
405  efficient.
406
407* The FDR method was previously overriding any manually-specified
408  threshold. This has been fixed so that if the user specifies
409  threshold=X, then the FDR method is not called.
410
411* Some undefined things were happening with textual output when no
412  objects were detected. This has been fixed.
413
414* Memory leaks caused by FITS WCS irregularities have been fixed
415  (specifically, if a FITS header had NAXIS=2 but more than two WCS
416  axes were defined).
417
418
419
420Duchamp version 1.1.5 (2008/03/20)
421----------------------------------
422
423Bug fixes:
424* A major bug was discovered in the calculation of integrated
425  fluxes. The flux was incorrectly being weighted by the spatial size
426  of the detection, resulting in a (often considerable) overestimation
427  of the integrated flux. This has been corrected.
428
429* The beam size calculation was also incorrect, being out by a factor
430  of 1/ln(2).
431
432* The "make install" command previously failed to work properly if the
433  library had not been created. This has been fixed so that the
434  installation works even if there is no library file.
435
436New Features:
437* You can now provide a new flux unit string, so that the pixel fluxes
438  will be converted to these new fluxes before any calculations are
439  done. This is done with the newFluxUnits input parameter. The new
440  units should be directly convertible from the old ones (given by the
441  BUNIT header -- e.g. if BUNIT = Jy/beam, you can give newFluxUnits
442  as mJy/beam, but not mJy).
443
444* You can now specify the precision used in the output files for flux,
445  velocity and S/N ratio columns, via new input parameters precFlux,
446  precVel and precSNR. These will apply to the VOTable output as well
447  as the text table and information on the spectral plots.
448
449* The Karma annotation files previously provided just a circle at the
450  spatial location of the detected object. You now have the option to
451  draw a border around the detected pixels (in a similar manner to the
452  PGPLOT moment maps). Karma does not do this perfectly, so the lines
453  may not line up exactly with the pixel borders, so the option
454  remains to keep using the circles. This is controlled by the
455  parameter "annotationType", with possible options being "borders"
456  (the default) or "circles".
457
458* There is a new function getMetadata() that loads the header and WCS
459  data, but no pixel information. This is only of interest if you are
460  doing code development with the Duchamp library -- it does not
461  affect the running of Duchamp itself.
462
463Duchamp version 1.1.4 (2008/02/15)
464----------------------------------
465
466Most of the changes incorporated in this update result from ASKAP code
467development (that makes use of some of the Duchamp functionality),
468but do not actually affect the way Duchamp runs (other than, in a
469couple of cases, making it a bit faster). Changes that are
470relevant for regular users of Duchamp are as follows:
471
472* A new option has been made available (thanks to Mary Putman et al
473  for the suggestion!) to save the spectra of all detected objects in
474  a text file. This has the form of one column for the spectral
475  coordinates and one column of fluxes for each object. This is
476  enabled by the input parameters flagTextSpectra and spectraTextFile.
477
478* Slight changes to the output include he formatting of the way the
479  detected objects are written to the log file. This meant the
480  verification files were also updated. Also the cube statistics are
481  not printed to the results file if a user threshold is specified (as
482  they are not calculated!).
483
484* The determination of beam size has been made more reliable, as has
485  the BUNIT determination.
486
487* Fixed a bug that meant source merging was not done for 2D images
488  (not usually a problem, as the source-finding takes care of this,
489  but came up in parallelisation development).
490
491Duchamp version 1.1.3 (2008/01/08)
492----------------------------------
493
494A minor update that just improves the build process. The location of
495the wcslib include files was not specified correctly, so that some
496machines were unable to find them. The configure script has been fixed
497so that the compilation should work in all cases.
498
499Some minor changes have also been made to the code in the PixelMap
500directory, and to param.cc, to fix warnings or errors that may appear
501in compilation.
502
503However, there are no changes to the actual workings of the code in
504this minor version, so if you have a working version of Duchamp 1.1.2
505there is probably no reason to update.
506
507Duchamp version 1.1.2 (2007/12/07)
508----------------------------------
509
510Compilation:
511
512* The compilation had problems working correctly when the cfitsio and
513  wcs libraries were not in standard locations. The configure script
514  has been tweaked to make sure the libraries are found.
515
516* Problems with compiling in the absence of pgplot have been fixed,
517  and it should now compile fine.
518
519* Improved the configure script for use with Mac OS X and gfortran.
520
521
522Bugfixing:
523
524* A major problem with the text-based output was fixed. The widths of
525  the columns were not being calculated correctly, and were running
526  together. This should no longer be the case.
527
528* There was a bug in the way Duchamp interpreted spectral axes,
529  particularly AIPS types such as FELO-HEL, leading to incorrect
530  scaling of the velocity axis. This has been fixed, so that
531  non-standard types are now dealt with appropriately and the velocity
532  scaling should be accurate.
533
534* Another bug meant the beam correction was always applied to the
535  integrated spectra, regardless of whether the flux units involved
536  the beam (e.g. Jy/beam). This has been fixed. Note that the values
537  of the integrated flux presented in the results table were always
538  calculated correctly.
539
540* Other minor changes to improve the speed and efficiency, especially
541  of the merging code.
542
543New user parameters:
544
545* There is now the possibility to save a FITS file that contains a
546  mask array, indicating where the detected objects are. This is
547  governed by the flagOutputMask parameter.
548
549* The header information that is printed at the start of the results
550  file -- that is, the list of parameters, the statistics of the cube,
551  and the number of detections -- can now be written to a separate
552  file. Set the flagSeparateHeader parameter to true or 1 and it will
553  go to the file indicated by the headerFile parameter (the default is
554  duchamp-Results.hdr).
555
556* A "scaleMax" parameter has been added, so that the wavelet
557  reconstruction can include only a specified range of scales (for
558  instance, if one wants to search just for narrow features such as
559  absorption lines).
560
561* A "flagRobustStats" parameter has been added. This allows the user
562  to elect to use robust statistics (median and median absolute
563  deviation from the median) to estimate the noise parameters. If set
564  to false, the mean and standard deviation will be used. The default
565  value is true.
566
567New Feature:
568
569* When Duchamp is run on a 2D image (i.e. with no spectral output), it
570  now produces a postscript file that shows information each
571  individual source plus the image cutout of the source. This is
572  similar to the spectral output file, but without the spectra. The
573  filename is given by the spectraFile parameter.
574
575* Ability to save a FITS file containing a mask array, with pixel
576  values of 1 for pixels in a detected object, and 0 elsewhere.
577
578
579Duchamp version 1.1.1 (2007/07/20)
580------------------------------------
581
582Minor update to the release, with just a few changes:
583
584* The verification script was generating diffs due to differences in
585  the precision of some calculations when done on different machines.
586  One of these was the integrated flux, and this has been corrected so
587  that the same value should appear on all machines.
588  The verification script has also changed so that just the number of
589  sources and their positions are tested, as well as the
590  logfiles. This should avoid the reporting of spurious differences.
591
592* The grey-scale used in the image cutouts (in the spectral plots) has
593  been inverted. This makes it consistent with the scale used in the
594  maps, and hopefully easier to see when printing.
595
596* The configure/make system has been altered to make it easier to
597  install, and to specify different external libraries. In particular,
598  it is now not necessary to have PGPLOT installed on your system to
599  run Duchamp. In the absence of PGPLOT, Duchamp will run as normal,
600  just without any graphical output. Some source code needed to be
601  restructured to make this work. Please read the README file, or the
602  Installation appendix in the User's Guide, for complete details.
603
604* The time of completion is now written to the log file, so that the
605  user can have some idea of how long the program took.
606
607
608Duchamp version 1.1 (2007/05/17)
609------------------------------------
610
611Changes made since the last numbered release:
612
613EFFICIENCY OF EXECUTION:
614
615* Major change to the way detections are stored. They are now recorded
616  via run-length encoding in the x-y plane, and stored as collections
617  of channel-maps. This improves the memory usage and the speed of
618  execution (particularly for routines such as the merging
619  routines). The memory usage has also been improved by changing the
620  way the list of detected objects is stored.
621
622SMOOTHING:
623
624* Addition of ability to spatially smooth the cube before
625  searching. This is done with a Gaussian kernel, the size and shape
626  of which can be specified by the user, using the parameters kernMaj
627  & kernMin (which are the FWHM for the major & minor axes -- if
628  kernMin is not given it is assumed to match kernMaj) and kernPA (the
629  position angle of the major axis).  There is a new parameter
630  smoothType that distinguishes this method from the spectral (Hanning)
631  smoothing already in use.
632
633DETECTIONS:
634
635* Changed the way detection is done -- now only search in 2D images,
636  keeping all detections (ie. no minimum-pixel requirement). This
637  should be the same as doing both the 1D and 2D searches with the
638  minimum pixel requirement in, but simpler. The rejection is done at
639  the end after all the merging and growing has been done. This leads
640  to a larger number of intermediate detections (ie.  the number
641  before merging), which may increase the run-time slightly, although
642  this is offset by the changes to the efficiency (see above).
643
644* Increased the range over which objects can be grown to match the
645  threshSpatial & threshVelocity parameters, as well as rejecting new
646  pixels based on the BLANK and MW tests.
647
648INPUTS:
649
650* There has been a subtle change in the way BLANK pixels are dealt
651  with. To enable trimming of BLANK pixels, users should use the new
652  parameter flagTrim. The parameters flagBlankPix and blankPixVal are
653  no longer accessible via the parameter file -- warning messages are
654  given if they are provided in the parameter file.
655
656* Added ability to specify a statsec, so that the statistics are only
657  calculated from a given subsection of the cube, rather than the full
658  cube.
659
660* The subsections can also specify the ability to remove a border of n
661  pixels from the edges of an axis (ie. n from the start and from the
662  end) -- as requested in Trac ticket #5.
663
664* Changed the default value of the reconDim parameter from 3 to 1, and
665  the default value of the flagATrous parameter to false.
666
667OUTPUTS:
668
669* The output now includes three different estimates of the "centre" of
670  the detection: peak location, centroid (flux-weighted), or average.
671
672* Some slight improvements to the user feedback during execution.
673
674* Spectral output now includes the baseline, if one was fitted. The
675  format of the plot headers is slightly changed, to stop information
676  falling off the edge of the page.
677
678* Added command-line option -x to directly disable the PGPLOT X-window
679  map plotting. This overrides the setting of flagXOutput in the
680  parameter file.
681
682* Fallback spectral units (in case the FITS header fails to record
683  them) changed to SPC, but code has been fixed so that any problem
684  should be caught before this becomes an issue.
685
686BUGFIXES:
687
688* Fixed bug (Trac ticket #4) that meant the velocity units were not
689  correctly dealt with. Duchamp should be more robust for different
690  velocity axis setups now.
691
692* Fixed bug (ticket #9) with the VOTable output, where the tags were
693  not closing.
694
695* Fixed a bug that meant the integrated fluxes were not calculated
696  properly -- no allowance was made for the number of spatial
697  pixels. This should also work properly for 2D images now as well.
698
699* Fixed minor bug in calculating the flux threshold from the p-value
700  threshold when the FDR method is used. This did not affect the
701  actual thresholding, merely the quoted flux threshold in the results
702  file. Also, the MW channels are kept out of the p-value threshold
703  determination if they are being flagged.
704
705
706
707Duchamp version 1.0.7 (2006/11/22)
708----------------------------------
709
710One new feature, and some improvements and bug-fixes.
711
712* The user can now elect to Hanning-smooth the spectral direction of
713  the cube before the searching is done. This can be done instead of the
714  wavelet reconstruction (although if both are selected, the
715  reconstruction takes precendence). This functionality is switched on
716  and off by the flagSmooth parameter, and the width of the Hanning
717  kernel is governed by the hanningWidth parameter.
718
719* The smoothed array can also be written to a FITS file and read in at
720  the start in the same manner as the reconstructed array.
721
722* Several improvements have been made to the memory
723  management. Several memory leaks were fixed, and the memory usage of
724  Duchamp is considerably less, which will be a help for running it on
725  large cubes. The speed of some routines has also been improved, by
726  removing unnecessarily repetitive loops.
727
728* The sorting routines have been changed, and should now be slightly quicker
729  (and a bit more robust).
730
731* Enabled the scale bar (plotted on the 0th moment map in the spectral
732  output file) to be able to deal with much finer spatial scales (as
733  may be expected from VLBI data).
734
735* Other minor changes to code and presentation.
736
737
738Duchamp version 1.0.6 (2006/11/01)
739----------------------------------
740
741Some incremental improvements and changes to the code:
742
743* The statistics used for the detection are now calculated once for
744  the entire cube, rather than being calculated separately for each
745  channel map and spectrum. This results in a uniform threshold value
746  across the entire cube. The way the statistics calculations are
747  implemented in the code was changed, using a new statistics class.
748
749* This means we can report a peak signal-to-noise value for each
750  detection. This is given in the text-based output, as well as in the
751  summary information above the spectral output for each source.
752
753* The user can now elect not to have the moment map displayed in a
754  PGPlot window, through the use of the new flagXOutput
755  parameter. This should help in cases of running Duchamp on a dumb
756  terminal (with no X-display capabilities), or as part of a batch
757  script where the continual popping-up of the PGPlot window might
758  become annoying.
759
760* There are different Flags reported for the case of an object lying on
761  the spatial edge and spectral edge of the cube (E and S respectively).
762
763* A few minor bug fixes:
764  - When providing a subsection, any axes with the range given by *
765    had the pixel values offset incorrectly. This has been fixed.
766  - Negative searches now correctly invert the reconstructed array
767    when it is read in from a file.
768
769* Other minor changes to the code, to improve memory handling and
770  remove redundant arrays and variables.
771
772
773Duchamp version 1.0.5 (2006/09/06)
774----------------------------------
775
776Since version 1.0, there have been a range of mostly minor
777changes. These are generally bug-fixes, thanks to feedback from a
778number of users, as well as a few extra features.
779
780Here is a summary of the changes since version 1.0:
781
782USER INTERFACE:
783
784* The user is now able to enter the value of flag parameters in the
785  parameter file as strings, as well as integers (so one can enter
786  true or 1 to give the same result).
787
788GRAPHICAL OUTPUT:
789
790* Added a new function that draws the edge of the blank region on the
791  maps and image cutouts. There is a new flag parameter --
792  drawBlankEdges -- that controls the use of this function (the
793  default is true).
794  Also, the edge of the field is plotted on the image cutouts as a
795  yellow line. This distinguishes it from the purple blank pixel
796  dividing line.
797
798* The size of the tick mark in the image cutout (indicating the
799  spatial scale of the image) is now adaptable, so that it shows the
800  scale that best fits the image (ranging from 1 arcsec to 15
801  degrees). (This is a change from the previous standard length of 15
802  arcmin.)
803
804* The zoomed spectrum had its flux scale determined by all points in
805  the zoom box,including those flagged by the Milky Way (MW)
806  range. This has been fixed so that any MW channels will not affect
807  the flux scaling, potentially improving the appearance of objects
808  detected close in velocity to strong MW emission or absorption.
809
810* Improved Karma Annotation file output, so that files without good
811  WCS are dealt with appropriately.
812
813TEXT-BASED OUTPUT:
814
815* The position resolution in the IAU-format names has been increased,
816  so that distinct objects close to one another are more readily
817  distinguished.  Overlapping sources at different velocities may
818  still have the same name, but this is a more general problem.
819
820* The presentation of the results in tabular format has been improved,
821  so that the precision of faint sources is sufficient to show their
822  flux, for instance, is not 0. This also applies to the information
823  presented above the spectral plots.
824
825* Improved error and warning reporting, so that the formatting and
826  presentation of information is clearer.
827
828FITS I/O RELATED:
829
830* The previous version was did not deal well with 4 (or greater)
831  dimensions in the FITS file -- the memory allocation was badly done,
832  and the axes needed to be in a particular order. This has been
833  fixed, so that the FITS I/O routines can now handle any sized FITS
834  file, with axes in any order (as long as there are two spatial and one
835  spectral axes).
836
837* When the FITS file does not have a rest frequency defined, there is
838  no way to transform the frequency axis into velocity. In this case,
839  the spectral axis is left as frequency, and put into units of MHz.
840
841* If the beam size is not indicated by the FITS header (through the
842  BMAJ and BMIN keywords), the user can manually specify the size
843  through the parameter file (using parameter beamSize).
844
845* The FITS I/O routines make use of the command fits_file_exists. This
846  was introduced into the CFITSIO package from version 2.5, so Duchamp
847  will only work with this version or higher. Version 3+ is preferred.
848
849OTHER BUG-FIXING:
850
851* Several bugs related to the blank-pixels were dealt with.
852  The correct values were not propagating through correctly, meaning
853  that the default values were being used. Also, there was the
854  potential for blank pixels to be detected when the FDR method was
855  used. Finally, the image cutout displays occasionally did not
856  obscure the blank pixels. All these problems should be fixed now.
857
858* The FDR setup routine was occasionally failing with a segmentation
859  fault, due to it accessing unallocated memory. This has been fixed.
860
861* Fixed bugs that affected the way 2D images (rather than 3D cubes)
862  were dealt with. The minChannels test failed when minChannels=0.
863
864* If there is no beam information in the FITS header, the user can now
865  enter a beam size as a parameter.
866
867* Other minor fixes to the code, to improve its structure and
868  robustness.
869
870
871Duchamp version 1.0 (2006/06/30)
872--------------------------------
873
874The first full release version.
875
876Several major changes compared to previous version:
877
878* Incorporated a FitsHeader class, to keep track of header information
879  (including WCS) from the FITS file. All units-related calculations
880  are done with this class, such as conversion to velocity, and
881  pixel-to-WCS conversion.  The main advantage of this is improved
882  speed of execution, more adaptable to different units, and improved
883  code (easier for me!).
884
885* Able to select the dimensionality of the reconstruction, rather than
886  just doing it in 3-D.
887
888* Robust text output, so that the columns are sized correctly given
889  the data being written, and the relevant units (derived from the
890  FITS header) are included in the output table.
891
892* Improved the way the reconstructed image is saved and read back in,
893  with a better naming scheme and a better set of new FITS header
894  keywords. The MW headers are now not written.
895
896Other, more minor changes include:
897
898* MW channels now not set to 0, but just ignored for searching
899  purposes (and for the scaling of the spectral output -- they are
900  plotted though and highlighted with a hashed box).
901
902* The scale bar in the moment map in the spectral output file has its
903  length indicated.
904
905* Improved VOTable output, with more information about the way Duchamp
906  was run.
907
908* Made sure all statistics calculations in the reconstruction are
909  based on robust (ie. median) methods.
910
911Also moved to an autoconf based configure/make compilation, for ease of use.
912
913
914Duchamp version 0.9.2 (2006/06/27)
915--------------------------------
916
917* Added the use of warning flags for detections: for either edge
918  location or negative enclosed flux.
919
920* A new command line option added so that the user can specify a FITS
921  file to be searched with the default parameters, rather than giving
922  a full parameter file.
923
924* The scale bar on the moment cutout now works in general case, using
925  an iterative process to get to the correct length.
926
927* RA axes are now done correctly on the full-scale maps.
928
929* Various coding fixes, improving the readability of the code,
930  particularly regarding the declaration of temporary variables.
931
932* Changed the way the time of execution is called : now using time.h
933  functions, rather than a system call.
934
935* Changed output in Detection/outputDetection.cc for the pixel
936  information of detected objects (the info printed above the spectral
937  plots) -- now print out number of voxels in object, and have
938  improved the formatting a little.
939
940* Improved the functionality of saving the FITS file containing the
941  reconstructed array. Added ability to save and read back in the MW
942  parameters when saving a reconstructed cube (if a reconstructed cube
943  has different MW range to that being considered, it would cause
944  problems). ReadRecon now just returns a FAILURE and will reconstruct
945  the cube anew.
946
947* Changed default value of flagGrowth to 0.
948
949
950
951Duchamp version 0.9 (2006/05/05)
952--------------------------------
953
954First public release version.
Note: See TracBrowser for help on using the repository browser.