source: tags/release-1.6.1/CHANGES

Last change on this file was 1397, checked in by MatthewWhiting, 10 years ago

A bit extra in CHANGES to describe the change in interface of a bunch of functions.

File size: 66.2 KB
Line 
1Duchamp version 1.6.1 (2014/05/01)
2----------------------------------
3
4Principal reason for the release is to fix a memory leak. This was
5occuring when making blank pixel masks, particularly in the
6parameterisation step. It was apparent with large files and large
7numbers of sources. Thanks to Quang Nguyen for raising the bug and
8helping with the identification of the problem.
9
10For those interested in the code base itself, all boolean masks have
11been moved to vector<bool> types, with the consequent change of
12interface for some functions (including the statistics functions,
13Gaussian smoothing, and some spectral utility functions).
14
15A few other potential memory leaks were identified and fixed.
16
17To aid the debugging, the progress bar now also reports the percentage
18complete as well as the set of hashes.
19
20
21Duchamp version 1.6 (2014/04/22)
22--------------------------------
23
24Improvements and bug fixes:
25
26* When searching for negative features while using baseline
27  subtraction, the parameterisation of the resulting detections was
28  not being done correctly. Duchamp now correctly identifies the peak
29  absorption location and measures the peak as being the peak
30  absorption from the fitted continuum level. A future release will
31  add more absorption-line-oriented parameters.
32
33* The way the borders of detections are displayed in annotation files
34  has been improved. Duchamp now writes them in a polygon or
35  join-the-dots fashion. This reduces the size of the annotation
36  files, and is now compatible with the CASA viewer.
37
38* The VOTables now refer to version 1.3 of the VOTable schema. Note
39  that they still use the old COOSYS method of specifying the
40  coordinates. Moving to the preferred STC method will happen in a
41  future release.
42
43* There were some problems with the storage and recovery of parameters
44  in the binary catalogue - these have been fixed.
45
46* The BITPIX keyword in the mask FITS files that Duchamp writes are
47  now SHORT_IMG, although they can be bigger if warranted by the
48  number of objects.
49
50* Duchamp can now read .fits.gz files, and have the output FITS files
51  appropriately named in the automatic way (the .gz suffix was not
52  being recognised & removed properly).
53
54* Some UCDs in the VOTable were missing semicolons between elements.
55
56* When calculating the cube statistics, Duchamp makes a mask showing
57  the locations of blank pixels, flagged channels, and the statistics
58  subsection are, so that only the required pixels are used in the
59  calculations. If none of these apply, however (that is, if there are
60  no blank pixels or flagged channels, and the user is not requesting
61  a particular stats subsection via the statsec parameter), then the
62  mask is not created. This saves additional memory allocation, which
63  can be important for large cubes. Thanks to Andrew Walsh for
64  identifying this problem.
65
66* Duchamp exits better (ie. without throwing a segmentation fault)
67  when the requested FITS file does not exist.
68
69* The reference cube used for the verification script has been changed
70  - the sources therein are now smaller spatially (more appropriately
71  so for the pixel size), which gives a better idea as to the
72  performance.
73
74Documentation improvmements
75
76* The InputComplete file is more up-to-date, and has information on
77  the type and default values of each possible input parameter (this
78  information is also reflected in the User Guide). This is in
79  preparation for a parameter-editing GUI that will be released in a
80  forthcoming version.
81
82* The User's Guide now has a section on common installation issues,
83  based on feedback and experience with new users.
84
85Build changes:
86
87* Duchamp is now linked with the C++ compiler. Accordingly, the
88  configure script searches for libgfortran when the gfortran compiler
89  is specified as the F77 compiler (ie. it has been used to build
90  pgplot).
91
92* To allow Duchamp to build on Mac OS X 10.9 (Mavericks), configure
93  searches for the libc++ library as well as stdc++. Duchamp has been
94  successfully built on 10.9, with fresh installs of pgplot (5.2),
95  wcslib (4.20) and cfitsio (3.36), but, as always, your mileage may
96  vary. Please contact me via the Trac tickets if you encounter
97  problems.
98
99* A number of warnings that came to light with recent XCode upgrades
100  on the Mac have been fixed, as well as those from an upgrade to
101  gcc-4.4.5 on debian.
102
103
104Code base changes:
105
106* There are new wcs-pix conversion functions in fitsHeader that allow
107  the specification of a single set of pixel and world coordinates
108  (rather than arrays).
109
110* There is cleaner separation of the writing functions in the
111  VOTableCatalogueWriter class.
112
113* The management of the wavelet filters has been improved, with new
114  classes to handle the different filter types, and a factory class to
115  generate them. The interface via the Param class is largely the
116  same, however.
117
118* The annotation file changes noted above involve a new PixelInfo
119  class called Line, with associated files. The method for drawing the
120  borders has been moved into its own file (drawBorders.cc) to allow
121  dependence on the pgplot library.
122
123* The function Cube::reInvert() has been removed - use Cube::invert()
124  instead. Note that the interface for the latter now has two optional
125  bool parameters.
126
127* There are improved front-end functions for the writing of arrays to
128  the various FITS files.
129
130
131
132Duchamp version 1.5 (2013/08/29)
133--------------------------------
134
135New features & algorithms:
136
137* There is now a more flexible way to specify channels that should be
138  ignored by the source-finding. Use flaggedChannels to provide a list
139  of single channels or channel ranges that should be ignored. This
140  replaces the flagMW/minMW/maxMW parameters, extending their
141  functionality and allowing more than one set of channels to be
142  specified.
143
144* There is now an alternative way to find (and remove) spectral
145  baselines, using a median baselining algorithm. This calculates the
146  baseline value for a given pixel to be the median value within a box
147  of a specified size centred on that pixel. There are two input
148  parameters now available, baselineType (atrous or median), and
149  baselineBoxWidth (the width of the median box). Consult the User's
150  Guide for further information.
151
152* There is now more flexibility in running the spatial smoothing. The
153  cutoff value in determining the size of the smoothing kernel can now
154  be set via the input parameters, as can the way the edge pixels get
155  treated. Conult the User's Guide for details.
156
157* You can now also specify the maximum number of voxels, spatial
158  pixels and/or channels, in a way analogous to the minimum
159  values. Detections with more than the maximum are rejected. Negative
160  values (such as the defaults) mean this comparison is not done.
161
162Output changes:
163
164* The results files now include the Nchan and Nspatpix columns,
165  showing the number of distinct channels and the number of spatial
166  pixels in each detection. For clarity, the Npix column has been
167  renamed Nvoxel.
168
169* The VOTable now includes the pixel location X, Y, Z columns, and the
170  pixel ranges - this makes it much closer to the ASCII results file
171  (it is just missing the string versions of RA/DEC, and F_tot when
172  F_int is calculated).
173
174Bug fixes:
175
176* Negative velocity (and other) values were resulting in the column
177  widths not adjusting correctly, leading to columns running into each
178  other. This has been fixed, so that the spacing in the results files
179  should be correct.
180
181* Fixed a problem applicable to cubes with blank/masked pixels in the
182  same spectra as detections. The velocity width calculations could
183  sometimes fail due to the mask not being applied.
184
185Code changes:
186
187* The plotting code has been refactored, improving its class structure
188  and inheritance. No functional change from this should be evident,
189  but it improves the maintainability of the code.
190
191
192Duchamp version 1.4 (2013/06/20)
193--------------------------------
194
195Installation:
196
197* The "make lib" command will now create a shared library
198  libduchamp.1.4.so as well as the static library libduchamp.1.4.a
199  (formerly just called libduchamp.a).
200
201Bug Fixes:
202
203* The orientation of ellipses in the DS9 region files are now correct
204  (they were wrong by 90 degrees).
205
206* Corrected the output FITS filenames so that they work when the input
207  filename does *not* end in ".fits".
208
209Code changes:
210
211* The code that manages the output columns for the ASCII and VOTable
212  output has been overhauled and streamlined. Little functional change
213  should be evident, but it should be much more robust. And easier to
214  use in derived software.
215
216Duchamp version 1.3.2 (2013/05/02)
217----------------------------------
218
219Bug fixes:
220
221* The units for the integrated flux (for F_int) were not being
222  calculated for cases of a FITS file without a spectral
223  axis. Additionally, a vestigial default value meant this column had
224  units of "counts". This has been fixed so that a FITS file with
225  Jy/beam units will have F_int values in Jy.
226
227* The ellipse fitting to find the MAJ/MIN/PA was not working correctly
228  in the case of negative searches. This has been fixed.
229
230* The scaling of MAJ/MIN values was not being done correctly in all
231  cases, so that the values were out by a factor of 60 or 3600. This
232  was particularly the case when the ellipse fitting failed (due to
233  small numbers of pixels, for instance).
234
235* The principle axes calculations have been simplified slightly, and
236  now are done only on pixels above half the peak in the moment-0 map
237  (to estimate the FWHM).
238
239Duchamp version 1.3.1 (2013/04/18)
240----------------------------------
241
242Bug fixes:
243
244* The kernel used in the 2D smoothing was not normalised properly,
245  which meant the fluxes in the smoothed array were scaled
246  incorrectly. The kernel is now normalised, so that the fluxes in the
247  smoothed array decrease (and to an increasing degree with larger
248  kernels, as expected).
249
250* The way the position angle of the smoothing kernel was interpreted
251  was wrong. It now conforms to the typical astronomical position
252  angle definition of degrees east of north.
253
254* The Z_PEAK column was being left out of the results file for
255  Duchamp-1.3. It has been put back in.
256
257* The calculation of S/Nmax has changed so that when smoothing or
258  reconstruction is done, the peak flux used is measured in the
259  reconstructed/smoothed array (where the noise is measured).
260
261* The flux errors are now not reported in the case of smoothing, since
262  we don't measure the noise in the original input image array.
263
264Other fixes:
265
266* The vertical range of the spectral plots now properly takes into
267  account all spectra (not just the input array), and quirks with a MW
268  range lying outside the plotted range have been fixed.
269
270* The flux scaling for the moment-0 map plot now ignores negative
271  values, meaning the scale should be sensible.
272
273* The spelling of the Object2D::getPrincipalAxes() has been corrected.
274
275* Minor code optimisations have been made to the smoothing code.
276
277* The subsection class is now initialised with a blank string.
278
279Duchamp version 1.3 (2013/03/08)
280--------------------------------
281
282New features:
283
284* New source parameters:
285
286  # Each source now has a measurement of the major & minor axis sizes,
287    along with the position angle of the major axis. The sizes are the
288    full-width at half maximum, measured from the moment-0 map. These
289    now appear in the catalogue and in the spectral plots, with the
290    ellipse drawn on the moment map cutout in the spectral plots. The
291    old measurements of w_RA & w_DEC are still made and included in
292    the full catalogue, but are no longer reported in the smaller
293    catalogue printed to screen (nor in the XML/VOTable output).
294
295  # Each source also now has a measurement of the error on the
296    integrated and total fluxes. This is calculated from summing in
297    quadrature the statistical noise on each detected voxel. This is
298    from a request by Sara Shakouri.
299
300* Output files - new types and changes to the way they are written:
301
302  # Ability to create CASA region format files showing the location of
303    the detected sources. This is analogous to the Karma annotation
304    files or DS9 region files, for use with the casa viewer, but can
305    also be imported into casapy.
306
307  # Ability to save baseline values to a FITS file (in the same way as
308    for the reconstructed or smoothed array).
309
310  # Ability to save the moment-0 mask to a FITS file (that is, a mask
311    indicating which spatial pixels form part of the moment-0 map).
312
313  # There is an improved way to store the detected pixels for later
314    re-use. While previously the detected pixels were written as scans
315    to the logfile, and then read in when the usePrevious flag was
316    set, we now write the scans and other metadata to a binary
317    catalogue that can be read in again. Writing as a binary file
318    leads to much better compression of the data, particularly when
319    combined with the run-length encoding. It is anticipated future
320    tools will be provided to allow additional interaction with these
321    binary catalogues.
322
323  # There are slight changes to the format of the ASCII catalogues,
324    where lines not containing sources are prefixed with a comment
325    character '#'. This will facilitate their use in other software.
326
327* There is a new command-line parameter, -t THRESH, which specifies
328  the flux threshold for searching. It is designed to be used with the
329  -f option, as a quick way of searching a FITS image to a specified
330  flux level.
331
332Bug fixes:
333
334* A bug in the spatial smoothing has been fixed. The mask was being
335  interpreted incorrectly, so that no valid pixels were getting
336  smoothed.
337
338* The WCS for the moment-0 FITS cube has been fixed (specifically, the
339  axis names).
340
341* When usePrevious was used, the behaviour in previous versions was to
342  always write individual spectra. This is now controlled by a new
343  parameter flagPlotIndividualSpectra.
344
345* Minor improvements to the output when verbose=false.
346
347* Improvements to the Makefile, so that header files from a
348  previously-installed version of Duchamp do not get used instead of
349  those from the current version.
350
351* The vertical range for the spectral plots now take into account the
352  baseline and reconstructed/smoothed arrays as well (outside of any
353  MW range, of course).
354
355Other
356
357* The code-base for reading from and writing to FITS files has been
358  overhauled and streamlined. It can now be found in the FitsIO
359  directory. The interface for the writing of FITS files via the Cube
360  class has not changed.
361
362* The User Guide has been slightly re-ordered to provide more explicit
363  information about the source parameters.
364
365
366Duchamp version 1.2.2 (2012/10/29)
367----------------------------------
368
369Bug fixes:
370
371* The reading of reconstructed & smoothed arrays in the case of large
372  (>2GB) cubes has been improved. While the most recent versions of
373  cfitsio were able to handle these, earlier versions would result in
374  a segementation fault using the previous interface. An alternative
375  interface has been implemented that avoids these faults, even for
376  the older cfitsio libraries.
377
378* A bug affecting the writing of FITS mask files (apparently for the
379  case of flagging by the object number) has been fixed.
380
381* The moment map occasionally failed if sources lay spatially within
382  the blank pixel region of the first channel. This check has been
383  removed and the moment map should be produced successfully in all
384  situations.
385
386Other:
387
388* The UCDs used in the VOTable catalogue output have been
389  updated. Several of these were shared between different columns, and
390  so they have been changed so that each UCD is unique to one
391  column. The column ID strings have been updated for clarity.
392
393* The determination of default output image filenames has been
394  improved -- it previously assumed the input filename ended in
395  '.fits', but this is no longer the case.
396
397Duchamp version 1.2.1 (2012/10/09)
398----------------------------------
399
400New feature:
401
402* Duchamp can now produce region files to annotate images displayed in
403  SAOImage DS9. There are new parameters flagDS9 and ds9File that work
404  in the same way as the Karma annotation file parameters. The region
405  files can also be displayed in (at least some versions of)
406  casaviewer.
407
408* There is a new script to fix occasional problems with the
409  automatically-detected Makefile, and the verification script has
410  been updated and improved.
411
412Bug fixes:
413
414* The main bug fix for this release corrects a problem with the
415  velocity width measurements made when searching for negative
416  detections. It was possible to get very small (and incorrect) widths
417  in some cases - this was due to the integrated spectrum not being
418  inverted correctly.
419
420* In the case of smoothing, the stats of the full cube that were being
421  reported in the output files were actually those of the un-smoothed
422  (input cube). This only affected the output files, not the detection
423  process itself.
424
425* The units were not being reported in the VOTable. This has been
426  fixed.
427
428* The UCDs for the spectral parameters in the VOTable were not being
429  adapted to the user requests, so didn't always match the types of
430  the parameters. All should be consistent now.
431
432Other changes:
433
434* The codebase relating to the creation of and writing to output files
435  (results, logs, annotation, VOTables) has been overhauled, with a
436  cleaner interface. Most of this code is in the new subdirectory
437  src/Outputs, to where the columns code has been moved as well.
438
439  This was instigated by ASKAP/Selavy development, but also allowed
440  the expansion of output formats to include DS9 region files. No
441  change to the user should be visible, but anyone using the software
442  will notice differences. Please get in touch if changes are
443  difficult to follow.
444
445Duchamp version 1.2 (2012/08/08)
446--------------------------------
447
448Key changes:
449
450* The way the wavelet reconstruction is done in the presence of BLANK
451  voxels is slightly different, specifically when there were BLANK
452  voxels on the edge. While BLANK voxels are always ignored by the
453  reconstruction (and left in place), the previous approach dealt with
454  BLANKS on the edge by moving the effective edge of the image inwards
455  until the first non-blank voxel. This meant that the size of the
456  dimensions used to determine the number of scales, and the location
457  where boundary reflections took place where different to the input
458  image size.
459
460  However, this meant that BLANK voxels on the edge were treated
461  differently to those not on the edge, so this inconsistency was
462  removed. The full image dimensions are always used to calculate the
463  number of scales, and reflections (which is how the reconstruction
464  deals with the boundaries) will occur at the actual image edges.
465
466  If your data has this property (BLANK pixels at the image
467  boundaries), then any reconstruction will be affected (most likely
468  only in a small way) and potentially any subsequent searching. You
469  are advised to check this (for instance by saving the results of the
470  resonstruction from 1.1.13 and 1.2 and comparing).
471
472* The way the spectral world coordinate system is dealt with has been
473  improved. Previously Duchamp tried to convert to a velocity axis,
474  and got a bit grumpy if that didn't work well. Now it will express
475  the spectral units in the axis type indicated by the FITS
476  header. Duchamp will also allow you to change this type by providing
477  an appropriate WCS type as an input parameter. You may also provide
478  a rest frequency in the parameter file and this will be used to
479  calculate velocities. And, as before, you can provide specific units
480  for the spectral quantities to be converted into.
481
482* Since v1.1.13 was released, the journal paper describing Duchamp has
483  been published. It can be found at MNRAS 421, 3242 (2012), or
484  http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2966.2012.20548.x/full. It
485  includes descriptions of the various algorithms used for Duchamp, as
486  well as some indicative comparisons of the relative completeness &
487  reliability. Please cite this paper when describing Duchamp.
488
489Other new features:
490
491* The default value of snrCut has changed from 3 to 5. This is
492  espeically important if you use the -f option, but also if you don't
493  provide snrCut in your parameter file.
494
495* The XML VOTable output now includes a more complete list of
496  parameters, matching the output given in text form in the results &
497  log output files. Only those parameters affecting the results are
498  included - things like the output file names and so on are left out.
499
500* The minVoxels parameter is now adjusted to be at least (minPix +
501  minChannels - 1). If it is changed, a warning message is triggered.
502
503* The warning/error reporting has been overhauled, with an improved
504  interface for developers. Also, some ERROR instances that previously
505  resulted in the program terminating now allow it to continue
506  (provided that is possible given the error).
507
508* It is now possible to give the convergence criterion for the wavelet
509  reconstruction via the parameter reconConvergence. When the relative
510  change in standard deviation of the residuals from the
511  reconstruction falls below this value, the a trous algorithm stops
512  iterating.
513
514* The way one-dimensional arrays were dealt with was unsatisfactory,
515  both with the way positions were registered and the format of the
516  graphical output. Improvements have been made such that a 1D data
517  structure is assumed to be a spectrum, and so positions in the
518  spectrum are reported as z-pixels (or the equivalent world
519  coordinate). Instead of a 2D moment map, the X-windows display will
520  show the spectrum with all detected pixels plus the final list of
521  detections highlighted, along with the detection and growth
522  thresholds. This plot will also be written to the "detectionMap"
523  image.
524
525* All spectral plots will now show the detection (and growth, if
526  applicable) thresholds when plotting the peak flux spectrum.
527
528* Accessing FITS files when a subsection string is provided has been
529  streamlined. The cfitsio package, which handles the FITS access,
530  creates a temporary file containing this image section, and this
531  meant the previous approach was slow, particularly for large
532  files/sections. Now the file is only opened once and the overhead of
533  creating the temporary file is only encountered once.
534
535* Several aspects of the processing & output did not handle a
536  non-existent WCS well. This has been improved, so that all stages of
537  execution will proceed without errors.
538
539Bug fixes:
540
541* The absence of a BLANK keyword when trimming will now not trigger a
542  failure, only a warning message.
543
544* The flux unit conversion (eg. from Jy/beam to mJy/beam) was not
545  being applied correctly when an existing reconstructed or smoothed
546  array was being read in. This is now applied properly.
547
548* When saving reconstructed or smoothed arrays, the data type is now
549  set to FLOAT, so that the correct values are written (and
550  subsequently read in). The previous version was potentially saving
551  to a FITS file with integer data type (this depended on the type of
552  the input array). In this case, the full precision of data values
553  would not be preserved, so reading back in and doing an identical
554  search could yield different sources.
555
556* For certain cases, the reconstruction attempted to use a very large
557  number of scales. This has been fixed.
558
559* The maximum scale for the reconstruction was not always being
560  applied. The scale ranges are now enforced for all types of
561  reconstructions.
562
563* When saving a mask image while using a subsection of a cube, the
564  offsets for the subsection were not being accounted for
565  correctly. This is now fixed.
566
567* The detection map plots were not recording pixels added from the
568  growing stage. This has been fixed.
569
570* The RA & Dec now have appropriate precision, rather than an
571  arbitrary 2 decimal places on the seconds value. The RA will be one
572  decimal place more than the Dec, and they will reflect the degree of
573  precision in the image pixels.
574
575* A number of data type conversions (typically ints to floats) led to
576  errors in some calculations, such as WCS conversions. Care has been
577  taken to make sure all indexing is done appropriately with no
578  overflow, and that all conversions (where necessary) are done
579  appropriately.
580
581* It was possible to get world positions looking like 11:59:60.0! Not
582  any more.
583
584* Reading previous detections from the log file (via the use of the
585  usePrevious parameter) did result in error messages due to slightly
586  incompatible formats. These have been fixed, and all graphical
587  output should work properly.
588
589* When using a spectral search, having a blank pixel in the first
590  channel could lead to that entire spectrum being ignored, leading to
591  inconsistent results between spectral and spatial searches. This
592  issue has been fixed, with both types of searches returning the same
593  catalogue.
594
595
596Code base development notes:
597
598* Most instances of integer overflow due to insufficient precision
599  have been tracked down - many of these were indexing variables of
600  type int, which have been changed to size_t.
601
602* Importantly, for code interfacing with the duchamp::Cube and related
603  classes, axisDim is now an array of size_t elements, rather than
604  long.
605
606* Object3D now carries its spatial map with it, rather than
607  calculating it on the fly when requested. This saves a lot of
608  unnecessary computational effort.
609
610* The warning/error interface has improved, making use of C++
611  exception handling. This should be compatible with external logging
612  infrastructure (such as log4cxx).
613
614* The interface to the FitsHeader & WCS structures for external code
615  has been improved, so that the WCS can be set up via function calls.
616
617
618
619Duchamp version 1.1.13 (2011/04/10)
620-------------------------------------
621
622Bug fixes:
623
624* The median statistics calculations had a bug in the test for whether
625  the array under consideration was of even size. The correction for
626  this can mean small differences in the resulting values. This can
627  flow through to calculated detection thresholds - please check this
628  with your data if you use this mode!
629
630* The reconstruction code had a bug where the incorrect number of
631  scales was being used. This occurred when the blank pixel flag was
632  set, and when the spectral dimension was smaller than both the
633  spatial dimensions.
634
635Other:
636
637* The default value of the blank pixel flag has been set to false,
638  rather than true. For Duchamp, this should not matter, as it is set
639  when the FITS file is read in. For external code using, for
640  instance, the reconstruction algorithms, this default may be
641  important. Having it true was contributing to the second bug listed
642  above. It also makes more sense for it to be false unless explicitly
643  set in some way.
644
645* The reconstruction code has been streamlined a little, reducing its
646  memory impact and using more appropriate variable types
647  (eg. unsigned ints instead of ints and so forth).
648
649* For those who care about the actual code base, the statistics
650  functions have been expanded, and separated from getStats.cc into
651  "normal" and "robust" versions.
652
653
654Duchamp version 1.1.12 (2011/03/18)
655-------------------------------------
656
657Bug fixes:
658
659* The velocity width calculations had a bug that occasionally led to
660  very large values. The widths are calculated using the integrated
661  spectrum, using a threshold relative to its peak. In v.1.1.10 and
662  1.1.11, however, the peak was searched for over the entire spectral
663  range, rather than just the range for the current object. This led
664  to spurious values. This has been fixed, so that the peak is only
665  searched for within the detected ranage of the object.
666
667* Both the pixel and statistics subsections are now more carefully
668  examined, with errors reported if there are no valid pixels in the
669  pixel subsection, or if the statistics subsection does not intersect
670  with the pixel subsection.
671
672Other:
673
674* The configure script has been slightly improved so that the pgsbox
675  library is only added if PGPlot has been enabled - this is
676  particularly necessary with the slightly changed build procedure for
677  recent wcslib versions.
678
679* In a related note, one file - momentMap.cc - had some #include
680  statements that failed when PGPlot (and hence pgsbox in WCSLIB) was
681  not enabled. These were actually unnecesssary and have been removed.
682
683* There is a new input parameter - flagPlotSpectra - that allows the
684  user to turn off the production of the spectral plots. It defaults
685  to true (meaning the plots are produced).
686
687
688Duchamp version 1.1.11 (2011/03/01)
689-------------------------------------
690
691Improvements:
692
693* The largest changes in this release involved improving the
694  efficiency of the code, resulting in further speed-ups. The code
695  affected was the low-level object-handling code, with the merging
696  stages in particular showing good speed-ups.
697
698* The default value for the beam size, when the beam parameters are
699  not in the FITS header, has been dropped. Now the default behaviour
700  is to simply not make any beam corrections if the beam is not
701  specified by either the FITS file or the input parameters. Thanks to
702  Tobias Westemeier for the suggestion.
703
704* The reporting of the beam size has changed slightly to provide a bit
705  more information.
706
707Bug Fixes:
708
709* The statistics section (statSec) could be larger than the image
710  subsection (if provided), yet the pixels required would never be
711  read in from the FITS file. The behaviour has been changed so that
712  the statSec, if requested, is trimmed to be wholly within the image
713  section.
714
715* It was possible to request, for instance, spectral smoothing on a 2D
716  image. This resulted in a blank smoothed array, which led to
717  problems in the calculations of statistics (and hence the
718  threshold), as well as subsequent calculations. This has been fixed,
719  so that in cases like this the smoothing is turned off (and a
720  warning message is displayed).
721
722* There was a problem with using a MW range and subsectioning when
723  growing objects, as a result of changes in 1.1.10. This has been
724  fixed.
725
726* Inversion was failing when no array was allocated (not a problem for
727  standard Duchamp, but affected its use as a library by other code).
728
729* Writing text spectra would only occur when PGPlot output was enabled
730  in the build (it was combined with the plotting of the spectral
731  graphs). This has been changed so that this output can be requested
732  without requiring PGPlot.
733
734* The equation for the beam size in Sec.4.2 of the User Guide was
735  incorrect and has been fixed.
736
737* Minor change to the configure script to improve the detection of the
738  PGPlot library.
739
740Code development notes:
741
742* The main work has been additions and improvements to the interfaces
743  for the Param and the Section classes, as well as new classes to
744  manage the beam information. The efficiency changes mentioned above
745  also affected the internals of some of the PixelInfo classes, and
746  provided additional functions for judging the closeness of
747  neighbouring objects.
748
749Duchamp version 1.1.10 (2010/11/15)
750-------------------------------------
751
752Improvements:
753
754* The major change for this release is a greatly improved growing
755  algorithm. The previous incarnation was very inefficient (testing
756  all pixels in an object, most of which only have neighbours that are
757  already in the object), and could take an unnecessarily large amount
758  of time in the case of extended sources. The improved algorithm
759  makes use of voxel flags to quickly identify those voxels not yet in
760  an object and only examines them. For a certain test case
761  (observations of extended Galactic HI), the time required reduced
762  from about a day to about a minute! (Note that compact sources, such
763  as HI galaxies, will not show this degree of speedup...) Many thanks
764  to Tara Murphy for pointing out this bug and her help in
765  diagnosing/fixing the problem.
766
767* There have been a number of further improvements to the code to
768  speed it up, based on some profiling. The most important was the
769  function to add pixels to a 2D object, but there were several other
770  minor changes as well.
771
772* The minimum size of the detections can now also be specified in
773  terms of the total number of voxels (in addition or instead of
774  specifying the minimum spatial pixels or channels).
775
776* The way memory is allocated when reading the image has been
777  streamlined. The amount of memory being allocated is also now
778  reported - this is in an effort to allow users to identify problems
779  with running out of memory.
780
781* The version number is now reported in the results and log files.
782
783* Only the filename of the input image (ie. not the leading
784  directories) is now shown on the detection and moment-0 maps. This
785  is to avoid problems with large directory paths being too wide for
786  the plot.
787
788* The verification script was improved for readability (although no
789  functional change was made).
790
791Bug fixes:
792
793* Growing was not being done when a single source was found. Now
794  fixed.
795
796* For particular WCS setups, the RA can be interpreted as being
797  negative, which corrupted the Source ID (ie. the IAU-format
798  string). This has been fixed.
799
800* When the flux units were changed, problems had been seen when
801  writing a reconstructed cube to a FITS file. Any unit change is now
802  undone prior to writing and there should now be no problem.
803
804* Filenames with spaces in them were not handled well. New functions
805  were included and moved to a more obvious location. These filenames
806  now work as expected.
807
808* Spectral axes of type FREQ that had a rest frequency were not being
809  put into velocity units. Now fixed.
810
811* Improvements to the output to screen, making sure everything is
812  covered by the verbose flag.
813
814* Better management of the allocation of arrays.
815
816* The minSize parameter in Image was never initialised, leading to
817  unpredictable behaviour. Now fixed.
818
819Code development notes:
820
821* New functionality includes: a function to return a vector list of
822  voxels in an Object3D or Detection; a new generic Search function
823  (basically a front-end to each of the individual functions); more
824  complete copy constructors for the DataArray classes; new methods
825  for finding the velocity widths.
826
827Duchamp version 1.1.9 (2010/03/26)
828-------------------------------------
829
830Improvements:
831
832* There is now the ability to save the moment-0 map as a FITS
833  file. This is controlled by the parameters flagOutputMomentMap and
834  fileOutputMomentMap, which work in the same way for the mask file.
835
836* There is a new parameter flagRejectBeforeMerge that, when true,
837  rejects sources according to the minPix/minChannels requirements
838  before the merging and growing is done. This defaults to false (so
839  default behaviour is as before). Thanks to Tobias Westmeier for
840  suggesting this and the above improvement.
841
842* There is also a new parameter flagTwoStageMerging. When true (the
843  default), newly-detected objects are merged with the first close
844  object in the list. When false, they are simply added to the end of
845  the list. In both cases, a second round of merging is done to pick
846  up all close matches.
847
848* The way the beam is specified in the absence of the BMAJ/BMIN/BPA
849  parameters has been slightly changed. The use of "beamSize" was
850  somewhat ambiguous (it meant the number of pixels covered by the
851  beam, not the FWHM), so new parameters have been introduced. The
852  beam can be specified by beamArea (which replaces beamSize), or
853  beamFWHM (the FWHM of the beam in pixels). If beamFWHM is provided,
854  it will be used, else the beamArea will be.
855
856* There is a new parameter searchType that allows the user to choose
857  how the searching is done. The behaviour up till now has been to
858  search the 2D channel maps one at a time to build up the 3D
859  detections. This is the default, and can be obtained by setting
860  searchType=spatial. Alternatively, you can set searchType=spectral
861  to do the searching in the 1D spectra.
862
863* Profiling of the code has led to a few changes that have sped up
864  some calculations, particularly those involving the median. Rather
865  than using std::sort, the code now simply uses std::nth_element,
866  which shows a substantial speedup factor.
867
868* When using the objectList parameter, the maps will now only show the
869  selected objects, rather than all detected objects.
870
871* There is a new verification test that looks at the "growing"
872  functionality.
873
874Bug fixes:
875
876* When saving a mask FITS file, there was an occasional memory leak
877  that caused Duchamp to crash (only when the cube was suitably
878  large). This has been fixed.
879
880* The median calculation had a bug that led to an incorrect value
881  being reported. The difference will not be great (the element of an
882  array being reported as the median was out by one), but could be
883  noticeable depending on the dataset.
884
885* The MW range parameters did not respond to the use of a
886  subsection. They should refer to channel ranges in the original
887  cube, and changes have been made to the code to reflect this.
888
889* There was an occasional error in writing out FITS keywords, due to
890  the way comment strings were intialised. This has been improved and
891  made more robust.
892
893* Testing with gcc-4.3.2 showed a number of compilation warnings &
894  errors, which have been fixed.
895
896* The Gaussian smoothing kernel was too small - it is now made big
897  enough to encompass all possible values. It was also being
898  incorrectly scaled. This had no functional effect on the detection
899  of objects, but for other uses was incorrect. This has been
900  rectified.
901
902* Some outputs that weren't caught by the verbose flag now are.
903
904
905Code development notes:
906
907  The following notes only apply if you want to use the code as a
908  library, rather than the stand-alone package. These have generally
909  come out of the ASKAP software development. If you just use the
910  stand-alone package, they won't be a concern.
911
912* The API for storing detected objects has changed, making it more
913  robust from a programming point of view.
914
915* Additional versions of some functions (and the Gaussian smoothing
916  class) have been added - this has come out of the ASKAP development
917  work.
918
919* A number of instances of "unsigned int" being used for loops have
920  been changed to iterators or "size_t". There shouldn't be any
921  functional change from this -- the code should just build more
922  cleanly.
923
924* The Detection class now records whether the parameters have been
925  set, and unsets that flag when objects are merged. This allows
926  external programs to track which objects have been merged and deal
927  with them appropriately.
928
929
930Duchamp version 1.1.8 (2009/07/20)
931----------------------------------
932
933Improvements:
934
935* The final source list can now be sorted on one of a range of object
936  parameters: x-value, y-value, z-value, ra, dec, vel, w50, iflux,
937  pflux (integrated and peak flux respectively), or snr. Simply use
938  the new input parameter sortingParam. Its default value is vel, so
939  the default behaviour stays the same.
940
941* The FDR method involves calculating how many pixels are
942  correlated. This previously involved multiplying the beam area by 2,
943  implying that 2 neighbouring channels were correlated. This factor
944  is now a user-selectable parameter, so that if you know how many
945  spectral channels should be correlated, you can set the parameter
946  FDRnumCorChan and the FDR calculation will be done correctly.
947
948* Screen output now has more information on the growing threshold when
949  the cube statistics are printed.
950
951
952Bug fixes:
953
954* When reading in previous detections, there was a bug causing a
955  segmentation fault. This has been fixed and made more robust.
956
957* There was an apparent bug when writing out the reconstructed cubes
958  to a FITS file that caused the new file to be very large. Changing
959  the cfitsio function used has fixed this.
960
961* Using NCP projections near the equator could result in a large
962  stream of error messages, due to coordinate transformations being
963  done in blank regions outside of the acceptable range of world
964  coordinates. This has been fixed.
965
966* The function that grows objects had a major bug, that stopped it
967  working when flagAdjacent=false. This has been fixed and should work
968  fine.
969
970* The input parameter spectraTextFile was not being read
971  properly. This has been remedied.
972
973* The units for the integrated flux were wrong for some types of pixel
974  flux units. This has been fixed.
975
976* A minor bug caused incorrect calculation of the 20% widths.
977
978* All calls to uint were changed to unsigned int, as some compilers
979  had problems recognising that they were the same thing.
980
981* src/fitsHeader.cc was missing an include statement for stdlib.h,
982  again causing some compilers to fail.
983
984
985Duchamp version 1.1.7 (2009/01/16)
986----------------------------------
987
988Improvements:
989
990* The mask file that can be created with flagMask can now specify
991  which object a given detected pixel belongs to, by taking the object
992  ID as its value. This applies if you set flagMaskWithObjectNum=true
993  (it defaults to false, which means each detected pixel has the value
994  1). Non-detected pixels still have the value 0.
995
996* The names of the output FITS files are now able to be specified
997  directly by input parameters. These will override the default names
998  that Duchamp provides.
999
1000* The Karma annotation file now specifies a font - previously it did
1001  not and so was at the mercy of whatever was specified in other
1002  annotation files being viewed at the same time. Please let me know
1003  if the font I've chosen (lucidasans-12) is not suitable.
1004
1005* The default flag, used in the absence of 'E', 'S' or 'N', is now '-'
1006  rather than blank. This will ensure that each column in the results
1007  file has something in it.
1008
1009* The configure script is somewhat more robust to non-standard
1010  systems, particularly when the X11 libraries are in unusual
1011  places. It can also deal with the slightly different way that
1012  wcslib-4.3 installs itself.
1013
1014* The installation part of the Makefile was altered so that the
1015  symbolic link Duchamp that points to Duchamp-1.1.7 does not have the
1016  absolute path encoded in it. This will enable the files to be moved
1017  around at a later date.
1018
1019Bug Fixes:
1020
1021* Fixed a bug that caused problems when the flux units were less than
1022  5 characters long (e.g. 'K')
1023
1024* The new velocity width values were not getting proper headers in the
1025  VOTable output. This has been remedied.
1026
1027* Minor improvements to help non-pgplot use
1028
1029* Minor fix in WCS functionality.
1030
1031* Minor fixes to the FitsHeader class.
1032
1033* Improved FITS data reading, that doesn't require a nullarray
1034  array. This will reduce memory usage.
1035
1036* Improved subsection parsing, particularly for non-standard WCS
1037  systems.
1038
1039* Improving the memory allocation of the Cube class.
1040
1041* Fixed a bug that meant the growthThreshold values were sometimes
1042  being lost.
1043
1044* Improving the way the growing and merging is done, particularly in
1045  the case of non-adjacent merging.
1046
1047* Fixed a scaling bug in the GaussSmooth function.
1048
1049Other:
1050
1051* Numerous changes to the code that do not affect how Duchamp itself
1052  runs, but were necessary for code development with the Duchamp
1053  libraries (primarily as a part of the ASKAP code development).
1054
1055
1056Duchamp version 1.1.6 (2008/09/08)
1057----------------------------------
1058
1059New features:
1060
1061* The velocity widths can now be quoted in two additional ways: the
1062  full width at 50% of the peak flux (ie. the FWHM) and the full width
1063  at 20% of the peak flux (w_50 and w_20 respectively). The w_50
1064  parameter is now quoted in the results printed to the screen
1065  (instead of w_VEL), but all three are written to the results file.
1066
1067* The facility now exists to bypass the searching step and go straight
1068  to the output stage using a list of previously detected objects. The
1069  list is extracted from a previously-created log file. The user can
1070  change the way the spectra are plotted (e.g. choose to plot
1071  integrated rather than peak spectra), and select a subset of the
1072  detected objects to be printed to individual postscript files. Use
1073  the input parameter usePrevious (set to true) to use this facility,
1074  and provide a list of objects using the objectList parameter
1075  (eg. 1,2,4,7-10,15)
1076
1077* A new parameter "growthThreshold" has been created, that goes with
1078  "threshold". If you manually specify a threshold, and you wish to
1079  grow detections, you need to manually specify a growthThreshold (in
1080  flux units).
1081
1082Bug fixes:
1083
1084* Cubes that do not have a spectral axis (such as Stokes cubes) were
1085  causing memory leaks and crashing, due to some assumptions of the
1086  existence of the spectral axis. These bugs have been fixed, so that
1087  Duchamp will run on such cubes, although the WCS transforms may not
1088  always work appropriately. Please let me know via bug reports of
1089  difficulties you encounter!
1090
1091* The growing function has had a few bugs fixed and is now more
1092  efficient.
1093
1094* The FDR method was previously overriding any manually-specified
1095  threshold. This has been fixed so that if the user specifies
1096  threshold=X, then the FDR method is not called.
1097
1098* Some undefined things were happening with textual output when no
1099  objects were detected. This has been fixed.
1100
1101* Memory leaks caused by FITS WCS irregularities have been fixed
1102  (specifically, if a FITS header had NAXIS=2 but more than two WCS
1103  axes were defined).
1104
1105
1106
1107Duchamp version 1.1.5 (2008/03/20)
1108----------------------------------
1109
1110Bug fixes:
1111* A major bug was discovered in the calculation of integrated
1112  fluxes. The flux was incorrectly being weighted by the spatial size
1113  of the detection, resulting in a (often considerable) overestimation
1114  of the integrated flux. This has been corrected.
1115
1116* The beam size calculation was also incorrect, being out by a factor
1117  of 1/ln(2).
1118
1119* The "make install" command previously failed to work properly if the
1120  library had not been created. This has been fixed so that the
1121  installation works even if there is no library file.
1122
1123New Features:
1124* You can now provide a new flux unit string, so that the pixel fluxes
1125  will be converted to these new fluxes before any calculations are
1126  done. This is done with the newFluxUnits input parameter. The new
1127  units should be directly convertible from the old ones (given by the
1128  BUNIT header -- e.g. if BUNIT = Jy/beam, you can give newFluxUnits
1129  as mJy/beam, but not mJy).
1130
1131* You can now specify the precision used in the output files for flux,
1132  velocity and S/N ratio columns, via new input parameters precFlux,
1133  precVel and precSNR. These will apply to the VOTable output as well
1134  as the text table and information on the spectral plots.
1135
1136* The Karma annotation files previously provided just a circle at the
1137  spatial location of the detected object. You now have the option to
1138  draw a border around the detected pixels (in a similar manner to the
1139  PGPLOT moment maps). Karma does not do this perfectly, so the lines
1140  may not line up exactly with the pixel borders, so the option
1141  remains to keep using the circles. This is controlled by the
1142  parameter "annotationType", with possible options being "borders"
1143  (the default) or "circles".
1144
1145* There is a new function getMetadata() that loads the header and WCS
1146  data, but no pixel information. This is only of interest if you are
1147  doing code development with the Duchamp library -- it does not
1148  affect the running of Duchamp itself.
1149
1150Duchamp version 1.1.4 (2008/02/15)
1151----------------------------------
1152
1153Most of the changes incorporated in this update result from ASKAP code
1154development (that makes use of some of the Duchamp functionality),
1155but do not actually affect the way Duchamp runs (other than, in a
1156couple of cases, making it a bit faster). Changes that are
1157relevant for regular users of Duchamp are as follows:
1158
1159* A new option has been made available (thanks to Mary Putman et al
1160  for the suggestion!) to save the spectra of all detected objects in
1161  a text file. This has the form of one column for the spectral
1162  coordinates and one column of fluxes for each object. This is
1163  enabled by the input parameters flagTextSpectra and spectraTextFile.
1164
1165* Slight changes to the output include he formatting of the way the
1166  detected objects are written to the log file. This meant the
1167  verification files were also updated. Also the cube statistics are
1168  not printed to the results file if a user threshold is specified (as
1169  they are not calculated!).
1170
1171* The determination of beam size has been made more reliable, as has
1172  the BUNIT determination.
1173
1174* Fixed a bug that meant source merging was not done for 2D images
1175  (not usually a problem, as the source-finding takes care of this,
1176  but came up in parallelisation development).
1177
1178Duchamp version 1.1.3 (2008/01/08)
1179----------------------------------
1180
1181A minor update that just improves the build process. The location of
1182the wcslib include files was not specified correctly, so that some
1183machines were unable to find them. The configure script has been fixed
1184so that the compilation should work in all cases.
1185
1186Some minor changes have also been made to the code in the PixelMap
1187directory, and to param.cc, to fix warnings or errors that may appear
1188in compilation.
1189
1190However, there are no changes to the actual workings of the code in
1191this minor version, so if you have a working version of Duchamp 1.1.2
1192there is probably no reason to update.
1193
1194Duchamp version 1.1.2 (2007/12/07)
1195----------------------------------
1196
1197Compilation:
1198
1199* The compilation had problems working correctly when the cfitsio and
1200  wcs libraries were not in standard locations. The configure script
1201  has been tweaked to make sure the libraries are found.
1202
1203* Problems with compiling in the absence of pgplot have been fixed,
1204  and it should now compile fine.
1205
1206* Improved the configure script for use with Mac OS X and gfortran.
1207
1208
1209Bugfixing:
1210
1211* A major problem with the text-based output was fixed. The widths of
1212  the columns were not being calculated correctly, and were running
1213  together. This should no longer be the case.
1214
1215* There was a bug in the way Duchamp interpreted spectral axes,
1216  particularly AIPS types such as FELO-HEL, leading to incorrect
1217  scaling of the velocity axis. This has been fixed, so that
1218  non-standard types are now dealt with appropriately and the velocity
1219  scaling should be accurate.
1220
1221* Another bug meant the beam correction was always applied to the
1222  integrated spectra, regardless of whether the flux units involved
1223  the beam (e.g. Jy/beam). This has been fixed. Note that the values
1224  of the integrated flux presented in the results table were always
1225  calculated correctly.
1226
1227* Other minor changes to improve the speed and efficiency, especially
1228  of the merging code.
1229
1230New user parameters:
1231
1232* There is now the possibility to save a FITS file that contains a
1233  mask array, indicating where the detected objects are. This is
1234  governed by the flagOutputMask parameter.
1235
1236* The header information that is printed at the start of the results
1237  file -- that is, the list of parameters, the statistics of the cube,
1238  and the number of detections -- can now be written to a separate
1239  file. Set the flagSeparateHeader parameter to true or 1 and it will
1240  go to the file indicated by the headerFile parameter (the default is
1241  duchamp-Results.hdr).
1242
1243* A "scaleMax" parameter has been added, so that the wavelet
1244  reconstruction can include only a specified range of scales (for
1245  instance, if one wants to search just for narrow features such as
1246  absorption lines).
1247
1248* A "flagRobustStats" parameter has been added. This allows the user
1249  to elect to use robust statistics (median and median absolute
1250  deviation from the median) to estimate the noise parameters. If set
1251  to false, the mean and standard deviation will be used. The default
1252  value is true.
1253
1254New Feature:
1255
1256* When Duchamp is run on a 2D image (i.e. with no spectral output), it
1257  now produces a postscript file that shows information each
1258  individual source plus the image cutout of the source. This is
1259  similar to the spectral output file, but without the spectra. The
1260  filename is given by the spectraFile parameter.
1261
1262* Ability to save a FITS file containing a mask array, with pixel
1263  values of 1 for pixels in a detected object, and 0 elsewhere.
1264
1265
1266Duchamp version 1.1.1 (2007/07/20)
1267------------------------------------
1268
1269Minor update to the release, with just a few changes:
1270
1271* The verification script was generating diffs due to differences in
1272  the precision of some calculations when done on different machines.
1273  One of these was the integrated flux, and this has been corrected so
1274  that the same value should appear on all machines.
1275  The verification script has also changed so that just the number of
1276  sources and their positions are tested, as well as the
1277  logfiles. This should avoid the reporting of spurious differences.
1278
1279* The grey-scale used in the image cutouts (in the spectral plots) has
1280  been inverted. This makes it consistent with the scale used in the
1281  maps, and hopefully easier to see when printing.
1282
1283* The configure/make system has been altered to make it easier to
1284  install, and to specify different external libraries. In particular,
1285  it is now not necessary to have PGPLOT installed on your system to
1286  run Duchamp. In the absence of PGPLOT, Duchamp will run as normal,
1287  just without any graphical output. Some source code needed to be
1288  restructured to make this work. Please read the README file, or the
1289  Installation appendix in the User's Guide, for complete details.
1290
1291* The time of completion is now written to the log file, so that the
1292  user can have some idea of how long the program took.
1293
1294
1295Duchamp version 1.1 (2007/05/17)
1296------------------------------------
1297
1298Changes made since the last numbered release:
1299
1300EFFICIENCY OF EXECUTION:
1301
1302* Major change to the way detections are stored. They are now recorded
1303  via run-length encoding in the x-y plane, and stored as collections
1304  of channel-maps. This improves the memory usage and the speed of
1305  execution (particularly for routines such as the merging
1306  routines). The memory usage has also been improved by changing the
1307  way the list of detected objects is stored.
1308
1309SMOOTHING:
1310
1311* Addition of ability to spatially smooth the cube before
1312  searching. This is done with a Gaussian kernel, the size and shape
1313  of which can be specified by the user, using the parameters kernMaj
1314  & kernMin (which are the FWHM for the major & minor axes -- if
1315  kernMin is not given it is assumed to match kernMaj) and kernPA (the
1316  position angle of the major axis).  There is a new parameter
1317  smoothType that distinguishes this method from the spectral (Hanning)
1318  smoothing already in use.
1319
1320DETECTIONS:
1321
1322* Changed the way detection is done -- now only search in 2D images,
1323  keeping all detections (ie. no minimum-pixel requirement). This
1324  should be the same as doing both the 1D and 2D searches with the
1325  minimum pixel requirement in, but simpler. The rejection is done at
1326  the end after all the merging and growing has been done. This leads
1327  to a larger number of intermediate detections (ie.  the number
1328  before merging), which may increase the run-time slightly, although
1329  this is offset by the changes to the efficiency (see above).
1330
1331* Increased the range over which objects can be grown to match the
1332  threshSpatial & threshVelocity parameters, as well as rejecting new
1333  pixels based on the BLANK and MW tests.
1334
1335INPUTS:
1336
1337* There has been a subtle change in the way BLANK pixels are dealt
1338  with. To enable trimming of BLANK pixels, users should use the new
1339  parameter flagTrim. The parameters flagBlankPix and blankPixVal are
1340  no longer accessible via the parameter file -- warning messages are
1341  given if they are provided in the parameter file.
1342
1343* Added ability to specify a statsec, so that the statistics are only
1344  calculated from a given subsection of the cube, rather than the full
1345  cube.
1346
1347* The subsections can also specify the ability to remove a border of n
1348  pixels from the edges of an axis (ie. n from the start and from the
1349  end) -- as requested in Trac ticket #5.
1350
1351* Changed the default value of the reconDim parameter from 3 to 1, and
1352  the default value of the flagATrous parameter to false.
1353
1354OUTPUTS:
1355
1356* The output now includes three different estimates of the "centre" of
1357  the detection: peak location, centroid (flux-weighted), or average.
1358
1359* Some slight improvements to the user feedback during execution.
1360
1361* Spectral output now includes the baseline, if one was fitted. The
1362  format of the plot headers is slightly changed, to stop information
1363  falling off the edge of the page.
1364
1365* Added command-line option -x to directly disable the PGPLOT X-window
1366  map plotting. This overrides the setting of flagXOutput in the
1367  parameter file.
1368
1369* Fallback spectral units (in case the FITS header fails to record
1370  them) changed to SPC, but code has been fixed so that any problem
1371  should be caught before this becomes an issue.
1372
1373BUGFIXES:
1374
1375* Fixed bug (Trac ticket #4) that meant the velocity units were not
1376  correctly dealt with. Duchamp should be more robust for different
1377  velocity axis setups now.
1378
1379* Fixed bug (ticket #9) with the VOTable output, where the tags were
1380  not closing.
1381
1382* Fixed a bug that meant the integrated fluxes were not calculated
1383  properly -- no allowance was made for the number of spatial
1384  pixels. This should also work properly for 2D images now as well.
1385
1386* Fixed minor bug in calculating the flux threshold from the p-value
1387  threshold when the FDR method is used. This did not affect the
1388  actual thresholding, merely the quoted flux threshold in the results
1389  file. Also, the MW channels are kept out of the p-value threshold
1390  determination if they are being flagged.
1391
1392
1393
1394Duchamp version 1.0.7 (2006/11/22)
1395----------------------------------
1396
1397One new feature, and some improvements and bug-fixes.
1398
1399* The user can now elect to Hanning-smooth the spectral direction of
1400  the cube before the searching is done. This can be done instead of the
1401  wavelet reconstruction (although if both are selected, the
1402  reconstruction takes precendence). This functionality is switched on
1403  and off by the flagSmooth parameter, and the width of the Hanning
1404  kernel is governed by the hanningWidth parameter.
1405
1406* The smoothed array can also be written to a FITS file and read in at
1407  the start in the same manner as the reconstructed array.
1408
1409* Several improvements have been made to the memory
1410  management. Several memory leaks were fixed, and the memory usage of
1411  Duchamp is considerably less, which will be a help for running it on
1412  large cubes. The speed of some routines has also been improved, by
1413  removing unnecessarily repetitive loops.
1414
1415* The sorting routines have been changed, and should now be slightly quicker
1416  (and a bit more robust).
1417
1418* Enabled the scale bar (plotted on the 0th moment map in the spectral
1419  output file) to be able to deal with much finer spatial scales (as
1420  may be expected from VLBI data).
1421
1422* Other minor changes to code and presentation.
1423
1424
1425Duchamp version 1.0.6 (2006/11/01)
1426----------------------------------
1427
1428Some incremental improvements and changes to the code:
1429
1430* The statistics used for the detection are now calculated once for
1431  the entire cube, rather than being calculated separately for each
1432  channel map and spectrum. This results in a uniform threshold value
1433  across the entire cube. The way the statistics calculations are
1434  implemented in the code was changed, using a new statistics class.
1435
1436* This means we can report a peak signal-to-noise value for each
1437  detection. This is given in the text-based output, as well as in the
1438  summary information above the spectral output for each source.
1439
1440* The user can now elect not to have the moment map displayed in a
1441  PGPlot window, through the use of the new flagXOutput
1442  parameter. This should help in cases of running Duchamp on a dumb
1443  terminal (with no X-display capabilities), or as part of a batch
1444  script where the continual popping-up of the PGPlot window might
1445  become annoying.
1446
1447* There are different Flags reported for the case of an object lying on
1448  the spatial edge and spectral edge of the cube (E and S respectively).
1449
1450* A few minor bug fixes:
1451  - When providing a subsection, any axes with the range given by *
1452    had the pixel values offset incorrectly. This has been fixed.
1453  - Negative searches now correctly invert the reconstructed array
1454    when it is read in from a file.
1455
1456* Other minor changes to the code, to improve memory handling and
1457  remove redundant arrays and variables.
1458
1459
1460Duchamp version 1.0.5 (2006/09/06)
1461----------------------------------
1462
1463Since version 1.0, there have been a range of mostly minor
1464changes. These are generally bug-fixes, thanks to feedback from a
1465number of users, as well as a few extra features.
1466
1467Here is a summary of the changes since version 1.0:
1468
1469USER INTERFACE:
1470
1471* The user is now able to enter the value of flag parameters in the
1472  parameter file as strings, as well as integers (so one can enter
1473  true or 1 to give the same result).
1474
1475GRAPHICAL OUTPUT:
1476
1477* Added a new function that draws the edge of the blank region on the
1478  maps and image cutouts. There is a new flag parameter --
1479  drawBlankEdges -- that controls the use of this function (the
1480  default is true).
1481  Also, the edge of the field is plotted on the image cutouts as a
1482  yellow line. This distinguishes it from the purple blank pixel
1483  dividing line.
1484
1485* The size of the tick mark in the image cutout (indicating the
1486  spatial scale of the image) is now adaptable, so that it shows the
1487  scale that best fits the image (ranging from 1 arcsec to 15
1488  degrees). (This is a change from the previous standard length of 15
1489  arcmin.)
1490
1491* The zoomed spectrum had its flux scale determined by all points in
1492  the zoom box,including those flagged by the Milky Way (MW)
1493  range. This has been fixed so that any MW channels will not affect
1494  the flux scaling, potentially improving the appearance of objects
1495  detected close in velocity to strong MW emission or absorption.
1496
1497* Improved Karma Annotation file output, so that files without good
1498  WCS are dealt with appropriately.
1499
1500TEXT-BASED OUTPUT:
1501
1502* The position resolution in the IAU-format names has been increased,
1503  so that distinct objects close to one another are more readily
1504  distinguished.  Overlapping sources at different velocities may
1505  still have the same name, but this is a more general problem.
1506
1507* The presentation of the results in tabular format has been improved,
1508  so that the precision of faint sources is sufficient to show their
1509  flux, for instance, is not 0. This also applies to the information
1510  presented above the spectral plots.
1511
1512* Improved error and warning reporting, so that the formatting and
1513  presentation of information is clearer.
1514
1515FITS I/O RELATED:
1516
1517* The previous version was did not deal well with 4 (or greater)
1518  dimensions in the FITS file -- the memory allocation was badly done,
1519  and the axes needed to be in a particular order. This has been
1520  fixed, so that the FITS I/O routines can now handle any sized FITS
1521  file, with axes in any order (as long as there are two spatial and one
1522  spectral axes).
1523
1524* When the FITS file does not have a rest frequency defined, there is
1525  no way to transform the frequency axis into velocity. In this case,
1526  the spectral axis is left as frequency, and put into units of MHz.
1527
1528* If the beam size is not indicated by the FITS header (through the
1529  BMAJ and BMIN keywords), the user can manually specify the size
1530  through the parameter file (using parameter beamSize).
1531
1532* The FITS I/O routines make use of the command fits_file_exists. This
1533  was introduced into the CFITSIO package from version 2.5, so Duchamp
1534  will only work with this version or higher. Version 3+ is preferred.
1535
1536OTHER BUG-FIXING:
1537
1538* Several bugs related to the blank-pixels were dealt with.
1539  The correct values were not propagating through correctly, meaning
1540  that the default values were being used. Also, there was the
1541  potential for blank pixels to be detected when the FDR method was
1542  used. Finally, the image cutout displays occasionally did not
1543  obscure the blank pixels. All these problems should be fixed now.
1544
1545* The FDR setup routine was occasionally failing with a segmentation
1546  fault, due to it accessing unallocated memory. This has been fixed.
1547
1548* Fixed bugs that affected the way 2D images (rather than 3D cubes)
1549  were dealt with. The minChannels test failed when minChannels=0.
1550
1551* If there is no beam information in the FITS header, the user can now
1552  enter a beam size as a parameter.
1553
1554* Other minor fixes to the code, to improve its structure and
1555  robustness.
1556
1557
1558Duchamp version 1.0 (2006/06/30)
1559--------------------------------
1560
1561The first full release version.
1562
1563Several major changes compared to previous version:
1564
1565* Incorporated a FitsHeader class, to keep track of header information
1566  (including WCS) from the FITS file. All units-related calculations
1567  are done with this class, such as conversion to velocity, and
1568  pixel-to-WCS conversion.  The main advantage of this is improved
1569  speed of execution, more adaptable to different units, and improved
1570  code (easier for me!).
1571
1572* Able to select the dimensionality of the reconstruction, rather than
1573  just doing it in 3-D.
1574
1575* Robust text output, so that the columns are sized correctly given
1576  the data being written, and the relevant units (derived from the
1577  FITS header) are included in the output table.
1578
1579* Improved the way the reconstructed image is saved and read back in,
1580  with a better naming scheme and a better set of new FITS header
1581  keywords. The MW headers are now not written.
1582
1583Other, more minor changes include:
1584
1585* MW channels now not set to 0, but just ignored for searching
1586  purposes (and for the scaling of the spectral output -- they are
1587  plotted though and highlighted with a hashed box).
1588
1589* The scale bar in the moment map in the spectral output file has its
1590  length indicated.
1591
1592* Improved VOTable output, with more information about the way Duchamp
1593  was run.
1594
1595* Made sure all statistics calculations in the reconstruction are
1596  based on robust (ie. median) methods.
1597
1598Also moved to an autoconf based configure/make compilation, for ease of use.
1599
1600
1601Duchamp version 0.9.2 (2006/06/27)
1602--------------------------------
1603
1604* Added the use of warning flags for detections: for either edge
1605  location or negative enclosed flux.
1606
1607* A new command line option added so that the user can specify a FITS
1608  file to be searched with the default parameters, rather than giving
1609  a full parameter file.
1610
1611* The scale bar on the moment cutout now works in general case, using
1612  an iterative process to get to the correct length.
1613
1614* RA axes are now done correctly on the full-scale maps.
1615
1616* Various coding fixes, improving the readability of the code,
1617  particularly regarding the declaration of temporary variables.
1618
1619* Changed the way the time of execution is called : now using time.h
1620  functions, rather than a system call.
1621
1622* Changed output in Detection/outputDetection.cc for the pixel
1623  information of detected objects (the info printed above the spectral
1624  plots) -- now print out number of voxels in object, and have
1625  improved the formatting a little.
1626
1627* Improved the functionality of saving the FITS file containing the
1628  reconstructed array. Added ability to save and read back in the MW
1629  parameters when saving a reconstructed cube (if a reconstructed cube
1630  has different MW range to that being considered, it would cause
1631  problems). ReadRecon now just returns a FAILURE and will reconstruct
1632  the cube anew.
1633
1634* Changed default value of flagGrowth to 0.
1635
1636
1637
1638Duchamp version 0.9 (2006/05/05)
1639--------------------------------
1640
1641First public release version.
Note: See TracBrowser for help on using the repository browser.