| 24 | | * Note that we need to include the project_id. |
| 25 | | * '''20080204''': script is working. Waiting for removal of "bad" data files from the storage disks before running again. |
| 26 | | * [MW, LK] The tables in the database have duplicate entries for some CPSR2 data, showing the data files in the directory with pulsar name (eg. /pulsar/archive10/CPSR2/J2330-2005) and the symbolic links to those same files in the scrunched directory (eg. /pulsar/archive10/CPSR2/J2330-2005S). It would be good to get rid of these -- this will need to be done either by removing the symbolic links (can this be done in the scrunching scripts?) or tinkering with the find_archives.pl script to ignore the *S directories. |
| 27 | | * Update 20071213 -- The files with *S directories have been removed from the updated tables in the database, so they won't appear in the query results. This is a temporary fix that won't apply when the find_archives.pl script is running again, so it needs to be able to avoid them. |
| | 23 | * ~~ Note that we need to include the project_id.~~ project ID part of `vap` output. |
| | 24 | * '''20080204''': script is working. Waiting for removal of "bad" data files from the storage disks, as well as new format for CPSR2 data [GH, DM] before running again. #31 |
| | 25 | |
| | 26 | '''Web Archive''' |
| | 27 | * [MW, AK] Need to enable OPAL-style authentication. #40, #42 |
| | 28 | * The code is there, but need to have an Oracle driver installed. Have not been able to check this yet. |
| | 29 | * Also enable anonymous access for non-proprietry data. |
| | 30 | * [MW, AK] Also enable checking of project IDs to enable/deny access accordingly. #38 |
| | 31 | * [MW] Fix minor issues with conesearch, and register the conesearch with a VO registry (see notes on WebQuery). #25, #39, #41 |
| | 32 | * [DS] Enable logging of queries and downloads, so we know what is happening with the archive. #37 |
| | 33 | * [DS] Enable query parameters to be modified without having to restart the query page from scratch. #36 |
| | 34 | * [VM, MW, ?] Make webpage live. #43 |
| | 35 | * [MW] Write up a "Project Book": a guide to the archive & web pages, for use by future developers. #44 |
| | 36 | |
| | 37 | * There was a suggestion from the GW meeting (Dec 13) that the option of downloading scruched data be offered, perhaps with user-selectable parameters. This may be future work beyond the scope of the current project. |
| | 38 | ---- |
| | 39 | |
| | 40 | === Old tasks, mostly complete but kept for reference === |
| | 41 | |
| | 42 | '''Data''' |
| | 43 | * ~~ [MW, LK] The tables in the database have duplicate entries for some CPSR2 data, showing the data files in the directory with pulsar name (eg. /pulsar/archive10/CPSR2/J2330-2005) and the symbolic links to those same files in the scrunched directory (eg. /pulsar/archive10/CPSR2/J2330-2005S). It would be good to get rid of these -- this will need to be done either by removing the symbolic links (can this be done in the scrunching scripts?) or tinkering with the find_archives.pl script to ignore the *S directories. ~~ |
| | 44 | * ~~ Update 20071213 -- The files with *S directories have been removed from the updated tables in the database, so they won't appear in the query results. This is a temporary fix that won't apply when the find_archives.pl script is running again, so it needs to be able to avoid them. ~~ |
| 31 | | '''Web Archive''' |
| 32 | | * [MW, AK] Need to enable OPAL-style authentication. |
| 33 | | * The code is there, but need to have an Oracle driver installed. Have not been able to check this yet. |
| 34 | | * [MW, AK] Also enable checking of project IDs to enable/deny access accordingly. |
| 35 | | * [MW] Register the conesearch with a VO registry (see notes on WebQuery). |
| 36 | | * Make webpage live. |
| 37 | | * [MW] Write up a guide to the archive & web pages, for use by future developers. |
| 38 | | * There was a suggestion from the GW meeting (Dec 13) that the option of downloading scruched data be offered, perhaps with user-selectable parameters. This may be future work beyond the scope of the current project. |
| | 48 | '''Web archive''' |
