Jump to: navigation, search

persistent flagging using MIS

The flagging file, by convention, is called mis.uvflag. It will be applied by do_uvflag, and you can select anything else but the default via vis=. This flagging file is a small text file that can have everything but the uvflag vis=... flagval=flag in it, line by line applied by different calls to uvflag. Here is an example


for cx323.1E_89NGC133.20 in this case. Once you have edited this file, add it to the pipefile persistency list, e.g.

  pipepar pipefile=mis.uvflag

and make sure it's saved within $MIS/def:


Of course after this, you still need to "cvs ci" all your projects under $MIS/def and/or make sure you team mates didn't conflict with your changes. You can potentially use the "mis -u" and "mis -q" and "mis -c" commands for this, if you can do it with those CVS shortcuts.

CAVEAT: since the rawdata parameter could potentially point to a location that is uniq to each site, saving them in CVS can lead to annoying differences which are really no differences.

In the current pipeline, dp_uvflag is automatically called by do_uvcat1 and do_uvcatSD and applied to the uvdata and sddata resp.

setting up MIS pipelines

When you start with a completely clean directory, absolutely nothing in it, the first thing you will need is to create a set of project directories (we use the convention where they are the trial names, e.g. cx323.1E_89NGC133.20) in which each dataset is reduced. This can most easily be done with the piperun command:

  piperun -c -o pipesetup.log $MIS/cat/n1333.lis 'pipepar -c ; pipesetup project=%s'

You can then take any of the pre-defined example pipelines and run them:

  pipeline $MIS/cat/pipefile.002 > $MIS/cat/Pipefile
  piperun -o pipe.002.log $MIS/cat/n1333.lis 'pipe clean all'

For example, the current single dish pipeline for the E array takes about 15 mins, for calibration of interferometry about 6 minutes.

Alternatively you can test a pipeline manually:

  pipeline 3 do_uvcat1 do_inspect1 do_cal1 > $MIS/cat/Pipefile
  piperun -o pipe.log $MIS/cat/n1333.lis 'pipe clean all'

which is really the same as running them manually

  piperun $MIS/cat/n1333.lis do_uvcat1
  piperun $MIS/cat/n1333.lis do_inspect1
  piperun $MIS/cat/n1333.lis do_cal1
Personal tools