-
Notifications
You must be signed in to change notification settings - Fork 16
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding FoV detection, improved groundscatter flag #135
Comments
Can this be prototyped in python first? The python tools I started would make this way easier to start with since they can basically write any python dictionary to dmap. |
If we have something finalized it would make it much more easy to translate this into RST. |
I have the fov code in davitpy already. The Ribiero-like reflagging doesn't work well in python (thanks to the depth-first search), but I have C code that works and has run on about 4 years of data so far. Right now this all works by outputting ascii files. |
Sounds good. Well I definitely think we should figure out the scope of work and decide on the best of course of action from there! @egthomas will definitely know more about judging the scope of work of adding a feature to make_grid. |
@aburrell - so these will basically be files that contain all of the same information as a normal fit/fitacf file, but also some additional information about front/rear FOV and a more accurate ground scatter determination? From working with the map files, we found it is not very difficult to add new data fields to dmap-format files. Maybe we could do something similar by adding additional data fields to the fit/fitacf format files? For example, upon creation with make_fit those fields would be empty, but after running your post-processing software those fields would be populated? There is already some precedent for this with the An alternative would be to take the |
Sorry, we wouldn't be adding new fields to fit-format files, only the fitacf (dmap) format files. |
I prefer the first option as well. From what I remember we'd need to add a FoV flag and decide whether or not to keep the old elevation angle. The groundscatter flag would have a new possible value, but the old values would mean the same thing and existing code should not be affected. |
Another thing to keep in mind is whether we want this code to be operational in real-time or not. I know how I'd like to structure the processing, but haven't needed it and so haven't mocked it up. |
When you say operational in real-time, do you mean at the radar site? Or something that can be located off-site and takes the real-time fitacf-type data stream as input (ie http://superdarn.ca/real-time-display)? |
Something that can be located off-site and take real-time fitacf-type data as input. |
Do you see this being valuable for the realtime display or do you have some other realtime process you'd like to run? |
When I presented this algorithm at the Royal Astronomical Society special meeting (2016), one of the questions was whether it was possible to run in real time or not. So, I assume there is some interest in having this available. I don't need it yet; I'm still stuck in the 23rd solar cycle. |
If the underlying algorithm is implemented in an RST library then it should be fairly straightforward to write top-level binaries which can handle either a standard fitacf file or the real-time fitacf data stream as input. |
Apologies for trailing behind -- I am in Australia right now... |
An elevation quality indicator is a good idea. However, you can run both of these methods without calibrated elevation angles. In both cases, the results are usable but not quite as good:
|
Ok, I am actively working on this, and need to implement the MINPACK least-squares fitting routine as a part of one of the subroutines. I have been looking at |
I would like to add my automated field of view (FoV) detection and improved groundscatter flagging to RST. This won’t be simple, since we’ll need an “after fitacf, before grd” file as output that the make_grd routines can read. Would anyone be interested in helping this development and/or determining what these new files should look like and be called?
references: http://dx.doi.org/10.1002/2015RS005808, and another RS paper that's still under review or any of my conference presentations in the last year.
The text was updated successfully, but these errors were encountered: