Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AM Miscellaneous fixes to mimic Sundew behaviour #980

Open
andreleblanc11 opened this issue Mar 18, 2024 · 5 comments
Open

AM Miscellaneous fixes to mimic Sundew behaviour #980

andreleblanc11 opened this issue Mar 18, 2024 · 5 comments
Assignees
Labels
bug Something isn't working ReliabilityRecovery improve behaviour in failure situations. v3only Only affects v3 branches.

Comments

@andreleblanc11
Copy link
Member

Place holder for all small fixes made to flowcb/gather/am.py or bulletin.py. These were mostly all picked up by my auditing script, comparing with the old NCP nodes.

Fixes made so far in PRs

Reject float types for Julian day value in getTime : #979
Add missing tokIsYear method from Sundew. Prevents some erronous bulletins not being filtered. : #973
Add fix to handle improperly parsed station names from getStation : #963
Properly handle trailing spaces at end of bulletin headers : #956
Move AM renamer to gather. Allows us to properly use sundew variable expansions. : #952
Lots of AM corrections (Renamer + AHL corrections in gather) : #946

@andreleblanc11 andreleblanc11 self-assigned this Mar 18, 2024
@andreleblanc11 andreleblanc11 added v3 issue deferred to or affects version 3 v3only Only affects v3 branches. bug Something isn't working and removed v3 issue deferred to or affects version 3 labels Mar 18, 2024
@andreleblanc11 andreleblanc11 added the likely-fixed likely fix is in the repository, success not confirmed yet. label Apr 3, 2024
@andreleblanc11
Copy link
Member Author

With #997 's fix that got pushed last week, I'm hoping that those were the final changes to AM before NCP move.

There hasn't been any Sundew compatible bugs found for about two weeks now.

@petersilva petersilva added the ReliabilityRecovery improve behaviour in failure situations. label Apr 15, 2024
@andreleblanc11 andreleblanc11 removed the likely-fixed likely fix is in the repository, success not confirmed yet. label Apr 22, 2024
@andreleblanc11
Copy link
Member Author

Found another bug. A BBB entry in the header was wrong and sr3 didn't filter it out like Sundew.

Sundew has a method that does this and more to verify the header. This should be likely added to sr3 -> https://github.com/MetPX/Sundew/blob/main/lib/bulletin.py#L601-L671

Not urgent. The sundew receiver downstream was able to filter the problem out so clients won't notice.

@petersilva
Copy link
Contributor

petersilva commented Apr 22, 2024

BBB is OK, and should make it through... it depends on which header... I would only filter out invalid revision codes "AMENDMENT" is clearly wrong, but AMD, AAA, BBB, COR, are all OK.

UPDATE: nvmd... I understand you were referring to the header in general now, my bad.

andreleblanc11 added a commit that referenced this issue May 14, 2024
… bug while fixing previous bug. Didn't cause any data loss.
@andreleblanc11
Copy link
Member Author

Need a patch for MetPX/Sundew#20

andreleblanc11 added a commit that referenced this issue May 22, 2024
…r bug while fixing previous bug. Didn't cause any data loss.
andreleblanc11 added a commit that referenced this issue May 23, 2024
…ion Mapping conditions, correct verifyHeader bug, add unit test coverage
andreleblanc11 added a commit that referenced this issue May 23, 2024
…ion Mapping conditions, correct verifyHeader bug, add unit test coverage
petersilva added a commit that referenced this issue May 27, 2024
#980 Expand scope of isProblem.
@andreleblanc11
Copy link
Member Author

Take note of MetPX/sr_insects#43 (comment)

  • Some american bulletins *KWAL* and canadian SACN[34]* bulletins are failing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working ReliabilityRecovery improve behaviour in failure situations. v3only Only affects v3 branches.
Projects
None yet
Development

No branches or pull requests

2 participants