Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error generation end2end test data for calibration spectra #306

Open
samaloney opened this issue Jan 19, 2023 · 2 comments
Open

Error generation end2end test data for calibration spectra #306

samaloney opened this issue Jan 19, 2023 · 2 comments

Comments

@samaloney
Copy link
Collaborator

samaloney commented Jan 19, 2023

The script to generate the data used for end2end testing is showing an error but not failing so we should fix the error and maybe fail the test on any error?

2023-01-18T14:10:59Z ERROR stixcore.processing.LBtoL0 91: Error processing file /private/var/folders/r1/6cz6bl3156s18tp0wqggp6mc0000gn/T/pytest-of-shane/pytest-51/LB/21/6/41/solo_LB_stix-21-6-41_0678240000_V01.fits for 21, 6, 41
Traceback (most recent call last):
  File "/Users/shane/Projects/STIX/STIXCore/stixcore/processing/LBtoL0.py", line 86, in process_tm_type
    level0 = tmp.from_levelb(levelb, parent=file.name)
  File "/Users/shane/Projects/STIX/STIXCore/stixcore/products/level0/quicklookL0.py", line 623, in from_levelb
    counts_rebinned = rebin_proportional(np.hstack(cur_counts), cin, c_out)
  File "/Users/shane/Projects/STIX/STIXCore/stixcore/products/common.py", line 252, in rebin_proportional
    start = cum_sum[np.ceil(i_place[:-1]).astype(int)]
IndexError: index 26 is out of bounds for axis 0 with size 26
2023-01-18T14:10:59Z ERROR stixcore.processing.LBtoL0 91: Error processing file /private/var/folders/r1/6cz6bl3156s18tp0wqggp6mc0000gn/T/pytest-of-shane/pytest-51/LB/21/6/41/solo_LB_stix-21-6-41_0678240000_V01.fits for 21, 6, 41
Traceback (most recent call last):
  File "/Users/shane/Projects/STIX/STIXCore/stixcore/processing/LBtoL0.py", line 86, in process_tm_type
    level0 = tmp.from_levelb(levelb, parent=file.name)
  File "/Users/shane/Projects/STIX/STIXCore/stixcore/products/level0/quicklookL0.py", line 623, in from_levelb
    counts_rebinned = rebin_proportional(np.hstack(cur_counts), cin, c_out)
  File "/Users/shane/Projects/STIX/STIXCore/stixcore/products/common.py", line 252, in rebin_proportional
    start = cum_sum[np.ceil(i_place[:-1]).astype(int)]
IndexError: index 26 is out of bounds for axis 0 with size 26
2023-01-18T14:10:59Z ERROR stixcore.processing.LBtoL0 93: index 26 is out of bounds for axis 0 with size 26
2023-01-18T14:10:59Z ERROR stixcore.processing.LBtoL0 93: index 26 is out of bounds for axis 0 with size 26
2023-01-18T14:10:59Z INFO stixcore.idb.idb 522: IDB loaded from /Users/shane/Projects/STIX/STIXCore/stixcore/data/idb/v2.26.35/idb.sqlite
@samaloney
Copy link
Collaborator Author

we should look into / fix this before the data release

@samaloney
Copy link
Collaborator Author

So this seems to be something to do with how we create the test data as when the source files are processed normally this error doesn't occur it only after we generate our own xml file that this happens so look like something is being reordered or missed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant