Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: RTC SAS Failing on S1A_IW_SLC__1SDV_20230114T161231_20230114T161258_046782_059BD6_D15F #734

Open
niarenaw opened this issue Feb 1, 2024 · 1 comment
Assignees
Labels
bug Something isn't working needs triage Issue that requires triage

Comments

@niarenaw
Copy link

niarenaw commented Feb 1, 2024

Checked for duplicates

Yes - I've already checked

Describe the bug

The RTC is failing on the following granule: S1A_IW_SLC__1SDV_20230114T161231_20230114T161258_046782_059BD6_D15F

It looks like something in the SAS is failing:
Running preprocessor for RtcS1PreProcessorMixin Starting SAS execution for RtcS1Executor Traceback (most recent call last): File "/home/rtc_user/opera/scripts/pge_main.py", line 189, in <module> pge_main() File "/home/rtc_user/opera/scripts/pge_main.py", line 185, in pge_main pge_start(run_config_filename) File "/home/rtc_user/opera/scripts/pge_main.py", line 159, in pge_start pge.run() File "/home/rtc_user/opera/pge/base/base_pge.py", line 760, in run self.run_sas_executable(**kwargs) File "/home/rtc_user/opera/pge/base/base_pge.py", line 739, in run_sas_executable elapsed_time = time_and_execute( File "/home/rtc_user/opera/util/run_utils.py", line 214, in time_and_execute logger.critical(module_name, ErrorCode.SAS_PROGRAM_FAILED, error_msg) File "/home/rtc_user/opera/util/logger.py", line 407, in critical raise RuntimeError(description) RuntimeError: Command "/home/rtc_user/miniconda3/condabin/conda run --no-capture-output -n RTC rtc_s1.py /home/rtc_user/output_dir/scratch_dir/RunConfig_sas.yaml" failed with exit code 1 ERROR conda.cli.main_run:execute(47): conda run sh -c exec ${CONDA_ROOT}/bin/pge_docker_entrypoint.sh "${@}" -- --file /home/rtc_user/runconfig/RunConfig.yaml failed. (See above for error)

What did you expect?

Would expect the PGE to be able to process this granule

Reproducible steps

No response

Environment

Ran on PST venue using rc 2.1.1

Triaged job in GRQ: https://100.104.62.10/hysds_ui/tosca?dataset=%22triaged_job%22&_id=%22triaged_job-SCIFLO_L2_RTC_S1__2.1.1-S1A_IW_SLC__1SDV_20230114T161231_20230114T161258_046782_059BD6_D15F-r1-20240125T184212.5149Z_task-12054786-83a3-40f7-b4da-bcf1e0d294f3%22
@niarenaw niarenaw added bug Something isn't working needs triage Issue that requires triage labels Feb 1, 2024
@collinss-jpl collinss-jpl transferred this issue from nasa/opera-sds-pge Feb 2, 2024
@collinss-jpl
Copy link
Collaborator

Retested granule and RTC-S1 job still fails with following error from PGE/SAS log:

[StdErr] Traceback (most recent call last):
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/bin/rtc_s1_single_job.py", line 35, in <module>
[StdErr]     run_single_job(cfg)
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/lib/python3.9/site-packages/rtc/rtc_s1_single_job.py", line 1656, in run_single_job
[StdErr]     rg_lut, az_lut = compute_correction_lut(
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/lib/python3.9/site-packages/rtc/rtc_s1_single_job.py", line 243, in compute_correction_lut
[StdErr]     gdal.Open(f'{scratch_path}/height.rdr', gdal.GA_ReadOnly).ReadAsArray()
[StdErr]   File "/home/rtc_user/miniconda3/envs/RTC/lib/python3.9/site-packages/osgeo/gdal.py", line 5296, in Open
[StdErr]     return _gdal.Open(*args)
[StdErr] RuntimeError: DSI or ACC record missing.  DTED access to
[StdErr] /home/rtc_user/scratch_dir/temp_1712164165.8587625/temp_1712164170.0907102/t160_342212_iw1//height.rdr failed.

This may indicate an issue with the underlying SLC granule.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working needs triage Issue that requires triage
Projects
None yet
Development

No branches or pull requests

2 participants