6S lookup tables

[jgrss]

@mmann1123 I created a module (see branch sixs-lut) for the 6S radiative transfer model with lookup tables for Landsat 5, 7, and 8 and Sentinel 2A and 2B. The files are too large (1-2 GB) to include as package data. Any ideas on how or where to host them so that they are only downloaded when needed?

[mmann1123]

Awesome! Happy to sponsor a S3 bucket or dropbox app. Just let me know what you would prefer.

[jgrss]

I would prefer S3 over Dropbox.

[mmann1123]

Sure if you send the files I can setup a public bucket.

…

On Mon, Mar 1, 2021 at 12:41 AM Jordan ***@***.***> wrote: I would prefer S3 over Dropbox. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#67 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABHR6VEBCH7IRLZLSSVRNS3TBMSITANCNFSM4XTX4GJA> .

[jgrss]

Thanks for uploading those files @mmann1123. I have a downloader in geowombat.radiometry.sixs that looks like:

@staticmethod
def _load(sensor, wavelength, interp_method, from_toar=False):

    if from_toar:
        raise NotImplementedError('Lookup tables from top of atmosphere reflectance are not supported.')
        lut_path = SENSOR_LOOKUP[sensor].path / f'{sensor}_{wavelength}_from_toar.lut'
    else:
        lut_path = SENSOR_LOOKUP[sensor].path / f'{sensor}_{wavelength}.lut'

    if not lut_path.is_file():

        logger.info(f'  Downloading {lut_path.name} into {SENSOR_LOOKUP[sensor].path}.')

        lutd = LUTDownloader()

        lutd.download(f'https://s3geowombat.s3.amazonaws.com/{sensor}_{wavelength}.lut',
                      str(lut_path),
                      safe_download=False)

    lut_ = joblib.load(str(lut_path))

    return lut_[interp_method]

Lookup tables will be stored in ~/.geowombat/datasets/lut.

[mmann1123]

Great. Happy to help.

…

On Tue, Mar 2, 2021, 6:19 PM Jordan ***@***.***> wrote: Thanks for uploading those files @mmann1123 <https://github.com/mmann1123>. I have a downloader in geowombat.radiometry.sixs that looks like: @staticmethoddef _load(sensor, wavelength, interp_method, from_toar=False): if from_toar: raise NotImplementedError('Lookup tables from top of atmosphere reflectance are not supported.') lut_path = SENSOR_LOOKUP[sensor].path / f'{sensor}_{wavelength}_from_toar.lut' else: lut_path = SENSOR_LOOKUP[sensor].path / f'{sensor}_{wavelength}.lut' if not lut_path.is_file(): logger.info(f' Downloading {lut_path.name} into {SENSOR_LOOKUP[sensor].path}.') lutd = LUTDownloader() lutd.download(f'https://s3geowombat.s3.amazonaws.com/{sensor}_{wavelength}.lut', str(lut_path), safe_download=False) lut_ = joblib.load(str(lut_path)) return lut_[interp_method] Lookup tables will be stored in ~/.geowombat/datasets/lut. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#67 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABHR6VGWATCM6KAIJMGZDZ3TBVW7TANCNFSM4XTX4GJA> .