You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Materialization works ok but when trying to access the materialized asset, load_asset_value fails to use the resource_config:
with defs.get_asset_value_loader(instance=instance) as loader:
df2 = loader.load_asset_value(AssetKey("df_sample_labels"), partition_key='2023-09-18',\
resource_config={'s3_io_manager':{'config':{'s3_path':resources['s3_io_manager'].s3_path}}})
Dagster version
1.7.4
What's the issue?
I have a customized io manager (S3IOManager) that requires
s3_path
in its config:Materialization works ok but when trying to access the materialized asset,
load_asset_value
fails to use the resource_config:will report error:
However, if I put both
s3_io_manager
ands3_path
in resource_config:It will complain
s3_path
can't be there:What did you expect to happen?
load_asset_value() will easily reuse the resources to access the materialized assets.
How to reproduce?
No response
Deployment type
Local
Deployment details
No response
Additional information
No response
Message from the maintainers
Impacted by this issue? Give it a 👍! We factor engagement into prioritization.
The text was updated successfully, but these errors were encountered: