You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Catalogs for different source types are created independently. The config information the API needs for that source should ideally be created by the same program creating the data, or at least at the same time, but currently all config information is in the same file. I would like to keep data and possibly also the config information for each source type in subdirectories of a top-level directory which would have the top-level config. Such a config would look something like this: catalog_dir: top_dir catalog_name: top_config (more top-level keys) object_types: star: !include star/dc2_star.yaml snana: !include snana/dc2_sn.yaml galaxy: !include galaxy/cosmodc2_galaxy.yaml bulge: !include galaxy/cosmodc2_bulge.yaml disk: !include galaxy/cosmodc2_disk.yaml knots: !include galaxy/cosmodc2_knots.yaml
yaml does not natively support !include but there are extensions which do. I've tested pyyaml_include and it seems to be adequate.
dc2_star.yaml, one of the included files, could have contents subtype : cosmodc2_star star_truth: /global/cfs/cdirs/lsst/groups/SSim/DC2/dc2_stellar_healpixel.db MW_extinction: F19 area_partition: nside: 32 ordering: ring type: healpix data_file_type: parquet file_template: star/pointsource_(?P<healpix>\d+).parquet flux_file_template: star/pointsource_flux_(?P<healpix>\d+).parquet internal_extinction: None sed_file_root_env_var: SIMS_SED_LIBRARY_DIR sed_model: file_nm
The text was updated successfully, but these errors were encountered:
The chief advantage of this scheme would be independence of source types, which in general are not created at the same time or by the same means. Subdirectories containing the data could be symlinks if convenient.
The subtype keyword would allow the API user to, e.g., refer to source type galaxy without being concerned whether the galaxies in question are cosmodc2 galaxies or diffsky galaxies.
Catalogs for different source types are created independently. The config information the API needs for that source should ideally be created by the same program creating the data, or at least at the same time, but currently all config information is in the same file. I would like to keep data and possibly also the config information for each source type in subdirectories of a top-level directory which would have the top-level config. Such a config would look something like this:
catalog_dir: top_dir
catalog_name: top_config
(more top-level keys)
object_types:
star: !include star/dc2_star.yaml
snana: !include snana/dc2_sn.yaml
galaxy: !include galaxy/cosmodc2_galaxy.yaml
bulge: !include galaxy/cosmodc2_bulge.yaml
disk: !include galaxy/cosmodc2_disk.yaml
knots: !include galaxy/cosmodc2_knots.yaml
yaml does not natively support
!include
but there are extensions which do. I've tested pyyaml_include and it seems to be adequate.dc2_star.yaml, one of the included files, could have contents
subtype : cosmodc2_star
star_truth: /global/cfs/cdirs/lsst/groups/SSim/DC2/dc2_stellar_healpixel.db
MW_extinction: F19
area_partition:
nside: 32
ordering: ring
type: healpix
data_file_type: parquet
file_template: star/pointsource_(?P<healpix>\d+).parquet
flux_file_template: star/pointsource_flux_(?P<healpix>\d+).parquet
internal_extinction: None
sed_file_root_env_var: SIMS_SED_LIBRARY_DIR
sed_model: file_nm
The text was updated successfully, but these errors were encountered: