STASIS

ROMANDP-0.17.0-1-py310-macos-arm64

Conda is required to manage installation of the delivery environment. A fresh installation of Miniforge3 is not required for each ROMANDP delivery, however. An existing conda installation may be used. The method described here allows for multiple entirely separate pipeline installations.

A POSIX-compatible shell (e.g. bash) is required for all steps below. Python dependencies are taken directly from PyPI or development repositories as needed, so conda's ability to install hybrid conda/pip environments from a YAML specification is used. This requires first downloading the specification file and then creating the environment with it.

Installing Conda

If conda is not available on the target system, it will need to be installed and configured before the delivery environment can be installed.

For detailed instructions of this step, please visit: https://conda.io/projects/conda/en/latest/user-guide/install/index.html

Miniforge3:

wget https://github.com/conda-forge/miniforge/releases/download/24.9.0-0/Miniforge3-24.9.0-0-MacOSX-arm64.sh
bash Miniforge3-24.9.0-0-MacOSX-arm64.sh
$HOME/Miniforge3/condabin/conda init

Installing ROMANDP

Option 1: Install this delivery

conda env create \
    --file https://ssb.stsci.edu/stasis/releases/roman/ROMANDP-0.17.0/delivery/ROMANDP-0.17.0-1-py310-macos-arm64.yml

Activate this delivery

conda activate ROMANDP-0.17.0-1-py310-macos-arm64

Option 2: Install the latest delivery

Warning: The latest URL may provide software different than what is presented by the release notes section below!

conda env create \
    --name ROMANDP-latest-py310 \
    --file https://ssb.stsci.edu/stasis/releases/roman/ROMANDP-0.17.0/delivery/latest-py310-macos-arm64.yml

Activate the latest delivery

conda activate ROMANDP-latest-py310

Each new delivery iteration will need to be installed using one of the above commands.

Software Release Notes

romancal

What's Changed

Return to development by @jhunkeler in https://github.com/spacetelescope/romancal/pull/1105
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/spacetelescope/romancal/pull/1104
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/spacetelescope/romancal/pull/1106
Fix the datamodels docs by @WilliamJamieson in https://github.com/spacetelescope/romancal/pull/1112
Find and fix all the tmpdir usages by @WilliamJamieson in https://github.com/spacetelescope/romancal/pull/1108
Use dqflags defined in roman_datamodels by @WilliamJamieson in https://github.com/spacetelescope/romancal/pull/1099
remove tmpdir_factory usage, enable no:legacypath as a tox factor by @braingram in https://github.com/spacetelescope/romancal/pull/1117
copy reference pixels during dqinit by @braingram in https://github.com/spacetelescope/romancal/pull/1121
Improve documentation by @nden in https://github.com/spacetelescope/romancal/pull/1124
RCAL-698: fix TweakReg to allow for Roman datamodels as input by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1089
Fix DMS requirement number by @nden in https://github.com/spacetelescope/romancal/pull/1127
Update units on science data products. by @schlafly in https://github.com/spacetelescope/romancal/pull/1126
RCAL-776: Change image units. by @PaulHuwe in https://github.com/spacetelescope/romancal/pull/1128
Rad-155 by @nden in https://github.com/spacetelescope/romancal/pull/1131
Improve PSF fitting by @schlafly in https://github.com/spacetelescope/romancal/pull/1125
Use dark slope in ramp fitting by @schlafly in https://github.com/spacetelescope/romancal/pull/1088
RCAL-751 Create FluxStep to apply the flux correction to Level 2 data. by @stscieisenhamer in https://github.com/spacetelescope/romancal/pull/1120
fix regtest teardown for fixture updates by @braingram in https://github.com/spacetelescope/romancal/pull/1140
Clarify how to get V2/V3_REF by @nden in https://github.com/spacetelescope/romancal/pull/1142
Consolidate regression tests into fewer files. by @schlafly in https://github.com/spacetelescope/romancal/pull/1084
RCAL-726: allow ModelContainer as input to outlier detection step. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1092
remove unused test code by @braingram in https://github.com/spacetelescope/romancal/pull/1145
[SCSB-145] require Python 3.10 by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1144
fix n_diffs in compare_asdf by @braingram in https://github.com/spacetelescope/romancal/pull/1148
RCAL-725: fix outlier detection step issues. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1146
allow DQInitStep to pass through non-rampmodel keys by @braingram in https://github.com/spacetelescope/romancal/pull/1151
Rcal-783 Update the high level pipeline for B14 by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1143
RCAL-620: allow ModelContainer to work with context manager. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1147
RCAL-805: Split cal_step into L2 & L3 by @PaulHuwe in https://github.com/spacetelescope/romancal/pull/1165
switch rad roman_datamodels back to dev by @braingram in https://github.com/spacetelescope/romancal/pull/1168
RCAL-787: allow DQ flags to be specified by the user in resample. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1166
Update HLP regtest to use existing L1/L2 files by @schlafly in https://github.com/spacetelescope/romancal/pull/1171
RCAL-800: Set flux step status for each input by @stscieisenhamer in https://github.com/spacetelescope/romancal/pull/1160
RCAL-795: fix incorrect weight maps returned by resampling by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1181
Remove link to non-existent STScI logo by @larrybradley in https://github.com/spacetelescope/romancal/pull/1186
RCAL-775: initial commit of tessel matching code by @perrygreenfield in https://github.com/spacetelescope/romancal/pull/1161
update calibration_software_version when a step is run by @braingram in https://github.com/spacetelescope/romancal/pull/1194
rcal-818 Add preview images tp hlp regtest by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1199
Fix finalize by @nden in https://github.com/spacetelescope/romancal/pull/1201
Fix unit typo in docs by @larrybradley in https://github.com/spacetelescope/romancal/pull/1200
RCAL-816: add function to populate L3 mosaic meta.basic. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1188
RCAL-799: Populate the Level 3 wcsinfo by @stscieisenhamer in https://github.com/spacetelescope/romancal/pull/1182
make rotation matrix 2d for schema validation by @stscieisenhamer in https://github.com/spacetelescope/romancal/pull/1205
Add Source Catalog Step by @bmorris3 in https://github.com/spacetelescope/romancal/pull/1102
Doc fixes by @larrybradley in https://github.com/spacetelescope/romancal/pull/1211
RCAL-801: update skymatch to return updated models if the input is an asn by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1208
Make sure logs get included in L3 products. by @schlafly in https://github.com/spacetelescope/romancal/pull/1207
Put real file names in meta.resample.meta. by @schlafly in https://github.com/spacetelescope/romancal/pull/1209
fix incorrect boolean comparison within isfile() by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1210
RCAL-802: Update outlier detection step to return a ModelContainer if input is an association file. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1212
Rcal 803 Initial resampling to skycell in the hlp by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1214
adding plotting utility by @perrygreenfield in https://github.com/spacetelescope/romancal/pull/1204
Add tests of WCS accuracy. by @schlafly in https://github.com/spacetelescope/romancal/pull/1185
RCAL-798: Populate the l3 product individual_image_meta block by @stscieisenhamer in https://github.com/spacetelescope/romancal/pull/1216
Regtest / integration fixes for B14 by @schlafly in https://github.com/spacetelescope/romancal/pull/1228
Also ignore version information in Table schema meta. by @schlafly in https://github.com/spacetelescope/romancal/pull/1229
update actions version by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1096
Bump scientific-python/action-check-changelogfile from 0.2 to 0.3 by @dependabot in https://github.com/spacetelescope/romancal/pull/1230
remove clean_up_after_test by @braingram in https://github.com/spacetelescope/romancal/pull/1245
rcal-845_dsd rename highlevelpipeline to mosaicpipeline by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1249
Update python from 3.9 to 311 in JenkinsfileRT_dev by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1251
apply minor fixes for sonarqube by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1250
Refactor DQInitStep to use the RampModel method of creating ramps by @stscieisenhamer in https://github.com/spacetelescope/romancal/pull/1258
rcal-846 Add mosaic info to the science products RTD page by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1262
add codecov_token secret to CI workflow by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1265
rcal-850 Addition of catalog step to mosaic pipeline by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1266
Fix bug when setting meta.background in SkyMatchStep. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1233
RCAL-828: add PSF bits to source catalog. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1243
Fix comparison operator. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1269
Rcal 854 Tweakreg step listed as skipped when run & refactor exposure pipeline by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1271
pin numpy <2 by @braingram in https://github.com/spacetelescope/romancal/pull/1275
use resample many_to_many in outlier detection by @braingram in https://github.com/spacetelescope/romancal/pull/1260
replace deprecated stpipe configobj with astropy by @braingram in https://github.com/spacetelescope/romancal/pull/1267
RCAL-777: allow Step._datamodels_open to open association files by @braingram in https://github.com/spacetelescope/romancal/pull/1270
Do not set conda version in Jenkinsfile(s) by @jhunkeler in https://github.com/spacetelescope/romancal/pull/1286
rcal-859 Update okify script to use GA directories on artifactory by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1282
add upper pin for photutils by @braingram in https://github.com/spacetelescope/romancal/pull/1291
unpin webbpsf by @braingram in https://github.com/spacetelescope/romancal/pull/1288
Rcal 860 Allow roman datamodel as input to the exposure pipeline by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1296
Fix issue in constructing skycell WCS. by @schlafly in https://github.com/spacetelescope/romancal/pull/1297
Fix psf tests by @larrybradley in https://github.com/spacetelescope/romancal/pull/1293
Update exposure_pipeline.py by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1298
remove executable bits from non-script files by @braingram in https://github.com/spacetelescope/romancal/pull/1299
show logs on failed tests by @braingram in https://github.com/spacetelescope/romancal/pull/1307
remove pytest asdf plugin configuration for non-existant schemas by @braingram in https://github.com/spacetelescope/romancal/pull/1305
Remove unnecessary global variable and unit tests. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1314
replace usages of copy_arrays with memmap by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1316
Replace ModelContainer with ModelLibrary by @braingram in https://github.com/spacetelescope/romancal/pull/1241
delete unreachable code by @braingram in https://github.com/spacetelescope/romancal/pull/1322
Pin stcal for development by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1326
RCAL-830: update tweakreg to use source catalog by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1276
provide formatter to log_records by @braingram in https://github.com/spacetelescope/romancal/pull/1327
use reusable workflow from WebbPSF repository to download and cache data by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1311
Bump actions/labeler from 4 to 5 by @dependabot in https://github.com/spacetelescope/romancal/pull/1231
use monkeypatch in patch_match tests to avoid global state change by @braingram in https://github.com/spacetelescope/romancal/pull/1319
update labeler to v5 by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1333
remove creation of stray fits file by @braingram in https://github.com/spacetelescope/romancal/pull/1338
remove stcal upper pin by @braingram in https://github.com/spacetelescope/romancal/pull/1340
increase asdf minimum required version by @braingram in https://github.com/spacetelescope/romancal/pull/1343
Remove uses of lazy_load=False, update step input handling by @braingram in https://github.com/spacetelescope/romancal/pull/1342
rcal-827 Add reg test for DMS373 by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1348
uncomment and use get_asn by @braingram in https://github.com/spacetelescope/romancal/pull/1320
RCAL-885: Updated Sky Background for Schema by @PaulHuwe in https://github.com/spacetelescope/romancal/pull/1351
Update absolute separation default. by @schlafly in https://github.com/spacetelescope/romancal/pull/1352
[SCSB-169] add user input to specify CRDS_CONTEXT by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1361
make crs bigger for new pars file for jump unit tests by @braingram in https://github.com/spacetelescope/romancal/pull/1356
RCAL-858: Create a regtest for sky match. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1358
fix number of context planes by @braingram in https://github.com/spacetelescope/romancal/pull/1355
Populate sky metadata with zero if matching is not possible. by @schlafly in https://github.com/spacetelescope/romancal/pull/1360
metadata for release 0.16.0 (24Q4_B15) by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1353
release metadata for 0.16.1 + update stpipe to use ModelLibrary + stcal to use outlier detection functions by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1364
Add a default suffix to ELP by @nden in https://github.com/spacetelescope/romancal/pull/1378
only load patch table when needed by @braingram in https://github.com/spacetelescope/romancal/pull/1367
Populate segmentation model metadata for exposures and mosaics. by @schlafly in https://github.com/spacetelescope/romancal/pull/1391
rcal-906 Allow asn product name to be the output product name by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1394
use towncrier to handle changelog entries by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1375
rcal-890 Update Docs for B15 by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1396
RCAL-900: fix numpy 2.0 issues with bitflags in resample by @mcara in https://github.com/spacetelescope/romancal/pull/1383
drop support for ols ramp fitting by @braingram in https://github.com/spacetelescope/romancal/pull/1398
TST: Use photutils nightly wheel by @pllim in https://github.com/spacetelescope/romancal/pull/1363
[SCSB-174] move DMS requirement <-> test correlations from @metrics_logger decorators to romancal/tests/dms_requirement_tests.json by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1399
unpin pytest by @braingram in https://github.com/spacetelescope/romancal/pull/1409
add CI check that CHANGES.rst is not modified by @braingram in https://github.com/spacetelescope/romancal/pull/1412
Rcal 910 Add target option to the asn_from_list command by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1411
RCAL-896: update TweakRegStep to use common code from stcal by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1395
remove default values from docs by @braingram in https://github.com/spacetelescope/romancal/pull/1419
[CI] rename changelog check job to be more explicit on its purpose by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1422
update pull request checklist by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1336
RCAL-895: allow updating source catalog with tweaked WCS when running ELP by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1373
set rad and roman_datamodels to dev by @braingram in https://github.com/spacetelescope/romancal/pull/1424
fix artifactory_repos for pytest 8 by @braingram in https://github.com/spacetelescope/romancal/pull/1427
remove MultilineLogger, split logs with \ into multiple messages by @braingram in https://github.com/spacetelescope/romancal/pull/1377
Update Outlier Detection to use stcal by @braingram in https://github.com/spacetelescope/romancal/pull/1357
Work around NotImplemented Quantity.tofile by @braingram in https://github.com/spacetelescope/romancal/pull/1436
Split long regtests into reusable fixtures and smaller named tests by @braingram in https://github.com/spacetelescope/romancal/pull/1426
Fix files left over by testing by @WilliamJamieson in https://github.com/spacetelescope/romancal/pull/1446
add missing rtdata.output assignments to repointed tests by @braingram in https://github.com/spacetelescope/romancal/pull/1453
Put okify results in unique subdirectories to avoid file overwrites by @braingram in https://github.com/spacetelescope/romancal/pull/1456
rcal-920 script to create associations based on skycells by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1437
RCAL-913 Resolve numpy 2 issues by @WilliamJamieson in https://github.com/spacetelescope/romancal/pull/1447
remove display_version from docs config by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1463
RCAL-911 & 932: remove units from MOS and ELP pipelines. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1445
Manual Pre-commit update by @WilliamJamieson in https://github.com/spacetelescope/romancal/pull/1462
remove lib.dms by @braingram in https://github.com/spacetelescope/romancal/pull/1433
vendorize and fix crds workflow by @braingram in https://github.com/spacetelescope/romancal/pull/1467
rcal-936 Update skycell_asn docs and add skycell_asn as a script at install time by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1471
Group models by obs_id for steps that use grouping by @braingram in https://github.com/spacetelescope/romancal/pull/1448
RCAL-941: Update romancal to use new L1/L2 schema. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1473
Point back to RAD/RDM main branches. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1478
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/spacetelescope/romancal/pull/1470
Misc small fixes and tweaks by @WilliamJamieson in https://github.com/spacetelescope/romancal/pull/1480
move run results directory on Artifactory to regression-tests/runs/ by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1475
RCAL-937: update s_region after running TweakRegStep. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1484
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/spacetelescope/romancal/pull/1491
rcal-935 Check for correct skycell name in mosaic product by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1498
Replace create_s_region with stcal's compute_s_region_keyword. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1493
update okify for new directory structure by @braingram in https://github.com/spacetelescope/romancal/pull/1500
Reduce the number of tests for supported catalog formats. by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1496
Fix bug when checking for "target" in model.asn by @mairanteodoro in https://github.com/spacetelescope/romancal/pull/1502
remove logging manipulation during create_gridded_psf_model by @braingram in https://github.com/spacetelescope/romancal/pull/1503
add class aliases for steps by @braingram in https://github.com/spacetelescope/romancal/pull/1509
Fix crds keywords by @schlafly in https://github.com/spacetelescope/romancal/pull/1510
Restore flux units to source catalog table by @larrybradley in https://github.com/spacetelescope/romancal/pull/1512
Improve unit handling by @larrybradley in https://github.com/spacetelescope/romancal/pull/1514
rcal-949 Update file naming and asn header coords by @ddavis-stsci in https://github.com/spacetelescope/romancal/pull/1505
Copy input datamodel in source_catalog step by @larrybradley in https://github.com/spacetelescope/romancal/pull/1457
RCAL-943: Add a step for creating multiband source catalogs by @larrybradley in https://github.com/spacetelescope/romancal/pull/1485
pin roman_datamodels>=0.22.0 and stcal>=1.10.0, and remove rad pin by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1520
metadata for release 0.17.0 by @zacharyburnett in https://github.com/spacetelescope/romancal/pull/1521

New Contributors

@larrybradley made their first contribution in https://github.com/spacetelescope/romancal/pull/1186
@dependabot made their first contribution in https://github.com/spacetelescope/romancal/pull/1230

Full Changelog: https://github.com/spacetelescope/romancal/compare/0.14.0...0.17.0