chore: initialize insar management system v2
This commit is contained in:
@@ -0,0 +1,157 @@
|
||||
# Phase 2 Bridge Smoketest
|
||||
|
||||
Date: 2026-04-06
|
||||
|
||||
## Scope
|
||||
|
||||
Validate the current SBAS bridge chain with the previously verified LT-1 sample stack:
|
||||
|
||||
1. `build_lt1_stack_prep.py`
|
||||
2. `materialize_lt1_stack_scenes.py`
|
||||
3. `build_lt1_stack_prep.py` refresh
|
||||
|
||||
This run validates the current bridge boundary only:
|
||||
|
||||
- raw LT-1 scenes
|
||||
- local precise orbit pool
|
||||
- local prepared DEM
|
||||
- fresh scratch workspace
|
||||
|
||||
It does not run:
|
||||
|
||||
- `stripmapStack`
|
||||
- MintPy
|
||||
- geocode/export/publish
|
||||
|
||||
## Inputs
|
||||
|
||||
- sample manifest:
|
||||
- `experiments/isce2_sbas_timeseries/configs/sample_stack_e123p3_n46p1.json`
|
||||
- orbit pool:
|
||||
- `/mnt/d/orbit_pools/isce2`
|
||||
- DEM:
|
||||
- `/mnt/z/Code/Insar_management_system_v2/experiments/isce2_sbas_timeseries/scratch/lt1a_strip1_hh_descending_e123p3_n46p1/inputs/dem/stack_dem_window.wgs84`
|
||||
|
||||
## Workspace
|
||||
|
||||
- scratch root:
|
||||
- `experiments/isce2_sbas_timeseries/scratch/phase2_bridge_smoketest_20260406`
|
||||
|
||||
## Result
|
||||
|
||||
- final readiness: `True`
|
||||
- scene count: `5`
|
||||
- reference date: `20250510`
|
||||
- all orbits resolved: `True`
|
||||
- all `.slc/.slc.xml` present: `True`
|
||||
- all `data` shelves present: `True`
|
||||
|
||||
## Materialization Summary
|
||||
|
||||
- dates:
|
||||
- `20250118`
|
||||
- `20250315`
|
||||
- `20250510`
|
||||
- `20250705`
|
||||
- `20250830`
|
||||
- status counts:
|
||||
- `materialized: 5`
|
||||
- total bytes written:
|
||||
- `16313641344`
|
||||
|
||||
## Artifacts
|
||||
|
||||
- selected manifest used for this WSL run:
|
||||
- `experiments/isce2_sbas_timeseries/scratch/phase2_bridge_smoketest_20260406/selected_stack_manifest_wsl.json`
|
||||
- generated stack manifest:
|
||||
- `experiments/isce2_sbas_timeseries/scratch/phase2_bridge_smoketest_20260406/stack_input_manifest.json`
|
||||
- materialization summary:
|
||||
- `experiments/isce2_sbas_timeseries/scratch/phase2_bridge_smoketest_20260406/materialization_summary.json`
|
||||
- generated stack dry-run wrapper:
|
||||
- `experiments/isce2_sbas_timeseries/scratch/phase2_bridge_smoketest_20260406/run_stripmap_stack_dryrun.sh`
|
||||
- synthetic water-mask recovery report:
|
||||
- `experiments/isce2_sbas_timeseries/scratch/phase2_bridge_smoketest_20260406/stack_work/logs/run_01_reference.synthetic_watermask.json`
|
||||
|
||||
## Finding
|
||||
|
||||
`build_lt1_stack_prep.py` currently reads `scene["tiff_path"]` and `scene["meta_path"]` directly.
|
||||
When the script is run inside WSL against the sample manifest, the original `F:\...` Windows paths are not readable as Linux paths.
|
||||
|
||||
For this smoketest, a temporary WSL-path manifest copy was generated and used:
|
||||
|
||||
- `selected_stack_manifest_wsl.json`
|
||||
|
||||
This is an experiment-side workaround only.
|
||||
No production/system logic was changed for this run.
|
||||
|
||||
## Update 2026-04-07
|
||||
|
||||
The same fresh workspace was then continued through the stripmap stack run files.
|
||||
|
||||
### Additional Result
|
||||
|
||||
- `run_01_reference`
|
||||
- reached `createWaterMask`
|
||||
- failed on remote `SWBD` retrieval from:
|
||||
- `https://e4ftl01.cr.usgs.gov/MEASURES/SRTMSWBD.003/...`
|
||||
- recovered with a local synthetic all-land `waterMask.rdr`
|
||||
- `run_02_focus_split`
|
||||
- completed
|
||||
- `run_03_geo2rdr_coarseResamp`
|
||||
- completed
|
||||
- `run_04_refineSecondaryTiming`
|
||||
- completed
|
||||
- `run_05_invertMisreg`
|
||||
- completed
|
||||
- `run_06_fineResamp`
|
||||
- completed
|
||||
- `run_07_grid_baseline`
|
||||
- completed
|
||||
- `run_08_igram`
|
||||
- completed through interferogram generation, filtering, coherence, and `snaphu` unwrapping
|
||||
|
||||
### Interferogram Snapshot
|
||||
|
||||
- pair count on disk:
|
||||
- `10`
|
||||
- verified pair folders:
|
||||
- `20250118_20250315`
|
||||
- `20250118_20250510`
|
||||
- `20250118_20250705`
|
||||
- `20250118_20250830`
|
||||
- `20250315_20250510`
|
||||
- `20250315_20250705`
|
||||
- `20250315_20250830`
|
||||
- `20250510_20250705`
|
||||
- `20250510_20250830`
|
||||
- `20250705_20250830`
|
||||
- verified key files in every pair directory:
|
||||
- `filt_<date12>.int`
|
||||
- `filt_<date12>.cor`
|
||||
- `filt_<date12>_snaphu.unw`
|
||||
- `filt_<date12>_snaphu.unw.conncomp`
|
||||
|
||||
### Finding Update
|
||||
|
||||
The original `run_generated_stack_runfile_ubuntu2404.sh` fallback only matched the `.netrc` credential failure text.
|
||||
This workspace showed a second offline failure mode:
|
||||
|
||||
- `createWaterMask` started normally
|
||||
- ISCE2 `DataRetriever` failed during `SWBD` file retrieval
|
||||
- the wrapper therefore did not auto-recover on the first attempt
|
||||
|
||||
The experiment helper has now been widened to recognize both:
|
||||
|
||||
- missing Earthdata credential text
|
||||
- direct `SWBD` retrieval failure text from `createWaterMask`
|
||||
|
||||
No production/system runtime was changed by this fix.
|
||||
|
||||
## Recommended Next Step
|
||||
|
||||
Use this fresh workspace to continue with:
|
||||
|
||||
1. unified-env MintPy smoketest using:
|
||||
- `configs/phase2_bridge_smoketest_20260406_smallbaseline.cfg`
|
||||
2. publish-style geocode/export if MintPy succeeds
|
||||
3. compare this fresh replay with the earlier baseline workspace
|
||||
Reference in New Issue
Block a user