Skip to content

SydCS/OPD-Param-Analysis

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 

Repository files navigation

OPD Delta Analysis

This directory contains a CLI tool for analyzing the final parameter update

Delta W = W_opd - W_src

between a source HuggingFace checkpoint and an OPD-trained checkpoint.

Training follows the public implementations and configurations from verl, thunlp/OPD, and siyan-zhao/OPSD, where applicable. We thank the authors and maintainers of these projects for their efforts.

The analysis entry point is scripts/analyze_opd_delta.py.

python scripts/analyze_opd_delta.py \
  --src_model [W_src] \
  --opd_model [W_opd] \
  --out_dir outputs/opd_delta_analysis \
  --max_exact_svd_dim 4096 \
  --approx_svd_max_numel 3000000

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages