distill::distillation¶

Classes¶

	Name
class	distill::distillation::Distiller

Attributes¶

	Name
	parser
	required
	True
	help
	args
	project_root
	distiller
dict	loss_log
str	out_dir
	parents
	exist_ok
	f
	indent

Detailed Description¶

Logit-based knowledge distillation from teacher to student.```



## Attributes Documentation

### variable parser

```python
parser =  argparse.ArgumentParser(description="Run knowledge distillation for a specialist");

variable required¶

required;

variable True¶

True;

variable help¶

help;

variable args¶

args =  parser.parse_args();

variable project_root¶

project_root =  Path(__file__).resolve().parent.parent;

variable distiller¶

distiller =  Distiller();

variable loss_log¶

dict loss_log =  {
        "niche": args.niche,
        "losses": [float("inf")],
        "note": "Placeholder — run with model and tokenizer for real KD loss",
    };

variable out_dir¶

str out_dir =  project_root / "artifacts" / "distill";

variable parents¶

parents;

variable exist_ok¶

exist_ok;

variable f¶

f;

variable indent¶

indent;

Updated on 2026-07-25 at 22:56:57 +0000