8 Commits

Author	SHA1	Message	Date
Jonathan King	9b2a4f83aa	Add missing warmup_num_steps parameter. ... warmup_decay_num_steps is a valid user argument but is not added to the config. This commit adds this argument to the configuration output.	2023-03-07 17:29:48 -05:00
Gustaf Ahdritz	f362ebffa7	Undo DeepSpeed config change	2022-03-29 20:38:31 -04:00
Gustaf Ahdritz	9f5581781e	Fix DeepSpeed config builder	2022-03-29 15:19:30 -04:00
Gustaf Ahdritz	ca810168d9	Add bfloat16 support to DeepSpeed config script	2021-11-29 19:03:40 -05:00
Gustaf Ahdritz	872787b9f0	Add gradient clipping to DeepSpeed config generator	2021-10-21 20:59:41 -04:00
Gustaf Ahdritz	d48c052cd9	Add training parsers	2021-10-15 17:59:11 -04:00
Gustaf Ahdritz	2065a6ca22	Add missing license notice	2021-09-27 17:20:21 -04:00
Gustaf Ahdritz	cc6ba53456	Add DeepSpeed config script	2021-09-27 17:19:14 -04:00