Commit Graph

158 Commits

Author SHA1 Message Date
Jennifer Wei
4312aec6b2 Add link to issue for deepspeed_evo_attention test. 2025-04-25 20:31:38 +00:00
Jennifer Wei
9caf30ae13 Change casting for deepspeed compare model test to fp32 2025-04-24 20:51:34 +00:00
Jennifer Wei
5221ed479e Update test_permutation.py
Fixed a small typo in permutation unit test docstring
2024-05-13 05:13:00 +00:00
Dingquan Yu
ad414ec94d Update tests and comments 2024-05-13 05:13:00 +00:00
Geoffrey Yu
b54270180b remove unnecessary lines 2024-05-13 05:12:59 +00:00
Geoffrey Yu
54ec5c4cbe fixed bugs in unittests for multi-chain permutation. now working on extra subtests 2024-05-13 05:12:59 +00:00
Jennifer
cdf603962f change message for test_model.py compare 2024-05-06 08:30:34 +00:00
Christina Floristean
4f2f069bc8 Additional fix for multimer deepspeed test 2024-05-06 08:24:18 +00:00
Jennifer Wei
af457b9507 adds mpi4py to environment and removes stray print statements from test 2024-05-06 04:51:08 +00:00
Jennifer
0fe5ea3168 Add fixes to permutation test after refactor 2024-02-07 01:03:40 -05:00
Jennifer
0aa694741c fix deepspeed_evo_attention to work in both monomer and multimer settings. 2024-02-07 00:07:58 -05:00
Jennifer
204ed19105 create separate test configs for multimer and monomer 2024-02-07 00:07:29 -05:00
Jennifer
bf8788c7c7 debugging for permutation test 2024-02-06 03:49:53 -05:00
Jennifer
30195c4abb Adds absolute error comparison function with better messaging. 2024-02-01 22:53:12 -05:00
Jennifer
8f8b537da8 update deprecated jax.numpy.DeviceArray to jax.Array 2024-02-01 22:53:12 -05:00
Christina Floristean
40d9e7d72d Additional fix for multimer deepspeed test 2024-01-23 12:17:40 -05:00
Christina Floristean
9a07b7f976 Fix deepspeed test for multimer 2024-01-17 10:21:24 -05:00
jnwei
39f9958b4a Change test_compare_model in deepspeed test to use mean instead of max 2024-01-11 15:05:37 +07:00
Christina Floristean
9d6127cbc4 Fix missing import in tests 2023-12-15 11:49:25 -05:00
Christina Floristean
1606ac0834 Merge branch 'main' into multimer 2023-12-11 10:48:16 -05:00
Christina Floristean
40d76358fa Minor change to tests 2023-12-08 13:43:25 -05:00
Christina Floristean
336c899acb Minor test and README changes 2023-12-08 11:38:36 -05:00
Christina Floristean
f156399972 Minor test fix 2023-11-13 13:33:27 -05:00
Christina Floristean
7fb12cf5cd Update setup script and refactor qkv prep 2023-11-13 13:12:29 -05:00
Christina Floristean
5aa549583a Merge branch 'main' into deepspeed-evo-attention 2023-11-08 13:32:44 -05:00
Christina Floristean
f65b75fe48 Fix for loading old OF weights into refactored model 2023-11-03 14:26:18 -04:00
Christina Floristean
5fcd6ed221 Unit test fixes for when AF2 is not installed 2023-11-02 15:57:23 -04:00
Christina Floristean
d7c115371e Merge branch 'main' into multimer 2023-10-27 12:09:39 -04:00
Sachin Kadyan
28334db382 Added test for no column attention Evoformer 2023-10-10 16:33:07 -04:00
Sachin Kadyan
a7c0d0d178 Added sequence embedding mode test for model. 2023-10-10 16:33:07 -04:00
Sachin Kadyan
777d738a59 Added test for PreembeddingEmbedder 2023-10-10 16:33:07 -04:00
Christina Floristean
f545323c44 Added test for backward pass 2023-10-06 13:28:05 -04:00
Christina Floristean
a3de9cb930 Added kernel to template pair stack and updated tests 2023-10-05 16:48:21 -04:00
Christina Floristean
a098576109 Remove scale when using ds kernel 2023-10-03 20:48:51 -04:00
Geoffrey Yu
f3c1af4556 fixed error with anchor selections; updated permutation unittest 2023-09-21 15:49:26 +02:00
Jennifer Wei
8baae516a4 Adds cuda wrapper to pytorch vectors to fix TestModel.test_dry_run 2023-09-20 13:01:51 -07:00
Christina Floristean
6ebcd8b4b0 Correct unit tests to run attention functions instead of Attention module in order to avoid 'final' init on outputs 2023-09-20 13:15:30 -04:00
Jennifer Wei
48668ca30b Adds float wrapper to to vectors in TestExtraMSAStack in
test_evoformer.py
2023-09-18 14:57:27 -07:00
Christina Floristean
710088d92d Update to deepspeed main repo, final changes to tests 2023-09-18 15:21:24 -04:00
Christina Floristean
a8d896fd1b Fix seq min length issue in kernel test 2023-09-14 17:19:31 -04:00
Christina Floristean
e9898a6000 Fix bug in test to enable kernel 2023-09-14 15:07:47 -04:00
Christina Floristean
2bf185202d Clean up DS kernel integration and test, add cutlass to installation procedure 2023-09-13 17:38:02 -04:00
Christina Floristean
dd944f64da Remove AF2 requirement from test 2023-09-07 23:13:09 -04:00
Christina Floristean
f0a320e0d2 Integrated deepspeed attention kernel and added initial tests. 2023-09-07 16:51:27 -04:00
Geoffrey Yu
cec5a42692 added test3 to test if permutated tensors end up as expected 2023-09-03 16:22:56 +02:00
Geoffrey Yu
c5f16efc35 update permutation unittest 2023-09-03 16:05:20 +02:00
Christina Floristean
3de188e9d0 Minor model test fix 2023-08-10 12:51:09 -04:00
Christina Floristean
44b0bf76d0 Merge branch 'main' into multimer 2023-08-10 12:36:07 -04:00
Christina Floristean
82bda2d6d3 Refactored multimer config update 2023-08-03 20:52:06 -04:00
Christina Floristean
30764cf9e0 Minor fixes/reformatting for recent multimer training PR 2023-08-03 11:38:07 -04:00