total: 39, pass: 37, fail: 2
update commit hash
Also added 0.3.1 to `commit_hashes`.
elapsed time: 118,156 ms
elapsed time: 33,301 ms
elapsed time: 8,514 ms
elapsed time: 2,963 ms
elapsed time: 2,902 ms
elapsed time: 93,616 ms
elapsed time: 3,755 ms
elapsed time: 3,432 ms
elapsed time: 190,518 ms
elapsed time: 580,877 ms
elapsed time: 139,912 ms
elapsed time: 66,918 ms
elapsed time: 1,595 ms
elapsed time: 2,905 ms
elapsed time: 137,528 ms
tfidf result on term 'main crate build into all' is not close enough. error: `approximation[1] not in answer`, answer: ['799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', '0d4fafb4e2410e369b8b2b01f1028098af982abdb891a6790000000100000207', '7689aa16093bee7c396f30d25cb8a512ea7cec4bf45f42060000000100000204', '01632c8715a20988f1d1ee95aa8d5cd1fc4c7c0e7b70c4570000000100000205', '07edccd7468f00ef416e169bb45eeec81e91e583cce8aa8e0000000100000200', '787e2c52575c48133ffde911106c06bba30603371f754ef20000000100000212', '52071601888dbbfd851b3188ad73454b2f566441d31c871e0000000100000207', '73f3b15a8d584c9252dc807e7d72f355852318257b12dac60000000100000200', '344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205'], approximation: ['344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205', '959571cc4d4ddd87dbd356ec2c47db33e21828f5d9b9a4d90000000100000205', '4067940b7279a68d63d39f24f3fb04cf5b6b25c9211bec820000000100000203', '6e7981be3fbc8db066f1bc4bbe0a2ddc2125df397c253a030000000100000204', '799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'b339028f8314802ef2d037e64b6fcb5ac5680baee8188e720000000100000217', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', 'b6f621988c1c030bcb6f6b25e048c83897eb707c7bfec17800000001000001ec', 'a4108b3bb5b84d19c62119cca82b25dafa5d69617af38ae70000000100000174', 'f53abaa5da04cc7b686f73ab29e6e6161ac05f5f1ff449d2000000010000020b']
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 103, in ii_worker
raise AssertionError(f"approximation[{i}] not in answer")
AssertionError: approximation[1] not in answer
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 437, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 36, in ii
ii_worker()
File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 116, in ii_worker
raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'main crate build into all' is not close enough. error: `approximation[1] not in answer`, answer: ['799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', '0d4fafb4e2410e369b8b2b01f1028098af982abdb891a6790000000100000207', '7689aa16093bee7c396f30d25cb8a512ea7cec4bf45f42060000000100000204', '01632c8715a20988f1d1ee95aa8d5cd1fc4c7c0e7b70c4570000000100000205', '07edccd7468f00ef416e169bb45eeec81e91e583cce8aa8e0000000100000200', '787e2c52575c48133ffde911106c06bba30603371f754ef20000000100000212', '52071601888dbbfd851b3188ad73454b2f566441d31c871e0000000100000207', '73f3b15a8d584c9252dc807e7d72f355852318257b12dac60000000100000200', '344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205'], approximation: ['344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205', '959571cc4d4ddd87dbd356ec2c47db33e21828f5d9b9a4d90000000100000205', '4067940b7279a68d63d39f24f3fb04cf5b6b25c9211bec820000000100000203', '6e7981be3fbc8db066f1bc4bbe0a2ddc2125df397c253a030000000100000204', '799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'b339028f8314802ef2d037e64b6fcb5ac5680baee8188e720000000100000217', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', 'b6f621988c1c030bcb6f6b25e048c83897eb707c7bfec17800000001000001ec', 'a4108b3bb5b84d19c62119cca82b25dafa5d69617af38ae70000000100000174', 'f53abaa5da04cc7b686f73ab29e6e6161ac05f5f1ff449d2000000010000020b']
elapsed time: 13,863 ms
elapsed time: 3,930 ms
elapsed time: 4,988 ms
elapsed time: 2,339 ms
elapsed time: 8,492 ms
elapsed time: 9,996 ms
elapsed time: 13,352 ms
elapsed time: 69,731 ms
elapsed time: 41,602 ms
elapsed time: 32,832 ms
Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 437, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 390, in <lambda>
("end_to_end llama3.3-70b", lambda: end_to_end(test_model="llama3.3-70b")),
File "/home/baehyunsol/Documents/ragit/tests/end_to_end.py", line 87, in end_to_end
cargo_run(["check", "--recover"])
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 66, in cargo_run
result = subprocess.run(args, **kwargs)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.
elapsed time: 5,220 ms
elapsed time: 38,443 ms
elapsed time: 77,824 ms
elapsed time: 2,620 ms
elapsed time: 3,742 ms
elapsed time: 11,326 ms
elapsed time: 12,765 ms
elapsed time: 26,646 ms
elapsed time: 11,227 ms
elapsed time: 1,607 ms
elapsed time: 5,838 ms
elapsed time: 1,692 ms
elapsed time: 102,009 ms
elapsed time: 610,758 ms