total: 50, pass: 48, fail: 2
update commit hash
elapsed time: 166,162 ms
elapsed time: 31,435 ms
elapsed time: 9,886 ms
elapsed time: 2,708 ms
elapsed time: 2,697 ms
elapsed time: 95,049 ms
elapsed time: 4,159 ms
elapsed time: 79,399 ms
elapsed time: 3,173 ms
elapsed time: 190,865 ms
elapsed time: 587,227 ms
elapsed time: 143,098 ms
elapsed time: 73,170 ms
elapsed time: 1,457 ms
elapsed time: 2,734 ms
elapsed time: 139,790 ms
tfidf result on term 'option term and max prompt' is not close enough. error: `answer[2] not in approximation`, answer: ['859fb47d1a0a9f9d6449cbb0ef90493d3e8214fd4fb1197d0000000100000200', '6cf9a06a68fc872599477b563e2702f3f6286f8b1c55742f0000000100000201', '450a5eae9cc6757966842901dbea3eaa34fb9a31bba41e600000000100000208', 'd156f6b497cb7caf3815431a639df57879a98d2ace222b080000000100000200', 'fac67afb13664044ae2058cc6e675dcb4783448b2f81bf320000000100000203', 'a71839b2358e19e146f760d87bf4096a9311603d30d61d200000000100000200', '2abe4848e274bc72fc988da303ca76d8a2986df530f256890000000100000200', '74e0560294c701c12135cbd57b716cfc0f62c4aaadcbb08d0000000100000200', 'bc6df5bd938da93b70936b91b903aa2bc1748e7a7e1e433d0000000100000200', '2a52e440eaff4b85ce68285cb275a339e584b0e2e73573e90000000100000200'], approximation: ['859fb47d1a0a9f9d6449cbb0ef90493d3e8214fd4fb1197d0000000100000200', 'fac67afb13664044ae2058cc6e675dcb4783448b2f81bf320000000100000203', 'ecd7d325413ff3a2b877a19ef18df5a3659f9d63d23d845700000001000001f9', '866807711fd9d99bb0a8b4daef8dd6f468274dcd191c1a9a0000000100000201', 'a71839b2358e19e146f760d87bf4096a9311603d30d61d200000000100000200', '6cf9a06a68fc872599477b563e2702f3f6286f8b1c55742f0000000100000201', '264990888f431b1ff8e07c56334805d28ae627ff33a058ff0000000100000217', '2a52e440eaff4b85ce68285cb275a339e584b0e2e73573e90000000100000200', 'bc6df5bd938da93b70936b91b903aa2bc1748e7a7e1e433d0000000100000200', '29e603c73ac0ec8b39683b715d91663bdb92bb646a823f610000000100000204']
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 100, in ii_worker
raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[2] not in approximation
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 538, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 36, in ii
ii_worker()
File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 116, in ii_worker
raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'option term and max prompt' is not close enough. error: `answer[2] not in approximation`, answer: ['859fb47d1a0a9f9d6449cbb0ef90493d3e8214fd4fb1197d0000000100000200', '6cf9a06a68fc872599477b563e2702f3f6286f8b1c55742f0000000100000201', '450a5eae9cc6757966842901dbea3eaa34fb9a31bba41e600000000100000208', 'd156f6b497cb7caf3815431a639df57879a98d2ace222b080000000100000200', 'fac67afb13664044ae2058cc6e675dcb4783448b2f81bf320000000100000203', 'a71839b2358e19e146f760d87bf4096a9311603d30d61d200000000100000200', '2abe4848e274bc72fc988da303ca76d8a2986df530f256890000000100000200', '74e0560294c701c12135cbd57b716cfc0f62c4aaadcbb08d0000000100000200', 'bc6df5bd938da93b70936b91b903aa2bc1748e7a7e1e433d0000000100000200', '2a52e440eaff4b85ce68285cb275a339e584b0e2e73573e90000000100000200'], approximation: ['859fb47d1a0a9f9d6449cbb0ef90493d3e8214fd4fb1197d0000000100000200', 'fac67afb13664044ae2058cc6e675dcb4783448b2f81bf320000000100000203', 'ecd7d325413ff3a2b877a19ef18df5a3659f9d63d23d845700000001000001f9', '866807711fd9d99bb0a8b4daef8dd6f468274dcd191c1a9a0000000100000201', 'a71839b2358e19e146f760d87bf4096a9311603d30d61d200000000100000200', '6cf9a06a68fc872599477b563e2702f3f6286f8b1c55742f0000000100000201', '264990888f431b1ff8e07c56334805d28ae627ff33a058ff0000000100000217', '2a52e440eaff4b85ce68285cb275a339e584b0e2e73573e90000000100000200', 'bc6df5bd938da93b70936b91b903aa2bc1748e7a7e1e433d0000000100000200', '29e603c73ac0ec8b39683b715d91663bdb92bb646a823f610000000100000204']
elapsed time: 14,410 ms
elapsed time: 3,798 ms
elapsed time: 4,770 ms
elapsed time: 2,122 ms
elapsed time: 8,063 ms
elapsed time: 9,370 ms
elapsed time: 12,537 ms
elapsed time: 68,635 ms
elapsed time: 41,280 ms
elapsed time: 78,252 ms
elapsed time: 6,272 ms
elapsed time: 4,313 ms
elapsed time: 4,290 ms
elapsed time: 43,356 ms
elapsed time: 82,685 ms
elapsed time: 2,442 ms
elapsed time: 3,543 ms
elapsed time: 4,950 ms
elapsed time: 24,312 ms
elapsed time: 8,617 ms
elapsed time: 9,428 ms
elapsed time: 27,356 ms
elapsed time: 13,043 ms
elapsed time: 1,518 ms
elapsed time: 7,719 ms
elapsed time: 102,210 ms
elapsed time: 48,173 ms
elapsed time: 1,908 ms
elapsed time: 7,512 ms
elapsed time: 250 ms
elapsed time: 119 ms
elapsed time: 127,101 ms
elapsed time: 107,191 ms
elapsed time: 4 ms
can only concatenate list (not "str") to list
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 538, in <module>
ended_at = datetime.now()
File "/home/baehyunsol/Documents/ragit/tests/config.py", line 13, in config
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 53, in cargo_run
args = ["cargo", "run", "--release", "--"] + args
TypeError: can only concatenate list (not "str") to list