total: 35, pass: 31, fail: 4
draft archive 2
I fixed some bugs and added a test suite for the new commands. But there
are still bugs and rough edges.
elapsed time: 41,466 ms
elapsed time: 26,065 ms
elapsed time: 2,915 ms
elapsed time: 1,188,702 ms
elapsed time: 231,999 ms
elapsed time: 2,395 ms
elapsed time: 80,904 ms
elapsed time: 633,578 ms
elapsed time: 117,752 ms
elapsed time: 58,030 ms
elapsed time: 1,605 ms
elapsed time: 117,234 ms
tfidf result on term 'creat ragit term crate into' is not close enough. error: `answer[2] not in approximation`, answer: ['d5ee259b4afa9bc733bb562e4a9281d12343515e815202450000000100000200', '9472da43529ebdc22dd213d531a154cd2c07d079313ba5000000000100000202', '84aed5c72890ef1144cab5f96f565095c0f92ad0f660c1220000000100000203', '8c9f87cd8250d41d6cc5d0dea639d13d8fa6d6fa62a40ec8000000010000020a', '42c9887f5422714a5f3dff5e34ac38d6e2f9845c4b529a4b0000000100000200', 'dbcb7afb279f3ff09399a35658c20df4e309a2eb12134da60000000100000200', 'c2ffba3baefd33352f7ce4d503c299524d808db4a6c6cf340000000100000201', 'c3047bec8101aacb87b8831c9960646a2dddacc317f117790000000100000201', '2a3b14d52539191cf368f7ffe5357efed11eeb6826714cab0000000100000203', '555b44c69d185277b5a1191d522b2e965064ed61bca95af90000000100000204'], approximation: ['d5ee259b4afa9bc733bb562e4a9281d12343515e815202450000000100000200', '9472da43529ebdc22dd213d531a154cd2c07d079313ba5000000000100000202', 'b1c2f4c177b7adb69f3abacae813115be2ee9688628e8b9a0000000100000202', '3fad69f35fd51c692d4b4598b2b3af87c56b5df06435e179000000010000020c', 'dbcb7afb279f3ff09399a35658c20df4e309a2eb12134da60000000100000200', 'c3047bec8101aacb87b8831c9960646a2dddacc317f117790000000100000201', '555b44c69d185277b5a1191d522b2e965064ed61bca95af90000000100000204', '42c9887f5422714a5f3dff5e34ac38d6e2f9845c4b529a4b0000000100000200', '8c9f87cd8250d41d6cc5d0dea639d13d8fa6d6fa62a40ec8000000010000020a', 'c2ffba3baefd33352f7ce4d503c299524d808db4a6c6cf340000000100000201']
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 88, in ii
raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[2] not in approximation
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 368, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 104, in ii
raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'creat ragit term crate into' is not close enough. error: `answer[2] not in approximation`, answer: ['d5ee259b4afa9bc733bb562e4a9281d12343515e815202450000000100000200', '9472da43529ebdc22dd213d531a154cd2c07d079313ba5000000000100000202', '84aed5c72890ef1144cab5f96f565095c0f92ad0f660c1220000000100000203', '8c9f87cd8250d41d6cc5d0dea639d13d8fa6d6fa62a40ec8000000010000020a', '42c9887f5422714a5f3dff5e34ac38d6e2f9845c4b529a4b0000000100000200', 'dbcb7afb279f3ff09399a35658c20df4e309a2eb12134da60000000100000200', 'c2ffba3baefd33352f7ce4d503c299524d808db4a6c6cf340000000100000201', 'c3047bec8101aacb87b8831c9960646a2dddacc317f117790000000100000201', '2a3b14d52539191cf368f7ffe5357efed11eeb6826714cab0000000100000203', '555b44c69d185277b5a1191d522b2e965064ed61bca95af90000000100000204'], approximation: ['d5ee259b4afa9bc733bb562e4a9281d12343515e815202450000000100000200', '9472da43529ebdc22dd213d531a154cd2c07d079313ba5000000000100000202', 'b1c2f4c177b7adb69f3abacae813115be2ee9688628e8b9a0000000100000202', '3fad69f35fd51c692d4b4598b2b3af87c56b5df06435e179000000010000020c', 'dbcb7afb279f3ff09399a35658c20df4e309a2eb12134da60000000100000200', 'c3047bec8101aacb87b8831c9960646a2dddacc317f117790000000100000201', '555b44c69d185277b5a1191d522b2e965064ed61bca95af90000000100000204', '42c9887f5422714a5f3dff5e34ac38d6e2f9845c4b529a4b0000000100000200', '8c9f87cd8250d41d6cc5d0dea639d13d8fa6d6fa62a40ec8000000010000020a', 'c2ffba3baefd33352f7ce4d503c299524d808db4a6c6cf340000000100000201']
elapsed time: 14,464 ms
elapsed time: 3,652 ms
elapsed time: 4,918 ms
elapsed time: 2,343 ms
elapsed time: 7,255 ms
elapsed time: 8,368 ms
elapsed time: 12,643 ms
elapsed time: 47,791 ms
elapsed time: 27,161 ms
elapsed time: 52,276 ms
elapsed time: 5,144 ms
elapsed time: 54,542 ms
elapsed time: 300,178 ms
elapsed time: 1,489 ms
elapsed time: 2,358 ms
elapsed time: 9,925 ms
elapsed time: 10,843 ms
elapsed time: 20,197 ms
elapsed time: 27,572 ms
elapsed time: 972 ms
Command '['cargo', 'run', '--release', '--', '--model', 'llama3.2-11b-groq', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 368, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 337, in <lambda>
("ragit_api llama3.2-11b-groq", lambda: ragit_api(test_model="llama3.2-11b-groq")),
File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'llama3.2-11b-groq', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
elapsed time: 154 ms
Command '['cargo', 'run', '--release', '--', '--model', 'command-r', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 368, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 338, in <lambda>
("ragit_api command-r", lambda: ragit_api(test_model="command-r")),
File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'command-r', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
elapsed time: 5,149 ms
Command '['cargo', 'run', '--release', '--', '--model', 'phi-4-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 368, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 339, in <lambda>
("ragit_api phi-4-14b-ollama", lambda: ragit_api(test_model="phi-4-14b-ollama")),
File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'phi-4-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
elapsed time: 42,010 ms