c6f1d1ec3-linux

result.json

total: 35, pass: 30, fail: 5

impl `archive-create` and `archive-extract`

Now it can extract prompts and configs, and it passes the test. I can
say it's complete!

• commit: c6f1d1ec37926c53c93dfe002216df951b3b7aa4
• platform: Linux-5.15.0-130-generic-x86_64-with-glibc2.35
• ragit version: ragit 0.3.0-dev
• rustc version: rustc 1.84.1 (e71f9a9a9 2025-01-27)
• cargo version: cargo 1.84.1 (66221abde 2024-11-19)
• python version: 3.10.12
• tested at: 2025-02-15T19:25:27.035811Z (143 days ago)
• total elapsed time: 3,559,549 ms

TOC

1. cargo_tests  
2. add_and_rm  
3. recover  
4. clone  
5. clone2  
6. cli  
7. archive  
8. many_chunks  
9. many_jobs  
10. ls  
11. meta  
12. ii  
13. cat_file  
14. images  
15. markdown_reader  
16. csv_reader  
17. subdir  
18. tfidf  
19. merge  
20. external_bases  
21. end_to_end dummy  
22. end_to_end gpt-4o-mini  
23. prompts dummy  
24. prompts gpt-4o-mini  
25. prompts claude-3.5-sonnet  
26. empty dummy  
27. empty gpt-4o-mini  
28. images2 gpt-4o-mini  
29. images2 claude-3.5-sonnet  
30. extract_keywords dummy  
31. extract_keywords gpt-4o-mini  
32. ragit_api llama3.2-11b-groq  
33. ragit_api command-r  
34. ragit_api phi-4-14b-ollama  
35. migrate  

Cases

elapsed time: 113,555 ms

history

elapsed time: 27,422 ms

history

elapsed time: 2,921 ms

history

elapsed time: 1,492,282 ms

history

elapsed time: 227,039 ms

history

elapsed time: 2,399 ms

history

elapsed time: 93,183 ms

history

elapsed time: 644,883 ms

history

elapsed time: 123,309 ms

history

elapsed time: 58,692 ms

history

elapsed time: 1,607 ms

history

elapsed time: 117,485 ms

tfidf result on term '2 ragit term crate into' is not close enough. error: `answer[2] not in approximation`, answer: ['d5ee259b4afa9bc733bb562e4a9281d12343515e815202450000000100000200', 'd293c9149515dd7c04129ef94b1791628fbc006d25ada940000000010000021e', '84aed5c72890ef1144cab5f96f565095c0f92ad0f660c1220000000100000203', '9472da43529ebdc22dd213d531a154cd2c07d079313ba5000000000100000202', '465b1e1adb577100aa2b865be1baa3c6755c5e0b0b48dafc00000001000001d0', 'ac8690a258bc98a854a99a2512f4b17d8de51161f694ea5c000000010000020e', 'd4917c9e8e760256736d7c05629b59e9c9b9701956973ae70000000100000219', 'a121c704fa7a939f4fb37298bc286f32ddc8c5267decd25d0000000100000202', '6a6d03257b84a48be255b98134b39f1f4e92f51d2d7b9bf80000000100000203', 'd5368126b70297e71e9f1d14a62abf20e14e4b2d65a2b6b60000000100000209'], approximation: ['d293c9149515dd7c04129ef94b1791628fbc006d25ada940000000010000021e', 'd4917c9e8e760256736d7c05629b59e9c9b9701956973ae70000000100000219', 'd5ee259b4afa9bc733bb562e4a9281d12343515e815202450000000100000200', '774dbc28ac14c24848625e6d76b8f694df61a757c35e7c010000000100000203', '7530692c0030c33b58aa9916e7b8a6d7202ef9597c01de8d0000000100000216', 'f904926c1393dcaa00f5db46b16cc959d17aa616093cf0bd0000000100000216', '964519d4e91635411905103bc03a40da9c6867e443bde89c0000000100000207', 'f13dfcfee4a0f4b756e9c743d22c2ca01dcacf7946e422320000000100000205', '349f430bb7db8f8592b6d6c8154b1cf36dbfddd93d0e6c900000000100000200', '6a6d03257b84a48be255b98134b39f1f4e92f51d2d7b9bf80000000100000203']
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 88, in ii
    raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[2] not in approximation

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 368, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 104, in ii
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term '2 ragit term crate into' is not close enough. error: `answer[2] not in approximation`, answer: ['d5ee259b4afa9bc733bb562e4a9281d12343515e815202450000000100000200', 'd293c9149515dd7c04129ef94b1791628fbc006d25ada940000000010000021e', '84aed5c72890ef1144cab5f96f565095c0f92ad0f660c1220000000100000203', '9472da43529ebdc22dd213d531a154cd2c07d079313ba5000000000100000202', '465b1e1adb577100aa2b865be1baa3c6755c5e0b0b48dafc00000001000001d0', 'ac8690a258bc98a854a99a2512f4b17d8de51161f694ea5c000000010000020e', 'd4917c9e8e760256736d7c05629b59e9c9b9701956973ae70000000100000219', 'a121c704fa7a939f4fb37298bc286f32ddc8c5267decd25d0000000100000202', '6a6d03257b84a48be255b98134b39f1f4e92f51d2d7b9bf80000000100000203', 'd5368126b70297e71e9f1d14a62abf20e14e4b2d65a2b6b60000000100000209'], approximation: ['d293c9149515dd7c04129ef94b1791628fbc006d25ada940000000010000021e', 'd4917c9e8e760256736d7c05629b59e9c9b9701956973ae70000000100000219', 'd5ee259b4afa9bc733bb562e4a9281d12343515e815202450000000100000200', '774dbc28ac14c24848625e6d76b8f694df61a757c35e7c010000000100000203', '7530692c0030c33b58aa9916e7b8a6d7202ef9597c01de8d0000000100000216', 'f904926c1393dcaa00f5db46b16cc959d17aa616093cf0bd0000000100000216', '964519d4e91635411905103bc03a40da9c6867e443bde89c0000000100000207', 'f13dfcfee4a0f4b756e9c743d22c2ca01dcacf7946e422320000000100000205', '349f430bb7db8f8592b6d6c8154b1cf36dbfddd93d0e6c900000000100000200', '6a6d03257b84a48be255b98134b39f1f4e92f51d2d7b9bf80000000100000203']

history

elapsed time: 14,732 ms

history

elapsed time: 3,659 ms

history

elapsed time: 5,121 ms

history

elapsed time: 2,336 ms

history

elapsed time: 7,466 ms

history

elapsed time: 8,964 ms

history

elapsed time: 12,514 ms

history

elapsed time: 49,207 ms

history

elapsed time: 39,399 ms

history

elapsed time: 71,950 ms

history

elapsed time: 5,175 ms

history

elapsed time: 51,634 ms

history

elapsed time: 115,545 ms

Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 368, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 325, in <lambda>
    ("prompts claude-3.5-sonnet", lambda: prompts(test_model="claude-3.5-sonnet")),
  File "/home/baehyunsol/Documents/ragit/tests/prompts.py", line 34, in prompts
    cargo_run(["build"])
  File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 65, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.

history

elapsed time: 1,501 ms

history

elapsed time: 3,107 ms

history

elapsed time: 13,855 ms

history

elapsed time: 73,557 ms

history

elapsed time: 19,658 ms

history

elapsed time: 29,422 ms

history

elapsed time: 993 ms

Command '['cargo', 'run', '--release', '--', '--model', 'llama3.2-11b-groq', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 368, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 337, in <lambda>
    ("ragit_api llama3.2-11b-groq", lambda: ragit_api(test_model="llama3.2-11b-groq")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'llama3.2-11b-groq', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

elapsed time: 145 ms

Command '['cargo', 'run', '--release', '--', '--model', 'command-r', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 368, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 338, in <lambda>
    ("ragit_api command-r", lambda: ragit_api(test_model="command-r")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'command-r', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

elapsed time: 5,148 ms

Command '['cargo', 'run', '--release', '--', '--model', 'phi-4-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 368, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 339, in <lambda>
    ("ragit_api phi-4-14b-ollama", lambda: ragit_api(test_model="phi-4-14b-ollama")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'phi-4-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

elapsed time: 95,498 ms

history