ca1d9b482-mac

result.json

total: 50, pass: 45, fail: 5

update docs

• commit: ca1d9b482a847f6aa562d8f7bf5f376c8b6d529b
• platform: macOS-14.3.1-arm64-arm-64bit
• ragit version: ragit 0.4.0-dev
• rustc version: rustc 1.87.0-nightly (f9e0239a7 2025-03-04)
• cargo version: cargo 1.87.0-nightly (2622e844b 2025-02-28)
• python version: 3.9.6
• tested at: 2025-04-03T11:32:16.038744Z (72 days ago)
• total elapsed time: 4,488,086 ms

TOC

1. cargo_tests  
2. add_and_rm  
3. add_and_rm2  
4. ignore  
5. recover  
6. clone  
7. clone2  
8. server  
9. cli  
10. archive  
11. many_chunks  
12. many_jobs  
13. ls  
14. meta  
15. symlink  
16. ii  
17. cat_file  
18. images  
19. markdown_reader  
20. csv_reader  
21. subdir  
22. tfidf  
23. merge  
24. external_bases  
25. end_to_end dummy  
26. end_to_end llama3.3-70b  
27. audit llama3.3-70b  
28. logs llama3.3-70b  
29. prompts dummy  
30. prompts gpt-4o-mini  
31. prompts claude-3.5-sonnet  
32. empty dummy  
33. empty llama3.3-70b  
34. server2 dummy  
35. server2 llama3.3-70b  
36. images2 gpt-4o-mini  
37. images3 gpt-4o-mini  
38. web_images gpt-4o-mini  
39. images2 claude-3.5-sonnet  
40. extract_keywords dummy  
41. extract_keywords gpt-4o-mini  
42. orphan_process llama3.3-70b  
43. write_lock llama3.3-70b  
44. ragit_api command-r  
45. query_options llama3.3-70b  
46. models_init  
47. test_home_config_override  
48. migrate  
49. migrate2  
50. config  

Cases

elapsed time: 378,318 ms

history

elapsed time: 120,516 ms

history

elapsed time: 41,735 ms

history

elapsed time: 13,114 ms

history

elapsed time: 11,332 ms

history

elapsed time: 3,184 ms

Command '['cargo', 'run', '--release', '--', 'push', '--remote=http://127.0.0.1/test-user/repo1']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 538, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/clone.py", line 53, in clone
    cargo_run(["push", "--remote=http://127.0.0.1/test-user/repo1"])
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/utils.py", line 66, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'push', '--remote=http://127.0.0.1/test-user/repo1']' returned non-zero exit status 1.

history

elapsed time: 7,909 ms

history

elapsed time: 308,578 ms

Command '['cargo', 'run', '--release', '--', 'push', '--configs', '--prompts', '--remote=http://127.0.0.1/test-user/sample-empty/']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 538, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/server.py", line 61, in server
    cargo_run(["push", "--configs", "--prompts", f"--remote=http://127.0.0.1/test-user/{repo}/"])
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/utils.py", line 66, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'push', '--configs', '--prompts', '--remote=http://127.0.0.1/test-user/sample-empty/']' returned non-zero exit status 1.

history

elapsed time: 22,607 ms

history

elapsed time: 428,233 ms

history

elapsed time: 634,335 ms

history

elapsed time: 55,290 ms

history

elapsed time: 337,041 ms

history

elapsed time: 6,787 ms

history

elapsed time: 9,373 ms

history

elapsed time: 120,107 ms

tfidf result on term 'search gpg annot select correspond' is not close enough. error: `approximation[2] not in answer`, answer: ['3e0d93ece16c10490435c08b7b755db9a57e53b818a9e62c0000000100000fa3', 'c5719c769542cb0cde49558784948082703f2da9618c29d80000000100000fb3', '6d1b2eeef26e5ce9672e62a7ca43412c66b86ad0e48d27620000000100000fa0', '606389435f969a017ad1cf63a7a30eba0d1a08c743efea9f0000000100000318', 'f386d96798aad5baf548b6985b367932bdc89483b756b515000000010000081f', 'c66345d5ab119b4cf05a6899472b54a4fd0041ee2b83b9f80000000100000fa2', 'bf8735875031f53ccd50e48e6674d9ac64c90f68bb0c7edb0000000100000fa0', '509b4b369f9f9729365a6947ce43335209d934562feeb7220000000100000fa2', '82ad9747a31109a3ef965e4168a0968cb56a448390416e290000000100000bf5', 'b632241f25a98c9320097079669e1acd10afd534e67ec2600000000100000fa2'], approximation: ['3e0d93ece16c10490435c08b7b755db9a57e53b818a9e62c0000000100000fa3', 'b632241f25a98c9320097079669e1acd10afd534e67ec2600000000100000fa2', '90a25e1efdafffab6369490140eecabb90ab0649108feeff0000000100000cd4', 'bf8735875031f53ccd50e48e6674d9ac64c90f68bb0c7edb0000000100000fa0', '5cdbfe828a4a84a4129bda3cc32bb8376914275561fa6a1a0000000100000da8', 'c5719c769542cb0cde49558784948082703f2da9618c29d80000000100000fb3', '0833e100c47da17ca6a2d202310483ed3c08f75ec2cfbf4a0000000100000c67', '1ff3d753fa4b857385f748c5d02a7371332241a8579211f9000000010000075c', '6f305111c4ab2bb2243ce34889afb4f72dff498303da56890000000100000c1e', '6d1b2eeef26e5ce9672e62a7ca43412c66b86ad0e48d27620000000100000fa0']
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 103, in ii_worker
    raise AssertionError(f"approximation[{i}] not in answer")
AssertionError: approximation[2] not in answer

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 538, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 49, in ii
    ii_worker()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 116, in ii_worker
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'search gpg annot select correspond' is not close enough. error: `approximation[2] not in answer`, answer: ['3e0d93ece16c10490435c08b7b755db9a57e53b818a9e62c0000000100000fa3', 'c5719c769542cb0cde49558784948082703f2da9618c29d80000000100000fb3', '6d1b2eeef26e5ce9672e62a7ca43412c66b86ad0e48d27620000000100000fa0', '606389435f969a017ad1cf63a7a30eba0d1a08c743efea9f0000000100000318', 'f386d96798aad5baf548b6985b367932bdc89483b756b515000000010000081f', 'c66345d5ab119b4cf05a6899472b54a4fd0041ee2b83b9f80000000100000fa2', 'bf8735875031f53ccd50e48e6674d9ac64c90f68bb0c7edb0000000100000fa0', '509b4b369f9f9729365a6947ce43335209d934562feeb7220000000100000fa2', '82ad9747a31109a3ef965e4168a0968cb56a448390416e290000000100000bf5', 'b632241f25a98c9320097079669e1acd10afd534e67ec2600000000100000fa2'], approximation: ['3e0d93ece16c10490435c08b7b755db9a57e53b818a9e62c0000000100000fa3', 'b632241f25a98c9320097079669e1acd10afd534e67ec2600000000100000fa2', '90a25e1efdafffab6369490140eecabb90ab0649108feeff0000000100000cd4', 'bf8735875031f53ccd50e48e6674d9ac64c90f68bb0c7edb0000000100000fa0', '5cdbfe828a4a84a4129bda3cc32bb8376914275561fa6a1a0000000100000da8', 'c5719c769542cb0cde49558784948082703f2da9618c29d80000000100000fb3', '0833e100c47da17ca6a2d202310483ed3c08f75ec2cfbf4a0000000100000c67', '1ff3d753fa4b857385f748c5d02a7371332241a8579211f9000000010000075c', '6f305111c4ab2bb2243ce34889afb4f72dff498303da56890000000100000c1e', '6d1b2eeef26e5ce9672e62a7ca43412c66b86ad0e48d27620000000100000fa0']

history

elapsed time: 31,131 ms

history

elapsed time: 8,178 ms

history

elapsed time: 12,982 ms

history

elapsed time: 6,889 ms

history

elapsed time: 25,222 ms

history

elapsed time: 28,066 ms

history

elapsed time: 47,177 ms

history

elapsed time: 102,464 ms

history

elapsed time: 73,379 ms

history

elapsed time: 101,245 ms

history

elapsed time: 16,158 ms

history

elapsed time: 10,236 ms

history

elapsed time: 10,853 ms

history

elapsed time: 57,734 ms

history

elapsed time: 72,590 ms

history

elapsed time: 15,625 ms

history

elapsed time: 15,275 ms

history

elapsed time: 306,366 ms

Command '['cargo', 'run', '--release', '--', 'push', '--configs', '--remote=http://127.0.0.1/test-user/sample1']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 538, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 489, in <lambda>
    ("server2 dummy", lambda: server2(test_model="dummy")),
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/server2.py", line 33, in server2
    cargo_run(["push", "--configs", "--remote=http://127.0.0.1/test-user/sample1"])
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/utils.py", line 66, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'push', '--configs', '--remote=http://127.0.0.1/test-user/sample1']' returned non-zero exit status 1.

history

elapsed time: 305,665 ms

Command '['cargo', 'run', '--release', '--', 'push', '--configs', '--remote=http://127.0.0.1/test-user/sample1']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 538, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 490, in <lambda>
    ("server2 llama3.3-70b", lambda: server2(test_model="llama3.3-70b")),
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/server2.py", line 33, in server2
    cargo_run(["push", "--configs", "--remote=http://127.0.0.1/test-user/sample1"])
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/utils.py", line 66, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'push', '--configs', '--remote=http://127.0.0.1/test-user/sample1']' returned non-zero exit status 1.

history

elapsed time: 14,931 ms

history

elapsed time: 13,779 ms

history

elapsed time: 55,475 ms

history

elapsed time: 15,657 ms

history

elapsed time: 3,089 ms

history

elapsed time: 16,614 ms

history

elapsed time: 118,552 ms

history

elapsed time: 79,964 ms

history

elapsed time: 5,607 ms

history

elapsed time: 11,781 ms

history

elapsed time: 899 ms

history

elapsed time: 429 ms

history

elapsed time: 231,074 ms

history

elapsed time: 68,250 ms

history

elapsed time: 37,340 ms

history