Home Explore Blog CI



6ae9fcff5-linux

result.json

total: 37, pass: 35, fail: 2

write docs for `--quiet` option

TOC

  1. ignore  
  2. recover  
  3. clone  
  4. clone2  
  5. cli  
  6. archive  
  7. ls  
  8. meta  
  9. symlink  
  10. ii  
  11. images  
  12. subdir  
  13. tfidf  
  14. merge  
  15. migrate  

Cases

cargo_tests
 

elapsed time: 115,621 ms

history

add_and_rm
 

elapsed time: 34,056 ms

history

add_and_rm2
 

elapsed time: 8,594 ms

history

ignore
 

elapsed time: 2,948 ms

history

recover
 

elapsed time: 2,892 ms

history

clone
 

elapsed time: 95,841 ms

history

clone2
 

elapsed time: 4,430 ms

history

cli
 

elapsed time: 3,429 ms

history

archive
 

elapsed time: 190,576 ms

history

many_chunks
 

elapsed time: 580,693 ms

history

many_jobs
 

elapsed time: 133,885 ms

history

ls
 

elapsed time: 57,499 ms

history

meta
 

elapsed time: 1,586 ms

history

symlink
 

elapsed time: 2,905 ms

history

ii
 

elapsed time: 127,068 ms

Error

tfidf result on term 'file bit' is not close enough. error: `answer[2] not in approximation`, answer: ['67a9aa5ab96ac1fbf864840e636ba712fb94c38e664884340000000100000200', '4f98c4341a1c1e58e0d3319a016da6bf2a3866aeff0aec4e0000000100000203', '62c87b79b38b0cef2e1bf1699f3beb9fa05dadc647b2c7c20000000100000200', '3ff468c629255504b26f4396374bc20de7b27ce25b79e1e00000000100000211', '03fb8fa50a27ee46979abb3af31240120f9004c18ee3babc0000000100000228', '9e32427659389711bfc3764e45299e7b2ff430db0da92ea70000000100000202', 'bafded8759c9e99107f67f1d03ee1addc7be61909eed58550000000100000200', '73a8a9e86f54bec7dab6678626c4f6da88564076977d4de60000000100000200', 'a13216c20ea27166caf0de37e9ba0e8b152aac6c305e5350000000010000020e', '7e7b04bc676e5b0356382c07edac8a103d5e7dc3dac55d6a00000001000001ab'], approximation: ['67a9aa5ab96ac1fbf864840e636ba712fb94c38e664884340000000100000200', '4f98c4341a1c1e58e0d3319a016da6bf2a3866aeff0aec4e0000000100000203', '03fb8fa50a27ee46979abb3af31240120f9004c18ee3babc0000000100000228', 'bafded8759c9e99107f67f1d03ee1addc7be61909eed58550000000100000200', 'a13216c20ea27166caf0de37e9ba0e8b152aac6c305e5350000000010000020e', 'fe2785367aa4a9382af4982ce9fb6c06ce5f29e845b9828f0000000100000209', '1da1341fa8f8011ab5e65a2c8bfe1ed192fe34bb622b28560000000100000200', '260b0d1b6384cf4dd589f005c59bc64fd9a9b078013c2ef70000000100000202', '7c36035328bdadfc7212bf853468ef3833ecc38a21e0974b0000000100000202', '5e6ef5a3692cf3e3e08cc22cf8f7501ac7a7bea69e8a0a590000000100000200']
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 102, in ii_worker
    raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[2] not in approximation

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 398, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 38, in ii
    ii_worker()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 118, in ii_worker
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'file bit' is not close enough. error: `answer[2] not in approximation`, answer: ['67a9aa5ab96ac1fbf864840e636ba712fb94c38e664884340000000100000200', '4f98c4341a1c1e58e0d3319a016da6bf2a3866aeff0aec4e0000000100000203', '62c87b79b38b0cef2e1bf1699f3beb9fa05dadc647b2c7c20000000100000200', '3ff468c629255504b26f4396374bc20de7b27ce25b79e1e00000000100000211', '03fb8fa50a27ee46979abb3af31240120f9004c18ee3babc0000000100000228', '9e32427659389711bfc3764e45299e7b2ff430db0da92ea70000000100000202', 'bafded8759c9e99107f67f1d03ee1addc7be61909eed58550000000100000200', '73a8a9e86f54bec7dab6678626c4f6da88564076977d4de60000000100000200', 'a13216c20ea27166caf0de37e9ba0e8b152aac6c305e5350000000010000020e', '7e7b04bc676e5b0356382c07edac8a103d5e7dc3dac55d6a00000001000001ab'], approximation: ['67a9aa5ab96ac1fbf864840e636ba712fb94c38e664884340000000100000200', '4f98c4341a1c1e58e0d3319a016da6bf2a3866aeff0aec4e0000000100000203', '03fb8fa50a27ee46979abb3af31240120f9004c18ee3babc0000000100000228', 'bafded8759c9e99107f67f1d03ee1addc7be61909eed58550000000100000200', 'a13216c20ea27166caf0de37e9ba0e8b152aac6c305e5350000000010000020e', 'fe2785367aa4a9382af4982ce9fb6c06ce5f29e845b9828f0000000100000209', '1da1341fa8f8011ab5e65a2c8bfe1ed192fe34bb622b28560000000100000200', '260b0d1b6384cf4dd589f005c59bc64fd9a9b078013c2ef70000000100000202', '7c36035328bdadfc7212bf853468ef3833ecc38a21e0974b0000000100000202', '5e6ef5a3692cf3e3e08cc22cf8f7501ac7a7bea69e8a0a590000000100000200']

history

cat_file
 

elapsed time: 14,845 ms

history

images
 

elapsed time: 3,927 ms

history

markdown_reader
 

elapsed time: 4,895 ms

history

csv_reader
 

elapsed time: 2,331 ms

history

subdir
 

elapsed time: 8,505 ms

history

tfidf
 

elapsed time: 9,887 ms

history

merge
 

elapsed time: 13,506 ms

history

external_bases
 

elapsed time: 49,775 ms

history

end_to_end dummy
 

elapsed time: 40,583 ms

history

end_to_end llama3.3-70b
 

elapsed time: 31,909 ms

Error

Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 398, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 355, in <lambda>
    ("end_to_end llama3.3-70b", lambda: end_to_end(test_model="llama3.3-70b")),
  File "/home/baehyunsol/Documents/ragit/tests/end_to_end.py", line 88, in end_to_end
    cargo_run(["check", "--recover"])
  File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 66, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.

history

prompts dummy
 

elapsed time: 5,324 ms

history

prompts gpt-4o-mini
 

elapsed time: 48,400 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 77,685 ms

history

empty dummy
 

elapsed time: 2,610 ms

history

empty llama3.3-70b
 

elapsed time: 3,568 ms

history

images2 gpt-4o-mini
 

elapsed time: 10,819 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 9,202 ms

history

extract_keywords dummy
 

elapsed time: 1,699 ms

history

extract_keywords gpt-4o-mini
 

elapsed time: 7,943 ms

history

ragit_api command-r
 

elapsed time: 1,772 ms

history

migrate
 

elapsed time: 92,319 ms

history

migrate2
 

elapsed time: 608,572 ms

history


<< 499147737-linux
976387664-mac >>