Home Explore Blog CI



499147737-linux

result.json

total: 39, pass: 36, fail: 3

refactor

Created `constant.rs` and moved all the constant definitions to the
file.

TOC

  1. ignore  
  2. recover  
  3. clone  
  4. clone2  
  5. cli  
  6. archive  
  7. ls  
  8. meta  
  9. symlink  
  10. ii  
  11. images  
  12. subdir  
  13. tfidf  
  14. merge  
  15. migrate  

Cases

cargo_tests
 

elapsed time: 113,621 ms

history

add_and_rm
 

elapsed time: 33,591 ms

history

add_and_rm2
 

elapsed time: 8,580 ms

history

ignore
 

elapsed time: 2,954 ms

history

recover
 

elapsed time: 2,886 ms

history

clone
 

elapsed time: 95,354 ms

history

clone2
 

elapsed time: 4,384 ms

history

cli
 

elapsed time: 3,435 ms

history

archive
 

elapsed time: 189,670 ms

history

many_chunks
 

elapsed time: 590,144 ms

history

many_jobs
 

elapsed time: 121,692 ms

history

ls
 

elapsed time: 57,926 ms

history

meta
 

elapsed time: 1,589 ms

history

symlink
 

elapsed time: 2,906 ms

history

ii
 

elapsed time: 129,132 ms

Error

tfidf result on term 'uid millisecond' is not close enough. error: `answer[2] not in approximation`, answer: ['eb477fe53b995a5db3f744577d978f030b4c3441723250c20000000100000200', 'c67309f08723bad8c4a462ed6b626d64b388dbe1fdab63e70000000100000201', 'a34bb746e81c66fb626a2502664b643d85b8afc6febe57cf0000000100000200', 'ca60d537d41918ffcae596285212754f7c3e54515b6b8aea0000000100000202', 'a401c320b165cf20893a561cd09e538b29d115e5bf19a96a0000000100000200', 'aa43ab2c426432560ecfea3dfe9c18412a8c5d9eb71e47f70000000100000200', 'cc62459e21f45e9183a03d5491d04a0600b5d56a21226e0e000000010000021a', '0c27c576c15fd76248dc69f7c130690fa1ba0fd5aee9e7dc0000000100000220', '438696528797e0cea206e229c04c5e3d8ff2bd8ecb6561200000000100000201', '1a01fc72814e7e4c1241776dab4086ecb28b9ecc6b5b6af30000000100000200'], approximation: ['eb477fe53b995a5db3f744577d978f030b4c3441723250c20000000100000200', 'c67309f08723bad8c4a462ed6b626d64b388dbe1fdab63e70000000100000201', 'ca60d537d41918ffcae596285212754f7c3e54515b6b8aea0000000100000202', 'aa43ab2c426432560ecfea3dfe9c18412a8c5d9eb71e47f70000000100000200', '0c27c576c15fd76248dc69f7c130690fa1ba0fd5aee9e7dc0000000100000220', '5a9aa69519171f78b318b3c4f47c53d57d1fa61f6e6bbcea0000000100000200', 'd56d2a40441eff2319ef35902b1da831efae36466966e91f0000000100000200', '9a67f08092060d919044364700b3f66155f1f54dba67ce4d0000000100000204', 'e33951aa606d59ad1b057f66e1af0adaaa0ce063e46d3efd0000000100000202', '9bf5c562fca7d23b1d3aef33a847011e5924d4b002f373ba0000000100000203']
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 102, in ii_worker
    raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[2] not in approximation

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 402, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 38, in ii
    ii_worker()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 118, in ii_worker
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'uid millisecond' is not close enough. error: `answer[2] not in approximation`, answer: ['eb477fe53b995a5db3f744577d978f030b4c3441723250c20000000100000200', 'c67309f08723bad8c4a462ed6b626d64b388dbe1fdab63e70000000100000201', 'a34bb746e81c66fb626a2502664b643d85b8afc6febe57cf0000000100000200', 'ca60d537d41918ffcae596285212754f7c3e54515b6b8aea0000000100000202', 'a401c320b165cf20893a561cd09e538b29d115e5bf19a96a0000000100000200', 'aa43ab2c426432560ecfea3dfe9c18412a8c5d9eb71e47f70000000100000200', 'cc62459e21f45e9183a03d5491d04a0600b5d56a21226e0e000000010000021a', '0c27c576c15fd76248dc69f7c130690fa1ba0fd5aee9e7dc0000000100000220', '438696528797e0cea206e229c04c5e3d8ff2bd8ecb6561200000000100000201', '1a01fc72814e7e4c1241776dab4086ecb28b9ecc6b5b6af30000000100000200'], approximation: ['eb477fe53b995a5db3f744577d978f030b4c3441723250c20000000100000200', 'c67309f08723bad8c4a462ed6b626d64b388dbe1fdab63e70000000100000201', 'ca60d537d41918ffcae596285212754f7c3e54515b6b8aea0000000100000202', 'aa43ab2c426432560ecfea3dfe9c18412a8c5d9eb71e47f70000000100000200', '0c27c576c15fd76248dc69f7c130690fa1ba0fd5aee9e7dc0000000100000220', '5a9aa69519171f78b318b3c4f47c53d57d1fa61f6e6bbcea0000000100000200', 'd56d2a40441eff2319ef35902b1da831efae36466966e91f0000000100000200', '9a67f08092060d919044364700b3f66155f1f54dba67ce4d0000000100000204', 'e33951aa606d59ad1b057f66e1af0adaaa0ce063e46d3efd0000000100000202', '9bf5c562fca7d23b1d3aef33a847011e5924d4b002f373ba0000000100000203']

history

cat_file
 

elapsed time: 14,784 ms

history

images
 

elapsed time: 3,935 ms

history

markdown_reader
 

elapsed time: 4,891 ms

history

csv_reader
 

elapsed time: 2,314 ms

history

subdir
 

elapsed time: 8,363 ms

history

tfidf
 

elapsed time: 10,002 ms

history

merge
 

elapsed time: 13,368 ms

history

external_bases
 

elapsed time: 50,062 ms

history

end_to_end dummy
 

elapsed time: 40,562 ms

history

end_to_end gpt-4o-mini
 

elapsed time: 66,897 ms

history

prompts dummy
 

elapsed time: 5,329 ms

history

prompts gpt-4o-mini
 

elapsed time: 39,719 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 149,207 ms

history

empty dummy
 

elapsed time: 1,861 ms

history

empty gpt-4o-mini
 

elapsed time: 2,534 ms

history

images2 gpt-4o-mini
 

elapsed time: 8,206 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 35,537 ms

history

extract_keywords dummy
 

elapsed time: 1,624 ms

history

extract_keywords gpt-4o-mini
 

elapsed time: 8,143 ms

history

ragit_api llama3.2-11b-groq
 

elapsed time: 992 ms

Error

Command '['cargo', 'run', '--release', '--', '--model', 'llama3.2-11b-groq', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 402, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 370, in <lambda>
    ("ragit_api llama3.2-11b-groq", lambda: ragit_api(test_model="llama3.2-11b-groq")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'llama3.2-11b-groq', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

ragit_api command-r
 

elapsed time: 885 ms

history

ragit_api phi-4-14b-ollama
 

elapsed time: 5,164 ms

Error

Command '['cargo', 'run', '--release', '--', '--model', 'phi-4-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 402, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 372, in <lambda>
    ("ragit_api phi-4-14b-ollama", lambda: ragit_api(test_model="phi-4-14b-ollama")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'phi-4-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

migrate
 

elapsed time: 88,861 ms

history

migrate2
 

elapsed time: 601,275 ms

history


<< a53323dbc-windows
6ae9fcff5-linux >>