Home Explore Blog CI



90d1f221f-mac

result.json

total: 50, pass: 48, fail: 2

add status message to `tests/cargo_tests.py`

TOC

  1. ignore  
  2. recover  
  3. clone  
  4. clone2  
  5. server  
  6. cli  
  7. archive  
  8. ls  
  9. meta  
  10. symlink  
  11. ii  
  12. images  
  13. subdir  
  14. tfidf  
  15. merge  
  16. migrate  
  17. config  

Cases

cargo_tests
 

elapsed time: 290,888 ms

history

add_and_rm
 

elapsed time: 119,331 ms

history

add_and_rm2
 

elapsed time: 41,804 ms

history

ignore
 

elapsed time: 13,138 ms

history

recover
 

elapsed time: 11,181 ms

history

clone
 

elapsed time: 68,266 ms

history

clone2
 

elapsed time: 6,968 ms

history

server
 

elapsed time: 370,520 ms

history

cli
 

elapsed time: 21,974 ms

history

archive
 

elapsed time: 398,699 ms

history

many_chunks
 

elapsed time: 611,704 ms

history

many_jobs
 

elapsed time: 53,704 ms

history

ls
 

elapsed time: 269,468 ms

history

meta
 

elapsed time: 6,611 ms

history

symlink
 

elapsed time: 9,446 ms

history

ii
 

elapsed time: 76,432 ms

Error

tfidf result on term 'index bit' is not close enough. error: `answer[2] not in approximation`, answer: ['67a9aa5ab96ac1fbf864840e636ba712fb94c38e664884340000000100000200', '4f98c4341a1c1e58e0d3319a016da6bf2a3866aeff0aec4e0000000100000203', '84f73637f6b047d40de0119f8b324bc22311833ce7ad8b740000000100000206', '7d4de8382ff1f4f6ff46958bb58160a6056b4036886f4095000000010000020c', '14c727affd6c6d5ad0ef8e0b96fe1dd1dd9a6b990d2208b20000000100000206', '9eba4fcd4da97f011faca64a1987433c6c56aae64b3f1f660000000100000200', '4d747c0a72fc372c3ac313636cace24201628166a54bc6470000000100000201', 'e6d61827ae35a73b03e0681fa685156ca44ebb8fd82d82ce0000000100000201', 'aef519ca2bda08440e33e2f84c3a1f7cff31a0bd5bd94c120000000100000200', '200bc1cb317e9877236e85abc331b191e6fa4046098e61540000000100000205'], approximation: ['67a9aa5ab96ac1fbf864840e636ba712fb94c38e664884340000000100000200', '4f98c4341a1c1e58e0d3319a016da6bf2a3866aeff0aec4e0000000100000203', '7d4de8382ff1f4f6ff46958bb58160a6056b4036886f4095000000010000020c', '14c727affd6c6d5ad0ef8e0b96fe1dd1dd9a6b990d2208b20000000100000206', '9eba4fcd4da97f011faca64a1987433c6c56aae64b3f1f660000000100000200', 'e6d61827ae35a73b03e0681fa685156ca44ebb8fd82d82ce0000000100000201', 'aef519ca2bda08440e33e2f84c3a1f7cff31a0bd5bd94c120000000100000200', '200bc1cb317e9877236e85abc331b191e6fa4046098e61540000000100000205', '581b8316abc587e68b614b69c25e9c15e29fe5a8affc67850000000100000200', '73a8a9e86f54bec7dab6678626c4f6da88564076977d4de60000000100000200']
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 100, in ii_worker
    raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[2] not in approximation

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 538, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 36, in ii
    ii_worker()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 116, in ii_worker
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'index bit' is not close enough. error: `answer[2] not in approximation`, answer: ['67a9aa5ab96ac1fbf864840e636ba712fb94c38e664884340000000100000200', '4f98c4341a1c1e58e0d3319a016da6bf2a3866aeff0aec4e0000000100000203', '84f73637f6b047d40de0119f8b324bc22311833ce7ad8b740000000100000206', '7d4de8382ff1f4f6ff46958bb58160a6056b4036886f4095000000010000020c', '14c727affd6c6d5ad0ef8e0b96fe1dd1dd9a6b990d2208b20000000100000206', '9eba4fcd4da97f011faca64a1987433c6c56aae64b3f1f660000000100000200', '4d747c0a72fc372c3ac313636cace24201628166a54bc6470000000100000201', 'e6d61827ae35a73b03e0681fa685156ca44ebb8fd82d82ce0000000100000201', 'aef519ca2bda08440e33e2f84c3a1f7cff31a0bd5bd94c120000000100000200', '200bc1cb317e9877236e85abc331b191e6fa4046098e61540000000100000205'], approximation: ['67a9aa5ab96ac1fbf864840e636ba712fb94c38e664884340000000100000200', '4f98c4341a1c1e58e0d3319a016da6bf2a3866aeff0aec4e0000000100000203', '7d4de8382ff1f4f6ff46958bb58160a6056b4036886f4095000000010000020c', '14c727affd6c6d5ad0ef8e0b96fe1dd1dd9a6b990d2208b20000000100000206', '9eba4fcd4da97f011faca64a1987433c6c56aae64b3f1f660000000100000200', 'e6d61827ae35a73b03e0681fa685156ca44ebb8fd82d82ce0000000100000201', 'aef519ca2bda08440e33e2f84c3a1f7cff31a0bd5bd94c120000000100000200', '200bc1cb317e9877236e85abc331b191e6fa4046098e61540000000100000205', '581b8316abc587e68b614b69c25e9c15e29fe5a8affc67850000000100000200', '73a8a9e86f54bec7dab6678626c4f6da88564076977d4de60000000100000200']

history

cat_file
 

elapsed time: 31,720 ms

history

images
 

elapsed time: 8,321 ms

history

markdown_reader
 

elapsed time: 13,094 ms

history

csv_reader
 

elapsed time: 6,930 ms

history

subdir
 

elapsed time: 24,997 ms

history

tfidf
 

elapsed time: 27,854 ms

history

merge
 

elapsed time: 46,804 ms

history

external_bases
 

elapsed time: 111,096 ms

history

end_to_end dummy
 

elapsed time: 70,670 ms

history

end_to_end llama3.3-70b
 

elapsed time: 98,696 ms

history

audit llama3.3-70b
 

elapsed time: 17,208 ms

history

logs llama3.3-70b
 

elapsed time: 9,071 ms

history

prompts dummy
 

elapsed time: 9,027 ms

history

prompts gpt-4o-mini
 

elapsed time: 50,668 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 67,243 ms

history

empty dummy
 

elapsed time: 9,532 ms

history

empty llama3.3-70b
 

elapsed time: 10,781 ms

history

server2 dummy
 

elapsed time: 6,458 ms

history

server2 llama3.3-70b
 

elapsed time: 30,554 ms

history

images2 gpt-4o-mini
 

elapsed time: 13,214 ms

history

images3 gpt-4o-mini
 

elapsed time: 13,573 ms

history

web_images gpt-4o-mini
 

elapsed time: 58,897 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 13,122 ms

history

extract_keywords dummy
 

elapsed time: 2,813 ms

history

extract_keywords gpt-4o-mini
 

elapsed time: 10,368 ms

history

orphan_process llama3.3-70b
 

elapsed time: 116,602 ms

history

write_lock llama3.3-70b
 

elapsed time: 26,372 ms

Error

Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 538, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 501, in <lambda>
    ("write_lock llama3.3-70b", lambda: write_lock(test_model="llama3.3-70b")),
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/write_lock.py", line 38, in write_lock
    cargo_run(["build"])
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/utils.py", line 66, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.

history

ragit_api command-r
 

elapsed time: 7,631 ms

history

query_options llama3.3-70b
 

elapsed time: 10,829 ms

history

models_init
 

elapsed time: 999 ms

history

test_home_config_override
 

elapsed time: 447 ms

history

migrate
 

elapsed time: 243,202 ms

history

migrate2
 

elapsed time: 68,852 ms

history

config
 

elapsed time: 39,173 ms

history


<< 239d2df2c-linux
ca1d9b482-mac >>