Home Explore Blog CI



97b4dd02c-mac

result.json

total: 47, pass: 43, fail: 4

bump versions

TOC

  1. ignore  
  2. recover  
  3. clone  
  4. clone2  
  5. server  
  6. cli  
  7. archive  
  8. ls  
  9. meta  
  10. symlink  
  11. ii  
  12. images  
  13. subdir  
  14. tfidf  
  15. merge  
  16. migrate  

Cases

cargo_tests
 

elapsed time: 185,797 ms

history

add_and_rm
 

elapsed time: 118,952 ms

history

add_and_rm2
 

elapsed time: 38,897 ms

history

ignore
 

elapsed time: 12,837 ms

history

recover
 

elapsed time: 10,941 ms

history

clone
 

elapsed time: 3,021 ms

Error

Command '['cargo', 'run', '--release', '--', 'push', '--remote=http://127.0.0.1/test-user/repo1']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 504, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/clone.py", line 53, in clone
    cargo_run(["push", "--remote=http://127.0.0.1/test-user/repo1"])
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/utils.py", line 66, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'push', '--remote=http://127.0.0.1/test-user/repo1']' returned non-zero exit status 1.

history

clone2
 

elapsed time: 7,825 ms

history

server
 

elapsed time: 3,798 ms

Error

Command '['cargo', 'run', '--release', '--', 'push', '--configs', '--prompts', '--remote=http://127.0.0.1/test-user/repo1/']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 504, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/server.py", line 41, in server
    cargo_run(["push", "--configs", "--prompts", "--remote=http://127.0.0.1/test-user/repo1/"])
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/utils.py", line 66, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'push', '--configs', '--prompts', '--remote=http://127.0.0.1/test-user/repo1/']' returned non-zero exit status 1.

history

cli
 

elapsed time: 15,657 ms

history

archive
 

elapsed time: 415,356 ms

history

many_chunks
 

elapsed time: 673,994 ms

history

many_jobs
 

elapsed time: 49,921 ms

history

ls
 

elapsed time: 260,371 ms

history

meta
 

elapsed time: 6,682 ms

history

symlink
 

elapsed time: 10,965 ms

history

ii
 

elapsed time: 73,973 ms

Error

tfidf result on term 'term into main option prompt' is not close enough. error: `approximation[2] not in answer`, answer: ['8cd5af56b19604ebf37f2d56386a79d319b2c9fdaeb740ff0000000100000209', '97fa996b1a209732d2622109a2e7dc3932e4999a28d4556d0000000100000201', 'cce42ccb94294ffd04cfafc7996082c783232da0cb1c91d70000000100000203', '51d12ee94dcc704a9ff06dff542b90857b4c3ba4832b8fdd0000000100000201', '3659820d56ae19007e1cf89490b349285b76f5aa61add2580000000100000202', 'fc3691997880298dc1924a1c2bb49aabed8537bbf622d38e0000000100000214', 'f1c542865f65cff136e38f89256def87384be608aac3e7ed0000000100000217', 'bc6df5bd938da93b70936b91b903aa2bc1748e7a7e1e433d0000000100000200', '12f465533e678ad2c7ceff2984aae0ab607900433330f19b0000000100000200', '6c1de977cd7a1bddbecfd694e0570e39545c6acb5d9a641e0000000100000209'], approximation: ['97fa996b1a209732d2622109a2e7dc3932e4999a28d4556d0000000100000201', '6c1de977cd7a1bddbecfd694e0570e39545c6acb5d9a641e0000000100000209', '58074ce21bb649a3583b295536a669ce421915c577490abd0000000100000202', '12f465533e678ad2c7ceff2984aae0ab607900433330f19b0000000100000200', '8cd5af56b19604ebf37f2d56386a79d319b2c9fdaeb740ff0000000100000209', 'db01e0347c39fa19cd478ad136e02c3be5ae514968bfafb30000000100000200', 'cce42ccb94294ffd04cfafc7996082c783232da0cb1c91d70000000100000203', '51d12ee94dcc704a9ff06dff542b90857b4c3ba4832b8fdd0000000100000201', '9c9b79c9c2bf343e2f6058d1afa471c43a73f9cad3ad88c60000000100000203', '02e6389bb2340bd8772d0f9d5a31ceea21d17ca755b026b00000000100000200']
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 103, in ii_worker
    raise AssertionError(f"approximation[{i}] not in answer")
AssertionError: approximation[2] not in answer

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 504, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 36, in ii
    ii_worker()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 116, in ii_worker
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'term into main option prompt' is not close enough. error: `approximation[2] not in answer`, answer: ['8cd5af56b19604ebf37f2d56386a79d319b2c9fdaeb740ff0000000100000209', '97fa996b1a209732d2622109a2e7dc3932e4999a28d4556d0000000100000201', 'cce42ccb94294ffd04cfafc7996082c783232da0cb1c91d70000000100000203', '51d12ee94dcc704a9ff06dff542b90857b4c3ba4832b8fdd0000000100000201', '3659820d56ae19007e1cf89490b349285b76f5aa61add2580000000100000202', 'fc3691997880298dc1924a1c2bb49aabed8537bbf622d38e0000000100000214', 'f1c542865f65cff136e38f89256def87384be608aac3e7ed0000000100000217', 'bc6df5bd938da93b70936b91b903aa2bc1748e7a7e1e433d0000000100000200', '12f465533e678ad2c7ceff2984aae0ab607900433330f19b0000000100000200', '6c1de977cd7a1bddbecfd694e0570e39545c6acb5d9a641e0000000100000209'], approximation: ['97fa996b1a209732d2622109a2e7dc3932e4999a28d4556d0000000100000201', '6c1de977cd7a1bddbecfd694e0570e39545c6acb5d9a641e0000000100000209', '58074ce21bb649a3583b295536a669ce421915c577490abd0000000100000202', '12f465533e678ad2c7ceff2984aae0ab607900433330f19b0000000100000200', '8cd5af56b19604ebf37f2d56386a79d319b2c9fdaeb740ff0000000100000209', 'db01e0347c39fa19cd478ad136e02c3be5ae514968bfafb30000000100000200', 'cce42ccb94294ffd04cfafc7996082c783232da0cb1c91d70000000100000203', '51d12ee94dcc704a9ff06dff542b90857b4c3ba4832b8fdd0000000100000201', '9c9b79c9c2bf343e2f6058d1afa471c43a73f9cad3ad88c60000000100000203', '02e6389bb2340bd8772d0f9d5a31ceea21d17ca755b026b00000000100000200']

history

cat_file
 

elapsed time: 32,004 ms

history

images
 

elapsed time: 8,339 ms

history

markdown_reader
 

elapsed time: 13,262 ms

history

csv_reader
 

elapsed time: 7,079 ms

history

subdir
 

elapsed time: 25,557 ms

history

tfidf
 

elapsed time: 28,850 ms

history

merge
 

elapsed time: 49,227 ms

history

external_bases
 

elapsed time: 64,350 ms

history

end_to_end dummy
 

elapsed time: 167,195 ms

history

end_to_end llama3.3-70b
 

elapsed time: 182,539 ms

history

audit llama3.3-70b
 

elapsed time: 14,874 ms

history

prompts dummy
 

elapsed time: 8,943 ms

history

prompts gpt-4o-mini
 

elapsed time: 55,936 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 85,474 ms

history

empty dummy
 

elapsed time: 19,715 ms

history

empty llama3.3-70b
 

elapsed time: 20,874 ms

history

server2 dummy
 

elapsed time: 19,957 ms

history

server2 llama3.3-70b
 

elapsed time: 23,589 ms

history

images2 gpt-4o-mini
 

elapsed time: 13,792 ms

history

images3 gpt-4o-mini
 

elapsed time: 13,943 ms

history

web_images gpt-4o-mini
 

elapsed time: 30,692 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 13,904 ms

history

extract_keywords dummy
 

elapsed time: 2,767 ms

history

extract_keywords gpt-4o-mini
 

elapsed time: 10,200 ms

history

orphan_process llama3.3-70b
 

elapsed time: 116,842 ms

history

write_lock llama3.3-70b
 

elapsed time: 26,008 ms

Error

Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 504, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 469, in <lambda>
    ("write_lock llama3.3-70b", lambda: write_lock(test_model="llama3.3-70b")),
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/write_lock.py", line 38, in write_lock
    cargo_run(["build"])
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/utils.py", line 66, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.

history

ragit_api command-r
 

elapsed time: 3,129 ms

history

models_init
 

elapsed time: 959 ms

history

test_home_config_override
 

elapsed time: 437 ms

history

migrate
 

elapsed time: 235,612 ms

history

migrate2
 

elapsed time: 130,025 ms

history


<< bf63890c0-windows
0550e1646-linux >>