Home Explore Blog CI



b08604d5b-linux

result.json

total: 39, pass: 37, fail: 2

refactor `ragit-server`

1. Added a helper trait `HandleError`. Now you can use `?` operators in
   methods!
2. Moved api endpoints document from `main.rs` to `README.md`.

TOC

  1. ignore  
  2. recover  
  3. clone  
  4. clone2  
  5. cli  
  6. archive  
  7. ls  
  8. meta  
  9. symlink  
  10. ii  
  11. images  
  12. subdir  
  13. tfidf  
  14. merge  
  15. migrate  

Cases

cargo_tests
 

elapsed time: 125,227 ms

history

add_and_rm
 

elapsed time: 33,575 ms

history

add_and_rm2
 

elapsed time: 8,715 ms

history

ignore
 

elapsed time: 2,969 ms

history

recover
 

elapsed time: 2,898 ms

history

clone
 

elapsed time: 93,660 ms

history

clone2
 

elapsed time: 3,762 ms

history

cli
 

elapsed time: 3,450 ms

history

archive
 

elapsed time: 189,154 ms

history

many_chunks
 

elapsed time: 579,810 ms

history

many_jobs
 

elapsed time: 138,887 ms

history

ls
 

elapsed time: 73,648 ms

history

meta
 

elapsed time: 1,591 ms

history

symlink
 

elapsed time: 2,897 ms

history

ii
 

elapsed time: 136,596 ms

Error

tfidf result on term 'main crate build into all' is not close enough. error: `approximation[1] not in answer`, answer: ['799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', '0d4fafb4e2410e369b8b2b01f1028098af982abdb891a6790000000100000207', '7689aa16093bee7c396f30d25cb8a512ea7cec4bf45f42060000000100000204', '01632c8715a20988f1d1ee95aa8d5cd1fc4c7c0e7b70c4570000000100000205', '07edccd7468f00ef416e169bb45eeec81e91e583cce8aa8e0000000100000200', '787e2c52575c48133ffde911106c06bba30603371f754ef20000000100000212', '52071601888dbbfd851b3188ad73454b2f566441d31c871e0000000100000207', '73f3b15a8d584c9252dc807e7d72f355852318257b12dac60000000100000200', '344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205'], approximation: ['344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205', '959571cc4d4ddd87dbd356ec2c47db33e21828f5d9b9a4d90000000100000205', '4067940b7279a68d63d39f24f3fb04cf5b6b25c9211bec820000000100000203', '6e7981be3fbc8db066f1bc4bbe0a2ddc2125df397c253a030000000100000204', '799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'b339028f8314802ef2d037e64b6fcb5ac5680baee8188e720000000100000217', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', 'b6f621988c1c030bcb6f6b25e048c83897eb707c7bfec17800000001000001ec', 'a4108b3bb5b84d19c62119cca82b25dafa5d69617af38ae70000000100000174', 'f53abaa5da04cc7b686f73ab29e6e6161ac05f5f1ff449d2000000010000020b']
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 103, in ii_worker
    raise AssertionError(f"approximation[{i}] not in answer")
AssertionError: approximation[1] not in answer

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 437, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 36, in ii
    ii_worker()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 116, in ii_worker
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'main crate build into all' is not close enough. error: `approximation[1] not in answer`, answer: ['799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', '0d4fafb4e2410e369b8b2b01f1028098af982abdb891a6790000000100000207', '7689aa16093bee7c396f30d25cb8a512ea7cec4bf45f42060000000100000204', '01632c8715a20988f1d1ee95aa8d5cd1fc4c7c0e7b70c4570000000100000205', '07edccd7468f00ef416e169bb45eeec81e91e583cce8aa8e0000000100000200', '787e2c52575c48133ffde911106c06bba30603371f754ef20000000100000212', '52071601888dbbfd851b3188ad73454b2f566441d31c871e0000000100000207', '73f3b15a8d584c9252dc807e7d72f355852318257b12dac60000000100000200', '344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205'], approximation: ['344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205', '959571cc4d4ddd87dbd356ec2c47db33e21828f5d9b9a4d90000000100000205', '4067940b7279a68d63d39f24f3fb04cf5b6b25c9211bec820000000100000203', '6e7981be3fbc8db066f1bc4bbe0a2ddc2125df397c253a030000000100000204', '799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'b339028f8314802ef2d037e64b6fcb5ac5680baee8188e720000000100000217', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', 'b6f621988c1c030bcb6f6b25e048c83897eb707c7bfec17800000001000001ec', 'a4108b3bb5b84d19c62119cca82b25dafa5d69617af38ae70000000100000174', 'f53abaa5da04cc7b686f73ab29e6e6161ac05f5f1ff449d2000000010000020b']

history

cat_file
 

elapsed time: 15,778 ms

history

images
 

elapsed time: 3,937 ms

history

markdown_reader
 

elapsed time: 4,922 ms

history

csv_reader
 

elapsed time: 2,338 ms

history

subdir
 

elapsed time: 8,400 ms

history

tfidf
 

elapsed time: 9,908 ms

history

merge
 

elapsed time: 13,435 ms

history

external_bases
 

elapsed time: 55,342 ms

history

end_to_end dummy
 

elapsed time: 41,503 ms

history

end_to_end llama3.3-70b
 

elapsed time: 32,854 ms

Error

Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 437, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 390, in <lambda>
    ("end_to_end llama3.3-70b", lambda: end_to_end(test_model="llama3.3-70b")),
  File "/home/baehyunsol/Documents/ragit/tests/end_to_end.py", line 87, in end_to_end
    cargo_run(["check", "--recover"])
  File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 66, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.

history

prompts dummy
 

elapsed time: 5,405 ms

history

prompts gpt-4o-mini
 

elapsed time: 55,128 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 78,381 ms

history

empty dummy
 

elapsed time: 2,603 ms

history

empty llama3.3-70b
 

elapsed time: 3,950 ms

history

images2 gpt-4o-mini
 

elapsed time: 8,598 ms

history

images3 gpt-4o-mini
 

elapsed time: 12,755 ms

history

web_images gpt-4o-mini
 

elapsed time: 22,609 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 9,701 ms

history

extract_keywords dummy
 

elapsed time: 1,592 ms

history

extract_keywords gpt-4o-mini
 

elapsed time: 7,386 ms

history

ragit_api command-r
 

elapsed time: 2,009 ms

history

migrate
 

elapsed time: 103,352 ms

history

migrate2
 

elapsed time: 640,136 ms

history


<< 8071c3063-linux
5387e6dec-mac >>