Home Explore Blog CI



5387e6dec-mac

result.json

total: 42, pass: 41, fail: 1

add `tests/server.py`

TOC

  1. ignore  
  2. recover  
  3. clone  
  4. clone2  
  5. server  
  6. cli  
  7. archive  
  8. ls  
  9. meta  
  10. symlink  
  11. ii  
  12. images  
  13. subdir  
  14. tfidf  
  15. merge  
  16. migrate  

Cases

cargo_tests
 

elapsed time: 237,984 ms

history

add_and_rm
 

elapsed time: 126,497 ms

history

add_and_rm2
 

elapsed time: 34,445 ms

history

ignore
 

elapsed time: 13,889 ms

history

recover
 

elapsed time: 11,698 ms

history

clone
 

elapsed time: 61,682 ms

history

clone2
 

elapsed time: 6,645 ms

history

server
 

elapsed time: 370,689 ms

history

cli
 

elapsed time: 16,028 ms

history

archive
 

elapsed time: 412,712 ms

history

many_chunks
 

elapsed time: 707,679 ms

history

many_jobs
 

elapsed time: 48,260 ms

history

ls
 

elapsed time: 347,048 ms

history

meta
 

elapsed time: 7,177 ms

history

symlink
 

elapsed time: 10,277 ms

history

ii
 

elapsed time: 75,262 ms

Error

tfidf result on term 'crate main build into all' is not close enough. error: `approximation[1] not in answer`, answer: ['799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', '0d4fafb4e2410e369b8b2b01f1028098af982abdb891a6790000000100000207', '7689aa16093bee7c396f30d25cb8a512ea7cec4bf45f42060000000100000204', '01632c8715a20988f1d1ee95aa8d5cd1fc4c7c0e7b70c4570000000100000205', '07edccd7468f00ef416e169bb45eeec81e91e583cce8aa8e0000000100000200', '787e2c52575c48133ffde911106c06bba30603371f754ef20000000100000212', '52071601888dbbfd851b3188ad73454b2f566441d31c871e0000000100000207', '73f3b15a8d584c9252dc807e7d72f355852318257b12dac60000000100000200', '344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205'], approximation: ['344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205', '0280d49b1308e37a67c22969ab99bf3aecebda7511b583040000000100000214', '959571cc4d4ddd87dbd356ec2c47db33e21828f5d9b9a4d90000000100000205', 'b339028f8314802ef2d037e64b6fcb5ac5680baee8188e720000000100000217', '799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', 'b3fb241e2bdcb85ea72edc4bd3a063b13d9121058c2523d600000001000001ab', '6e1a3ddbf0402ea96c366c66295a909805302b20fa8013b7000000010000012a', 'd58a4a1947d256486ade8fc6ed56473a8d3884af84854bf60000000100000204', '7689aa16093bee7c396f30d25cb8a512ea7cec4bf45f42060000000100000204']
Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 103, in ii_worker
    raise AssertionError(f"approximation[{i}] not in answer")
AssertionError: approximation[1] not in answer

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/tests.py", line 472, in <module>
    test()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 36, in ii
    ii_worker()
  File "/Users/baehyunsol/Documents/Rust/ragit/tests/ii.py", line 116, in ii_worker
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'crate main build into all' is not close enough. error: `approximation[1] not in answer`, answer: ['799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', '0d4fafb4e2410e369b8b2b01f1028098af982abdb891a6790000000100000207', '7689aa16093bee7c396f30d25cb8a512ea7cec4bf45f42060000000100000204', '01632c8715a20988f1d1ee95aa8d5cd1fc4c7c0e7b70c4570000000100000205', '07edccd7468f00ef416e169bb45eeec81e91e583cce8aa8e0000000100000200', '787e2c52575c48133ffde911106c06bba30603371f754ef20000000100000212', '52071601888dbbfd851b3188ad73454b2f566441d31c871e0000000100000207', '73f3b15a8d584c9252dc807e7d72f355852318257b12dac60000000100000200', '344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205'], approximation: ['344e42adabf8ed79fd4681c3f6ae1e3379404a502a14dfff0000000100000205', '0280d49b1308e37a67c22969ab99bf3aecebda7511b583040000000100000214', '959571cc4d4ddd87dbd356ec2c47db33e21828f5d9b9a4d90000000100000205', 'b339028f8314802ef2d037e64b6fcb5ac5680baee8188e720000000100000217', '799fecfd3dce4231daa21ca8f4c3bda4dccb0ee1019ea3d20000000100000204', 'c2b54a503a1ef3737b50b828489fc3624c7ed0bf9de113870000000100000200', 'b3fb241e2bdcb85ea72edc4bd3a063b13d9121058c2523d600000001000001ab', '6e1a3ddbf0402ea96c366c66295a909805302b20fa8013b7000000010000012a', 'd58a4a1947d256486ade8fc6ed56473a8d3884af84854bf60000000100000204', '7689aa16093bee7c396f30d25cb8a512ea7cec4bf45f42060000000100000204']

history

cat_file
 

elapsed time: 34,318 ms

history

images
 

elapsed time: 9,105 ms

history

markdown_reader
 

elapsed time: 14,470 ms

history

csv_reader
 

elapsed time: 7,651 ms

history

subdir
 

elapsed time: 27,467 ms

history

tfidf
 

elapsed time: 31,846 ms

history

merge
 

elapsed time: 50,949 ms

history

external_bases
 

elapsed time: 159,612 ms

history

end_to_end dummy
 

elapsed time: 77,774 ms

history

end_to_end llama3.3-70b
 

elapsed time: 87,665 ms

history

prompts dummy
 

elapsed time: 12,535 ms

history

prompts gpt-4o-mini
 

elapsed time: 52,040 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 89,483 ms

history

empty dummy
 

elapsed time: 10,408 ms

history

empty llama3.3-70b
 

elapsed time: 11,412 ms

history

images2 gpt-4o-mini
 

elapsed time: 13,972 ms

history

images3 gpt-4o-mini
 

elapsed time: 11,880 ms

history

web_images gpt-4o-mini
 

elapsed time: 25,863 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 14,245 ms

history

extract_keywords dummy
 

elapsed time: 3,015 ms

history

extract_keywords gpt-4o-mini
 

elapsed time: 9,603 ms

history

orphan_process llama3.3-70b
 

elapsed time: 115,681 ms

history

write_lock llama3.3-70b
 

elapsed time: 40,868 ms

history

ragit_api command-r
 

elapsed time: 7,139 ms

history

migrate
 

elapsed time: 201,700 ms

history

migrate2
 

elapsed time: 249,934 ms

history


<< b08604d5b-linux
fec3323ea-linux >>