Home Explore Blog CI



ee72580d7-linux

result.json

total: 48, pass: 47, fail: 1

impl `yesno` and `code` schema for ragit-pdl

TOC

  1. ignore  
  2. recover  
  3. clone  
  4. clone2  
  5. server  
  6. cli  
  7. archive  
  8. ls  
  9. meta  
  10. symlink  
  11. ii  
  12. images  
  13. subdir  
  14. tfidf  
  15. merge  
  16. migrate  

Cases

cargo_tests
 

elapsed time: 126,110 ms

history

add_and_rm
 

elapsed time: 31,466 ms

history

add_and_rm2
 

elapsed time: 9,681 ms

history

ignore
 

elapsed time: 2,704 ms

history

recover
 

elapsed time: 2,681 ms

history

clone
 

elapsed time: 97,627 ms

history

clone2
 

elapsed time: 3,867 ms

history

server
 

elapsed time: 79,136 ms

history

cli
 

elapsed time: 3,147 ms

history

archive
 

elapsed time: 184,472 ms

history

many_chunks
 

elapsed time: 552,381 ms

history

many_jobs
 

elapsed time: 136,913 ms

history

ls
 

elapsed time: 95,037 ms

history

meta
 

elapsed time: 1,454 ms

history

symlink
 

elapsed time: 2,730 ms

history

ii
 

elapsed time: 147,069 ms

Error

tfidf result on term 'main' is not close enough. error: `answer[2] not in approximation`, answer: ['2ff63726cd35393e754d357e2bcd18e2b614cf3c6be7858b00000001000001c0', '968682cfc7b59bb1f7703f233e07fdba0a69e17b03f23f0c00000001000001e8', '243df3b7cafea5fd39ca25bdc1eb5dc0e6f37b257e01816100000001000001c9', 'dd640d80f6cd58da4087957d0dd282393633c75d4e6af270000000010000020e', '3866920645ce9cdd61f76bf558084433d299d4e9e39dca5c000000010000020e', 'e70e7cf654c87be73761641b1e3013c05fc66627156b55e80000000100000148', 'b732a677df44c14f936df1d937d2c8a7d3e14aa919fdae56000000010000013e', '7c46884cd1787aa09d1698c6233d2024c58530e10e96c3830000000100000202', 'd34bd5a2db49303bca8b5d463bc2ee17bdf814932c7a244b0000000100000201', 'cd555347422db94b5eb41d8c2c5eba0d7ed199a95f69c472000000010000020d'], approximation: ['2ff63726cd35393e754d357e2bcd18e2b614cf3c6be7858b00000001000001c0', '968682cfc7b59bb1f7703f233e07fdba0a69e17b03f23f0c00000001000001e8', 'dd640d80f6cd58da4087957d0dd282393633c75d4e6af270000000010000020e', '3866920645ce9cdd61f76bf558084433d299d4e9e39dca5c000000010000020e', 'e70e7cf654c87be73761641b1e3013c05fc66627156b55e80000000100000148', 'b732a677df44c14f936df1d937d2c8a7d3e14aa919fdae56000000010000013e', '7c46884cd1787aa09d1698c6233d2024c58530e10e96c3830000000100000202', 'd34bd5a2db49303bca8b5d463bc2ee17bdf814932c7a244b0000000100000201', 'cd555347422db94b5eb41d8c2c5eba0d7ed199a95f69c472000000010000020d', 'c65c91aa1fcd2da63f8d8eae3b4555dbc906bdf4cc6449e80000000100000204']
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 100, in ii_worker
    raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[2] not in approximation

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 517, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 36, in ii
    ii_worker()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 116, in ii_worker
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'main' is not close enough. error: `answer[2] not in approximation`, answer: ['2ff63726cd35393e754d357e2bcd18e2b614cf3c6be7858b00000001000001c0', '968682cfc7b59bb1f7703f233e07fdba0a69e17b03f23f0c00000001000001e8', '243df3b7cafea5fd39ca25bdc1eb5dc0e6f37b257e01816100000001000001c9', 'dd640d80f6cd58da4087957d0dd282393633c75d4e6af270000000010000020e', '3866920645ce9cdd61f76bf558084433d299d4e9e39dca5c000000010000020e', 'e70e7cf654c87be73761641b1e3013c05fc66627156b55e80000000100000148', 'b732a677df44c14f936df1d937d2c8a7d3e14aa919fdae56000000010000013e', '7c46884cd1787aa09d1698c6233d2024c58530e10e96c3830000000100000202', 'd34bd5a2db49303bca8b5d463bc2ee17bdf814932c7a244b0000000100000201', 'cd555347422db94b5eb41d8c2c5eba0d7ed199a95f69c472000000010000020d'], approximation: ['2ff63726cd35393e754d357e2bcd18e2b614cf3c6be7858b00000001000001c0', '968682cfc7b59bb1f7703f233e07fdba0a69e17b03f23f0c00000001000001e8', 'dd640d80f6cd58da4087957d0dd282393633c75d4e6af270000000010000020e', '3866920645ce9cdd61f76bf558084433d299d4e9e39dca5c000000010000020e', 'e70e7cf654c87be73761641b1e3013c05fc66627156b55e80000000100000148', 'b732a677df44c14f936df1d937d2c8a7d3e14aa919fdae56000000010000013e', '7c46884cd1787aa09d1698c6233d2024c58530e10e96c3830000000100000202', 'd34bd5a2db49303bca8b5d463bc2ee17bdf814932c7a244b0000000100000201', 'cd555347422db94b5eb41d8c2c5eba0d7ed199a95f69c472000000010000020d', 'c65c91aa1fcd2da63f8d8eae3b4555dbc906bdf4cc6449e80000000100000204']

history

cat_file
 

elapsed time: 14,000 ms

history

images
 

elapsed time: 3,802 ms

history

markdown_reader
 

elapsed time: 4,863 ms

history

csv_reader
 

elapsed time: 2,203 ms

history

subdir
 

elapsed time: 8,130 ms

history

tfidf
 

elapsed time: 9,373 ms

history

merge
 

elapsed time: 12,630 ms

history

external_bases
 

elapsed time: 27,679 ms

history

end_to_end dummy
 

elapsed time: 132,641 ms

history

end_to_end llama3.3-70b
 

elapsed time: 146,704 ms

history

audit llama3.3-70b
 

elapsed time: 6,701 ms

history

logs llama3.3-70b
 

elapsed time: 3,644 ms

history

prompts dummy
 

elapsed time: 4,200 ms

history

prompts gpt-4o-mini
 

elapsed time: 46,586 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 68,373 ms

history

empty dummy
 

elapsed time: 2,434 ms

history

empty llama3.3-70b
 

elapsed time: 3,517 ms

history

server2 dummy
 

elapsed time: 5,284 ms

history

server2 llama3.3-70b
 

elapsed time: 22,858 ms

history

images2 gpt-4o-mini
 

elapsed time: 9,015 ms

history

images3 gpt-4o-mini
 

elapsed time: 8,320 ms

history

web_images gpt-4o-mini
 

elapsed time: 19,978 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 10,425 ms

history

extract_keywords dummy
 

elapsed time: 1,543 ms

history

extract_keywords gpt-4o-mini
 

elapsed time: 6,572 ms

history

orphan_process llama3.3-70b
 

elapsed time: 107,376 ms

history

write_lock llama3.3-70b
 

elapsed time: 48,370 ms

history

ragit_api command-r
 

elapsed time: 2,065 ms

history

models_init
 

elapsed time: 256 ms

history

test_home_config_override
 

elapsed time: 119 ms

history

migrate
 

elapsed time: 119,681 ms

history

migrate2
 

elapsed time: 81,535 ms

history


<< 1ad288e5e-mac
ec6d09311-linux >>