Home Explore Blog CI



3c6b6ebe1-linux

result.json

total: 66, pass: 62, fail: 4

fix svg and pdf test

a035ec6db added cargo features, and now svg and pdf file readers work
only if the cargo features are enabled. So I enabled the features in the
test cases and added another check about the features.

TOC

  1. ignore  
  2. recover  
  3. clone  
  4. pull  
  5. server  
  6. cli  
  7. outside  
  8. archive  
  9. ls  
  10. meta  
  11. symlink  
  12. ii  
  13. images  
  14. subdir  
  15. tfidf  
  16. korean  
  17. merge  
  18. config  
  19. migrate  

Cases

cargo_tests
 

elapsed time: 1,135,096 ms

history

cargo_features
 

elapsed time: 603,036 ms

history

add_and_rm
 

elapsed time: 85,947 ms

history

add_and_rm2
 

elapsed time: 29,254 ms

history

ignore
 

elapsed time: 8,814 ms

history

recover
 

elapsed time: 7,742 ms

history

clone
 

elapsed time: 258,243 ms

history

clone_empty
 

elapsed time: 8,156 ms

history

pull
 

elapsed time: 12,139 ms

history

server
 

elapsed time: 268,020 ms

history

server_permission
 

elapsed time: 1,834 ms

Error

'readme'
Traceback (most recent call last):
  File "/home/ubuntu/Documents/ragit/tests/tests.py", line 709, in <module>
    test()
  File "/home/ubuntu/Documents/ragit/tests/server_permission.py", line 46, in server_permission
    assert repo_info1["readme"] == "hello, world"
           ~~~~~~~~~~^^^^^^^^^^
KeyError: 'readme'

history

cli
 

elapsed time: 15,357 ms

history

outside
 

elapsed time: 7,083 ms

history

archive
 

elapsed time: 357,952 ms

history

many_chunks
 

elapsed time: 1,326,527 ms

history

many_jobs
 

elapsed time: 604,242 ms

history

ls
 

elapsed time: 195,001 ms

history

meta
 

elapsed time: 4,648 ms

history

symlink
 

elapsed time: 7,176 ms

history

gh_issue_20
 

elapsed time: 5,624 ms

history

ii
 

elapsed time: 686,744 ms

Error

tfidf result on term 'chunk aa' is not close enough. error: `answer[2] not in approximation`, answer: ['c220827e4739df472d66229f61ad8bf1c0bff67b570314b9000000010000021a', '4cfd8868993b18eab4e66c956ad05a39f4c083d6ba68f3b60000000100000214', 'ece7d9ac964d374e578a3c05daf8b46245af9d2a8e76e9210000000100000200', 'c39e41c76d2c3c01c18bb20a135669481eb9ea963597940e0000000100000209', 'c7062921979fb787f85436d9298930448db1718d47fed4930000000100000200', '1c167dbbaa87d63afa5b9e650a29c6f64f4dc19dea2249b2000000010000018e', '1e89c4adea8975cae21c8a68dc77dd4f11f30a544ffa000e0000000100000207', '61a0bf5da68d4a7d9126655b2a034f62fc5fab123b4679f00000000100000215', '1557ddd1b584b8dcec275d294009e627e2df8cc9860aeb570000000100000200', '598898fc27f7824376050f6071364c5ebb2c2108be8f2e9d0000000100000200'], approximation: ['c220827e4739df472d66229f61ad8bf1c0bff67b570314b9000000010000021a', '4cfd8868993b18eab4e66c956ad05a39f4c083d6ba68f3b60000000100000214', 'c7062921979fb787f85436d9298930448db1718d47fed4930000000100000200', '1c43e67a9383f8da92cae72c60dd7ff0d918d4941bd7051c0000000100000200', '684f8cb61b37901593b302c6644af01e24360c471e433d0d0000000100000203', 'be4c7d1522ab942c04dba3edb8b354010ac4d2a6ecaa06d40000000100000208', 'ad42b38e1087dd9e249f08166e00d1942a5e2893f30932270000000100000200', 'b39ce5e746eaf69d250805cec1a7a9722b04dd40fe4ea1840000000100000200', 'afda08a0b80435143b38bfc4d92b08a262e371f39767f1ca0000000100000200', '297fe4e4ef251791c7e32590618b928ccb01f435ce47ae370000000100000201']
Traceback (most recent call last):
  File "/home/ubuntu/Documents/ragit/tests/ii.py", line 100, in ii_worker
    raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[2] not in approximation

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/Documents/ragit/tests/tests.py", line 709, in <module>
    test()
  File "/home/ubuntu/Documents/ragit/tests/ii.py", line 36, in ii
    ii_worker()
  File "/home/ubuntu/Documents/ragit/tests/ii.py", line 116, in ii_worker
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'chunk aa' is not close enough. error: `answer[2] not in approximation`, answer: ['c220827e4739df472d66229f61ad8bf1c0bff67b570314b9000000010000021a', '4cfd8868993b18eab4e66c956ad05a39f4c083d6ba68f3b60000000100000214', 'ece7d9ac964d374e578a3c05daf8b46245af9d2a8e76e9210000000100000200', 'c39e41c76d2c3c01c18bb20a135669481eb9ea963597940e0000000100000209', 'c7062921979fb787f85436d9298930448db1718d47fed4930000000100000200', '1c167dbbaa87d63afa5b9e650a29c6f64f4dc19dea2249b2000000010000018e', '1e89c4adea8975cae21c8a68dc77dd4f11f30a544ffa000e0000000100000207', '61a0bf5da68d4a7d9126655b2a034f62fc5fab123b4679f00000000100000215', '1557ddd1b584b8dcec275d294009e627e2df8cc9860aeb570000000100000200', '598898fc27f7824376050f6071364c5ebb2c2108be8f2e9d0000000100000200'], approximation: ['c220827e4739df472d66229f61ad8bf1c0bff67b570314b9000000010000021a', '4cfd8868993b18eab4e66c956ad05a39f4c083d6ba68f3b60000000100000214', 'c7062921979fb787f85436d9298930448db1718d47fed4930000000100000200', '1c43e67a9383f8da92cae72c60dd7ff0d918d4941bd7051c0000000100000200', '684f8cb61b37901593b302c6644af01e24360c471e433d0d0000000100000203', 'be4c7d1522ab942c04dba3edb8b354010ac4d2a6ecaa06d40000000100000208', 'ad42b38e1087dd9e249f08166e00d1942a5e2893f30932270000000100000200', 'b39ce5e746eaf69d250805cec1a7a9722b04dd40fe4ea1840000000100000200', 'afda08a0b80435143b38bfc4d92b08a262e371f39767f1ca0000000100000200', '297fe4e4ef251791c7e32590618b928ccb01f435ce47ae370000000100000201']

history

cat_file
 

elapsed time: 56,231 ms

history

generous_file_reader
 

elapsed time: 1,776,823 ms

history

clean_up_erroneous_chunk
 

elapsed time: 3,228 ms

history

images
 

elapsed time: 8,214 ms

history

markdown_reader
 

elapsed time: 10,457 ms

history

csv_reader
 

elapsed time: 8,430 ms

history

real_repos
 

elapsed time: 1,182,765 ms

Error

[Errno 2] No such file or directory: 'clone-here'
Traceback (most recent call last):
  File "/home/ubuntu/Documents/ragit/tests/tests.py", line 709, in <module>
    test()
  File "/home/ubuntu/Documents/ragit/tests/real_repos.py", line 161, in real_repos
    os.chdir("clone-here")
FileNotFoundError: [Errno 2] No such file or directory: 'clone-here'

Message

started creating a knowledge-base of git

finished creating a knowledge-base of git: it took 1106 seconds

----- git (0 errors) -----


started creating a knowledge-base of postgresql

failed to clone https://git.postgresql.org/git/postgresql.git

started creating a knowledge-base of rustc

history

real_repos_regression
 

elapsed time: 16,889 ms

history

subdir
 

elapsed time: 20,437 ms

history

tfidf
 

elapsed time: 22,572 ms

history

korean
 

elapsed time: 6,091 ms

history

merge
 

elapsed time: 35,238 ms

history

external_bases
 

elapsed time: 195,887 ms

history

end_to_end dummy
 

elapsed time: 87,833 ms

history

end_to_end llama3.3-70b
 

elapsed time: 78,321 ms

history

audit llama3.3-70b
 

elapsed time: 11,329 ms

history

logs llama3.3-70b
 

elapsed time: 6,231 ms

history

prompts dummy
 

elapsed time: 8,366 ms

history

prompts gpt-4o-mini
 

elapsed time: 50,451 ms

history

prompts gemini-2.0-flash
 

elapsed time: 29,171 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 72,273 ms

history

empty dummy
 

elapsed time: 7,014 ms

history

empty llama3.3-70b
 

elapsed time: 7,972 ms

history

server_chat llama3.3-70b
 

elapsed time: 23,961 ms

history

server_chat gemini-2.0-flash
 

elapsed time: 41,602 ms

history

images2 gpt-4o-mini
 

elapsed time: 11,565 ms

history

images3 gpt-4o-mini
 

elapsed time: 9,658 ms

history

pdl gpt-4o-mini
 

elapsed time: 7,131 ms

history

pdf gpt-4o-mini
 

elapsed time: 151,333 ms

history

svg gpt-4o-mini
 

elapsed time: 15,363 ms

Error


Traceback (most recent call last):
  File "/home/ubuntu/Documents/ragit/tests/tests.py", line 709, in <module>
    test()
  File "/home/ubuntu/Documents/ragit/tests/tests.py", line 658, in <lambda>
    ("svg gpt-4o-mini", lambda: svg(test_model="gpt-4o-mini")),
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/Documents/ragit/tests/svg.py", line 129, in svg
    assert "ragit" in cargo_run(["pdl", "test1.pdl"], stdout=True).lower()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError

history

web_images gpt-4o-mini
 

elapsed time: 55,659 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 12,145 ms

history

extract_keywords dummy
 

elapsed time: 2,862 ms

history

extract_keywords gpt-4o-mini
 

elapsed time: 8,769 ms

history

orphan_process llama3.3-70b
 

elapsed time: 107,806 ms

history

write_lock llama3.3-70b
 

elapsed time: 126,137 ms

history

ragit_api command-r
 

elapsed time: 1,397 ms

history

query_options llama3.3-70b
 

elapsed time: 7,479 ms

history

query_with_schema llama3.3-70b
 

elapsed time: 2,710 ms

history

models_init
 

elapsed time: 715 ms

history

test_home_config_override
 

elapsed time: 355 ms

history

config
 

elapsed time: 141,635 ms

history

migrate
 

elapsed time: 1,133,174 ms

history

migrate2
 

elapsed time: 377,767 ms

history

migrate3
 

elapsed time: 887,283 ms

history


<< 774e5c41d-linux
f0327eaea-linux >>