Home • Explore • Blog • CI
☰



0bfcdc3e5-linux

result.json

total: 36, pass: 28, fail: 8

update commit hash

TOC

  1. cargo_tests  
  2. add_and_rm  
  3. recover  
  4. clone  
  5. clone2  
  6. cli  
  7. archive  
  8. many_chunks  
  9. many_jobs  
  10. ls  
  11. meta  
  12. symlink  
  13. ii  
  14. cat_file  
  15. images  
  16. markdown_reader  
  17. csv_reader  
  18. subdir  
  19. tfidf  
  20. merge  
  21. external_bases  
  22. end_to_end dummy  
  23. end_to_end gpt-4o-mini  
  24. prompts dummy  
  25. prompts gpt-4o-mini  
  26. prompts claude-3.5-sonnet  
  27. empty dummy  
  28. empty gpt-4o-mini  
  29. images2 gpt-4o-mini  
  30. images2 claude-3.5-sonnet  
  31. extract_keywords dummy  
  32. extract_keywords gpt-4o-mini  
  33. ragit_api llama3.2-11b-groq  
  34. ragit_api command-r  
  35. ragit_api phi-4-14b-ollama  
  36. migrate  

Cases

cargo_tests
 

elapsed time: 115,622 ms

history

add_and_rm
 

elapsed time: 27,030 ms

history

recover
 

elapsed time: 2,919 ms

history

clone
 

elapsed time: 1,079,452 ms

history

clone2
 

elapsed time: 888 ms

Error 


#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_ec6e5261a4b44345: rag clone http://ragit.baehyunsol.com/sample/git

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.06s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/git'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/git/archive-list/" }



#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_ec6e5261a4b44345: rag clone http://ragit.baehyunsol.com/sample/ragit

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.07s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/ragit'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/ragit/archive-list/" }



#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_ec6e5261a4b44345: rag clone http://ragit.baehyunsol.com/sample/rustc

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.06s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/rustc'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/rustc/archive-list/" }

Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/clone2.py", line 72, in clone2
    raise Exception("\n\n".join(errors))
Exception: 
#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_ec6e5261a4b44345: rag clone http://ragit.baehyunsol.com/sample/git

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.06s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/git'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/git/archive-list/" }



#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_ec6e5261a4b44345: rag clone http://ragit.baehyunsol.com/sample/ragit

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.07s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/ragit'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/ragit/archive-list/" }



#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_ec6e5261a4b44345: rag clone http://ragit.baehyunsol.com/sample/rustc

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.06s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/rustc'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/rustc/archive-list/" }

history

cli
 

elapsed time: 2,605 ms

history

archive
 

elapsed time: 117,858 ms

history

many_chunks
 

elapsed time: 590,067 ms

history

many_jobs
 

elapsed time: 115,862 ms

history

ls
 

elapsed time: 58,579 ms

history

meta
 

elapsed time: 1,608 ms

history

symlink
 

elapsed time: 2,512 ms

history

ii
 

elapsed time: 123,862 ms

Error 

tfidf result on term 'model build buffer crate all' is not close enough. error: `answer[0] not in approximation`, answer: ['6ea382bebb6d2adbf7dbd48d7c21b62bbc17b13d8a22723e000000010000018d', 'e9d9a44d90b9887cdbb444738901ae5ee4a52abbe6e0df900000000100000201', '42c9887f5422714a5f3dff5e34ac38d6e2f9845c4b529a4b0000000100000200', 'b0658c1805e02ec22db3f63b7d06357cef2dcd406f45476d000000010000020a', '361cf8d14a17dc2b4f027f296badd8c28bf882beee165449000000010000021d', '7af8f806193600bc6b6660c3152b08a1169e07cda1f685d80000000100000202', 'fcdb6180eaab63a79d97999df09a3e5c97c60c45ae104599000000010000020e', 'fe8139c42af838ef2529c2065f8852f56a10e18c3b1c0c350000000100000200', 'adee25a9516d1488496205dbe918fc1ad33975083b6fcf230000000100000200', 'bfc0be2493488e8a0407ed010a4dd5edcc775ed145d78b44000000010000020d'], approximation: ['361cf8d14a17dc2b4f027f296badd8c28bf882beee165449000000010000021d', '42c9887f5422714a5f3dff5e34ac38d6e2f9845c4b529a4b0000000100000200', 'e9d9a44d90b9887cdbb444738901ae5ee4a52abbe6e0df900000000100000201', '8be2584c5f1670f97f857a0a936c630367aafc6cc7a7257c0000000100000203', '36bf5937526d2f4b487fa405dc46420be67e38bb89d250f20000000100000200', '7af8f806193600bc6b6660c3152b08a1169e07cda1f685d80000000100000202', '1c5c6f49f6341b8728659c8a82e7b7982597c2aca5962a98000000010000020b', 'c3047bec8101aacb87b8831c9960646a2dddacc317f117790000000100000201', 'ea51413d5882ea717387b10bfad1acb351dec8d08ee59dc40000000100000200', '1504318cb9835a6794251f011926a512a156fe8b40c4d0450000000100000200']
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 90, in ii
    raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[0] not in approximation

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 106, in ii
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'model build buffer crate all' is not close enough. error: `answer[0] not in approximation`, answer: ['6ea382bebb6d2adbf7dbd48d7c21b62bbc17b13d8a22723e000000010000018d', 'e9d9a44d90b9887cdbb444738901ae5ee4a52abbe6e0df900000000100000201', '42c9887f5422714a5f3dff5e34ac38d6e2f9845c4b529a4b0000000100000200', 'b0658c1805e02ec22db3f63b7d06357cef2dcd406f45476d000000010000020a', '361cf8d14a17dc2b4f027f296badd8c28bf882beee165449000000010000021d', '7af8f806193600bc6b6660c3152b08a1169e07cda1f685d80000000100000202', 'fcdb6180eaab63a79d97999df09a3e5c97c60c45ae104599000000010000020e', 'fe8139c42af838ef2529c2065f8852f56a10e18c3b1c0c350000000100000200', 'adee25a9516d1488496205dbe918fc1ad33975083b6fcf230000000100000200', 'bfc0be2493488e8a0407ed010a4dd5edcc775ed145d78b44000000010000020d'], approximation: ['361cf8d14a17dc2b4f027f296badd8c28bf882beee165449000000010000021d', '42c9887f5422714a5f3dff5e34ac38d6e2f9845c4b529a4b0000000100000200', 'e9d9a44d90b9887cdbb444738901ae5ee4a52abbe6e0df900000000100000201', '8be2584c5f1670f97f857a0a936c630367aafc6cc7a7257c0000000100000203', '36bf5937526d2f4b487fa405dc46420be67e38bb89d250f20000000100000200', '7af8f806193600bc6b6660c3152b08a1169e07cda1f685d80000000100000202', '1c5c6f49f6341b8728659c8a82e7b7982597c2aca5962a98000000010000020b', 'c3047bec8101aacb87b8831c9960646a2dddacc317f117790000000100000201', 'ea51413d5882ea717387b10bfad1acb351dec8d08ee59dc40000000100000200', '1504318cb9835a6794251f011926a512a156fe8b40c4d0450000000100000200']

history

cat_file
 

elapsed time: 15,037 ms

history

images
 

elapsed time: 3,660 ms

history

markdown_reader
 

elapsed time: 4,910 ms

history

csv_reader
 

elapsed time: 2,338 ms

history

subdir
 

elapsed time: 7,275 ms

history

tfidf
 

elapsed time: 8,968 ms

history

merge
 

elapsed time: 12,723 ms

history

external_bases
 

elapsed time: 49,787 ms

history

end_to_end dummy
 

elapsed time: 39,473 ms

history

end_to_end gpt-4o-mini
 

elapsed time: 78,261 ms

history

prompts dummy
 

elapsed time: 5,155 ms

history

prompts gpt-4o-mini
 

elapsed time: 53,754 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 88,738 ms

history

empty dummy
 

elapsed time: 1,488 ms

history

empty gpt-4o-mini
 

elapsed time: 2,578 ms

history

images2 gpt-4o-mini
 

elapsed time: 9,414 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 11,029 ms

history

extract_keywords dummy
 

elapsed time: 343 ms

Error 

Command '['cargo', 'run', '--release', '--', 'clone', 'http://ragit.baehyunsol.com/sample/ragit']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 342, in <lambda>
    ("extract_keywords dummy", lambda: extract_keywords(test_model="dummy")),
  File "/home/baehyunsol/Documents/ragit/tests/extract_keywords.py", line 8, in extract_keywords
    cargo_run(["clone", "http://ragit.baehyunsol.com/sample/ragit"])
  File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 65, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'clone', 'http://ragit.baehyunsol.com/sample/ragit']' returned non-zero exit status 1.

history

extract_keywords gpt-4o-mini
 

elapsed time: 201 ms

Error 

Command '['cargo', 'run', '--release', '--', 'clone', 'http://ragit.baehyunsol.com/sample/ragit']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 343, in <lambda>
    ("extract_keywords gpt-4o-mini", lambda: extract_keywords(test_model="gpt-4o-mini")),
  File "/home/baehyunsol/Documents/ragit/tests/extract_keywords.py", line 8, in extract_keywords
    cargo_run(["clone", "http://ragit.baehyunsol.com/sample/ragit"])
  File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 65, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'clone', 'http://ragit.baehyunsol.com/sample/ragit']' returned non-zero exit status 1.

history

ragit_api llama3.2-11b-groq
 

elapsed time: 1,011 ms

Error 

Command '['cargo', 'run', '--release', '--', '--model', 'llama3.2-11b-groq', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 346, in <lambda>
    ("ragit_api llama3.2-11b-groq", lambda: ragit_api(test_model="llama3.2-11b-groq")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'llama3.2-11b-groq', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

ragit_api command-r
 

elapsed time: 145 ms

Error 

Command '['cargo', 'run', '--release', '--', '--model', 'command-r', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 347, in <lambda>
    ("ragit_api command-r", lambda: ragit_api(test_model="command-r")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'command-r', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

ragit_api phi-4-14b-ollama
 

elapsed time: 5,147 ms

Error 

Command '['cargo', 'run', '--release', '--', '--model', 'phi-4-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 348, in <lambda>
    ("ragit_api phi-4-14b-ollama", lambda: ragit_api(test_model="phi-4-14b-ollama")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'phi-4-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

migrate
 

elapsed time: 94,142 ms

Error 

Command '['cargo', 'run', '--release', '--', 'migrate']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/migrate.py", line 90, in migrate
    cargo_run(["migrate"])
  File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 65, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'migrate']' returned non-zero exit status 1.

history

<< 3e76f8b4f-linux
5d15f3ade-linux >>