Home • Explore • Blog • CI
☰



5d15f3ade-linux

result.json

total: 36, pass: 28, fail: 8

fix `get_chunks_of_file`

`uid::load_from_file` was implemented very long ago, but
`get_chunks_of_file` wasn't using the function.

TOC

  1. cargo_tests  
  2. add_and_rm  
  3. recover  
  4. clone  
  5. clone2  
  6. cli  
  7. archive  
  8. many_chunks  
  9. many_jobs  
  10. ls  
  11. meta  
  12. symlink  
  13. ii  
  14. cat_file  
  15. images  
  16. markdown_reader  
  17. csv_reader  
  18. subdir  
  19. tfidf  
  20. merge  
  21. external_bases  
  22. end_to_end dummy  
  23. end_to_end gpt-4o-mini  
  24. prompts dummy  
  25. prompts gpt-4o-mini  
  26. prompts claude-3.5-sonnet  
  27. empty dummy  
  28. empty gpt-4o-mini  
  29. images2 gpt-4o-mini  
  30. images2 claude-3.5-sonnet  
  31. extract_keywords dummy  
  32. extract_keywords gpt-4o-mini  
  33. ragit_api llama3.2-11b-groq  
  34. ragit_api command-r  
  35. ragit_api phi-4-14b-ollama  
  36. migrate  

Cases

cargo_tests
 

elapsed time: 116,485 ms

history

add_and_rm
 

elapsed time: 27,294 ms

history

recover
 

elapsed time: 2,918 ms

history

clone
 

elapsed time: 1,055,707 ms

history

clone2
 

elapsed time: 642 ms

Error 


#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_b8d5ec9e0d7e76d4: rag clone http://ragit.baehyunsol.com/sample/git

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.07s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/git'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/git/archive-list/" }



#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_b8d5ec9e0d7e76d4: rag clone http://ragit.baehyunsol.com/sample/ragit

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.06s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/ragit'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/ragit/archive-list/" }



#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_b8d5ec9e0d7e76d4: rag clone http://ragit.baehyunsol.com/sample/rustc

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.07s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/rustc'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/rustc/archive-list/" }

Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/clone2.py", line 72, in clone2
    raise Exception("\n\n".join(errors))
Exception: 
#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_b8d5ec9e0d7e76d4: rag clone http://ragit.baehyunsol.com/sample/git

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.07s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/git'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/git/archive-list/" }



#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_b8d5ec9e0d7e76d4: rag clone http://ragit.baehyunsol.com/sample/ragit

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.06s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/ragit'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/ragit/archive-list/" }



#####################
### path: command ###
/home/baehyunsol/Documents/ragit/__tmp_b8d5ec9e0d7e76d4: rag clone http://ragit.baehyunsol.com/sample/rustc

### returncode ###

1

### stdout ###



### stderr ###

    Finished `release` profile [optimized] target(s) in 0.07s
     Running `/home/baehyunsol/Documents/ragit/target/release/rag clone 'http://ragit.baehyunsol.com/sample/rustc'`
CloneRequestError { code: Some(404), url: "http://ragit.baehyunsol.com:41127/sample/rustc/archive-list/" }

history

cli
 

elapsed time: 2,609 ms

history

archive
 

elapsed time: 110,754 ms

history

many_chunks
 

elapsed time: 587,973 ms

history

many_jobs
 

elapsed time: 127,503 ms

history

ls
 

elapsed time: 58,762 ms

history

meta
 

elapsed time: 1,617 ms

history

symlink
 

elapsed time: 2,544 ms

history

ii
 

elapsed time: 130,063 ms

Error 

tfidf result on term 'crate 2 model buffer main' is not close enough. error: `answer[1] not in approximation`, answer: ['a974c5df121320d676c39c814ba5eba8dfe73ad9cb90a4e50000000100000200', 'b0658c1805e02ec22db3f63b7d06357cef2dcd406f45476d000000010000020a', '6ea382bebb6d2adbf7dbd48d7c21b62bbc17b13d8a22723e000000010000018d', 'fcdb6180eaab63a79d97999df09a3e5c97c60c45ae104599000000010000020e', '1de00a341406d7a4642c477dae3535f9782c03c4fd951a8b0000000100000200', 'f211c60d3d5aa0eae8d26be6526ccbe5f69e64089802bba20000000100000200', 'fe8139c42af838ef2529c2065f8852f56a10e18c3b1c0c350000000100000200', 'e9d9a44d90b9887cdbb444738901ae5ee4a52abbe6e0df900000000100000201', '659de5fb5893965eb34991f592a4bc41724cbba9edaacce10000000100000200', '73f3b15a8d584c9252dc807e7d72f355852318257b12dac60000000100000200'], approximation: ['a974c5df121320d676c39c814ba5eba8dfe73ad9cb90a4e50000000100000200', 'f211c60d3d5aa0eae8d26be6526ccbe5f69e64089802bba20000000100000200', '1de00a341406d7a4642c477dae3535f9782c03c4fd951a8b0000000100000200', 'fcdb6180eaab63a79d97999df09a3e5c97c60c45ae104599000000010000020e', '73f3b15a8d584c9252dc807e7d72f355852318257b12dac60000000100000200', '42c9887f5422714a5f3dff5e34ac38d6e2f9845c4b529a4b0000000100000200', 'e9d9a44d90b9887cdbb444738901ae5ee4a52abbe6e0df900000000100000201', '6ea382bebb6d2adbf7dbd48d7c21b62bbc17b13d8a22723e000000010000018d', '0351005ec37b2e7a84f1e6535c6091804d64c78aa916bbca0000000100000201', '659de5fb5893965eb34991f592a4bc41724cbba9edaacce10000000100000200']
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 90, in ii
    raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[1] not in approximation

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/ii.py", line 106, in ii
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'crate 2 model buffer main' is not close enough. error: `answer[1] not in approximation`, answer: ['a974c5df121320d676c39c814ba5eba8dfe73ad9cb90a4e50000000100000200', 'b0658c1805e02ec22db3f63b7d06357cef2dcd406f45476d000000010000020a', '6ea382bebb6d2adbf7dbd48d7c21b62bbc17b13d8a22723e000000010000018d', 'fcdb6180eaab63a79d97999df09a3e5c97c60c45ae104599000000010000020e', '1de00a341406d7a4642c477dae3535f9782c03c4fd951a8b0000000100000200', 'f211c60d3d5aa0eae8d26be6526ccbe5f69e64089802bba20000000100000200', 'fe8139c42af838ef2529c2065f8852f56a10e18c3b1c0c350000000100000200', 'e9d9a44d90b9887cdbb444738901ae5ee4a52abbe6e0df900000000100000201', '659de5fb5893965eb34991f592a4bc41724cbba9edaacce10000000100000200', '73f3b15a8d584c9252dc807e7d72f355852318257b12dac60000000100000200'], approximation: ['a974c5df121320d676c39c814ba5eba8dfe73ad9cb90a4e50000000100000200', 'f211c60d3d5aa0eae8d26be6526ccbe5f69e64089802bba20000000100000200', '1de00a341406d7a4642c477dae3535f9782c03c4fd951a8b0000000100000200', 'fcdb6180eaab63a79d97999df09a3e5c97c60c45ae104599000000010000020e', '73f3b15a8d584c9252dc807e7d72f355852318257b12dac60000000100000200', '42c9887f5422714a5f3dff5e34ac38d6e2f9845c4b529a4b0000000100000200', 'e9d9a44d90b9887cdbb444738901ae5ee4a52abbe6e0df900000000100000201', '6ea382bebb6d2adbf7dbd48d7c21b62bbc17b13d8a22723e000000010000018d', '0351005ec37b2e7a84f1e6535c6091804d64c78aa916bbca0000000100000201', '659de5fb5893965eb34991f592a4bc41724cbba9edaacce10000000100000200']

history

cat_file
 

elapsed time: 14,888 ms

history

images
 

elapsed time: 3,672 ms

history

markdown_reader
 

elapsed time: 5,041 ms

history

csv_reader
 

elapsed time: 2,259 ms

history

subdir
 

elapsed time: 7,501 ms

history

tfidf
 

elapsed time: 8,994 ms

history

merge
 

elapsed time: 12,868 ms

history

external_bases
 

elapsed time: 50,065 ms

history

end_to_end dummy
 

elapsed time: 39,823 ms

history

end_to_end gpt-4o-mini
 

elapsed time: 168,796 ms

history

prompts dummy
 

elapsed time: 5,195 ms

history

prompts gpt-4o-mini
 

elapsed time: 69,474 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 165,404 ms

history

empty dummy
 

elapsed time: 1,482 ms

history

empty gpt-4o-mini
 

elapsed time: 2,352 ms

history

images2 gpt-4o-mini
 

elapsed time: 12,764 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 37,275 ms

history

extract_keywords dummy
 

elapsed time: 339 ms

Error 

Command '['cargo', 'run', '--release', '--', 'clone', 'http://ragit.baehyunsol.com/sample/ragit']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 342, in <lambda>
    ("extract_keywords dummy", lambda: extract_keywords(test_model="dummy")),
  File "/home/baehyunsol/Documents/ragit/tests/extract_keywords.py", line 8, in extract_keywords
    cargo_run(["clone", "http://ragit.baehyunsol.com/sample/ragit"])
  File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 65, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'clone', 'http://ragit.baehyunsol.com/sample/ragit']' returned non-zero exit status 1.

history

extract_keywords gpt-4o-mini
 

elapsed time: 340 ms

Error 

Command '['cargo', 'run', '--release', '--', 'clone', 'http://ragit.baehyunsol.com/sample/ragit']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 343, in <lambda>
    ("extract_keywords gpt-4o-mini", lambda: extract_keywords(test_model="gpt-4o-mini")),
  File "/home/baehyunsol/Documents/ragit/tests/extract_keywords.py", line 8, in extract_keywords
    cargo_run(["clone", "http://ragit.baehyunsol.com/sample/ragit"])
  File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 65, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'clone', 'http://ragit.baehyunsol.com/sample/ragit']' returned non-zero exit status 1.

history

ragit_api llama3.2-11b-groq
 

elapsed time: 983 ms

Error 

Command '['cargo', 'run', '--release', '--', '--model', 'llama3.2-11b-groq', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 346, in <lambda>
    ("ragit_api llama3.2-11b-groq", lambda: ragit_api(test_model="llama3.2-11b-groq")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'llama3.2-11b-groq', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

ragit_api command-r
 

elapsed time: 146 ms

Error 

Command '['cargo', 'run', '--release', '--', '--model', 'command-r', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 347, in <lambda>
    ("ragit_api command-r", lambda: ragit_api(test_model="command-r")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'command-r', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

ragit_api phi-4-14b-ollama
 

elapsed time: 5,149 ms

Error 

Command '['cargo', 'run', '--release', '--', '--model', 'phi-4-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 348, in <lambda>
    ("ragit_api phi-4-14b-ollama", lambda: ragit_api(test_model="phi-4-14b-ollama")),
  File "/home/baehyunsol/Documents/ragit/tests/ragit_api.py", line 11, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'phi-4-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

migrate
 

elapsed time: 93,236 ms

Error 

Command '['cargo', 'run', '--release', '--', 'migrate']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 377, in <module>
    test()
  File "/home/baehyunsol/Documents/ragit/tests/migrate.py", line 90, in migrate
    cargo_run(["migrate"])
  File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 65, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'migrate']' returned non-zero exit status 1.

history

<< 0bfcdc3e5-linux
d283fd55c-mac >>