Home Explore Blog CI



4c3b9e864-linux

result.json

total: 31, pass: 26, fail: 5

update chat models

1. It supports reasoning models (needs further testing).
2. It can query model name by short strings.

TOC

  1. recover  
  2. clone  
  3. clone2  
  4. cli  
  5. ls  
  6. meta  
  7. ii  
  8. images  
  9. subdir  
  10. tfidf  
  11. merge  
  12. migrate  

Cases

cargo_tests
 

elapsed time: 1,407,553 ms

Error


#####################
### path: command ###
/home/ubuntu/Documents/ci/ragit/crates/ignore: cargo test

### status_code ###
101

### stdout ###

running 1 test
test tests::ignore_test ... FAILED

failures:

---- tests::ignore_test stdout ----
thread 'tests::ignore_test' panicked at src/tests.rs:90:9:
(pattern: "ab*" -> IgnorePattern { r: Regex("^([^/]+/)*ab*$") }, path: "a/abc") has to match, but but doesn't
(pattern: "ab*" -> IgnorePattern { r: Regex("^([^/]+/)*ab*$") }, path: "abc") has to match, but but doesn't
(pattern: "*.json" -> IgnorePattern { r: Regex("^([^/]+/)**\\.json$") }, path: "a.json") has to match, but but doesn't
(pattern: "*.json" -> IgnorePattern { r: Regex("^([^/]+/)**\\.json$") }, path: "res/a.json") has to match, but but doesn't
(pattern: "/*.json" -> IgnorePattern { r: Regex("^/*\\.json$") }, path: "a.json") has to match, but but doesn't
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace


failures:
    tests::ignore_test

test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s



### stderr ###
    Updating crates.io index
     Locking 44 packages to latest compatible versions
      Adding windows-core v0.52.0 (latest: v0.59.0)
      Adding windows-targets v0.52.6 (latest: v0.53.0)
      Adding windows_aarch64_gnullvm v0.52.6 (latest: v0.53.0)
      Adding windows_aarch64_msvc v0.52.6 (latest: v0.53.0)
      Adding windows_i686_gnu v0.52.6 (latest: v0.53.0)
      Adding windows_i686_gnullvm v0.52.6 (latest: v0.53.0)
      Adding windows_i686_msvc v0.52.6 (latest: v0.53.0)
      Adding windows_x86_64_gnu v0.52.6 (latest: v0.53.0)
      Adding windows_x86_64_gnullvm v0.52.6 (latest: v0.53.0)
      Adding windows_x86_64_msvc v0.52.6 (latest: v0.53.0)
   Compiling autocfg v1.4.0
   Compiling memchr v2.7.4
   Compiling num-traits v0.2.19
   Compiling aho-corasick v1.1.3
   Compiling iana-time-zone v0.1.61
   Compiling regex-syntax v0.8.5
   Compiling regex-automata v0.4.9
   Compiling chrono v0.4.39
   Compiling pathdiff v0.2.3
   Compiling ragit-fs v0.2.1 (/home/ubuntu/Documents/ci/ragit/crates/fs)
   Compiling regex v1.11.1
   Compiling ragit-ignore v0.2.1 (/home/ubuntu/Documents/ci/ragit/crates/ignore)
    Finished `test` profile [unoptimized + debuginfo] target(s) in 10.58s
     Running unittests src/lib.rs (target/debug/deps/ragit_ignore-3ee0d5869150c5c3)
error: test failed, to rerun pass `--lib`




#####################
### path: command ###
/home/ubuntu/Documents/ci/ragit/crates/ignore: cargo test --release

### status_code ###
101

### stdout ###

running 1 test
test tests::ignore_test ... FAILED

failures:

---- tests::ignore_test stdout ----
thread 'tests::ignore_test' panicked at src/tests.rs:90:9:
(pattern: "ab*" -> IgnorePattern { r: Regex("^([^/]+/)*ab*$") }, path: "a/abc") has to match, but but doesn't
(pattern: "ab*" -> IgnorePattern { r: Regex("^([^/]+/)*ab*$") }, path: "abc") has to match, but but doesn't
(pattern: "*.json" -> IgnorePattern { r: Regex("^([^/]+/)**\\.json$") }, path: "a.json") has to match, but but doesn't
(pattern: "*.json" -> IgnorePattern { r: Regex("^([^/]+/)**\\.json$") }, path: "res/a.json") has to match, but but doesn't
(pattern: "/*.json" -> IgnorePattern { r: Regex("^/*\\.json$") }, path: "a.json") has to match, but but doesn't
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace


failures:
    tests::ignore_test

test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s



### stderr ###
   Compiling autocfg v1.4.0
   Compiling memchr v2.7.4
   Compiling num-traits v0.2.19
   Compiling aho-corasick v1.1.3
   Compiling regex-syntax v0.8.5
   Compiling iana-time-zone v0.1.61
   Compiling chrono v0.4.39
   Compiling regex-automata v0.4.9
   Compiling pathdiff v0.2.3
   Compiling ragit-fs v0.2.1 (/home/ubuntu/Documents/ci/ragit/crates/fs)
   Compiling regex v1.11.1
   Compiling ragit-ignore v0.2.1 (/home/ubuntu/Documents/ci/ragit/crates/ignore)
    Finished `release` profile [optimized] target(s) in 24.83s
     Running unittests src/lib.rs (target/release/deps/ragit_ignore-27a493991d786f76)
error: test failed, to rerun pass `--lib`


Traceback (most recent call last):
  File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
    test()
  File "/home/ubuntu/Documents/ci/ragit/tests/cargo_tests.py", line 45, in cargo_tests
    raise Exception("\n\n".join(errors))
Exception: 
#####################
### path: command ###
/home/ubuntu/Documents/ci/ragit/crates/ignore: cargo test

### status_code ###
101

### stdout ###

running 1 test
test tests::ignore_test ... FAILED

failures:

---- tests::ignore_test stdout ----
thread 'tests::ignore_test' panicked at src/tests.rs:90:9:
(pattern: "ab*" -> IgnorePattern { r: Regex("^([^/]+/)*ab*$") }, path: "a/abc") has to match, but but doesn't
(pattern: "ab*" -> IgnorePattern { r: Regex("^([^/]+/)*ab*$") }, path: "abc") has to match, but but doesn't
(pattern: "*.json" -> IgnorePattern { r: Regex("^([^/]+/)**\\.json$") }, path: "a.json") has to match, but but doesn't
(pattern: "*.json" -> IgnorePattern { r: Regex("^([^/]+/)**\\.json$") }, path: "res/a.json") has to match, but but doesn't
(pattern: "/*.json" -> IgnorePattern { r: Regex("^/*\\.json$") }, path: "a.json") has to match, but but doesn't
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace


failures:
    tests::ignore_test

test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s



### stderr ###
    Updating crates.io index
     Locking 44 packages to latest compatible versions
      Adding windows-core v0.52.0 (latest: v0.59.0)
      Adding windows-targets v0.52.6 (latest: v0.53.0)
      Adding windows_aarch64_gnullvm v0.52.6 (latest: v0.53.0)
      Adding windows_aarch64_msvc v0.52.6 (latest: v0.53.0)
      Adding windows_i686_gnu v0.52.6 (latest: v0.53.0)
      Adding windows_i686_gnullvm v0.52.6 (latest: v0.53.0)
      Adding windows_i686_msvc v0.52.6 (latest: v0.53.0)
      Adding windows_x86_64_gnu v0.52.6 (latest: v0.53.0)
      Adding windows_x86_64_gnullvm v0.52.6 (latest: v0.53.0)
      Adding windows_x86_64_msvc v0.52.6 (latest: v0.53.0)
   Compiling autocfg v1.4.0
   Compiling memchr v2.7.4
   Compiling num-traits v0.2.19
   Compiling aho-corasick v1.1.3
   Compiling iana-time-zone v0.1.61
   Compiling regex-syntax v0.8.5
   Compiling regex-automata v0.4.9
   Compiling chrono v0.4.39
   Compiling pathdiff v0.2.3
   Compiling ragit-fs v0.2.1 (/home/ubuntu/Documents/ci/ragit/crates/fs)
   Compiling regex v1.11.1
   Compiling ragit-ignore v0.2.1 (/home/ubuntu/Documents/ci/ragit/crates/ignore)
    Finished `test` profile [unoptimized + debuginfo] target(s) in 10.58s
     Running unittests src/lib.rs (target/debug/deps/ragit_ignore-3ee0d5869150c5c3)
error: test failed, to rerun pass `--lib`




#####################
### path: command ###
/home/ubuntu/Documents/ci/ragit/crates/ignore: cargo test --release

### status_code ###
101

### stdout ###

running 1 test
test tests::ignore_test ... FAILED

failures:

---- tests::ignore_test stdout ----
thread 'tests::ignore_test' panicked at src/tests.rs:90:9:
(pattern: "ab*" -> IgnorePattern { r: Regex("^([^/]+/)*ab*$") }, path: "a/abc") has to match, but but doesn't
(pattern: "ab*" -> IgnorePattern { r: Regex("^([^/]+/)*ab*$") }, path: "abc") has to match, but but doesn't
(pattern: "*.json" -> IgnorePattern { r: Regex("^([^/]+/)**\\.json$") }, path: "a.json") has to match, but but doesn't
(pattern: "*.json" -> IgnorePattern { r: Regex("^([^/]+/)**\\.json$") }, path: "res/a.json") has to match, but but doesn't
(pattern: "/*.json" -> IgnorePattern { r: Regex("^/*\\.json$") }, path: "a.json") has to match, but but doesn't
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace


failures:
    tests::ignore_test

test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s



### stderr ###
   Compiling autocfg v1.4.0
   Compiling memchr v2.7.4
   Compiling num-traits v0.2.19
   Compiling aho-corasick v1.1.3
   Compiling regex-syntax v0.8.5
   Compiling iana-time-zone v0.1.61
   Compiling chrono v0.4.39
   Compiling regex-automata v0.4.9
   Compiling pathdiff v0.2.3
   Compiling ragit-fs v0.2.1 (/home/ubuntu/Documents/ci/ragit/crates/fs)
   Compiling regex v1.11.1
   Compiling ragit-ignore v0.2.1 (/home/ubuntu/Documents/ci/ragit/crates/ignore)
    Finished `release` profile [optimized] target(s) in 24.83s
     Running unittests src/lib.rs (target/release/deps/ragit_ignore-27a493991d786f76)
error: test failed, to rerun pass `--lib`


history

add_and_rm
 

elapsed time: 67,586 ms

history

recover
 

elapsed time: 8,398 ms

history

clone
 

elapsed time: 13,524 ms

Error

Command '['cargo', 'run', '--release', '--', 'clone', 'http://127.0.0.1/test-user/repo1']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
    test()
  File "/home/ubuntu/Documents/ci/ragit/tests/clone.py", line 50, in clone
    cargo_run(["clone", "http://127.0.0.1/test-user/repo1"])
  File "/home/ubuntu/Documents/ci/ragit/tests/utils.py", line 61, in cargo_run
    result = subprocess.run(args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'clone', 'http://127.0.0.1/test-user/repo1']' returned non-zero exit status 1.

history

clone2
 

elapsed time: 379,790 ms

history

cli
 

elapsed time: 6,070 ms

history

many_chunks
 

elapsed time: 259,319 ms

history

ls
 

elapsed time: 179,518 ms

history

meta
 

elapsed time: 5,391 ms

history

ii
 

elapsed time: 30,783 ms

Error

tfidf result on term 'valu tfidf map term count' is not close enough. error: `answer[2] not in approximation`, answer: ['e8a5962f9b54ee9431c93df83595f5dd412edf0bc0b7f7e60000000100000216', '225c75fb823a51ff665653cd9b9c2267699bb2be227177dd0000000100000213', '929ddfe9cb7a78b787e784d556b588f8f1af57f829fa8aa40000000100000201', 'caa84862afaf775e3b6c14ade5ca017785e174f3c01cd7df0000000100000200', '1cb944f6e3c7a429669dfc1c444db1032ad9c89a018809590000000100000200', 'ef7dd93a7c14fc3a779d244c39da7482d2d412f62e4b5d060000000100000201', '1d864c20b618267b470944a67b2492269a17a9f3227b39590000000100000220', 'f13dfcfee4a0f4b756e9c743d22c2ca01dcacf7946e422320000000100000205', '29c35669031cf3a17a891913511593fcf23f78fbbaad181c0000000100000201', '05f4974fbc2aaec070abc9a84e7aa78028b56e4727585252000000010000021c'], approximation: ['e8a5962f9b54ee9431c93df83595f5dd412edf0bc0b7f7e60000000100000216', 'caa84862afaf775e3b6c14ade5ca017785e174f3c01cd7df0000000100000200', '225c75fb823a51ff665653cd9b9c2267699bb2be227177dd0000000100000213', 'ef7dd93a7c14fc3a779d244c39da7482d2d412f62e4b5d060000000100000201', '9e4bdf580cd9e559f9336df781c29edfb2d84655ad3451840000000100000203', '05f4974fbc2aaec070abc9a84e7aa78028b56e4727585252000000010000021c', 'f13dfcfee4a0f4b756e9c743d22c2ca01dcacf7946e422320000000100000205', '29c35669031cf3a17a891913511593fcf23f78fbbaad181c0000000100000201', '2a8c493194046ba39029062d15d0f6564a56c1256157481a0000000100000204', 'd5472e15d434698b801e4071d190e55c16e1a37ea7024dc900000001000001a0']
Traceback (most recent call last):
  File "/home/ubuntu/Documents/ci/ragit/tests/ii.py", line 88, in ii
    raise AssertionError(f"answer[{i}] not in approximation")
AssertionError: answer[2] not in approximation

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
    test()
  File "/home/ubuntu/Documents/ci/ragit/tests/ii.py", line 104, in ii
    raise AssertionError(f"tfidf result on term '{term}' is not close enough. error: `{e}`, answer: {answer}, approximation: {approximation}")
AssertionError: tfidf result on term 'valu tfidf map term count' is not close enough. error: `answer[2] not in approximation`, answer: ['e8a5962f9b54ee9431c93df83595f5dd412edf0bc0b7f7e60000000100000216', '225c75fb823a51ff665653cd9b9c2267699bb2be227177dd0000000100000213', '929ddfe9cb7a78b787e784d556b588f8f1af57f829fa8aa40000000100000201', 'caa84862afaf775e3b6c14ade5ca017785e174f3c01cd7df0000000100000200', '1cb944f6e3c7a429669dfc1c444db1032ad9c89a018809590000000100000200', 'ef7dd93a7c14fc3a779d244c39da7482d2d412f62e4b5d060000000100000201', '1d864c20b618267b470944a67b2492269a17a9f3227b39590000000100000220', 'f13dfcfee4a0f4b756e9c743d22c2ca01dcacf7946e422320000000100000205', '29c35669031cf3a17a891913511593fcf23f78fbbaad181c0000000100000201', '05f4974fbc2aaec070abc9a84e7aa78028b56e4727585252000000010000021c'], approximation: ['e8a5962f9b54ee9431c93df83595f5dd412edf0bc0b7f7e60000000100000216', 'caa84862afaf775e3b6c14ade5ca017785e174f3c01cd7df0000000100000200', '225c75fb823a51ff665653cd9b9c2267699bb2be227177dd0000000100000213', 'ef7dd93a7c14fc3a779d244c39da7482d2d412f62e4b5d060000000100000201', '9e4bdf580cd9e559f9336df781c29edfb2d84655ad3451840000000100000203', '05f4974fbc2aaec070abc9a84e7aa78028b56e4727585252000000010000021c', 'f13dfcfee4a0f4b756e9c743d22c2ca01dcacf7946e422320000000100000205', '29c35669031cf3a17a891913511593fcf23f78fbbaad181c0000000100000201', '2a8c493194046ba39029062d15d0f6564a56c1256157481a0000000100000204', 'd5472e15d434698b801e4071d190e55c16e1a37ea7024dc900000001000001a0']

history

cat_file
 

elapsed time: 16,772 ms

history

images
 

elapsed time: 4,845 ms

history

markdown_reader
 

elapsed time: 9,561 ms

history

csv_reader
 

elapsed time: 5,458 ms

history

subdir
 

elapsed time: 15,814 ms

history

tfidf
 

elapsed time: 18,572 ms

history

merge
 

elapsed time: 34,716 ms

history

external_bases
 

elapsed time: 64,843 ms

history

end_to_end dummy
 

elapsed time: 56,403 ms

history

end_to_end gpt-4o-mini
 

elapsed time: 126,728 ms

history

prompts dummy
 

elapsed time: 8,044 ms

history

prompts gpt-4o-mini
 

elapsed time: 79,468 ms

history

prompts claude-3.5-sonnet
 

elapsed time: 96,685 ms

history

empty dummy
 

elapsed time: 4,015 ms

history

empty gpt-4o-mini
 

elapsed time: 5,035 ms

history

images2 gpt-4o-mini
 

elapsed time: 14,858 ms

history

images2 claude-3.5-sonnet
 

elapsed time: 16,084 ms

history

ragit_api llama3.2-11b-groq
 

elapsed time: 8,649 ms

history

ragit_api command-r
 

elapsed time: 405 ms

Error

Command '['cargo', 'run', '--release', '--', '--model', 'command-r', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
    test()
  File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 302, in <lambda>
    ("ragit_api command-r", lambda: ragit_api(test_model="command-r")),
                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/Documents/ci/ragit/tests/ragit_api.py", line 9, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'command-r', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

ragit_api phi-3-14b-ollama
 

elapsed time: 314 ms

Error

Command '['cargo', 'run', '--release', '--', '--model', 'phi-3-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.
Traceback (most recent call last):
  File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
    test()
  File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 303, in <lambda>
    ("ragit_api phi-3-14b-ollama", lambda: ragit_api(test_model="phi-3-14b-ollama")),
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/Documents/ci/ragit/tests/ragit_api.py", line 9, in ragit_api
    subprocess.run(["cargo", "run", "--release", '--', '--model', test_model, '--input', 'hello_world.pdl'], check=True)
  File "/usr/lib/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', '--model', 'phi-3-14b-ollama', '--input', 'hello_world.pdl']' returned non-zero exit status 101.

history

migrate
 

elapsed time: 492,605 ms

history


<< 869568e0b-linux
c256e7191-linux >>