total: 46, pass: 41, fail: 5
end_to_end [model=dummy] run `end_to_end` test
It simulates a basic workflow of ragit: init, add, build and
query. It runs on a real dataset: the documents of ragit.tested at: 2025-02-24T21:11:27.969515Z (110 days ago)
elapsed time: 31,909 ms
Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 398, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 355, in <lambda>
("end_to_end llama3.3-70b", lambda: end_to_end(test_model="llama3.3-70b")),
File "/home/baehyunsol/Documents/ragit/tests/end_to_end.py", line 88, in end_to_end
cargo_run(["check", "--recover"])
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 66, in cargo_run
result = subprocess.run(args, **kwargs)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.
tested at: 2025-02-25T10:21:57.114315Z (109 days ago)
elapsed time: 85,923 ms
tested at: 2025-02-26T00:11:13.124361Z (109 days ago)
elapsed time: 69,967 ms
tested at: 2025-02-26T20:31:03.132225Z (108 days ago)
elapsed time: 32,832 ms
Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 437, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 390, in <lambda>
("end_to_end llama3.3-70b", lambda: end_to_end(test_model="llama3.3-70b")),
File "/home/baehyunsol/Documents/ragit/tests/end_to_end.py", line 87, in end_to_end
cargo_run(["check", "--recover"])
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 66, in cargo_run
result = subprocess.run(args, **kwargs)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.
tested at: 2025-02-27T22:17:10.555252Z (107 days ago)
elapsed time: 32,854 ms
Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 437, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 390, in <lambda>
("end_to_end llama3.3-70b", lambda: end_to_end(test_model="llama3.3-70b")),
File "/home/baehyunsol/Documents/ragit/tests/end_to_end.py", line 87, in end_to_end
cargo_run(["check", "--recover"])
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 66, in cargo_run
result = subprocess.run(args, **kwargs)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'check', '--recover']' returned non-zero exit status 1.
tested at: 2025-02-28T11:26:54.429209Z (106 days ago)
elapsed time: 87,665 ms
tested at: 2025-03-01T12:48:39.169037Z (105 days ago)
elapsed time: 388,738 ms
tested at: 2025-03-02T01:39:46.519770Z (105 days ago)
elapsed time: 146,448 ms
tested at: 2025-03-03T19:29:08.807193Z (103 days ago)
elapsed time: 146,782 ms
tested at: 2025-03-03T21:49:32.573405Z (103 days ago)
elapsed time: 144,225 ms
tested at: 2025-03-04T22:05:09.327920Z (102 days ago)
elapsed time: 141,911 ms
tested at: 2025-03-06T00:32:55.162195Z (101 days ago)
elapsed time: 141,768 ms
tested at: 2025-03-07T01:10:52.766008Z (100 days ago)
elapsed time: 140,894 ms
tested at: 2025-03-08T13:37:45.309833Z (98 days ago)
elapsed time: 140,749 ms
tested at: 2025-03-09T00:38:56.569526Z (98 days ago)
elapsed time: 140,918 ms
tested at: 2025-03-09T14:13:04.841105Z (97 days ago)
elapsed time: 1,175,184 ms
tested at: 2025-03-10T11:01:50.525266Z (96 days ago)
elapsed time: 182,539 ms
tested at: 2025-03-10T22:06:31.618023Z (96 days ago)
elapsed time: 141,932 ms
tested at: 2025-03-12T11:49:54.685992Z (94 days ago)
elapsed time: 181,437 ms
tested at: 2025-03-15T01:23:08.009762Z (92 days ago)
elapsed time: 146,704 ms
tested at: 2025-03-21T01:05:42.480054Z (86 days ago)
elapsed time: 78,252 ms
tested at: 2025-03-23T22:32:14.898790Z (83 days ago)
elapsed time: 54,164 ms
tested at: 2025-03-31T22:46:05.278555Z (75 days ago)
elapsed time: 75,443 ms
tested at: 2025-04-01T22:38:25.777417Z (74 days ago)
elapsed time: 66,618 ms
tested at: 2025-04-02T11:15:28.201699Z (73 days ago)
elapsed time: 98,696 ms
tested at: 2025-04-03T11:32:16.038744Z (72 days ago)
elapsed time: 101,245 ms
tested at: 2025-04-04T13:59:04.442731Z (71 days ago)
elapsed time: 98,556 ms
tested at: 2025-04-11T21:47:12.055124Z (64 days ago)
elapsed time: 64,031 ms
tested at: 2025-05-09T11:29:30.226975Z (36 days ago)
elapsed time: 102,601 ms
tested at: 2025-05-14T14:26:51.020259Z (31 days ago)
elapsed time: 97,232 ms
tested at: 2025-05-15T23:00:24.413178Z (30 days ago)
elapsed time: 55,447 ms
Command '['cargo', 'run', '--release', '--', 'meta', '--set', 'git-hash', 'adcf2562496ce6b4c2f17f0a5699f05d686b2dd9']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 621, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 561, in <lambda>
("end_to_end llama3.3-70b", lambda: end_to_end(test_model="llama3.3-70b")),
File "/home/baehyunsol/Documents/ragit/tests/end_to_end.py", line 133, in end_to_end
cargo_run(["meta", "--set", "git-hash", get_commit_hash()])
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 70, in cargo_run
result = subprocess.run(args, **kwargs)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'meta', '--set', 'git-hash', 'adcf2562496ce6b4c2f17f0a5699f05d686b2dd9']' returned non-zero exit status 1.
tested at: 2025-05-17T00:48:25.067654Z (29 days ago)
elapsed time: 62,128 ms
tested at: 2025-05-18T09:48:01.799303Z (27 days ago)
elapsed time: 58,369 ms
tested at: 2025-05-19T10:47:10.063082Z (26 days ago)
elapsed time: 99,604 ms
tested at: 2025-05-20T00:59:40.946018Z (26 days ago)
elapsed time: 57,961 ms
tested at: 2025-05-23T00:18:04.093493Z (23 days ago)
elapsed time: 1,046,879 ms
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 670, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 608, in <lambda>
("end_to_end llama3.3-70b", lambda: end_to_end(test_model="llama3.3-70b")),
File "/home/baehyunsol/Documents/ragit/tests/end_to_end.py", line 137, in end_to_end
assert chunk_count_prev == chunk_count
AssertionError
tested at: 2025-05-24T20:40:39.036733Z (21 days ago)
elapsed time: 54,228 ms
tested at: 2025-05-29T21:31:38.721609Z (16 days ago)
elapsed time: 80,303 ms
tested at: 2025-05-31T05:38:30.224392Z (14 days ago)
elapsed time: 78,321 ms
tested at: 2025-06-01T18:34:31.254192Z (13 days ago)
elapsed time: 53,495 ms
tested at: 2025-06-02T00:08:14.271670Z (13 days ago)
elapsed time: 51,044 ms
tested at: 2025-06-03T01:16:18.813157Z (12 days ago)
elapsed time: 52,659 ms
tested at: 2025-06-05T12:05:40.934810Z (9 days ago)
elapsed time: 1,008,796 ms
tested at: 2025-06-05T16:46:27.585326Z (9 days ago)
elapsed time: 113,628 ms
tested at: 2025-06-07T08:13:40.365332Z (7 days ago)
elapsed time: 97,415 ms
tested at: 2025-06-09T20:06:53.014494Z (5 days ago)
elapsed time: 79,283 ms