total: 87, pass: 77, fail: 10
end_to_end [model=dummy] run `end_to_end` test
It simulates a basic workflow of ragit: init, add, build and
query. It runs on a real dataset: the documents of ragit.tested at: 2025-01-31T13:19:57.917499Z (321 days ago)
elapsed time: 56,403 ms
tested at: 2025-02-01T13:33:17.370823Z (320 days ago)
elapsed time: 56,293 ms
tested at: 2025-02-01T14:43:58.869373Z (320 days ago)
elapsed time: 56,525 ms
tested at: 2025-02-02T09:05:10.457957Z (319 days ago)
elapsed time: 23,346 ms
The build should have timed out
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 288, in <lambda>
("end_to_end dummy", lambda: end_to_end(test_model="dummy")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/end_to_end.py", line 78, in end_to_end
raise Exception("The build should have timed out")
Exception: The build should have timed out
tested at: 2025-02-02T14:10:34.499863Z (319 days ago)
elapsed time: 23,329 ms
The build should have timed out
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 288, in <lambda>
("end_to_end dummy", lambda: end_to_end(test_model="dummy")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/end_to_end.py", line 78, in end_to_end
raise Exception("The build should have timed out")
Exception: The build should have timed out
tested at: 2025-02-02T16:15:48.629665Z (319 days ago)
elapsed time: 23,387 ms
The build should have timed out
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 288, in <lambda>
("end_to_end dummy", lambda: end_to_end(test_model="dummy")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/end_to_end.py", line 78, in end_to_end
raise Exception("The build should have timed out")
Exception: The build should have timed out
tested at: 2025-02-03T17:04:26.540585Z (318 days ago)
elapsed time: 23,447 ms
The build should have timed out
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 288, in <lambda>
("end_to_end dummy", lambda: end_to_end(test_model="dummy")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/end_to_end.py", line 78, in end_to_end
raise Exception("The build should have timed out")
Exception: The build should have timed out
tested at: 2025-02-04T15:10:26.917676Z (317 days ago)
elapsed time: 23,420 ms
The build should have timed out
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 288, in <lambda>
("end_to_end dummy", lambda: end_to_end(test_model="dummy")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/end_to_end.py", line 78, in end_to_end
raise Exception("The build should have timed out")
Exception: The build should have timed out
tested at: 2025-02-05T15:29:51.351113Z (316 days ago)
elapsed time: 23,332 ms
The build should have timed out
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 288, in <lambda>
("end_to_end dummy", lambda: end_to_end(test_model="dummy")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/end_to_end.py", line 78, in end_to_end
raise Exception("The build should have timed out")
Exception: The build should have timed out
tested at: 2025-02-05T16:21:42.336285Z (316 days ago)
elapsed time: 1,442 ms
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 288, in <lambda>
("end_to_end dummy", lambda: end_to_end(test_model="dummy")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/end_to_end.py", line 22, in end_to_end
assert cargo_run(["config", "--set", "model", "invalid-model-name"], check=False) != 0
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
tested at: 2025-02-06T15:55:46.906731Z (315 days ago)
elapsed time: 47,242 ms
tested at: 2025-02-07T16:11:19.427628Z (314 days ago)
elapsed time: 47,495 ms
tested at: 2025-02-08T07:18:57.662601Z (313 days ago)
elapsed time: 47,635 ms
tested at: 2025-02-08T09:14:50.625391Z (313 days ago)
elapsed time: 47,705 ms
tested at: 2025-02-09T13:52:50.577849Z (312 days ago)
elapsed time: 48,143 ms
tested at: 2025-02-13T11:03:41.308826Z (308 days ago)
elapsed time: 57,015 ms
tested at: 2025-02-14T10:49:06.096222Z (307 days ago)
elapsed time: 60,737 ms
tested at: 2025-02-15T18:21:48.654767Z (306 days ago)
elapsed time: 27,161 ms
tested at: 2025-02-15T19:25:27.035811Z (306 days ago)
elapsed time: 39,399 ms
tested at: 2025-02-16T22:19:46.278551Z (304 days ago)
elapsed time: 72,814 ms
tested at: 2025-02-17T01:09:23.586875Z (304 days ago)
elapsed time: 39,393 ms
tested at: 2025-02-17T23:02:16.263362Z (303 days ago)
elapsed time: 39,473 ms
tested at: 2025-02-19T01:05:38.745266Z (302 days ago)
elapsed time: 39,823 ms
tested at: 2025-02-20T10:48:05.861169Z (301 days ago)
elapsed time: 74,141 ms
tested at: 2025-02-20T21:08:53.813099Z (300 days ago)
elapsed time: 39,761 ms
tested at: 2025-02-21T11:22:37.525002Z (300 days ago)
elapsed time: 72,591 ms
tested at: 2025-02-22T00:04:30.493006Z (299 days ago)
elapsed time: 40,533 ms
tested at: 2025-02-22T13:23:38.813172Z (299 days ago)
elapsed time: 40,534 ms
tested at: 2025-02-23T12:06:32.581533Z (298 days ago)
elapsed time: 48,457 ms
Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
Traceback (most recent call last):
File "C:\Users\baehy\ragit\tests\tests.py", line 402, in <module>
test()
~~~~^^
File "C:\Users\baehy\ragit\tests\tests.py", line 354, in <lambda>
("end_to_end dummy", lambda: end_to_end(test_model="dummy")),
~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\end_to_end.py", line 94, in end_to_end
cargo_run(["build"])
~~~~~~~~~^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\utils.py", line 66, in cargo_run
result = subprocess.run(args, **kwargs)
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.752.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 579, in run
raise CalledProcessError(retcode, process.args,
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
tested at: 2025-02-23T19:52:59.344108Z (298 days ago)
elapsed time: 40,562 ms
tested at: 2025-02-24T21:11:27.969515Z (296 days ago)
elapsed time: 40,583 ms
tested at: 2025-02-25T10:21:57.114315Z (296 days ago)
elapsed time: 76,506 ms
tested at: 2025-02-26T00:11:13.124361Z (295 days ago)
elapsed time: 39,488 ms
tested at: 2025-02-26T20:31:03.132225Z (295 days ago)
elapsed time: 41,602 ms
tested at: 2025-02-27T22:17:10.555252Z (293 days ago)
elapsed time: 41,503 ms
tested at: 2025-02-28T11:26:54.429209Z (293 days ago)
elapsed time: 77,774 ms
tested at: 2025-03-01T12:48:39.169037Z (292 days ago)
elapsed time: 377,229 ms
tested at: 2025-03-02T01:39:46.519770Z (291 days ago)
elapsed time: 131,165 ms
tested at: 2025-03-03T19:29:08.807193Z (290 days ago)
elapsed time: 132,636 ms
tested at: 2025-03-03T21:49:32.573405Z (289 days ago)
elapsed time: 131,583 ms
tested at: 2025-03-04T22:05:09.327920Z (288 days ago)
elapsed time: 132,501 ms
tested at: 2025-03-06T00:32:55.162195Z (287 days ago)
elapsed time: 134,007 ms
tested at: 2025-03-07T01:10:52.766008Z (286 days ago)
elapsed time: 132,380 ms
tested at: 2025-03-08T13:37:45.309833Z (285 days ago)
elapsed time: 132,787 ms
tested at: 2025-03-09T00:38:56.569526Z (284 days ago)
elapsed time: 131,224 ms
tested at: 2025-03-09T14:13:04.841105Z (284 days ago)
elapsed time: 171,432 ms
tested at: 2025-03-10T11:01:50.525266Z (283 days ago)
elapsed time: 167,195 ms
tested at: 2025-03-10T22:06:31.618023Z (282 days ago)
elapsed time: 132,094 ms
tested at: 2025-03-12T11:49:54.685992Z (281 days ago)
elapsed time: 164,290 ms
tested at: 2025-03-15T01:23:08.009762Z (278 days ago)
elapsed time: 132,641 ms
tested at: 2025-03-21T01:05:42.480054Z (272 days ago)
elapsed time: 41,280 ms
tested at: 2025-03-23T22:32:14.898790Z (269 days ago)
elapsed time: 40,386 ms
tested at: 2025-03-31T22:46:05.278555Z (261 days ago)
elapsed time: 40,700 ms
tested at: 2025-04-01T22:38:25.777417Z (260 days ago)
elapsed time: 38,559 ms
tested at: 2025-04-02T11:15:28.201699Z (260 days ago)
elapsed time: 70,670 ms
tested at: 2025-04-03T11:32:16.038744Z (259 days ago)
elapsed time: 73,379 ms
tested at: 2025-04-04T13:59:04.442731Z (258 days ago)
elapsed time: 73,584 ms
tested at: 2025-04-11T21:47:12.055124Z (250 days ago)
elapsed time: 41,417 ms
tested at: 2025-05-09T11:29:30.226975Z (223 days ago)
elapsed time: 76,034 ms
tested at: 2025-05-14T14:26:51.020259Z (218 days ago)
elapsed time: 81,064 ms
tested at: 2025-05-15T23:00:24.413178Z (216 days ago)
elapsed time: 41,584 ms
Command '['cargo', 'run', '--release', '--', 'meta', '--set', 'git-hash', 'adcf2562496ce6b4c2f17f0a5699f05d686b2dd9']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 621, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 560, in <lambda>
("end_to_end dummy", lambda: end_to_end(test_model="dummy")),
File "/home/baehyunsol/Documents/ragit/tests/end_to_end.py", line 133, in end_to_end
cargo_run(["meta", "--set", "git-hash", get_commit_hash()])
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 70, in cargo_run
result = subprocess.run(args, **kwargs)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'meta', '--set', 'git-hash', 'adcf2562496ce6b4c2f17f0a5699f05d686b2dd9']' returned non-zero exit status 1.
tested at: 2025-05-17T00:48:25.067654Z (215 days ago)
elapsed time: 43,263 ms
tested at: 2025-05-18T09:48:01.799303Z (214 days ago)
elapsed time: 43,243 ms
tested at: 2025-05-19T10:47:10.063082Z (213 days ago)
elapsed time: 81,439 ms
tested at: 2025-05-20T00:59:40.946018Z (212 days ago)
elapsed time: 36,348 ms
tested at: 2025-05-23T00:18:04.093493Z (209 days ago)
elapsed time: 35,250 ms
tested at: 2025-05-24T20:40:39.036733Z (208 days ago)
elapsed time: 42,427 ms
tested at: 2025-05-29T21:31:38.721609Z (202 days ago)
elapsed time: 87,369 ms
tested at: 2025-05-31T05:38:30.224392Z (201 days ago)
elapsed time: 87,833 ms
tested at: 2025-06-01T18:34:31.254192Z (200 days ago)
elapsed time: 33,831 ms
tested at: 2025-06-02T00:08:14.271670Z (199 days ago)
elapsed time: 36,250 ms
tested at: 2025-06-03T01:16:18.813157Z (198 days ago)
elapsed time: 38,999 ms
tested at: 2025-06-05T12:05:40.934810Z (196 days ago)
elapsed time: 65,929 ms
tested at: 2025-06-05T16:46:27.585326Z (196 days ago)
elapsed time: 91,211 ms
tested at: 2025-06-07T08:13:40.365332Z (194 days ago)
elapsed time: 83,251 ms
tested at: 2025-06-09T20:06:53.014494Z (192 days ago)
elapsed time: 88,179 ms
tested at: 2025-06-20T11:50:38.004891Z (181 days ago)
elapsed time: 76,638 ms
tested at: 2025-06-27T11:25:09.159801Z (174 days ago)
elapsed time: 69,808 ms
tested at: 2025-07-09T12:03:26.241876Z (162 days ago)
elapsed time: 69,750 ms
--- summary of the knowledge-base ---
dummy
tested at: 2025-07-21T08:03:09.691900Z (150 days ago)
elapsed time: 103,528 ms
--- summary of the knowledge-base ---
dummy
--- What makes ragit special? ---
dummy
--- What makes ragit special? (super rerank mode) ---
dummy
tested at: 2025-07-21T11:53:02.138116Z (150 days ago)
elapsed time: 78,208 ms
--- summary of the knowledge-base ---
dummy
--- What makes ragit special? ---
dummy
--- What makes ragit special? (super rerank mode) ---
dummy
tested at: 2025-07-25T08:20:45.661982Z (146 days ago)
elapsed time: 101,616 ms
--- summary of the knowledge-base ---
dummy
--- What makes ragit special? ---
dummy
--- What makes ragit special? (super rerank mode) ---
dummy
tested at: 2025-08-01T14:20:52.926510Z (139 days ago)
elapsed time: 102,263 ms
--- summary of the knowledge-base ---
dummy
--- What makes ragit special? ---
dummy
--- What makes ragit special? (super rerank mode) ---
dummy
tested at: 2025-08-26T11:51:14.366171Z (114 days ago)
elapsed time: 33,191 ms
Traceback (most recent call last):
File "/Users/baehyunsol/Documents/Rust/ragit-versions/ragit-0.4.3-dev/tests/tests.py", line 822, in <module>
test()
File "/Users/baehyunsol/Documents/Rust/ragit-versions/ragit-0.4.3-dev/tests/tests.py", line 755, in <lambda>
("end_to_end dummy", lambda: end_to_end(test_model="dummy")),
File "/Users/baehyunsol/Documents/Rust/ragit-versions/ragit-0.4.3-dev/tests/end_to_end.py", line 107, in end_to_end
assert has_ragit_in_tfidf
AssertionError
tested at: 2025-09-15T16:35:10.288703Z (94 days ago)
elapsed time: 72,406 ms
--- summary of the knowledge-base ---
dummy
--- What makes ragit special? ---
dummy
--- What makes ragit special? (super rerank mode) ---
dummy
tested at: 2025-09-23T17:41:46.610984Z (86 days ago)
elapsed time: 103,592 ms
--- summary of the knowledge-base ---
dummy
--- What makes ragit special? ---
dummy
--- What makes ragit special? (super rerank mode) ---
dummy
tested at: 2025-11-20T10:25:32.672961Z (28 days ago)
elapsed time: 87,493 ms
--- summary of the knowledge-base ---
dummy
--- What makes ragit special? ---
dummy
--- What makes ragit special? (super rerank mode) ---
dummy