total: 76, pass: 72, fail: 4
images2 [model] run `images2` test
It tests whether models can generate image-description
files correctly.
NOTE: It uses the vision capability of the model.
Make sure that the model has one.tested at: 2025-01-31T13:19:57.917499Z (134 days ago)
elapsed time: 16,084 ms
tested at: 2025-02-01T13:33:17.370823Z (133 days ago)
elapsed time: 14,393 ms
tested at: 2025-02-01T14:43:58.869373Z (133 days ago)
elapsed time: 18,283 ms
tested at: 2025-02-02T09:05:10.457957Z (132 days ago)
elapsed time: 13,113 ms
tested at: 2025-02-02T14:10:34.499863Z (132 days ago)
elapsed time: 12,792 ms
tested at: 2025-02-02T16:15:48.629665Z (132 days ago)
elapsed time: 12,969 ms
tested at: 2025-02-03T17:04:26.540585Z (131 days ago)
elapsed time: 13,148 ms
tested at: 2025-02-04T15:10:26.917676Z (130 days ago)
elapsed time: 12,780 ms
tested at: 2025-02-05T15:29:51.351113Z (129 days ago)
elapsed time: 127,093 ms
Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 298, in <lambda>
("images2 claude-3.5-sonnet", lambda: images2(test_model="claude-3.5-sonnet")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/images2.py", line 30, in images2
cargo_run(["build"])
File "/home/ubuntu/Documents/ci/ragit/tests/utils.py", line 61, in cargo_run
result = subprocess.run(args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
tested at: 2025-02-05T16:21:42.336285Z (129 days ago)
elapsed time: 2,496 ms
Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 101.
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 298, in <lambda>
("images2 claude-3.5-sonnet", lambda: images2(test_model="claude-3.5-sonnet")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/images2.py", line 30, in images2
cargo_run(["build"])
File "/home/ubuntu/Documents/ci/ragit/tests/utils.py", line 61, in cargo_run
result = subprocess.run(args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 101.
tested at: 2025-02-06T15:55:46.906731Z (128 days ago)
elapsed time: 13,035 ms
tested at: 2025-02-07T16:11:19.427628Z (127 days ago)
elapsed time: 106,793 ms
tested at: 2025-02-08T07:18:57.662601Z (126 days ago)
elapsed time: 12,298 ms
tested at: 2025-02-08T09:14:50.625391Z (126 days ago)
elapsed time: 13,159 ms
tested at: 2025-02-09T13:52:50.577849Z (125 days ago)
elapsed time: 12,708 ms
tested at: 2025-02-13T11:03:41.308826Z (121 days ago)
elapsed time: 13,705 ms
tested at: 2025-02-14T10:49:06.096222Z (120 days ago)
elapsed time: 14,481 ms
tested at: 2025-02-15T18:21:48.654767Z (119 days ago)
elapsed time: 10,843 ms
tested at: 2025-02-15T19:25:27.035811Z (119 days ago)
elapsed time: 73,557 ms
tested at: 2025-02-16T22:19:46.278551Z (118 days ago)
elapsed time: 13,915 ms
tested at: 2025-02-17T01:09:23.586875Z (118 days ago)
elapsed time: 11,439 ms
tested at: 2025-02-17T23:02:16.263362Z (117 days ago)
elapsed time: 11,029 ms
tested at: 2025-02-19T01:05:38.745266Z (116 days ago)
elapsed time: 37,275 ms
tested at: 2025-02-20T10:48:05.861169Z (114 days ago)
elapsed time: 13,482 ms
tested at: 2025-02-20T21:08:53.813099Z (114 days ago)
elapsed time: 8,996 ms
tested at: 2025-02-21T11:22:37.525002Z (113 days ago)
elapsed time: 12,849 ms
tested at: 2025-02-22T00:04:30.493006Z (113 days ago)
elapsed time: 10,328 ms
tested at: 2025-02-22T13:23:38.813172Z (112 days ago)
elapsed time: 97,035 ms
Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 402, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 364, in <lambda>
("images2 claude-3.5-sonnet", lambda: images2(test_model="claude-3.5-sonnet")),
File "/home/baehyunsol/Documents/ragit/tests/images2.py", line 30, in images2
cargo_run(["build"])
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 66, in cargo_run
result = subprocess.run(args, **kwargs)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
tested at: 2025-02-23T12:06:32.581533Z (111 days ago)
elapsed time: 14,835 ms
tested at: 2025-02-23T19:52:59.344108Z (111 days ago)
elapsed time: 35,537 ms
tested at: 2025-02-24T21:11:27.969515Z (110 days ago)
elapsed time: 9,202 ms
tested at: 2025-02-25T10:21:57.114315Z (109 days ago)
elapsed time: 13,546 ms
tested at: 2025-02-26T00:11:13.124361Z (109 days ago)
elapsed time: 10,114 ms
tested at: 2025-02-26T20:31:03.132225Z (108 days ago)
elapsed time: 11,227 ms
tested at: 2025-02-27T22:17:10.555252Z (107 days ago)
elapsed time: 9,701 ms
tested at: 2025-02-28T11:26:54.429209Z (106 days ago)
elapsed time: 14,245 ms
tested at: 2025-03-01T12:48:39.169037Z (105 days ago)
elapsed time: 11,519 ms
tested at: 2025-03-02T01:39:46.519770Z (105 days ago)
elapsed time: 9,909 ms
tested at: 2025-03-03T19:29:08.807193Z (103 days ago)
elapsed time: 11,728 ms
tested at: 2025-03-03T21:49:32.573405Z (103 days ago)
elapsed time: 11,027 ms
tested at: 2025-03-04T22:05:09.327920Z (102 days ago)
elapsed time: 9,819 ms
tested at: 2025-03-06T00:32:55.162195Z (101 days ago)
elapsed time: 10,215 ms
tested at: 2025-03-07T01:10:52.766008Z (100 days ago)
elapsed time: 10,223 ms
tested at: 2025-03-08T13:37:45.309833Z (98 days ago)
elapsed time: 9,721 ms
tested at: 2025-03-09T00:38:56.569526Z (98 days ago)
elapsed time: 10,113 ms
tested at: 2025-03-09T14:13:04.841105Z (97 days ago)
elapsed time: 13,332 ms
tested at: 2025-03-10T11:01:50.525266Z (96 days ago)
elapsed time: 13,904 ms
tested at: 2025-03-10T22:06:31.618023Z (96 days ago)
elapsed time: 10,922 ms
tested at: 2025-03-12T11:49:54.685992Z (94 days ago)
elapsed time: 13,690 ms
tested at: 2025-03-15T01:23:08.009762Z (92 days ago)
elapsed time: 10,425 ms
tested at: 2025-03-21T01:05:42.480054Z (86 days ago)
elapsed time: 13,043 ms
tested at: 2025-03-23T22:32:14.898790Z (83 days ago)
elapsed time: 10,210 ms
tested at: 2025-03-31T22:46:05.278555Z (75 days ago)
elapsed time: 38,434 ms
tested at: 2025-04-01T22:38:25.777417Z (74 days ago)
elapsed time: 37,523 ms
tested at: 2025-04-02T11:15:28.201699Z (73 days ago)
elapsed time: 13,122 ms
tested at: 2025-04-03T11:32:16.038744Z (72 days ago)
elapsed time: 15,657 ms
tested at: 2025-04-04T13:59:04.442731Z (71 days ago)
elapsed time: 14,843 ms
tested at: 2025-04-11T21:47:12.055124Z (64 days ago)
elapsed time: 10,161 ms
tested at: 2025-05-09T11:29:30.226975Z (36 days ago)
elapsed time: 44,614 ms
tested at: 2025-05-14T14:26:51.020259Z (31 days ago)
elapsed time: 19,467 ms
tested at: 2025-05-15T23:00:24.413178Z (30 days ago)
elapsed time: 9,449 ms
tested at: 2025-05-17T00:48:25.067654Z (29 days ago)
elapsed time: 12,780 ms
tested at: 2025-05-18T09:48:01.799303Z (27 days ago)
elapsed time: 9,143 ms
tested at: 2025-05-19T10:47:10.063082Z (26 days ago)
elapsed time: 15,367 ms
tested at: 2025-05-20T00:59:40.946018Z (26 days ago)
elapsed time: 9,344 ms
tested at: 2025-05-23T00:18:04.093493Z (23 days ago)
elapsed time: 10,155 ms
tested at: 2025-05-24T20:40:39.036733Z (21 days ago)
elapsed time: 9,756 ms
tested at: 2025-05-29T21:31:38.721609Z (16 days ago)
elapsed time: 14,068 ms
tested at: 2025-05-31T05:38:30.224392Z (14 days ago)
elapsed time: 12,145 ms
tested at: 2025-06-01T18:34:31.254192Z (13 days ago)
elapsed time: 8,301 ms
tested at: 2025-06-02T00:08:14.271670Z (13 days ago)
elapsed time: 12,607 ms
tested at: 2025-06-03T01:16:18.813157Z (12 days ago)
elapsed time: 9,500 ms
tested at: 2025-06-05T12:05:40.934810Z (9 days ago)
elapsed time: 16,831 ms
tested at: 2025-06-05T16:46:27.585326Z (9 days ago)
elapsed time: 16,110 ms
tested at: 2025-06-07T08:13:40.365332Z (7 days ago)
elapsed time: 700 ms
Command '['cargo', 'run', '--release', '--no-default-features', '--', 'config', '--set', 'model', 'claude-3.5-sonnet']' returned non-zero exit status 1.
Traceback (most recent call last):
File "C:\Users\baehy\ragit\tests\tests.py", line 720, in <module>
test()
~~~~^^
File "C:\Users\baehy\ragit\tests\tests.py", line 673, in <lambda>
("images2 claude-3.5-sonnet", lambda: images2(test_model="claude-3.5-sonnet")),
~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\images2.py", line 25, in images2
cargo_run(["config", "--set", "model", test_model])
~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\utils.py", line 87, in cargo_run
result = subprocess.run(args, **kwargs)
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.1008.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 577, in run
raise CalledProcessError(retcode, process.args,
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--no-default-features', '--', 'config', '--set', 'model', 'claude-3.5-sonnet']' returned non-zero exit status 1.
tested at: 2025-06-09T20:06:53.014494Z (5 days ago)
elapsed time: 15,471 ms