total: 86, pass: 82, fail: 4
images2 [model] run `images2` test
It tests whether models can generate image-description
files correctly.
NOTE: It uses the vision capability of the model.
Make sure that the model has one.tested at: 2025-01-31T13:19:57.917499Z (368 days ago)
elapsed time: 14,858 ms
tested at: 2025-02-01T13:33:17.370823Z (367 days ago)
elapsed time: 16,524 ms
tested at: 2025-02-01T14:43:58.869373Z (367 days ago)
elapsed time: 15,202 ms
tested at: 2025-02-02T09:05:10.457957Z (366 days ago)
elapsed time: 12,234 ms
tested at: 2025-02-02T14:10:34.499863Z (366 days ago)
elapsed time: 12,678 ms
tested at: 2025-02-02T16:15:48.629665Z (366 days ago)
elapsed time: 18,709 ms
tested at: 2025-02-03T17:04:26.540585Z (365 days ago)
elapsed time: 15,566 ms
tested at: 2025-02-04T15:10:26.917676Z (364 days ago)
elapsed time: 12,855 ms
tested at: 2025-02-05T15:29:51.351113Z (363 days ago)
elapsed time: 13,350 ms
tested at: 2025-02-05T16:21:42.336285Z (363 days ago)
elapsed time: 2,491 ms
Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 101.
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 295, in <lambda>
("images2 gpt-4o-mini", lambda: images2(test_model="gpt-4o-mini")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/images2.py", line 30, in images2
cargo_run(["build"])
File "/home/ubuntu/Documents/ci/ragit/tests/utils.py", line 61, in cargo_run
result = subprocess.run(args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 101.
tested at: 2025-02-06T15:55:46.906731Z (362 days ago)
elapsed time: 13,717 ms
tested at: 2025-02-07T16:11:19.427628Z (361 days ago)
elapsed time: 13,248 ms
tested at: 2025-02-08T07:18:57.662601Z (360 days ago)
elapsed time: 11,222 ms
tested at: 2025-02-08T09:14:50.625391Z (360 days ago)
elapsed time: 10,980 ms
tested at: 2025-02-09T13:52:50.577849Z (359 days ago)
elapsed time: 11,596 ms
tested at: 2025-02-13T11:03:41.308826Z (355 days ago)
elapsed time: 16,013 ms
tested at: 2025-02-14T10:49:06.096222Z (354 days ago)
elapsed time: 13,315 ms
tested at: 2025-02-15T18:21:48.654767Z (353 days ago)
elapsed time: 9,925 ms
tested at: 2025-02-15T19:25:27.035811Z (353 days ago)
elapsed time: 13,855 ms
tested at: 2025-02-16T22:19:46.278551Z (352 days ago)
elapsed time: 13,051 ms
tested at: 2025-02-17T01:09:23.586875Z (352 days ago)
elapsed time: 10,037 ms
tested at: 2025-02-17T23:02:16.263362Z (351 days ago)
elapsed time: 9,414 ms
tested at: 2025-02-19T01:05:38.745266Z (350 days ago)
elapsed time: 12,764 ms
tested at: 2025-02-20T10:48:05.861169Z (348 days ago)
elapsed time: 14,047 ms
tested at: 2025-02-20T21:08:53.813099Z (348 days ago)
elapsed time: 11,625 ms
tested at: 2025-02-21T11:22:37.525002Z (347 days ago)
elapsed time: 12,921 ms
tested at: 2025-02-22T00:04:30.493006Z (347 days ago)
elapsed time: 13,237 ms
tested at: 2025-02-22T13:23:38.813172Z (346 days ago)
elapsed time: 10,108 ms
tested at: 2025-02-23T12:06:32.581533Z (345 days ago)
elapsed time: 16,002 ms
tested at: 2025-02-23T19:52:59.344108Z (345 days ago)
elapsed time: 8,206 ms
tested at: 2025-02-24T21:11:27.969515Z (344 days ago)
elapsed time: 10,819 ms
tested at: 2025-02-25T10:21:57.114315Z (343 days ago)
elapsed time: 13,729 ms
tested at: 2025-02-26T00:11:13.124361Z (343 days ago)
elapsed time: 13,047 ms
tested at: 2025-02-26T20:31:03.132225Z (342 days ago)
elapsed time: 11,326 ms
tested at: 2025-02-27T22:17:10.555252Z (341 days ago)
elapsed time: 8,598 ms
tested at: 2025-02-28T11:26:54.429209Z (340 days ago)
elapsed time: 13,972 ms
tested at: 2025-03-01T12:48:39.169037Z (339 days ago)
elapsed time: 12,440 ms
tested at: 2025-03-02T01:39:46.519770Z (339 days ago)
elapsed time: 8,297 ms
tested at: 2025-03-03T19:29:08.807193Z (337 days ago)
elapsed time: 9,411 ms
tested at: 2025-03-03T21:49:32.573405Z (337 days ago)
elapsed time: 9,015 ms
tested at: 2025-03-04T22:05:09.327920Z (336 days ago)
elapsed time: 8,199 ms
tested at: 2025-03-06T00:32:55.162195Z (335 days ago)
elapsed time: 10,124 ms
tested at: 2025-03-07T01:10:52.766008Z (334 days ago)
elapsed time: 9,148 ms
tested at: 2025-03-08T13:37:45.309833Z (332 days ago)
elapsed time: 9,315 ms
tested at: 2025-03-09T00:38:56.569526Z (332 days ago)
elapsed time: 17,395 ms
tested at: 2025-03-09T14:13:04.841105Z (331 days ago)
elapsed time: 11,582 ms
'charmap' codec can't decode byte 0x8d in position 40: character maps to <undefined>
Traceback (most recent call last):
File "C:\Users\baehy\ragit\tests\tests.py", line 504, in <module>
test()
~~~~^^
File "C:\Users\baehy\ragit\tests\tests.py", line 459, in <lambda>
("images2 gpt-4o-mini", lambda: images2(test_model="gpt-4o-mini")),
~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\images2.py", line 38, in images2
j = json.load(f)
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.752.0_x64__qbz5n2kfra8p0\Lib\json\__init__.py", line 293, in load
return loads(fp.read(),
~~~~~~~^^
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.752.0_x64__qbz5n2kfra8p0\Lib\encodings\cp1252.py", line 23, in decode
return codecs.charmap_decode(input,self.errors,decoding_table)[0]
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8d in position 40: character maps to <undefined>
tested at: 2025-03-10T11:01:50.525266Z (330 days ago)
elapsed time: 13,792 ms
tested at: 2025-03-10T22:06:31.618023Z (330 days ago)
elapsed time: 8,306 ms
tested at: 2025-03-12T11:49:54.685992Z (328 days ago)
elapsed time: 10,623 ms
tested at: 2025-03-15T01:23:08.009762Z (326 days ago)
elapsed time: 9,015 ms
tested at: 2025-03-21T01:05:42.480054Z (320 days ago)
elapsed time: 8,617 ms
tested at: 2025-03-23T22:32:14.898790Z (317 days ago)
elapsed time: 9,609 ms
tested at: 2025-03-31T22:46:05.278555Z (309 days ago)
elapsed time: 10,919 ms
tested at: 2025-04-01T22:38:25.777417Z (308 days ago)
elapsed time: 13,747 ms
tested at: 2025-04-02T11:15:28.201699Z (307 days ago)
elapsed time: 13,214 ms
tested at: 2025-04-03T11:32:16.038744Z (306 days ago)
elapsed time: 14,931 ms
tested at: 2025-04-04T13:59:04.442731Z (305 days ago)
elapsed time: 12,812 ms
tested at: 2025-04-11T21:47:12.055124Z (298 days ago)
elapsed time: 7,660 ms
tested at: 2025-05-09T11:29:30.226975Z (270 days ago)
elapsed time: 16,031 ms
tested at: 2025-05-14T14:26:51.020259Z (265 days ago)
elapsed time: 13,296 ms
tested at: 2025-05-15T23:00:24.413178Z (264 days ago)
elapsed time: 11,348 ms
tested at: 2025-05-17T00:48:25.067654Z (263 days ago)
elapsed time: 9,358 ms
tested at: 2025-05-18T09:48:01.799303Z (261 days ago)
elapsed time: 7,839 ms
tested at: 2025-05-19T10:47:10.063082Z (260 days ago)
elapsed time: 13,375 ms
tested at: 2025-05-20T00:59:40.946018Z (260 days ago)
elapsed time: 9,460 ms
tested at: 2025-05-23T00:18:04.093493Z (257 days ago)
elapsed time: 10,071 ms
tested at: 2025-05-24T20:40:39.036733Z (255 days ago)
elapsed time: 6,645 ms
tested at: 2025-05-29T21:31:38.721609Z (250 days ago)
elapsed time: 9,996 ms
tested at: 2025-05-31T05:38:30.224392Z (249 days ago)
elapsed time: 11,565 ms
tested at: 2025-06-01T18:34:31.254192Z (247 days ago)
elapsed time: 7,489 ms
tested at: 2025-06-02T00:08:14.271670Z (247 days ago)
elapsed time: 9,816 ms
tested at: 2025-06-03T01:16:18.813157Z (246 days ago)
elapsed time: 5,689 ms
tested at: 2025-06-05T12:05:40.934810Z (243 days ago)
elapsed time: 12,032 ms
tested at: 2025-06-05T16:46:27.585326Z (243 days ago)
elapsed time: 11,652 ms
tested at: 2025-06-07T08:13:40.365332Z (241 days ago)
elapsed time: 755 ms
Command '['cargo', 'run', '--release', '--no-default-features', '--', 'config', '--set', 'model', 'gpt-4o-mini']' returned non-zero exit status 1.
Traceback (most recent call last):
File "C:\Users\baehy\ragit\tests\tests.py", line 720, in <module>
test()
~~~~^^
File "C:\Users\baehy\ragit\tests\tests.py", line 665, in <lambda>
("images2 gpt-4o-mini", lambda: images2(test_model="gpt-4o-mini")),
~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\images2.py", line 25, in images2
cargo_run(["config", "--set", "model", test_model])
~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\utils.py", line 87, in cargo_run
result = subprocess.run(args, **kwargs)
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.1008.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 577, in run
raise CalledProcessError(retcode, process.args,
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--no-default-features', '--', 'config', '--set', 'model', 'gpt-4o-mini']' returned non-zero exit status 1.
tested at: 2025-06-09T20:06:53.014494Z (239 days ago)
elapsed time: 8,960 ms
tested at: 2025-06-20T11:50:38.004891Z (228 days ago)
elapsed time: 10,662 ms
tested at: 2025-06-27T11:25:09.159801Z (221 days ago)
elapsed time: 10,910 ms
tested at: 2025-07-09T12:03:26.241876Z (209 days ago)
elapsed time: 10,800 ms
tested at: 2025-07-21T08:03:09.691900Z (197 days ago)
elapsed time: 9,989 ms
tested at: 2025-07-21T11:53:02.138116Z (197 days ago)
elapsed time: 12,076 ms
tested at: 2025-07-25T08:20:45.661982Z (193 days ago)
elapsed time: 10,112 ms
tested at: 2025-08-01T14:20:52.926510Z (186 days ago)
elapsed time: 12,233 ms
tested at: 2025-08-26T11:51:14.366171Z (161 days ago)
elapsed time: 12,611 ms
'NoneType' object has no attribute 'group'
Traceback (most recent call last):
File "/Users/baehyunsol/Documents/Rust/ragit-versions/ragit-0.4.3-dev/tests/tests.py", line 822, in <module>
test()
File "/Users/baehyunsol/Documents/Rust/ragit-versions/ragit-0.4.3-dev/tests/tests.py", line 767, in <lambda>
("images2 gpt-4o-mini", lambda: images2(test_model="gpt-4o-mini")),
File "/Users/baehyunsol/Documents/Rust/ragit-versions/ragit-0.4.3-dev/tests/images2.py", line 57, in images2
file_uid = re.search(r"uid\:\s([0-9a-f]{64})", ls_file_result).group(1)
AttributeError: 'NoneType' object has no attribute 'group'
tested at: 2025-09-15T16:35:10.288703Z (141 days ago)
elapsed time: 12,414 ms
tested at: 2025-09-23T17:41:46.610984Z (133 days ago)
elapsed time: 18,265 ms