total: 45, pass: 43, fail: 2
audit [model] run `audit` testtested at: 2025-03-06T00:32:55.162195Z (287 days ago)
elapsed time: 6,253 ms
tested at: 2025-03-07T01:10:52.766008Z (286 days ago)
elapsed time: 6,286 ms
tested at: 2025-03-08T13:37:45.309833Z (285 days ago)
elapsed time: 5,357 ms
tested at: 2025-03-09T00:38:56.569526Z (284 days ago)
elapsed time: 6,264 ms
tested at: 2025-03-09T14:13:04.841105Z (284 days ago)
elapsed time: 13,507 ms
tested at: 2025-03-10T11:01:50.525266Z (283 days ago)
elapsed time: 14,874 ms
tested at: 2025-03-10T22:06:31.618023Z (282 days ago)
elapsed time: 5,637 ms
tested at: 2025-03-12T11:49:54.685992Z (281 days ago)
elapsed time: 14,566 ms
tested at: 2025-03-15T01:23:08.009762Z (278 days ago)
elapsed time: 6,701 ms
tested at: 2025-03-21T01:05:42.480054Z (272 days ago)
elapsed time: 6,272 ms
tested at: 2025-03-23T22:32:14.898790Z (269 days ago)
elapsed time: 5,239 ms
tested at: 2025-03-31T22:46:05.278555Z (261 days ago)
elapsed time: 8,153 ms
tested at: 2025-04-01T22:38:25.777417Z (260 days ago)
elapsed time: 6,539 ms
tested at: 2025-04-02T11:15:28.201699Z (260 days ago)
elapsed time: 17,208 ms
tested at: 2025-04-03T11:32:16.038744Z (259 days ago)
elapsed time: 16,158 ms
tested at: 2025-04-04T13:59:04.442731Z (258 days ago)
elapsed time: 14,894 ms
tested at: 2025-04-11T21:47:12.055124Z (250 days ago)
elapsed time: 5,943 ms
tested at: 2025-05-09T11:29:30.226975Z (223 days ago)
elapsed time: 16,512 ms
tested at: 2025-05-14T14:26:51.020259Z (218 days ago)
elapsed time: 15,265 ms
tested at: 2025-05-15T23:00:24.413178Z (216 days ago)
elapsed time: 6,920 ms
tested at: 2025-05-17T00:48:25.067654Z (215 days ago)
elapsed time: 6,259 ms
tested at: 2025-05-18T09:48:01.799303Z (214 days ago)
elapsed time: 5,575 ms
tested at: 2025-05-19T10:47:10.063082Z (213 days ago)
elapsed time: 15,851 ms
tested at: 2025-05-20T00:59:40.946018Z (212 days ago)
elapsed time: 5,962 ms
tested at: 2025-05-23T00:18:04.093493Z (209 days ago)
elapsed time: 95,491 ms
Command '['cargo', 'run', '--release', '--', 'query', 'Why is the sky blue?']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 670, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 609, in <lambda>
("audit llama3.3-70b", lambda: audit(test_model="llama3.3-70b")),
File "/home/baehyunsol/Documents/ragit/tests/audit.py", line 35, in audit
cargo_run(["query", "Why is the sky blue?"])
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 77, in cargo_run
result = subprocess.run(args, **kwargs)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'query', 'Why is the sky blue?']' returned non-zero exit status 1.
tested at: 2025-05-24T20:40:39.036733Z (208 days ago)
elapsed time: 5,978 ms
tested at: 2025-05-29T21:31:38.721609Z (202 days ago)
elapsed time: 11,171 ms
tested at: 2025-05-31T05:38:30.224392Z (201 days ago)
elapsed time: 11,329 ms
tested at: 2025-06-01T18:34:31.254192Z (200 days ago)
elapsed time: 6,058 ms
tested at: 2025-06-02T00:08:14.271670Z (199 days ago)
elapsed time: 5,322 ms
tested at: 2025-06-03T01:16:18.813157Z (198 days ago)
elapsed time: 5,776 ms
tested at: 2025-06-05T12:05:40.934810Z (196 days ago)
elapsed time: 244,766 ms
tested at: 2025-06-05T16:46:27.585326Z (196 days ago)
elapsed time: 11,065 ms
tested at: 2025-06-07T08:13:40.365332Z (194 days ago)
elapsed time: 742 ms
Command '['cargo', 'run', '--release', '--no-default-features', '--', 'config', '--set', 'model', 'llama3.3-70b']' returned non-zero exit status 1.
Traceback (most recent call last):
File "C:\Users\baehy\ragit\tests\tests.py", line 720, in <module>
test()
~~~~^^
File "C:\Users\baehy\ragit\tests\tests.py", line 655, in <lambda>
("audit llama3.3-70b", lambda: audit(test_model="llama3.3-70b")),
~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\audit.py", line 22, in audit
cargo_run(["config", "--set", "model", test_model])
~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\utils.py", line 87, in cargo_run
result = subprocess.run(args, **kwargs)
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.1008.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 577, in run
raise CalledProcessError(retcode, process.args,
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--no-default-features', '--', 'config', '--set', 'model', 'llama3.3-70b']' returned non-zero exit status 1.
tested at: 2025-06-09T20:06:53.014494Z (192 days ago)
elapsed time: 10,849 ms
tested at: 2025-06-20T11:50:38.004891Z (181 days ago)
elapsed time: 18,829 ms
tested at: 2025-06-27T11:25:09.159801Z (174 days ago)
elapsed time: 20,523 ms
tested at: 2025-07-09T12:03:26.241876Z (162 days ago)
elapsed time: 19,457 ms
tested at: 2025-07-21T08:03:09.691900Z (150 days ago)
elapsed time: 16,966 ms
tested at: 2025-07-21T11:53:02.138116Z (150 days ago)
elapsed time: 17,167 ms
tested at: 2025-07-25T08:20:45.661982Z (146 days ago)
elapsed time: 16,106 ms
tested at: 2025-08-01T14:20:52.926510Z (139 days ago)
elapsed time: 15,920 ms
tested at: 2025-08-26T11:51:14.366171Z (114 days ago)
elapsed time: 17,502 ms
tested at: 2025-09-15T16:35:10.288703Z (94 days ago)
elapsed time: 18,771 ms
tested at: 2025-09-23T17:41:46.610984Z (86 days ago)
elapsed time: 19,316 ms