total: 83, pass: 76, fail: 7
prompts [model=dummy] run `prompts` test
It's the smallest set of commands that parses and executes all
the `.pdl` files in `prompts/` directory.tested at: 2025-01-31T13:19:57.917499Z (222 days ago)
elapsed time: 96,685 ms
tested at: 2025-02-01T13:33:17.370823Z (221 days ago)
elapsed time: 92,129 ms
tested at: 2025-02-01T14:43:58.869373Z (221 days ago)
elapsed time: 90,954 ms
tested at: 2025-02-02T09:05:10.457957Z (221 days ago)
elapsed time: 80,978 ms
tested at: 2025-02-02T14:10:34.499863Z (220 days ago)
elapsed time: 83,897 ms
tested at: 2025-02-02T16:15:48.629665Z (220 days ago)
elapsed time: 87,938 ms
tested at: 2025-02-03T17:04:26.540585Z (219 days ago)
elapsed time: 98,420 ms
tested at: 2025-02-04T15:10:26.917676Z (218 days ago)
elapsed time: 60,305 ms
Command '['cargo', 'run', '--release', '--', 'query', "You're looking at a source code of a command line utility. What does the main function do?"]' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 292, in <lambda>
("prompts claude-3.5-sonnet", lambda: prompts(test_model="claude-3.5-sonnet")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/prompts.py", line 46, in prompts
cargo_run(["query", "You're looking at a source code of a command line utility. What does the main function do?"])
File "/home/ubuntu/Documents/ci/ragit/tests/utils.py", line 61, in cargo_run
result = subprocess.run(args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'query', "You're looking at a source code of a command line utility. What does the main function do?"]' returned non-zero exit status 1.
tested at: 2025-02-05T15:29:51.351113Z (217 days ago)
elapsed time: 117,042 ms
Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 292, in <lambda>
("prompts claude-3.5-sonnet", lambda: prompts(test_model="claude-3.5-sonnet")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/prompts.py", line 34, in prompts
cargo_run(["build"])
File "/home/ubuntu/Documents/ci/ragit/tests/utils.py", line 61, in cargo_run
result = subprocess.run(args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
tested at: 2025-02-05T16:21:42.336285Z (217 days ago)
elapsed time: 3,134 ms
Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 101.
Traceback (most recent call last):
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 332, in <module>
test()
File "/home/ubuntu/Documents/ci/ragit/tests/tests.py", line 292, in <lambda>
("prompts claude-3.5-sonnet", lambda: prompts(test_model="claude-3.5-sonnet")),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ubuntu/Documents/ci/ragit/tests/prompts.py", line 34, in prompts
cargo_run(["build"])
File "/home/ubuntu/Documents/ci/ragit/tests/utils.py", line 61, in cargo_run
result = subprocess.run(args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.12/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 101.
tested at: 2025-02-06T15:55:46.906731Z (216 days ago)
elapsed time: 95,153 ms
tested at: 2025-02-07T16:11:19.427628Z (215 days ago)
elapsed time: 141,379 ms
tested at: 2025-02-08T07:18:57.662601Z (215 days ago)
elapsed time: 89,674 ms
tested at: 2025-02-08T09:14:50.625391Z (215 days ago)
elapsed time: 84,633 ms
tested at: 2025-02-09T13:52:50.577849Z (213 days ago)
elapsed time: 96,369 ms
tested at: 2025-02-13T11:03:41.308826Z (210 days ago)
elapsed time: 108,965 ms
tested at: 2025-02-14T10:49:06.096222Z (209 days ago)
elapsed time: 100,844 ms
tested at: 2025-02-15T18:21:48.654767Z (207 days ago)
elapsed time: 300,178 ms
tested at: 2025-02-15T19:25:27.035811Z (207 days ago)
elapsed time: 115,545 ms
Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 368, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 325, in <lambda>
("prompts claude-3.5-sonnet", lambda: prompts(test_model="claude-3.5-sonnet")),
File "/home/baehyunsol/Documents/ragit/tests/prompts.py", line 34, in prompts
cargo_run(["build"])
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 65, in cargo_run
result = subprocess.run(args, **kwargs)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
tested at: 2025-02-16T22:19:46.278551Z (206 days ago)
elapsed time: 98,681 ms
tested at: 2025-02-17T01:09:23.586875Z (206 days ago)
elapsed time: 83,093 ms
tested at: 2025-02-17T23:02:16.263362Z (205 days ago)
elapsed time: 88,738 ms
tested at: 2025-02-19T01:05:38.745266Z (204 days ago)
elapsed time: 165,404 ms
tested at: 2025-02-20T10:48:05.861169Z (203 days ago)
elapsed time: 88,146 ms
tested at: 2025-02-20T21:08:53.813099Z (202 days ago)
elapsed time: 74,571 ms
tested at: 2025-02-21T11:22:37.525002Z (202 days ago)
elapsed time: 86,724 ms
tested at: 2025-02-22T00:04:30.493006Z (201 days ago)
elapsed time: 78,963 ms
tested at: 2025-02-22T13:23:38.813172Z (200 days ago)
elapsed time: 112,080 ms
Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 402, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 358, in <lambda>
("prompts claude-3.5-sonnet", lambda: prompts(test_model="claude-3.5-sonnet")),
File "/home/baehyunsol/Documents/ragit/tests/prompts.py", line 34, in prompts
cargo_run(["build"])
File "/home/baehyunsol/Documents/ragit/tests/utils.py", line 66, in cargo_run
result = subprocess.run(args, **kwargs)
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--', 'build']' returned non-zero exit status 1.
tested at: 2025-02-23T12:06:32.581533Z (200 days ago)
elapsed time: 75,050 ms
tested at: 2025-02-23T19:52:59.344108Z (199 days ago)
elapsed time: 149,207 ms
tested at: 2025-02-24T21:11:27.969515Z (198 days ago)
elapsed time: 77,685 ms
tested at: 2025-02-25T10:21:57.114315Z (198 days ago)
elapsed time: 87,606 ms
tested at: 2025-02-26T00:11:13.124361Z (197 days ago)
elapsed time: 433,599 ms
tested at: 2025-02-26T20:31:03.132225Z (196 days ago)
elapsed time: 77,824 ms
tested at: 2025-02-27T22:17:10.555252Z (195 days ago)
elapsed time: 78,381 ms
tested at: 2025-02-28T11:26:54.429209Z (195 days ago)
elapsed time: 89,483 ms
tested at: 2025-03-01T12:48:39.169037Z (194 days ago)
elapsed time: 86,944 ms
tested at: 2025-03-02T01:39:46.519770Z (193 days ago)
elapsed time: 72,997 ms
tested at: 2025-03-03T19:29:08.807193Z (191 days ago)
elapsed time: 96,669 ms
tested at: 2025-03-03T21:49:32.573405Z (191 days ago)
elapsed time: 67,858 ms
tested at: 2025-03-04T22:05:09.327920Z (190 days ago)
elapsed time: 64,986 ms
tested at: 2025-03-06T00:32:55.162195Z (189 days ago)
elapsed time: 76,046 ms
tested at: 2025-03-07T01:10:52.766008Z (188 days ago)
elapsed time: 67,889 ms
tested at: 2025-03-08T13:37:45.309833Z (186 days ago)
elapsed time: 64,619 ms
tested at: 2025-03-09T00:38:56.569526Z (186 days ago)
elapsed time: 65,733 ms
tested at: 2025-03-09T14:13:04.841105Z (185 days ago)
elapsed time: 72,176 ms
tested at: 2025-03-10T11:01:50.525266Z (185 days ago)
elapsed time: 85,474 ms
tested at: 2025-03-10T22:06:31.618023Z (184 days ago)
elapsed time: 65,046 ms
tested at: 2025-03-12T11:49:54.685992Z (183 days ago)
elapsed time: 73,249 ms
tested at: 2025-03-15T01:23:08.009762Z (180 days ago)
elapsed time: 68,373 ms
tested at: 2025-03-21T01:05:42.480054Z (174 days ago)
elapsed time: 82,685 ms
tested at: 2025-03-23T22:32:14.898790Z (171 days ago)
elapsed time: 68,101 ms
tested at: 2025-03-31T22:46:05.278555Z (163 days ago)
elapsed time: 89,431 ms
tested at: 2025-04-01T22:38:25.777417Z (162 days ago)
elapsed time: 67,659 ms
tested at: 2025-04-02T11:15:28.201699Z (162 days ago)
elapsed time: 67,243 ms
tested at: 2025-04-03T11:32:16.038744Z (161 days ago)
elapsed time: 72,590 ms
tested at: 2025-04-04T13:59:04.442731Z (159 days ago)
elapsed time: 87,925 ms
tested at: 2025-04-11T21:47:12.055124Z (152 days ago)
elapsed time: 60,136 ms
tested at: 2025-05-09T11:29:30.226975Z (125 days ago)
elapsed time: 91,932 ms
tested at: 2025-05-14T14:26:51.020259Z (119 days ago)
elapsed time: 128,583 ms
tested at: 2025-05-15T23:00:24.413178Z (118 days ago)
elapsed time: 62,698 ms
tested at: 2025-05-17T00:48:25.067654Z (117 days ago)
elapsed time: 71,254 ms
tested at: 2025-05-18T09:48:01.799303Z (116 days ago)
elapsed time: 68,796 ms
tested at: 2025-05-19T10:47:10.063082Z (115 days ago)
elapsed time: 74,632 ms
tested at: 2025-05-20T00:59:40.946018Z (114 days ago)
elapsed time: 72,351 ms
tested at: 2025-05-23T00:18:04.093493Z (111 days ago)
elapsed time: 96,848 ms
Expected 12~15 chunks, got 1.
Traceback (most recent call last):
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 670, in <module>
test()
File "/home/baehyunsol/Documents/ragit/tests/tests.py", line 614, in <lambda>
("prompts claude-3.5-sonnet", lambda: prompts(test_model="claude-3.5-sonnet")),
File "/home/baehyunsol/Documents/ragit/tests/prompts.py", line 40, in prompts
raise Exception(f"Expected 12~15 chunks, got {chunks}.")
Exception: Expected 12~15 chunks, got 1.
tested at: 2025-05-24T20:40:39.036733Z (109 days ago)
elapsed time: 61,614 ms
tested at: 2025-05-29T21:31:38.721609Z (104 days ago)
elapsed time: 72,866 ms
tested at: 2025-05-31T05:38:30.224392Z (103 days ago)
elapsed time: 72,273 ms
tested at: 2025-06-01T18:34:31.254192Z (101 days ago)
elapsed time: 70,175 ms
tested at: 2025-06-02T00:08:14.271670Z (101 days ago)
elapsed time: 65,378 ms
tested at: 2025-06-03T01:16:18.813157Z (100 days ago)
elapsed time: 72,230 ms
tested at: 2025-06-05T12:05:40.934810Z (98 days ago)
elapsed time: 112,270 ms
tested at: 2025-06-05T16:46:27.585326Z (97 days ago)
elapsed time: 89,466 ms
tested at: 2025-06-07T08:13:40.365332Z (96 days ago)
elapsed time: 932 ms
Command '['cargo', 'run', '--release', '--no-default-features', '--', 'config', '--set', 'strict_file_reader', 'true']' returned non-zero exit status 1.
Traceback (most recent call last):
File "C:\Users\baehy\ragit\tests\tests.py", line 720, in <module>
test()
~~~~^^
File "C:\Users\baehy\ragit\tests\tests.py", line 660, in <lambda>
("prompts claude-3.5-sonnet", lambda: prompts(test_model="claude-3.5-sonnet")),
~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\prompts.py", line 31, in prompts
cargo_run(["config", "--set", "strict_file_reader", "true"])
~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\baehy\ragit\tests\utils.py", line 87, in cargo_run
result = subprocess.run(args, **kwargs)
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.1008.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 577, in run
raise CalledProcessError(retcode, process.args,
output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--no-default-features', '--', 'config', '--set', 'strict_file_reader', 'true']' returned non-zero exit status 1.
tested at: 2025-06-09T20:06:53.014494Z (93 days ago)
elapsed time: 78,746 ms
tested at: 2025-06-20T11:50:38.004891Z (83 days ago)
elapsed time: 76,376 ms
tested at: 2025-06-27T11:25:09.159801Z (76 days ago)
elapsed time: 94,641 ms
tested at: 2025-07-09T12:03:26.241876Z (64 days ago)
elapsed time: 123,454 ms
tested at: 2025-07-21T08:03:09.691900Z (52 days ago)
elapsed time: 127,910 ms
tested at: 2025-07-21T11:53:02.138116Z (52 days ago)
elapsed time: 116,512 ms
tested at: 2025-07-25T08:20:45.661982Z (48 days ago)
elapsed time: 114,566 ms
tested at: 2025-08-01T14:20:52.926510Z (40 days ago)
elapsed time: 123,817 ms