query_with_schema llama3.3-70b

total: 23, pass: 22, fail: 1

    query_with_schema [model]   run `query_with_schema` test
                                It tests `--schema` flag of `rag query`.

TOC

1. adcf25624-linux  
2. 7cebb43a6-linux  
3. ba3b6b026-linux  
4. 5ba0a12a6-mac  
5. 92df3569e-linux  
6. 3aa665352-linux  
7. 16a6c7ac3-linux  
8. 774e5c41d-linux  
9. 3c6b6ebe1-linux  
10. f0327eaea-linux  
11. bb69badeb-linux  
12. 29a3bf1cb-linux  
13. 7f979aa5e-mac  
14. 0526d3e20-linux  
15. 0526d3e20-windows  
16. 869568e0b-linux  
17. a5cdea9c6-mac  
18. 3e136fdeb-mac  
19. a24618552-mac  
20. a0c02bb2e-linux  
21. a0c02bb2e-mac  
22. 45d75cf09-linux  
23. ad17ef1a2-linux  

Cases

tested at: 2025-05-15T23:00:24.413178Z (118 days ago)

elapsed time: 1,667 ms

suite

tested at: 2025-05-17T00:48:25.067654Z (117 days ago)

elapsed time: 1,602 ms

suite

tested at: 2025-05-18T09:48:01.799303Z (116 days ago)

elapsed time: 1,681 ms

suite

tested at: 2025-05-19T10:47:10.063082Z (115 days ago)

elapsed time: 3,683 ms

suite

tested at: 2025-05-20T00:59:40.946018Z (114 days ago)

elapsed time: 1,658 ms

suite

tested at: 2025-05-23T00:18:04.093493Z (111 days ago)

elapsed time: 2,073 ms

suite

tested at: 2025-05-24T20:40:39.036733Z (109 days ago)

elapsed time: 1,624 ms

suite

tested at: 2025-05-29T21:31:38.721609Z (104 days ago)

elapsed time: 2,942 ms

suite

tested at: 2025-05-31T05:38:30.224392Z (103 days ago)

elapsed time: 2,710 ms

suite

tested at: 2025-06-01T18:34:31.254192Z (101 days ago)

elapsed time: 1,563 ms

suite

tested at: 2025-06-02T00:08:14.271670Z (101 days ago)

elapsed time: 1,647 ms

suite

tested at: 2025-06-03T01:16:18.813157Z (100 days ago)

elapsed time: 1,767 ms

suite

tested at: 2025-06-05T12:05:40.934810Z (98 days ago)

elapsed time: 3,661 ms

suite

tested at: 2025-06-05T16:46:27.585326Z (97 days ago)

elapsed time: 2,809 ms

suite

tested at: 2025-06-07T08:13:40.365332Z (96 days ago)

elapsed time: 766 ms

Command '['cargo', 'run', '--release', '--no-default-features', '--', 'config', '--set', 'model', 'llama3.3-70b']' returned non-zero exit status 1.
Traceback (most recent call last):
  File "C:\Users\baehy\ragit\tests\tests.py", line 720, in <module>
    test()
    ~~~~^^
  File "C:\Users\baehy\ragit\tests\tests.py", line 681, in <lambda>
    ("query_with_schema llama3.3-70b", lambda: query_with_schema(test_model="llama3.3-70b")),
                                               ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\baehy\ragit\tests\query_with_schema.py", line 24, in query_with_schema
    cargo_run(["config", "--set", "model", test_model])
    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\baehy\ragit\tests\utils.py", line 87, in cargo_run
    result = subprocess.run(args, **kwargs)
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.13_3.13.1008.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 577, in run
    raise CalledProcessError(retcode, process.args,
                             output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['cargo', 'run', '--release', '--no-default-features', '--', 'config', '--set', 'model', 'llama3.3-70b']' returned non-zero exit status 1.

suite

tested at: 2025-06-09T20:06:53.014494Z (93 days ago)

elapsed time: 2,878 ms

suite

tested at: 2025-06-20T11:50:38.004891Z (83 days ago)

elapsed time: 3,652 ms

suite

tested at: 2025-06-27T11:25:09.159801Z (76 days ago)

elapsed time: 3,776 ms

suite

tested at: 2025-07-09T12:03:26.241876Z (64 days ago)

elapsed time: 3,597 ms

suite

tested at: 2025-07-21T08:03:09.691900Z (52 days ago)

elapsed time: 18,809 ms

suite

tested at: 2025-07-21T11:53:02.138116Z (52 days ago)

elapsed time: 3,574 ms

suite

tested at: 2025-07-25T08:20:45.661982Z (48 days ago)

elapsed time: 3,432 ms

suite

tested at: 2025-08-01T14:20:52.926510Z (40 days ago)

elapsed time: 3,255 ms

suite