Terms of Service

Last updated: June 24, 2026

These Terms of Service ("Terms") are a binding agreement between you and Maniac, Inc. ("Maniac", "we", "us"), the company that operates commitbench (the "Service"). By creating an account, running a benchmark, or otherwise using the Service, you agree to these Terms. If you do not agree, do not use the Service.

1. What the Service does

commitbench turns a code repository's own commit history into a benchmark. It runs coding agents and models against tasks derived from that history and scores their output using an automated judge. Scores, costs, and timing are estimates produced by software, not guarantees of quality, correctness, or fitness for any purpose.

2. Accounts

You sign in with a third-party identity provider such as GitHub. You are responsible for activity under your account and for keeping your credentials secure. You must be old enough to form a binding contract in your jurisdiction, and you may not use the Service if we are barred from offering it to you under applicable law.

3. Repository authorization and acceptable use

You may only point the Service at repositories you own or are authorized to access and analyze. You are responsible for having all rights and permissions needed for any code, data, or content the Service processes on your behalf.

Running a benchmark executes autonomous coding agents that read and modify a working copy of the target repository inside isolated cloud containers. These agents run code. Do not point the Service at repositories you do not trust or are not permitted to run. You agree not to use the Service to break the law, infringe others' rights, attempt to access systems or data you are not authorized to access, or interfere with the Service's operation.

4. Credits, payment, and refunds

Runs are paid for with credits. You can purchase credits or a subscription through our payment processor, Stripe. Prices and credit costs are shown before you start a run and may change over time. When you start a run we place a hold for the estimated cost; when the run finishes we settle the actual amount and refund the difference for work that did not run, in credits. Credits have no cash value, are not transferable, and except where required by law are non-refundable once spent. You authorize us and Stripe to charge your selected payment method for amounts you incur.

5. Public results and your content

You retain ownership of your code and content. By marking a run as public, or by using features that publish results, you grant Maniac a worldwide, non-exclusive license to host, display, and share that run's data (such as the benchmark tasks, diffs, scores, and repository name) as part of the Service, including on public leaderboards and comparison pages. Do not publish a run that contains code or data you are not permitted to disclose.

6. Third-party services

The Service relies on third parties including GitHub for sign-in and repository access, cloud compute providers for execution, model and agent providers for generation and judging, Stripe for payments, and our hosting and analytics providers. Your use of those services through commitbench is also subject to their terms, and we are not responsible for their acts or omissions.

7. Intellectual property

The Service, including its software, design, and content other than your own content, is owned by Maniac or its licensors and is protected by law. These Terms do not grant you any right to our trademarks or branding.

8. Disclaimers

The Service is provided "as is" and "as available" without warranties of any kind, whether express or implied, including merchantability, fitness for a particular purpose, and non-infringement. We do not warrant that benchmark scores are accurate, that the Service will be uninterrupted or error free, or that any result reflects how a model or agent will perform on your real work.

9. Limitation of liability

To the maximum extent permitted by law, Maniac will not be liable for any indirect, incidental, special, consequential, or punitive damages, or for lost profits, data, or goodwill. Our total liability for any claim relating to the Service is limited to the greater of the amount you paid us for the Service in the three months before the claim or one hundred US dollars.

10. Indemnification

You agree to indemnify and hold harmless Maniac from claims, losses, and expenses arising out of your use of the Service, your content, or your breach of these Terms, including claims that you lacked the rights to process a repository you submitted.

11. Changes and termination

We may update the Service and these Terms. If we make material changes we will update the date above and, where appropriate, give notice. Continued use after changes take effect means you accept them. We may suspend or terminate access if you violate these Terms or to protect the Service. You may stop using the Service at any time.

12. Governing law

These Terms are governed by the laws of the State of Delaware, United States, without regard to its conflict-of-laws rules. Any dispute will be brought in the state or federal courts located in Delaware, and you consent to their jurisdiction.

13. Contact

Maniac, Inc. Questions about these Terms can be sent to support@maniac.ai.