# Downtime Compensation While we do our best to uphold the compensation policies listed below, we may be unable to fulfill them in special circumstances. This page serves as a guide to our policies, and nothing here supersedes our Terms of Service or Supplier Hosting Agreement. ## Good Practices. Remember to always... * Make offsite backups * AI/ML Inference: Distribute workloads across multiple hosts and load balance accordingly * AI/ML Training: Checkpoint training jobs ## Downtime Measurements We monitor downtime from at least four servers located in different regions. If the servers reach a quorum and agree that a GPU hostnode has gone offline, then we will count that as downtime. ## Downtime Remediation Our minimum compensation is $5, and our maximum compensation is capped at 100% of a client's previous month's spending. #### Top Hosts These are typically hosts who've demonstrated reliability and whose GPUs are located in data centers, with services marketed as such. Because we hold these hosts to standards meant for mission critical workloads, we deduct **10x the hourly rate** multiplied by the downtime and add that to the customer's account. For example, if a client workload was running at $10/hour and incurred 1 hour of downtime, we'd add $100 of compensation. #### Standard Hosts These are hosts who may be hosting servers in residential or business facilities. They may have little or no redundancy. Some may be located in a data center but opt to be marketed as a standard host to face lower downtime penalties. In any case, expect that a system hosted with a standard host will eventually experience downtime. For downtime, we deduct **5x the hourly rate** multiplied by the downtime and add that to the customer's account. ## Data Loss Remediation In the event of unexpected data loss, you will be provided with credits equivalent to 40x the hourly rate you were paying when your virtual machine went offline. ## Change Log June 27, 2024: Modified wording. Increased Top Host compensation from 5x hourly rate to 10x hourly rate. Increased Standard Host compensation from refund to 5x hourly rate. --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.tensordock.com/legal-information/downtime-compensation.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.