To build a large-scale NVIDIA H100 cluster, several key considerations must be taken into account, including GPU selection and quantity, data requirements, consumption patterns, tooling needs, and questions to ask potential providers. Companies should gather information on model sizes, training jobs, data distribution, and idle times to understand the scope of their solution. Providers offer three primary models: on-premises, hosted, or cloud-based solutions, each with its own financial considerations and capabilities. It is essential to assess a provider's design, delivery, and support experience, as well as their technology for maximizing GPU throughput and ensuring data access, to ensure the health and uptime of the solution.