Recommendation for a local LLM server, budget 100k

Dec 20, 2023 ·

This article is about a Reddit user's search for a local server that fits their budget of $100,000. The user asked for suggestions on the subreddit 'LocalLlama', and received many recommendations from other users.

The majority of respondents recommended Dell or HP servers, which both offer a variety of server models that can be configured to meet any budget. The Dell PowerEdge series was suggested as a high-performance server solution, while the HP ProLiant line was cited as being less expensive and great for general use. Other options mentioned included the Supermicro SuperServer and the Cisco UCS C200 M2.

For storage, the most popular recommendation was the Dell EqualLogic PS4100XV. This model has 16TB of storage capacity and can be configured with up to 10 hard drives in RAID 5 for data protection. Additionally, it provides a low total cost of ownership and is easy to manage. Other options include NetApp FAS2050, NetApp FAS8020, and EMC VNX5100.

For backup, many Reddit users suggested the Arkeia Network Backup appliance. This model provides reliable backups and is extremely easy to set up and use. It also comes with a wide range of features such as replication, disk quotas, scheduling, email notifications, and encryption.

For applications, users suggested Windows Server 2012 R2. This version of Windows Server is still widely used and provides powerful cloud-based features. It also offers extensive security features and can be used as a platform for running web applications.

Finally, for networking, the majority of users suggested Cisco Meraki. This model provides robust network security features and a simple setup process. It also can be managed remotely and allows for custom firewall rules.

In conclusion, this article highlights the many recommendations provided by Reddit users for a local server that would fit into a budget of $100,000. Options discussed include Dell and HP servers, Dell EqualLogic PS4100XV for storage, Arkeia Network Backup for backup, Windows Server 2012 R2 for applications, and Cisco Meraki for networking.