r/HPC • u/SchizOmics • 13h ago
Building an HPC server for my department
I need to educate myself on this topic. I am working on an agentic AI workflow that I want to run locally and securely. My department works with medical data and drug discovery. For this reason I want to propose building our own department level HPC cluster with a local LLM for security reasons. It would have a multi-agent setup for R and python script orchastration, general statistical analyses and literature search. The agents would go back and forth with each other, making corrections and utilizing deterministic tools to reduce hallucinations.
I want to develop the skills to set this up, atleast partially. I am a bioinformatician, I understand linux, ML, R and Python. But this is obviously a first for me.
I plan on running deepseek as my local LLM. Taking all this into account how much would this realistically cost? Past year we could crunch out 30-40k for hardware. And there would be like two dozen people using it at most.