Servers

🖥️ Servers for Dynaroars Lab

Server Specs

Our ROARS lab has four servers (pictures).

1. 🧋 Boba

   • NVIDIA DGX Spark
   • CPU: NVidia GB10 Chip, 20 core Arm (10 Cortex-X925 + 10 Cortex-A725 Arm)
   • Unified Memory/Graphic: 128GB RAM
   • OS: NVIDIA DGX OS (based on Ubuntu LTS)

   This system is ideal for AI-based projects, e.g., generative LLMs

2. 🍕 Pizza

   • Custom built
     • CPU: 32 cores, 64 threads, 3.6GHz (AMD Ryzen Threadripper PRO 5975WX)
     • Graphic: 2x Nvidia RTX 4090 24GB RAM
     • Memory: 128GB RAM
     • OS: Debian Stable

   This system is ideal for projects that can leverage many cores and specialized GPU.

3. 🍣 Sushi

   • Lenovo ThinkStation P620
     • CPU: 64 cores, 128 threads, 4.3GHz (AMD Ryzen Threadripper PRO 3995WX)
     • Graphic: Nvidia RTX 5090 RTX 24GB RAM
     • Memory: 128GB RAM
     • OS: Debian Stable

   This system is ideal for projects that can leverage many cores and specialized GPU.

4. 🌮 Taco

   • Alienware Aurora
     • CPU: 16 cores, 24 threads, 5.20GHz (Intel 12th Gen Core i9-12900KF)
     • Graphic: Nvidia RTX 3080 Ti 12GB RAM
     • Memory: 64GB RAM
     • OS: Debian Stable

   This system is ideal for experiments that need fast CPU (but not lots of core) and fast GPU.

⚠️ For Debian machines, DO NOT install any thing other than Debian stable packages to these computers (e.g., do not mix unstable or new repositories to apt sources list). You can download and install anything in your home (local) directory. If in doubt, contact us.

Getting an account

• To get an account on the server, send a request and your SSH public key (for password-less log in)

Miscs

1. You can use an IDE such as VSCode to do remote development on these servers (just connect to the server via the builtin remote login method in VSCode). You can also use other editors that support remote development (e.g., Emac + TRAMP).
2. Do take advantage of the multicores these machine have. Most programming languages support multiprocessing (e.g., Python) and can significantly reduce program runtime.
3. Periodically check top and htop to make sure you are not taking too much CPU or memory.
4. Periodically check /var/tmp or /tmp/ to make sure you are not taking too much space there.

Pictures

🍣 Sushi

🍣 Sushi Cooling System

🍕 Pizza

🧋 Boba