Blame
| 63b96b | Anonymous | 2026-04-13 06:56:18 | 1 | # Indra startup checklist |
| 2 | ||||
| 3 | SSH into INDRA (192.168.40.40) as the user `isnai`. |
|||
| 4 | If you SSH with another user, change users with `sudo -u isnai bash` (assuming you are among the sudoers) |
|||
| 5 | ||||
| 6 | ## Sanity Checks |
|||
| 7 | After booting check that all GPUs are working with `nvtop`. |
|||
| 8 | ||||
| 9 | If they are not working or `nvtop` is not working, please reinstall nvtop, `nvidia-smi` and nvidia drivers in that order: try after each. |
|||
| 10 | ||||
| 11 | You may have to restart again after the installation. |
|||
| 12 | ||||
| 13 | ## Restart the LLM servers: |
|||
| 14 | ```bash |
|||
| 15 | cd /home/isnai/dev/tgi |
|||
| 16 | nohup ./run-qwen32.sh > /home/isnai/qwen32.log 2>&1 & |
|||
| 17 | nohup ./roleplay.sh > /home/isnai/roleplay.log 2>&1 & |
|||
| 18 | ||||
| 19 | cd /home/isnai/dev/sglang/sglang |
|||
| 20 | source env/bin/activate |
|||
| 21 | nohup ./sglangrun.sh > /home/isnai/sglang.log 2>&1 & |
|||
| 22 | ``` |
|||
| 23 | ||||
| 24 | ## Deploy VISNA |
|||
| 25 | ```bash |
|||
| 26 | cd /home/isnai/testing/visna |
|||
| 27 | source env/bin/activate |
|||
| 28 | export CUDA_VISIBLE_DEVICES=6,7 |
|||
| 29 | nohup ./gunicorn_backend.sh > backend.log 2>&1 & |
|||
| 30 | nohup ./gunicorn_frontend.sh > frontend.log 2>&1 & |
|||
| 31 | ``` |
|||
| 32 | ||||
| 33 | ## Troubleshooting |
|||
| 34 | You should be able to see [VISNA](https://visna.isn.edu.au/). |
|||
| 35 | If notm here are other possible things you may have to do. |
|||
| 36 | ||||
| 37 | 1. Restart nginx with `sudo systemctl restart nginx` |
|||
| 38 | 2. Check if mongodb is running with `sudo systemctl status mongod` |
|||
| 39 | 3. If is not running, run `sudo systemctl start mongod` |