Are you ready to dive into the world of High-Performance Computing (HPC) in the cloud? With HPC-NOW, getting started is as easy as pie. This blog will guide you through the entire setup process and help you understand how to build, install, and run your HPC-NOW environment seamlessly. Let’s begin!

1. Understanding HPC-NOW

High-Performance Computing in the cloud is a game-changer, offering unparalleled scalability and flexibility. However, many users don’t know how to set up HPC solutions in the cloud due to the technical challenges involved. HPC-NOW aims to eliminate these barriers, allowing you to start HPC workloads with minimal operational workload.

2. Core Components

The key components of HPC-NOW include:

• Installer: Facilitates the installation of the HPC-NOW service.
• HPC Operator (hpcopr): Manages clusters, users, jobs, data, and monitoring.
• Now-Crypto: A module that handles encryption for sensitive files.
• HPC Manager (hpcmgr): Utility for communication within cluster nodes.
• Infra-as-code: Infrastructure codes in HCL format.
• Scripts: Help initialize clusters and install applications.

3. Steps to Build, Install, Run, and Use HPC-NOW

3.1 Build

Prerequisites

Before you start building, ensure you have:

• Git for code management.
• A standard C compiler (e.g., gcc for GNULinux, clang for macOS, or mingw-w64 for Windows).

Steps to Build

1. Clone the Repository:

   git clone https://github.com/zhenrong-wang/hpc-now

2. Change Directory:

   cd hpc-now

3. Run the Build Script: Depending on your OS, use the respective command:
   • Windows:

     .make_windows.bat build

   • GNULinux:

     chmod +x make_linux.sh
     .make_linux.sh build

   • macOS:

     chmod +x make_darwin.sh
     .make_darwin.sh build

3.2 Install

Run the Installer

You’ll need temporary administrator privileges to run the installer. Use the following commands based on your OS:

Windows:

cd c:\users\public\hpc-now\build
.installer-win-0.3.2.exe install --hloc hpcopr-win-0.3.2.exe --cloc now-crypto-aes-win.exe

GNULinux:

sudo .installer-lin-0.3.2.exe install --hloc hpcopr-lin-0.3.2.exe --cloc now-crypto-aes-lin.exe

macOS:

sudo .installer-dwn-0.3.2.exe install --hloc hpcopr-dwn-0.3.2.exe --cloc now-crypto-aes-dwn.exe

3.3 Run

The hpcopr serves as your main command-line interface (CLI). You can use it to manage and run tasks. To update or uninstall HPC-NOW services, run the installer with appropriate privileges.

3.4 Basic Workflow

Here’s a simple workflow to help you get started:

• Import cloud credentials (keypair or key file).
• Initialize a new cluster.
• Deploy applications and upload your data.
• Connect to the cluster.
• Start your HPC workload.
• Wait for the job to complete.
• Export your data and hibernate or destroy the cluster.

3.5 Troubleshooting

If you encounter issues during the build or installation process, consider the following troubleshooting tips:

• Ensure all prerequisites are correctly installed.
• Check your connectivity to GitHub if cloning fails.
• Be vigilant about using the correct command based on your operating system.
• Make sure you have the appropriate permissions for performing installations.

For more insights, updates, or to collaborate on AI development projects, stay connected with fxis.ai.

4. Conclusion

At fxis.ai, we believe that such advancements are crucial for the future of AI, as they enable more comprehensive and effective solutions. Our team is continually exploring new methodologies to push the envelope in artificial intelligence, ensuring that our clients benefit from the latest technological innovations.