• Posts
AI
• Infrastructure
  • Guides On Choosing Deep Learning Server
• LLM
  • Asksage
  • Ollama
  • Ollama
• PyTorch
  • Learning PyTorch Part I
  • Pytorch Distributed Data Parallel With Model Parallel in an HPC Environment
Tools
• NeoVim
• An Intro to a CLI Password Management: Pass
• Exercism Cli Shortcut
• Random Docker/Podman tips
HPC
• ALCF
  • Distributed Training
  • QWen2.5-VL
Linux
• Manage Users in Linux
• Setup Ubuntu 22.04
Embedded Systems
Programming
• C++
  • C++ Enum Pattern
• Competitive Programming
  • How to Learn Programming
  • Mistakes I Have Made
  • TopCoder
    • HoleCakeCuts topcoder SRM411 div2 level3
    • InfiniteSequence topcoder SRM413 div2 level3
    • StringsAndTabs topcoder SRM412 div2 level3
    • TeleportsNetwork topcoder SRM409 div2 level3
• Design Patterns
  • Object-Oriented Analysis
  • Object-Oriented Design Principles
• Python
  • Python Conditional Timeit Decorator

Configure Ollama

Introduction When running Ollama on a server, you may need to configure various aspects of the deployment - from changing model storage locations to adjusting performance parameters. This guide covers common server-side administration tasks: Understanding Ollama environment variables and configuration options Changing the model storage location (useful for disk space management) Configuring Ollama via systemd service files Migrating existing models to new storage locations For information on connecting to a remote Ollama instance from your local machine, see Connecting to Remote Ollama Servers with SSH Tunneling.

Monday, November 3, 2025 | 2 minutes Read

Asksage Python API Setup

AskSage is a secure and extensible generative AI platform designed for government and commercial organizations, with a particular focus on the public sector and regulated industries. It provides a way for teams to leverage various large language models (LLMs) and other AI capabilities in a secure and compliant environment. Key features of AskSage include: Multi-model access: Support for various LLMs including GPT, Claude, Gemini, and specialized government-approved models Enterprise security: SOC 2 compliance, data encryption, and air-gapped deployment options Audit trails: Complete logging and monitoring for regulatory compliance Custom integrations: API access for embedding AI capabilities into existing workflows Content filtering: Built-in safety measures and content moderation A comprehensive example is provided by AskSage here.

Saturday, September 6, 2025 | 5 minutes Read

Connecting to Remote Ollama Servers with SSH Tunneling

Introduction Ollama is a tool for running large language models (LLMs) locally. When you have Ollama running on a remote server (e.g., a GPU-enabled workstation or HPC cluster), you can access it securely from your local machine using SSH tunneling. This guide demonstrates how to: Create an SSH tunnel to a remote Ollama instance Test the connection and query available models Use Ollama with the OpenAI-compatible API for seamless integration with existing code Getting Started Setting up the SSH Tunnel First, configure your environment variables. We’ll map the remote Ollama service (default port 11434) to a local port 11435 to avoid conflicts with any local Ollama instance.

Sunday, June 15, 2025 | 3 minutes Read