Hackergpt2

Revision as of 05:34, 7 September 2024 by Maintenance script (talk | contribs) (Initial)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

HackerGPT 2.0 Language Model

HackerGPT 2.0 is an advanced language model that leverages the capabilities of the uncensored llama model. This model can be implemented at no cost, and is available to anyone interested in running sophisticated language models.

Getting Started

Here’s a quick guide on setting up and running HackerGPT 2.0:

Requirements

Operating System: Ubuntu (any Linux based distro should work, other OS’ I have not tested) Memory: Minimum of 8 GB RAM for 7B models; 16 GB for 13B models; 32 GB for 33B models

Installation Steps

Clone the Repository

<syntaxhighlight lang="shell">git clone https://github.com/Hacker-GPT/HackerGPT-2.0.git</syntaxhighlight>

  1. Install Dependencies Install necessary dependencies as listed in the repository.

  2. Set Up Supabase Create a Supabase account and install Supabase. CD into supabase and type

supabase start

(this allows users to pull models at least llama variants onto local machine; syncs quickly after data is pulled)

  1. Install Docker Install Docker and any required dependencies

  2. Install Ollama and Models

  • For macOS:

    <syntaxhighlight lang="shell">curl -fsSL https://ollama.com/install.sh | sh</syntaxhighlight>
  • Pull and run the model:

    <syntaxhighlight lang="shell">ollama pull llama2-uncensored

    ollama run llama2-uncensored</syntaxhighlight>
  • uncensored has regular 7b and 70b models if you want to run the 38gb uncensored version the commands would be:

ollama pull llama2-uncensored:70b

ollama run llama2-uncensored:70b

Additional Resources

GitHub Repository: HackerGPT 2.0 GitHub

Note: Ensure you have adequate RAM based on the model size you plan to run.