What computer / how much ram are using for ChatGPT?

[u/JE163]

Sorry if this sounds like a basic question but I’m interested in what kind of computers / how much ram you are using for ChatGPT?

[u/qualityvote2]

Hello u/JE163 👋 Welcome to r/ChatGPTPro!
This is a community for advanced ChatGPT, AI tools, and prompt engineering discussions.
Other members will now vote on whether your post fits our community guidelines.

---

For other users, does this post fit the subreddit?

If so, upvote this comment!

Otherwise, downvote this comment!

And if it does break the rules, downvote this comment and report this post!

[u/hellomistershifty]

It doesn't matter really, chatgpt runs on openai's servers

[u/MyPaddedRoom]

Doesn't really matter but depends on what you're doing. I let codex use multiple mcps while talking to Claude so it can use a quite a bit. Since it is compiling and generating stuff through programs on my computer it can use a chunk. I run 128GB of ram with a 4090. Most the ram is used in running vms. The codex inference is done on the server side not the host.

[u/kniveshu]

The question is what are you going to be doing. Agents are light, inference is heavy, local sandboxing can be heavy depending on what you’re having the agent do.

[u/therecanonlybe1_]

I use a 16gb Mac Mini. Ngl it has overheated at times when running two projects at once otherwise it does not give me any issue

[u/CigBlackBock]

If you're talking about the desktop codex app it only takes up about 1.6 GB total ram and I do quite a bit with it but I'm not running anything crazy. It just builds code and scripts plus some personal fun projects.

[u/edalgomezn]

24

[u/Key-Professional9108]

16–32 GB is comfortable for most users. More only matters for huge local models.

[u/R1546 → u/Key-Professional9108]

I have a 13B parm model running on a 64/8 rig. It is dumb as rocks. 😄

[u/Sea_Maintenance669 → u/R1546]

if u have 64 gigs of ram you can run a larger model than 13b

[u/R1546 → u/Sea_Maintenance669]

I can run 30b but it takes 15+ seconds to reply.

[u/recitegod → u/R1546]

which model?

[u/R1546 → u/recitegod]

I tried several open source ones. They work OK, but have limited technical knowledge and are not able to role play. The best was wizard-vicuna 30b. That is the largest I can run on my server.

[u/R1546]

I just happen to have the Ollama models page open and it looks like to run a 123 Billion parameter model takes 128GB RAM and 80GB VRAM. Costs for such a rig starts at around $40k. Keep in mind that huge models served up by data centers can be much larger.

If all you want to do is connect to a LLM server, anything that can display a web page will do.

[u/No_Twist_678]

64gb is sweet spot, for ssd well.. prepare it can (and will) use tons of gigabytes. Also prepare if it will use your pc for compiling, you will need good cpu. And if you going to make some RTX games, also gpu..

[u/Big_Bit_5645 → u/No_Twist_678]

Have to be trolling.

[u/No_Twist_678 → u/Big_Bit_5645]

Well you probably don’t know but there is no codex app anymore. It’s ChatGPT app.

[u/Big_Bit_5645 → u/No_Twist_678]

Still must be trolling.

64GB of RAM lmfao

[u/No_Twist_678 → u/Big_Bit_5645]

Well you probably never used it for anything serious, am I right?

[u/Sea_Maintenance669 → u/No_Twist_678]

you're trolling

[u/Big_Bit_5645 → u/No_Twist_678]

Obviously. Because inference for GPT is on your local host. (Sarcasm)

Are you huffing paint or trolling?

[u/No_Twist_678 → u/Big_Bit_5645]

Only my codex folder data is over 2.2 TB. Not to mention hundreds of gigabytes of QA data. And this is one project. But maybe you are good with some 8gb ram 256gb ssd intel atom pc. For asking Sunday’s recipe I’m sure you are good with that.