Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I have a system with an ungodly amount of Optane memory and I'm hoping this will work.


What do you have? I've got a 905P and a 900P and am already using these in LM Studio by putting all models there and extending system memory with more scratch space... Not sure if I need to do anything differently with this since LM Studio already enabled it I think


The DIMM version, PMEM 200 modules. Appears as /dev/dax and you can mmap it. Could also use as a virtual filesystem, or using RAM as a cache for pmem, but sceptical of that.

Is the virtual memory system is a good way to expand memory for inference, via having it directly manage a non uniform pool? I haven't seen any research on that.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: