Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't

[ermantrout]

Article URL: Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't (and Where They Slow Down)

Comments URL: Unified Memory, Explained: Why Mini PCs Can Run 70B Models a Big GPU Can't | Hacker News

Points: 34

# Comments: 27

Continue reading...