JavaScript's garbage collector is not very ready for machine learning

calendar May 26, 2024  ·
Share on: linkedin copy

The problem When using node-mlx for training LLM, the RAM was quickly exhausted. After some profiling, it turned out that MLX's tensors (mx.array) were too slow to be garbage collected before runni...

Read more here: External Link