Red Hat has entered into a definitive agreement to acquire Neural Magic, an academic spin-out that specializes in optimizing GenAI inference workloads. No price is being given, but the IBM wing will be taking on all 45 staff, if all goes to plan. The very short-notice presentation saw Red Hat leadership expand on the problem and opportunity here. In short, Neural Magic is building on the open source vLLM project, which is an optimized library for Large Language Model (LLM) inferencing – the process through which the model ‘infers’ understand about its new question or material, based on the model’s underlying training. Cloud computing, and its edge extension, has a business model centered around efficiency. It must ensure that the…