Skip to content

Teaching "old" LLMs new tricks#

AutoCon 3 (Prague) digest Program Wildcard pick Prague · 28–30 May 2025

Urs Baumann

Play the recording: Teaching old LLMs new tricks

  • Why: Not about networking per se, but a signal of where network automation tooling is heading: specialized models fine-tuned for automation tasks. Worth a look even for a skeptic of LLM-for-netops.
  • What: A method for making general-purpose LLMs accurate on specialized network automation tasks without datacenter-scale training budgets, plus a practical fine-tuning pipeline.
  • How: LoRA (Low-Rank Adaptation) fine-tuning — adding small trainable weight matrices to a frozen base model — which sharply reduces the compute needed to specialize an LLM, applied to network-automation tasks. (From abstract only — the slide text didn't extract.)
  • Where applicable: The technique is general; the constraint is having a task set worth fine-tuning for and the discipline to evaluate accuracy claims honestly. Interesting more as a direction than a deployable today.