New ask Hacker News story: Ask HN: How training of LLM dedicated to code is different from LLM of “text”

Ask HN: How training of LLM dedicated to code is different from LLM of “text”
2 by transformi | 2 comments on Hacker News.
Does it go beyond exposing to the LLM only "code"?, or there are extra steps in the training? (like giving the compiler/interpreter rules)? Since programming are more structured , I think that using grammar that are dedicated to those language might be useful.