AI Assistant only up to .NET 6
Hello,
I'm wondering if anyone can point me to where I can see the limit of the Jetbrains AI Assistant? I was querying it regarding Blazor 8 and quickly realized it doesn't have any data on that, it seems it's only trained up to .NET 6.
I'm wondering when this will be updated? Seeing as it's not even up to .NET 7 yet. I'm paying for the subscription and I guess it didn't occur to me that the data might still be outdated. Is there any plans to bring it up to speed with current .NET releases (if that's even possible with the LLMs atm)
Josef
Please sign in to leave a comment.
Hello,
For basic questions, we use a local model; for simple queries, we switch to GPT-3.5; and for most other, more complex questions, we rely on GPT-4.
That is why you could see outdated data sometimes. However, this tiered approach ensures efficiency and accuracy in handling different types of inquiries. Could you share an exact example of such a response and describe the expected result, so we can fine-tune our algorithms in this aspect?
Ah interesting. I'm curious how it determines which model to use? if it's a simple query, but requires up to date information, how is that handled?
In my case I was asking the assistant about the Interactivity Type that was introduced in .NET 8 for Blazor. It wasn't aware of this feature and it's knowledge of the Blazor project templates seemed outdated as well. I then gave it some reference by saying the feature was introduced in .NET 8, and it responded that at the time of writing only .NET 6 is released. Here is a snippet from the exchange:
From my understanding GPT4 should be more up to date than .NET 6. I'm aware that .NET 8 is pretty fresh and may not be in the training set yet, is there any guess as to when it would catch up to .NET 8?
Thanks for your response!
Josef-coban, the GPT-4 knowledge base is updated until Apr. 2023, so the .NET 8 related questions may too early for it.
Same here. I was asking about the .NET 8 SDK and got:
Tao Sun, that makes sense, I'll wait for the next GPT-4 update to see any .NET 8 content.
Regarding the different models that the assistant uses however, is there a way to control that depending on our needs? As I mentioned what I asked was a simple question (though not in the knowledge base), if I want to manually use the GPT 4 model is that possible?
Because if my query was using the GPT-4 base that was updated Apr.2023, it should have knowledge of .NET 7, but the response I got was that the latest is .NET 6.
Josef-coban, the LLMs are transparent to the AI Assistant users, JetBrains AI Service will determine and choose the proper model based on user's input, thus you could not specify to use which models.
The models that used by AI Assistant are optimized for programming issues, it's working properly on analyzing and refactoring, but may lack some knowledge on latest changes, as it's not the standard chat models. Just like the “code-davanci-002" model different with others. You could use other tools that collaborate with search engine for the new features related problems.