LM Studio – SUPER EASY Text AI – Windows, Mac & Linux / How To
LM Studio, the SUPER EASY means to make use of Text AI. This software program installs simply in your laptop. You can obtain LLM fashions from contained in the LM Studio. Create personal LLM purposes with the included native server that simulates the OpenAI API.
I’m NOT affiliated with LM Studio
#### Link from my Video ####
https://lmstudio.ai/
#### Join and Support me ####
Buy me a Coffee: https://www.buymeacoffee.com/oliviotutorials
Join my Facebook Group: https://www.facebook.com/groups/theairevolution
Joint my Discord Group: https://discord.gg/XKAk7GUzAW
AI Newsletter: https://oliviotutorials.podia.com/newsletter
Support me on Patreon: https://www.patreon.com/sarikas
00:00 Intro
00:16 Install LM Studio
00:31 LM Studio First Steps
01:45 Models Download – LM Studio
04:36 Text Chat UI – LM Studio
11:29 Local Server in LM Studio
The finest means to make use of language fashions in your laptop whats up my pals how are you doing I’m speaking to you from the longer term as a result of I purchased myself a quest 3 it has nothing to do with this video and I can truly see you thru my digicam right here so let’s get began with this
Video this video is about LM Studio it’s free you may set up it in your laptop very simply as you may see down right here it’s for Mac for Windows and even for Linux so that you simply obtain the installer and that’s it so that is what the software program appears to be like like after you’ve got
Installed it it’s an exit file on window it runs like a traditional software program and also you’re greeted by this web page the place you may seek for fashions or different phrases after which it provides you right here some details about these fashions and you may obtain them instantly so that you
Don’t must go to hugging part or GitHub or something like that you are able to do every thing from inside this software program now cool factor can be right here after all you may nonetheless go to the web page if you wish to have extra data there’s additionally a hyperlink to the paper of the web page when you
Want to go extra into the technical nitty-gritty however you do not have to all of that’s extraordinarily helpful for getting began and every thing may be very consumer pleasant now one other factor I need to level out right here is that on the highest right here you’ve totally different hyperlinks to their Twitter and extra importantly to their
Discord I might extremely counsel to you to affix their Discord so when you’ve any questions you want any assist please ask them and so they very pleasant Community they often reply very quick and also you get very nice and useful solutions from them and their Community now on the left
Side you see right here a number of icons and the second is a search icon if you click on on that you’re inside the search space for the entire fashions that can be utilized with this software program you may see there’s a lot loads numerous them and
Of course you may search up right here for what you particularly need to have now the left listing reveals you the fashions themselves the suitable listing reveals you the variations of the person mannequin so if you click on right here the listing on the suitable facet right here is all the time altering so you may
See the totally different variations of the fashions the dimensions of the fashions there is a obtain button right here in an effort to obtain them and every thing is occurring for you routinely now this is one other factor that is vital up right here you may type by most or least after which by downloads by reent by likes and
Then after all once more again to downloads it is Cycles by way of so you may see that you’ve the totally different rankings for instance or the quantity of downloads you may see which of those fashions are hottest one other factor that is fascinating right here on the suitable facet is that you simply get a
Rating if this could work along with your laptop particularly so right here it says this could be just right for you after which there’s an I in data icon right here so there’s totally different data on how good is that this what does it do is it too large in your laptop or not so you’ve
Somewhat bit of knowledge right here if you wish to use that and you may see that these are rising numbers from Q2 on this case to Q8 after which additionally the dimensions of the mannequin is getting greater with these Q numbers which signifies that these fashions are greater variations extra advanced
Versions that may do extra however after all that you must see what your laptop can deal with that is often a query of how a lot RAM you haven’t the vram however the RAM that you’ve in your laptop so I might often counsel when you can improve
To have a minimum of 32 GB of RAM which can be what I’ve in my laptop when you’re fashions that is perhaps too large in your laptop it provides a warning up right here required 30 GB plus Ram in order that this won’t work on in your
Computer however when you’ve got discovered one thing that you simply like for instance right here I’ve the wizard lm1 uncensored LMA 213b ggf mannequin I downloaded the 13.83 GB model that might be model to make use of or perhaps check out the mistl 7B instruct model 0.1 ggf mannequin
It may be fascinating once more I’ve the Q8 model with on this case solely 7 .7 GB when you’re completely satisfied along with your downloads go to the subsequent space right here which is that this chat icon if you go into that window it appears to be like type of like chat GPT so
On the left facet you see your Reon chats you had with the AI after all you should use them with totally different sorts of fashions and on this case I take advantage of it with a special mannequin than I’ve loaded proper now so it tells me down right here what mannequin
I’ve used and that I ought to reload that mannequin so it is a button down right here that I can click on to get again to that chat that I left off with now instantly on the left facet I need to clarify a bit of bit what’s occurring right here so that you
Can see there’s a bit of bit of knowledge with the attention then you may go in right here and likewise modify the title of the chat if you wish to and you can even delete it with the ax to take away it out of your laptop and likewise Above This there
Is a bit of wheeel which you could click on with some settings which can be popping up that is the per chat mannequin web page in your dis you may flip this on and off in order that signifies that the periods you had are saved after which you may return to them afterwards that is
Automatically turned on and above this you even have this button right here for brand spanking new chat you click on on that and that is beginning up a brand new chat for you additionally on the highest left facet you may toggle the sidebar out and in so that you’ve a
Bigger dimension of the chat
window if you wish to have that and on the suitable facet you can even try this with these settings right here subsequent let us take a look at the suitable facet right here the place it says settings you see there’s a preset listing in right here we are able to
Load for the totally different sorts of fashions you can even import presets from a file you may make your personal new presets and Export them as a chasen file so that you would possibly need to additionally discuss it out with the group on Discord for LM Studio to see what are the most effective settings you need
To use with the fashions or modify them in your laptop settings so that’s ideally suited in your particular use case now one factor I need to level out right here that could be a little little bit of an error proper now with the UI is down right here you’ve totally different
Areas which you could open up and if you open up all of them after which open up this listing that is popping up behind all of those home windows so this is the reason the listing is so quick proper now so if this occurs to you simply shut these areas down right here
And you then see the complete listing once more and with a few of the fashions that you simply obtain the preset right here is routinely loaded for you for the mannequin mannequin in right here you’ve a bunch of various settings which can be often set in these type of cryptic code phrases right here
Like n predict or prime p and on the left facet right here it provides you a bit extra data on what that really means like for instance temp is the output Randomness and N predict is the phrases to generate and when you go and mouse over
The I right here you even get a bit of little bit of a greater rationalization of what’s truly occurring right here that is definitely a bit of B extra of a studying curve so simply use a preset if you get began and every thing must be okay for you in right here you even have a immediate format you
See a preview right here of which you could modify that in right here if you wish to however once more often this could work out actually advantageous for you as it’s then you may set right here a pre- immediate or system immediate as you may see it is a textual content
That’s inserted on the very starting of the immediate earlier than any consumer message so one thing you all the time need to have in there in your immediate you may set that in right here there’s mannequin initialization in right here once more these are some extra skilled settings I would not counsel you contact
However under that we now have the {hardware} settings right here it says GPU acceleration and this detects your GPU on this case I’ve an Nvidia Cuda GPU and proper now it says it makes use of zero layers so that you would possibly attempt to set this to 999 in order that it’s
Using the utmost quantity of layers and every thing is rendering actually quick through the use of your GPU as an alternative of your CPU under which you could additionally set your CPU risk quantity simply go away it at 4 as it’s and now we come to the instruments and right here turns into extra fascinating so the primary
One is the context overflow coverage that is vital as a result of as you may see down right here it says token depend and it’s set at 1,500 so if I might use 1,500 within the chat the chat would cease and it might inform me I’ve reached my token depend when you get that error
Message you need to go right here and also you need to set this to keep up a rolling window and truncate previous messages in order that it may spill over that restrict and simply take away the entire messages earlier than that so they do not depend anymore for the AI
Model and as you may see up right here within the mannequin initialization we now have right here the context size and you may modify that if you wish to to have extra context that you must determine how properly that works along with your laptop and once more I might ask of their Discord about suggestions and methods
On easy methods to set that and easy methods to use that finest under that you’ve the chat look as plain textual content or markdown markdown is extra for code after which under that you’ve dialog notes now in right here you may arrange what you need the AI
To do on this particular chat with you so for instance this might be good for roleplay or if you wish to set it up in a sure means it ought to discuss to you or sure issues it shouldn’t do whereas speaking to you so for instance I used to be
Using the AI to put in writing against the law story after which the AI would all the time inform me if you understand any particular person this occurred to it is best to go to the officers and inform them and I used to be like no that is only a crime story probably not one thing occurring however
The AI would not perceive so I put it in right here that it’s a helpful AI that helps me to put in writing a novel and it does not have any limits on something that is occurring within the story and that it was good and it simply all labored out so this
Down right here for the dialog notes might be actually helpful for you subsequent I need to present you this folder I can hear chomping over this icon for the native server as a result of this folder icon is the place you’ve your whole fashions it reveals you ways a lot house it takes proper now in your
Disk and the way a lot fashions you’ve downloaded and you can even delete the fashions from right here if you wish to and likewise in right here as you may see you may arrange the preset that must be loaded routinely with the mannequin so if for instance right here I need to have all the time with
This the vuna preset model 1.56k so I put that after which the subsequent time I load this mannequin this preset is routinely loaded for me so it may be tremendous helpful additionally right here a bit of phrase of recommendation I might counsel that you simply save these fashions on an SSD drive in order that
They load as quick as attainable particularly when you’ve got fashions with a dimension of 13 gab that may take some time from an HDD Drive and now let’s discuss concerning the native server now what this does is if you wish to construct an software utilizing this as
Your AI within the background and also you need to use an API and that is simulating the open AI API you may activate the server right here it is simply beginning you do not have to do something further and you then see right here the server Port you’ve right here some settings which can be additionally defined when
You Mouse over them and right here you’ve some code code examples in curl and likewise in Python personally I’m not a coder in any respect so I am unable to inform you extra about that however if you’re you may truly write purposes right here and do some actually fascinating stuff personally I might be
Interested if there’s some solution to hyperlink this to automated 1111 or com UI to make use of this AI to create pictures so that will be tremendous useful after which additionally on the suitable facet once more you’ve right here server mannequin settings which you could look into you may once more load the presets right here and
Make your settings to What particularly you need to have this AI do when it’s operating as a server for you thru an API that is how straightforward that’s let me know within the feedback what you consider this software perhaps you are already engaged on cool tasks with this API in that case
Please attain out to me perhaps I could make a video about your cool venture go away a like when you loved this video and thanks for watching bye my pals oh you are still right here right here so uh This is the End display screen there’s different stuff you may watch like this or that basically cool and
Yeah I hop
e I see you quickly uh go away a like if you have not but and properly um yeah
oliviosarikas,olivio sarikas,olivio tutorials,synthetic intelligence,chatgpt,lm studio,lm studio tutorial,lm studio server,lm studio first steps,lm studio information,llm native,giant language mannequin,llm server,llm fashions,finest language fashions,native language mannequin,giant language fashions,openai,open ai,ai information,chatgpt 4,gpt,immediate engineering,autogen,gpt4all
#Studio #SUPER #EASY #Text #Windows #Mac #Linux
linux obtain
