Running oTToDev Locally on MacBook Air M2

gteshuva · December 9, 2024, 5:06pm

Hi everyone,

I’m looking to run oTToDev locally and wondering if my MacBook Air M2 (8-core CPU, 8-core GPU, [RAM size] RAM) is sufficient for this.

If not, could you recommend a good remote server or cloud-based service for running oTToDev efficiently?

Thanks in advance for your help!

Best regards,

Gal

thecodacus · December 9, 2024, 7:08pm

whats the ram size ?

TokyoScooterGuy · December 10, 2024, 4:52am

It is designed to be run locally. And your MacBook Air will run it fine even with 8gb RAM. But you’ll need an API from one of the AI providers to get it to work well.

gteshuva · December 10, 2024, 7:57am

How to get api of qwern 2.5?

wonderwhy.er · December 10, 2024, 10:15am

Open router has it

HuggingFace

Together AI too

You can try here

You will need to get a API key
You can click on Get API Key to be redirected to it