Like the tag line says I’m not a coder but I have grown up around coders. I have always wanted to be able to create my own software so this makes me super excited.
Here are my main questions that I have and could use some direction on. If you have a resource or video that can help me then please share it would mean a lot to me. I have tones of ideas that need yo be made lol.
First question. I do not have a workable computer set up to run a local model or run this set up locally. I’m also low income that’s why this is so exciting to me. So my first question I have is how can I find and set up a virtual set up on the cloud like a virtual cloud pc set up where I can set up and run this version of ottodev on that us scalable and very inexpensive. And would also allow me to play with other things as well. I do not want to be hindered by my low income I want to use this to grow my income and create a real product I can sell to solve real problems and in turn solve my own. So thank you in advance for any and all help. Please make sure that the explication is easy to understand and is very detailed nothing left out. I’m a non coder that does not understand.
Question two. This is a question about the functionality of ottodev and a feature set that would be great to implement for someone like me who has no understanding of coding languages or frameworks. Not to mention what are the best AI models to use as well. My idea is to have an option for both a dynamic AI model selector option and dynamic code selector option and the like. Where as someone who is a non coder explains what they want to make the platform can choose the best AI models to use to code the software and can interchange between models as needed to use each model for its strength. While also knowing the best coding languages to use for each part of the process as well for best results and practices for the principals of creating a real working application that us production ready. A person can also put cost consideration in their prompt and it will choose open source abd free models as well.
I hope what I am saying is making sense. I am a visual hands on person numbers and code are not my wheel house. But I see this as being an amazing way to build the applications that will shape my future. I can’t keep paying so many subscriptions that’s why this is so exciting for me. Please let me know how I can get started virtually and I can not wait to see what happens next. I will be a power user for sure. Thank you so much sincerely Nathaniel Ratcliff.
2 Likes
Hey @bigsmiles, thanks for posting these in depth questions, I appreciate it a lot!
Question 1 - You can certainly rent a machine in the cloud to run local LLMs so you don’t have to pay to build a machine yourself, but even that can get pretty expensive because you’ll pay at least >$1.00 per hour for a lot of these machines. My suggestion would be to use the OpenRouter API to get access to these open source LLMs for dirt cheap! You can use super powerful LLMs through OpenRouter like Qwen-2.5-Coder 32b and DeepSeek Coder v2 236b.
Question 2 - I love this idea! Basically an LLM router similar to something like what ChatLLM (Abacus.ai) has. Let me think more about this but honestly I’d love to add this to the main “desired features” list in the README!
4 Likes
Thank you so much I appreciate your input. So I just want to make sure I’m understanding what your saying correctly. It’s to still have ottodev hosted locally on the computer but connecting the API key for open router so that you can use the software locally but don’t have to have the llms local on the computer to save compute space on your local computer? If at all possible can you share a video on how to set this up. I have ottodev downloaded using pinokio so if you can share how to set that up on pinokio that would be a life saver I was trying but for done reason it would not let me paste the API key in.
Also correct me if I was seeing things but on one of your recent videos updating us on ottodev I could have sworn I saw in the model drop down on your screen capture that the option for hugging face was there. Cuz that’s a huge thing is that available to all of us as well and if so how?
Thank you so much for all of this. Any idea that I share that you think is worth adding to the plan and adding as a functionality of thus software fork yes add it away you have my permission hands down. I not good with coding but I am good with putting ideas together. I would love to do what I can to help the community. If giving you clever ideas is what I can do then that’s what I will do.
I also have a tone more suggestions lol I have really been going down the rabbit hole and can see so many ways to bring more to the table. My other suggestions to things that would make this epic are listed below.
- A Copycoder AI like interface or an interface like you get inside of replit assistant where the prompting system is more like talking to an actual developer.
- A setup where you can build your own agents and within the agent set up you can pull up your ottodev terminal to create super specific specifications.
- Including open source data bace and hosting integrations.
- I also would love to have an aspect of the software that is scraping all the open source softwares and repositories and creating a database of knowledge to pull from with documentation and API keys to boot to them be able to pull from when creating projects in the coding fase but also the running of your application.
- I know there where a few other things but they are escaping me now. But taking all these things and centralizing them into one master open source platform that will allow your creative dreams to run wild that’s the dream I have. Thank you for all you do I’ll continue to share more ideas as they come up. Oh I just remembered lol there us the Copycoder that allows you to take a picture of a site and then it will create the prompt for the platform can you create something like that too. I will have more coming but that’s enough for now lol. Thank you so much.@ColeMedin
2 Likes
Love all your suggestions - thank you! A lot of these we are actually planning - some of them more for the long term since they are certainly larger efforts!
Yes - you can use HuggingFace! All you have to do is put in the HuggingFace API key, which if you select HuggingFace as the provider in oTToDev there is a link there that directs you to get your key.
For OpenRouter, could you clarify what prevented you from pasting in your OpenRouter API key?
1 Like
Sorry for the late reply life has been crazy. Yes I copied the API key but when I went to rite click to paste it in I did not have the pop up come up to show me the paste option to paste it in. So that’s what Im seeing.