Hello guys, I just got curious to know about the API cost for Claude 3.5 sonnet to develop a million LOC (example) software and asked this to chatgpt and it gave me the below response of the cost analysis. Would really appreciate anyone who can share some insights on the reality of this cost analysis. And also I would like to know whether oTToDEV is capable of developing a million LOC software using sonnet 3.5 or any capable local LLM. Thank you
Chatgpt response:
Input Token Cost: $3 per million tokens
Output Token Cost: $15 per million tokens
The estimate includes extensive testing and more than 10 iterations for finalizing the software.
Assumptions:
- Token Calculation:
1 line of code (LOC): ~10 tokens (5 input + 5 output on average).
• 1 million LOC: 10 million tokens total (5M input + 5M output).
- Iterations:
10 iterations for refinement and testing.
• Each iteration processes the same 1 million LOC (10M tokens per iteration).
- Extensive Testing:
• Testing will add 50% more token usage compared to the coding process.
- Additional Tokens:
• For design, requirement analysis, and deployment: 30% of coding token consumption.
Cost Breakdown:
- Coding Phase:
Tokens per iteration: 10 million (5M input + 5M output).
10 iterations:.
Input cost: 50M, \text{tokens} \div 1M \times 3 = $150
Output cost: 50M, \text{tokens} \div 1M \times 15 = $750
• Total coding cost = $900.
- Testing Phase:
Tokens: 50% of coding tokens.
Total tokens =
• Input cost: 25M \div 1M \times 3 = $75.
Output cost:
25M \div 1M \times 15 = $375.
• Total testing cost = $450.
- Other Phases (Requirement
Analysis, Design, Deployment):
30% of coding tokens.
Input cost: 15M \div 1M \times 3 = $45.
Total tokens =
Output cost: 15M \div 1M \times 15 = $225.
• Total cost for other phases = $270.
Total Estimated Cost:
-
Coding: $900
-
Testing: $450
-
Other Phases: $270
Grand Total: $1,620
Considerations:
Overhead for Edge Cases: Add 10-20% buffer for unanticipated issues or scope creep.
Final Cost Estimate: $1,620-$1,940.