700,000 dollars per day: This is how expensive the operation of ChatGPT should be

Already at the beginning of the year, experts discussed that the power consumption of services based on artificial intelligence such as ChatGPT is immensely high and that companies should present this transparently. Now there are projections of what the operation may cost approximately.

Because there is no disclosure yet, but the interest in this information is great. The research company, called SemiAnalysis, did the math on available data and came up with a staggering figure: The company estimates that running ChatGPT requires around $700,000 per day.

This corresponds to around 36 cents per request addressed to the ChatBot. The hardware infrastructure required to operate the AI ​​systems accounts for most of the fixed costs.
Infographic Artificial Intelligence: AI, a threat to public order?

Interesting cost model

“Estimating the cost of ChatGPT is a difficult endeavor due to several unknown variables. We created a cost model showing that running ChatGPT costs $694,444 per day in computing hardware costs. OpenAI requires ~3,617 HGX A100 servers ( 28,936 GPUs) to run ChatGPT,” writes SemiAnalysis writes in a blog post. Based on this estimate, operating costs would be in excess of $255 million per year if all factors remained as they are. However, Microsoft is said to be already working on using its own hardware to reduce the operating costs of ChatGPT. We are talking about new processors that work more energy-efficiently. In addition, ChatGPT is one of the fastest growing technologies at the moment. In January, just two months after its freely accessible launch, over 100 million active users had already been counted.

See also:

ChatGPT, OpenAI