2023-06-14

Cheap Computing and the Balancing
Act of Population Decline

Cristian – Gavril Olar | Director of Systems Software at AXELERA AI

Cheap Computing and the Balancing
Act of Population Decline

2023-06-14

Cheap Computing and the Balancing
Act of Population Decline

Cristian – Gavril Olar | Director of Systems Software at AXELERA AI

After 20 years of calling me to fix their email and antivirus settings, my parents started calling my 13-year-old daughter for help instead. Technology seems to have been nagging rather than helping grandparents, but the advent of cheap computing gives fundamental reasons to change this balance.

Worldwide population figures 2024

Figure 1 – A few population pyramid examples. There are places with significant population shrinking and places with population growth, but in the last few years, the global trend is toward population shrinkage. Source: https://www.populationpyramid.net

Economic Growth in a Shifting Population Landscape

In the past century, we’ve seen a 10% market growth [1], reshaping the foundation of our civilization with the assumption of continuous economic growth. Whether it’s investment funds, pension plans, or governments calculating bond rates, all have factored in the premise of growth.

Until recently, an important driver of this growth was the increasing global population. A larger population equates to more brain and muscle power, leading to heightened productivity capacity. However, in recent years, the world has witnessed a decline in population growth, albeit unevenly across different regions.

Some see this decline as ominous, as famously raised by Elon Musk two years ago when claiming civilization could crumble [2]. On the more analytical side of things, this shift has drawn attention due to its potential impact on various aspects, notably retirement plans and workload stress. The population decrease is driving the trend toward fewer workers supporting a higher number of retirees along with a greater number of dependents and fewer skilled workers.

It has led some countries to make legislation changes to move the retirement age upwards [3]. Increasing productivity, therefore, is becoming a crucial goal in sustaining economic growth, albeit with potential consequences such as increased workload stress [4].

Working Smarter with Cheap Computing

To counteract these challenges, the focus must shift towards increasing productivity without human overload. In other words, we need to get more human equivalent. Historically, automation has played a key role in boosting productivity. However, the recent decrease in computational costs suggests a potential profound transformation on the horizon. The promise of almost free computer power has significant implications for productivity growth.

The ESP32-CAM from Espressif, a low-cost development kit capable of computer vision applications, perfectly exemplifies the advent of cheap computing. In fact, in an article where it was presented 5 years ago it prompted the author to say computing [with ESP32] is not just cheap but it’s essentially free [5]. This seemingly trivial device’s potential is immense, setting a precedent for affordable compute power that creates value from virtually nothing.

When I learned about Espressif, I was working at Intel in the technology department building the MyriadX chip. I tried out ESP32 in my spare time because it had some similarities to Myriad: it could use a camera, do some level of image processing, and claimed to do computer vision applications. A couple of weekends later, I was able to build a few interesting applications and was very excited. But then I looked at machine learning applications on ESP32, and the performance there was really limiting my ideas. Even so, the article comment was something that stuck in my mind: a platform that makes compute essentially free.

This revelation came back into focus when during an internal brainstorming session, Fabrizio del Maffeo, our CEO at Axelera, commented that we were essentially getting Tera Operations Per Second (TOPS) for free with In-Memory Computing. At the time the comment was made, we were still waiting for Metis, Axelera’s first commercially available chip to come from the factory into the lab. The comment still felt theoretical.

Figure 2 – Areas which were traditionally empty are starting to get filled up with architectures from different applications. Cornami adds encryption power, Axelera adds Artificial Intelligence power.

Unlocking the Power of Artificial Intelligence at low costs

Things changed just a few days later when Metis came into the lab. Incidentally, Metis’ early power-up coincided with the week before and after Easter. In Romania, where I am based, in a word-by-word translation these weeks would be “The Great Week” and “The Enlightened Week” which seemed fitting: Metis came alive in the Great Week and started running Neural Networks in the Enlightened Week. To introduce Metis to the world we decided to use the MIT Lincoln Laboratory [6] report which charted current compute trends with a live demonstration.

Metis AIPU was not there yet at the time of publishing the 2022 trends but we did a live plot running internal max TOPS programs for the In-Memory Computing engines.

This chart doesn’t show the compute cost but all this comes at around $200. Now, the human brain memory power is likened to around 100 trillion calculations [also called „operations”] per second [7]. The program used above was an artificial one loading the In-Memory Computing part of Metis with an artifical neural net-like that had some load/store overheads to an ideal pure-calculation program measuring the AIPU In-Memory Computing power used for this. It reaches a practical 200 TOPS result, so the equivalent of two human brains. There is a lot more work to reach actual use of human brains but what really shook me was that price for such brain power. Such calculation capacity has existed for quite sometime now. Still, the computing platforms needed for it have had wild price evolutions so far and have generally stayed in the thousands of dollars. But $100 for a human brain capacity is eye opening and has significant transformation potential. Currently, the smallest country nominal GDP per capita in the world is $249. With the capacity of two human brains lowered at less than half of that, we are witnessing the first point in history where the compute equivalent of human productivity is clearly available anywhere in the world, creating the ability to democratize AI to even the poorest of countries.

To look at the practical implications of this capacity we can look at analysis recently made showing the potential to double the productivity in China which is one of the countries already facing some of the most serious population declines and hedging their hopes on automation [8]. Doubling productivity could more than compensate for an eventual productivity decline caused by population shrinkage.

Hand holding Metis AI processing unit with two brains in the background

Evaluate industry defining AI inference technology today.

The Axelera AI Metis Platform accelerates prototyping and deploying (vision) AI acceleration by providing a comprehensive hardware and software solution with unmatched usability and cost-efficiency.

Be among the first to accelerate your innovation and experience true freedom to innovate. Order your Metis evaluation kit and be a part of shaping the future of Edge AI.

Which Evaluation kit do you want to order?1/3.

This field is required!
This field is required!
This field is required!
This is not correct
This is not correct.
This is not correct

Your contact details2/3.

This field is required!
This field is required!
This field is required!
  • United States
  • Canada
  • Afghanistan
  • Albania
  • Algeria
  • American Samoa
  • Andorra
  • Angola
  • Anguilla
  • Antarctica
  • Antigua and Barbuda
  • Argentina
  • Armenia
  • Aruba
  • Australia
  • Austria
  • Azerbaijan
  • Bahamas
  • Bahrain
  • Bangladesh
  • Barbados
  • Belarus
  • Belgium
  • Belize
  • Benin
  • Bermuda
  • Bhutan
  • Bolivia
  • Bosnia and Herzegovina
  • Botswana
  • Brazil
  • British Indian Ocean Territory
  • British Virgin Islands
  • Brunei
  • Bulgaria
  • Burkina Faso
  • Burundi
  • Cambodia
  • Cameroon
  • Cape Verde
  • Cayman Islands
  • Central African Republic
  • Chad
  • Chile
  • China
  • Christmas Island
  • Cocos (Keeling) Islands
  • Colombia
  • Comoros
  • Congo
  • Cook Islands
  • Costa Rica
  • Croatia
  • Cuba
  • Curaçao
  • Cyprus
  • Czech Republic
  • Côte d’Ivoire
  • Democratic Republic of the Congo
  • Denmark
  • Djibouti
  • Dominica
  • Dominican Republic
  • Ecuador
  • Egypt
  • El Salvador
  • Equatorial Guinea
  • Eritrea
  • Estonia
  • Ethiopia
  • Falkland Islands
  • Faroe Islands
  • Fiji
  • Finland
  • France
  • French Guiana
  • French Polynesia
  • French Southern Territories
  • Gabon
  • Gambia
  • Georgia
  • Germany
  • Ghana
  • Gibraltar
  • Greece
  • Greenland
  • Grenada
  • Guadeloupe
  • Guam
  • Guatemala
  • Guernsey
  • Guinea
  • Guinea-Bissau
  • Guyana
  • Haiti
  • Honduras
  • Hong Kong S.A.R., China
  • Hungary
  • Iceland
  • India
  • Indonesia
  • Iran
  • Iraq
  • Ireland
  • Isle of Man
  • Israel
  • Italy
  • Jamaica
  • Japan
  • Jersey
  • Jordan
  • Kazakhstan
  • Kenya
  • Kiribati
  • Kuwait
  • Kyrgyzstan
  • Laos
  • Latvia
  • Lebanon
  • Lesotho
  • Liberia
  • Libya
  • Liechtenstein
  • Lithuania
  • Luxembourg
  • Macao S.A.R., China
  • Macedonia
  • Madagascar
  • Malawi
  • Malaysia
  • Maldives
  • Mali
  • Malta
  • Marshall Islands
  • Martinique
  • Mauritania
  • Mauritius
  • Mayotte
  • Mexico
  • Micronesia
  • Moldova
  • Monaco
  • Mongolia
  • Montenegro
  • Montserrat
  • Morocco
  • Mozambique
  • Myanmar
  • Namibia
  • Nauru
  • Nepal
  • Netherlands
  • New Caledonia
  • New Zealand
  • Nicaragua
  • Niger
  • Nigeria
  • Niue
  • Norfolk Island
  • North Korea
  • Northern Mariana Islands
  • Norway
  • Oman
  • Pakistan
  • Palau
  • Palestinian Territory
  • Panama
  • Papua New Guinea
  • Paraguay
  • Peru
  • Philippines
  • Pitcairn
  • Poland
  • Portugal
  • Puerto Rico
  • Qatar
  • Romania
  • Russia
  • Rwanda
  • Réunion
  • Saint Barthélemy
  • Saint Helena
  • Saint Kitts and Nevis
  • Saint Lucia
  • Saint Pierre and Miquelon
  • Saint Vincent and the Grenadines
  • Samoa
  • San Marino
  • Sao Tome and Principe
  • Saudi Arabia
  • Senegal
  • Serbia
  • Seychelles
  • Sierra Leone
  • Singapore
  • Slovakia
  • Slovenia
  • Solomon Islands
  • Somalia
  • South Africa
  • South Korea
  • South Sudan
  • Spain
  • Sri Lanka
  • Sudan
  • Suriname
  • Svalbard and Jan Mayen
  • Swaziland
  • Sweden
  • Switzerland
  • Syria
  • Taiwan
  • Tajikistan
  • Tanzania
  • Thailand
  • Timor-Leste
  • Togo
  • Tokelau
  • Tonga
  • Trinidad and Tobago
  • Tunisia
  • Turkey
  • Turkmenistan
  • Turks and Caicos Islands
  • Tuvalu
  • U.S. Virgin Islands
  • Uganda
  • Ukraine
  • United Arab Emirates
  • United Kingdom
  • United States Minor Outlying Islands
  • Uruguay
  • Uzbekistan
  • Vanuatu
  • Vatican
  • Venezuela
  • Viet Nam
  • Wallis and Futuna
  • Western Sahara
  • Yemen
  • Zambia
  • Zimbabwe
This is not correct.
This field is required!
This field is required!

Your project info3/3.

This field is required!

One more thing...

This field is required!
This is not correct

Thank you for your ordering your Axelera Metis Evaluation Kit!


We've received your order, and a confirmation email has been sent to the provided email address. Our team is excited to review your order.

After evaluating your input, we will be in touch within the next 2 business days to discuss the next steps and how your order can benefit your innovative projects.
Stay tuned for more details coming your way soon!

The Future of Productivity Through Compute

The rise of affordable computation, coupled with advances in AI, could provide tangible relief to pension funds. By boosting overall productivity, the returns from investment-based pension funds could improve, and profit tax revenues for state-financed pension funds could increase. This shift could effectively stabilize pension fund sustainability even with a smaller proportion of working individuals. It could also potentially improve living standards for retirees, without an increased financial burden on the younger generation.

Additionally, an increased reliance on automation could also alleviate workload stress for workers. By automating repetitive tasks and processes, workers could focus on more engaging, creative aspects of their jobs. A reduction in workload stress could lead to improved job satisfaction and mental well-being, contributing to an overall higher quality of life.

Instead of a Conclusion

So there’s a lot of benefit coming over for grandparents. But is technology still a nag? My father found creative ways of enjoying his retirement with chatGPT recently. He remembered vaguely at some point in his youth a friend of his used to have a great traditional stew recipe but could never really find a recipe for that. He decided to feed transfomers every information he remembered and sure enough: chatGPT came with the right recipe and instructions for getting the special stew done. I think the nag is being forgiven.

References

[1] James Royal, A. O. (2023, 05 30). nerdwallet. Retrieved from https://www.nerdwallet.com/article/investing/average-stock-market-return

[2] Thomson, S. (2021, December 14). Civilization is going to crumble,’ if we don’t have more kids, says Elon Musk. Retrieved from thehub.ca: https://thehub.ca/2021-12-14/civilization-is-going-to-crumble-if-we-dont-have-more-kids/

[3] David Knox, G. P. (2022, November 16). How Shrinking Populations Can Affect Pensions. Retrieved from brinknews.com: https://www.brinknews.com/how-shrinking-populations-can-affect-pensions/

[4] Mazur, C. (2023, February 11). 40+ WORRISOME WORKPLACE STRESS STATISTICS [2023]: FACTS, CAUSES, AND TRENDS. Retrieved from zippia.com: https://www.zippia.com/advice/workplace-stress-statistics/

[5] Allan, A. (2018, June 27). hackster.io. Retrieved from Using a Camera with the ESP32: https://www.hackster.io/news/using-a-camera-with-the-esp32-9d6994b34a2b

[6] Albert Reuther, P. M. (2022). AI and ML Accelerator Survey and Trends. MIT Lincoln Laboratory Supercomputing Center.

[7] S.K.Katti, M. a. (2010). Superficial Analogies and Differences between the Human Brain. IJCSNS International Journal of Computer Science and Network Security, 197. Retrieved from https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=536bef6aeb17f591da6fd0ab9e86746d6e6222e8

[8] Sender, H. (2021, May 5). Robots will make doubling China’s GDP by 2035 look easy. Retrieved from https://asia.nikkei.com/: https://asia.nikkei.com/Opinion/Robots-will-make-doubling-China-s-GDP-by-2035-look-easy