You are currently viewing SemiWiki as a guest which gives you limited access to the site. To view blog comments and experience other SemiWiki features you must be a registered member. Registration is fast, simple, and absolutely free so please, join our community today!
Will an AI/ML program be built that learns and advances on its own as it is used? If so, will this lead to a myriad of AI/ML programs that constantly advance as there are used? Any thoughts, comments or expansions sought and welcome.
What timelines and potential do the SemiWiki readers feel AI/ML have and what will be its best use cases? Will it just be AMD and Nvidia and their customers win or will other players and users come into play? Dangers and opportunities?
I don't exactly know what the best use cases will be I personally work in analytics and we use LLM's to extract certain information from text that would be nearly impossible with other methods. I think also that lot of performance is left on the table and the software stack needs to catch up. Particularly AMD has lot of catching up to do. I heard their software is becoming a lot better and more versatile but playing catch up with Nvidia is lot harder than it was catching up with Intel.
Elon Musk has hinted (indirectly) that the opposite may be the case - that it may feed on itself and regress.
I can't find the post, but he said that when training AI the Grok team uses 2023 or pre-2023 data as an increasing amount of data on the internet is AI generated.
My take-away was that using too much recent data would effectively bias or poison the training, making it less useful. (i.e. If you keep abstracting something, you eventually lose all meaning. )
Elon is of course only one person, but I just wanted to share this viewpoint.
AI is everywhere now Art, mostly in the datacenters but it is pushing to the edge with cars and smartphones. I have a new iPhone with AI. At some point in time the edge and datacenters will be able to keep track of us in intimate detail which is the good news and bad news. There is no way the privacy laws and security people will keep up. Life as we know it will be very different in five years than from today. I would liken it to what social media did to society creating the look-at-me selfie generation.
LLM is just another black box like SQL server. Everyone has it, everyone use it, but it will slowly fade into background. Most people don't care which SQL server they use, most people won't care which LLM they use too.
