sridhar Profile picture
Jan 11, 2023 11 tweets 7 min read Read on X
1/ AI exploded on the scene at the end of 2022, with applications like @OpenAI's ChatGPT taking the world by storm.

2023 is poised to be the most exciting year of AI yet! 🎉

Here's mine and @vivek7ue's look at the lay of the land + what might happen next...

👀🧵 Image
2/ Let's first dive into what the industry looks like today.

We see 5 main categories:
⭐ Foundation Model Players
⭐ AI Frontend Startups
⭐ Copilot/LLM for X Companies
⭐ Tooling Companies
⭐ Big Compute Clouds Image
3/ ⭐ Foundation Model Players

These include @AnthropicAI, @OpenAI, @CohereAI, and @AI21Labs. All of these players will all have instruction following models that are more or less substitutes for each other. Their businesses will all be based on an API model.
4/ Their APIs will all converge to:
➡️ Generations
➡️ Embeddings
➡️ Fine tuning
➡️ Classification

They will all:
☑️ Recruit AI frontend startups
☑️ Use an “index YCombinator” business model
☑️ Outsource GTM to AI frontend startups

Quality of model 🤝 Loyal customers
5/ ⭐ AI Frontend Startups

These are companies like @jasper_ai_ and @copy_ai that are vertical specific “prompt engineering layers” on top of the foundation model players.

These companies will use APIs from the foundation model players to stitch together end user solutions.
6/ 💪 Strengths = User focus + GTM

Most of YCombinator’s 2023 vintage will be companies of this form (a large number being marketing tech companies).

They'll look like a dressed-up version of the enterprise SaaS companies from the last decade, w/ an “AI intelligence layer”.
7/ ⭐ Copilot/LLM for X Companies

These will include:
📌 Original CoPilot for programmers (@github / MSFT)
📌 LLM for Chatbots (@character_ai, @inflectionAI)
📌 LLM for RPA (@AdeptAILabs)
📌 LLM for search (@Neeva) + many others
8/ These will also include OG LLM companies like @cresta (enterprise chatbots) & @LiltHQ (translation).

All these companies will bet that task-specific LLM tech + deep understanding of user + product is how the market is won.

They'll need big capital raises to pull it off. 💰
9/ ⭐ Tooling Companies

These are classic shovel providers in a gold-rush and will include:
↪️ Labeling companies (@scale_AI, @HelloSurgeAI, @SnorkelAI)
↪️ Training infra companies (@MosaicML, Stronger Compute)
↪️ Inference infra companies (@gooseai_NLP) + many others
10/ ⭐ Big Compute Clouds

These companies (like GCP, AWS, @Azure and @Oracle) will:
✅ Wake up to the business opp that LLMs provide
✅ Compete aggressively to go up the value chain beyond being just “GPU compute providers”

Azure threatens to have run away w/ this game already.
11/ Over the next year, we expect to see multiple battles, consolidation, and splintering across these categories.

Stay tuned for tomorrow where we share our top predictions on how the industry will shake out in the year ahead… Image

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with sridhar

sridhar Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @RamaswmySridhar

Feb 8, 2023
The web needs real, authentic content.

You’ve honed your craft as a publisher, producing high quality material.

And a lot of your hard-earned traffic comes from page ranking well in Google search.

But things are about to get a whole lot worse for you… 🧵
Even in the past, a lot of your traffic from Google was drive-by.

Maybe people stayed for exactly one view.

You’ve looked for ways to increase stickiness.

But you haven’t really built search & recommendation engines on your site. They’re hard to custom build for your content.
Here come the LLMs and AI answer bots aggregating and summarizing YOUR content in search results.

You’ve seen how ChatGPT gives fluent answers and what that previews.

With answer-bots, you aren’t getting attribution nor traffic.

Does this sound like “fair use” to you?
Read 13 tweets
Feb 7, 2023
Lots of AI-focused investments being announced w/ BIG $$$ at play.

Many rounds are being led by cloud vendors like Azure and GCP.

What's going on?

These clouds have 50% utilization on their AI compute.

AI is a HUGE opportunity for cloud providers

What @vivek7ue + I see🧵
LLM startups are aiming to secure access to guaranteed compute at effective prices.

Why?

There’s a big squeeze on (a) cost of compute and (b) availability.

Say you’re an LLM startup. Having compute is a competitive advantage over your peers.
Compute power to run an LLM can be high! (esp if you need to play the "AGI big boy" game...)

And availability for compute access is a first order issue.

Unless you are willing to commit large amounts of $$, you are NOT prioritized for availability for compute.
Read 10 tweets
Feb 5, 2023
⚠️Publishers, beware! ⚠️

Your content is going to get sucked into AI bots pulling YOUR work into their large language models.

Your referral traffic will go down!

If Google clones @Neeva AI (which we expect), then publishers are at risk

@vivek7ue & I have solutions 🧵
As search engines become answer engines, referral traffic will drop!

It’s happened before: Google featured snippets caused this on 10-20% of queries in the past.

This is dangerous for pubs unless they take control of their relationship w/their search overlords. 3 ways to this:
1️⃣ Don’t get crawled – Tough to do. Unless publishers band together, unilateral disarmament is hard for a single publisher to achieve against a monopoly.
2️⃣ Ask for payment for LLM inclusion – again, tough against a monopoly. (@Neeva is committed to pub revenue share)

Or…
Read 14 tweets
Feb 4, 2023
@VeronicaSaron from my team said. "Dude, I feel old. How to I talk to genZ?!"

(NOOOOO...she did not say that. I am, um, paraphrasing...)

Me: "Can totally do a tool for you. I hear chatGPT is good at programming."
easy enough, right?! does not work. 403 blah blah.
back to @Neeva top result is this: medium.com/codingthesmart…
Read 4 tweets
Feb 4, 2023
Want to know how our team at @neeva seamlessly combined LLMs with our search stack?

And how we reduced time to first byte from 8 seconds to less than 1.5 seconds?

Read on below…🧵
To get answers on NeevaAI, there are 4 phases:
1/ Retrieve and rank pages from our 4 billion index (soon to be 6b)

2/ Compute extractive and abstractive summaries for the top pages

3/ Send back a search result page w/a skeleton NeevaAI answer

4/ Stream the AI answer back
Step 1 can be done in about 500ms but step 2 took >7 seconds.

That is an unacceptable delay for any search engine!

Our team had to get into model brain surgery!

While deep learning has traditionally favored model symmetry we find this can be troublesome for efficient inference
Read 11 tweets
Jan 26, 2023
1/ Ten blue links headed to a museum near you!!

@Neeva is applying cutting edge AI to definitely change up the search experience!

Not only are we providing real time, cited AI, because we are making the whole search experience a breeze!

🧵
2/ First, a quick backstory on #NeevaAI.

We were the first company to launch cited summaries backed by actual data. With our real-time AI search and web crawling capabilities, we provide authoritative answers that you can trust.

No more hallucinations!
3/ And now, we're taking our experience to the next level with the launch of Citation cards.

Simply click on a sentence in our summaries and see a card with additional details, allowing you to fact-check AI in a user-first experience.
Read 10 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(