After 2 years, Practical Deep Learning for Coders v5 is finally ready! 🎊

This is a from-scratch rewrite of our most popular course. It has a focus on interactive explorations, & covers @PyTorch, @huggingface, DeBERTa, ConvNeXt, @Gradio & other goodies 🧵
course.fast.ai
For details on what's in this new course, check out the launch post:
fast.ai/2022/07/21/dl-…
There are 9 lessons, and each lesson is around 90 minutes long. It's based on our 5⭐rated book, which is freely available online. Special hardware/software isn't needed—we show how to use free resources for everything.
amazon.com/Deep-Learning-…
University math isn’t needed either — the necessary calculus and linear algebra is introduced as needed during the course.
course.fast.ai/Lessons/lesson…
Since first using neural nets >25 years ago, I've led many companies and projects that have ML at their core, including first company to focus on DL and medicine, and the first company to develop a fully optimised pricing algorithm for insurance
Many students have told us about how they’ve been gold medallists in ML competitions, got offers from top companies, and had research papers published.

Alum have gone on to jobs at organizations like Google Brain, OpenAI, Adobe, Amazon, and Tesla
course.fast.ai/Resources/test…
If you're ready to start your deep learning journey, we're ready to support you!
course.fast.ai
Big thanks to @quarto_pub, which I used to create the course website (along with #nbdev)
I'm proud to be associated with @UQSchoolITEE, where this course was recorded.
itee.uq.edu.au
If you'd like to learn more about the philosophy of @fastdotai and the results of our work, check out this conversation with @derrickharris on @future (part of @a16z)
future.com/the-rise-of-do…
Also, a big hat-tip to @OpenAI for making DALL-E available, so that I could ensure there's an adorable bunny or teddy illustration for every lesson! My favorite is the "data ethics" illustration...
course.fast.ai/Lessons/lesson…
Nearly all the materials for this course can be run directly on @kaggle GPUs, which means you can run them in the cloud for free, with nothing to install!

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Jeremy Howard

Jeremy Howard Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @jeremyphoward

Jul 8
I led the team that studied mask efficacy in early 2020 and published our results in the Proceedings of the National Academy of Science.

I spent three months earlier this year revisiting this topic, and today I'm publishing my notes and links here:
fast.ai/2022/07/04/upd…
An admission: these notes were meant to be the basis of another academic paper, and I gave up on it. In Jan 2022 when I finished this research, I looked around, and it seemed like no-one much cared about avoiding COVID any more.

So I figured it wasn't worth spending time on.
It seems like in the last couple of weeks there's signs that folks might be more open to protecting themselves and others by wearing a mask.

But the vast majority of public health advice I see on mask use is scientifically inaccurate. So I'm digging out this research for you.
Read 14 tweets
Jul 7
If you use any fast.ai library, then you'll want to install the latest fastcore, because it's >3x faster to import!

For instance, that means that git actions in an nbdev repo are now ~3x faster 😀

I used a neat but simple trick to speed it up...
Where things got slow is if you imported `fastcore.xtras`, which is a module that wraps a bunch of python stdlib functionality into some convenient interfaces. It's used by `fastcore.net`, `fastcore.parallel`, and `fastcore.utils`, so it comes up a lot.
But to do that, fastcore.xtras had to import a *lot* of stuff from python's stdlib!...
Read 5 tweets
Jun 27
One of my fave chapters of "Practical Deep Learning for Coders", co-written with @GuggerSylvain, is chapter 8. I've just made the whole thing available as an executable notebook on Kaggle!

It covers a lot of critical @PyTorch & deep learning principles 🧵
kaggle.com/jhoward/collab…
The chapter looks at the "matrix completion" problem at the heart of recommendation systems -- e.g what would you guess are the missing values in this matrix showing what rating users gave movies?
The key idea is to find the "latent factors" behind people's preferences
Read 15 tweets
Jun 25
Often we want to predict more than one dependent variable in a neural network. For instance in the current @kaggle "Paddy Doctor" competition there's both paddy disease and rice variety provided for each image.

It's easy w/ fastai DataBlock! Notebook &🧵:
kaggle.com/code/jhoward/m… Image
In the pic in the previous tweet, you can see that each image is associated with two outputs: disease, and variety.

Here's all the code needed to create DataLoaders which provide that data to a model (see the notebook for details on what every line does) Image
To train our model to predict these two outputs, we need to create the two parts of our loss function, and update the Learner to create enough outputs for our needs Image
Read 5 tweets
Jun 19
Big release of fastai today - @huggingface Accelerate is now supported for distributed training thanks to @TheZachMueller and @GuggerSylvain. That means you can now do distributed training in a notebook! 1/🧵
Here's all you need to train imagewoof with xresnet50 and mixup augmentation, on multiple GPUs. Run with `accelerate launch distrib.py`
github.com/fastai/fastai/…
Here's a tutorial on using Accelerate distributed training in a notebook
docs.fast.ai/tutorial.distr…
Read 5 tweets
Jun 18
Are you ready to embark on a deep learning journey? I've just released over 6 hours of videos and the first in a series of notebooks showing the thought process of how I got to #1 in a current Kaggle comp.

Follow this 🧵 for updates on the journey!
kaggle.com/code/jhoward/f…
The first thing you might notice if you click the link in the tweet above is that I've created `fastkaggle`, a little library of utilities to help kagglers -- especially to help running kaggle stuff on your own machine
fastai.github.io/fastkaggle/
You'll also see there the links to the over 6 hours of videos walkthrus where I'll take you through every step of the process.

(This is a sneak peak at a new feature we're adding to the fast.ai course this year!)
Read 13 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(