Large Language Models15 min read
How Image Generation Actually Works
The real process behind Midjourney, Gemini, FLUX, and ChatGPT
Topic
Computer Vision
Computer vision is where What's AI started. This topic groups explainers on image models, segmentation, 3D, video, and the visual research that shaped the field.
computer visionimagevideovisionsegmentation3dnerfdiffusiongandall
Computer Vision11 min read
Your AI Can Improve Itself — Or Fool You
Self-Improving AI Is No Longer Theory
Large Language Models4 min read
Master LLMs in a Weekend
Full 10-hour video course now live, first 4-hour module free
AI Engineering10 min read
Open-Sora 2.0 Explained: Architecture, Training, and Why It Matters
How Open-Sora 2.0 Built Sora-Level Video AI for $200K
Large Language Models9 min read
2023: The best AI papers - A Review 🚀
A recap of the research progress and important news in AI in 2023!
Computer Vision8 min read
The Future of Video Generation: Deep Dive into Stable Video Diffusion
Stable Video Diffusion Explained
Computer Vision58 min read
Revolutionizing AI Applications: Dmitry Shapiro's Vision for MindStudio
This is an interview with Dmitry Shapiro, previously working at Google and CTO of MySpace Music. Now, Dmitry is building something super ambitious with the goal of democratizing ar
Computer Vision7 min read
DALLE 3 Explained: Improving Image Generation with Better Captions
OpenAI’s BEST text-to-image model to date!
Computer Vision6 min read
Generate music with AI: Stable Audio Explained
New AI That Generates Amazing Music !
Computer Vision6 min read
MVDream: Creating Lifelike 3D Models from Words
MVDream: A new text-to-3d approach (explained)!
Large Language Models5 min read
The First General-Purpose Visual and Language AI: LLaVA
LLaVA: Bridging the Gap Between Visual and Language AI with GPT-4
Computer Vision5 min read
Fixing AI Hallucinations: The Importance of Explainability in AI (XAI)
An introduction to explainable AI
Large Language Models6 min read
Large Language Models Enter the 3D World!
An overview of the first 3D-LLM
Computer Vision7 min read
StyleGANEX: Enhancing Image Manipulation with Dilated Convolutions
Enhance Your Photos with AI: From HD Upscaling to Cartoon Filters
Computer Vision9 min read
Revolutionizing Online Shopping: AI's Virtual Try-On Experience
AI Does magic with UNets, Diffusion, and clothes!
Computer Vision7 min read
The Best Image-to-3D AI to date: Neuralangelo
Here's the best Images-to-3D AI to date, and how it works…
RAG and Retrieval6 min read
Image Manipulation with Your Mouse! Drag Your Gan Explained
Move anything from point A to point B!
Large Language Models5 min read
Your Dictionary for AI in 2023
Logan Kilpatrick's Definitions for all the words to know for OpenAI, GPT and AI in 2023
Large Language Models2 min read
An Interview with OpenAI's Developer Advocate Logan Kilpatrick
Building with LLMs, ChatGPT, and Working at OpenAI With Logan Kilpatrick (Dev Rel @OpenAI) - What's AI episode 11
Computer Vision5 min read
Perfusion: Stable Diffusion but more Controllable!
The new Perfusion model by NVIDIA Explained
Large Language Models6 min read
Meta's new Segment Anything Model Explained
SAM, promptable segmentation and the largest segmentation dataset to date!
Computer Vision6 min read
Image Editing from Text Instructions: InstructPix2Pix
The hottest image editing AI, InstructPix2Pix, explained!
AI News and Analysis29 min read
The 2022 AI Recap - A Review 🚀
A curated list of the latest breakthroughs in AI by release date with a clear video explanation, link to a more in-depth article, and code.
Computer Vision6 min read
From Audio to Talking Heads in Real-Time with AI! RAD-NeRF explained
Efficient NeRFs for Real-Time Portrait Synthesis (RAD-NeRF)
Computer Vision5 min read
InfiniteNature-Zero: Fly Into Your Pictures With AI!
Generate infinite new frames as if you would be flying into your image!
Computer Vision6 min read
eDiffi explained: New SOTA Image Synthesis model!
NVIDIA's new model has better results, more control and more fidelity than DALLE and Stable Diffusion!
Computer Vision6 min read
Diffusion models: Everything you need to know
Here's every vision application Diffusion models were a game changer in 2022: image, text, video, 3D, and more!
Computer Vision7 min read
AI Image Editing from Text! Imagic Explained
Imagic: Manipulate images using pre-trained image generator models!
Computer Vision5 min read
3D Models from Text! DreamFusion Explained
How AI generates 3d models from only text!
AI Engineering4 min read
General Video Recognition with AI
What does such a model understand when it sees such a picture or, even more complex, a video?
Computer Vision5 min read
Guiding Stable Diffusion with your Images
Personalizing Text-to-Image Generation using Textual Inversion
AI Engineering5 min read
How Stable Diffusion works? Latent Diffusion Models Explained
A High-Resolution Image Synthesis Architecture: Latent Diffusion
Computer Vision5 min read
Build Animatable 3D Models with AI
Create deformable 3D models from pictures with BANMo!
Computer Vision6 min read
Produce Amazing Artworks with Text and Sketches!
"Make-A-Scene": a fantastic blend between text and sketch-conditioned image generation.
Computer Vision4 min read
How does dalle-mini work?
Dalle mini is a free, open-source AI that produces amazing images from text inputs. Here's how it works.
Computer Vision6 min read
Google Brain's Answer to Dalle-e 2: Imagen
An AI that creates photorealistic images from input text better than Dall-e 2!
Computer Vision5 min read
This is a BIG step for GANs! BlobGAN Explained
A GAN model that uses simple blobs to manipulate objects in images…
Computer Vision6 min read
Your Personal Photoshop Expert with AI!
This AI can reconstruct, enhance and edit your images!
Computer Vision7 min read
OpenAI's new model DALL·E 2 is amazing!
An amazing new model by OpenAI capable of generating and inpainting images from a text input with incredible results!
Computer Vision6 min read
NVIDIA Turns Photos into 3D Scenes in Milliseconds | Instant NeRF Explained
Instant NeRF by NVIDIA Research explained simply
Computer Vision8 min read
Combine Lidar and Cameras for 3D object detection - Waymo
Combine Lidar and regular Cameras for 3D object detection - Waymo & Google Research
Computer Vision7 min read
Impressive photo restoration by AI !
This new and completely free AI model can fix most of your old pictures in a split second!
Computer Vision8 min read
Create Realistic 3D Renderings with AI !
From a few images to a 3D model using AI!
Computer Vision9 min read
Remove Undesired Objects From Your Images With Artificial Intelligence!
Learn how this algorithm can understand images and automatically remove the undesired object or person and save your future Instagram post!
Computer Vision11 min read
Top 10 Computer Vision Papers of 2021
The top 10 computer vision papers in 2021 with video demos, articles, code, and paper reference.
AI News and Analysis33 min read
2021: A Year Full of Amazing AI papers - A Review
A curated list of the latest breakthroughs in AI by release date with a clear video explanation, link to a more in-depth article, and code.
AI News and Analysis4 min read
The AI Monthly Top 3 - December 2021
The most interesting December's AI breakthroughs with video demos, short articles, code, and paper reference.
Large Language Models6 min read
New SOTA Image Captioning: ClipCap
Easily generate text descriptions for images using CLIP and GPT models!
Computer Vision5 min read
CityNeRF: 3D Modelling at City Scale!
Generate city-scale 3D scenes with high-quality details at any scale!
AI News and Analysis5 min read
The AI Monthly Top 3 - November 2021
The most interesting November's AI breakthroughs with video demos, short articles, code, and paper reference.
Computer Vision8 min read
NVIDIA EditGAN: Image Editing with Full Control From Sketches
Control any feature from quick drafts, and it will only edit what you want keeping the rest of the image the same! SOTA Image Editing from sketches model by NVIDIA, MIT, UofT.
Computer Vision6 min read
This AI makes blurry faces look 8 times sharper! SwinIR: Photo Upsampling
Transform your small 512-pixel large images into 4k with AI!
AI News and Analysis5 min read
The AI Monthly Top 3 - October 2021
The most interesting October's AI breakthroughs with video demos, short articles, code, and paper reference.
Computer Vision8 min read
AI Synthesizes Smooth Videos from a Couple of Images!
Let's construct 3D models from a couple of photos…
AI News and Analysis5 min read
The AI Monthly Top 3 — September 2021
The 3 most interesting AI papers this month with video demos, short articles, code, and paper reference.
Generative AI6 min read
Generate Video Variations - No dataset or deep learning required!
This model can do any video manipulation or video generation application you have in mind!
Generative AI7 min read
How to Make Slow Motion Videos With AI!
TimeLens can understand the movement of the particles in-between the frames of a video to reconstruct what really happened at a speed even our eyes cannot see. In fact, it achieves results that our intelligent phones and no other models could reach before.
Computer Vision7 min read
Manipulate Real Images With Text - An AI For Creative Artists! StyleCLIP Explained
AI could generate images, then, using a lot of brainpower and trial and error, researchers could control the results following specific styles. Now, you can do that using only text!
AI News and Analysis3 min read
The AI Monthly Top 3 — August 2021
The 3 most interesting AI papers of August 2021 with video demos, short articles, code, and paper reference.
Computer Vision7 min read
Make GANs Training Easier for Everyone : Generate Images Following a Sketch
Control GANs outputs based on the simplest type of knowledge you could provide it: hand-drawn sketches.
AI Engineering7 min read
Image Synthesis and Editing from Sketches: SDEdit. No more tedious training needed!
Say goodbye to complex GAN and transformer architectures for image generation. This new method can generate new images from any user-based inputs.
AI News and Analysis3 min read
The AI Monthly Top 3 — July 2021
The 3 most interesting AI papers of July 2021 with video demos, short articles, code, and paper reference.
Computer Vision7 min read
How Apple Photos Recognizes People in Private Photos Using Machine Learning
Using multiple machine learning-based algorithms running privately on your device, Apple allows you to accurately curate and organize your images and videos on iOS 15.
Computer Vision6 min read
OpenAI's New Code Generator: GitHub Copilot (and Codex)
Find out how this AI Generates Code From Words
Computer Vision4 min read
⏩ How AI Generates New Images: GANs Put Simply
Understand how AI creates new images using Generative Adversarial Networks in 2 minutes
AI Engineering6 min read
⏩ How AI *Understand* Images in Simple Terms
AI is everywhere; understand how it works and build the most powerful applications! A simple explanation of the most popular deep neural network architecture for images: Convolutional Neural Networks. AI put simply.
Learning AI5 min read
How Machines Beat Humans at Everything
Discover how machines become super-human in most domains they attack using reinforcement learning. Video submission for the IJCAI-21 AI Video Competition (adapted)
AI Engineering8 min read
CVPR 2021 Best Paper Award: GIRAFFE - Controllable Image Generation
Using a modified GAN architecture, they can move objects in the image without affecting the background or the other objects!
AI News and Analysis5 min read
The AI Monthly Top 3 — June 2021
The 3 most interesting AI papers of June 2021 with video demos, short articles, code, and paper reference.
Computer Vision8 min read
Create Realistic Animated Looping Videos from Pictures
This model takes a picture, understands which particles are supposed to be moving, and realistically animates them in an infinite loop while conserving the rest of the picture entirely still creating amazing-looking videos like this one.
Computer Vision8 min read
Translate or Edit Text from Images Emulating the Style: TextStyleBrush
This new Facebook AI model can translate or edit every text in the image in your own language, following the same style!
Computer Vision8 min read
Barbershop: Try Different Hairstyles and Hair Colors from Pictures (GANs)
This AI can transfer your hair to see how it would look like before committing to the change.
AI News and Analysis4 min read
The AI Monthly Top 3 — May 2021
a curated list of the latest breakthroughs in AI and Data Science in May 2021 with a clear video explanation, link to a more in-depth article, and code (if applicable)
Computer Vision6 min read
High-Resolution Photorealistic Image Translation in Real-Time
Apply any style to your 4K image in real-time using this new machine learning-based approach!
AI Engineering6 min read
Is AI The Future Of Video Game Design? Enhancing Photorealism Enhancement
This AI can be applied live to the video game and transform every frame to look much more natural.
Computer Vision6 min read
Articulated 3D Reconstruction from Videos
Generate 3D models of humans or animals moving from only a short video as input.
Computer Vision6 min read
Infinite Nature: Fly into an image and explore the landscape
The next step for view synthesis: Perpetual View Generation, where the goal is to take an image to fly into it and explore the landscape!
AI News and Analysis3 min read
The AI Monthly Top 3 — April 2021
a curated list of the latest breakthroughs in AI and Data Science in April 2021 with a clear video explanation, link to a more in-depth article, and code (if applicable)
Computer Vision16 min read
What is the state of AI in computer vision?
I will openly share everything about deep nets for vision applications, their successes, and the limitations we have to address.
AI News and Analysis3 min read
The AI Monthly Top 3 — March 2021
The 3 most interesting AI papers this month, March 2021, with video demos, short articles, code, and paper reference.
Computer Vision4 min read
GrabCut NoteBook implementation for Image Matting
A fun introduction project for computer vision and python on Google Colab. iterative-grabcut: Using a simple rectangle and a brush removing the background of any image!
Computer Vision8 min read
Create 3D Models from Images! GANverse3D & NVIDIA Omniverse
This promising model called GANverse3D only needs an image to create a 3D figure that can be customized and animated!
AI Engineering7 min read
How can Transformers be used in Computer Vision?
In less than 5 minutes, you will know how the transformer architecture can be applied to computer vision with a new paper called the Swin Transformer
Computer Vision5 min read
OpenAI’s DALL·E: Text-to-Image Generation Explained
OpenAI just released the paper explaining how DALL-E works! It is called “Zero-Shot Text-to-Image Generation”.
AI News and Analysis23 min read
2020: A Year Full of Amazing AI Papers - A Review
A curated list of the latest breakthroughs in AI in 2020 by release date with a clear video explanation, link to a more in-depth article, and code
Computer Vision6 min read
Train Your GAN With 1/10th of the Data! NVIDIA ADA Explained
With this new training method developed by NVIDIA, you can train a powerful generative model with one-tenth of the images! Making possible many applications that do not have access to so many images!
Computer Vision8 min read
Remove any Background Without Green Screens
This new background removal technique can extract a person from a single input image, without the need for a green screen in real-time!
Computer Vision9 min read
State-of-the-Art Convolutional Neural Networks Explained - DenseNet
Facial recognition, targeted ads, and image recognition all have one thing in common. They are all done using the best Convolutional Neural Networks.