Penguin has moved up the publication date of my new book with Patchen Barss called "Smarter Than Us". The book explains how AI works for a non-technical reader and then talks about the myriad risks and what to do about them.
Geoffrey Hinton
Geoffrey Everest Hinton (born 6 December 1947) is a British-Canadian computer scientist, cognitive scientist, cognitive psychologist and Nobel Prize laureate known for his work on artificial neural networks, which earned him the title "the Godfather of AI". He is University Professor Emeritus at the University of Toronto. More on Wikipedia
-
Geoffrey Hinton
@geoffreyhinton
-
Geoffrey Hinton
@geoffreyhinton
The idea of an intelligence explosion caused by recursive self improvement has been around for a long time but until very recently it did not seem imminent. Now many leading researchers think it may happen quite soon. You can read our paper about it here:
casp.ac/reports/intelligence-explosion -
Geoffrey Hinton reposted
Jacob Coxon
@hilbertspaess
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.
-
Geoffrey Hinton
@geoffreyhinton
I am finishing a book with @patchenbarss that gives a non-technical explanation of how AI works and explains why it is dangerous and what we should do about it.
@VikingBooks @VikingBooksUK
www.penguinrandomhouse.com/books/835891/smarter-than-us-bโฆ -
Geoffrey Hinton
@geoffreyhinton
I just watched an amazingly good lecture by Adam Brown about the future impact of AI on physics
www.youtube.com/watch?v=Mw60FH5iflI -
Geoffrey Hinton
@geoffreyhinton
I just had my first ride with HOVR, a Canadian alternative to Uber. They are cheaper and pay their drivers more. They already have over 3000 drivers in the Greater Toronto Area. You can download HOVR in App Store and Google Play using this link ๐ท www.appurl.io/_njqzPQ57k
-
Geoffrey Hinton
@geoffreyhinton
Our lying Ontario premier has just stolen $50 from every single person in Ontario. The estimated cost of repairing our beloved Science Center was 200 million dollars. The firm that made the estimate was told to multiply it by 1.85 to make it bigger. We were then told it would be better to build a new science center. Now we learn the new center will be smaller and will cost a billon dollars before the cost overruns. The only win is that the extensive parking lots of the old Science Center will be available for his developer friends.
-
Geoffrey Hinton
@geoffreyhinton
This is a great report that provides a thoughtful, detailed and very well researched description of the risks of AI. It is essential reading for anyone who wants to write or talk about AI risks.
Yoshua Bengio
@Yoshua_Bengio
Today weโre releasing the International AI Safety Report 2026: the most comprehensive evidence-based assessment of AI capabilities, emerging risks, and safety measures to date. ๐งต
(1/17)This media couldn't be displayed. See it on the original post. -
Geoffrey Hinton
@geoffreyhinton
I just watched a really great conversation about the future of AI. Every politician should watch it before they join the lemmings saying that regulation of AI will interfere with innovation.
www.youtube.com/watch?v=rGAA59JTBtg -
Geoffrey Hinton
@geoffreyhinton
I recently talked about the old days with Jeff Dean.
Jeff Dean
@JeffDean
It was delightful to do a fireside chat with my longtime colleague @geoffreyhinton a couple of weeks ago, moderated by @JordanJacobs10. The recording of our full discussion is now on Spotify:
open.spotify.com/episode/2zM1FkXwxspjK1OlX7wMSU
Radical Ventures
@radicalvcfund
On the latest Radical Talks podcast: @GeoffreyHinton X @JeffDean - a friendship that defined modern AI as breakthrough theories met massive scale. Recorded at #neurips2025, Radical Co-Founder @JordanJacobs10 sits down with these two icons of AI to discuss one of historyโs most productive collaborations.
This media couldn't be displayed. See it on the original post. -
Geoffrey Hinton
@geoffreyhinton
Democratic politicians seem to be incapable of learning from Trump. They should never use the word "tariff". They should always say "federal sales tax". Trump went ballistic when Jeff Bezos suggested listing tariffs as if they were a sales tax. Using the word "tariff" is gross political incompetence.
-
Geoffrey Hinton reposted
Yoshua Bengio
@Yoshua_Bengio
Iโm pleased to share the Second Key Update to the International AI Safety Report, which outlines how AI developers, researchers, and policymakers are approaching technical risk management for general-purpose AI systems.
(1/5) -
Geoffrey Hinton
@geoffreyhinton
I did a podcast with Jon Stewart who has always been a hero of mine. It was a lot of fun. He really wanted to understand how AI works.
www.youtube.com/watch?v=jrK3PsD3APk -
Geoffrey Hinton
@geoffreyhinton
Some generous companies in Toronto are funding three lectures on AI safety by Owain Evans on Nov 10, 11, 12.
Tickets are $10 and are available at thehintonlectures.rsvpify.com -
Geoffrey Hinton
@geoffreyhinton
A major cut to the funding of the National Science Foundation would be very bad for the future of the US.
thehill.com/opinion/technology/5439205-congress-wants-to-โฆ -
Geoffrey Hinton
@geoffreyhinton
There is a book on Amazon called "Modern AI Revolution" by Geoffrey Hinton. This is a scam. It has nothing to do with me and I wish Amazon would remove it.
-
Geoffrey Hinton
@geoffreyhinton
Congratulations to @Yoshua_Bengio on launching @LawZero_ โ a research effort to advance safe-by-design AI, especially as frontier systems begin to exhibit signs of self-preservation and deceptive behaviour.
-
Geoffrey Hinton
@geoffreyhinton
I just watched a great compilation of various people's views about what is coming:
Scr0nkf1nkle
@Scr0nkf1nkle
The Great AI Job Displacement Is Closer Than You Think
This media couldn't be displayed. See it on the original post. -
Geoffrey Hinton
@geoffreyhinton
AGI is the most important and potentially dangerous technology of our time. OpenAI was right that this technology merits strong structures and incentives to ensure it is developed safely, and is wrong now in attempting to change these structures and incentives.
We're urging the AGs to protect the public and stop this. notforprivategain.org (2/2) -
Geoffrey Hinton
@geoffreyhinton
I like OpenAIโs mission of 'ensure that artificial general intelligence benefits all of humanityโ, and Iโd like to stop them from completely gutting it.
Iโve signed on to a new letter to @AGRobBonta & @DE_DOJ asking them to halt the restructuring. (1/2) -
Geoffrey Hinton
@geoffreyhinton
Researchgate sent me a fake paper called "The AI Health Revolution: Personalizing Care through Intelligent Case-based Reasoning" which claims to be by me and Yann LeCun. More than one third of the citations are to Shefiu Yusuf which may mean nothing.
-
Geoffrey Hinton
@geoffreyhinton
I recently got a subscription to the Atlantic. Its is a great magazine.
-
Geoffrey Hinton
@geoffreyhinton
I think Elon Musk should be expelled from the British Royal Society. Not because he peddles conspiracy theories and makes Nazi salutes, but because of the huge damage he is doing to scientific institutions in the US. Now let's see if he really believes in free speech.
-
Geoffrey Hinton
@geoffreyhinton
I was happy to add my name to this list of employees and alumni of AI companies. These signatories have better insight than almost anyone else into what is coming next with AI and we should heed their warnings.
Garrison Lovely
@GarrisonLovely
110+ employees and alums of top-5 AI companies just published an open letter supporting SB 1047, aptly called the "world's most controversial AI bill." 3-dozen+ of these are current employees of companies opposing the bill.
Check out my coverage of it in the @sfstandard ๐งต -
Geoffrey Hinton
@geoffreyhinton
Iโm excited to share that I have joined the advisory board of @cusp_ai who have today come out of stealth mode and are using cutting edge AI to tackle one of the most urgent problems we as society face: climate change.
-
Geoffrey Hinton
@geoffreyhinton
New AI safety paper in Science with a lot of authors: www.science.org/doi/10.1126/science.adn0117
-
Post not available here, view on X
Geoffrey Hinton
@geoffreyhinton
If you leave it to companies to decide what is safe you get the Boeing 737 max.
-
Geoffrey Hinton
@geoffreyhinton
There is a UK company called Profit Crunch Ltd that is fraudulent. They claim i am a director and use my reputation to reassure investors. They are crooks. I have nothing to do with them. They also forged my signature on an insurance certificate.
-
Geoffrey Hinton reposted
Vayu Robotics
@VayuRobotics
๐ฐ ๐ #vayurobotics has been named to the 2024 @CBinsights #ai 100 list in recognition of our novel tech developing AI foundation models for mobility & #robotics. We are honored to be on this list of esteemed companies. Congratulations, Team Vayu! www.vayurobotics.com/press-releases/vayu-robotics-named-tโฆ
-
Geoffrey Hinton
@geoffreyhinton
The way it attends to relevant parts of the visual input seems almost human, though its attending in parallel as well as sequentially.
Nitish Srivastava
@nitishsr
Interpreting end-to-end trainable autonomy models is crucial for fostering trust and ensuring safety. The use of transformers in Vayu's autonomy model allows us to interpret the model's thought process through attention maps. www.vayurobotics.com/blog/interpretable-end-to-end-drivinโฆ
#ai #nvidiarobotics -
Geoffrey Hinton
@geoffreyhinton
One evening this summer, my partner and I saw the Loch Ness monster swimming in Lake Huron. It was at least 10 feet long and swam in an undulating fashion with big black humps that were each several feet long and went up and down as it moved across the lake.
Post not available here, view on X
Geoffrey Hinton
@geoffreyhinton
If two boats on a similar course went by some time ago, their wakes would be small and almost parallel. Where the wakes intersect you would get an interference pattern of bigger waves alternating with smaller waves and this pattern would move sideways in an undulating fashion.
Geoffrey Hinton
@geoffreyhinton
Someone with access to two boats should be able to recreate this and make a viral video of it. The water needs to be rough enough to disguise the wakes except when they positively interfere.
-
Geoffrey Hinton
@geoffreyhinton
Yann LeCun thinks the risk of AI taking over is miniscule. This means he puts a big weight on his own opinion and a miniscule weight on the opinions of many other equally qualified experts.
Post not available here, view on X
Geoffrey Hinton
@geoffreyhinton
The central issue on which we disagree is whether LLMs actually understand what they are saying. You think they definitely don't and I think they probably do. Do you agree that this is the core of our disagreement?
-
Geoffrey Hinton
@geoffreyhinton
Fei-Fei Li has written a book. She was the first computer vision researcher to truly understand the power of big data and her work opened the floodgates for deep learning. She delivers a clear-eyed account of the awesome potential and danger of AI.
www.momentoflift.com/the-worlds-i-see -
Geoffrey Hinton
@geoffreyhinton
I suspect that Andrew Ng and Yann LeCun have missed the main reason why the big companies want regulations. Years ago the founder of a self-driving company told me that he liked safety regulations because if you satisfied them it reduced your legal liability for accidents.
-
Andrew Ng
@AndrewYNg
My greatest fear for the future of AI is if overhyped risks (such as human extinction) lets tech lobbyists get enacted stifling regulations that suppress open-source and crush innovation.
Read more in our Halloween special issue of the Batch: www.deeplearning.ai/the-batch/issue-220/
Geoffrey Hinton
@geoffreyhinton
So what is your best estimate of the probability that if AI is not strongly regulated it will lead to human extinction in the next 30 years? If you are a true Bayesian you should be able to give a number. My current estimate is 0.1. I suspect Yann's is <0.01
-
Geoffrey Hinton
@geoffreyhinton
Andrew Ng is claiming that the idea that AI could make us extinct is a big-tech conspiracy. A datapoint that does not fit this conspiracy theory is that I left Google so that I could speak freely about the existential threat.
-
Geoffrey Hinton reposted
Radical Ventures
@radicalvcfund
As underwriters of tomorrowโs innovations, venture capital needs a framework for responsible AI investing. Today Radical Ventures is pleased to share its Responsible AI for Startups (RAIS) framework - an open source resource for investors evaluating investments in AI technologies developed in partnership with @VectorInst. radical.vc/underwriting-responsible-ai-venture-capital-neโฆ
-
Geoffrey Hinton
@geoffreyhinton
New paper:
managing-ai-risks.com
Companies are planning to train models with 100x more computation than todayโs state of the art, within 18 months. No one knows how powerful they will be. And thereโs essentially no regulation on what theyโll be able to do with these models. -
Geoffrey Hinton
@geoffreyhinton
Since leaving Google, I have received many requests to join the advisory boards of start-ups and, until now, I have declined them all. However, I have decided to join as an advisor for @VayuRobotics to work with @nitishsr again. www.vayurobotics.com/press-releases/godfather-of-ai-geoffโฆ (1/3)
Geoffrey Hinton
@geoffreyhinton
@VayuRobotics is designing light, low-speed robots for local deliveries. These robots have about 1% of the kinetic energy of a 50 mph car and a much shorter stopping distance, which makes it far easier to make them safe. (2/3)
Geoffrey Hinton
@geoffreyhinton
It seems to me that @VayuRobotics is addressing a great market niche and their approach has fewer ethical problems than many other AI applications. I look forward to working with @nitishsr and his team. (3/3)
-
Geoffrey Hinton reposted
aaronbrindle
@aaronbrindle1
Oct 4th, 4pm ET: Join AI luminaries @geoffreyhinton and @drfeifei in conversation with Radical's @JordanJacobs10 on building responsible AI systems and how their careers intersected at one of modern AIโs key inflection points. Sign-up here: luma.com/hinton-li-livestream-2023
Radical Ventures
@radicalvcfund
Radical Ventures presents a conversation between @geoffreyhinton & @drfeifei. Moderated by Radical's @JordanJacobs10, you won't want to miss this opportunity to hear from two of AI's most influential figures.
Register today for exclusive access: lu.ma/hinton-li-livestream-2023
#ai -
Geoffrey Hinton
@geoffreyhinton
The University of Toronto made a video for a non technical audience in which I explain how deep learning works, the enormous promise of this technology and some of the potential risks. youtu.be/-9cW4Gcn5WY
-
Andrew Ng
@AndrewYNg
Had an insightful conversation with @geoffreyhinton about AI and catastrophic risks. Two thoughts we want to share:
(i) It's important that AI scientists reach consensus on risks-similar to climate scientists, who have rough consensus on climate change-to shape good policy.
(ii) Do AI models understand the world? We think they do. If we list out and develop a shared view on key technical questions like this, it will help move us toward consensus on risks.
I learned a lot speaking with Geoff. Letโs all of us in AI keep having conversations to learn from each other!This media couldn't be displayed. See it on the original post.
Geoffrey Hinton
@geoffreyhinton
I used to talk to Andrew a lot and it was great to catch up again and get his take on the various risks posed by recent developments in AI. We agreed on a lot of things, especially on the need for the researchers to arrive at a consensus view of the risks to inform policy makers.
-
Geoffrey Hinton
@geoffreyhinton
Dishonest CBC headline:
"Canada's AI pioneer Geoffrey Hinton says AI could wipe out humans. In the meantime, there's money to be made".
The second sentence was said by a journalist, not me, but you wouldn't know that. -
Geoffrey Hinton
@geoffreyhinton
In the NYT today, Cade Metz implies that I left Google so that I could criticize Google. Actually, I left so that I could talk about the dangers of AI without considering how this impacts Google. Google has acted very responsibly.
-
Geoffrey Hinton reposted
Mengye Ren
@mengyer
Wondering about how to train deep neural networks without backprop? Check out our ICLR 2023 paper: arxiv.org/abs/2210.03310
Forward gradient computes gradient information from forward pass. But it is slow and noisy โ it computes the directional gradient along a random weight perturbation. Gradient variance explodes with deeper and wider networks.
Our key insight is to utilize local activity perturbation and we introduce a new architecture with many local losses throughout the network so that each loss is associated with a small number of weights.
Both supervised and self-supervised (contrastive) learning works. Much better than a lot of backprop-free methods on large scale problems.
Joint work with @geoffreyhinton @skornblith @lrjconan
Our ICLR poster will be presented on Tuesday May 2, in Kigali, Rwanda! -
Geoffrey Hinton
@geoffreyhinton
Reinforcement Learning by Human Feedback is just parenting for a supernaturally precocious child.
-
Geoffrey Hinton
@geoffreyhinton
Caterpillars extract nutrients which are then converted into butterflies. People have extracted billions of nuggets of understanding and GPT-4 is humanity's butterfly.
-
Geoffrey Hinton reposted
The Royal Society
@royalsociety
Nominations for the Royal Society's medals and awards close on Friday 24 February, celebrating outstanding contributions to science from individuals and teams. You don't have to be a Fellow of the Royal Society to nominate or be nominated, find out more: royalsociety.org/grants-schemes-awards/awards/nominations/
-
Geoffrey Hinton
@geoffreyhinton
A huge amount of practical experience has been distilled into this great guide to tuning deep learning models.
George E. Dahl
@GeorgeEDahl
We've just released the first version of our Deep Learning Tuning Playbook! This is our attempt to distill our process for actually getting good results with deep learning. We emphasize hyperparameter tuning since it has been a large pain point. github.com/google-research/tuning_playbook
-
Geoffrey Hinton
@geoffreyhinton
Renjie finally got Gaussian-Bernoulli RBMs to work well.
Renjie Liao
@lrjconan
We show that Gaussian RBMs can generate good images just like other generative models, despite the single-layer architecture. Key innovations:
1) Gibbs-Langevin sampling;
2) modified Contrastive Divergence.
Paper: arxiv.org/abs/2210.10318
Code: github.com/lrjconan/GRBM
1/2 -
Geoffrey Hinton reposted
Jordan Jacobs
@JordanJacobs10
AI is eating software. Iโve said this for a while. Why? Traditional software never improves. AI enables โsmartโ software to learn & improve constantly. The world runs on software and AI is changing everything. Yet few people see or understand the massive AI wave on the horizon.
-
Geoffrey Hinton reposted
Yao Qin
@YaoQin_UCSB
Super excited to announce that I will join the ECE department at UCSB @ucsantabarbara as an assistant professor in January, 2023! After three amazing years at @googIeresearch in New York, I will move back to California! Actively looking for students and please get in touch๐!
-
Geoffrey Hinton
@geoffreyhinton
Does HSBC UK have any ML people? HSBC will not comply with my written instructions to transfer money within the UK. Fraud detection says it must be authorized by high value transfers. High value transfers say they cannot authorize it. 7 hours on the phone so far. Help!
Geoffrey Hinton
@geoffreyhinton
I tried HSBC chat. Here's what they said:
Iโll transfer you to an agent now. It could take up to 6 hours to get connected because our agents are helping other customers like you. Please feel free to log out of Online Banking, and check back later for our response. Thank you. -
Geoffrey Hinton
@geoffreyhinton
Equivariance rules!
Andrea Tagliasacchi
@taiyasaki
๐ข๐ข๐ข Introducing ๐๐๐ฎ๐ซ๐๐ฅ ๐๐๐ฌ๐๐ซ๐ข๐ฉ๐ญ๐จ๐ซ ๐ ๐ข๐๐ฅ๐๐ฌ (๐๐๐ )
That's right, we ๐ญ๐๐๐๐ก ๐ ๐ซ๐จ๐๐จ๐ญ to manipulate unseen objects, and unseen poses from ๐ฃ๐ฎ๐ฌ๐ญ ๐๐ ๐๐ฑ๐๐ฆ๐ฉ๐ฅ๐๐ฌ ๐คฏ
Wanna know more? See this threadThis post is unavailable. See it on X. -
Geoffrey Hinton reposted
U of T Department of Computer Science
@UofTCompSci
Join us at @UofTCompSci! We are now hiring for tenure-stream faculty positions in multiple areas.
We will start reviewing applications on December 6, and we will give full consideration to all applications submitted by January 10.
Get the details: uoft.me/7jH -
Geoffrey Hinton reposted
Andrea Tagliasacchi
@taiyasaki
๐ข๐ข๐ข Have you ever wondered what "capsules" are in deep learning? For primary capsules, it is actually very very simple, and explained excellently by Weiwei in his upcoming talk at #neurips21, linked below:
youtu.be/tUQJV2W7Z8g
canonical-capsules.github.io
Thread ๐งตโฌ๏ธ -
Geoffrey Hinton
@geoffreyhinton
Canadian politicians are talking about setting up a Canadian DARPA. Tying precious research dollars to military applications is not an efficient way to innovate and will lead to obscenities like the self-healing minefield. Encourage start-ups, not the military industrial complex.
-
Geoffrey Hinton
@geoffreyhinton
A common argument against taking inspiration from the brain when designing neural networks is that it's like taking inspiration from feathers when designing flying machines. Drones need blades that will not damage things they hit and can be easily repaired with a quick preen.
-
Geoffrey Hinton
@geoffreyhinton
Canada prides itself on being a more caring society than the US and is publicly apologetic about its past abuses. So why is it ignoring current torture in its prisons? ottawacitizen.com/opinion/doob-and-sprott-trudeau-should-โฆ
-
Geoffrey Hinton
@geoffreyhinton
I am excited to support @raquelutrasun as she begins her next chapter with @waabi_ai. She has been an AI pioneer for the last 20 years and will bring new thinking to an incredibly important space.
-
Geoffrey Hinton reposted
MIT CSAIL
@MIT_CSAIL
Describe coding in exactly six words.
Weโll RT all the best ones.
From the folks @StackOverflow:
Build. Deploy. Test. Debug. Debug. Debug.
#codingin6words #thursdaythoughts -
Geoffrey Hinton
@geoffreyhinton
I have a new paper on how to represent part-whole hierarchies in neural networks.
arxiv.org/abs/2102.12627 -
Geoffrey Hinton
@geoffreyhinton
Finding the natural parts of an object and their intrinsic coordinate frames without supervision is a crucial step in learning to parse images into part-whole hierarchies. If we start with point clouds, we can do it!
Andrea Tagliasacchi
@taiyasaki
๐ข๐ข๐ข ๐๐ฎ๐ง ๐๐ญ ๐๐ฅ. "๐๐๐ง๐จ๐ง๐ข๐๐๐ฅ ๐๐๐ฉ๐ฌ๐ฎ๐ฅ๐๐ฌ: ๐๐ง๐ฌ๐ฎ๐ฉ๐๐ซ๐ฏ๐ข๐ฌ๐๐ ๐๐๐ฉ๐ฌ๐ฎ๐ฅ๐๐ฌ ๐ข๐ง ๐๐๐ง๐จ๐ง๐ข๐๐๐ฅ ๐๐จ๐ฌ๐"
A network design that realizes the concept of "๐ฆ๐๐ง๐ญ๐๐ฅ ๐ฉ๐ข๐๐ญ๐ฎ๐ซ๐" for unsupervised 3D deep learning.
canonical-capsules.github.io -
Geoffrey Hinton reposted
Andrea Tagliasacchi
@taiyasaki
Our new paper "๐๐ง๐ฌ๐ฎ๐ฉ๐๐ซ๐ฏ๐ข๐ฌ๐๐ ๐ฉ๐๐ซ๐ญ ๐ซ๐๐ฉ๐ซ๐๐ฌ๐๐ง๐ญ๐๐ญ๐ข๐จ๐ง ๐๐ฒ ๐ ๐ฅ๐จ๐ฐ ๐๐๐ฉ๐ฌ๐ฎ๐ฅ๐๐ฌ" is out arxiv.org/abs/2011.13920
TL;DR: are newborns exposed to 14 million (i.e. ImageNet) labeled images? No! They learn by observing motion... in an unsupervised fashion -
Geoffrey Hinton reposted
Alberto Paccanaro
@A_Paccanaro
Read my latest #research on #machinelearning applied to #drugsideeffectsprediction, published with @SpringerNature in @NatureComms together with my brilliant PhD student @diegogaleano05 and
@shantaolee and @MarkGerstein
www.nature.com/articles/s41467-020-18305-y -
Geoffrey Hinton
@geoffreyhinton
My wonderful former graduate student, Roland Memisevic, used neural networks to make a great fitness app:
www.cnbc.com/2020/08/20/twentybn-ally-microsoft-apple-amaโฆ -
Geoffrey Hinton reposted
Andrea Tagliasacchi
@taiyasaki
Source code and full talk for ๐ก๐๐ฆ๐: ๐ก๐ฒ๐๐ฟ๐ฎ๐น ๐๐ฟ๐๐ถ๐ฐ๐๐น๐ฎ๐๐ฒ๐ฑ ๐ฆ๐ต๐ฎ๐ฝ๐ฒ ๐๐ฝ๐ฝ๐ฟ๐ผ๐ ๐ถ๐บ๐ฎ๐๐ถ๐ผ๐ป is now available โย links ๐๐
Talk @ #eccv2020 โ youtu.be/-6e_46VuH8U
Project page โ nasa-eccv20.github.io
Source code โ github.com/tensorflow/graphics/tree/master/tensorflow_graโฆ -
Geoffrey Hinton reposted
Andrea Tagliasacchi
@taiyasaki
Do you like implicit functions to model 3D geometry?
We show that "Neural Articulated Shape Approximation" improves the approximation power by over 50% ABSOLUTE!!
Fast-forward of our #eccv paper, full talk, additional material, and code comings soon.
arxiv.org/abs/1912.03207 -
Geoffrey Hinton
@geoffreyhinton
A non-linearity that works much better than ReLUs. The work described in this video might also be relevant to understanding grid cells.
www.youtube.com/watch?v=Q2fLWGBeaiI -
Geoffrey Hinton
@geoffreyhinton
I thought I had a very good idea about perceptual learning and accepted several invitations to give talks about it next week. But I have just discovered a fatal flaw in the idea, so I am cancelling all those talks. I apologize.
-
Geoffrey Hinton
@geoffreyhinton
Extrapolating the spectacular performance of GPT3 into the future suggests that the answer to life, the universe and everything is just 4.398 trillion parameters.
-
Geoffrey Hinton
@geoffreyhinton
My friend @Jordanjacobs10 of @RadicalVCFund asked what I thought of the @covariantAI team and technology. I told him I had made a rather small investment (I don't want to reinforce reinforcement learning) but now wished I had invested 100X more. So Radical did (and then some).
-
Geoffrey Hinton reposted
Andrea Tagliasacchi
@taiyasaki
Do you need differentiable convex hulls? Take a look at our CvxNet work arxiv.org/abs/1909.05736
-
Geoffrey Hinton
@geoffreyhinton
This is a really neat way of using neural networks to get rid of polygonal meshes. The interaction of computer graphics with neural networks is really exciting.
Andrea Tagliasacchi
@taiyasaki
NASA: Neural Articulated Shape Approximation
Representing characters and deformable shapes without polygonal meshes for 3D perception, games, ...
arxiv.org/pdf/1912.03207.pdf -
Geoffrey Hinton reposted
Andrea Tagliasacchi
@taiyasaki
NASA: Neural Articulated Shape Approximation
Representing characters and deformable shapes without polygonal meshes for 3D perception, games, ...
arxiv.org/pdf/1912.03207.pdf -
Geoffrey Hinton
@geoffreyhinton
The sequence modeling group at the Toronto lab of Google Research has some really impressive new work on generating the words in a sequence in parallel. Imputers rock!
Mohammad Norouzi
@mo_norouzi
If you're interested in parallel generation of output sequences in machine translation and speech recognition, check out our new work on "Imputer", achieving 28 BELU on WMT'16 En>De just in 4 generation steps.
translation: arxiv.org/abs/2004.07437
speech: arxiv.org/abs/2002.08926 -
Geoffrey Hinton
@geoffreyhinton
This is really nice work
Azalia Mirhoseini
@Azaliamirh
So excited to share our work on RL for Chip Placement, which enables chip optimization in < 6 hrs, whereas baselines require manual efforts and can take weeks. Joint work with my co-TL @annadgoldie, @JeffDean (cont.)
Paper: arxiv.org/abs/2004.10746
Blog: ai.googleblog.com/2020/04/chip-design-with-deep-reinforceโฆ -
Geoffrey Hinton
@geoffreyhinton
Shooting someone on Fifth Avenue and getting away with it seems like a minor indiscretion compared with killing thousands of New Yorkers by refusing to order the manufacture of ventilators.
-
Geoffrey Hinton
@geoffreyhinton
I have one N95 mask. After using, I put it in a plastic bag, wash my hands and bake at 170F for 2 hours. My guess is that a half-baked mask is better than none. I would love to know whether baking at 170F reliably kills COVID-19 and whether it degrades the filtering by the mask.
Geoffrey Hinton
@geoffreyhinton
I was not far off!
Data from @StanfordEng Professors @yicuistanford
& Steven Chu show #n95masks can be decontaminated without decreasing filtration efficiency using 70C heat for 30 min. Alcohol & bleach should not be used. -
Geoffrey Hinton reposted
Dr. Amy Price
@AmyPricePhD
Data from @StanfordEng Professors
@yicuistanford & Steven Chu show #n95masks can be decontaminated without decreasing filtration efficiency using 70C heat for 30 min. Alcohol & bleach should not be used. @hmkyale @DermHAG @mike_mitt aim.stanford.edu/covid-19-evidence-service/ -
Geoffrey Hinton
@geoffreyhinton
Students at U. Toronto have a websiteย flatten.caย
for people in theย Greater Toronto Area to report symptoms of COVID-19. The reported numbers of likely positive cases and vulnerable individuals are displayed for each region defined by the first half of the postcode. -
Geoffrey Hinton reposted
Ting Chen
@tingchenai
Happy to share that we've open-sourced both the code and pretrained models for SimCLR (a simple framework for contrastive learning of visual representations): github.com/google-research/simclr
joint work with @skornblith, @mo_norouzi and @geoffreyhinton. -
Geoffrey Hinton
@geoffreyhinton
Organizers of data science and machine learning conferences (NeurIPS, ICML, AISTATS, ICLR, UAI, ...): Allow remote paper & poster presentations at conferences - Sign the Petition! www.change.org/p/organizers-of-data-science-and-machine-lโฆ via @Change
-
Geoffrey Hinton
@geoffreyhinton
Suppose you have cancer and you have to choose between a black box AI surgeon that cannot explain how it works but has a 90% cure rate and a human surgeon with an 80% cure rate. Do you want the AI surgeon to be illegal?
-
Geoffrey Hinton
@geoffreyhinton
Unsupervised learning of representations is beginning to work quite well without requiring reconstruction.
Ting Chen
@tingchenai
Introducing SimCLR: a Simple framework for Contrastive Learning of Representations. SimCLR advances previous SOTA in self-supervised and semi-supervised learning on ImageNet by 7-10% (see next).
arxiv.org/abs/2002.05709
Joint work with @skornblith @mo_norouzi @geoffreyhinton. -
Geoffrey Hinton reposted
Adam R. Kosiorek
@arkosiorek
We've just open-sourced the code for Stacked Capsule Autoencoders (NeurIPS '19): github.com/google-research/google-research/tree/master/stโฆ
joint work with @sabour_sara, @yeewhye and @geoffreyhinton -
Geoffrey Hinton
@geoffreyhinton
This is a much better version of capsules.
Adam R. Kosiorek
@arkosiorek
We recently developed a new, unsupervised version of capsule networks (with @sabour_sara, @yeewhye, and @geoffreyhinton). I hope that my new blog will make it easier to understand some ideas that led to this work. Enjoy!
akosiorek.github.io/ml/2019/06/23/stacked_capsule_autoencโฆ -
Geoffrey Hinton reposted
Yann LeCun
@ylecun
This report on Trump's concentration camps for migrant children is absolutely horrifying.
Conditions are unsanitary and unsafe.
Children, toddlers, infants are dying of purposeful neglect.
This is a... www.nytimes.com/2019/06/21/us/migrant-children-border-soaโฆ -
Geoffrey Hinton
@geoffreyhinton
Inman is always thought-provoking.
Walter de Back ๐จ๐ปโ๐ป
@wdeback
Great to see Inman Harvey mentioned here. I encourage all to (re)read his though-provoking essay "Robotics: Philosophy of Mind using a Screwdriver". Pages 11-32 in: dspace.library.uu.nl/bitstream/handle/1874/27687/preprintโฆ
-
Geoffrey Hinton
@geoffreyhinton
The X factor: When I was an undergrad at Kings College Cambridge, Les Valiant who won the Turing award in 2010 lived in the adjacent room on X staircase. He just told me that Turing lived on X staircase when he was a fellow at Kings and probably wrote his 1936 paper there!
-
Post not available here, view on X
Geoffrey Hinton
@geoffreyhinton
Thanks to my graduate students and postdocs whose work won a Turing award. Thanks to my visionary mentors Inman Harvey, David Rumelhart and Terry Sejnowski. And thanks to Jeff Dean for creating the brain team that turns basic research in neural nets into game-changing products.
-
Geoffrey Hinton
@geoffreyhinton
Some new work from the brain team in Toronto @rishabh_467 @Mo_Norouzi
Google AI
@GoogleAI
Applying reinforcement learning to environments with sparse and underspecified rewards is an ongoing challenge, requiring generalization from limited feedback. See how we address this with a novel method that provides more refined feedback to the agent. blog.research.google/2019/02/learning-to-generalize-from-โฆ
-
Geoffrey Hinton reposted
Vector Institute
@VectorInst
Vector Institute is offering scholarships to top candidates applying to AI Masterโs Programs. Learn more vectorinstitute.ai/aimasters/
-
Geoffrey Hinton
@geoffreyhinton
My Coursera MOOC "Neural Networks for Machine Learning" was prepared in 2012 and is now seriously out of date so I have asked them to discontinue the course. But the lectures are still a good introduction to many of the basic ideas and are available at www.cs.toronto.edu/~hinton/coursera_lectures.html
-
Geoffrey Hinton
@geoffreyhinton
The Google Brain team in Toronto has openings for several research scientists who have already made exceptional contributions to research on deep learning or its applications in NLP, vision, or reinforcement learning. To apply, go to
careers.google.com/jobs/results/6264190289117184
















