So uh we can't keep ATC online but we can launch giant rockets?
Mike Schroepfer
Mike Schroepfer (born February 1, 1975) is an entrepreneur, technical architect, climate investor, and philanthropist who was the chief technology officer (CTO) at Meta Platforms between March 2013 and March 2022. In 2022 he transitioned to become Senior Fellow at Meta to focus on investing and philanthropic work related to addressing the climate crisis. Schroepfer's current focus is investing in tech and science to fight climate change through his venture capital firm Gigascale Capital, philanthropic entity Additional Ventures, and as board chair of the Carbon to Sea Initiative. More on Wikipedia
-
Mike Schroepfer
@schrep
-
Mike Schroepfer reposted
Andrew Davison
@AjdDavison
This is a really good interview about Fractile and a clear vision of accelerating AI inference via more memory bandwidth. I met Walter at ICRA 2022 when he was presenting some of the final work in his PhD in robotics! The insights from Sir Robin Saxby who was the founding CEO of ARM are fascinating too... a very different British company from a very different time, but astoundingly successful in achieving his vision of becoming a global standard.
Finn Murphy
@FinnMurphy12
Walter Goodwin believes the world's most capable AI models are held back from delivering on their potential by the chips of today. Yesterday his company, Fractile, announced a $720M Series C to fix that.
Walter, an Oxford PhD, founded Fractile in summer 2022, on a bet that there would be a huge dividend to speed in running AI models. The round is led by Thrive Capital, Founders Fund, Lightspeed and Redpoint, and comes six months after Fractile's $220M Series B.
We sat down in London to discuss the future of semiconductors alongside Sir Robin Saxby, the founding CEO of ARM, who started one of the largest companies ever to come out of the UK with 12 engineers in a pub.
Congratulations to @goodwin_ml and the @fractile_ai team. Enjoy this one!
TIMESTAMPS
0:00 Intro
1:24 Starting Fractile
6:01 Inference Is the Profit Center
9:39 Chips Over My Dead Body: The Founding of ARM
18:45 The Art of the Opinionated Chip
25:09 Breaking the Memory Wall
32:15 How ARM Picked Winners
38:23 Robin Calls a Correction
42:51 The Stickiness of the Transformer
46:49 Is There a Limit to AI Demand?
56:11 How TSMC Became the Standard
57:44 AI-Designed Chips
1:03:52 Brutal HonestyThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Finn Murphy
@FinnMurphy12
Walter Goodwin believes the world's most capable AI models are held back from delivering on their potential by the chips of today. Yesterday his company, Fractile, announced a $720M Series C to fix that.
Walter, an Oxford PhD, founded Fractile in summer 2022, on a bet that there would be a huge dividend to speed in running AI models. The round is led by Thrive Capital, Founders Fund, Lightspeed and Redpoint, and comes six months after Fractile's $220M Series B.
We sat down in London to discuss the future of semiconductors alongside Sir Robin Saxby, the founding CEO of ARM, who started one of the largest companies ever to come out of the UK with 12 engineers in a pub.
Congratulations to @goodwin_ml and the @fractile_ai team. Enjoy this one!
TIMESTAMPS
0:00 Intro
1:24 Starting Fractile
6:01 Inference Is the Profit Center
9:39 Chips Over My Dead Body: The Founding of ARM
18:45 The Art of the Opinionated Chip
25:09 Breaking the Memory Wall
32:15 How ARM Picked Winners
38:23 Robin Calls a Correction
42:51 The Stickiness of the Transformer
46:49 Is There a Limit to AI Demand?
56:11 How TSMC Became the Standard
57:44 AI-Designed Chips
1:03:52 Brutal HonestyThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Drew Baglino
@baglino
@SheldonKimber thank you and the entire Intersect team for the close collaboration and commitment to bring a next generation utility scale solar inverter to market with @heronpower!
Heron Power Electronics
@heronpower
We couldn’t be more excited to announce that our first lighthouse partner, Intersect, has reserved 1.5 GW of Heron Link manufacturing capacity for solar.
This has been many months in the making. Intersect worked closely with our technical and commercial teams to ensure Heron Link meets the needs of large-scale energy developers.
Thank you, Intersect, for leaning in with Heron as we bring a step change in power conversion to our industry. We can't wait for the day we tour an operating project powered by Heron together.
For more, see our release: heronpower.com/news-stories/intersect-reserves-1-5-gw-of-… -
Mike Schroepfer
@schrep
In a data center, chips are the biggest power draw. Inside one, it's moving data to/from memory.
@fractile_ai stacks DRAM on top of logic. A direct shot at the memory bottleneck + energy efficient chips.
Gigascale is back in for the $720M Series C. Congrats @goodwin_ml!
They’re hiring: fractile.com/jobsFractile @fractile_ai
We’re delighted to announce that Fractile has raised $720M in a Series C led by @thrivecapital @foundersfund @lightspeedvp and @redpoint, with further participation by brilliant new and existing investors.
-
Mike Schroepfer
@schrep
Building power at internet scale and speed!
Drew Baglino
@baglino
We've been marking major milestones at @heronpower the past few weeks, from completing our first two prototype Heron Links to pushing power at 34.5kVAC in our backyard test facility in Scotts Valley. Come join the fun, we're hiring!
-
Mike Schroepfer
@schrep
Hyundai Ioniq 5 Waymo spotted testing in Palo Alto!
-
Mike Schroepfer
@schrep
No renders just turbo machinery
ian
@IanRountree
Lots of $$ going into turbine startups and more renders to go with them.
Meanwhile Arbor (@ArborEnergyCo) is testing their 1MW sCO2 system and scaling up to 25MW in 2027. Apply if you want to build time-to-power with a bunch of former SpaceX and GE engineers. -
Mike Schroepfer
@schrep
Keep finding obvious alpha in applying 27 years of lessons building internet infra to building out our power grid. Continuous monitoring, buffering, software defined networking. All coming to your power grid.
Mike Schroepfer
@schrep
Today its continuous monitoring - fund to do this one with you @adityaag
www.axios.com/2026/11/05/nyquis-seed-grid-monitoring -
Mike Schroepfer reposted
Alicia Harmon @Alicia_AERC
Sunday thoughts reading this piece, nursing a candy hangover:
“When I interview machinists and engineers who work on the factory floor, the word “muscle memory” comes up a lot. It might be the angle used to hold a tool, the timing of an operation or an adjustment for a particular machine. This is the tacit knowledge that physical AI needs to collect. And it won't be collected through data farms like robotics data.”
In the recent Field Trips episode with @schrep there’s a back-and-forth about how important the senior experience on our team is, and how there is just something in the gut simulations can’t capture. And the relationships we have with suppliers / ‘guys who know a guy’ is another point that comes up a few times.
It’s an exciting time to be thinking about building new machines and the manufacturing capability behind them. But it does strike me that the special use cases are ones with a human in the loop, technology or systems that make expertise exponential. The automation/replacement plays feel a longgggg way off. But I digress…
What is cooler IMHO is seeing the way the ecosystem is rippling outward in the wake of the hardware renaissance in SoCal, making the human reality of what makes Shenzhen’s manufacturing capability so robust. We can have the advanced technology and the vertical integration and learning acceleration AND an edge that stems from deep human relationships and a respect for every partner in the process.
Link to Field Trips Video
youtu.be/yB9-hbGGBdk
Michelle Sun
@michellelsun
-
Mike Schroepfer
@schrep
if you cold email me please don't say "I'd love to pick your brain"
-
Mike Schroepfer reposted
Rhoda AI
@RhodaAI
Robots rarely fail on the clean runs. They fail on the edge cases.
On Field Trips, @schrep and @gigascale watched our robot hit one live on camera and work through it on its own, with no human stepping in.
That's what out DVA model is built for.
🎥 youtu.be/VnzfHhovGDkThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Radiant
@RadiantNuclear
Radiant has secured U.S. Department of Energy (@ENERGY) approval of its Documented Safety Analysis for Kaleidos, making it the only microreactor to be reviewed and approved by the DOE for full power operations.
The approval is not just for criticality, but for Radiant’s full power, full temperature testing at the Idaho National Laboratory. Radiant will test the complete reactor system using the same design it will manufacture at scale.
Next up in the path to commercialization: Readiness Review.
Read more here 🔗 www.radiantnuclear.com/news/radiant-secure-doe-approval-f… -
Mike Schroepfer
@schrep
Touring factories & labs is one of my favorite parts of this job. I could spend all day asking questions.
This time we brought cameras.
Field Trips starts with @RhodaAI, @ArborEnergyCo & @harbingermotors:
www.youtube.com/@watchfieldtripsThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
Service expansion for @Waymo very exciting. Can you please make it all the way to Santa Cruz for me?
waymo.com/blog/shorts/more-places/ -
Mike Schroepfer
@schrep
Latest Field Trips episode being recorded today at @CFS_energy.
What questions do you have about commercial fusion power? -
Mike Schroepfer reposted
dj patil
@dpatil
I've got a new mission. Joining forces with @kevinweil, @manohar_paluri & Sol Reisberg. Our mission is to help the world discover new medicines faster—and build the capacity to do it here in America.
This one is super personal to me. I've sat with patients and families confronting diseases. I've met people with rare diseases who have spent years searching for treatments. I've spent time with cancer patients who have exhausted every available option.
Those conversations change how you think about science, technology, and time.
When you're sitting across from someone who is waiting for a medicine that doesn't exist yet, the pace of scientific progress stops being an abstract question.
It becomes deeply personal. This needed to change for a long time. We're here to help. 🇺🇸
Kevin Weil 🇺🇸
@kevinweil
💥 Introducing Warp Sciences, a new company applying AI and robotics to help the world develop new medicines faster.
We’ve raised a $215M Series A led by @lightspeedvp to bring frontier AI out of the browser and into the lab, and build scientific capacity here in America.
I co-founded Warp with my long-time friend @dpatil, FAIR co-founder @manohar_paluri, and drug hunter Sol Reisberg. The early team is full of incredible people like @bkspears9, who helped achieve Q>1 fusion at LLNL. -
Mike Schroepfer
@schrep
So excited to back this incredible team!
Kevin Weil 🇺🇸
@kevinweil
💥 Introducing Warp Sciences, a new company applying AI and robotics to help the world develop new medicines faster.
We’ve raised a $215M Series A led by @lightspeedvp to bring frontier AI out of the browser and into the lab, and build scientific capacity here in America.
I co-founded Warp with my long-time friend @dpatil, FAIR co-founder @manohar_paluri, and drug hunter Sol Reisberg. The early team is full of incredible people like @bkspears9, who helped achieve Q>1 fusion at LLNL. -
Mike Schroepfer reposted
Drew Baglino
@baglino
We are proud to lean into native 800VDC datacenters with @VantageDC. The first of many GWs to come.
Heron Power Electronics
@heronpower
.@VantageDC just reserved over 1 GW of manufacturing capacity for Heron Link, bringing the adoption of 800 VDC power architecture for next-generation AI data centers a step closer.
The @nvidia 800 VDC architecture calls for converting medium-voltage grid power directly to 800 VDC. Heron Link does just that, integrating power conversion, protection, and distribution into a single cabinet.
Our agreement with @VantageDC creates a path to bring this architecture to hyperscale data center campuses.
Read more: heronpower.com/news-stories/vantage-and-heron-power-elect… -
Mike Schroepfer
@schrep
The people with the most experience running reactors choosing @RadiantNuclear. Something to be said about that...
Radiant
@RadiantNuclear
The @USNavy has selected Radiant to deploy our Kaleidos microreactor at Naval Weapons Station Crane, Indiana.
With this selection, Radiant is now the only nuclear microreactor company with partnerships across the Army, Navy and Air Force.
The Navy has more than 70 years of safe reactor operations. It wrote the playbook on reactor safety. Earning its confidence is powerful independent validation of Kaleidos.
This milestone moves us closer to our goal: reliable, resilient nuclear power wherever the mission demands. Through our work with all three branches, we’re building a clear path from military deployment to nuclear energy at scale for government and commercial customers.
Read more details here: www.radiantnuclear.com/news/navy-selects-radiant -
Mike Schroepfer reposted
Radiant
@RadiantNuclear
The @USNavy has selected Radiant to deploy our Kaleidos microreactor at Naval Weapons Station Crane, Indiana.
With this selection, Radiant is now the only nuclear microreactor company with partnerships across the Army, Navy and Air Force.
The Navy has more than 70 years of safe reactor operations. It wrote the playbook on reactor safety. Earning its confidence is powerful independent validation of Kaleidos.
This milestone moves us closer to our goal: reliable, resilient nuclear power wherever the mission demands. Through our work with all three branches, we’re building a clear path from military deployment to nuclear energy at scale for government and commercial customers.
Read more details here: www.radiantnuclear.com/news/navy-selects-radiant -
Mike Schroepfer reposted
Sawyer Merritt
@SawyerMerritt
United Airlines has just introduced an awesome new @Starlink Wi-Fi tracker that not only makes it easy to find out if your flight has Starlink, but also gives real-time Starlink installation progress for their fleet.
United has now installed Starlink on 43% of its fleet, with 639 aircraft now equipped. It even breaks down what percent of flights from each hub have Starlink, as well as installation progress by aircraft type. Really cool!
Tracker: starlinktracker.united.com/program/starlinkThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Hooman
@hoomanrenezhad
We raised $80M to build the future of rare earth metalmaking. Samarium, for example, is vital to America's defense. We are the only active American producer.
We’re hiring staff mechanical engineers, fabricators, recruiters, etc. Join us. DMs open. -
Mike Schroepfer
@schrep
This is rad!
Rhoda AI
@RhodaAI
What can a robot do without vision?
We gave our robot a sense of touch and showed it can recognize and retrieve objects with its cameras blindfolded.
Introducing Rhoda’s new tactile sensor—it feels pressure, texture, vibration, slip, and temperature, just like your fingertips.This media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
The portal was one of the most loved products we built
-
Mike Schroepfer
@schrep
Next Field Trip episode being filmed today. Unlimited clean energy from the world’s most powerful laser.
-
Mike Schroepfer
@schrep
Which factory and founder do you want to see for next Field Trips episode?
So far we got plans for @harbinger @CFS_energy @RadiantNuclear Arbor Energy @solcoatech @RhodaAI @xcimerenergy and @Tesla semi factory
Mike Schroepfer
@schrep
oh @heronpower of course
-
Mike Schroepfer
@schrep
This is smart. Power electronics are the future.
Will Cooper
@wcooper19
Today, the @DeptofWar's Office of Strategic Capital announced a $1.5 billion conditional loan commitment to Wolfspeed to help strengthen the U.S. supply chain for silicon carbide (SiC), gallium nitride (GaN), and other wide bandgap semiconductor materials.
Combined with private capital, the proposed financing would support domestic production of critical materials and power devices with applications across defense, Super Intelligence, critical infrastructure, and other strategically important sectors.
These technologies are essential to high-performance propulsion, directed energy weapons, drones, electronic warfare systems, radars, and missile defense systems. The financing would also advance U.S. economic security as SiC and GaN are expected to play an increasingly important role in the SI revolution.
www.war.gov/News/Releases/Release/Article/4621223/departm… -
Mike Schroepfer
@schrep
People are sleeping on how big a deal @Tesla semi will be.
Chansoo Byeon
@Chansoo
A million-mile trucker who called the Tesla Semi "stupid" just drove one fully loaded.
His verdict: "This industry is going to be changed."
He lost 1 mph up a 7% grade, he's straight about the charging trade-off, and then he ran the fleet math: "Why would I buy a diesel truck again?"
🎥 via @MotorTrend ft. @adamlwingfield of @FreightWaves
0:00 "This industry is going to be changed"
0:29 "Feels like transportation innovation"
0:49 Instant torque vs a 6th-gear diesel
1:16 Fully loaded up a 7% grade: 35 → 34 mph
2:17 Charging & range: the honest trade-off
2:57 No DEF, no DPF, $50K a year in diesel saved
3:31 Critic to convert: "I was wrong"This media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Eric Topol
@EricTopol
$1.8 billion committed for predictive models of AI biology
@biohub @GoogleDeepMind, @ENERGY , @NIH, @Meta @IsomorphicLabs all came together
www.reuters.com/business/healthcare-pharmaceuticals/us-go… -
Mike Schroepfer
@schrep
This is rad
Tesla Energy
@teslaenergy
Powershare Home Backup is now available for new Model 3 & Model Y with Powerwall 3
Extend your home backup by over 2 days with your vehicleThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
Hard agree - sfo + @united are now GOAT domestic travel pair
Yash Bhardwaj
@ybhrdwj
sfo has cracked the peak airport ux:
- under 5mins security
- no need to take laptop out
- no password 600mbps wifi
- curbside ubers, no walking far
actual stuff thats impactful, none of the performative fountain/greenery changi airport nonsense -
Mike Schroepfer
@schrep
Ok this is a 60s version even better!!
-
Mike Schroepfer
@schrep
Understanding and belief are in short supply.
But - they are renewable resources.
I meet hardworking people everyday building an amazing future.
Sharing their stories with the world is gonna help more folks understand and believe.
Soon! I can't wait. -
Mike Schroepfer
@schrep
Did a screening of the first three episodes of Field Trips where we tour the deeptech factories last night.
Youngest audience member was 3.
Obvi paying attn as he talked about something that happened 30 mins in.
You *can* teach complex technical topics to anyone who is curious. -
Mike Schroepfer
@schrep
Working with Opus 5.5 making explainer videos on a flight with Starlink is just bonkers.
Here's a video explaining how Arbor Energy uses Oxycombustion and sC02 to make turbine that is ~10x smaller and can be emission free.This media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
Fission. Fusion. Rare earths made cleanly in the US. Robots. Electric trucks.
The hardest problems don't show up on a slide deck. You find them on the factory floor, so I went and brought cameras.
Field Trips Season 1 trailer 👇 First 3 episodes with @RhodaAI, Arbor, @HarbingerMotors premiere Thursday 10/8. Thanks to @jagdeep, Andres Garcia-Clark and @JohnHenryHarris for having me.This media couldn't be displayed. See it on the original post.
Mike Schroepfer
@schrep
We are doing a screening tonight in SF for the first three episodes - DM me if you want one of the last seats.
-
Mike Schroepfer reposted
Brian Sozzi
@BrianSozzi
For the better part of a year, Meta founder Mark Zuckerberg has been in what techies call founder mode.
And for Zuck, there is much more to being in founder mode than showing up at product demos in comfy clothing as if he's pulling office all-nighters like fellow billionaire Elon Musk.
Founder mode, at its core, is being freakishly locked into executing on a long-term vision literally every second of the day. It's a true obsession with the work at hand.
Provided you're a founder with money — such as Zuck — one component of this mode is being ruthless about hiring the people you need for battle. Money is no object. Where that person currently works is irrelevant. If they fit the job description and can put wins on the board, that's all that matters.
Out comes the checkbook and powers of persuasion.
Weekend🔥take: finance.yahoo.com/technology/article/the-simple-reason-me…
(V/@YahooFinance) -
Mike Schroepfer reposted
sarah guo
@saranormous
Really fun @NoPriorsPod with @goodwin_ml founder of @fractile_ai
topics:
- how to win the ai chip market, structurally
- ai for chip design, what’s compressible
- the need to be a frontier lab to serve frontier labs
- solving memory bandwidth
- new hardware scaling lawsThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
Give me three parking spaces and I’ll power your building for 5 years.
Amazing to see @RadiantNuclear’s reactor at @INL with @DougBernauer!
Will be first reactor to power on here in 32 years! -
Mike Schroepfer
@schrep
Biggest bottleneck in AI Infra buildout?
-
Mike Schroepfer reposted
Yahoo Finance
@YahooFinance
🗣️ @schrep says the real debate right now is whether chips or energy is the bigger bottleneck to AI progress, and his money's on energy.
The former Meta CTO is backing ocean-based data centers and compact nuclear reactors to solve it, while still investing in chips too.This media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
On my way INL Demonstration of Microreactor Experiments (DOME) test bed to see the @RadiantNuclear kaleidos reactor. what do you want to know?
-
Mike Schroepfer
@schrep
Worst part of moving from operator to investor is saying no. I remember every no I got 26 years ago (including one investor falling asleep during my pitch!). It kills me to say no and I really actually mean it when I say I want you to crush it. Im guilty of doing pro bono work for plenty of folks we didn’t invest in. I wish I could invest in much more!!!!
-
Mike Schroepfer reposted
Yahoo Finance
@YahooFinance
What's it like to work with Mark Zuckerberg?
"He's an amazing human," but you will get a 30-page email on a Sunday night, Meta's Former CTO Mike Schroepfer says. 📧 😂This media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Brian Sozzi
@BrianSozzi
Wild to hear @schrep is investing in data centers in the ocean. Makes sense:
(V/Power Players With Brian Sozzi podcast @YahooFinance)This media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
This is very cool
Tesla Semi
@tesla_semi
Semi is here
Today, we're launching high volume productionThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
TBPN
@tbpn
Today, China dominates rare-earth mining and processing.
But that wasn’t always the case.
Solcoa’s @hoomanrenezhad explains how the West lost its rare-earth mojo:
"So contrary to popular belief, we do mine in the West. We have an enormous rare earth mine in Australia. There’s one in California."
“The actual raw feedstock is not rare."
“The bottleneck is what you do after it. It’s the processing. That is something that we’re completely unable to do in the West."
“We actually invented these processes in America."
"The technologies used to make rare earths in China today are American technologies from the Manhattan Project.”
“We built this technology and these systems, and then we shipped it to China. China dominated. They matured it. They took over.”
Now his company is trying to bring that capability back to the U.S. with a process built for today’s economics.
“If we were just copying that same technology stack again, it was impossible. The economics don’t close.”This media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
Said this before muse launched so now yall can believe me @finkd is in founder mode - never bet against him: finance.yahoo.com/technology/article/metas-mark-zuckerber…
-
Mike Schroepfer reposted
Hooman
@hoomanrenezhad
We must make the metals of power and motion.
Solcoa Industries
@solcoatech
We’ve secured $75M in financing to build Solcoa One, our first commercial rare earth metallization plant.
This media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Solcoa Industries
@solcoatech
The financing includes $45M in equity led by @BainCapVC , with @schrep and @gigascale, @LongJourneyVC, @zoink, and leaders across defense and technology, alongside $30M in debt, anchored by @jpmorgan.
-
Mike Schroepfer
@schrep
Proud to have backed @hoomanrenezhad from the very beginning. Cheaper, sovereign, cleaner all together in one
Hooman
@hoomanrenezhad
Today we're announcing $75M to build Solcoa One, our 500-tonne rare earth metallization plant in Nevada.
At Solcoa, we believe rare earths are the foundation of America's next great industrial era. An era we intend to win on the merits, with superior American technology. -
Mike Schroepfer
@schrep
Thought cheap scaled carbon removal was dead?
Think again. Megaton scale carbon removal with impact by 2030 from one of our portfolio companies!
blog.google/company-news/outreach-and-initiatives/sustain… -
Mike Schroepfer reposted
Richie Erb @richie_erb
it's the lowest cost architecture at scale (independent of region). bc it's the least physical material per module, and able to be automated at a system level.
the spread on that vs what is currently being done in the market is most acute in US so messaging focuses on what resonates there... but the gap exists everywhere. -
Mike Schroepfer
@schrep
Seen the results myself in person and it is impressive
Rhoda AI
@RhodaAI
At Rhoda, we care deeply about the science of pre-training for robotics.
In one of the most rigorous studies of its kind, over thousands of trials and hundreds of hours of robot evaluations, we show how scaling web-video pre-training leads to better real-world robot performance.This media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Rhoda AI
@RhodaAI
At Rhoda, we care deeply about the science of pre-training for robotics.
In one of the most rigorous studies of its kind, over thousands of trials and hundreds of hours of robot evaluations, we show how scaling web-video pre-training leads to better real-world robot performance.This media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
BUILD SOLAR FASTER!
-
Mike Schroepfer
@schrep
This is sage the planted robot. Such an elegant and simple machine. Cheap steel pipe as the foundation - no concrete, no site prep. Much better land use - 2x the density. Plants grow under the panels so soil is retained. So cool
-
Mike Schroepfer
@schrep
I've been trying to answer a very simple question: if panels are so cheap and only ~30% of the cost of a solar farm how do we slash the cost and time of building solar power.
Our first (but not last!) investment from this deep dive is Planted. They build robots that make installation 2x as energy dense, faster, and cheaper - let me say a bit more...Post not available here, view on X
Mike Schroepfer
@schrep
What does all of this mean?
Typically 2x energy density per acre. Much faster approvals. Cheaper. Use of land that couldn't otherwise be used.
This is how you use clever technology to go faster.
Mike Schroepfer
@schrep
Learn more here: www.fastcompany.com/91606923/this-startup-just-raised-31-…
-
Mike Schroepfer reposted
Billy Thalheimer
@billythalheimer
Great question! Seagliders use a "blown wing" to takeoff at low speeds.
The high-speed prop wash is concentrated on the wing so the wing sees fast air and generates high lift, even while the seaglider is moving slowly.
We trick the wing into thinking it is flying faster than it is.
For takeoff, allows us to takeoff directly from the hydrofoils (no one has been able to do that before).
For landing, lets us land slower so we can land in higher wave states.
You want the blown wing to focus all the propeller energy on the wing. Bigger props would waste energy above and below!
Toto
@7_e_2_1
What's the reason for 12 small props rather than 2-4 (likely more efficient) big ones?
-
Mike Schroepfer
@schrep
This is really impressive progress
Mark Zuckerberg
@finkd
Muse Spark 1.3 is rolling out today with frontier performance almost too cheap to meter. This is the biggest jump we've made so far on coding and agentic work. Try it in Muse Code and our API.
Next up 🍉 and Muse Spark open weights releases coming soon. -
Mike Schroepfer
@schrep
Great explanation
Billy Thalheimer
@billythalheimer
Past WIGs and seaplanes have had 3 major problems:
1. Poor wave tolerance - they used planing hulls and skipped off waves
2. Poor maneuverability - accelerating to takeoff speeds in crowded waterways is difficult
3. Poor safety - human flown vehicles were difficult to control
Seagliders fix it with modern tech:
1. Hydrofoils let seagliders cut through sea state - the hull doesnt even touch the water
2. Seagliders have three modes of operation: float, foil, and fly. In the harbor, we're on our hydrofoils, as maneuverable as an America's Cup racing yacht
3. Our digital flight control system flies the vehicle by itself and ensures envelope protection and system safety.
With these 3 unlocks - we can open up the coastlines of the world for rapid, long range transit with SeaglidersThis post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Exciting to see hard tech return real money. Have invested with Factorial Funds and think they are great.
Yuliya Chernova
@ychernova
Scoop: Sol Bier's venture firm Factorial Funds crossed $1 billion in proceeds, per a letter it shared with LPs. That's $965 million in distributions to its LPs. VC liquidity is finally getting going. www.wsj.com/pro/venture-capital/vc-liquidity-is-finally-h… via @WSJ
-
Mike Schroepfer
@schrep
Let's make energy affordable and plentiful!
Light @PwrdByLight
Today, we’re introducing Light. ⚡
We’re building the API platform for electricity—enabling companies to launch branded electricity plans embedded directly into their products.
And we’ve raised a $46M Series A led by Matrix.
We’re just getting started. -
Mike Schroepfer
@schrep
This is a great read from @Waymo on lessons learned for autonomy.
I'll admit I was over optimistic about end-to-end neutral networks and in vision only systems but neither has seemed to pan out.
The "humans can drive with just visual sensors" argument always misses that our "cameras" are on a 6DOF pivot (our head) and that we can deploy glare protection (sunshade, sunglasses) in realtime.
waymo.com/blog/2026/08/10ailessons/ -
Mike Schroepfer
@schrep
Spent last two days in El Segundo, Garden Grove, San Bernardino, and Torrance meeting with entrepreneurs building better, cheaper, cleaner products. Most visits ran over because there is so much exciting stuff to see. Got some great stuff on video we will share in a bit to take you behind the scenes….
-
Mike Schroepfer
@schrep
This is so exciting. Electric aircraft can be much quieter that traditional ones. 1:07 is the section of the video where the @WhisperAero plane flies overhead!
vimeo.com/1219084098/25e68f44fb?fl=pl&fe=cm -
Mike Schroepfer
@schrep
Today is the last day of our summer fellows. So sad to see them go!
-
Mike Schroepfer
@schrep
This is how you build power infra at hyper scale
Drew Baglino
@baglino
Today is a pivotal day at @heronpower as we announce Heron Factory One, our first large-scale manufacturing facility, in Morgan Hill, California.
We will invest over $100M to transform a former distribution warehouse into a facility capable of manufacturing 10,000 Heron Links a year.
The decisions involved in manufacturing are weighty and consequential. Whether to build a factory, where to site it, what to make versus buy, how much to automate, what equipment to use. Each one can bring pain or gain to a company at a critical time. As they say, prototypes are easy and manufacturing is hard.
The Heron team faces this challenge pooling decades of hard-won, hands-on experience building 10k per week battery and vehicle lines, vertically integrated energy storage factories, and continuous motion consumer goods and battery cell factories. Perfection is impossible, but we have high execution expectations for Heron Factory One, and our customers do too.
America's grid is growing faster than in decades to meet new demand from AI, electrification, and re-shored manufacturing. But much of the critical equipment underpinning the grid hasn't fundamentally changed in a hundred years, and nearly 80% is imported.
Heron Link replaces passive steel and oil with silicon and software, offering our customers a more efficient, smaller footprint, faster to deploy, and high uptime solution. We are bringing much-needed innovation to the grid edge to match the pace of progress in AI, energy storage, and renewable energy.
Securing the site is the first of many steps towards building the largest SST manufacturing facility in the United States, if not the world, and prep for mass production in late 2027.
heronpower.com/news-stories/press-release-heron-power-sel… -
Mike Schroepfer reposted
Aditya Agarwal
@adityaag
Today we’re announcing SPC Fund IV: $575M to help founders find their life’s work.
A decade of guiding founders through -1 to 0 brings @SPC to $2B in AUM and, more importantly, a 1200 member community of the world’s most talented technologists. We strongly believe that:
→ The person comes before the idea. At -1, generational founders are often busy reading, prototyping, discarding, and earning the right to their own conviction.
→ Ambition is social. The people you surround yourself with in the early days play a big part in inflecting your ambition.
→ Patience compounds. It is better to work on something you have deep conviction in rather than simply sprint at the first idea.
The quiet months we protect at the beginning have produced three funds in the top 10% of their vintages, and companies like @baseten, @GammaApp, @render, @GoodfireAI, @LumaLabsAI, and @profound. We are proud to have worked with all these founders in their -1 phase and beyond.
While we defined -1 to 0, we're no longer bound by it. Fund IV allows us to partner with companies well beyond launch.
We're doing this now because we've never seen a wider gap between what's possible and what's being attempted. Intelligence is abundant. The cost of trying ideas keeps falling, and problems that seemed insurmountable a few years ago are quickly becoming solvable.
To our members, to the founders who trusted us before anyone else did, and to the LPs who had conviction in our own -1 journey: thank you. This milestone belongs to you as much as to us.
To the builders looking to find your life’s work: let’s get started. -
Mike Schroepfer reposted
Doug Bernauer
@DougBernauer
Our totally portable, containerized reactor is about to ship out, I'm staying on top of things here!
-
Mike Schroepfer
@schrep
This is so friggen cool
Doug Bernauer
@DougBernauer
Our totally portable, containerized reactor is about to ship out, I'm staying on top of things here!
-
Mike Schroepfer
@schrep
“when Claude’s search led it to real systems on the open internet, it treated them as part of the exercise.”
Everyone’s seen war games right? Model thought it was all part of the exercise!
Scary!
Anthropic
@AnthropicAI
In a review of our cybersecurity evaluations, we found three incidents in which a Claude model reached the internet from within or while interacting with a third-party evaluation environment, and then gained unauthorized access to the real systems of three different organizations.
Our post describes what happened, how it happened, and what we’re changing. We encourage other AI developers to perform similar reviews.
We conducted this review together with @Irregular, one of our evaluation partners, and thank them for the joint investigation and their collaboration on this post. This type of collaboration is increasingly critical to safe, rigorous evaluation of models, and we look forward to continuing to work together on security.
www.anthropic.com/news/investigating-incidents-cybersecur… -
Mike Schroepfer reposted
Colossus
@colossusmag
In 2018, Sarah Guo became the youngest general partner in Greylock's 60-year history. She was 28. Four years later, she quit to launch Conviction, a firm staked entirely on AI.
Before ChatGPT shipped, she seeded Baseten and Harvey; each is now worth over $11 billion. In Conviction's first year, she wrote early checks into Sierra, Cognition, and Mistral; those three companies are now worth, together, $54 billion.
Andrej Karpathy worked out of Conviction's office until Anthropic hired him in May. Guo has been close to Jensen Huang for over a decade. Her first two calls after starting the firm were to Sam Altman and Nat Friedman.
And yet the investor closest to the AI frontier is betting against its biggest companies.
The two big frontier labs, worth close to a trillion dollars apiece, no longer just want to build the models. They also want to build every product and company on top of them, leaving nothing for anyone else.
The market is paying as though they might succeed. Of the $300 billion in venture capital deployed in the first quarter of 2026, the biggest quarter in the history of the trade, 65% went to only four companies: Anthropic, OpenAI, xAI, and Waymo.
Guo is betting the labs can't build everything, and she spends her days making sure of it. She won Harvey its first client. She flew across the country to take a single Baseten candidate to a four-hour lunch. On one wedding anniversary, she spent the whole weekend on back-to-back calls, keeping two founders on the line so they couldn't speak to rival firms. Twice a year, she flies the world's brightest young founders to San Francisco and inducts them into the fight.
In the months @domcooke spent reporting this piece, @saranormous had her fourth child, walked the Met Gala in 45 pounds of chainmail, and still answered her founders' texts within minutes.
Guo's parents arrived from China in 1987 with $50, built a company, and took it public at $1.2 billion. Then it went bankrupt. Guo grew up inside that startup. She built its first website, did her homework in a cubicle, and slept over for bug bashes. She loved it.
If two labs build everything, no one gets to do that again.
Welcome to Sarah's Wager. Read it below. -
Mike Schroepfer
@schrep
I’ve invested with @saranormous and worked with @mvernal for a decade. They are the real deal and a team I’d recommend to any founder. I still struggle to call myself an investor rather than an operator but Sara has shown how it can be done with class AND massive impact.
-
Mike Schroepfer
@schrep
Quick math says average American owns/uses ~60x more battery capacity than they did 20 years ago. I bet the same happens for AI compute - huge growth in use per capita over the coming years...
www.cnbc.com/video/2026/07/02/were-still-at-the-beginning… -
Mike Schroepfer reposted
Squawk Box
@SquawkCNBC
"We spent 15 years with the theory that software is eating the world," says Gigascale Capital Founder @schrep. "I think AI is eating software. And what's left is competition in the physical infrastructure." cnb.cx/3RftQUT
-
Mike Schroepfer
@schrep
Did a long chat with @yayitsrob on Shift Key about the Gigascale thesis, hard tech, and why the "US can't build anything" take is wrong.
A few things I believe: 🧵Post not available here, view on X
Mike Schroepfer
@schrep
Everything in your life that got cheaper — TVs, computers, phones — is mass manufactured.
Everything that got more expensive is custom built. Every time.
Mike Schroepfer
@schrep
Go spec a power transformer today. Hire an engineer, write specs, design doc, wait forever. A custom bespoke wedding cake every single time.
@heronpower is the Costco sheet cake equivalent for transformers. One cake tons of customers.Post not available here, view on X
Mike Schroepfer
@schrep
Fusion: the triple product has improved faster than Moore's Law for decades. It's incremental, incremental, incremental — then whoa, the thing's running.
@CFS_energy's magnet could levitate an aircraft carrier.
Mike Schroepfer
@schrep
We don't need 4,000 companies. We need ~20-40 — the @FormEnergyInc, the @heronpower, @CFS_energy, @_panthalassa, @solcoatech — and the whole physical economy gets rebuilt around them.
Full episode: podcasts.apple.com/us/podcast/shift-key-with-robinson-mey… -
Mike Schroepfer
@schrep
This was very fun - worth a listen!
Heatmap News
@heatmap_news
New on SHIFT KEY:
@gigascale founder @schrep just raised $250M to fund hard tech to fight climate change.
In this economy?
He talks with @robinsonmeyer about why he’s convinced his bet will pay off:
podcasts.apple.com/us/podcast/shift-key-with-robinson-mey… -
Mike Schroepfer reposted
Andrew Côté
@Andercot
Well it ended up being ~32,000 people and 105 events, by far the biggest yet.
Give me 10 years and I'll put on a worthy successor to the 1915 San Francisco Worlds Fair
Andrew Côté
@Andercot
SF Deep Tech Week starts tomorrow
85 events, 11,000 people, about a thousand founders and investors, tens of billions in AUM
The world's largest gathering of Deep Tech community kicks off in Alameda, at Longshot Factory, tomorrow sunday. -
Mike Schroepfer
@schrep
1/ Ask a leader to describe their culture and you'll get the positives.
Ask them to describe the cost they're willing to pay for that culture and you'll often get silence.
Culture embodies trade-offs. If you can't name the con that comes with the pro, you don't fully understand the culture you've chosen.Post not available here, view on X
Mike Schroepfer
@schrep
5/ That moment probably saved us hours. But more than that, it proved the culture was real.
Psychological safety isn't a soft concept. It's how you win, because no one is sitting on the fix, too afraid to speak up.
Mike Schroepfer
@schrep
6/ Most leaders describe their culture's strengths. The ones who actually understand it can tell you what it costs.
Thanks to @molly_g for the conversation on the WorkLife podcast: www.youtube.com/watch?v=9cwt_rMXOoU&list=PLAWu34VO7OtJTX1… -
Mike Schroepfer
@schrep
1/ On June 25th during SF @deeptechweek, I'm hosting an afternoon with founders and engineers rebuilding the electric industrial stack from the ground up. Here's what we're getting into.
Register here: www.deep-tech-week.com/host/events/b0c2dd09-ca54-4e8a-ad8…Post not available here, view on X
Mike Schroepfer
@schrep
6/ What I want to get into: the decisions that don't survive first contact with manufacturing. The architecture choices at the prototype stage that determine what's possible at scale. The stuff that's genuinely harder than you ever think it's going to be. And the hard-won lessons that can be shortcuts for others.
Mike Schroepfer
@schrep
7/ If you want to nerd out on energy infrastructure with the people actually building it — and see real components up close — join us June 25th in SF.
www.deep-tech-week.com/host/events/b0c2dd09-ca54-4e8a-ad8… -
Mike Schroepfer
@schrep
Page Mill Road in Palo Alto should be renamed "Self Driving Vehicle Testing Facility"
In the last 24 hours spotted Nuro/Lucid, Tesla Model Y test vehicle + multiple Cybercabs, Rivian Test Vehicle, one I couldn't identify (white vehicle with tall lidar sensor on roof rack) -
Mike Schroepfer
@schrep
This was fun!
Currence
@Currence_AI
New interview series from CTVC unlocked. @schrep sat down with @KimberlyZou and @SophiePurdom to talk about making the shift from the digital economy to the physical economy
-
Mike Schroepfer
@schrep
Anika Nilles was incredible. Best drums I’ve heard live in a long time - played with such precision and power. Bravo!!!
CONSEQUENCE
@consequence
RUSH's new drummer Anika Nilles has nailed the assignment.
📹: Ray BoucherThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
I really wish I could directly convey the daily optimism I get from working with deeptech founders. I'm literally overwhelmed with trying to find time to spend with all the amazing people chasing 5-10x hardware wins. I get to see new factories, new tech every day. amaze amaze
-
Mike Schroepfer
@schrep
Always fun to be asked about P(doom) on live tv. Much more fun to talk about electrons, atoms, datacenters in the ocean, building our world through electrochemisty!
-
Mike Schroepfer reposted
Newcomer
@NewcomerMedia
The Week in Short is here, including news on:
• @Google tapping equity markets for $85 billion
• @SpaceX seeking $75 billion at a $1.75 trillion valuation
• @gigascale founding partner @schrep and his new $250 million hardware-focused fund
• Median TVPI for venture funds finally being on the rise
• @tryramp's jam-packed fundraising week
and a lot more.
Read about them all: www.newcomer.co/p/ai-pushes-markets-into-uncharted -
Mike Schroepfer
@schrep
Going on TV shortly to talk about venture dollars for atoms not bits, scaling deeptech, AI, and more - anything you want to hear about?
-
Mike Schroepfer
@schrep
1/ Yesterday @XcimerEnergy fired up Phoenix — now the largest privately-owned laser on the planet. We're investors, and I'm fired up about this one. Quick thread on a counterintuitive idea: a bigger laser is the path to a cheaper fusion plant.
Post not available here, view on X
Mike Schroepfer
@schrep
10/ Phoenix by the numbers: a >1 kJ excimer source and a 38-meter SBS optic — the biggest and highest-energy SBS ever built. Pulling it off meant rebuilding an industrial muscle the US nearly lost after the Cold War. Reindustrialization, not a science project.
Mike Schroepfer
@schrep
11/ We backed Xcimer because they flipped the hard problem. Others in the field are trying to wring a power plant out of a marginal science machine. Xcimer's building the big, cheap, manufacturable laser that makes a real plant possible. Huge congrats to the team on Phoenix.
-
Mike Schroepfer
@schrep
This is why we backed @RhodaAI and are looking at others in the space!
TBPN
@tbpn
Gigascale founder and former Meta CTO @schrep says industrial robotics will grow faster than robots made for the home.
"You're playing on hard mode, to start in the home."
"I've shipped home electronics. People drop stuff. They spill wine on them."
"There's all sorts of things that can happen in the home that I just don't have to worry about in a factory. So I think you're going to see [more robotics] in factories and warehouses first."
"We already use robots in car factories all the time. So the question is, can you move into slightly less well-structured things."
"If you look at a lot of factories and warehouses, there's a surprising amount of boxing and unboxing that happens... It's all done by humans now. It's a really hard thing to automate with a KUKA robot — every box is a little different, the bag gets stuck."
"Those are the sorts of things that I think are going to be really good."This media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
Solar panels got cheap. Really cheap.
The bottleneck now is deployment: installation, storage, transmission, grid flexibility, permitting, and rising power demand from AI and industry.
That's where I'm paying attention.
TBPN
@tbpn
Gigascale Founder and former Meta CTO @schrep says new solar startups will go after installation costs rather than compete with China on solar panels.
"If you look at a solar farm, you lay down all this steel and put up all this framing for the panels. When that panel was the most expensive thing on the field, then [startups producing solar panels] made sense."
"But solar panels are now the cheapest thing in the field. All the rest of the stuff costs more than the panel."
"I think what we're going to see is startups saying, 'Let's rethink how we actually deploy solar from a form-factor and automation perspective. And just go after installation costs.'" -
Mike Schroepfer reposted
TBPN
@tbpn
Gigascale Founder and former Meta CTO @schrep says new solar startups will go after installation costs rather than compete with China on solar panels.
"If you look at a solar farm, you lay down all this steel and put up all this framing for the panels. When that panel was the most expensive thing on the field, then [startups producing solar panels] made sense."
"But solar panels are now the cheapest thing in the field. All the rest of the stuff costs more than the panel."
"I think what we're going to see is startups saying, 'Let's rethink how we actually deploy solar from a form-factor and automation perspective. And just go after installation costs.'" -
Mike Schroepfer reposted
The Information
@theinformation
Today on TITV:
-Nvidia unveils new chip for PCs | @aaronpholmes
-Why forward deployed engineers are all the rage | @LauraBratton5
-Former Meta CTO & Founding Partner of Gigascale Capital @schrep on his $250M fund & the AI ad race
📺 Tune in at 10 am PT / 1 pm ET on thein.fo/4wWnk5n -
Mike Schroepfer
@schrep
1/ Today we're announcing Gigascale Capital's $250M first institutional fund to back early-stage founders rebuilding the physical economy.
Post not available here, view on X
Mike Schroepfer
@schrep
6/ Climate impact won't come from asking the world to adopt worse systems for virtuous reasons. It comes when a different technical approach makes the cleaner system also simpler, more scalable, and cost competitive.
Mike Schroepfer
@schrep
7/ That's the future we're backing.
www.axios.com/2026/06/01/gigascale-capital-schroepfer-250… -
Mike Schroepfer
@schrep
My grandfather was from a generation that didn't talk about the sacrifices they made.
He fought with the US Army in WWII and the only thing he'd tell me was about being seasick on the trip across the Atlantic.
I'm deeply thankful today for him and the millions of others who've fought and sacrificed for our freedom. -
Mike Schroepfer
@schrep
This is a big deal. Best way to build faster is less parts and better performance. From the report. 65% lower electrical equipment cost and 90% lower installation labor. Better performance.
This is the way.
Drew Baglino
@baglino
Today at @heronpower we are publishing our vision for how future native 800 VDC data centers will be built.
There's plenty of discussion circulating on 800V data centers, and our work stands apart in two key ways. First, it's an end-to-end blueprint for an AI factory data hall, fully specifying a 12 MW building block with bill of materials, redundancy topology, floor layout, and product specs benchmarked against ERCOT's large load interconnection requirements. Second, it line-item the costs and labor breakdowns per MW for our blueprint compared to traditional 480 VAC builds.
Stacked against today’s tech, Heron’s architecture is 1/3 the MV-to-rack electrical cost, 1/10th the installation labor, and half the inefficiency from grid to chip, unlocking faster, more affordable, gigascale buildouts.
Read the full details here:
heronpower.com/blueprint-for-800-vdc -
Mike Schroepfer reposted
Sam D'Amico
@sdamico
Update: this is now a @ImpulseLabs x @westmagco x (and now) @gigascale operation.
Come spend your summer building on the electric stack. Link below.
Sam D'Amico
@sdamico
Trying something new (ft. @boxcardavid @stolerlyn)
If you're an early-career builder working on the electric stack -- we'd love to host you at our office this summer. More info in the next post. -
Mike Schroepfer
@schrep
Let’s go!
Lyn Stoler @stolerlyn
@Gigascale is partnering with the Electric Stack Fellowship!
fellows now also get:
- time and mentorship from the Gigascale team, including @schrep
- opportunity for up to $500k in investment from Gigascale in companies started as part of the fellowship
apps close 5/14
Sam D'Amico
@sdamico
Trying something new (ft. @boxcardavid @stolerlyn)
If you're an early-career builder working on the electric stack -- we'd love to host you at our office this summer. More info in the next post. -
Mike Schroepfer
@schrep
AI needs a lot more power and this is a tremendous opportunity to pull new sources of cheap clean energy forward. The machine is deceptively simple - simply = cheap and easy manufacture. Some of the best ideas often have the reaction “why didn’t someone do this before?” - I think we’ll see that here
Garth Sheldon-Coulson
@garthsc
Today we're announcing @_panthalassa’s $140M Series B, led by Peter Thiel, with participation from John Doerr and many other incredible investors. The mission: unlock the ocean as another planetary-scale energy resource for humanity. First stop: compute.
This media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
Great chat with @Waymo CPO @saswat101 just now. I was already a Waymo super-fan because of their approach to safety - but walking through the logs of my ride + taking feedback on how to improve the UI and experience makes me a ultra-super-fan. So great to see a company doing it right.
Mike Schroepfer
@schrep
Had a scary @Waymo ride just now. Said it had to pull off highway suddenly, then stopped short before a major intersection. Started moving erratically so I jumped out of the car while the light was red. It’s still stopped blocking a lane on 84/woodside. Calling support from car didn’t work so wonder if it was a network issue?
-
Mike Schroepfer
@schrep
How much of the interference market in 2028 is models/kv cache sizes requiring a full rack (NVL72) v.s. a single nodel (B300/NVL8 or equivalent)? Asking for a friend!
-
Mike Schroepfer
@schrep
It is staggering the advances in compute, memory, and bandwidth for AI training and inference.
blog.google/innovation-and-ai/infrastructure-and-cloud/go… -
Mike Schroepfer
@schrep
To be clear I’m a super fan of Waymo - especially their approach to publishing safety data in a way others can verify. Also long on self driving. Vehicle injuries are a preventable tragedy.
In a Waymo again now! -
Mike Schroepfer
@schrep
Had a scary @Waymo ride just now. Said it had to pull off highway suddenly, then stopped short before a major intersection. Started moving erratically so I jumped out of the car while the light was red. It’s still stopped blocking a lane on 84/woodside. Calling support from car didn’t work so wonder if it was a network issue?
Mike Schroepfer
@schrep
I’ve done 52 rides/550 miles and this is the first issue - overall love love Waymo
Mike Schroepfer
@schrep
Oh I’m all good!! Thanks for all the texts :)
Mike Schroepfer
@schrep
Few quick follow-ups:
1) Waymo publishes safety data in a way others can verify. That data says 90+% risk reduction for injuries. Besides the connivence this is why I will continue to ride.
2) being stopped in the middle lane of a busy road at night while raining and the car being an obviously weird state (moving forward a few times, etc) was odd - but I wasn’t stressed - opened the door and crossed the street a stepped in a huge puddle which sucked but otherwise fine!
3) support from car didn’t work - this was the worst part. Waiting a few minutes while it said “contacting support”. Calling from my phone got someone quickly who was very helpful.
4) Waymo followed up several times to make sure I’m ok
To:Dr I’m taking a Waymo this am -
Mike Schroepfer
@schrep
Really excited about this.
Ashlee Vance
@ashleevance
I mean. This is pretty sick.
Full pod on @_panthalassa right here www.youtube.com/watch?v=Q4PCJRN7yGsThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Ashlee Vance
@ashleevance
I mean. This is pretty sick.
Full pod on @_panthalassa right here www.youtube.com/watch?v=Q4PCJRN7yGsThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Rhoda AI
@RhodaAI
Our CEO, Jagdeep Singh, joined @johncoogan & @jordihays from @tbpn to talk about the state of robotics and AI models, Rhoda’s approach to data and training, full-stack development, market focus and the issues with sim-to-real based training. Watch the full interview with @startupjag here.
This media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Jagdeep Singh
@startupjag
Every company I've built comes back to the same four things: a big unsolved problem, a differentiated solution, a world-class team, and early customer validation.
With @rhodaai , the problem is robots that fail outside the lab. The differentiator is internet-scale video pretraining. The team is exceptional. And the traction is real — strong customer interest and evals with 100% autonomous operation at a major global automaker.
I talked through the full journey on the Dealmakers podcast.
Link in comments → -
Mike Schroepfer
@schrep
I still remember the productivity boost/joy of Google + Stack overflow for coding/debugging in the 2000s.
Coding agents make all of that really cute and quaint. It is hard to overstate. -
Mike Schroepfer
@schrep
Working with Claude Code is disorienting. I first thought it was like pair programming with a epic Unix hacker from the 90s, but it is more like PMing that unix hacker who is wicked fast.
Promting "this isn't working" followed by log tailing, debugging, and a working deployed change is mind blowing. -
Mike Schroepfer
@schrep
I’ve been skeptical of robotics adapting to the difficulties of the real world - but the combo of using Internet scale data to pre-train, plus examples of use in real world factory settings, plus this team make this one I had to back.
Jagdeep Singh
@startupjag
After operating in stealth for the last 18 months @rhodaai , we’re excited today to finally show the world what we’ve been working on. We believe we’re on a path to physical AGI with the launch of our brand new foundation model, the Direct Video Action (DVA) model.
This media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Jagdeep Singh
@startupjag
After operating in stealth for the last 18 months @rhodaai , we’re excited today to finally show the world what we’ve been working on. We believe we’re on a path to physical AGI with the launch of our brand new foundation model, the Direct Video Action (DVA) model.
This media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
Common VC wisdom is to avoid hardware, and certainly avoid consumer hardware. Common wisdom creates Alpha :)
We've backed two companies with top tier net promoter scores saving consumers money and making their homes more comfortable. Hell ya. -
Mike Schroepfer
@schrep
Owned the Lucid Gravity for 2 months now — my 4th EV.
Once people can buy reasonably priced 400+ mile EVs it is over for gas cars.
Still think the 2014 P85D was years ahead of its time.
Good:
• 400+ mile range is bonkers. Total game changer
• 4-wheel steering makes tight Bay Area parking lots easy
• Massive interior space for stuff + 7 seats
• Quiet and genuinely fun to drive
Bad:
• Build quality. Multiple day-0 issues → 3 week shop visit and still waiting on parts
• Touch controls on the steering wheel are terrible
• Software bugs
• No CarPlay
• No autonomy -
Mike Schroepfer
@schrep
Lithium-ion batteries were designed around energy density - which matters in your pocket.
Form Energy asked the question "whats the cheapest materials we can use to build a battery if we don't care about weight."
Here's where a 30 GW HOURS of battery storage comes in.
That's enough to run ~300k GPUs for 4 hours. DAMN.
www.canarymedia.com/articles/batteries/gigantic-form-ener… -
Mike Schroepfer
@schrep
Too many bonkers but great ideas showing up in my inbox to fund all of them. Future can be awesome if we built it!
-
Mike Schroepfer
@schrep
Neo continues to innovate! Can’t wait to see the new companies coming out of this!
Neo
@neo
Today we unveiled Neo Residency, a new program for startups and high-agency student teams. 🎉
We’re replacing our best-known program, Neo Accelerator, with something even better and more selective. 🧵 -
Mike Schroepfer
@schrep
Love this clip from @baglino when describing what @heronpower does for a datacenter:
1. Alternative supply built in America
2. 70% less gear between grid and chip
3. Reduce losses grid->chip by factor of 4
Shipping commercially NEXT year
This is the sort of speed and scale we need!
youtu.be/XVbhKJazTLY?t=143 -
Mike Schroepfer
@schrep
Couldn't be more excited about this company - proud to invest even more in this round!
techcrunch.com/2026/02/18/heron-power-raises-140m-to-ramp… -
Mike Schroepfer
@schrep
Energy is the key to prosperity.
Developing economies are leaping to solar + EVs because they are cheaper. Happened in telecom when they when straight to cell phones and skipped landlines.
Common wisdom says there is a tradeoff between energy access and pollution. Technical progress flips that tradeoff on it's head. -
Mike Schroepfer
@schrep
Pretty crazy how normal it feels to be sitting in the back of a car on highway 101 with no driver
-
Mike Schroepfer
@schrep
About to do first Waymo ride on the highway AMA!
-
Mike Schroepfer
@schrep
First automated landing via @Garmin autoland when the pressurization system failed!
So cool it worked perfectly!
www.denver7.com/news/front-range/broomfield/in-a-first-pl… -
Mike Schroepfer
@schrep
What is a possible national security risk of a wind turbine?
We need a lot more energy production in the US!
www.nytimes.com/2025/12/22/climate/trump-offshore-wind-fa… -
Mike Schroepfer
@schrep
Orbital servers
Glow with endless afternoon,
Waste heat paints the void. -
Mike Schroepfer
@schrep
This is a really helpful part of the conversion @andrewmccalip
To me the debate is simple. It's possible, much more expensive now, is highly dependent on a) launch costs b) satellite Capex and c) your inability to build on land data centers.
If you just *can't* get DC's on earth permitted or powered then you don't care about cost. If you can build and care about cost it isn't even a close call today.
Obvi @SpaceX is in a unique position to drive launch and satellite costs down.
Anyone who's built data centers on land has *stories* about things that derailed or delayed projects. I'll tell some sometime. This is likely to get worse not better in the near term. If you have a high chance your project will not be approved you have to parallel track more options which adds to expense.
Depending on how you think all of this balances out you are more or less excited about these ideas.
Outside of economics the allure of owning your own destiny is clear. Moving from interconnect queues, planning commissions and environmental impact reports to "launch scheduled for May 5" is alluring. Feels a bit like shipping whatever you want on the web vs having to get App Store approval.
Building compute closer to the power source is obviously a good idea - and something I'm backing in various ways on land and at sea. Eliminating steps/parts is a sure fire way to build faster, cheaper, and smaller.
Andrew McCalip
@andrewmccalip
Data centers in space.
It might not be economically rational. But it might be physically possible.
I’m trying to bring some quantitative structure to a conversation that’s been mostly big-number vibes.
andrewmccalip.com/space-datacenters -
Mike Schroepfer
@schrep
Got to visit XCIMER energy this week.
Last visit the floor was mostly empty.
Now: high quality seed beam systems working, Marx generators coming together, controls online. HW revisions from lessons learned deployed. High power shots coming soon
Fusion is getting built! -
Mike Schroepfer
@schrep
Why does a United flight attendant call out on the intercom “if person x is here please ring your call button”
Like don’t they know where everyone is seated? -
Mike Schroepfer
@schrep
One of the most important aspects of modern LLMs that is most impressive is how improving in one domain doesn't harm overall performance in other domains nearly as much as it used to.
This means that LLMs are able to effectively absorb the knowledge of multiple expert humans in different domains.
Have we seen a major novel insight from connecting knowledge across these domains which you would see with multidisciplinary teams of humans? -
Mike Schroepfer
@schrep
Scam alert!
Called me 1-415-222-9958 claiming to be x.com support - number on my account had been changed.
When I asked them to verify they said "look the number up its a twitter support number." Which it is - so they are spoofing that.
Sent a password reset and asked me to read the password back to them. Threatened account would be locked if I didn't.
Yikes! Don't ever read passwords to someone! -
Mike Schroepfer reposted
Doug Bernauer
@DougBernauer
Feast your eyes on two metric tons of West Virginia graphite that will be slowing down neutrons in our first nuclear reactor by next year! Baked at over 2500C by Amsted Graphite Materials, it’s the first reactor order of American-made, nuclear-grade, graphite in over a decade.
-
Mike Schroepfer reposted
Doug Bernauer
@DougBernauer
Borne of Fire, the Strength to Contain Fission. - Over 6 tons of American Forged Nuclear Reactor Pressure Vessel from @ScotForge! Coming to @RadiantNuclear’s headquarters for reactor assembly later this year.
-
Mike Schroepfer
@schrep
EVs are the massive disruption staring us in the face.
A few things announced in the last week:
1) slate.auto announced a $20k EV pickup. They've capitalized on the idea that EVs have many fewer parts than ICE vehicles - so why not push that to the extreme: ..Post not available here, view on X
Mike Schroepfer
@schrep
This is a platform shift like the shift from web->mobile. The first mobile games were straight ports. Nobody built "touch first" games because the market was too small.
First gen EVs and batteries have all been "straight ports"...
Mike Schroepfer
@schrep
Take a car platform we have plus a battery cell we already make and make a car. The market is now big enough that people can invest in second generation ground-up builds. If we build an EV from scratch and battery chemistry optimized for an EV what can we do?
...
Mike Schroepfer
@schrep
Turns out a lot. There is a large space of optimization to make.
Ohh and I forget Walmart announced that it will install fast EV chargers at thousands of walmart and sams club stores. 90% of americans live within ~10 minutes of a walmart.
....
Mike Schroepfer
@schrep
So I challenge everyone to imagine this possible future:
1) 90% of Americans can charge their EV in 10 minutes within 10 minutes of their home
2) There is an EV in each category that is same cost or cheaper off the lot than the ICE version
3) EV can be had with 400-500 miles of range -
Mike Schroepfer
@schrep
My multi-decade run as extended family IT guy may be at an end. @ChatGPTapp video mode walking me through arcane Windows11 driver and settings debugging was impressive. Amazing work @sama
-
Mike Schroepfer
@schrep
Yes we can build stuff in the US.
www.tomshardware.com/tech-industry/producing-wafers-at-ts… -
Mike Schroepfer
@schrep
This work is super cool.
www.technologyreview.com/2025/03/21/1113396/inside-a-new-… -
Mike Schroepfer reposted
The Full Ratchet
@TFR_Pod
@schrep of @gigascale has been at the center of major tech shifts—from @Meta’s AI lab to deep tech and energy.
We talked about AI’s future, why energy is a huge opportunity, and what he learned from Mark Zuckerberg about scaling tech. Listen to Episode 470 now! -
Mike Schroepfer
@schrep
Doing scaling hard tech office hours RIGHT NOW. You can also ask questions here if you have them :)
lu.ma/bqurmvjn -
Mike Schroepfer
@schrep
on DeepSeek:
1) We don't actually know the training costs - likely much higher than reported (still impressive work!)
2) The big news is they shared the work so everyone can benefit. Awesome algorithmic improvements that move the field forward
3) Reasoning models use a lot more compute at inference time. Optimal balance and total impact on infrastructure not really well understood
We've known for a long time that the amount of data to train an LLM was many orders of magnitude more than a human needs to learn a similar task. It is one of the arguments against LLMs being AGI/AMI. Reasoning models still use a ton of compute to pre-train - but they are much more sample efficient at post-training (or mostly RL in the deepseek case). However, they are also a lot more expensive at inference time.
How all of this shakes out we just don't know yet!
Will be an exciting few months as everyone replicates! -
Mike Schroepfer
@schrep
Who are the peeps in climate or vc who are also into surfing? Asking for a friend
-
Mike Schroepfer
@schrep
Tsunami warning in Palo Alto - entire bay area is in the "red zone" www.tsunami.gov what are we supposed to do? Scary push alert just says "get away from coastal waters" which isn't really helpful?
-
Mike Schroepfer
@schrep
Couldn’t agree more
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
There is going to be reckoning as all the SaaS companies realize they can't *each* charge an extra $19/month/user for "AI"
-
Mike Schroepfer
@schrep
There's potential to unlock billions for good through @DaffyGiving’s Private Stock Donation Program, helping companies turn #privatestock into #charity and support employees in giving back.@Figma is leading by offering now—who’s next? So happy to be backing @adamnash in this!!
-
Mike Schroepfer
@schrep
Everyone asking me in a slightly panicked way “will all the electricity demand from AI screw up our progress on climate?”
Got this backwards: THIS IS GREAT NEWS
We’ve got highly profitable, technically savvy customers with emissions reduction targets. They’ve proven a willingness to pay premiums for firm clean and fund new companies and tech.
Google and Meta both did geothermal deals. MSFT just signed a carbon negative power deal with a company I’m backing arbor.co.
Let’s go build! -
Mike Schroepfer
@schrep
Fun to sit down with @jtemple recently to discuss the full spectrum of my climate work. Here's a good quote: "If my product gets cheaper by about 5% to 10% a year, at some point I’m gonna win. Those trends are freight trains that are going down the hill and are pretty hard to stop."
This post is unavailable. See it on X. -
Mike Schroepfer reposted
TeachCode
@TeachCode
Tech and education leaders agree: in an age of AI, computer science education is more important than ever. See guidance for computer science classrooms: teachai.org/cs. ✨ Let’s #teachai
-
Mike Schroepfer reposted
Yann LeCun
@ylecun
Video generation models do not understand basic physics.
Let alone the human body.
🌟Cheshire Cat ᓚᘏᗢ,
@autismsupsoc
CW: Body Horror?
This AI video attempt to show gymnastics is one of the best examples I have seen that AI doesn’t actually understand the human body and it’s motion but is just regurgitating available data. (Which appears to be minimal for gymnastics) x.com/Przemek87394560/status/1806912243390357541/video/1 -
Mike Schroepfer
@schrep
Huge new study from @mill:
1. During the first four months of a mill you reduce you waste buy about 20%
2. In one year of operation with a small run of their v1 product they've diverted 2 million pounds of food waste from the landfill!
www.prnewswire.com/news-releases/mill-unveils-first-of-it… -
Mike Schroepfer
@schrep
Very excited to be backing this!
Humans have made fusion happen on earth- now it is time to turn it into a viable commercial source of unlimited clean power.
techcrunch.com/2024/06/04/star-wars-lasers-and-waterfalls… -
Mike Schroepfer
@schrep
Hey @nytimes please get it straight!
"Electric cars, sales of which have slowed in recent months"
Later in the same article
"The recent slowdown in the growth of electric car sales"
Slowed = fewer sales this year than last year
Slower Growth = more sales this year than last year
Huge difference!
www.nytimes.com/2024/06/03/business/electric-cars-becomin… -
Mike Schroepfer
@schrep
Leaders this is your job!
Harry Stebbings
@HarryStebbings
1. Why The Best Leaders are Conductors
You can get all the best players in the world
But if they all played different song sheets it’ll sound terrible.
Too many leaders undervalue coordination & optimisation. -
Mike Schroepfer
@schrep
This was a lot of fun - thank you @HarryStebbings !
Harry Stebbings
@HarryStebbings
I think @schrep is one of the greatest technologists of the last two decades:
📈 Scaled product to billions of users as former CTO of Meta
📦 Shipped millions of units of consumer hardware
👥 Led 35,000 people at Facebook
My biggest lessons from our conversation 👇 -
Mike Schroepfer reposted
Harry Stebbings
@HarryStebbings
I think @schrep is one of the greatest technologists of the last two decades:
📈 Scaled product to billions of users as former CTO of Meta
📦 Shipped millions of units of consumer hardware
👥 Led 35,000 people at Facebook
My biggest lessons from our conversation 👇 -
Mike Schroepfer
@schrep
One of the most exciting things out there right now.
I love that this is peer reviewed and published.
Commonwealth Fusion Systems
@CFS_energy
We’re revolutionizing #fusionenergy. Our High-Temperature Superconductor (HTS) magnets are:
✅ Tested and peer-reviewed
✅ Breaking world records with a 20 tesla field strength
✅ Reducing the cost per watt of a fusion power plant by a factor of almost 40
✅ Meeting the requirements for commercial fusion
Learn more: www.technologyreview.com/2024/04/23/1090425/mits-supercon… -
Mike Schroepfer
@schrep
Having just ridden a @Waymo in SF and a current model Y Uber in DC a few things are obvious:
1) self driving with lidar/expensive sensors is better than a human driver. Smoother ride, ability to see 360 degrees in astonishing detail. No fuss. This is here now.
2) @Tesla vision is impressive but not there yet. Went all in on cheaper vision based system. Amazing what they can see but also scary that it isn’t perfect. If vision only can be done Tesla has an interesting position. -
Mike Schroepfer
@schrep
Honest question what are the best cautionary tales of technology being deployed too quickly and if studied more or deployed more slowly would have been better?
-
Mike Schroepfer
@schrep
True Story!
One of the many reasons I love open source is it doesn't give a damn about the org chart or "managing up." If people outside of FB/Meta didn't use or like our OSS then something was wrong with it.
PyTorch succeeded because of the hyper focus on developer experience. @soumithchintala really set the example on this.
Jeremy Howard
@jeremyphoward
FB/Meta senior mgt has cared a lot about AI for many years. By way of example, here's a true story I haven't told before...
Do you remember when Zuck was giving testimony to congress in April 2018? I was watching it live, when the phone rang. It was the CTO of Facebook.This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Super fun recording a podcast with @kevin_scott today - we got to nerd out on everything from climate tech, to data centers, to llama2, to the early days of computer graphics. Can't wait to see it!
-
Mike Schroepfer reposted
Reid Hoffman
@reidhoffman
An exciting milestone for @inflectionAI and Pi users: Our latest model, Inflection-2.5, puts Pi up there with GPT-4 on all benchmarks. And yes, Pi is still curious and kind.
You can read more on @axios: www.axios.com/2024/03/07/inflection-ai-chatgpt-openai-com… -
Mike Schroepfer
@schrep
Deadline is approaching to apply to come work with me on climate tech investing this summer:
careers.gigascale.com/jobs/gigascale/621ebb0f-f18b-42a8-8… -
Mike Schroepfer
@schrep
🔥”Heating & cooling might sound basic, but after solar, it’s the next frontier in residential decarbonization.” - Techcrunch
Proud to be backing Arch - and they are hiring software engineers!
techcrunch.com/2024/02/15/arch-heat-pump-seed-round/ -
Mike Schroepfer
@schrep
Excited for @gigascale to work with @apartovi and @neo to help the next batch climate tech companies get started!
Neo
@neo
When you apply, opt to share your pitch with two dozen industry leaders who may invest alongside us from day one.
Cc @kayvz @Austen @blader @avichal @hadip @8en @ginab @jeffawilke @emilmichael @fkerrest @sasmith4 @avidl @amasad @RoxannePetraeus -
Mike Schroepfer
@schrep
One of the rare privileges of Gigascale Capital is we get to see the end-of-year updates of a wide range of climate tech companies from inception to pre-ipo. It is a sneak peak into a very exciting and different future than the doom and gloom that gets clicks.
I wish I could share them all because it would get you excited as well - but what I see is lots of steel in the ground, products you can buy right now, jobs being created, and most importantly companies that understand that learning rate is their key to success. They ask themselves every single day "how can I learn this quicker and cheaper."
Come build this future with me: careers.gigascale.com/jobs… -
Mike Schroepfer reposted
Andrew Ng
@AndrewYNg
When I think of existential risks to large parts of humanity:
* The next pandemic
* Climate change→massive depopulation
* Another asteroid
AI will be a key part of our solution. So if you want humanity to survive & thrive the next 1000 years, lets make AI go faster, not slower. -
Mike Schroepfer
@schrep
Come work on climate tech with me at Gigascale Capital!!
If you are experienced operator/executive in hard tech and but new to climate tech investing we are hiring a Visiting Partner: careers.gigascale.com/.../a6352337-829b-40f5-9c95...
If you are a former founder/CEO in any tech field and want to explore starting or joining a startup we are hiring a Visiting Entrepreneur: careers.gigascale.com/.../5f4263da-4d2d-4aed-9be1...
If you have a PHD in engineering or physical sciences and a few years of work experience we are hiring a Technical Associate:
careers.gigascale.com/.../fca41064-8d64-4086-b6ef...
If you have a bachelors in a technical or scientific field and a few years of work experience at a startup we are hiring an Associate:
careers.gigascale.com/.../62c6397c-2f8e-4004-a206...
If none of these are a fit there are 78 other open positions across our growing portfolio of kick ass climate tech companies. Companies like Mill, Dioxcycle, PastureBiosciences, and more:
careers.gigascale.com/jobs/gigascale
We’re helping scale solutions faster, building a killer business, and having a whole heck a lot of fun along the way.
TELL YOUR FRIENDS! -
Mike Schroepfer
@schrep
Yes we can build stuff fast. More here: www.linkedin.com/pulse/we-can-build-stuff-quickly-mike-sc…
-
Mike Schroepfer
@schrep
Big milestone - 10 years since we founded FAIR - everything from PyTorch to Segment Anything to LLama created here and available for all to use!
AI at Meta
@AIatMeta
10 years of FAIR.
10 years of advancing the state of the art in AI through open research.
We're celebrating the 10th anniversary of Meta's Fundamental AI Research team and continuing that legacy by sharing our work on three exciting new research projects today.
Details below 🧵 -
Mike Schroepfer
@schrep
Best proof yet we are not in a simulation. No programmer is *this* creative.
-
Mike Schroepfer
@schrep
Every experienced board member is having a day like when a blockbuster movie gets made about your profession.
-
Mike Schroepfer
@schrep
I was an exec at @mozilla when @Google decided that the browser was too critical to be run by a nonprofit they don’t control. Sounds a lot like @Microsoft and @OpenAI today. This is an unstable structure at its core. Hope all my friends over there are doing ok
-
Mike Schroepfer
@schrep
Documentary video of my configuring settings in the Google Workplace Admin Console.
youtu.be/LVLoc6FrLi0?t=97 -
Mike Schroepfer reposted
Diego Saez Gil
@dsaezgil
New study in @Nature by 220 scientists worldwide, finds:
🌎 Global forests have the potential to capture 226 GTns of additional carbon.
🌳 61% of this potential is in areas with existing forests, where they can recover to maturity.
🌱 The remaining 39% lies in regions in which forests have been removed or fragmented.
"Although forests cannot be a substitute for emissions reductions, our results support the idea that the conservation, restoration and sustainable management of diverse forests offer valuable contributions to meeting global climate and biodiversity targets."
www.nature.com/articles/s41586-023-06723-z -
Mike Schroepfer
@schrep
.@volvocars pls bring this to the US market! Would love to find an option for a fully electric minivan!
www.caranddriver.com/news/a45823115/volvo-em90-details/ -
Mike Schroepfer
@schrep
I can't wait to fly an electric taxi ride into NYC in the coming years!!! Congrats @jobyaviation !
www.jobyaviation.com/news/joby-flies-quiet-electric-air-t… -
Mike Schroepfer
@schrep
It’s an awesome time to be a climate investor. Why? The energy revolution is happening — and companies are innovating to be at the forefront. Thanks for taking the time to chat about @gigascale's investments and how we’re providing value to founders, @katiefehren!
Check out her full piece via Axios: www.axios.com/pro/climate-deals/2023/11/13/mike-schroepfe… -
Mike Schroepfer reposted
Sophie Purdom
@SophiePurdom
From @schrep and my chat at #verge2023
1) wait now, pay more later.
see: @stripe's frontier AMC
2) solutions are here already.
so: phone a founder
3) rollout actually happens quickly.
just ask: @Meta 20x datacenters in 10 yrs -
Mike Schroepfer
@schrep
Two common myths I wish we could bust r.e. climate change.
1) We can't build stuff fast enough. Nonsense. Have you paid attention to the rollout of datacenters or amazon warehouses in the few years? 20x scale of datacenters in ~10 years is what we did at @Meta
2) As a big co you can just wait and be a late adopter.
Once everyone figures out a change is happening there are massive supply shortages in key components. As any AI company how how easy it is for them to get GPUs in 2023?
More in my chat with @SophiePurdom at #verge2023
youtu.be/K2oGi1UH4Hw?t=67 -
Mike Schroepfer
@schrep
.@2ndharvest is a first rate org solving a huge problem in Silicon Valley. If you live here something you should really consider supporting...
Shobana Gubbi
@ShobanaGubbi
Please give what you can to ensure our neighbors have the basic need of nutritious food. Double your impact - donate today to Daffy campaigns of @reidhoffman or @schrep!
www.daffy.org/campaigns/feed-silicon-valley
Second Harvest of Silicon Valley
@2ndharvest
1 in 6 in Silicon Valley depends on @2ndharvest. Chief Philanthropy Officer, @ShobanaGubbi, notes that the increased need exceeds financial support. Consider volunteering, donating, or starting a virtual food drive this holiday season to help fill every table. #ourcommunitycan
-
Mike Schroepfer
@schrep
Was amazing to be there for this! Congrats @heirloomcarbon !!
Heirloom
@heirloomcarbon
The United States officially has its first commercial Direct Air Capture facility!
Today we welcomed U.S. Secretary of @ENERGY, Jennifer M Granholm, and California Lieutenant Governor, Eleni Kounalakis, to unveil a facility in our home state of California where we'll capture and lock away CO2 from the atmosphere.
Powered by 100% renewable energy supplied by PG&E and Ava Community Energy, constructed with union labor, backed by catalytic buyers of best-in-class carbon removal, and built in partnership with the City and community of Tracy, this first facility is our blueprint for responsible removal at billion-ton scale and beyond.
With a capture capacity of up to 1,000 tons per year, the CO2 captured at this facility will go for storage in concrete with our partner @CarbonCure so that it cannot continue heating the planet.
This facility is more than a labor of love from the engineers, researchers, chemists, construction workers, scientists, managers, assistants, policy wonks, and architects who made it possible –– it is a promise of what is possible when committed people come together to get things done, and a promise that we will keep building today, tomorrow, and every day after until we’ve realized our vision of a safer and more stable climate.
You can read more about the technology, partnerships, and people behind this facility here: www.heirloomcarbon.com/news/heirloom-unveils-americas-fir… -
Mike Schroepfer reposted
Heirloom
@heirloomcarbon
The United States officially has its first commercial Direct Air Capture facility!
Today we welcomed U.S. Secretary of @ENERGY, Jennifer M Granholm, and California Lieutenant Governor, Eleni Kounalakis, to unveil a facility in our home state of California where we'll capture and lock away CO2 from the atmosphere.
Powered by 100% renewable energy supplied by PG&E and Ava Community Energy, constructed with union labor, backed by catalytic buyers of best-in-class carbon removal, and built in partnership with the City and community of Tracy, this first facility is our blueprint for responsible removal at billion-ton scale and beyond.
With a capture capacity of up to 1,000 tons per year, the CO2 captured at this facility will go for storage in concrete with our partner @CarbonCure so that it cannot continue heating the planet.
This facility is more than a labor of love from the engineers, researchers, chemists, construction workers, scientists, managers, assistants, policy wonks, and architects who made it possible –– it is a promise of what is possible when committed people come together to get things done, and a promise that we will keep building today, tomorrow, and every day after until we’ve realized our vision of a safer and more stable climate.
You can read more about the technology, partnerships, and people behind this facility here: www.heirloomcarbon.com/news/heirloom-unveils-americas-fir… -
Mike Schroepfer
@schrep
Seeing the future! Here for the unveiling of the first commercial carbon capture plant in the us - so excited to be backing @heirloomcarbon and @ShashankSamala! Congrats on the launch!
-
Mike Schroepfer
@schrep
Big day at the @gigascale offices as our @mill composting device showed up. Amazing unboxing experience!
-
Mike Schroepfer
@schrep
If you're not deeply involved with climate entrepreneurs, it's easy to miss that we’re on the cusp of one of the most profound societal shifts since the industrial age. Thanks to @jtemple and @techreview for the energizing convo on how #climatetech innovators are creating options that are cleaner, cheaper, and just plain better for more people.
-
Mike Schroepfer
@schrep
Massive scale is needed to meet the climate crisis.
Tune in to the @greenbiz #verge23 livestream today at 3:30pm PST. @SophiePurdom and I are chatting about how to scale climate tech solutions faster. See you there!
Mike Schroepfer
@schrep
-
Mike Schroepfer
@schrep
As I walked into the room where the first commercially-relevant fusion machine is being built I had goosebumps. By harnessing the most energy dense reaction in the known universe @CFS_energy is ushering in a future source of unlimited clean energy.
Bob even more impressive than the boldness of their vision is their persistence through the everyday challenges of building a new company, a new factory, and a new fusion machine all at the same time. This stuff doesn’t just happen on its own - it takes teams of hardworking people grinding through problems big and small everyday. So inspiring!!!!! -
Mike Schroepfer
@schrep
This article captures a lot of my thinking on the need for climate innovation - thanks @adele_peters and @FastCompany
"I actually think technological breakthroughs are enabling a number of different products that are just better consumer products—where they save money and then they have this massive co-benefit of a dramatically reduced carbon footprint. Those are the businesses we’re looking for."
Fast Company
@FastCompany
Schroepfer knows it's going to take years—maybe decades—before some of this technology scales up, but he's optimistic. f-st.co/5WTVm4q
-
Mike Schroepfer
@schrep
Opening speaker @techreview #climatetech tomorrow with @jtemple. What do you want to hear about in the world of climate tech startups and science?
-
Mike Schroepfer
@schrep
Just me or is MacOS Bluetooth pairing nerfed to make AirPods seem so much better?
-
Mike Schroepfer
@schrep
Having seen earlier versions of this tech in the headset it is indeed the future
Lex Fridman
@lexfridman
Here's my conversation with Mark Zuckerberg, his 3rd time on the podcast, but this time we talked in the Metaverse as photorealistic avatars. This was one of the most incredible experiences of my life. It really felt like we were talking in-person, but we were miles apart 🤯 It's hard to put into words how awesome this was for someone like me who values the intimacy of in-person conversation. It gave me a glimpse of an exciting future with many new possibilities and fascinating questions about the nature of reality and human connection ❤
Timestamps:
0:00 - Introduction
0:52 - Metaverse
15:27 - Quest 3
30:16 - Nature of reality
34:54 - AI in the Metaverse
51:51 - Large language models
57:49 - Future of humanityThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Lex Fridman
@lexfridman
Here's my conversation with Mark Zuckerberg, his 3rd time on the podcast, but this time we talked in the Metaverse as photorealistic avatars. This was one of the most incredible experiences of my life. It really felt like we were talking in-person, but we were miles apart 🤯 It's hard to put into words how awesome this was for someone like me who values the intimacy of in-person conversation. It gave me a glimpse of an exciting future with many new possibilities and fascinating questions about the nature of reality and human connection ❤
Timestamps:
0:00 - Introduction
0:52 - Metaverse
15:27 - Quest 3
30:16 - Nature of reality
34:54 - AI in the Metaverse
51:51 - Large language models
57:49 - Future of humanityThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
Meta connect on campus!
-
Mike Schroepfer
@schrep
Great to join @Techonomy at Climate Week to talk solutions that scale. Technology creates better options. Shout out to @Mill for making composting less smelly and available to more people. And @sarahlamaison2 at Dixocycle for decarbonizing the materials that make up everyday products.
Techonomy
@techonomy
@worthmag's @DanCosta sat down with Gigascale Capital's + former Meta/Facebook CTO @schrep to talk "How to Hyperscale" at #techonomyclimate
-
Mike Schroepfer
@schrep
remember the first email/txt you sent from inflight wifi? something like “IM SENDING THIS FROM 35000 FEET IN A GIANT METAL TUBE GOING 500mph. this is awesome!”
Just ann no wifi on my flight to NYC along with a bunch of suggestions about how to cope.
How quickly we adapt…
Mike Schroepfer
@schrep
This is one of the reasons progress doesn’t always feel that way. What was new and amazing becomes something we assume is just the way the world works and get frustrated when it breaks. It’s like a glitch in the matrix
I bet for kids growing up now the idea that you can’t just
Mike Schroepfer
@schrep
Generate any image, video, or long form text you can think of a prompt for will be weird. Like “tell us what it was like before the internet” weird
-
Mike Schroepfer
@schrep
What @kevin_scott did to vault MSFT forward in #ai is really impressive. A lesson for CTOs everywhere that the job is to make sure your company has the tech in needs *not* to try to invent everything yourself ….
www.wsj.com/tech/ai/microsoft-ai-artificial-intelligence-… -
Mike Schroepfer
@schrep
Attending climate week in NYC next week - any must do events or people I should meet?
-
Mike Schroepfer
@schrep
Huge partnership between @AHAScience and @AdditionalVent to fund over $13M in research!
Additional Ventures @AdditionalVent
ICYMI: Together with @AHAScience, we have launched the AHA/AV Collaborative Sciences Awards in Single Ventricle, dedicating over $13M to support #singleventricle focused research 🫀
Learn more and apply: www.additionalventures.org/initiatives/biomedical-researc…
📆 Pre-Proposals (LOIs) are due December 19th! -
Mike Schroepfer
@schrep
Excited to speak at this in October!
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Saw a cybertruck today in Palo Alto with a big "RC" pained on it. Release candidate or remote control?
-
Mike Schroepfer
@schrep
Huge congrats to @sarahlamaison2 on closing their Series A!!It's the sort of company that got me into climate tech investing: new tech = existing product at lower price. Oh an by the way lower carbon. Thrilled to back this amazing team!
Mike Schroepfer
@schrep
More here: dioxycle.com/dioxycle-raises-17m-to-turn-co₂-emissions-in…
-
Mike Schroepfer
@schrep
This is a fantastic summary of why Llama2 is such a big deal in the AI community
Jim Fan
@DrJimFan
You'll soon see lots of "Llama just dethroned ChatGPT" or "OpenAI is so done" posts on Twitter. Before your timeline gets flooded, I'll share my notes:
▸ Llama-2 likely costs $20M+ to train. Meta has done an incredible service to the community by releasing the model with a commercially-friendly license. AI researchers from big companies were wary of Llama-1 due to licensing issues, but now I think many of them will jump on the ship and contribute their firepower.
▸ Meta's team did a human study on 4K prompts to evaluate Llama-2's helpfulness. They use "win rate" as a metric to compare models, in similar spirit as the Vicuna benchmark. 70B model roughly ties with GPT-3.5-0301, and performs noticeably stronger than Falcon, MPT, and Vicuna.
I trust these real human ratings more than academic benchmarks, because they typically capture the "in-the-wild vibe" better.
▸ Llama-2 is NOT yet at GPT-3.5 level, mainly because of its weak coding abilities. On "HumanEval" (standard coding benchmark), it isn't nearly as good as StarCoder or many other models specifically designed for coding. That being said, I have little doubt that Llama-2 will improve significantly thanks to its open weights.
▸ Meta's team goes above and beyond on AI safety issues. In fact, almost half of the paper is talking about safety guardrails, red-teaming, and evaluations. A round of applause for such responsible efforts!
In prior works, there's a thorny tradeoff between helpfulness and safety. Meta mitigates this by training 2 separate reward models. They aren't open-source yet, but would be extremely valuable to the community.
▸ I think Llama-2 will dramatically boost multimodal AI and robotics research. These fields need more than just blackbox access to an API.
So far, we have to convert the complex sensory signals (video, audio, 3D perception) to text description and then feed to an LLM, which is awkward and leads to huge information loss. It'd be much more effective to graft sensory modules directly on a strong LLM backbone.
▸ The whitepaper itself is a masterpiece. Unlike GPT-4's paper that shared very little info, Llama-2 spelled out the entire recipe, including model details, training stages, hardware, data pipeline, and annotation process. For example, there's a systematic analysis on the effect of RLHF with nice visualizations.
Quote sec 5.1: "We posit that the superior writing abilities of LLMs, as manifested in surpassing human annotators in certain tasks, are fundamentally driven by RLHF."
Congrats to the team again 🥂! Today is another delightful day in OSS AI. -
Mike Schroepfer
@schrep
This is indeed huge news in the world of AI! So excited to see this out in the world!
Yann LeCun
@ylecun
This is huge: Llama-v2 is open source, with a license that authorizes commercial use!
This is going to change the landscape of the LLM market.
Llama-v2 is available on Microsoft Azure and will be available on AWS, Hugging Face and other providers
Pretrained and fine-tuned models are available with 7B, 13B and 70B parameters.
Llama-2 website: ai.meta.com/llama/
Llama-2 paper: ai.meta.com/research/publications/llama-2-open-foundation…
A number of personalities from industry and academia have endorsed our open source approach: about.fb.com/news/2023/07/llama-2-statement-of-support/ -
Mike Schroepfer
@schrep
Awesome new product to make it easier to give! If you want to make it easier for your employees to give to charities check out @DaffyGiving’s workplace-giving platform daffy.org/work
-
Mike Schroepfer
@schrep
Huge day for climate tech! Big congrats to @SophiePurdom - been collaborating with her on climate tech for the last few years and thrilled to be investing in her new firm!
Sophie Purdom
@SophiePurdom
Announcing Planeteer Capital's first close & my reason for going "full climate tech VC" 🚀🌍👇
www.ctvc.co/planeteer-capital-launch/ -
Mike Schroepfer
@schrep
Awesome look into the day of the life of @ucsantabarbara ocean scientist Débora Iglesias-Rodriguez - a grantee of Carbon To Sea: chanzuckerberg.com/blog/day-in-the-life-oceanographer-deb…
-
Mike Schroepfer
@schrep
More on the announcements today from @jtemple www.technologyreview.com/2023/06/06/1074124/metas-former-…
-
Mike Schroepfer
@schrep
Carbon to Sea’s diverse group of funders each bring deep experience in ocean conservation, climate and R&D: @AdditionalVent, @AsteraInstitute, @BuildersVC, Catalyst for Impact, @ChanZuckerberg, @GrahamFound, Kissick Family Foundation, Oceankind, and @ThistledownFnd.
Mike Schroepfer
@schrep
The distinguished group of scientists who will serve as Carbon to Sea’s Scientific Advisory Board are @carlosduartephd, @DrOceanJulie, @David_Koweek, @sara_nawaz & @TakeshitaLab.
Post not available here, view on X
Mike Schroepfer
@schrep
Our Research grantees are working to determine how OAE can help the ocean safely remove CO₂ from the atmosphere: The Ocean Alk-align consortium lead by @KatjaFennel
at @DalhousieU, @WHOI, POaET at @HeriotWattUni, and the lab of Dr. Debora Iglesias Rodriguez at @ucsantabarbara.
Mike Schroepfer
@schrep
Our OAE Technology grantees are building prototypes to produce + deliver + monitor the effects of OAE at scale: @CrewCarbon + @ebbcarbon, Crystal Ocean, @PlanetaryOps, Aquatic Labs + @Scripps_Ocean, and @UofT + @McMasterU.
Mike Schroepfer
@schrep
So much work to do! I couldn’t be more excited to support these talented teams to find answers.
-
Mike Schroepfer
@schrep
Thrilled to announce that we at @AdditionalVent has created & spun out a $50M+ multi-funder, non-profit scientific research effort called the Carbon to Sea Initiative to advance one of the most promising ocean carbon dioxide removal pathways. www.linkedin.com/posts/schrep_activity-707220937864009728…
Mike Schroepfer
@schrep
.@IPCC_CH says “All pathways that limit global warming to 1.5°C with limited or no overshoot project the use of carbon dioxide removal (CDR) on the order of 100–1000 GtCO2 over the 21st century.”
Mike Schroepfer
@schrep
.@theNASEM has highlighted OAE as one of the highest potential ocean CDR pathways and more funding is needed. This program is answering the call to fund the thoughtful science needed to answer the key questions about OAE as a promising pathway for CDR.
-
Mike Schroepfer
@schrep
Realtime monitoring of emissions is something we can deploy at massive scale very fast to quickly reduce emissions. Solutions like @SailPlanAI are making an impact right now in shipping - lets get solutions like this deployed asap!
www.forbes.com/sites/gregorymcneal/2023/06/02/real-time-e… -
Mike Schroepfer
@schrep
Agreed! So many great product design choices in this van! Kinda wish I could get an adventure van designed by @Rivian - @RJScaringe ?? :)
Aiman Farooq @AimanFarooq
The Rivian/Amazon vans seem like a triumph of user-centered design. @DougDeMuro did a great video highlighting some of the intentional choices that went into them. www.youtube.com/watch?v=3CWCqJl0BEs
-
Mike Schroepfer
@schrep
This is an amazing community of founders and it’s been a lot of fun being part of it!
Neo
@neo
Joe Gebbia & Nate Blecharczyk (Airbnb founders) @jgebbia @nathanblec
Laura & Bob Muglia (Snowflake CEO) @Bob_Muglia
Max Levchin (Affirm, Paypal founder) @mlevchin
Mike Schroepfer (Gigascale Capital, Meta Senior Fellow) @schrep
Nellie Levchin (SciFi VC) @nlevchin
... /5 -
Mike Schroepfer reposted
Neo
@neo
We've raised $235 million in new funds from top tech leaders. /1
open.substack.com/pub/neo/p/neo-has-raised-235m-in-new-fu… -
Mike Schroepfer
@schrep
Looking for industrial customers with high heat needs interested in decarbonization/electrification. Anyone out there willing to talk about your needs?
-
Mike Schroepfer
@schrep
This is basically translating from spoken English to a fixed set of order options. Significantly easier than English->code except for the conversational parts. I expect to see a lot more of this wherever there is an order window or kiosk!
www.wsj.com/articles/wendys-google-train-next-generation-… -
Mike Schroepfer
@schrep
Finally automakers are getting serious about software - really awesome news for EV adoption. Congrats to @mabb0tt and $GM
Michael Wayland
@MikeWayland
$GM hires ex-Apple exec to lead new software unit cnb.cx/3M70Yc7
-
Mike Schroepfer reposted
Alex Volkov
@altryne
The demo link:
imagebind.metademolab.com/demo
It's... sure is something!
ImageBind can create audio from images (Sound ON) -
Mike Schroepfer
@schrep
It’s hard to think of a competitive moat bigger than @SpaceX
www.space.com/europe-no-reusable-rocket-until-2030s -
Mike Schroepfer
@schrep
Worth a read - important to understand your workload and design accordingly rather than just assuming hyped tech of the day is right for you - eg using microservices when a monolith is better www.primevideotech.com/video-streaming/scaling-up-the-pri…
-
Mike Schroepfer
@schrep
Big day! I’m teaming up with @VictoriaBeas + @EvalineTsai to launch @Gigascale Capital, a new kind of climate tech VC firm dedicated to investing in companies solving the climate crisis (thanks @CatClifford!) Come work with us!
www.cnbc.com/2023/05/02/former-facebook-cto-mike-schroepf… -
Mike Schroepfer
@schrep
Anyone willing to share how they are using segment-anything.com in their products?
-
Mike Schroepfer
@schrep
Really great to see @autodesk @hm @jpmorgan and @Workday pledge to buy carbon removal view Frontier and joining with @Meta and others!
Catherine Clifford
@CatClifford
.@autodesk, @hm, @jpmorgan, & @workday joined a slew of tech companies in buying carbon removal via Frontier (owned by @stripe). They're buying carbon removal in advance to spur the nascent industry. So far, over $1 billion has been purchased via Frontier. cnb.cx/43yXLZp
-
Mike Schroepfer
@schrep
Great to see @Thalolabs and @bhermalyn featured in the NYT. Proud to be an early backer of their efforts to decarbonize buildings!
www.nytimes.com/2023/04/06/nyregion/brooklyn-navy-yard-gr… -
Mike Schroepfer reposted
Guillaume Lample @ NeurIPS 2024
@GuillaumeLample
Today we release LLaMA, 4 foundation models ranging from 7B to 65B parameters.
LLaMA-13B outperforms OPT and GPT-3 175B on most benchmarks. LLaMA-65B is competitive with Chinchilla 70B and PaLM 540B.
The weights for all models are open and available at research.facebook.com/publications/llama-open-and-efficie…
1/n -
Mike Schroepfer
@schrep
If you are paying attention to AI you should follow this - the core advance powering many AI powered experiences is a foundational model. These are very difficult and expensive to train - so access is limited. This brings state of the art models to the entire research community
Mike Schroepfer
@schrep
2 important details:
a) Shows that smaller models trained with more data can outperform larger models (e.g. 13B outperforms GPT-3 175B)
2) The "larger" 65B model is competitive with best models - and is freely available to the research community!
research.facebook.com/publications/llama-open-and-efficie… -
Mike Schroepfer
@schrep
2 important details:
a) Shows that smaller models trained with more data can outperform larger models (e.g. 13B outperforms GPT-3 175B)
2) The "larger" 65B model is competitive with best models - and is freely available to the research community!
research.facebook.com/publications/llama-open-and-efficie… -
Mike Schroepfer
@schrep
This doc on the history of React reminded me of one of the big lessons I’ve learned as a technical leader. It was 2012 & FB stock had crashed to almost half its IPO price. We decided to rewrite our ads manager, using a fairly new tech we’d developed…
youtu.be/8pDqJVdNa44Post not available here, view on X
Mike Schroepfer
@schrep
I gave our teams simple instructions: make the right technical choice, and make the right long term choice — and if there are short term consequences, I’ll back you up. If you need months to do a rewrite, do it.
Mike Schroepfer
@schrep
This is what technical leaders need to do. You can't just encourage people to think long term, you need to transfer the risks of long term work — or perceived risks — from them to you. Nobody makes great decisions when they’re afraid of failure or focused on the short term
Mike Schroepfer
@schrep
Every major technology I’ve overseen, from React to PyTorch, had moments like this. It’s not easy, for the teams or for leaders. But it’s how people do their best work, and it’s where the magic happens. The story of React is an awesome example of this:
youtu.be/8pDqJVdNa44 -
Mike Schroepfer
@schrep
This is a really exciting milestone. Captured CO2 permanently sequestered into concrete.
66lbs of CO2 down, billions to go! Congrats to the @heirloomcarbon team!!
Heirloom
@heirloomcarbon
In a world first, we captured CO2 from the atmosphere using our DAC technology & permanently sequestered it in concrete with @CarbonCure to ensure it never returns to the atmosphere. www.reuters.com/business/sustainable-business/concrete-tr…
-
Mike Schroepfer
@schrep
Best HR/Payroll provider for startups? Gusto?
-
Mike Schroepfer
@schrep
This is huge! Such an obvious target for electrification that will save massive amounts over the long run in maintenance and fuel costs. Not to mention reducing pollution.
electrek.co/2022/12/20/us-postal-service-commits-to-buyin… -
Mike Schroepfer
@schrep
Unpopular opinion. Self-driving will progress rapidly in the next few years.
blog.waymo.com/2022/12/wheels-up-for-waymo-as-we-expand.html -
Mike Schroepfer
@schrep
Millions of innocent people are being forced from their homes around the world because of wars.
This #givingtuesday I’m supporting @IRC who support so many refugees & displaced families.
Join me on @DaffyGiving
www.daffy.org/schrep -
Mike Schroepfer
@schrep
State of the art AI model running at 20 million queries per second, 800 billion queries per day. This work enabling use of foundational models at Meta scale is one of the projects I’m most proud of - learn more about how it was done ai.facebook.com/blog/multiray-large-scale-AI-models
-
Mike Schroepfer reposted
Noam Brown
@polynoamial
We made an AI that persuades, coordinates, and negotiates with real humans *in natural language* in Diplomacy! Here's a 🧵 of dialogue examples with real human players. To put it mildly, players were surprised when they learned their conversations had been with an AI, not humans!
Noam Brown
@polynoamial
3 years ago my teammates and I set out toward a goal that seemed like science fiction: to build an AI that could strategically outnegotiate humans *in natural language* in Diplomacy. Today, I’m excited to share our Science paper showing we’ve succeeded! 🧵
AI at Meta
@AIatMeta
Meta AI presents CICERO — the first AI to achieve human-level performance in Diplomacy, a strategy game which requires building trust, negotiating and cooperating with multiple players.
Learn more about #cicerobymetaai: ai.meta.com/blog/cicero-ai-negotiates-persuades-and-coope… -
Mike Schroepfer
@schrep
AI advancement!
Diplomacy both more complicated than games like chess or Go (10^20 possible moves on a turn vs. ~361 in Go) and the AI agent needs to negotiate with human players using natural language
www.science.org/doi/10.1126/science.ade9097
Mike Schroepfer
@schrep
We’ve seen language models capable of generating convincing dialogue, but here our researchers combined that with a strategic reasoning engine capable of working towards a goal based on what other people are saying and doing. Here’s more on how it works:
ai.facebook.com/blog/cicero-ai-negotiates-persuades-and-c… -
Mike Schroepfer reposted
Yann LeCun
@ylecun
This tool is to paper writing as driving assistance is to driving.
It won't write papers automatically for you, but it will greatly reduce your cognitive load while you write them.
Yann LeCun
@ylecun
A Large Language Model trained on scientific papers.
Type a text and galactica.ai will generate a paper with relevant references, formulas, and everything.
Amazing work by @MetaAI / @paperswithcode
Papers with Code
@paperswithcode
🪐 Introducing Galactica. A large language model for science.
Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more.
Explore and get weights: galactica.org -
Mike Schroepfer reposted
Sergei Kalinin
@Sergei_Imaging
The new language model for science galactica.org. Upon few quick tries, it seems to generate professional text in the areas I am familiar with. And 7 years ago we were *joking* about ML writing papers!
-
Mike Schroepfer
@schrep
Incredible application of AI: summarize academic literature, generate wiki articles!!
Papers with Code
@paperswithcode
🪐 Introducing Galactica. A large language model for science.
Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more.
Explore and get weights: galactica.org -
Mike Schroepfer
@schrep
AI advancements fueling better recycling/resource recovery is hugely exiting: www.therobotreport.com/amp-robotics-recycling-robots-brin…
Mike Schroepfer
@schrep
This is fundamentally a sensing/perception problem which has made the earliest and most advancement since 2013 - excited to see these general advancements be applied to a much larger variety of fields
-
Mike Schroepfer
@schrep
Another advancement in AI …
AI at Meta
@AIatMeta
Using HyperTree Proof Search we created a new neural theorem solver that was able to solve 5x more International Math Olympiad problems than any previous AI system & best previous state-of-the-art systems on miniF2F & Metamath.
More in our new post ⬇️ -
Mike Schroepfer
@schrep
Yet another example of stunning advances: our researchers built an AI model that predicts protein structures 60X faster than existing state of the art - it took two weeks for it to create the largest database of protein structures ever assembled
ai.facebook.com/blog/protein-folding-esmfold-metagenomics/. . ...
Mike Schroepfer
@schrep
We’re releasing the model, the database, and an API for researchers. AI is revolutionizing scientific discovery, and we’re just getting started
esmatlas.com -
Mike Schroepfer reposted
Suhail
@Suhail
Amazing.
Using AI to compress audio files for quick and easy sharing: ai.facebook.com/blog/ai-powered-audio-compression-technique/ -
Mike Schroepfer
@schrep
So many high quality founders building non-zero sum answers to the climate crisis at #toughtechsummit. Food ground in waste water, melting rocks with mmWave, near zero loss power lines, serious conversations about *when* not if for Fusion... 1/n
Post not available here, view on X
Mike Schroepfer
@schrep
Much has been said of the "PayPal" mafia - well there is an increasing pool of people from SpaceX, Tesla, Blue Origin, Apple, Amazon, Meta etc who know how do to 0-1 and more importantly 1->scale out hardware product development and yes there are lessons 5/n
Mike Schroepfer
@schrep
from the hyperscalers as well. Also the "we don't know how to build stuff anymore" is nonsense. More to say on both of these topics shortly. Important to be patient, rigorous, and realistic - but the prizes at the end for humanity and investors - are massive.
-
Mike Schroepfer
@schrep
Any commercial property developers out there exploring geothermal for heating/cooling?
-
Mike Schroepfer
@schrep
Leading a session on building a strong CTO/CEO working relationship at the #toughtech summit hosted by @enginexyz - what would you want to know or share about this topic?
-
Mike Schroepfer
@schrep
Just finished reading the Broken Earth Trilogy by @nkjemisin. Read very slow because I didn't want it to end. Best read in a long long time. Thank you to the amazing author. Any recommendations for what to read next?
-
Mike Schroepfer
@schrep
Just had a great conversation with 20+ climate companies at @ClimateDraft on how to scale and lead eng organizations. Will share some of the lessons and stories here in the near future
-
Mike Schroepfer reposted
Soumith Chintala
@soumithchintala
We just released AITemplate -- a high-performance Inference Engine -- similar to TensorRT but open-source.
It is really fast!
On StableDiffusion, it is 2.5x faster than the XLA based version released last week.
AI at Meta
@AIatMeta
Get faster, more flexible inference on GPUs using our newly open-sourced AITemplate, a revolutionary new inference engine that delivers up to 12X performance improvements on NVIDIA GPUs & 4X on AMD GPUs compared to eager-mode within Pytorch.
Learn more: ai.facebook.com/blog/gpu-inference-engine-nvidia-amd-open… -
Mike Schroepfer
@schrep
Very exciting progress!
Ben Blaiszik
@BenBlaiszik
It's been a wild week already in #ml/#ai for science. Advancements in using diffusion models for protein folding, using learned potentials to discover new catalyst materials, a proposed battery data genome to speed energy storage material discovery, and so much more! 🧵 (1/8)
-
Mike Schroepfer
@schrep
Since you didn't like my robot video how about "basilisk lizard running on water" @MetaAIMakes
-
Mike Schroepfer
@schrep
Saw this pitch live this morning - such a great idea to increase access to mental health resources - congrats on the launch @megan_rozanski1!!
Megan Rozanski @megan_rozanski1
SO excited to finally share what
@HaveTheDeetz and I have been working on for months!! Mind and Match exists to help anyone, anywhere find the right mental health professional for themThis post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Excited to combine this with Make-A-Video in the future to be able to construct full video and audio sequences from a text prompt...
Felix Kreuk @FelixKreuk
We present “AudioGen: Textually Guided Audio Generation”!
AudioGen is an autoregressive transformer LM that synthesizes general audio conditioned on text (Text-to-Audio).
📖 Paper: tinyurl.com/audiogen-text2audio/paper.pdf
🎵 Samples: felixkreuk.github.io/audiogen/
💻 Code & models - soon!
(1/n) -
Mike Schroepfer
@schrep
prompt: "A robot heroically walking in the rain, at night, in urban city, cinematic, 4k, sharp focus, emitting diodes, smoke, artillery, sparks, racks, system unit, matte painting, 4k resolution blade runner"
Let me know if you have other Make-A-Video requests! -
Mike Schroepfer
@schrep
Any prompts you'd love to try for Make-A-Video?
-
Mike Schroepfer
@schrep
More fun AI generated videos :)
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
"Robot Dancing in Times Square" input to Make-a-video which can generate 5s videos from a text prompt. CRAZY cool! makeavideo.studio
-
Mike Schroepfer
@schrep
I generally disregard correlational studies but this one confirms my deep love of coffee so it is great.
Eric Topol
@EricTopol
Coffee lovers will love this new report ;-)
academic.oup.com/eurjpc/advance-article/doi/10.1093/eurjp…
@escardio @BakerResearchAu @uk_biobank
☕️☕️☕️ -
Mike Schroepfer reposted
PyTorch
@PyTorch
Two creators of passion projects that transformed the landscape of how we code today — Linus Torvalds and @soumithchintala meet for the first time, sharing a smile and a love for the open source community. #pytorchfoundation
-
Mike Schroepfer reposted
PyTorch
@PyTorch
(1/2) This Schrep Tech episode celebrates PyTorch’s 5th anniversary. As we look back, learn about the two main motivations behind creating PyTorch, and then catch the full episode with host @schrep and guests @soumithchintala, @ylecun and Lin Qiao: www.youtube.com/watch?v=r7qB7mKJOFk
-
Mike Schroepfer
@schrep
A big moment for a key piece of open infrastructure powering the AI revolution. Introducing the #pytorchfoundation!
ai.facebook.com/blog/pytorch-foundation/Post not available here, view on X
Mike Schroepfer
@schrep
This is part of a long history of Meta engineers building foundational tech—when web frameworks were hard, we built & open sourced React. For mobile, React Native. When data centers needed to scale, we open sourced data center hardware & design with the Open Compute Project
Mike Schroepfer
@schrep
I’m really proud to have been able to lead this work driving open infrastructure that powered the web, mobile, and now AI revolutions. And I’ll be PyTorch’s number one supporter as it thrives as a true community project as part of the Linux Foundation.
-
Mike Schroepfer
@schrep
Pumped to be an investor and supporter of @SailPlanAI. They are driving meaningful improvements in monitoring and reducing emissions in shipping. So much low hanging fruit to help reduce emissions and save money along the way! Nice work @JacobRuytenbeek !
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Many ML/AI advances are going to as a result of smarter data engineering. Crawl all the data out there and become smarter is going to be more an more pre-process the data to find the highest quality, most outlier generating bits and train on that.
AI at Meta
@AIatMeta
Models are increasingly data hungry, but do we really need all that data? @SuryaGanguli, @arimorcos and team show, in theory and practice, that we can beat power law scaling and achieve exponential scaling re: data if we can appropriately rank the importance of each datapoint.
-
Mike Schroepfer
@schrep
Favorite kid + climate joke: solar panel asks a wind turbine what kind of music are you into?
wait for it...
I'm a big metal fan
:) -
Mike Schroepfer reposted
Joelle Pineau
@joellepineau
This seems worthy of a first tweet! BB3 is the first 175B param, publicly available chatbot, with model weights, code, datasets, model cards, and focus on safety & explainability. See the Meta AI blog for more ai.facebook.com/blog/blenderbot-3-a-175b-parameter-public…. And try out the demo blenderbot.ai
-
Mike Schroepfer
@schrep
There's been a lot of discussion about chatbots lately but most people haven't had access to them. So here's a large scale chatbot with a public demo + code and datasets for researchers and others to get a sense of what this technology can do.
AI at Meta
@AIatMeta
(1/4) Meet BlenderBot 3, the first publicly available 175B-parameter chatbot with model weights, code & datasets. It can chat about nearly any topic & is designed to learn & improve by conversing with people in the real world.
Try the interactive demo: ai.facebook.com/blog/blenderbot-3-a-175b-parameter-public… -
Mike Schroepfer
@schrep
This is a great example of how AI can help people. Building language translation between any one of 200 languages - true Sci-fi like stuff coming to reality. Check out my conversations with Necip Fazil Ayan at @MetaAI
AI at Meta
@AIatMeta
What if the internet was a place where everyone could communicate with anyone? In this short clip, @Schrep and Necip Fazil Ayan talk about #nllb and opportunities of the future where people could consume any info on the internet. Watch their full convo: www.youtube.com/watch?v=xbDZRy8pH8E
-
Mike Schroepfer
@schrep
It was fun to talk to @CatClifford about my focus on climate change. Optimism with rigor. Philanthropy to fund scientific research and investing + 25 years of operating exp to scale new co's w/ massive positive climate impact. We need everyone's help! cnb.cx/3cT9RXq
-
Mike Schroepfer
@schrep
This is truly impressive work and a great example of AI making fundamental advancements that will have positive impacts for decades to come. Congrats @demishassabis and the @DeepMind team!
Demis Hassabis
@demishassabis
A year ago we open-sourced #alphafold
Today we're freely sharing the predicted structures of all 200M+ proteins known to science - almost the entire protein universe!
It's our gift to humanity, and a demonstration of the benefits AI can bring to society
dpmd.ai/AF-22-LI -
Mike Schroepfer
@schrep
I didn't even realize we had leap seconds but our teams have a convincing augment as to why they should be left behind!
engineering.fb.com/2022/07/25/production-engineering/its-… -
Mike Schroepfer
@schrep
This is very exciting - huge congrats to @ilangur!! He has done wonders getting science out of the lab and into the world via @activatefellows and now will do so at 10x the scale. YES!
Ilan Gur
@ilangur
Today, @activatefellows & UK government announced my appointment as founding CEO of the Advanced Research and Invention Agency (ARIA). With an £800M initial funding commitment, ARIA will support ground-breaking R&D to transform society for the better. /1
www.activate.org/ilan-gur-to-lead-uk-innovation-agency -
Mike Schroepfer
@schrep
Human's assisted by AI is going to be a huge driver of productivity and prosperity. So cool to see this applied to creative pursuits!
AI at Meta
@AIatMeta
Excited to announce Make-A-Scene, our latest research tool Mark Zuckerberg just shared. Make-A-Scene is an exploratory concept that gives creative control to anyone, artists & non-artists alike to use both text & sketches to guide AI image generation: ai.facebook.com/blog/greater-creative-control-for-ai-imag…
-
Mike Schroepfer
@schrep
This is a cautionary tale in outsourcing your R&D to suppliers. I bet if car manufactures did more of their design in house they’d need an order of magnitude fewer chips
Stephen Shankland
@stshank
For Volkswagen, semiconductors used to be just a relatively inexpensive component. Now it's the gating factor that keeps the company from selling cars, says engineering leader Berthold Hellenthal at Semicon West. A Porsche Taycan now has 8000 chips inside. Thread 1/n
-
Mike Schroepfer reposted
Antoine Bordes @AntoineBordes
Today we open-source No Language Left Behind: a single model that translates 200 languages. Game changer for people that could not access information because of language barrier. Part of the AI system already powering 25 billion translations every day across @meta platforms!
-
Mike Schroepfer
@schrep
Pretty excited to get closer and closer to the universal translator from Star Trek. Can translate between any one of 200 Languages! Code and models available for free!
Yann LeCun
@ylecun
"No Language Left Behind."
An open-source language translation system from FAIR capable of translating 200 languages between each other.
50 billion parameters.
The code and models are made available today as part of the Fairseq package.
Github: github.com/facebookresearch/fairseq/tree/nllb
1/nThis post is unavailable. See it on X. -
Mike Schroepfer
@schrep
I sat between Sheryl and Mark for over 13 years and worked closely with her through all the highs and lows at Facebook/Meta, so let me share a few of the important bits that people need to know about her:
Post not available here, view on X
Mike Schroepfer
@schrep
You don’t grow a business by 430x to annual revenues of $118 billion w/o top .01% people *and* execution skills. That should be obvious to anyone. But what is more obvious to those close to her is how much she cares about the positive impact of her work and the people around her.
Mike Schroepfer
@schrep
She has always been there for me as a friend. What’s likely most surprising critics is that she’s always asking in those private moments how she can be better or do more for others: whether that be a close friend or someone she’s never met. I wish more people knew this about her.
-
Mike Schroepfer
@schrep
Some big news here: FAIR, Meta’s amazing AI research lab, is joining forces with Reality Labs Research, which is inventing the technologies needed for the future of computing. An awesome combination of fundamental and applied research:
ai.facebook.com/blog/building-with-ai-across-all-of-meta/Post not available here, view on X
Mike Schroepfer
@schrep
That’s why putting a research lab at the heart of our AI efforts, and bringing @ylecun, Joelle Pineau and @AntoineBordes to lead, was one of the best decisions Meta ever made. Having an ultra-fast pipeline from AI research to better products at scale has been game changing
Mike Schroepfer
@schrep
And finally: Meta’s AI teams wouldn’t be where they are today without @an_open_mind, a brilliant thinker and leader who I’ve loved working with over many years. I can’t wait to see what he does next.
-
Mike Schroepfer reposted
Ocean Visions
@Ocean_Visions
ANNOUNCEMENT: @AdditionalVent is working with Ocean Visions and philanthropic partners to fund solutions that could enable safe and scalable #oea. Up to $1.5M per team. Pre‐proposal deadline is 7/15/22. See details: oceanvisions.org/rfp2oae
#oceanclimateaction
#cdr -
Mike Schroepfer
@schrep
Now accepting pre-proposals to get between $750k-$1.5M of funding each to develop prototypes that could enable safe, cost-efficient, and scalable OAE as a potential method for large-scale carbon dioxide removal (CDR). Tell your friends to apply!
www.additionalventures.org/news/announcing-the-ocean-alka… -
Mike Schroepfer
@schrep
Computers make mistakes!
That’s the shocking finding from running at a million machine scale.
Every day Meta pulls machines out of use because they return incorrect results…they literally just get the math wrong sometimes!
arxiv.org/abs/2203.08989Post not available here, view on X
Mike Schroepfer
@schrep
This is one of many reasons why it is hard to explain how painful scaling up is. Events that are 1/1,000,000 become daily occurrences. If you were a startup no investor would ask you “do you have a silent errors detection team” but…
Mike Schroepfer
@schrep
That’s exactly what Meta has. We run tests in production every day on every machine, as well as a more intensive test any time we do maintenance - sort of like the multipoint inspection you get when you take your car in for an oil change engineering.fb.com/2022/03/17/production-engineering/sile…
-
Mike Schroepfer
@schrep
Don't lose the key message: focus on solving a real problem in a massive and growing segment. We raised 2 rounds after dotcom crash because a) we had paying customers and b) we were riding a wave of growth in servers. Downturns can be great times to startup more stories follow…
Mike Schroepfer
@schrep
Nobody can predict what is going to happen over the next 12 months but we haven't had a real bad tech downturn since 2000 (2008 terrible for lots of other folks but nbd for tech) let me tell you what starting a company in 2000 was like..
Manish Singh
@refsrc
YC's message to founders:
Post not available here, view on X
Mike Schroepfer
@schrep
If you have a great team, attacking a problem of real value, in a growing market, with a solution that will work (technically and economically) then you've got a real shot. This is why I'm so excited now to be focusing my time and energy supporting climate focused companies...
Mike Schroepfer
@schrep
Because whatever happens in the market there are a lot of great businesses to be built that will make our lives better and more prosperous, and help the planet along the way. I'm hopeful what is happening now is the SNR goes back up and we can all get back to building...
-
Mike Schroepfer
@schrep
Nobody can predict what is going to happen over the next 12 months but we haven't had a real bad tech downturn since 2000 (2008 terrible for lots of other folks but nbd for tech) let me tell you what starting a company in 2000 was like..
Manish Singh
@refsrc
YC's message to founders:
Post not available here, view on X
Mike Schroepfer
@schrep
But we raised money somehow in Q4 of 2000 from @sequoia. Raising money then was weird – like zombie apocalypse weird – VC offices are full of glass conference rooms, and we were often the *only* people in the offices. I think we were the only SW deal Sequoia did in Q4 of 2000…
Mike Schroepfer
@schrep
Then the spreadsheets came. Full of assets from bankrupt companies their creditors wanted to sell us. Normal stuff like aeron chairs, Sun servers, and cisco switches. Also, weird stuff like DJ stations on 55” Plasma Screens (which were like $5k back then!) Lots of these...
Post not available here, view on X
Mike Schroepfer
@schrep
Until you’ve been a founder or small business owner it is hard to describe the awful pit-in-the-stomach feeling of “if this doesn’t come through, I can’t make payroll.”
Mike Schroepfer
@schrep
I have no idea if now is going to be the same, better, or worse than the 2000s crash. But bad times can last multiple years and if you can make decisions now that extend your runway that’s probably the right call
-
Mike Schroepfer
@schrep
The @MetaQuestVR was not designed with hardware to do hand tracking. We made it work anyway.
It is a really good example of how innovation actually happens which isn't what you see in the movies...
🧵
www.youtube.com/watch?v=frG4fM5Df_APost not available here, view on X
Mike Schroepfer
@schrep
Notice that the datacenters all look the same? We build several H-shaped buildings on a site, and those same buildings in every site we can (except for Singapore but that's for a future post)....
www.datacenterknowledge.com/meta-facebook/meta-adding-thr…
Mike Schroepfer
@schrep
Anyway in sum: optimize for learning rate and depend on technologies that are also improving at a rapid clip. Also VR is just getting started as learning rates compound :) Happy Thursday!
-
Mike Schroepfer
@schrep
Combines three things I love: 1) AI 2) Reducing Carbon Emissions 3) actually deploying stuff in the real world. @MetaAI developing lower carbon concrete in use for one of our datacenters
www.npr.org/2022/05/18/1099680622/can-a-new-concrete-mixt… -
Mike Schroepfer reposted
PyTorch
@PyTorch
We’re excited to announce support for GPU-accelerated PyTorch training on Mac! Now you can take advantage of Apple silicon GPUs to perform ML workflows like prototyping and fine-tuning. Learn more: pytorch.org/blog/introducing-accelerated-pytorch-training…
-
Mike Schroepfer
@schrep
Excited to be among the backers of @perennialearth (formerly Cloud Agronomics). There are a lot of promising techniques to increase carbon capture in soil on farms but they need measurement in order to make the $$ work. Congrats Perennial!
Perennial
@perennialearth
Today, Perennial (formerly Cloud Agronomics) is announcing our $18M Series A funding round with investments from Temasek, Bloomberg, SineWave Ventures, and the Microsoft Climate Innovation Fund.
Read here to learn more: www.perennial.earth/post/perennial-series-a-press-release -
Mike Schroepfer
@schrep
Openness in action. We released the largest ever open language model, within a week @huggingface has it up and available for anyone to use! Nice work @MetaAI and @huggingface !
Hugging Face
@huggingface
Last week @MetaAI publicly released huge LMs, with up to ☄️30B parameters. Great win for Open-Source🎉
These checkpoints are now in 🤗transformers!
But how to use such big checkpoints?
Introducing Accelerate and
⚡️BIG MODEL INFERENCE⚡️
Load & USE the 30B model in colab (!)⬇️ -
Mike Schroepfer
@schrep
Only in Silicon Valley: conversation at lunch veers into programming handles and memory management in 1990s era MacOS - person at next table leans over and says “I wrote the memory manager for that macOS” 😂
-
Mike Schroepfer
@schrep
Behind the scenes on what it takes to train a state of the art language model - 100 pages of raw notes released with the 175B parameter large language model OPT-175. There's a lot more trial and error than people like to admit in modern AI
github.com/facebookresearch/metaseq/blob/main/projects/OP… -
Mike Schroepfer
@schrep
Heard of advances in AI called Large Language models - e.g. GPT-2/3? Up till now only researchers at a handful of large companies could actually see what was behind the curtain. Now Meta AI has released a fully trained model for researchers...
www.technologyreview.com/2022/05/03/1051691/meta-ai-large…
Mike Schroepfer
@schrep
to examine. Not only that 100 pages (!!) of notes on how the model was trained to assist others in training these models themselves. This is a huge step forward for Open Research in AI!
-
Mike Schroepfer
@schrep
Earth day is coming up - so I spoke with Larry Zitnick, a Meta researcher working on Open Catalyst, an awesome project using AI to speed up the discovery of new materials needed for renewable energy storage youtu.be/2JspoyMQn6s
Mike Schroepfer
@schrep
Here's more on how AI is helping accelerate the development of the technologies we need to address the climate crisis ai.facebook.com/blog/how-ai-is-helping-address-the-climat…
-
Mike Schroepfer
@schrep
A great interview with @nanransohoff by @SophiePurdom - must read if you want to understand more about Carbon Removal
🌏 A new frontier for drawing carbon down climatetechvc.substack.com/p/-a-new-frontier-for-drawing-… -
Mike Schroepfer
@schrep
must read - @robinsonmeyer does a great job of explaining why @nanransohoff scaling carbon purchases by 60x and guaranteeing off take agreements upfront will catalyze investment in this space
Nan Ransohoff
@nanransohoff
Excellent overview of Frontier, our carbon removal AMC, from @robinsonmeyer at @TheAtlantic:
www.theatlantic.com/science/archive/2022/04/big-tech-inve…
Mike Schroepfer
@schrep
There’s a long history of using collective funding to jumpstart new industries: semiconductors, vaccines, electric vehicles. We need approaches like this to tackle climate problems
-
Mike Schroepfer
@schrep
IMHO we are going to see an explosion of applications of robotics outside of factories of the next decade. Indoor navigation used to be the stuff of research conferences and now it is mostly solved...
www.mobihealthnews.com/news/diligent-robotics-scores-more… -
Mike Schroepfer
@schrep
This is huge and I'm super proud @Meta is a launch partner. Even the most conservative climate models say we need to take carbon dioxide out of the atmosphere to avert the worst of the climate crisis. Many cool technologies exist but they don't have a market for their product..
Mike Schroepfer
@schrep
This is a bunch of forward leaning orgs saying "if you build it we will buy it" which will help these new technologies get the investment they need to scale and bring the cost down. It is just the beginning - a huge and important step. Congrats to @nanransohoff for launching!
-
Post not available here, view on X
Mike Schroepfer
@schrep
Why carbon removal? It’s now clear that to avoid the worst impacts of climate change, we’ll need to do more than just reduce carbon emissions — we also need to remove billions of tons of CO2 that’s already in the air. The technology to do that at scale doesn’t exist…yet.
-
Mike Schroepfer
@schrep
I’ve officially transitioned from Meta CTO->Senior Fellow—a part-time role focused on supporting strategic tech initiatives. I’ll be particularly focused on AI, which is the engine of so much of what we’re building. Congrats to @boztank for stepping into the CTO role!
Mike Schroepfer
@schrep
Outside Meta I’ll devote more of my time & resources to working on the climate crisis, both as an early stage climate tech investor, and by doubling down on philanthropic work to advance early-stage scientific research (such as www.additionalventures.org/initiatives/climate-action/oce…)
Mike Schroepfer
@schrep
Excited to use 25 years of experience in scaling teams from 0->30,000+, building real world stuff like datacenters and consumer hardware, and driving long term R&D, to decarbonize everything. There are few places where tech can play a bigger role in creating a better future
Mike Schroepfer
@schrep
I’ll still be tweeting here about tech and AI advancements, plus a lot more on climate related stuff!
-
Mike Schroepfer reposted
Nan Ransohoff
@nanransohoff
Summary from @jtemple of CDR takeaways from the IPCC report:
1. Carbon removal is basically non-optional
2. We’re going to need to do a whole lot of it
3. We need a portfolio of carbon removal options
4. Scaling up will require funding and policy decisions
www.technologyreview.com/2022/04/04/1048832/un-climate-re… -
Mike Schroepfer
@schrep
Climate + AI Twitter: what's the most promising applications of AI in climate you've seen or want to see?
-
Mike Schroepfer
@schrep
Three interesting things the latest @nvidia chips say about where things are in AI and where they are going:
www.anandtech.com/show/17327/nvidia-hopper-gpu-architectu…Post not available here, view on X
Mike Schroepfer
@schrep
2) 700W (!) of cooling needed. Thermals are going to be the biggest problem to continue to scale this up. Doing this a few more cycles is going to be fun/challenging. Doing it 10 more times is gonna require some new approaches
Mike Schroepfer
@schrep
3) Interesting to be marketing optimizations for Transformer networks in the chip. As much as I love the transformers (both the network and the robots!) what's the chance it is the arch of choice in 5 years?
-
Mike Schroepfer
@schrep
~7-8 years ago we were just getting Supervised Learning to work and @ylecun told us to focus on Self Supervision as the current approach wouldn't scale. Took us a bit to catch-up so I'd listen to him this time:)
ai.facebook.com/blog/yann-lecun-advances-in-ai-research/ -
Mike Schroepfer
@schrep
Universal translator from @StarTrek is within our reach if we focus on it. Access any information, speak to any person, regardless of your native language. So awesome #ai
ai.facebook.com/blog/teaching-ai-to-translate-100s-of-spo… -
Mike Schroepfer
@schrep
Meta is now the second largest buyer of clean energy in the US on this ranking, up from #5 last year. Glad to see many companies putting money to work to get renewable energy online. cebuyers.org/blog/clean-energy-buyers-association-announc…
-
Mike Schroepfer
@schrep
If you’re interested in the future of AI, don’t miss this: we’ll be sharing some incredible research breakthroughs, plus a debate on the path to human-level intelligence featuring @ylecun, @lexfridman and Yoshua Bengio! ai.facebook.com/events/inside-the-lab
Post not available here, view on X
Mike Schroepfer
@schrep
There’s more: Jacqueline Pan and @tvr2c will show some new approaches to building AI responsibly, and @eerichka will share our approach to open science and building a more diverse AI community
Mike Schroepfer
@schrep
And for the keynote: Mark Zuckerberg will share his vision for how AI will shape the future of computing. It’s going to be great! ai.facebook.com/events/inside-the-lab
-
Mike Schroepfer
@schrep
Personal thing NOT at all related to my work at Meta.
I'm excited to launch a $10M+ funding opportunity to fully research if Ocean Alkalinity Enhancement can be a safe and effective way to capture gigatons of carbon (CDR) AND de-acidify our oceans www.additionalventures.org/initiatives/climate-action/oae…
Mike Schroepfer
@schrep
Recently the National Academies of Sciences, Engineering, and Mathematics (NASEM) released a study on ocean-based CDR approaches. OAE stands out as a potentially efficient and highly scalable CDR pathway that permanently sequesters CO2 www.nationalacademies.org/news/2021/12/new-report-assesse…
Post not available here, view on X
Mike Schroepfer
@schrep
Awesome group of organizations have come together to fund this!
Mike Schroepfer
@schrep
If you want to nerd about a bit - here's a comparison of the opportunity of different Ocean CDR approaches
-
Mike Schroepfer
@schrep
Some awesome work from our Data For Good team published in PNAS this month: the first super high-resolution map of relative wealth and poverty in over 100 low- and middle-income countries globally, a great resource for aid and economic development: www.pnas.org/content/119/3/e2113658119
Post not available here, view on X
Mike Schroepfer
@schrep
And like all our best research, it’s been made publicly available for everyone to work with: data.humdata.org/dataset/relative-wealth-index
Mike Schroepfer
@schrep
And please forgive my terrible covid hair!
-
Mike Schroepfer
@schrep
Finished en.wikipedia.org/wiki/Ancillary_Justice recently and really loved it. Slow reading @JamesSACorey's Expanse book 9 to savor it.
What should I read next?
Mike Schroepfer
@schrep
Ancillary Sword is an obvious answer to my own question @ann_leckie really nice work on this series!
-
Mike Schroepfer
@schrep
Performance will be almost 5 exaflops of mixed precision compute (that’s 5 billion billion operations per second) This will be awesome for AI research.
AI at Meta
@AIatMeta
Meta is announcing the AI Research SuperCluster (RSC), our latest AI supercomputer 💻 for AI research. RSC will allow our researchers to do new, groundbreaking experiments in #ai. Learn more about RSC and the important role it will play: ai.meta.com/blog/ai-rsc/
This media couldn't be displayed. See it on the original post.
Mike Schroepfer
@schrep
It took some amazing system design to make this possible - the caching / storage can serve up training data at 16TB/s (!!). By summer there’ll be 16,000 GPUs running with no oversubscription. A beast!
ai.facebook.com/blog/ai-rsc -
Mike Schroepfer
@schrep
. This week @PyTorch turns 5! To celebrate I chatted with @ylecun, @soumithchintala and Lin Qiao about the past, present and future of ML frameworks: www.youtube.com/watch?v=r7qB7mKJOFk
Lots of words of wisdom here not just about AI but also how to build and support new things! -
Mike Schroepfer reposted
Soumith Chintala
@soumithchintala
It’s been 5 years since we launched @pytorch. It’s much bigger than we expected -- usage, contributors, funding. We’re blessed with success, but not perfect. A thread (mirrored at soumith.ch/posts/2022/01/pytorch-retro/ ) about some of the interesting decisions and pivots we’ve had to make 👇
-
Mike Schroepfer reposted
-
Mike Schroepfer reposted
Aleksander Madry
@aleks_madry
ImageNet is the new CIFAR! My students made FFCV (ffcv.io), a drop-in data loading library for training models *fast* (e.g., ImageNet in half an hour on 1 GPU, CIFAR in half a minute).
FFCV speeds up ~any existing training code (no training tricks needed) (1/3) -
Mike Schroepfer
@schrep
This is really impressive work boiling down what makes vision transformers perform well. ConvNets are not going down without a fight @ylecun !
Soumith Chintala
@soumithchintala
My colleagues at FAIR keeping up the good ConvNet fight!
AK
@_akhaliq
A ConvNet for the 2020s
abs: arxiv.org/abs/2201.03545
github: github.com/facebookresearch/ConvNeXt
Constructed entirely from standard ConvNet modules, achieving 87.8% ImageNet top-1 accuracy and outperforming Swin Transformers on COCO detection and ADE20K segmentation -
Mike Schroepfer
@schrep
Huge congrats @_karandeep on the new role - they are lucky to have you! techcrunch.com/2022/01/11/brex-confirms-12-3b-valuation-h…
-
Mike Schroepfer
@schrep
Everyone at #ces2022 anything exciting I'm missing besides EVs and electrifying everything? @peterpham ? @stevesi ?
-
Mike Schroepfer
@schrep
Have you deposited a check to an ATM? Then you've used the descendent of technology that was truly magic 30 years ago. That's how progress happens breakthrough -> boring. :)
Oliver Cameron
@olivercameron
Here's @ylecun in 1993(!) demoing LeNet-1.
This was the world's first convolutional neural network for handwriting recognition. Today—29 years later—this same approach powers the majority of computer vision.
Such a historical moment, and breakthrough for machine learning.
Mike Schroepfer
@schrep
What's fun is to see the advances in self-supervision, computer vision, and language that are happening now that will be widely used in 30 years - and considering boring then.
-
Mike Schroepfer
@schrep
Missing #ces this year but this would be top on my list to check out. Moving construction to all electric has so many benefits - not just climate but NOISE! Curious to see what they used to replace the hydraulics...
Bobcat Company
@BobcatCompany
Bobcat and its CES Innovation Award winner, T7X all-electric compact track loader, are coming to #ces.
See us in booth 5318. #bobcatequipment #ces2022
Mike Schroepfer
@schrep
I remember driving the first Nissan leaf at Moscone - was so fun to test drive a car indoors (no emissions!) and then of course I had to get one. Electrifying everything over the next 10 years is gonna be fun.
-
Mike Schroepfer
@schrep
We are going to see autonomous technology appear in farms, on rail, in the water, in the air and in cargo before it becomes common for people in cars www.wired.com/story/john-deere-self-driving-tractor-stirs… via @wired
-
Mike Schroepfer
@schrep
Exciting times for VR!
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
This is a good balanced article on the advances and limitations of language models. Building robust tests and metrics turns out to be one of the hardest tasks.
Techmeme
@Techmeme
AI language models like GPT-3 can achieve up to 97% accuracy on some Winograd schemas, but understanding language doesn't equate to understanding the world (@melmitchell1 / Quanta Magazine)
www.quantamagazine.org/what-does-it-mean-for-ai-to-unders…
www.techmeme.com/211218/p8 -
Mike Schroepfer
@schrep
Welcome to @Meta @AlexisBjorlin - excited to have you build the future of AI compute :) www.forbes.com/sites/patrickmoorhead/2021/12/16/as-metas-…
-
Mike Schroepfer
@schrep
Congrats to @hbarra - home diagnostics is a huge need and I’m glad to see you apply your talents to such a great problem!
Hugo Barra
@hbarra
Excited to finally share what I've been working on since leaving Facebook/Meta. I've joined forces with @JMRothberg to build Detect as its CEO — a consumer diagnostics company grounded in science, design & engineering. Bloomberg wrote about us: www.bloomberg.com/news/articles/2021-12-15/former-faceboo…
(1/11👇) -
Mike Schroepfer
@schrep
Impact of remote work: more people are moving and they are moving to lower rent areas.
Paul E Williams
@PEWilliams_
Part of what seems to be happening with rents is huge numbers of people getting out of expensive cities and into cheaper cities during the pandemic. This is "inflating" rents in the cheaper cities, but importantly, the new prices are *less* than people were paying prior. Context.
-
Mike Schroepfer
@schrep
Remote work opens us so much economic opportunity - no need to move to get a job. What's missing is more immersive technology so we are are not "stuck in my room looking at squares on a monitor." It's early but we are going to get there...
Mike Schroepfer
@schrep
Horizon Worlds is now open for everyone 18+ in US / Canada, so I did I got a guided tour with @pucknorris, whose team is building this awesome piece of the metaverse. Here's a little clip...
-
Mike Schroepfer
@schrep
Horizon Worlds is now open for everyone 18+ in US / Canada, so I did I got a guided tour with @pucknorris, whose team is building this awesome piece of the metaverse. Here's a little clip...
Mike Schroepfer
@schrep
More here:
Vivek Sharma
@pucknorris
Our amazing creators have taken the tools in @HorizonWorlds to create the most original and imaginative spaces that are just 🤯. Starting today, you'll be able to check it out yourself (and build your own world too!)
youtu.be/02kCEurWkqU -
Mike Schroepfer reposted
Joanna Popper
@JoannaPopper
Seen in the Miami airport. #vr is happening.
#virtualreality #metaverse -
Mike Schroepfer
@schrep
Our AI systems can now enforce a new content policy without needing tons of example data and months of training - it’s an amazing AI breakthrough that removes a serious bottleneck in @meta’s efforts to remove harmful content:
www.protocol.com/enterprise/meta-ai-few-shot
Mike Schroepfer
@schrep
A great example of why it’s so important for @meta to be doing cutting edge AI research: this few-shot learning approach only started getting good results in the lab last year. Now it’s being deployed to keep our platforms safe at billion-person scale:
ai.facebook.com/blog/harmful-content-can-evolve-quickly-o… -
Mike Schroepfer
@schrep
Unfortunately I know what “much of the internet is down and it’s our fault” feels like - sending good vibes to the folks over at Amazon/AWS today - never fun.
-
Mike Schroepfer reposted
AI at Meta
@AIatMeta
At #neurips2021 we’re sharing results of the Image Similarity Challenge, an open research competition to create better systems to identify manipulated images. We’re also sharing a unique million-image data set created by Meta AI. ai.facebook.com/blog/detecting-manipulated-images-the-ima…
-
Mike Schroepfer
@schrep
This is really amazing work. A few years ago teams came together for the #fastmri challenge - soon your MRI might be faster and cheaper! Awesome work @nicolapezzotti and #philips and @MetaAI
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Turns out you can upgrade the virtual world faster than the physical one :)
Meta VR
@MetaVR_Official
You asked, we listened! 😌
Horizon Workrooms v1.2 introduces the HIGHLY requested customizable room features which include:
☑️ A wider variety of themes
☑️ Adding your logos & posters to express your teams’ culture & personality
☑️ New stand to make presenting that much better -
Mike Schroepfer reposted
AI at Meta
@AIatMeta
Meta AI researchers are presenting 83 papers at #neurips2021, including eight as spotlights and five as orals. Learn more about wav2vec, Habitat 2.0, and more here: ai.facebook.com/blog/-meta-ai-research-at-neurips-2021-em…
-
Mike Schroepfer
@schrep
Continuing to lead on security and privacy. First encrypted backups now disappearing messages - nice work @WhatsApp www.theverge.com/2021/12/6/22820138/whatsapp-disappearing…
-
Mike Schroepfer
@schrep
First @Stanford class taught fully in VR on Oculus Quest! So cool! www.stanforddaily.com/2021/12/01/stanford-launches-first-…
-
Mike Schroepfer reposted
AI at Meta
@AIatMeta
The researchers behind Meta AI’s open source Detectron #computervision library (which recently received the Everingham Prize for contributions to the CV community) discuss how the project came about, how the OS community has contributed, & what comes next.ai.facebook.com/blog/detectron-everingham-prize/
-
Mike Schroepfer
@schrep
This is very cool - particularly that they are testing in real world. As we’ve seen with self driving the hard work is not the canned demo but the variability of the everyday world www.theverge.com/2021/11/19/22791267/alphabet-google-ever…
-
Mike Schroepfer
@schrep
We need to better understand if people’s experiences with @meta products differs across race. But as @RAustin_Jr says here, we can’t address what we can’t measure
about.fb.com/news/2021/11/inclusive-products-through-race…
Mike Schroepfer
@schrep
Here’s the technical paper from our Responsible AI team on how we’re working to assess fairness, while protecting privacy. This is incredibly important to get right
ai.facebook.com/research/publications/how-meta-is-working… -
Mike Schroepfer
@schrep
新的语音识别技术将使互联网向整个世界开放,您觉得呢?
-
Mike Schroepfer
@schrep
Speak in any one of 22 languages - have it translated to any one of 16 languages! Try it yourself:
huggingface.co/spaces/facebook/XLS-R-2B-22-16
Hugging Face
@huggingface
🎙️ Speech Translation stepped up its game!
@MetaAI just released XLS-R, a model pretrained on 128 spoken languages🌍
... and it's available on the Hub🤗
You can try out the first "All-to-All" Speech Translation checkpoint ever directly on the Hub 🔥
👉 huggingface.co/spaces/facebook/XLS-R-2B-22-16 -
Mike Schroepfer
@schrep
There are nearly 7,000 languages spoken around the world, but today’s speech systems work best in only a few dozen of them. Here’s the latest progress from our AI researchers, who are working toward a single model that understands every language:
ai.facebook.com/blog/xls-r-self-supervised-speech-process…
Mike Schroepfer
@schrep
The AI model we’re releasing today is trained to understand 128 languages. It gets great results on the CoVoST-2 benchmark, which tests speech translation — and it does an amazing job on languages where there’s not as much digitized training data - “low resource” languages in AI:
-
Mike Schroepfer reposted
AI at Meta
@AIatMeta
We're releasing XLS-R, a self-supervised multilingual model trained on 128 languages for a variety of speech tasks.
XLS-R sets a new state of the art on several speech recognition benchmarks, foreign-to-English speech translation & language identification.
ai.facebook.com/blog/xls-r-self-supervised-speech-process… -
Mike Schroepfer
@schrep
The AI model we’re releasing today is trained to understand 128 languages. It gets great results on the CoVoST-2 benchmark, which tests speech translation — and it does an amazing job on languages where there’s not as much digitized training data - “low resource” languages in AI:
Post not available here, view on X
Mike Schroepfer
@schrep
Wav2vec enables AI systems learn a language based on audio recordings with no matching text — as we’ve said before it’s a game changer for building speech AI that works in all languages, not just the dominant ones
Mike Schroepfer
@schrep
Our new AI system learned speech recognition in English with *zero* speech to text training data: researchers just gave it lots of audio, and it figured out what the words were. But it goes way beyond that - it learned Swahili too!
Mike Schroepfer
@schrep
We want this tech accessible to everyone, so like wav2vec, we’re open sourcing it!! You can find the 128-language model we announced today on GitHub (github.com/pytorch/fairseq/tree/main/examples/wav2vec/xlsr) and HuggingFace, which also has a great tutorial on how to work with our models huggingface.co/blog/fine-tune-xlsr-wav2vec2
-
Mike Schroepfer reposted
AI at Meta
@AIatMeta
With this new partnership, @paperswithcode aims to make it easier to access open-source code and ML datasets from ACL papers. A special thanks to the @aclanthology team for the collaboration.
Papers with Code
@paperswithcode
🎉 Papers with Code partners with ACL!
Access code and datasets directly from ACL papers.
Huge thanks to @mjpost and @mmbollmann for the collaboration. -
Mike Schroepfer
@schrep
Being able to use your hands in VR with no controllers has been a huge step forward. Now our researchers are exploring the next frontier: creating a realistic sense of touch in the virtual world
tech.fb.com/inside-reality-labs-meet-the-team-thats-bring…This media couldn't be displayed. See it on the original post. -
Mike Schroepfer reposted
Brennan Spiegel, MD, MSHS
@BrennanSpiegel
“Cardio that doesn’t suck”: Saw this ad while driving into the hospital this evening. One of the first times I’ve seen health-related #vr make it’s way onto the LA city streets. Awareness continues to grow about the manifold ways VR can help to support health.
-
Mike Schroepfer
@schrep
This is a great read of the investment in infrastructure at fb/meta. From 1 building in 2009 to 48 active buildings with 47(!) under construction
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Is anyone worried that web3 lays the perfect groundwork for AI agents to take over?
-
Mike Schroepfer
@schrep
Whats most interesting to me here is that by training one model on multiple languages we use the larger available data in English->German and other languages to improve translation to languages like Hausa where there is just less data...
AI at Meta
@AIatMeta
We built & open sourced the first-ever multilingual model to win the prestigious WMT competition, showing this approach is the future of machine translation. One-model-for-many-languages is simpler, more scalable, and can help deliver better translations. ai.facebook.com/blog/the-first-ever-multilingual-model-to…
Mike Schroepfer
@schrep
And its a win-win - this system performs better across the board. Another example of how technology removes zero sum tradeoffs. Want better English->German and English->Huasa translation? Train a bigger system on both and all is improved.
-
Mike Schroepfer
@schrep
This is an exciting moment on the path of building a universal translator. For the first time a AI model capable of translating between multiple languages has beaten special purpose single models at #wmt21
Post not available here, view on X
Mike Schroepfer
@schrep
I’m so proud of the Meta AI researchers who did this truly groundbreaking work. It’s fundamental to how we think about the technology we’re building — it needs to work for people everywhere. It's also a successful example of generalization -IMHO the biggest challenge in AI.
Mike Schroepfer
@schrep
More details here: ai.facebook.com/blog/the-first-ever-multilingual-model-to…
-
Mike Schroepfer
@schrep
Over the last year the prevalence of hate speech on Facebook decreased by more than half. That figure and much more here in our latest quarterly report:
about.fb.com/news/2021/11/meta-community-standards-enforc…
Mike Schroepfer
@schrep
How did this happen? Here’s some detail on how recent AI breakthroughs contributed: single-task models are being outperformed by ones that can generalize across multiple problems, and it’s helping us do a much better job enforcing our content policies.
ai.facebook.com/blog/the-shift-to-generalized-ai-to-bette… -
Mike Schroepfer
@schrep
A decade ago we tried something new and it worked out so much better than any of us could have imagined: after spending years designing a new kind of ultra-efficient, hyper-scalable data center, we open sourced all the designs. Gave them away.
Post not available here, view on X -
Mike Schroepfer
@schrep
#cop26 is going on right now - companies have a huge role to play in solving the climate crisis. Every company has things they are excellent at, and I think it works best when they use their unique expertise to tackle climate change. So here’s what’s worked for us:
Mike Schroepfer
@schrep
At @meta we're one of the world's largest builders and operators of data centers. So making them as energy efficient as possible has been our focus for the last decade. Average efficiency (en.wikipedia.org/wiki/Power_usage_effectiveness) of our fleet is 1.1 compared to an industry average closer to 1.5
Mike Schroepfer
@schrep
Collaborating with the industry helps us get more efficient, but it also means there are hundreds of other companies contributing to & benefiting from these advances via the Open Compute Project. Think of it like open-source for data centers: www.opencompute.org/about
Post not available here, view on X
Mike Schroepfer
@schrep
Like many of you, I often want to be in many places on any given day. Do I go to my kids soccer game, or that critical meeting in London? Right now I have to choose. In the future when VR is 90% as good as being in person I won’t. And I’ll save tons of carbon emissions to boot
Mike Schroepfer
@schrep
That’s the power of technology: remove zero sum choices.
-
Mike Schroepfer
@schrep
If I told you 10 years ago Facebook AI authors would be on 79 of the accepted papers at the premier Machine Learning conference you probably would have laughed. Crazy! neurips.cc/Conferences/2021/AcceptedPapersInitial
Mike Schroepfer
@schrep
Also 2334 accepted papers(!!?)
-
Mike Schroepfer
@schrep
Passthrough mixed reality experiences, ability to detect if a person, pet or object jumps in your way during a VR session. People don't really realize the compounding R&D investment we've been making in VR.
Meta VR
@MetaVR_Official
Nobody:
Oculus: Surprise! Our v34 update is here. We expanded the voice command functionalities, added Android phone notifications, Space Sense, and a whole lot more. Check out the “more” here: ocul.us/3EAwB7l -
Mike Schroepfer reposted
Shira Ovide
@ShiraOvide
Maybe it shouldn't be surprising, but it is, that a powerful tech company weighed the pros and cons of technology and decided that the the drawbacks weren't worth the benefits.
More of this please.
www.nytimes.com/2021/11/02/technology/facebook-facial-rec… -
Mike Schroepfer
@schrep
More from the head of AI @an_open_mind on how #responsibleai determined that it was worth disabling good features (like auto-tag friends, or alt-text) because of the broader concerns about FaceRec
Jerome Pesenti
@an_open_mind
Facebook was one of the first companies to deploy face recognition at scale. Today @meta is announcing that it is turning it off. #responsibleai is often deciding when to use, or in this case, not to use, AI. www.nytimes.com/2021/11/02/technology/facebook-facial-rec…
-
Mike Schroepfer reposted
Jerome Pesenti
@an_open_mind
Facebook was one of the first companies to deploy face recognition at scale. Today @meta is announcing that it is turning it off. #responsibleai is often deciding when to use, or in this case, not to use, AI. www.nytimes.com/2021/11/02/technology/facebook-facial-rec…
-
Mike Schroepfer
@schrep
This is a big deal.
about.fb.com/news/2021/11/update-on-use-of-face-recognition/ -
Mike Schroepfer reposted
Papers with Code
@paperswithcode
🎉 We've just crossed 5000 Datasets! 🎉
We now index and organize more than 5000 research datasets for machine learning. A huge thanks to the research community for their ongoing contributions.
Browse the full catalogue here: paperswithcode.com/datasets -
Mike Schroepfer reposted
AI at Meta
@AIatMeta
Today, as part of a larger tactile-sensing ecosystem, we’re announcing two major advances: DIGIT, a commercially available touch-sensing hardware produced in partnership with GelSight, and ReSkin, a replaceable, low-cost tactile skin. Read more about our work in touch sensing:
-
Mike Schroepfer
@schrep
Facebook is enabling a new generation of touchy-feely robots www.engadget.com/facebook-is-enabling-a-new-generation-of… via @engadget
-
Mike Schroepfer
@schrep
Having seen some recent mixed reality demos I can't wait for more people to experience them. Really had to describe the experience but as transformative to me as the first VR demos I had 7 years ago
Greg Madisᯅn
@GregMadison
When we stop to think about the future, beyond the limitations of any device, there will no longer be any AR, MR or even VR... There is only a sliding scale of perception, along the spectrum of realities.
-
Mike Schroepfer
@schrep
Touch is fundamental to everyday life, and AI will be much more useful if it can understand it too. But getting there requires inexpensive touch sensors and the software needed to learn from them. Here's a low-cost sensor we open-sourced last year to drive research progress
Post not available here, view on X
Mike Schroepfer
@schrep
This approach to touch perception is only possible thanks to recent advances in machine learning for computer vision systems — a great example of progress in one field of AI enabling entirely new fields to take off. It’s awesome.
Mike Schroepfer
@schrep
In particular the system can be trained end-to-end - meaning you don't train one network to understand the touch sensor and another to program the robot. Rather you take the what the touch sensor "sees" and use that to directly train to robot to do things.
Post not available here, view on X
Mike Schroepfer
@schrep
Here's more on how it works in this video and here: ai.facebook.com/blog/reskin-a-versatile-replaceable-low-c…
Mike Schroepfer
@schrep
Of course this all wouldn't be complete with out some open source software including PyTouch: github.com/facebookresearch/PyTouch
Mike Schroepfer
@schrep
If you want to read more: ai.facebook.com/blog/teaching-robots-to-perceive-understa…
-
Mike Schroepfer
@schrep
1/n Some really mind blowing technological advancements got lost in the excitement over the Meta name change yesterday. Let's start with lifelike avatars - this is an animated avatar not a video recording...
Post not available here, view on X
Mike Schroepfer
@schrep
13/13 what does that look like when you are not stuck on 2D screen but can walk around and feel like you are really there? I don't believe I'll see a transporter from star trek in my or my kids lifetime. But I do think we can get pretty darn close to the holodeck. Gonna be fun
Mike Schroepfer
@schrep
sorry for the typos - grandkids -> grandparents, even->event - was typing fast while late to a meeting. My AI digital twin is not yet fully trained. Soon...
-
Mike Schroepfer
@schrep
I dunno - maybe the VR thing might work?
Meta VR
@MetaVR_Official
.@BeatSaber hit $100M in lifetime revenue on Quest platforms. That's a lot of slashed cubes! To celebrate the milestone, @BeatGamesStudio just teased something they've been working on at #fbconnect. Check this out. ocul.us/3pHlxRs
-
Mike Schroepfer
@schrep
-
Mike Schroepfer
@schrep
Photorealistic avatars, realtime 3D reconstruction, reading nerve impulses from the wrist. If you arn't watching this section about the research work at FRL you are missing out on the future: www.youtube.com/watch?v=0294iXEPO4Y
-
Mike Schroepfer reposted
PyTorch
@PyTorch
PyTorch 1.10 is here!
Highlights include updates for:
- CUDA Graphs APIs updates
- Several frontend APIs moved to Stable
- Automatic fusion in JIT Compiler support for CPU/GPUs
- Android NNAPI now in beta
Blog: pytorch.org/blog/pytorch-1.10-released/
Release: github.com/pytorch/pytorch/releases/tag/v1.10.0 -
Mike Schroepfer reposted
Abhishek Das
@abhshkdz
We're looking for research interns to join us at FAIR as part of opencatalystproject.org. If you're a PhD student interested in graph neural networks for modeling atomic relaxations, that will then be used to explore catalysts for renewable energy storage, please reach out to me!
-
Mike Schroepfer
@schrep
Great read on key tech needed to fight climate change: Carbon Dioxide Removal or CDR from @ilangur. Happy to be supporting his work at @activatefellows, the awesome @mcjpod and some of the promising CDR solutions mentioned here like @Project_Vesta.
myclimatejourney.substack.com/p/carbon-dioxide-removal-th… -
Mike Schroepfer reposted
Gabriel Kra @GkraEnergy
Great piece by my buddy @ilangur Carbon Dioxide Removal: The Unreasonable Bet We Need myclimatejourney.substack.com/p/carbon-dioxide-removal-th…
-
Mike Schroepfer
@schrep
How can we teach machines to learn about the world the way humans do? It’s one of the hardest and most promising opportunities in AI, so we brought together a global consortium of universities and research labs to explore it.
ai.facebook.com/blog/teaching-ai-to-perceive-the-world-th…Post not available here, view on X
Mike Schroepfer
@schrep
To get there, we need AI capable of seeing things from a first-person perspective - researchers call it egocentric perception. That’s the goal of the Ego4D project announced today, there lots more detail about it here:
ai.facebook.com/blog/teaching-ai-to-perceive-the-world-th…
Mike Schroepfer
@schrep
Like all the best science, this work is being done in the open. Ego4D includes a dataset for researchers everywhere, plus a series of benchmark challenges designed to catalyze more experimentation. Can’t wait to see where it goes.
-
Mike Schroepfer
@schrep
Teaching AI to think more like a person would, and anticipate what’s coming next - really impressive work here
AI at Meta
@AIatMeta
Ever wondered if you already added an ingredient when cooking a meal? Or what to attach next when assembling a dresser? Facebook AI has built Anticipative Video Transformer, a model that can understand sequences of events & suggest the next step. Details:
ai.facebook.com/blog/anticipative-video-transformer-impro… -
Mike Schroepfer
@schrep
Recognized by @ICCV_2021 for “selfless contribution to other members of the computer vision community” — WELL DONE to @inkynumbers, @ppwwyyxx, Ilija Radosavovic, @kirillov_a_n, @georgiagkioxari, @fvsmassa, Wan-Yen Lo, Piotr Dollár and Kaiming He
AI at Meta
@AIatMeta
Congratulations to the Detectron team Ross Girshick, Yuxin Wu, Ilija Radosavovic, Alexander Kirillov, Georgia Gkioxari, Francisco Massa, Wan-Yen Lo, Piotr Dollár, & Kaiming He for winning the PAMI Everingham Prize at #iccv2021. Learn about the platform: ai.facebook.com/tools/detectron2/
-
Mike Schroepfer reposted
Meta Newsroom
@MetaNewsroom
Facebook Supports Climate and Clean Energy Provisions in the Budget Reconciliation Bill about.fb.com/news/2021/10/facebook-supports-climate-budge…
-
Mike Schroepfer
@schrep
More including why this work is important: "This means that for every one million people living in areas connected to fiber, an additional 78,000 people became employed. "
venturebeat.com/2021/10/07/facebook-connectivity-unveils-… -
Mike Schroepfer
@schrep
tl;dr: Longest subsea cable ever connecting Africa, new cable connecting Europe->US, 30,000 wireless backbone units deployed already in places like Perth and Anchorage, and a robot that can bring fiber to the home by climbing power cables.
Mike Schroepfer
@schrep
Our researchers are working on all the following: slash the cost of deploying fiber globally, connect homes with gigabit speed internet wirelessly, and triple the total bandwidth reaching Africa. We shared detail on each of these efforts today:
tech.fb.com/inside-the-lab-connectivity/ -
Mike Schroepfer
@schrep
Here's a shot of the robot moving over the power pole as it crawls along the cable - so cool!
Mike Schroepfer
@schrep
Our connectivity researchers are working on ways to slash the amount of time and money it takes to roll out high-speed broadband. They developed a robot that crawls along power lines, wrapping them with fiber-optic cable. No more digging trenches!
-
Mike Schroepfer
@schrep
Our connectivity researchers are working on ways to slash the amount of time and money it takes to roll out high-speed broadband. They developed a robot that crawls along power lines, wrapping them with fiber-optic cable. No more digging trenches!
Post not available here, view on X
Mike Schroepfer
@schrep
Why are we doing this? Some of us take internet access for granted, but it’s still unavailable or unaffordable for half the planet. That won’t change without the kind of technological progress we’re used to in the digital world but don’t see as much in the physical world
Mike Schroepfer
@schrep
Our researchers are working on all the following: slash the cost of deploying fiber globally, connect homes with gigabit speed internet wirelessly, and triple the total bandwidth reaching Africa. We shared detail on each of these efforts today:
tech.fb.com/inside-the-lab-connectivity/ -
Mike Schroepfer
@schrep
Yesterday’s outage across our products was a bad one, so we’re sharing some more detail here on exactly what happened, how it happened, and what we’re learning from it: engineering.fb.com/2021/10/05/networking-traffic/outage-d…
-
Mike Schroepfer
@schrep
More info on the outage today: engineering.fb.com/2021/10/04/networking-traffic/outage/
-
Mike Schroepfer
@schrep
Facebook services coming back online now - may take some time to get to 100%. To every small and large business, family, and individual who depends on us, I'm sorry.
-
Mike Schroepfer
@schrep
*Sincere* apologies to everyone impacted by outages of Facebook powered services right now. We are experiencing networking issues and teams are working as fast as possible to debug and restore as fast as possible
-
Mike Schroepfer
@schrep
Here’s @mags on a question we’re thinking about all the time: how to balance our optimism and hope for new technologies with the right amount of skepticism and caution
tech.fb.com/grace-hopper-keynote/ -
Mike Schroepfer
@schrep
Massive extension of the 2Africa subsea cable now planned. 45,000km long. Connecting Europe, Africa, India, and the Middle East. Operational in 2023!
www.cnet.com/news/facebook-backed-consortium-expands-plan… -
Mike Schroepfer
@schrep
1/ After 13 years at FB, I’ve decided to step down as CTO and pass the baton to @boztank at some point in 2022. I will stay on as long as it takes to ensure a successful leadership transition.
www.bloomberg.com/news/articles/2021-09-22/facebook-chief…Post not available here, view on X
Mike Schroepfer
@schrep
3/ It has been a privilege to lead our technology teams during a time of incredible growth & advancement. I am proud of what the team has achieved, from unleashing the benefits of AI & bringing VR to life to connecting more people around the world through technology.
Mike Schroepfer
@schrep
4/ I am still incredibly optimistic about the potential for AI and AR/VR to improve the lives of people every day. I am honored to be able to continue to support Facebook’s exciting future in my role as Senior Fellow.
-
Mike Schroepfer
@schrep
The Facebook Portal is the best way to video chat. Most requested feature is portability - which is now available with the Portal Go!
tech.fb.com/facebook-adds-two-new-portals-to-the-family-i… -
Mike Schroepfer
@schrep
Curious what "the cloud" looks like?
Here's a tour inside the now online $1B+ datacenter in Huntsville, Alabama powered by 100% renewable energy:
vimeo.com/593472959/75142e62b8 -
Mike Schroepfer
@schrep
This is an awesome program to turn research into products in the real world. Apply if interested!
Activate
@activatefellows
Are you a scientist or engineer with an impactful innovation?
The Activate Fellowship is a proven path to help you take your research from lab to market.
The world needs scientists, now more than ever—start your Cohort 2022 pre-application today: activate.org/applyThis media couldn't be displayed. See it on the original post. -
Mike Schroepfer
@schrep
Language model trained on raw audio - no txt, no ASR can say sensible things. Wild!
Lot more info including code and models here:
ai.facebook.com/blog/textless-nlp-generating-expressive-s…
Jerome Pesenti
@an_open_mind
First time ever a language model has been trained directly from raw audio: no text, no ASR. @facebookai's model has been trained on 8000 hours of audiobooks ( just the audio!). Given a short audio prompt, it can continue and generate new speech with its own voice.
-
Mike Schroepfer
@schrep
Lots of hard technical work to get the technology of smart glasses into a Ray-Ban style and form factor that people have loved for decades. Pretty excited to see people use this product!
This post is unavailable. See it on X.
Mike Schroepfer
@schrep
More ...
www.theverge.com/2021/9/9/22662809/facebook-ray-ban-stori… -
Mike Schroepfer reposted
Mark Rabkin @mrabkin
exciting news: Quest 2 is back on sale with 128GB of storage, at the old 64GB price — $299. More room for more amazing experiences. See you in Beat Saber! www.oculus.com/blog/oculus-starter-kit-13-games-to-instal…
-
Mike Schroepfer
@schrep
Two announcements out of Facebook today highlight a huge environmental opportunity: moving carbon-intensive activities online. Think replacing a business flight with virtual meetings, or replacing a car commute with remote presence.
Mike Schroepfer
@schrep
First, check out Workrooms, a new way for teams to collaborate in VR. I’ve been having my team meetings in it for a while now — it’s great, and we believe it’s a first step toward the workplaces of the future:
about.fb.com/news/2021/08/introducing-horizon-workrooms-r…
Mike Schroepfer
@schrep
Second, our global operations are already at net zero carbon emissions, and today we announced that by 2030 they will also restore more water to the environment than they consume:
about.fb.com/news/2021/08/restoring-water/
Mike Schroepfer
@schrep
These are both really hard goals for FB to hit. It requires operating some of the most efficient data centers on the planet, and building out the renewable energy and water restoration projects to support them.
Mike Schroepfer
@schrep
It’s a powerful combination: making tech that reduces the energy-intensity of modern life accessible to everyone, and delivering it with minimal environmental impact. We’re on track to do both, which is really exciting.
-
Mike Schroepfer
@schrep
For the last few years we’ve released quarterly numbers on how Facebook enforces its community standards. Today’s show prevalence of violating content continues to drop & proactive detection rates keep increasing — helped by improvements in AI systems
about.fb.com/news/2021/08/community-standards-enforcement… -
Mike Schroepfer
@schrep
If you want to run distributed systems at scale you need extremely accurate clocks. Today we’re open sourcing the Time Appliance hardware developed at Facebook to keep our millions of servers in sync: engineering.fb.com/2021/08/11/open-source/time-appliance/
-
Mike Schroepfer
@schrep
Features like visual search — just tap on an item in an image to find more like it — are going to keep getting better as our teams push the state of the art in computer vision ai.facebook.com/blog/advancing-ai-to-make-shopping-easier…
-
Mike Schroepfer
@schrep
This is great work: an AI system that doesn’t just detect deepfakes, it figures out the method used to create them. This helps us identify when multiple manipulated images or videos come from a single source — great for spotting coordinated behavior ai.facebook.com/blog/reverse-engineering-generative-model…
Mike Schroepfer
@schrep
This is a key responsibility that comes with building cutting-edge AI: creating systems that can counter misuse of the technology, and releasing them for everyone to use. The dataset, code, and trained models here are all being open sourced github.com/vishal3477/Reverse_Engineering_GMs
Mike Schroepfer
@schrep
The follows on the great work of the Deepfake Detection Challenge ai.facebook.com/blog/deepfake-detection-challenge-results…
Mike Schroepfer
@schrep
Another example of this in action: a new data set for researchers building systems that can detect manipulated images at scale — and a $200,000 prize pool for the best research work!
ai.facebook.com/blog/the-image-similarity-challenge-and-d… -
Mike Schroepfer
@schrep
There aren’t many things in life that have gotten 25 times better since 2016, but that’s what Facebook’s carbon footprint has done. A stunning improvement in just a few years:
tech.fb.com/building-a-sustainable-internet/Post not available here, view on X
Mike Schroepfer
@schrep
This change is thanks in large part to renewable energy. We’ve contracted for more than 5.9 GW of new wind and solar projects to power our operations, and we’re having them built where our data centers are. Our operations are now 100% powered by renewables
Mike Schroepfer
@schrep
Correction its now above 6 GW of contracted wind and solar. Wow!
Post not available here, view on X
Mike Schroepfer
@schrep
The impact of this goes way beyond our business. Enabling people to lead rich digital lives has a huge environmental impact of its own — swapping a drive to the mall for online shopping, or work travel for virtual meetings.
Mike Schroepfer
@schrep
If that technology can be offered to the whole world, with net zero greenhouse gas emissions, the impact will be enormous. We’re already there with our own operations, and the next big goal is doing it for our whole value chain.
sustainability.fb.com/our-climate-commitment/ -
Mike Schroepfer
@schrep
Two of my favorite things advancing AI and fighting climate change all in one project :).
AI at Meta
@AIatMeta
We are launching the Open Catalyst Challenge, an open AI research competition to build new machine learning models that will help scientists discover new catalysts for efficient, economical green energy storage.
Learn more: ai.facebook.com/blog/open-catalyst-challenge-using-ai-to-… -
Mike Schroepfer
@schrep
Here’s @mags on how our Responsibility teams are approaching building the future responsibly.
tech.fb.com/responsible-innovation/ -
Mike Schroepfer
@schrep
Data centers use a ton of electricity, and the world is going to need a lot more of them. We power ours with 100% clean energy, but making them more efficient is a huge focus — which is why we are happy to support research like this: www.channelnewsasia.com/news/singapore/stdct-nus-ntu-test…
Mike Schroepfer
@schrep
It mentions the StatePoint Liquid cooling system which is one of the ways we are achieving power efficiency in our datacenters: www.datacenterdynamics.com/en/news/facebook-deploy-statep…
-
Mike Schroepfer
@schrep
What do you think? Will productivity accelerate as AI and robotics get deployed more broadly?
MIT Technology Review
@techreview
AI and other digital technologies have been surprisingly slow to improve economic growth. But that could be about to change, according to researchers Erik Brynjolfsson and Georgios Petropoulos. www.technologyreview.com/2021/06/10/1026008/the-coming-pr…
-
Mike Schroepfer
@schrep
Fascinating experiment. 70,000 generations of bacteria evolved in identical conditions over 30 years. Following a power-law of continual improvement in their ability to reproduce with no signs of ending. Never bet against nature.
www.discovermagazine.com/planet-earth/how-a-30-year-exper… -
Mike Schroepfer
@schrep
Progress is not guaranteed, there are times when we go backward. But a jump in life expectancy in Europe from 30-40 years in 1800 to >75 years is stunning....
Todd Jones 🦊
@toddrjones
Life expectancy, 1800-2016.
Mike Schroepfer
@schrep
All driven by better knowledge and technology: better sanitation (including disinfecting drinking water), vaccines, nutrition, medical care and more...
-
Mike Schroepfer reposted
Yann LeCun
@ylecun
HuBERT: turns continuous speech signals into discrete tokens in a self-supervised manner.
AI at Meta
@AIatMeta
We are releasing pretrained HuBERT speech representation models and code for recognition and generation. By alternating clustering and prediction steps, HuBERT learns to invent discrete tokens representing continuous spoken input.
Learn more: ai.facebook.com/blog/hubert-self-supervised-representatio… -
Mike Schroepfer
@schrep
This improvement in electric motor performance is pretty bonkers
Alex
@alex_avoigt
A Tesla Performance Model leaves already today all fast cars behind but this curve tells you that between 40MPH and 60MPH Plaid is pure humiliation
-
Mike Schroepfer
@schrep
Our researchers built an AI model that can learn to edit the text in any image by training on just a single word. This has huge potential in augmented reality — imagine your AR glasses doing real-time translation of the world, from street signs to handwritten notes
Mike Schroepfer
@schrep
It could also be used to make misleading images, so we’re publishing a paper and dataset, but not open-sourcing the code. As with our approach to deepfakes, we think sharing research & datasets will help build detection systems and preempt attacks
ai.facebook.com/research/publications/textstylebrush-tran…
Mike Schroepfer
@schrep
More here: ai.facebook.com/blog/ai-can-now-emulate-text-style-in-ima…
-
Mike Schroepfer
@schrep
Facebook AI has a focus on building translation systems that will serve the entire world. Today we are releasing a first of its many-to-many evaluation data set covering 101 languages from all over the world.
ai.facebook.com/blog/the-flores-101-data-set-helping-buil…Post not available here, view on X
Mike Schroepfer
@schrep
English speakers often take it for granted that we can easily read and participate online. That’s not the case for billions of people who don’t speak one of the handful of languages that still dominate the internet.
Mike Schroepfer
@schrep
Tearing down the language barrier will open up huge economic opportunities across the world and make the internet work better for everyone. It’s one of the most exciting fields of work in AI today.
-
Mike Schroepfer
@schrep
When a developer community can rally around a common framework it accelerates everything. Wrote a bit here about how that’s been the case in AI with PyTorch, with huge consequences: tech.fb.com/community-changing-the-world-of-ai/
-
Mike Schroepfer
@schrep
Too many interesting comments to follow so I’m starting a fresh thread. I don’t work at Tesla so have no first hand knowledge of their safety data. Any safety critical system should be rigorously tested irrespective of how it is implemented to make sure it is safe 1/n
Mike Schroepfer
@schrep
All in on computer vision - removing radar from the cars. Wow! electrek.co/2021/05/25/tesla-vision-without-radar-warns-l…
Post not available here, view on X
Mike Schroepfer
@schrep
Low frequency events require scale to capture. This is where it is smart to use the existing fleet of vehicles to find every single weird thing that happens on the roads. Find weird thing, add to training set, rise and repeat.
Mike Schroepfer
@schrep
That’s it. Interesting to see them aggressively lean into long term trends. We’ll see how it plays out.
-
Mike Schroepfer
@schrep
All in on computer vision - removing radar from the cars. Wow! electrek.co/2021/05/25/tesla-vision-without-radar-warns-l…
-
Mike Schroepfer
@schrep
Excited to see enterprise support of PyTorch from Microsoft! Always great to work with you @kevin_scott pytorch.org/blog/announcing-pytorch-enterprise/
-
Mike Schroepfer
@schrep
I shared a recent advance in Unsupervised learning for speech to text. What's so interesting is how @ylecun predicted these advances more the 5 years ago. At the time supervised learning was making stunning advances - so it seemed hard to believe. .. (1/n)
Jerome Pesenti
@an_open_mind
Since @ylecun introduced his cake analogy at NeurIPS 5 years ago, unsupervised learning and the self-supervised approach in particular, has been a major focus of @facebookai and other AI labs. Progress has been steady and remarkable almost everywhere - NLU, MT, Speech, CV, Video
Post not available here, view on X
Mike Schroepfer
@schrep
anyway I don't love the hype of labels like "software 2.0" but it does feel like we are approaching a big change in how a lot of programming will be done over the next few decades. This may be as big as when computers from special purpose machines -> general purpose processing
Mike Schroepfer
@schrep
or bigger. We are moving from "all problems that can be solved with a declarative program" to "all problems that can be express as inputs and outputs" - which is - um - a lot of problems? :)
-
Mike Schroepfer reposted
Nasim Rahaman @nasim_rahaman
My knowledge of speech stuff is potato, but holy moly this blew my mind!
Mike Schroepfer
@schrep
Our new AI system learned speech recognition in English with *zero* speech to text training data: researchers just gave it lots of audio, and it figured out what the words were. But it goes way beyond that - it learned Swahili too!
-
Mike Schroepfer
@schrep
Our new AI system learned speech recognition in English with *zero* speech to text training data: researchers just gave it lots of audio, and it figured out what the words were. But it goes way beyond that - it learned Swahili too!
Mike Schroepfer
@schrep
Since many asked - we open sourced this work for all to use: github.com/pytorch/fairseq/tree/master/examples/wav2vec/u…
Post not available here, view on X
Mike Schroepfer
@schrep
Our researchers have it trained in Swahili, Tatar and Kyrgyz, and see no reason why the approach wouldn’t work in 1000s more languages. They wrote about the system here — and released the code for the whole world to use
ai.facebook.com/blog/wav2vec-unsupervised-speech-recognit…
Mike Schroepfer
@schrep
Voice recognition enables so many great experiences, like automatic subtitles on video—huge for accessibility. The possibility of bringing that kind of tech to billions of people for the first time is why building AI at Facebook is so exciting
-
Mike Schroepfer
@schrep
Recent advances mean AI systems are developing a more holistic understanding of the information presented to them. We are deploying these advances in production to reduce bad content on Facebook: tech.fb.com/how-ai-is-learning-to-see-the-bigger-picture/
Mike Schroepfer
@schrep
This is getting impressive results. Prevalence of hate speech, for example, has almost halved over the last year:
about.fb.com/news/2021/05/community-standards-enforcement…
Mike Schroepfer
@schrep
This goes way beyond how we enforce our rules — it’s driving advances for us in places like language translation and computer vision. And it goes beyond Facebook! Wrote a little about that here, re @karpathy’s work at Tesla:
Mike Schroepfer
@schrep
.@pabbeel's podcast with @karpathy is *excellent*. In particular it is important to understand where @karpathy explains how the vision system moved from single camera/single image->fusing all 8 cameras into a single model of the world around the car...
Pieter Abbeel
@pabbeel
Very excited to share the launch of my new podcast, The Robot Brains. The first episode was just released. My first guest is brilliant AI researcher, educator, and Director of AI and Autopilot Vision at Tesla @karpathy!
www.therobotbrains.ai -
Mike Schroepfer
@schrep
Just heard about more technology coming out of the labs into the real world. Dramatic reductions in energy use in industry: viaseparations.com. These things are win win win - industry save money, we reduce carbon. This is how we build our way out of the climate crisis.
-
Mike Schroepfer
@schrep
Just listened to an amazing talk from @nabsicle from @CellinoBio about tissue engineering at scale. Imagine a factory that can pump out perfectly pure tissues just for you. The future is going to be so awesome. www.engine.xyz/founders/cellino/
-
Mike Schroepfer
@schrep
Here’s a great opportunity for developers looking to build in VR — this field is only going to get bigger, and we want the dev community to be as diverse and vibrant as the real world developer.oculus.com/blog/introducing-the-2020-oculus-lau…
-
Mike Schroepfer reposted
Fei-Fei Li
@drfeifei
“Why We Need a National Research Cloud in the U.S.?” Here is a video @StanfordHAI team made to explain the Why, and also What we are doing to make progress on this important topic. youtu.be/9lbXMOTUpPU
-
Mike Schroepfer
@schrep
This game holds my record for longest sessions in VR. One of the most fun moments I've had with friends all year and it was in VR. Excited for everyone to get to play this!
Scout House
@ScoutHouseLab
‘Demeo’ Review: An RPG Lovers Dream VR Game via @KlyeOnFire vrscout.com/news/demeo-review-an-rpg-lovers-dream/
-
Mike Schroepfer
@schrep
Workplace reaches 7M paid users – 40% growth in a year!! Congrats to @_karandeep and the team on this amazing milestone!
This post is unavailable. See it on X. -
Mike Schroepfer reposted
David Marcus
@davidmarcus
Very excited to start enabling Payments in WhatsApp in Brazil today. This will be a gradual roll-out, but enabling people in 🇧🇷 to pay one another in conversations as easily as sending a text message is going to be so useful!
-
Mike Schroepfer
@schrep
With the ability to work remotely - will we see more "startup" countries? Very curious about how this will all play out....
www.bloomberg.com/news/articles/2021-03-27/prospera-in-ho… -
Mike Schroepfer
@schrep
.@AndrewYNg great at distilling down where AI is. Paper sayin AI trained at Stanford can read X-Ray's better than Humans @ Stanford - but same system doesn't work at hospital down the street. Generalization unsolved spectrum.ieee.org/view-from-the-valley/artificial-intelli…
Mike Schroepfer
@schrep
These Medical systems are usually fully supervised. Recent work in self-supervised computer vision may be able to help over time:
Mike Schroepfer
@schrep
Here’s our new computer vision system achieving state of the art results in image segmentation, without needing any labeled training data. This new model was trained on random, unlabeled data, but quickly achieved state-of-the-art results. It’s awesome.
-
Mike Schroepfer
@schrep
The ability of newer large language models to turn discrete things (trained categories) and open them up to more free-form text is going to appear in more and more places. Cool work!
Yin Cui
@YinCuiCV
Can we use free-form text to detect any object, especially long-tailed objects?
Yes!
We train Mask R-CNN by distilling from CLIP to enable zero-shot detection. The model achieves higher AP compared to its supervised counterpart on rare classes.
arxiv.org/abs/2104.13921 -
Mike Schroepfer
@schrep
Here’s our new computer vision system achieving state of the art results in image segmentation, without needing any labeled training data. This new model was trained on random, unlabeled data, but quickly achieved state-of-the-art results. It’s awesome.
Mike Schroepfer
@schrep
But it gets even more interesting. The model learned to categorize objects in images and organize them into groups based on physical properties — animal species were clearly separated, for example.
Mike Schroepfer
@schrep
In non-tech jargon. It figured out how to pick out the important parts of a video all on its own. This idea of "self supervision" is inspired by how young children learn language, physics, and more without formal instruction.
Mike Schroepfer
@schrep
Oh - and here's the best part - all yours to use. Code and pre-trained model is right here: github.com/facebookresearch/dino
Post not available here, view on X
Mike Schroepfer
@schrep
Detecting duplicates has a bunch of applications, including something our AI team spends a ton of time working on: automatically detecting and removing misinformation from our platforms.
Mike Schroepfer
@schrep
What’s happening here is one of the defining AI advances of recent years — self-supervised learning — enabling new systems to develop much deeper and more generalized understandings of the data they’re trained on.
Mike Schroepfer
@schrep
And there’s more! It’s not just that these AI models perform better in so many ways — the time and computing power needed to train them is an order of magnitude less. Our team wrote all about it today:
ai.facebook.com/blog/dino-paws-computer-vision-with-self-… -
Mike Schroepfer
@schrep
If you’re in college and aiming at a career in tech, here’s a great opportunity:
news.mlh.io/introducing-the-production-engineering-track-… -
Mike Schroepfer
@schrep
1/ This post from @priy2201 shows SEER, our computer vision system trained using random unlabeled images, outperforming conventional systems in recognizing household items from India, China and Nepal. The reason why is very cool…
ai.facebook.com/blog/seer-an-important-step-tow
Mike Schroepfer
@schrep
Proper link: ai.facebook.com/blog/seer-an-important-step-toward-ai-tha…
Post not available here, view on X
Mike Schroepfer
@schrep
In language translation, self-supervised AI models are already performing better in languages that don’t have huge troves of digitized training text — ie. languages historically underserved by digital technology.
ai.facebook.com/blog/-xlm-r-state-of-the-art-cross-lingua…
Mike Schroepfer
@schrep
But the potential is much greater, and we’re right at the beginning of this step change in AI capabilities. It’s an awesome time for AI.
-
Mike Schroepfer
@schrep
Worked with @DanRose999 for years - this is worth a read!
Dan Rose
@DanRose999
I was ambitious and worked hard to advance my career at Amazon and then Facebook. I thought the way to get ahead was to deliver results, then push for more responsibility and position myself for promotion. I later came to realize I had it totally backwards. Here's my story:
-
Mike Schroepfer
@schrep
Better avatars are a big part of making VR feel like a real social experience, and the new options on Oculus are great. Here’s how my avatar has evolved over the years
www.oculus.com/blog/new-day-new-you-avatars-are-more-expr…
Mike Schroepfer
@schrep
In 2016 I demod the second from the left Avatar at F8: www.youtube.com/watch?v=vzhHCcR6hic
-
Mike Schroepfer
@schrep
After more than 100 years of trying, we might finally have a really effective malaria vaccine. Amazing news! www.newscientist.com/article/2275573-malaria-vaccine-from…
-
Mike Schroepfer
@schrep
Another example of what I’m talking about here: a 25% energy efficiency gain in the servers powering two billion WhatsApp users.
Will Cathcart
@wcathcart
And we're working to make WhatsApp more efficient. Thanks to some of the great work from our friends at @erlang_org we've recently been able to improve our server efficiency by 25%, which means that even as we grow we’ll use less energy to support each person’s use of WhatsApp.
-
Mike Schroepfer
@schrep
High quality carbon removal (real, additional, long term) is going to be critical for tackling climate change. Congrats to @CharmIndustrial and @stripe!
Charm Industrial
@CharmIndustrial
1/ Today we're announcing we've delivered @stripe's 416 ton CO₂e carbon removal purchase ahead of schedule, just 12 months after inventing our new carbon removal pathway. The carbon is now in permanent geological storage. charmindustrial.com/blog/2021/4/19/charm-announces-ahead-…
-
Mike Schroepfer
@schrep
Really cool use of deep learning to estimate the relative wealth of 20 million 2.4 km² regions around the world.
dataforgood.fb.com/tools/relative-wealth-index/ -
Mike Schroepfer
@schrep
Lots of great stuff here, including @_ImeArchibong on why it’s so important for technologists to “design for the margins”
One Young World
@OneYoungWorld
We discussed #4ir w/ @_ImeArchibong from @Facebook & #oyw Ambassadors from Palestine, USA & Afghanistan.
Tech is the key to equity & we must continue to build inclusive solutions that lift everyone up.
Big thanks to our exceptional panel. Watch it back: www.facebook.com/OneYoungWorld/videos/262411842197164 -
Mike Schroepfer
@schrep
Here’s some great work combining two of the technologies that will change the world in the coming decade: AI and computational biology
about.fb.com/news/2021/04/ai-predicts-effective-drug-comb… -
Mike Schroepfer
@schrep
.@pabbeel's podcast with @karpathy is *excellent*. In particular it is important to understand where @karpathy explains how the vision system moved from single camera/single image->fusing all 8 cameras into a single model of the world around the car...
Pieter Abbeel
@pabbeel
Very excited to share the launch of my new podcast, The Robot Brains. The first episode was just released. My first guest is brilliant AI researcher, educator, and Director of AI and Autopilot Vision at Tesla @karpathy!
www.therobotbrains.aiPost not available here, view on X
Mike Schroepfer
@schrep
I don't think people really understand the progress here. Listen carefully where @karpathy starts off calling algo/modeling as "solved" and all the work is in the data .. but then clarifies that this is true of certain problems (image rec) but not others (robotics).
Mike Schroepfer
@schrep
I personally think it is a loop of all three: data, compute, and algorithms that all build off of each other. Better techniques require less data or learn faster/more from more data.
Mike Schroepfer
@schrep
But his overall description of the field is really excellent and approachable to anyone who's curious to learn more about the field. Kudos!
-
Mike Schroepfer
@schrep
1/n Happy Earth Day! Facebook’s entire global operations are now powered by 100% renewable energy and our greenhouse gas emissions are down 94% over the last three years.
tech.fb.com/renewable-energy/Post not available here, view on X
Mike Schroepfer
@schrep
5/n Next step is to get to net zero across the entire value chain by 2030
Mike Schroepfer
@schrep
The energy costs of HVAC: heating and cooling are often not discussed enough. This is particularly important in large data halls and why technologies like state point cooling can make a huge difference: engineering.fb.com/2018/06/05/data-center-engineering/sta…
-
Mike Schroepfer
@schrep
Two extremely cool features in the v28 Oculus release: 1) Air Link lets you stream VR games from your PC over WiFi - no more cable! Still an experimental feature but it’s awesome to see it out there in the wild. www.oculus.com/blog/introducing-oculus-air-link-a-wireles…
Mike Schroepfer
@schrep
And 2) A whole bunch of new Infinite Office features show how VR is becoming a remote collaboration platform unlike anything else out there.
x.com/boztank/status/1382112250467536897 -
Mike Schroepfer
@schrep
Open source communities are vital to the internet. It is critical that these communities be inclusive - so we are updating our open source code of conduct and requiring communities we support to have and apply one
developers.facebook.com/blog/post/2021/04/12/facebook-ope… -
Mike Schroepfer
@schrep
Making computer vision systems perform equally well for everyone across characteristics like age, gender & skin tone is a crucial issue in AI, which is why we’re open sourcing this for the entire research community: ai.facebook.com/blog/shedding-light-on-fairness-in-ai-wit…
-
Mike Schroepfer
@schrep
If you want to know what all this floating solar power is for:
engineering.fb.com/2019/01/14/data-center-engineering/sin…
Mike Schroepfer
@schrep
Our first purchase of floating solar!
www.theedgesingapore.com/news/deals-joint-ventures-allian… -
Mike Schroepfer
@schrep
Our first purchase of floating solar!
www.theedgesingapore.com/news/deals-joint-ventures-allian… -
Mike Schroepfer
@schrep
Stunning achievement of scale. Uses horizontal scale rather than vertical scale (more injectors in parallel rather than bigger injectors), continuous optimization via software, optimizing the whole supply chain, and modular construction.
www.cnn.com/2021/03/31/health/pfizer-vaccine-manufacturin… -
Mike Schroepfer
@schrep
I don't think people realize the difficulty of technical problems @boztank's FRL teams have tackled over the last 5 years and how much they are investing in the future. @WIRED did an amazing job giving an inside peak into that work.
WIRED
@WIRED
This week happens to be the five-year anniversary of the Oculus Rift. The technology has survived its initial lean years, but going from a few million users to a billion means far more than just adding a couple of commas. wired.trib.al/D5ZBBDC
-
Mike Schroepfer
@schrep
6 months on the market and outsold all of our prior VR systems *combined*. Now the real fun begins as developers have an increasing installed base to target
UploadVR
@UploadVR
Facebook says Oculus Quest 2 has already "outsold not just its predecessor, but all of its predecessors combined".
uploadvr.com/quest-2-outsells-oculus-headsets-combined -
Mike Schroepfer
@schrep
High speed foiling electric ferry launching in Stockholm next summer! Less energy per passenger than a hybrid bus. The future is awesome!! candelaspeedboat.com/public-transport/
-
Mike Schroepfer
@schrep
I'm lucky to learn a lot every day from these incredible women at FB who are creating change and paving the way as leaders in their fields, communities and businesses! #whm2021
tech.fb.com/women-tech-leaders/ -
Mike Schroepfer
@schrep
THANK YOU @rajiinio for a very clear explanation of bias in algorithms. READ THIS if you want to understand this topic in a deeper way.
Deb Raji
@rajiinio
These are the four most popular misconceptions people have about race & gender bias in algorithms.
I'm wary of wading into this conversation again, but it's important to acknowledge the research that refutes each point, despite it feeling counter-intuitive.
Let me clarify.👇🏾
Kareem Carr, Ph.D.
@kareem_carr
FOUR things to know about race and gender bias in algorithms:
1. The bias starts in the data
2. The algorithms don't create the bias but they do transmit it
3. There are a huge number of other biases. Race and gender bias are just the most obvious
4. It's fixable! 🧵👇 -
Mike Schroepfer
@schrep
More high speed connectivity - this time across the pacific. Surprising amount of engineering goes into these projects - more here.
engineering.fb.com/2021/03/28/connectivity/echo-bifrost/ -
Mike Schroepfer
@schrep
This is worth a read if you are interested in how tech trends will impact climate change. In 10 years solar has gotten 90% cheaper, wind 70% cheaper. Lithium-Ion batteries approaching 10x cheaper. The beginning of clean energy has just started :)
Andrew Beebe
@andrewbeebe
Over the next 20 years we’ll see concepts like ‘renewable energy company’, ‘electric vehicle company’ and ‘sustainable supply chain’ all become redundant. — worldpositive.com/we-have-entered-the-climate-decade-70b7…
-
Mike Schroepfer
@schrep
Great post from @boztank. The move from weekly->daily->continuous releases is one of the most underrated improvements in productivity and quality
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Really encouraging the Intel is opening up a foundry business and I’m hopeful @PGelsinger can get Intel back on track.
Ben Thompson
@benthompson
I was so blown away by @PGelsinger that I made this Daily Update free-to-read
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
More important than ever to have more people finding and fixing security vulnerabilities
www.wired.com/story/facebook-red-team-x-vulnerabilities/ -
Mike Schroepfer reposted
Road to VR
@RtoVR
Facebook's Rubin: 'The trajectory is clear, we're going to get to AAA VR games' roadtovr.com/oculus-quest-2-developer-ecosystem-facebook-… @Jason_Rubin @deantak
-
Mike Schroepfer
@schrep
Lots of great stuff in here about the road to Augmented Reality.
Janko Roettgers @jank0
Had a great conversation with Facebook's hardware head Andrew @boztank Bosworth about what it takes to build a smart interface for AR glasses. Turns out we may have to rethink the idea of a digital assistant. Sorry, Alexa! www.protocol.com/facebook-ar-assistant-andrew-bosworth
-
Mike Schroepfer
@schrep
Here’s some mind-blowing technology being developed by @boztank and his team for our AR glasses: wrist-based sensors that let you control devices using the same electrical motor nerve signals you use to move your hands
tech.fb.com/inside-facebook-reality-labs-wrist-based-inte…
Mike Schroepfer
@schrep
This technology has amazing potential, especially in making devices more accessible. I'm pretty excited about the idea of a full sized keyboard anywhere I go...
-
Mike Schroepfer
@schrep
Facebook has a lot to do to rebuild trust. Transparency is one of the most important ways to do it. Things like the Oversight Board, Community Enforcement Standards report - and now an annual public report on human rights concerns about.fb.com/news/2021/03/our-commitment-to-human-rights/
-
Mike Schroepfer
@schrep
This is a pretty big deal - hoping we can help people get the accurate info on COVID-19 vaccines
-
Mike Schroepfer reposted
AI at Meta
@AIatMeta
Facebook AI has built TimeSformer, a new architecture for video understanding. It’s the first based exclusively on the self-attention mechanism used in Transformers. It outperforms the state of the art while being more efficient than 3D ConvNets for video.ai.facebook.com/blog/timesformer-a-new-architecture-for-v…
-
Mike Schroepfer
@schrep
Always so fun to speak with engineering students. Thank you @JohnDVillasenor for moderating.
UCLA Samueli Engineering
@UCLAengineering
More than 600 @UCLA students, faculty and @UCLA_Alumni tuned in to @UCLAengineering speaker series featuring @Facebook CTO Mike Schroepfer @schrep. @UCLA_Law Prof. @JohnDVillasenor moderated the discussion on the future of #socialmedia tech development. samueli.ucla.edu/ucla-engineering-speaker-series-featurin…
Mike Schroepfer
@schrep
Oh fact check. I said I learned to program in C++ - it was C not C++ :).
-
Mike Schroepfer
@schrep
With Facebook’s Responsible AI team is in the news, I thought I’d share a recent conversation with Rachad Alao, who leads our efforts to put concepts like fairness and equality at the heart of our AI systems. It’s awesome work.
tech.fb.com/teaching-fairness-to-machines/ -
Mike Schroepfer
@schrep
This is a huge engineering focus for FB: platforms that serve people across the world at our scale need to work well for *everyone* — not just on high-end phones with super fast connections about.fb.com/news/2021/03/bringing-instagram-lite-to-170-…
-
Mike Schroepfer
@schrep
We started out interacting with computers using tape and punch cards. Then came keyboards, mice, and then touch screens. Here’s what’s coming next:
Reality Labs at Meta
@RealityLabs
Today we’re sharing our vision for a new type of interface—a human-centric interface—our research teams at Facebook Reality Labs are building to interact with all-day wearable AR glasses: tech.fb.com/inside-facebook-reality-labs-the-next-era-of-…
-
Mike Schroepfer
@schrep
There's still so much we are learning about how to build AI systems that can learn on their own. Interesting that some of the biggest advances are often simplifications -
a very exciting step forward!
Stéphane Deny
@StphTphsn1
New preprint! "Barlow Twins: Self-Supervised Learning via Redundancy Reduction"
🔗arxiv.org/abs/2103.03230
w/ Jure Zbontar, @jingli9111, @imisra_ & @ylecun at @facebookAI
TLDR: A simple yet effective method for SSL–no large batches, clustering or asymmetry needed!
⬇️Intro⬇️ -
Mike Schroepfer
@schrep
I always learn something from Joelle - so if you can watch this you should!
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Lots of good stuff in here: focusing on getting products to as many as possible, disconnecting geography from opportunity via next-gen remote work in VR, and more!
The Information
@theinformation
Exclusive: Mark Zuckerberg on mind reading, Apple and the race to mainstream VR. Listen to the whole exclusive interview on The Information’s 411 podcast. anchor.fm/the-informations-411 @alexeheath @mathewolson
-
Mike Schroepfer
@schrep
I agree that technological progress is the best tool we have to provide prosperity for all and protect the planet.
Alex Rampell
@arampell
1/ Productivity gains due to technology are the largest source of deflation. $1 buys less today than 1993, but productivity gains offset that for many goods
Technology+transparent pricing+competition =magic
We just lack this in (much of) education, medicine, and constructionThis post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Great article! Small correction: AWS doesn’t power Facebook we build our own infrastructure powered by 100% renewable energy www.fastcompany.com/90611088/the-complicated-design-legac…
Mike Schroepfer
@schrep
If you are curious there are a few tours of our datacenters out there: www.datacenterknowledge.com/archives/2016/05/24/inside-fa…
-
Mike Schroepfer
@schrep
The PyTorch community is doing awesome work keeping the platform at the cutting edge. PyTorch 1.8 released today, contains more than 3,000 commits since 1.7 released in October!
pytorch.org/blog/pytorch-1.8-released/ -
Mike Schroepfer
@schrep
whydoeswhitespacemattersyntaxerror #codingin6words
-
Mike Schroepfer
@schrep
hello world hello world hello world #codingin6words
-
Mike Schroepfer
@schrep
Great article on today's advacements
www.wired.com/story/facebook-new-ai-teaches-itself-see-le… -
Mike Schroepfer
@schrep
This is another step forward for on-device machine learning, this time in computer vision. It will make new experiences possible, and is great news for privacy:
ai.facebook.com/blog/d2go-brings-detectron2-to-mobile/ -
Mike Schroepfer
@schrep
In other news excited that Facebook is stepping in to purchase 190 MW of new wind energy in Kansas! electrek.co/2021/03/04/egeb-kansas-wind-farm-sold-faceboo…
-
Mike Schroepfer
@schrep
1/n New advancements in self supervision for computer vision:
ai.facebook.com/blog/seer-the-start-of-a-more-powerful-fl…Post not available here, view on X
Mike Schroepfer
@schrep
8/n as we make these fundamental advancements it sets us up for future progress. Very exciting.
-
Mike Schroepfer reposted
VentureBeat
@VentureBeat
Facebook's computer vision model achieves state-of-the-art performance by learning from images venturebeat-com.go-vip.co?p=2673310 by @Kyle_L_Wiggers
-
Mike Schroepfer
@schrep
AI will shape the future, and we need a more diverse group of people building it. There is so much to be done, and I love this approach to bringing more people into the field:
ai.facebook.com/blog/facebook-ais-raise-program-an-innova… -
Mike Schroepfer
@schrep
Congrats to @_imearchibong — Capital One is *very* lucky to have you on their board.
www.prnewswire.com/news-releases/ime-archibong-and-craig-… -
Mike Schroepfer
@schrep
Excited to expand our support of brining more students into the field of AI
Yann LeCun
@ylecun
Facebook AI announces a new partnership with University College London to fund PhD students in the UK.
@egrefen, @_rockt, and @riedelcastro are scientists at FAIR-London who are also affiliated with UCL.
They are looking for PhD candidates!
ai.facebook.com/blog/fair-unveils-uk-phd-program-in-partn… -
Mike Schroepfer
@schrep
This is awesome
spectrum.ieee.org/automaton/aerospace/robotic-exploration… -
Mike Schroepfer
@schrep
These are the sort of experienced we only get after getting a lot more people into VR. Excited to see how the platform evolves thanks to how inexpensive and easy the Quest 2 is!
www.cnn.com/2021/02/15/cnn-underscored/oculus-quest-2-gam… -
Mike Schroepfer
@schrep
AI is currently improving at a pace that’s rarely seen in technologies deployed on such a scale. You can see the results in the very encouraging numbers we’re releasing today.
ai.facebook.com/blog/ai-gets-better-every-day-heres-what-… -
Mike Schroepfer
@schrep
6 titles on Oculus Quest with >$10M in revenue. Best sign yet VR is here to stay.
www.oculus.com/blog/from-bear-to-bull-how-oculus-quest-2-… -
Mike Schroepfer
@schrep
1/3 Everyone has questions about how AI actually works, even the experts. Here’s a great conversation with AI researcher Joelle Pineau, who takes us through AI 101 and what’s happening in her amazing research lab: tech.fb.com/how-facebooks-research-lab-is-thinking-about-ai/
Mike Schroepfer
@schrep
2/3 first video on AI 101 here: www.facebook.com/watch/?v=1101602960304411
Mike Schroepfer
@schrep
3/3 second video on research here: www.facebook.com/watch/?v=533809190913508
-
Mike Schroepfer
@schrep
This is fantastic news. Can't wait to see the federal government do more to support innovation and research.
Eric Lander
@eric_lander
Humbled and excited to serve as WH science advisor for President-elect @JoeBiden. He has assembled a diverse team of brilliant scientists and is elevating the role of science. So much to be done, and it will take everyone working together. #scienceisback!
-
Mike Schroepfer
@schrep
Here’s a great example of AI making the internet more accessible: a 10X improvement in our system that describes the content of images for blind or visually impaired users tech.fb.com/how-facebook-is-using-ai-to-improve-photo-des…
-
Mike Schroepfer
@schrep
2021 will be a huge year for VR. It’s so exciting to see a technology we’ve been dreaming of for decades really hit its stride with users and developers. @boztank shares his thoughts on the future in a must read!
tech.fb.com/no-looking-back/ -
Mike Schroepfer
@schrep
This is really great news - David is awesome!
Steven J. Vaughan-Nichols
@sjvn
Open-source developer and manager David Recordon named White House Director of Technology zd.net/3bcvFKY via @ZDNet & @sjvn An #opensource leader will now head the executive branch's technology team.
-
Mike Schroepfer
@schrep
More than 3,300 teams from around the world competed in a first-of-its-kind challenge to make AI better at detecting complicated forms of hate speech. Some really encouraging results here:
AI at Meta
@AIatMeta
Hate speech can come in many forms, including memes that combine text & images. We launched the Hateful Memes Challenge, a first-of-its-kind competition, to help the AI community find new ways to detect multimodal hate speech. Learn about the winners here: ai.facebook.com/blog/hateful-memes-challenge-winners
-
Mike Schroepfer
@schrep
Facebook’s global operations will be 100% supported by renewable energy by the end of the year — and we’re not stopping there. It’s great to see construction begin on two more of our US solar projects www.solarpowerworldonline.com/2020/12/construction-contin…
-
Mike Schroepfer
@schrep
We’re presenting some amazing stuff at this year’s NeurIPS conference — cutting-edge work on natural language processing, speech recognition, multimodal understanding and embodied AI. All the papers, and details of our presentations, are here: ai.facebook.com/blog/facebook-research-at-neurips-2020/
-
Mike Schroepfer
@schrep
Excited about the constant train of software improvements/upgrades coming to Oculus Quest (1 and 2)
developer.oculus.com/blog/bringing-phase-sync-to-mobile-vr/ -
Mike Schroepfer
@schrep
Over the last decade @WhatsApp changed the world of messaging, and with end-to-end encryption it brings rock-solid privacy to billions of people. It was great chatting with Scott Ryder about why encryption matters: tech.fb.com/whatsapp-end-end-encryption/
-
Mike Schroepfer
@schrep
“PyTorch has everything we need to be successful” - some great detail here on the platform, and community, that’s driving so much progress in AI www.infoworld.com/article/3597904/why-enterprises-are-tur…
-
Mike Schroepfer
@schrep
This is pretty cool
Edward Grefenstette
@egrefen
Awesome result: @facebookai (FAIR), in collaboration with @ucl_nlp, takes the top (and often second as well) place in *every* competition in EfficientQA. Great job, everyone!
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
More details on some of the new tech in use to fight misinformation on Facebook: ai.facebook.com/blog/heres-how-were-using-ai-to-help-dete…
-
Mike Schroepfer
@schrep
Was really inspiring to speak with Cornelia Carapcea, who leads our efforts to use AI to stamp out hate speech. She has so much to say about the progress that’s been made, and what’s coming next: tech.fb.com/where-ai-fits-in-the-battle-against-hate-speech/
-
Mike Schroepfer
@schrep
These bars going up is a direct result of focusing our our AI Research and Development on fighting hate
Guy Rosen
@guyro
When we began reporting, our proactive rate for hate speech in 2017Q4 was 24%, i.e. of the hate speech we remove, 24% was found proactively before a user report. Today, we're at 95% on both FB and IG, i.e. of content removed as hate speech, 95% was detected by us (3/7)
-
Mike Schroepfer
@schrep
There’s some really encouraging news and numbers here. We’ve made great progress in applying AI against hate speech over the last year, and there’s hopefully more to come
Guy Rosen
@guyro
Today we released our quarterly Community Standards Enforcement Report, covering July - September 2020. about.fb.com/news/2020/11/community-standards-enforcement… (1/7)
-
Mike Schroepfer
@schrep
Our 2Africa project is so cool: a 37,000 mile fibre-optic cable, delivering more capacity than all the subsea cables serving Africa today, combined! Here’s some estimates on the impact it could have on employment & incomes across the continent: engineering.fb.com/2020/11/19/connectivity/subsea-cables/
-
Mike Schroepfer
@schrep
There’s so much we can learn from how engineers managed to keep the internet running under such huge strains this year — I’m really looking forward to this series: tech.fb.com/keeping-the-lights-on/
-
Mike Schroepfer
@schrep
400k developers, from 190 countries, more than half women building AR effects. Learn more in this interview with Spark AR’s Sue Young: tech.fb.com/augmented-reality-mobile-future/
-
Mike Schroepfer
@schrep
Joëlle Pineau, Managing Director of Facebook AI Research: “For the last few years, she has been the driving force behind a change in how AI research is published” www.technologyreview.com/2020/11/12/1011944/artificial-in…
Great article - Joelle is pushing the whole industry towards open and reproducible research -
Mike Schroepfer
@schrep
Excited to partner with @openminedorg on new PyTorch classes!
AI at Meta
@AIatMeta
Today we announced our partnership with @OpenMinedOrg to offer developers a new series of #pytorch privacy and machine learning courses:
- Privacy and Society
- Foundations of Private Comp.
- Enterprise Federated Learning
- Federated Learning on Mobile
ai.facebook.com/blog/facebook-ai-openmined-partner-on-new… -
Mike Schroepfer
@schrep
Great partnership with Google on getting PyTorch working at peak performance on mobile devices. It’s so cool to see PyTorch working with Android’s Neural Networks API — and I can’t wait to see what the community does with it: medium.com/pytorch/pytorch-mobile-now-supports-android-nn…
-
Mike Schroepfer
@schrep
First ever PyTorch Developer Day - free to all to watch now true to the spirit of Open Science and Research!
PyTorch
@PyTorch
The first PyTorch Developer Day is about to kick off. Join us for the full day of talks, including keynotes, PyTorch core updates, framework research, and private AI announcement starting at 8:00 AM PST.
Watch here:
www.facebook.com/pytorch/live/ -
Mike Schroepfer
@schrep
Can't wait to get a whole lot more people in VR. Nothing turns a VR skeptic like trying a Quest.
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
This was a really fun conversation with @azeem. We covered the early days of Facebook, VR, where AI is going, how we can use state-of-the-art technology to better protect people on Facebook, and how to get more people into the field of computing
link.chtbl.com/schrep-facebook-ev -
Mike Schroepfer
@schrep
This is the dataset we use to train state of the art language models in case you want to improve or build your own! Open science rocks!
Alexis Conneau
@alex_conneau
DATASET RELEASE: "CC100", the CommonCrawl dataset of 2.5TB of clean unsupervised text from 100 languages (used to train XLM-R) is now publicly available.
You can find below the
Data: data.statmt.org/cc-100/
Script: github.com/facebookresearch/cc_net
By @VishravC et al. -
Mike Schroepfer
@schrep
The PyTorch community announced the availability of PyTorch 1.7 today. Glitzy demos often get the press, but it’s the continuous improvement of core tools that powers real advancements in AI [1/n]
Post not available here, view on X
Mike Schroepfer
@schrep
Really great to see an ongoing focus from the community on ease of use: from native tools to loading images to keeping the C++ interfaces in sync with Python. Not to mention out-of-the box models in vision, audio and more [4/n]
Mike Schroepfer
@schrep
Huge congrats to the PyTorch community!!! I look forward to the continued improvement of a tool so critical to improving AI for all: pytorch.org/blog/pytorch-1.7-released/ [5/n]
-
Mike Schroepfer
@schrep
For years demos of hand tracking required special sensors or gloves to make work. Our FRL team advanced the field of computer vision to make it work "out of the box" on the $299 Oculus Quest 2. They continue to push the limits - check it out here
tech.fb.com/making-technology-feel-natural/ -
Mike Schroepfer
@schrep
You’ve probably seen the voter registration prompts in your Facebook apps. They’ve produced an incredible result: With our help, an estimated 4.4 million people have registered to vote www.usatoday.com/story/tech/2020/10/26/voter-registration…
-
Mike Schroepfer
@schrep
5,760x reduction in training data needed to achieve similar results of state of the art systems from just 1 year ago. Or 960 hours to 10 minutes. Or train on the larger dataset for better results. AI is often overhyped but this is a truly impressive result.
Michael Auli
@MichaelAuli
Great progress in speech recognition: wav2vec 2.0 pre-training + self-training with just 10 minutes of labeled data rivals the best published systems trained on 960 hours of labeled data from just a year ago.
Paper: arxiv.org/abs/2010.11430
Models: github.com/pytorch/fairseq/tree/master/examples/wav2vec -
Mike Schroepfer
@schrep
Pretty excited about the possibilities here. AR glasses can be the delivery vehicle for all sorts of AI powered enhancements. Helping anyone who has hearing loss, or just has trouble understanding people at a party would be amazing.
This post is unavailable. See it on X. -
Mike Schroepfer
@schrep
Universal translation would be truly world changing, in so many ways. We're not quite there yet, but I think people underestimate just how much progress has been made lately: tech.fb.com/bringing-down-the-language-barrier/
-
Mike Schroepfer
@schrep
Very excited to see how developers take advantage of the increase in GPU power of the Quest 2.
uploadvr.com/oculus-quest-2-benchmarks -
Mike Schroepfer
@schrep
This was a fun talk thanks for having me. I love this quote as it sums up my worldview. Let's not lose our optimism of the real promise of tech, but do it responsibly.
MIT Technology Review
@techreview
(1/2) “There’s so much promise of technology, but it’s incumbent on us to build this technology responsibly as we go,” says @schrep. #emtechmit #techreviewevents
-
Mike Schroepfer
@schrep
This is another amazing application of PyTorch - this time for 18,000 farmers to better detect pest infestations.
PyTorch
@PyTorch
The team @WadhwaniAI has built a multi-task network that detects pest infestations in cotton crops. This technology is being put directly in the hands of more than 18,000 farmers across India using #pytorch Mobile, TorchServe, and Weights & Biases. medium.com/pytorch/how-wadhwani-ai-uses-pytorch-to-empowe…
-
Mike Schroepfer
@schrep
We need to get more people of all backgrounds into Computer Science. This is one step among many needed to get there: research.fb.com/blog/2019/04/expanding-pathways-into-comp…
-
Mike Schroepfer
@schrep
Facebook simply would not exist today if not for Bletchley Park. It’s an honor to be able to provide the support that will help keep it open to the world. tech.fb.com/giving-back-to-the-birthplace-of-the-computer/
-
Mike Schroepfer
@schrep
More info on the Deepfake Detection challenge - including a new interview with the head of the AI Red Team: tech.fb.com/dfdc/
-
Post not available here, view on XPost not available here, view on X
Mike Schroepfer
@schrep
Huge shout out to @awscloud and @Microsoft for jumping in early to join up and get this done. @Werner and @kevin_scott always great working with your teams.


























































































































