Meta Muse Ember is lit 🔥 (pun intended). My personal project to help me learn Japanese that would have cost ~$1K USD is now only ~$100 USD in token costs.
I would not be able to afford this project with OpenAI, Gemini or Claude.
Fable 5.2 demos look cool, but I've seen frontier models struggle with tasks that smaller models handle surprisingly well.
My own benchmarks keep reinforcing this: bigger models don't necessarily produce better results.
Now could I get this even cheaper my training my own model? I guess I'll find that out next.
Facebook Artificial Intelligence Research
Fundamental Artificial Intelligence Research (FAIR), prédécemment connu sous le nom de Facebook Artificial Intelligence Research, est un organisme regroupant plusieurs laboratoires de recherche en intelligence artificielle rattaché à l'entreprise Meta, Inc., anciennement Facebook. More on Wikipedia
-
AI at Meta reposted
Andrew Brown
@andrewbrown
This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Mooncast Productions
@MooncastOnline
Japanese Tea Garden Bench - Muse Ember reachablegames.com/teagarden.html
Huge step up for this offering, although hard to know what to compare it to. Maybe an upgraded Muse Spark Open? Cheap smarts are good smarts!This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Naymur Rahman @naymur_dev
Muse Ember surprised me with the output 👀
A lightweight model created this 3D scene using the /design feature from Command Code.
Muse Ember nailed it in one shot, while GPT-6-Luna needed two prompts to get it perfect.This media couldn't be displayed. See it on the original post.
Command Code
@CommandCodeAI
Muse Ember is now live in Command Code on all plans.
· $10/mo GOAT gets $20 usage
· 1M token context window
· GPT-6 Luna & Haiku 5.5 level price
Try it out! -
AI at Meta
@AIatMeta
Today we're also bringing Muse Ember to @GoogleCloud along with Muse Wonder and Muse Spark 1.3.
AI at Meta
@AIatMeta
Today we're introducing Muse Ember, our smallest and most efficient model, built for complex reasoning execution and everyday agent work.
Muse Ember can carry workflows across apps, call tools in sequence, run tests and make targeted code fixes. With a 1M-token context window and native understanding of text, images, audio and video, it can also work across large document sets and varied inputs. -
AI at Meta reposted
Pi Dash @pidashai
Pi Dash + Muse Ember == Coding beast! 🔥
Pi Dash is honored to get early access to Muse Ember over the past weekend!
🤖 10 Muse Code agents with Muse Ember working together under Pi Dash's Coordination to evolve itself:⚡ Raw SQL → SeaORM, ~178,000 lines of production code rewrite in a day
Watch it in action 👇 pidash.airepublic.com -
AI at Meta reposted
Meta for Developers
@MetaforDevs
Ready to get started with Muse Ember? Read the dev blog for details on the model, how to access, and recipes: dev.meta.ai/resources/blog/build-with-muse-ember
Meta for Developers
@MetaforDevs
Muse Ember, our smallest, most efficient model, is now available in Muse Code and on Meta Model API.
Built for agentic execution at scale, Muse Ember excels at coding subtasks, tool calls and document analysis, with support for audio and video inputs alongside text and images for your multimodal workflows.
Pair it with Muse Wonder or Muse Spark to combine efficient execution with deeper planning, reasoning and open-ended work.
We’re excited to continue building out the Muse series of models to give developers more choice over how they tackle their toughest challenges.
s
Start building: dev.meta.ai/models/muse-ember -
AI at Meta reposted
William Shen @shenbokui
Our first version of Muse Ember 🔥
Ember aims to maximize intelligence per GW of inference to help bring personal superintelligence to everyone.
We would love all the feedback to keep hill-climbing. Please send it our way. We will keep hill-climbing on efficiency, user experience, and better approach to train with internal frontier!
More to come 🫡
Alexandr Wang
@alexandr_wang
1/ announcing our smallest, most efficient little model is here: muse ember 🔥
built for work that agents repeat all day, it gets you more intelligence per dollar than Haiku, Luna, and all other flash models at any reasoning setting and does it at a third of the cost or less! -
AI at Meta reposted
Vals AI
@ValsAI
Meta's Ember is the cheapest model on the Vals Index at just $0.15 per test outperforming both Haiku 5.5 and GPT-6 Luna.
It also finishes tests in about 15 minutes, making it the fastest model in the top 12. -
AI at Meta reposted
BijanBowen
@bijanbowen
Muse Ember did this in under 2 minutes on its highest reasoning effort, this model might SLAP
-
AI at Meta reposted
Michelle Ko
@michelleekokoko
Muse Ember 🔥 our smallest, most efficient model built for work that agents repeat all day.
It sits on the efficiency frontier, and is designed for complex reasoning execution and work at scale: tool calls, coding subtasks, routing, extraction, document parsing.
Read more here: -
AI at Meta reposted
Alexandr Wang
@alexandr_wang
1/ announcing our smallest, most efficient little model is here: muse ember 🔥
built for work that agents repeat all day, it gets you more intelligence per dollar than Haiku, Luna, and all other flash models at any reasoning setting and does it at a third of the cost or less! -
AI at Meta
@AIatMeta
Today we're introducing Muse Ember, our smallest and most efficient model, built for complex reasoning execution and everyday agent work.
Muse Ember can carry workflows across apps, call tools in sequence, run tests and make targeted code fixes. With a 1M-token context window and native understanding of text, images, audio and video, it can also work across large document sets and varied inputs.
AI at Meta
@AIatMeta
For agents that perform hundreds of small tasks, efficiency matters at every step. Muse Ember is built to deliver more intelligence for the cost.
On the @ArtificialAnlys Intelligence Index, it achieves performance comparable to Claude Haiku 5.5 at roughly one-third of the cost per task, while scoring higher than GPT-6 Luna across all of Luna's reasoning settings.
AI at Meta
@AIatMeta
Muse Ember is available today on the Meta Model API, at $0.10 per million input tokens and $0.50 per million output tokens.
Learn more on our research blog: go.meta.me/muse-ember -
AI at Meta reposted
Mark Zuckerberg
@finkd
Releasing Muse Ember today -- our smallest model that delivers higher intelligence per dollar than others in its class. Built for token-heavy work that agents repeat all day: tool calls, coding subtasks, routing, extraction, and long document parsing. Available today on the Meta Model API and in Muse Code.
-
AI at Meta
@AIatMeta
Today we're bringing specialized models trained using Muse Wonder to @Muse and Meta AI, giving users access to some of Muse Wonder's frontier capabilities for complex tasks at work and in everyday life.
These specialized models include Muse Wonder's Active Memory and Active Focus, helping them stay aligned with your goals as tasks unfold:
→ Active Memory helps recognize when earlier information matters and distinguish what's still relevant from what's become stale
→ Active Focus helps recover from setbacks or find alternatives when constraints change
In Muse, the improved models show a 2.4x reduction in forgetting information critical to your goals and a 67% improvement in getting unstuck as constraints evolve. That means less repeating yourself and fewer dead ends when plans change.
In Meta AI, these improvements help it break complex problems into steps, ask sharper follow-up questions and adapt when you change direction.
Read more on our research blog: go.meta.me/4kCPcHW -
AI at Meta
@AIatMeta
During Connect, we previewed Muse Realtime Avatar, our real-time embodiment technology that turns Muse Realtime Voice into expressive, interactive avatars.
Today, we’re rolling it out in the @Muse app in the US, giving people a more natural way to engage with their personal agents.
Learn more about Muse Realtime Avatar on our research blog: go.meta.me/47ZSNsoThis media couldn't be displayed. See it on the original post. -
AI at Meta reposted
SAIR
@SAIRfoundation
New on Open Math OS: Muse Spark Open by @AIatMeta
816B total parameters (42B active). 1M context window. Available now to all approved teams.
Apply for Open Math OS now:
apply.openmathmodel.org -
AI at Meta reposted
CuspAI
@cusp_ai
🧵We’re sharing ODAC25, the largest open dataset to date for Direct Air Capture materials ☁️
Published in @NatChemEng with @AIatMeta @GeorgiaTech, and leading academic partners. -
AI at Meta reposted
Simon Taylor
@sytaylor
Meta's @Muse answers questions very differently from ChatGPT or Anthropic.
It cites more sources but uses far fewer words and tables, and doesn't try to ask a follow-up.
This short-form content is designed for dealing with tasks rather than continuing a conversation, and frankly, it's far less exhausting to read. This speaks to a really well designed AI experience and its so different from the base LLMs.
Great study by the AirOps team 👇
gg @alexandr_wang -
AI at Meta reposted
Meta for Developers
@MetaforDevs
How can Muse models help you build and scale?
Join us tomorrow, Thursday, Oct 29 at 9:30am PT to explore coding and agentic use cases with Muse Wonder and Muse Spark 1.3, learn how each model fits into your stack, and get direct feedback from Meta experts in live Q&A.
RSVP: events.atmeta.com/musewonderoct26 -
AI at Meta
@AIatMeta
Today we're announcing support for university research at @Caltech, @OhioStateMed, @LSU, @IndianaUniv, and @UTHealthHouston to help advance breakthroughs across science and medicine.
As part of the support for university researchers, we’ll provide access to our latest Muse models, including Muse Wonder and Muse Spark; open weight models like Muse Glimmer and Muse Spark Open; computer vision models such as SAM, V-JEPA, and DINO; as well as SeamlessM4T, our multilingual communication model.
We’re excited to support these five universities as they use our models to accelerate the important work they’re doing.
Read more on our research blog: go.meta.me/47G6wV3
AI at Meta
@AIatMeta
Here’s a look at the hard problems these five universities are tackling:
@Caltech: Expanding our partnership with Caltech to test whether large language models can accelerate innovative research in mathematics and physical sciences – pushing the boundaries of what AI can do in rigorous scientific domains
@OhioStateMed: Developing AI workflows to assist radiologists screening X-rays, building AI tools for earlier heart failure detection, and building clinician-guided AI tools for Alzheimer’s diagnosis.
@LSU: Implementing AI to improve non-contact infant tracheostomy monitoring, neurosurgical outcomes, VR training for medical professionals, and more.
@IndianaUniv: Applying open-weight models to improve maternal-newborn care and learning, with a focus on tools that work with limited connectivity and accommodate diverse cognitive needs.
@UTHealthHouston: Using Muse Glimmer, one of our smallest open-weight models, to support projects that improve treatment for brain cancer and agentic benchmarking in healthcare settings. -
AI at Meta reposted
Meta for Developers
@MetaforDevs
Muse Wonder is now available on @Cline, @Cloudflare, @Cognition, @Cursor_AI, @OpenRouter, @Oracle and @Vercel - with more partners coming soon.
We look forward to seeing what the community builds with Muse Wonder!
Start building 👉 dev.meta.ai/models/muse-wonder
Meta for Developers
@MetaforDevs
Muse Wonder is available today on Meta Model API and in Muse Code, and Muse Wonder Full is launching exclusively for Muse Code subscribers.
The Muse Wonder series combines frontier coding, long-running agents and advanced computer use capabilities to tackle developers’ most demanding work. (1/3) -
AI at Meta
@AIatMeta
Today we published a technical report on Muse Glimmer, our 30B open-weight model built for agentic tasks on consumer hardware.
It runs at practical speeds on a Mac or PC with a single consumer GPU at 4-bit precision, and leads comparably-sized open models on tool use and multi-step planning.
Read about the model architecture, distillation recipe, quantization and more: go.meta.me/4Bcvxol -
AI at Meta
@AIatMeta
We trained our Muse foundational models, including Muse Wonder, at Prometheus, our gigawatt-scale supercluster in New Albany, Ohio.
Across a supercluster with hundreds of thousands of GPUs, even one underperforming host can slow an entire training run. We engineered Prometheus for resilience at scale, achieving 85%+ goodput on pretraining, 90%+ on reinforcement learning and ~47K GPU hours mean time between interruptions during Muse Wonder training.
Take a look at the tech powering Prometheus: go.meta.me/4yXXApZThis media couldn't be displayed. See it on the original post. -
AI at Meta reposted
SemiAnalysis
@SemiAnalysis_
American open weights are back. 🇺🇸 Huge credit to @finkd, @alexandr_wang and the Meta team for putting Muse Spark Open in developers’ hands.
Muse Spark Open beats Nemotron 3 Ultra by a wide margin on agentic tasks. We’ve already added it to I for B200, with more configs to come. See what it costs to run, output throughput, etc. (1/2)🧵 -
AI at Meta reposted
Nathan Lambert
@natolambert
Guys this is like my superbowl I waited so long for US open weight models to be relevant again. Before today the US models were still behind Chinese models from as early as Feb. 2026. Still more work to do!
This cut the gap by at least half, in time (say 3 months) -
AI at Meta reposted
Artificial Analysis
@ArtificialAnlys
Meta has released Muse Spark Open, an 816B (42B active) open-weights model that scores 39 on the Artificial Analysis Intelligence Index, making it the #1 US open-weights model
Muse Spark Open (xhigh) scores 22 points above Muse Glimmer (high, 17), Meta's 30B dense open-weights model from August. It is also ahead of NVIDIA's Nemotron 3.5 Super VL (26), the next highest-scoring US open-weights model, which launched today
@AIatMeta shared access with us ahead of public release for benchmarking. Congratulations to @AIatMeta, @finkd, and @alexandr_wang on the release!
Key Takeaways:
➤ Open weights at the level of Meta's August flagship. Muse Spark Open scores within a point of Muse Spark 1.2 (xhigh, 40). It is stronger on AutomationBench-AA and has a lower hallucination rate, but weaker on GDPval-AA v2.1, CritPt and AA-Omniscience accuracy. Within Meta's current lineup, it sits 13 points behind Muse Wonder (max, 52) and 17 points behind Muse Wonder Full (max, 56)
➤ Token-efficient, at a moderate cost per task. Muse Spark Open uses 40k output tokens per Intelligence Index task, the fewest among the nine highest-scoring open-weights models: e.g. 16% fewer than Muse Spark 1.2 (xhigh, 48k) and 43% fewer than GLM-5.3 (max, 71k), its closest Chinese peer by size. Together AI, Fireworks and Baseten offer it at launch for $1.25/$4.25 per 1M input/output tokens ($0.15 cached input). At that pricing it costs $0.84 per Intelligence Index task. That is less than Muse Spark 1.2 ($0.97) at the same per-token prices and less than half of GLM-5.3 (max, $2.01), but about three times DeepSeek V4.1 Flash (max, $0.27)
➤ A relative weakness in agentic work compared to Chinese open-weights leaders. Among the nine highest-scoring open-weights models, Muse Spark Open ranks last on the four agentic evaluations in the index but fourth on the other six combined, and it leads all open-weights models on AA-Omniscience (25). GLM-5.3 (max), the closest Chinese model by size, owes all of its 6-point lead to the agentic evaluations
➤ Self-hostable on a single node, or two Mac Studios. BF16 weights are ~1.6TB. Meta's NVFP4 checkpoint quantizes only the 256 experts, cutting the weights to ~530GB. Meta says this runs on four Blackwell Ultra GPUs or eight H200s, or on two 512GB M5 Ultra Mac Studios using MLX. The architecture uses 62 layers with grouped-query attention (16 KV heads), 8 of 256 experts active per token, and a 1.8B-parameter Perception Encoder for vision
Other model details:
➤ Parameters: 816B total, 42B active (MoE)
➤ Context window: 1M tokens
➤ License: Muse Model License, a custom license that requires "Built with Muse Spark Open" attribution and a separate agreement with Meta for Model-as-a-Service businesses with over $20M in annual revenue
➤ Input modalities: text, image, video and audio. Output: text
➤ Availability: weights on Hugging Face (BF16 and NVFP4), with API access via Baseten, Fireworks AI, Groq, Modal, Nebius, OpenRouter and Together AI -
AI at Meta reposted
thehype.
@thehypedotnews
meta muse spark open beats 3 open-weight models – best pixel survivors game
muse spark open builds the most playable game of the four for $0.59. same brief for all: a vampire survivors-style pixel game, plain canvas 2d, no libraries, no images, built in 4 steps
cost
#1 hy4 preview – $0.52
#2 inkling – $0.52
#3 muse spark open – $0.59
#4 step 5 preview – $0.60
time
#1 inkling – 10m 53s
#2 muse spark open – 19m 58s
#3 step 5 preview – 20m 31s
#4 hy4 preview – 52m 27s
observations:
• muse – the most game-like: hordes, damage numbers, level-ups, zero crashes
• hy4 – slowest by far, but clean code at every step
• step – crashed mid-build and needed an extra fix turn
• inkling – fastest, prettiest graveyard, but its weapons deal zero damage
follow @thehypedotnews for 24/7 ai news, analysis and breakdownsThis media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
Today we’re releasing Muse Spark Open, the most capable US open-weight model to date.
Built for coding and agentic work, it excels at long-horizon tasks, complex software engineering, and multi-step reasoning.
Key Model Specs:
→ 816B total / 42B active parameters
→ 1M token context window
→ Natively multimodal across text, image, video, audio -
AI at Meta reposted
Cursor
@cursor_ai
Muse Wonder from Meta Superintelligence Labs is now available in Cursor!
It scores 46.1% on CursorBench at default effort, the highest of any Muse model.
Priced at $4/M input and $20/M output tokens. -
AI at Meta
@AIatMeta
We’re proud to share that Meta Omnilingual Automatic Speech Recognition (ASR) has been named one of @TIME’s Best Inventions of 2026!
Meta Omnilingual ASR is a suite of models providing ASR capabilities for over 1,600 languages, including 500 low-coverage languages never before served by any ASR system.
While most ASR systems focus on a limited set of languages that are well-represented on the internet, this release marked a major step toward building a truly universal transcription system.
Learn more about it here: time.com/collection/best-inventions/2026/meta-omnilingual…This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Today we’re releasing Muse Spark Open, the most capable US open-weight model to date.
Built for coding and agentic work, it excels at long-horizon tasks, complex software engineering, and multi-step reasoning.
Key Model Specs:
→ 816B total / 42B active parameters
→ 1M token context window
→ Natively multimodal across text, image, video, audio
AI at Meta
@AIatMeta
To help make advanced models more accessible, Muse Spark Open is optimized to run on two Apple M5 Ultra Mac Studios with the latest MLX framework.
It also runs on leading inference engines like SGLang, vLLM, TensorRT-LLM, Hugging Face Transformers, llama.cpp, and Unsloth with optimizations for AMD, Apple, Intel, and NVIDIA silicon.
Developers can further customize the model with PyTorch, including TorchTitan for fine-tuning.
AI at Meta
@AIatMeta
Muse Spark Open is available today through API platforms at Baseten, Fireworks AI, Groq, Modal, Nebius, OpenRouter and Together AI.
Download the weights on Amazon SageMaker AI, Google Cloud Model Garden, Hugging Face, and Microsoft Foundry Models.
Weights are released under the Muse Model License, with limited commercial terms that let many developers use the model for free.
Learn more on our research blog: go.meta.me/musesparkopen
Download the weights: huggingface.co/collections/meta-models/muse-spark-open -
AI at Meta reposted
Alexandr Wang
@alexandr_wang
1/ muse spark open is the most capable US open-weight model to date.
816B total params, 42B active. 1M-token context. natively multimodal. built for coding and agentic work like long-horizon tasks, hard software engineering, multi-step reasoning.
america! 🇺🇲 -
AI at Meta reposted
Mark Zuckerberg
@finkd
Muse Spark Open -- weights releasing today -- runs great on new Mac Studios thanks to work with @johnternus and Apple.
-
AI at Meta
@AIatMeta
Muse Wonder and Muse Wonder Full deliver SOTA performance on personal and professional agentic tasks.
Learn more about the models on our researcher blog: go.meta.me/musewonderThis media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
Watch the full convo with @finkd, @alexandr_wang and @collision:
John Collison
@collision
Cheeky Pint is back! Mark Zuckerberg @finkd and Alexandr Wang @alexandr_wang came to the pub to discuss their new frontier model, Muse Wonder.
00:00:24 Muse’s breakout use cases
00:07:28 The model is the product
00:14:35 Muse Wonder
00:24:56 How frontier models are built
00:48:26 Betting $100B
01:07:21 Agentic commerce
01:19:34 OpenRouter
01:20:06 Beyond the smartphone
01:27:00 Funding
01:34:06 Why AI won’t be winner-take-all
01:40:46 Meta Superintelligence Labs (MSL)
02:08:11 Working for Mark ZuckerbergThis media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Jason Wei
@_jasonwei
In our health workstream at Meta we did a project where we wanted to see what research papers medical experts could write using a Muse Wonder coding scaffold that could access a database of 5M electronic health records we licensed from a vendor. The goal is that with 5M patients in this database, AI could do research to answer arbitrary questions like “did people who take statin have higher rates of diabetes later in life”? The thing we were betting on here is on what happens when you put human experts, a strong coding model, and access to data all together
We worked with a small group of medical experts to help them use this AI tool and the punchline is that they all found that this setup enabled a much faster pace of health research. They generated ten manuscripts in around two weeks, with one researcher (Paddy Ssentongo) generating three. Throughout the process, they collaborated with each other to review manuscripts and write skill files to help our coding scaffold improve at doing research. The medical experts liked how quickly they could test different hypotheses and choose the best ones to continue working on
Health research is pretty unique in that it is super important to be able to interpret noisy data and have taste to know which variables are important, which was still a significant value add from human researchers. Given that medicine is one of the oldest fields in human history and it is ultimately about humans, keeping a substantial human component in this type of research is probably important. In the near future I see AI primarily as a tool to facilitate human-led research. With the right scaffold I believe health researchers can be 10x or even 100x more productive using AI tools that have appropriate access to the wealth of data that the world has collected about human health
One way to see this work is through the broader lens of AI for science. You can think of science as two parts: (1) collecting raw data about the world, and (2) synthesizing that raw data into understanding. In this project we already had existing data about the world and we aimed to accelerate part (2) using AI. Eventually, I imagine a world where we have such great AI tools that the time to synthesize raw data into understanding is driven towards zero. In that world, science will be substantially faster and most of the work will be focused on collecting the right raw data via physical experiments
We did this in a pretty short amount of time (which was the point) and I think the future of scientific research will be more faster and more exciting than ever
AI at Meta
@AIatMeta
We’re exploring how AI can accelerate health science research.
While AI has made significant breakthroughs in formal sciences like mathematics, health data science depends on imperfect real-world data and consequential choices about cohorts, variables, and causal assumptions.
To explore how AI can assist health researchers, we built a human-led research scaffold powered by Muse Spark 1.3 and Muse Wonder with access to 5M retrospective de-identified electronic health records and publicly available data. A cohort of medical experts used the system to conduct original research, accelerate hypothesis generation, code execution, and manuscript drafting while maintaining full authority over scientific decisions.
Today, we’re sharing 10 research manuscripts produced through this exploration, spanning cardiology, oncology, infectious disease, emergency medicine, and more.
Read more in our research blog: go.meta.me/3U06wvDThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
We’re exploring how AI can accelerate health science research.
While AI has made significant breakthroughs in formal sciences like mathematics, health data science depends on imperfect real-world data and consequential choices about cohorts, variables, and causal assumptions.
To explore how AI can assist health researchers, we built a human-led research scaffold powered by Muse Spark 1.3 and Muse Wonder with access to 5M retrospective de-identified electronic health records and publicly available data. A cohort of medical experts used the system to conduct original research, accelerate hypothesis generation, code execution, and manuscript drafting while maintaining full authority over scientific decisions.
Today, we’re sharing 10 research manuscripts produced through this exploration, spanning cardiology, oncology, infectious disease, emergency medicine, and more.
Read more in our research blog: go.meta.me/3U06wvDThis media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Chubby♨️
@kimmonismus
Now I can say it: Had early access to @Meta’s new "Watermelon" for the past few days.
Trick questions didn’t fool it, it followed instructions to the word, and as a coding agent it wrote, ran and checked its own code. Creative writing still a bit dry for my taste, but very very very impressive overall.
From my initial testings its as good as the benchmarks make it look. Meta really nailed it with their model!
P.s.: the benchmarks still surprised me, in a postive way. Didnt see the benchmark evals in advance. -
AI at Meta reposted
John Collison
@collision
Cheeky Pint is back! Mark Zuckerberg @finkd and Alexandr Wang @alexandr_wang came to the pub to discuss their new frontier model, Muse Wonder.
00:00:24 Muse’s breakout use cases
00:07:28 The model is the product
00:14:35 Muse Wonder
00:24:56 How frontier models are built
00:48:26 Betting $100B
01:07:21 Agentic commerce
01:19:34 OpenRouter
01:20:06 Beyond the smartphone
01:27:00 Funding
01:34:06 Why AI won’t be winner-take-all
01:40:46 Meta Superintelligence Labs (MSL)
02:08:11 Working for Mark ZuckerbergThis media couldn't be displayed. See it on the original post. -
AI at Meta reposted
-
AI at Meta reposted
Artificial Analysis
@ArtificialAnlys
Meta has released Muse Wonder and Muse Wonder Full, achieving Artificial Analysis Intelligence Index v4.3 scores of 52 and 56 at max reasoning effort - each a material gain over Muse Spark 1.3 (max) at 48, with a release gap of only 6 weeks
Muse Wonder is available for users on Meta’s first-party API, while Muse Wonder Full is currently only available for Muse Code users. Meta notes that each model is designed for personal and professional agent use
Congratulations to @AIatMeta, @finkd, and @alexandr_wang on the release!
Key Takeaways:
➤ Both models exhibit a material jump in overall Intelligence Index score. Muse Wonder Full (max) improves on Muse Spark 1.3 (max) across all ten Intelligence Index evaluations, gaining 8 points to 56. The largest gains were seen in agentic evaluations: Terminal-Bench 4.0 (+24 points, 33% to 57%), GDPval-AA v2.1 (+176 Elo, 1681 to 1857), and AA-Briefcase (+148 Elo, 1581 to 1729). Muse Wonder (max) gains 4 Intelligence Index points and lands at 52, with notable improvements vs. Muse Spark 1.3 (max) in Terminal-Bench 4.0 (33% to 52%) and AutomationBench-AA (58% to 68%)
➤ Muse Wonder Full (max) places in the top three on six of the ten Intelligence Index evaluations, and is particularly strong in agentic knowledge work and scientific reasoning. In agentic knowledge work, it narrowly leads on GDP.pdf (33%), ranks #2 on GDPval-AA v2.1 (1857 Elo), and #3 on both AA-Briefcase (1729 Elo) and AutomationBench-AA (71%). In scientific reasoning, it tops the CritPt leaderboard at 33% and ranks #3 on SciCode with 63%. This builds on the relative strengths of Muse Spark 1.3 (max), which also showed particular ability in these two domains
➤ Both models use fewer output tokens than Muse Spark 1.3 (max). Muse Wonder (max) and Muse Wonder Full (max) each use around 54k output tokens per Intelligence Index task, down ~10% from Muse Spark 1.3 (max, 60k). This usage is lower than similarly intelligent models Gemini 4 Argon (high, 62k) and Claude Fable 5.1 (max w/ fallback, 78k), but higher than GPT-6.1 Sol (max, 38k) and GPT-6 Astra (max, 27k). Muse Wonder Full (max) uses 16% fewer input tokens per Intelligence Index task than Muse Wonder (max) (6.44M vs 7.69M), meaning it is both more intelligent and more token-efficient
➤ Cost per Task for Muse Wonder (max) lands higher than most similarly intelligent models. Despite efficient output token use, premium API pricing ($4 per million input tokens, $20 per million output tokens) and high input token use (7.69M per task) push Muse Wonder (max)’s cost to $4.52 per Intelligence Index task. This is lower than Claude Fable 5.1 (max w/ fallback, $7.63), Claude Opus 5.5 (max w/ fallback, $5.98), and Claude Sonnet 5.5 (max w/ fallback, $5.46), but higher than GPT-6 Astra (max, $3.26), Gemini 4 Argon (high, $1.99), GPT-6.1 Sol (max, $0.72), and its predecessor Muse Spark 1.3 (max, $1.60). Per-token pricing is not currently available for Muse Wonder Full, so no Cost per Task figure can be estimated at this stage
➤ Both models gain significantly in Coding Agent performance. Muse Wonder Full achieves 68 on the Artificial Analysis Coding Agents Index at max effort in Muse Code, alongside Claude Code with Sonnet 5.5 (max, 68) and Opus 5.5 (max, 66). Muse Wonder (max) scores 63. These represent material gains over Muse Code with Muse Spark 1.3 (max), which scores 54
Other details for the two new models:
➤ Context windows: 1M tokens each, unchanged from Muse Spark 1.3
➤ Pricing: for Muse Wonder, $4 input / $0.20 cached input / $20 output per 1M tokens. Pricing per token is not yet announced for Muse Wonder Full
➤ Input modalities: text, image, video, and audio
➤ Output modalities: text
➤ Availability: Muse Wonder is available on Meta's first-party API and Muse Code at launch, while Muse Wonder Full is only available to Muse Code users -
AI at Meta
@AIatMeta
From rebuilding our foundation to pushing the frontier in 14 months 🚀
-
AI at Meta
@AIatMeta
We’re excited to introduce the Muse Wonder series with Muse Wonder and Muse Wonder Full, our most capable models yet. Both are frontier models, built to deliver state-of-the-art performance for personal and professional agentic tasks.
Muse Wonder is available today via the Meta Model API and Muse Code. Muse Wonder Full is available today for Muse Code subscribers. Muse Wonder will also soon power experiences in our personal agent product, Muse, rolling out first to subscribers.This media couldn't be displayed. See it on the original post.Post not available here, view on X
AI at Meta
@AIatMeta
Two things make Muse Wonder suited for long-running, multi-step work an agent faces every day:
-> Active Memory carries your context across conversations and surfaces it when it's relevant.
-> Active Focus keeps the models working toward your goal when a task gets challenging, trying alternative approaches, working through blockers, and following through to completion.
AI at Meta
@AIatMeta
Delivering personal superintelligence requires a significant investment in alignment and safety, and demands a model that exercises discretion with private information and resists misuse.
We trained the Muse Wonder family to lead on both dimensions, with robustness to adversarial instructions and careful handling of private information.
AI at Meta
@AIatMeta
We hope that Muse Wonder and Muse Wonder Full give more people the power to pursue their dreams and build the world they want.
Learn more in our research blog: go.meta.me/musewonder
AI at Meta
@AIatMeta
To quantify how the models handle unfamiliar tasks, we compared test-time compute scaling on tasks trained on during post-training against other tasks.
Both models improve similarly out-of-distribution, but given the same in-distribution score, Muse Wonder Full performs better on unfamiliar tasks than the Muse Spark 1.3 trend predicts. We attribute this upward shift to a stronger base model, which carries post-training gains over more effectively to tasks we didn't anticipate. -
AI at Meta reposted
Alexandr Wang
@alexandr_wang
introducing muse wonder
our new frontier model. state-of-the-art at personal agents and professional agents.
our largest and most capable model yet—rivals the big boisThis media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Alexandr Wang
@alexandr_wang
MUSE WONDER
this is the culmination of over a year of research and infrastructure work in msl
since we originally shipped muse spark in april, we have continued to scale our models across pre-training and RL, now reaching the frontier 🏆
see our model's improvements on the artificial analysis index: -
AI at Meta reposted
Mark Zuckerberg
@finkd
Introducing Muse Wonder, our new family of frontier models with state of the art performance for personal and professional agentic work.
-
AI at Meta reposted
Alexandr Wang
@alexandr_wang
vibes kinda good 🍉
-
AI at Meta
@AIatMeta
Following gold-medal-level performance from our AI models across five competitions in mathematics, physics, and chemistry, we asked a harder question: can AI contribute when a problem is genuinely open and without an existing solution path?
Over the past several months, mathematicians worked with Muse Spark 1.1 and Muse Spark 1.2 in Thinking Mode through the regular meta.ai chat interface, with no custom research scaffold, to find solutions to such problems.
Our goal wasn't to mass-produce papers, but empower researchers. Every collaboration followed the same principles: mathematicians guided the research, a second group of mathematicians then reviewed the work, each paper marks which passages were drafted primarily by humans or AI, and each credits the prior research it builds on. Where other teams independently announced solutions to the same problems, we acknowledge their work as well.
Today, we're sharing six papers from that collaboration.
🧵👇
AI at Meta
@AIatMeta
1️⃣ Probability: Mathematicians worked with Muse Spark to answer a question about fitting random points onto the surface of a stretched sphere. For the setting studied, they proved a sharp cutoff between when an exact fit is likely and when it is unlikely.
Read the paper:Post not available here, view on X
AI at Meta
@AIatMeta
6️⃣ Non-Associative Algebra: The team worked with Muse Spark to find an exception to a proposed rule about mathematical structures inspired by biology. They went further by developing an alternative characterization, which the researchers checked and refined.
Read the paper:
AI at Meta
@AIatMeta
Read more on our research blog: research.meta.ai/blog/solving-open-research-problems-toge…
-
AI at Meta
@AIatMeta
In the past 6 months...
- Muse Spark
- Muse Image
- Muse Video
- Muse Spark 1.1
- Meta Model API
- Muse Glimmer
- Muse Spark 1.2
- Muse Code
- Muse Spark 1.3
- Muse
...and we’re just getting started. 🚀This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Meta for Developers
@MetaforDevs
Come and build the future of superintelligence at the Meta Global AI Developer Hackathon.
Ten days, access to our newest models and $1M in prizes.
It’s virtual, worldwide and free to enter.
Be the first to know when applications open → dev.meta.ai/events/global-hackathon -
AI at Meta reposted
Meta for Developers
@MetaforDevs
Meta Connect 2026: Developer State of the Union
x.com/i/broadcasts/1pKkOXLDQwMKj -
AI at Meta
@AIatMeta
@finkd just unveiled Muse Realtime Avatar, our real-time embodiment technology that turns Muse Realtime Voice into expressive, interactive avatars.
Muse Realtime Avatar enables an entirely new range of interactions in @Muse, starting with real-time conversations.
🧵👇
#metaconnectThis media couldn't be displayed. See it on the original post.Post not available here, view on X
AI at Meta
@AIatMeta
We put Muse Realtime Avatar head-to-head with two leading commercial avatar systems in their own live-call products. Raters held 2–3 minute conversations with matched avatar identities, then compared visual quality, sync, character consistency, and mannerisms.
Muse Realtime Avatar came out ahead on overall preference.
AI at Meta
@AIatMeta
Read our research blog to learn more about Muse Realtime Avatar: research.meta.ai/blog/bringing-your-muse-to-life
-
AI at Meta reposted
Meta for Developers
@MetaforDevs
Meta’s Segment Anything Model (SAM) 3.1 is now available on Meta Model API, giving developers a fast and lightweight model for detection, segmentation and tracking in a single call on inference tuned for SAM 3.1's architecture.
Use a short phrase to find objects in images and video. One API call returns detections, pixel-precise segmentation masks, and identity-preserving video tracks.
Learn more and start building: dev.meta.ai/models/sam-3-1 -
AI at Meta reposted
Meta for Developers
@MetaforDevs
Muse Code from Meta is now available natively on Windows - no WSL required.
It’s PowerShell-fluent, sandboxed by default, native x64 and ARM64, and supports zero-admin install. Coming soon: intersession messaging.
Get started: irm dev.meta.ai/install.ps1 | iex
Learn more:This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Mark Zuckerberg
@finkd
Last month I wrote about how we can build a positive and safe future for everyone: meta.com/thefutureisforeveryone
Every lab has the responsibility and incentive to move at the pace required to train its models safely, and the ability to take its own actions to ensure that happens.
The reality is:
- People won't want to use agents that are misaligned with them and that don't do what they ask, so labs have a strong natural incentive to make their models more aligned.
There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn't focus on alignment will fall behind.
- Labs face significant liability if their models cause harm, so they have a strong incentive to prevent this as well.
Meta delayed shipping Muse for several months to focus on safety and security. We didn't call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us. I'm proud of the security foundations we've built.
- Engaging independent evaluators and advisors is industry best practice. MSL already does this today in several areas because it helps produce better work. Other labs can just do this too. In general, it would be helpful for there to be a larger and more diverse ecosystem of evaluators.
- Committing the significant majority of compute towards serving people rather than racing towards recursive self-improvement is one of the best ways to ensure we develop this technology safely. Meta has made this commitment and other labs can do this as well.
I believe the key to building a positive future for everyone is maintaining the right balance of power. This is within our power to do. -
AI at Meta reposted
Daniel Levine
@levine_ds
Today, w/ Andrew Ferguson's group at @UChiPritzker: we're able to simulate entire enzyme systems with explicit solvent (O(100k) atoms) at near-quantum accuracy, matching real experimental measurements for enzyme activity.
~1,000x faster than SOTA QM/MM. -
AI at Meta reposted
DesignArena
@DesignArena
BREAKING: Muse Spark 1.3 (xhigh) takes 1st overall on Website Arena with an Elo of 1362!
This is a jump of 5 positions from Muse Spark 1.2, establishing a new Pareto frontier for Speed and Price.
Only a month after the release of Muse Spark 1.2, @AIatMeta has topped this category on Design Arena.
Note: GPT-6 Astra is still pending final results.
Congrats to the @Meta team! -
AI at Meta reposted
Ivan Zhao
@ivanhzhao
I've been testing Muse lately. A very capable, utility-minded personal agent in your pocket. Strong browser use. The spin on feed is interesting (still getting used to it.)
A great entrance to the agent space!
Alexandr Wang
@alexandr_wang
1/ today we're rolling out Muse, our new personal ai assistant. Muse is always-on, wicked fast, can use a browser, connect to your apps, and is designed to be secure.
try it now: muse.ai.This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
signüll
@signulll
muse has been a genuinely impressive product to play with. it has all of the functionality of the imessage agents in flight today but also has all of the ingredients that will expose it to hundreds of millions including a massive friend graph through insta, increasingly rich context from email & other services which you connect, & more importantly stuff like fb marketplace.
marketplace in particular is an incredible distribution wedge. millions of normal people could encounter muse simply cuz an agent helps them find something, negotiate the price, & arrange pickup.
pretty good execution here from fb. -
AI at Meta reposted
Matt Huang
@matthuang
I've really been enjoying Muse and I think they have really nailed the permissioning and secrets manager, which feels increasingly important as we let agents take on more scope in our lives.
Alexandr Wang
@alexandr_wang
1/ today we're rolling out Muse, our new personal ai assistant. Muse is always-on, wicked fast, can use a browser, connect to your apps, and is designed to be secure.
try it now: muse.ai.This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Alexandr Wang
@alexandr_wang
1/ today we're rolling out Muse, our new personal ai assistant. Muse is always-on, wicked fast, can use a browser, connect to your apps, and is designed to be secure.
try it now: muse.ai.This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Today we launched muse.ai, a personal AI agent, and published a deep dive on how we built safety into its system.
An agent that gets to know you over time necessarily holds a lot of context about you. That's the source of its usefulness and the reason we built Muse to be secure, safe, and private.
Read the full deep dive here: security.muse.aiThis media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Mark Zuckerberg
@finkd
Introducing Muse, the personal agent that understands your goals and works 24/7 to get things done for you.
-
AI at Meta
@AIatMeta
Introducing Muse, a personal agent that gets things done for you, powered by Muse Spark 1.3.
Get an inside look at how we built Muse and what it can do for you: introducing.muse.aiThis media couldn't be displayed. See it on the original post.
Muse
@Muse
Introducing Muse, your personal AI agent from Meta that gets things done across every part of life.
Download the Muse app and get started: muse.aiThis media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Vals AI
@ValsAI
Meta Muse Spark 1.3 (Max) matches the performance of Fable 5 and GPT 5.6 Sol on the Vals Index, at 4x - 8x cheaper.
-
AI at Meta
@AIatMeta
As a test of our progress to advance the frontier of AI research, in June we entered the next generation of our autonomous AI research system, AIRA₃, in a live Kaggle competition run by NVIDIA to fine-tune a 30B Nemotron model. The challenge was to teach the model to reason better — all competitors had access to the same information and were graded externally on a private test set.
AIRA₃ placed 8th out of ~4,000 teams to win Gold, outperforming human competitors who had access to the same frontier tools.
We believe this is a reliable signal that AIRA₃ can improve a targeted capability of an AI model at a level similar to human experts.
AI at Meta
@AIatMeta
We entered AIRA₃ with an ensemble of models in the live competition, and also assessed it with several others post-hoc. The 8th ranked gold medal entry ensemble was a combination of GPT 5.5 (w/ OpenCode) + Claude 4.8 (w/ ClaudeCode).
Post-hoc we assessed with Muse Spark 1.2 (w/ MuseCode), which also performed at a Gold Medal level, as well as Muse Spark 1.1 (w/ OpenCode) and GLM 5.2 (w/ OpenCode), both of which achieved Silver Medal level performance. The post-hoc submissions were also graded externally on the same private test set as those made during the live competition.
AI at Meta
@AIatMeta
Rather than relying on a central controller, AIRA₃ runs many long-running agents (pairs of models + coding harnesses) in their own isolated environments and coordinates asynchronously through two shared substrates:
1️⃣ a forum for sharing hypotheses and findings
2️⃣ a shared filesystem for solution artifacts
The individual agents collaborate, share discoveries, and build on each other’s work. As the graph below demonstrates, the system uses compute to compound knowledge and drive performance gains over time. Search strategies emerge dynamically as each agent decides which discoveries to build upon.
AI at Meta
@AIatMeta
While the Kaggle competition demonstrated AIRA₃’s capabilities in a specific domain, the system itself can generalize across distinct domains: changing only the task specification. In an internal benchmark, AIRA₃ achieved a 27% latency reduction on production GPU kernels, and gold-level performance in another Kaggle competition translating 4,000-year-old Akkadian clay tablets into English.
We're early, and hard problems are still ahead of us. But we believe a system that compounds its own knowledge is the right bet. As we continue to develop and scale, we’re excited about its potential to accelerate AI research and unlock recursive self-improvement. -
AI at Meta reposted
Iam_
@SPAC89
I’ve been testing Muse Spark 1.3 MAX and honestly, it’s insanely good and surprisingly efficient, It just got enabled today and it’s already sitting at 3 on Artificial Analysis. Definitely give it a try, it’s way better than I expected. Meta is seriously cooking right now!
This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Meta for Developers
@MetaforDevs
Muse Spark 1.3 with max reasoning is now available on Muse Code and Meta Model API. Developers can build with frontier performance without the frontier prices.
We thought showing would be better than telling, and encouraged our friends in Meta Superintelligence Labs to come up with a few demos.
One-shot prompt: Build a rendering engine from scratch in C that writes pixels directly, scales from simple primitives to complex scenes, and culminates in a striking lighting demo.
Check out the rest 👇🏻(1/4) -
AI at Meta
@AIatMeta
Muse Spark 1.3 with max reasoning is now available on Muse Code and Meta Model API 👇
Alexandr Wang
@alexandr_wang
1/ we just publicly released Muse Spark 1.3 max!
we see significantly stronger coding and agentic performance on muse spark 1.3 max, so would strongly recommend trying it out even if you've already tried muse spark 1.3 high or muse spark 1.3 xhigh.2 media couldn't be displayed. See them on the original post. -
AI at Meta reposted
Lumina
@LuminaBench
🚨 Meta just mogged Gemini 3.8 Flash a few hours after launch
Muse Spark 1.3 is already scoring 62 on Artificial Analysis vs 59 for Gemini 3.8 Flash
Google finally gets a win for once and Meta immediately pulls this😂 -
AI at Meta reposted
shirish
@shiri_shh
so...you're telling me Meta's new model is already ranking right next to Fable 5 and GPT 5.6 Sol?
there is absolutely no way this is real 😭
Artificial Analysis
@ArtificialAnlys
Meta has released Muse Spark 1.3, their fourth Muse Spark model release in five months. Muse Spark 1.3 (max), which is in limited preview for Meta’s partners, scores 62 on the Artificial Analysis Intelligence Index, behind only Claude Fable 5.1 and Claude Opus 5. The variant available now, Muse Spark 1.3 (xhigh), scores 61 and ties with GPT-5.6 Sol (max) and Grok 4.6 (high). Both variants’ gains come primarily from improvements in agentic work and scientific capabilities
Muse Spark 1.3 (xhigh) enters the Artificial Analysis Intelligence Index at 61, up 4 points from Muse Spark 1.2 (57, August) and 8 points from Muse Spark 1.1 (53, July). It enters tied with GPT-5.6 Sol (max), Grok 4.6 (high), and Claude Opus 5 (high), and behind Claude Fable 5.1 (max, 66), Claude Opus 5 (max, 63), and Claude Fable 5 (max, 62)
Muse Spark 1.3 (max), which is in a limited preview stage, lands at 62. This higher index score is enabled by gains vs. Muse Spark 1.3 (xhigh) in Tau3-Bench Banking (52% vs. 47%) and GDPval-AA v2 (1,754 Elo vs. 1,709). Muse Spark 1.3 (max) is second only to Claude’s Fable and Opus variants in total score
Congratulations to @AIatMeta, @finkd, and @alexandr_wang on the release!
Key Takeaways:
➤ Continued improvement on agentic knowledge work tasks. At the launch of Muse Spark 1.2, we noted its significant gains in agentic knowledge work performance vs. Muse Spark 1.1. The latest iteration continues this trend, with Muse Spark 1.3 (xhigh) demonstrating a notable 12-point gain vs. Muse Spark 1.2 in Tau3-Bench Banking (35% to 47%), a 5-point gain in Terminal-Bench 2.1 (80% to 85%), and a new GDPval-AA v2 Elo of 1709 against its predecessor’s 1615. Muse Spark 1.3 (max) improves further on Tau3-Bench Banking (52%) and GDPval-AA v2 (1,754 Elo). This Tau3-Bench Banking score is #1 among all models. Muse Spark 1.3 (max) achieves these higher agentic work scores by using more turns and total reasoning tokens, reasoning 62% more on GDPval-AA v2 and 28% more on Tau3-Bench Banking compared to Muse Spark 1.3 (xhigh)
➤ The lowest cost per task for any model at 59+ on the Artificial Analysis Intelligence Index. Muse Spark 1.3 (xhigh) costs $0.55 per Intelligence Index task at Meta's unchanged $1.25/$4.25 per 1M token pricing ($0.15 for cached input), with its peers GPT-5.6 Sol (max) and Grok 4.6 (high) costing $0.95 and $0.94 respectively, a 70%+ premium. This places Muse Spark 1.3 (xhigh) on the Pareto frontier for Intelligence vs. Cost per Task. Its cost per task is higher than Muse Spark 1.2 ($0.40 per task), driven by ~57% more input tokens per task on agentic evaluations, with output tokens up only ~8%. Pricing for Muse Spark 1.3 (max) is not yet publicly available
➤ Scientific Reasoning results rose across the board, led by CritPt. CritPt was the standout non-agentic score gain vs. Muse Spark 1.2, with a material +8 points for the xhigh variant (18% to 26%), and GPQA Diamond achieved +4 points (90% to 94%), while Humanity’s Last Exam and SciCode each gained a more modest 2-3 points (45% to 47% and 56% to 59%, respectively). Muse Spark 1.3 (max) achieved roughly similar scores to the xhigh variant, gaining 2 points in Humanity’s Last Exam, tying on GPQA Diamond, and losing a point on CritPt vs. Muse Spark 1.3 (xhigh)
➤ Minor regressions in only two evaluations. Both Muse Spark 1.3 (xhigh) and Muse Spark 1.3 (max) dropped 4 points in AA-LCR (83% to 79%) when compared to Muse Spark 1.2, and AA-Omniscience (Accuracy) fell 3 points for xhigh and 1 point for max. The drops in AA-Omniscience (Accuracy) are due to a higher abstention rate (not answering questions when unsure), which also lowered the hallucination rate for Muse Spark 1.3 (xhigh)
Other model details (xhigh variant):
➤ Context window: 1M tokens, unchanged from Muse Spark 1.2
➤ Pricing: unchanged from Muse Spark 1.2: $1.25/$4.25 per 1M input/output tokens, with cache hits discounted to $0.15 per 1M
➤ Input modalities: text, image, video
➤ Availability: Meta's first-party API and Muse Code -
AI at Meta reposted
Alex Volkov
@altryne
Damn, gloves are off!
Unreleased Meta Muse Spark with max reasoning is beating even Fable 5, while the xhigh that is available, matches Grok 4.6 and GPT 5.6 sol on @ArtificialAnlys
This is quite the statement from @AIatMeta 🔥
Busy weeks ahead of us!
Alexandr Wang
@alexandr_wang
i really hate to say it, but…
gemini who? 🏎️💨
Artificial Analysis
@ArtificialAnlys
Meta has released Muse Spark 1.3, their fourth Muse Spark model release in five months. Muse Spark 1.3 (max), which is in limited preview for Meta’s partners, scores 62 on the Artificial Analysis Intelligence Index, behind only Claude Fable 5.1 and Claude Opus 5. The variant available now, Muse Spark 1.3 (xhigh), scores 61 and ties with GPT-5.6 Sol (max) and Grok 4.6 (high). Both variants’ gains come primarily from improvements in agentic work and scientific capabilities
Muse Spark 1.3 (xhigh) enters the Artificial Analysis Intelligence Index at 61, up 4 points from Muse Spark 1.2 (57, August) and 8 points from Muse Spark 1.1 (53, July). It enters tied with GPT-5.6 Sol (max), Grok 4.6 (high), and Claude Opus 5 (high), and behind Claude Fable 5.1 (max, 66), Claude Opus 5 (max, 63), and Claude Fable 5 (max, 62)
Muse Spark 1.3 (max), which is in a limited preview stage, lands at 62. This higher index score is enabled by gains vs. Muse Spark 1.3 (xhigh) in Tau3-Bench Banking (52% vs. 47%) and GDPval-AA v2 (1,754 Elo vs. 1,709). Muse Spark 1.3 (max) is second only to Claude’s Fable and Opus variants in total score
Congratulations to @AIatMeta, @finkd, and @alexandr_wang on the release!
Key Takeaways:
➤ Continued improvement on agentic knowledge work tasks. At the launch of Muse Spark 1.2, we noted its significant gains in agentic knowledge work performance vs. Muse Spark 1.1. The latest iteration continues this trend, with Muse Spark 1.3 (xhigh) demonstrating a notable 12-point gain vs. Muse Spark 1.2 in Tau3-Bench Banking (35% to 47%), a 5-point gain in Terminal-Bench 2.1 (80% to 85%), and a new GDPval-AA v2 Elo of 1709 against its predecessor’s 1615. Muse Spark 1.3 (max) improves further on Tau3-Bench Banking (52%) and GDPval-AA v2 (1,754 Elo). This Tau3-Bench Banking score is #1 among all models. Muse Spark 1.3 (max) achieves these higher agentic work scores by using more turns and total reasoning tokens, reasoning 62% more on GDPval-AA v2 and 28% more on Tau3-Bench Banking compared to Muse Spark 1.3 (xhigh)
➤ The lowest cost per task for any model at 59+ on the Artificial Analysis Intelligence Index. Muse Spark 1.3 (xhigh) costs $0.55 per Intelligence Index task at Meta's unchanged $1.25/$4.25 per 1M token pricing ($0.15 for cached input), with its peers GPT-5.6 Sol (max) and Grok 4.6 (high) costing $0.95 and $0.94 respectively, a 70%+ premium. This places Muse Spark 1.3 (xhigh) on the Pareto frontier for Intelligence vs. Cost per Task. Its cost per task is higher than Muse Spark 1.2 ($0.40 per task), driven by ~57% more input tokens per task on agentic evaluations, with output tokens up only ~8%. Pricing for Muse Spark 1.3 (max) is not yet publicly available
➤ Scientific Reasoning results rose across the board, led by CritPt. CritPt was the standout non-agentic score gain vs. Muse Spark 1.2, with a material +8 points for the xhigh variant (18% to 26%), and GPQA Diamond achieved +4 points (90% to 94%), while Humanity’s Last Exam and SciCode each gained a more modest 2-3 points (45% to 47% and 56% to 59%, respectively). Muse Spark 1.3 (max) achieved roughly similar scores to the xhigh variant, gaining 2 points in Humanity’s Last Exam, tying on GPQA Diamond, and losing a point on CritPt vs. Muse Spark 1.3 (xhigh)
➤ Minor regressions in only two evaluations. Both Muse Spark 1.3 (xhigh) and Muse Spark 1.3 (max) dropped 4 points in AA-LCR (83% to 79%) when compared to Muse Spark 1.2, and AA-Omniscience (Accuracy) fell 3 points for xhigh and 1 point for max. The drops in AA-Omniscience (Accuracy) are due to a higher abstention rate (not answering questions when unsure), which also lowered the hallucination rate for Muse Spark 1.3 (xhigh)
Other model details (xhigh variant):
➤ Context window: 1M tokens, unchanged from Muse Spark 1.2
➤ Pricing: unchanged from Muse Spark 1.2: $1.25/$4.25 per 1M input/output tokens, with cache hits discounted to $0.15 per 1M
➤ Input modalities: text, image, video
➤ Availability: Meta's first-party API and Muse Code -
AI at Meta reposted
Tim Jayas
@TimJayas
Muse Spark 1.3 >> Fable 5
muse spark just teleported into #3 spot and it's the first ever model to get in between Claude and GPT
the pricing compared to fable is a joke, what a surprise launch!
Alexandr Wang
@alexandr_wang
1/ today we’re releasing muse spark 1.3—available in muse code & the meta model api.
this is our most capable model yet—frontier performance almost too cheap to meter. much stronger at agentic and coding with better usability. we think users will really notice the jump. -
AI at Meta reposted
Chubby♨️
@kimmonismus
wtf Muse Spark 1.3 It has achieved first place in DeepSWE with 75.4%, even ahead of GPT-5.6 Sol and Fable 5.
What's going on here?!
leo 🐾
@synthwavedd
Muse Spark 1.3 is here! Benchmarks look pretty good, with a SoTA score on DeepSWE v1.1
Proving to be a very busy week -
AI at Meta reposted
Artificial Analysis
@ArtificialAnlys
Meta has released Muse Spark 1.3, their fourth Muse Spark model release in five months. Muse Spark 1.3 (max), which is in limited preview for Meta’s partners, scores 62 on the Artificial Analysis Intelligence Index, behind only Claude Fable 5.1 and Claude Opus 5. The variant available now, Muse Spark 1.3 (xhigh), scores 61 and ties with GPT-5.6 Sol (max) and Grok 4.6 (high). Both variants’ gains come primarily from improvements in agentic work and scientific capabilities
Muse Spark 1.3 (xhigh) enters the Artificial Analysis Intelligence Index at 61, up 4 points from Muse Spark 1.2 (57, August) and 8 points from Muse Spark 1.1 (53, July). It enters tied with GPT-5.6 Sol (max), Grok 4.6 (high), and Claude Opus 5 (high), and behind Claude Fable 5.1 (max, 66), Claude Opus 5 (max, 63), and Claude Fable 5 (max, 62)
Muse Spark 1.3 (max), which is in a limited preview stage, lands at 62. This higher index score is enabled by gains vs. Muse Spark 1.3 (xhigh) in Tau3-Bench Banking (52% vs. 47%) and GDPval-AA v2 (1,754 Elo vs. 1,709). Muse Spark 1.3 (max) is second only to Claude’s Fable and Opus variants in total score
Congratulations to @AIatMeta, @finkd, and @alexandr_wang on the release!
Key Takeaways:
➤ Continued improvement on agentic knowledge work tasks. At the launch of Muse Spark 1.2, we noted its significant gains in agentic knowledge work performance vs. Muse Spark 1.1. The latest iteration continues this trend, with Muse Spark 1.3 (xhigh) demonstrating a notable 12-point gain vs. Muse Spark 1.2 in Tau3-Bench Banking (35% to 47%), a 5-point gain in Terminal-Bench 2.1 (80% to 85%), and a new GDPval-AA v2 Elo of 1709 against its predecessor’s 1615. Muse Spark 1.3 (max) improves further on Tau3-Bench Banking (52%) and GDPval-AA v2 (1,754 Elo). This Tau3-Bench Banking score is #1 among all models. Muse Spark 1.3 (max) achieves these higher agentic work scores by using more turns and total reasoning tokens, reasoning 62% more on GDPval-AA v2 and 28% more on Tau3-Bench Banking compared to Muse Spark 1.3 (xhigh)
➤ The lowest cost per task for any model at 59+ on the Artificial Analysis Intelligence Index. Muse Spark 1.3 (xhigh) costs $0.55 per Intelligence Index task at Meta's unchanged $1.25/$4.25 per 1M token pricing ($0.15 for cached input), with its peers GPT-5.6 Sol (max) and Grok 4.6 (high) costing $0.95 and $0.94 respectively, a 70%+ premium. This places Muse Spark 1.3 (xhigh) on the Pareto frontier for Intelligence vs. Cost per Task. Its cost per task is higher than Muse Spark 1.2 ($0.40 per task), driven by ~57% more input tokens per task on agentic evaluations, with output tokens up only ~8%. Pricing for Muse Spark 1.3 (max) is not yet publicly available
➤ Scientific Reasoning results rose across the board, led by CritPt. CritPt was the standout non-agentic score gain vs. Muse Spark 1.2, with a material +8 points for the xhigh variant (18% to 26%), and GPQA Diamond achieved +4 points (90% to 94%), while Humanity’s Last Exam and SciCode each gained a more modest 2-3 points (45% to 47% and 56% to 59%, respectively). Muse Spark 1.3 (max) achieved roughly similar scores to the xhigh variant, gaining 2 points in Humanity’s Last Exam, tying on GPQA Diamond, and losing a point on CritPt vs. Muse Spark 1.3 (xhigh)
➤ Minor regressions in only two evaluations. Both Muse Spark 1.3 (xhigh) and Muse Spark 1.3 (max) dropped 4 points in AA-LCR (83% to 79%) when compared to Muse Spark 1.2, and AA-Omniscience (Accuracy) fell 3 points for xhigh and 1 point for max. The drops in AA-Omniscience (Accuracy) are due to a higher abstention rate (not answering questions when unsure), which also lowered the hallucination rate for Muse Spark 1.3 (xhigh)
Other model details (xhigh variant):
➤ Context window: 1M tokens, unchanged from Muse Spark 1.2
➤ Pricing: unchanged from Muse Spark 1.2: $1.25/$4.25 per 1M input/output tokens, with cache hits discounted to $0.15 per 1M
➤ Input modalities: text, image, video
➤ Availability: Meta's first-party API and Muse Code -
AI at Meta
@AIatMeta
We’re excited to release Muse Spark 1.3 with improved performance on agentic and coding tasks, and a focus on real-world usability.
Key capabilities:
→ Sustains longer-horizon work across multiple workflows in a single thread
→ More actively collaborates with users: it asks clarifying questions, flags when it's stuck, confirms before consequential actions
→ Better calibrated on its own limits instead of hallucinating outcomes
→ ~20% fewer tool calls and ~25% fewer tokens vs. Muse Spark 1.2 in internal comparisons
AI at Meta
@AIatMeta
Muse Spark 1.3 is rolling out today in Muse Code and Meta Model API at dev.meta.ai, with max reasoning coming soon after we finish safety testing.
Learn more: go.meta.me/46IsHsV
AI at Meta
@AIatMeta
Stay tuned for more updates soon, including bigger models, Muse Spark open weights, and more. 🚀
-
AI at Meta reposted
Alexandr Wang
@alexandr_wang
1/ today we're rolling out muse voice transcribe, our first real-time audio perception model - SOTA in streaming speech-to-text. also handles speaker diarization and endpointing natively in a single model.
-
AI at Meta
@AIatMeta
Introducing Muse Voice Transcribe, the first real-time audio perception model from Meta Superintelligence Labs.
Muse Voice Transcribe delivers real-time streaming ASR, diarization with 20+ speakers, and endpointing. It’s multilingual with seamless code-switching and improves accuracy with language, keyword, and context biasing.
The model ranks first on @ArtificialAnlys streaming speech-to-text and on public diarization benchmarks.Post not available here, view on X
AI at Meta
@AIatMeta
With adaptive delay, Muse Voice Transcribe achieves the pareto frontier on speed-accuracy trade-off measured by time to final transcription.
AI at Meta
@AIatMeta
Muse Voice Transcribe is available today via Meta Model API, Meta AI for Mac, and Muse Code.
Learn more: go.meta.me/4xISnl2 -
AI at Meta reposted
Alexandr Wang
@alexandr_wang
1/ muse image is live on the meta model api
$0.01/image - one of the best price-to-quality ratios for production volumes -
AI at Meta reposted
Meta for Developers
@MetaforDevs
Muse Image is now available on Meta Model API and priced for production volumes at $0.01/image.
It’s an agentic image model that reasons before it renders. Each call searches the web to refine the output through iterative passes and evaluates the prompt for precise elements like charts and QR codes.
Text-to-image, single-image and multi-image editing, and multi-reference composition all live in one model, so there's no multi-step pipeline to stitch together.
Start building → dev.meta.ai/models/muse-image -
AI at Meta
@AIatMeta
Today we’re also previewing WildArtifactBench, an internal evaluation framework designed to assess agents on complex, real-world tasks across diverse deliverable formats.
By using win rates and Elo scores from human and agentic preference judges rather than strict ground-truth rubrics, it expands task coverage across practical multimodal workflows.
We’re releasing 10 tasks from WildArtifactBench as a step forward in our ability to measure the real practical utility delivered by multimodal agents: research.meta.ai/wild-artifact-benchPost not available here, view on X
AI at Meta
@AIatMeta
Here are the generated artifacts of Muse Spark 1.1 and 1.2 on the Cat Mesh: research.meta.ai/wild-artifact-bench/cat-mesh
AI at Meta
@AIatMeta
Here are the generated artifacts of Muse Spark 1.1 and 1.2 on the Plywood Whale: research.meta.ai/wild-artifact-bench/plywood-whale
-
AI at Meta
@AIatMeta
Muse Spark 1.2 supports a broad range of multimodal tasks, from turning visuals into working code to translating perception into physical action. It also brings robust audio-visual understanding to enable video-heavy workflows common in real-world enterprise use.
Today, we’re sharing new evals and demos that illustrate the breadth of the model’s visual understanding and reasoning capabilities.
Let’s start with a demo that shows how Muse Spark parses multimodal observations and calls tools to guide a robot to navigate in an unstructured environment to find a rubber duck.
🧵👇This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
Now let’s take a look at how Muse Spark 1.2 performs across visual reasoning, chart understanding, and knowledge-intensive tasks.
Post not available here, view on X
AI at Meta
@AIatMeta
Muse Spark brings spatial intelligence to robotics. A specialized variant of Muse Spark acts as the robot brain and orchestrator: it takes a user instruction, decodes tool calls, observes the results, and loops until the task is complete.
As shown in this demo, Muse Spark 1.2 can plan sub-tasks for a bimanual robot tidying a desk, distinguishing a hair brush from a makeup brush and placing the lipstick in a drawer.
AI at Meta
@AIatMeta
Internally, Muse Spark is deployed in several areas including media generation. For example, the model works with Muse Image for agentic media generation and produces detailed captions as training data for Muse Image and Muse Video. Muse Spark is also able to translate raw text, image, and video content into signals and insights that can be used in downstream applications.
See more Muse Spark 1.2 evals and demos here: go.meta.me/multimodalThis media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Meta for Developers
@MetaforDevs
Meet Muse Glimmer: an open-weight model built for always-on local agents.
30B parameters, Apache 2.0 and tuned for complex multi-step work so it plans, calls tools, hits errors, retries, and sees the task through long-horizon loops.
Muse Glimmer is designed to balance capability against the memory and compute constraints of local hardware.
We couldn’t be more excited to get this in the hands of developers.
Download and start building now: dev.meta.ai/models/muse-glimmer -
AI at Meta reposted
Jack Rae
@jack_w_rae
Fun demo with Muse Glimmer: ask the model to deploy itself to the HuggingFace inference endpoint and optimize the inference efficiency
Ben Burtenshaw
@ben_burtenshaw
Meta is back with Muse Glimmer: a 30B open-source multimodal model built for local, agentic use.
HF is shipping day-0 support and I built a few demos to see what it can do.
First: we gave Glimmer tools and asked it to quantize itself. -
AI at Meta
@AIatMeta
Introducing Muse Glimmer, an open-weight 30B-parameter model optimized for local, always-on agent workflows.
Muse Glimmer delivers strong performance on key agentic use cases and benchmarks compared with leading models in its size category, and is designed to run entirely on consumer hardware like a Mac or PCs with performant GPUs.
In keeping with our long tradition of sharing fundamental AI research, we’re releasing model weights under a permissive Apache 2.0 license.
🧵👇Post not available here, view on X
AI at Meta
@AIatMeta
Muse Glimmer can complete multi-step agentic tasks end-to-end from a single natural language prompt.
In this demo, it autonomously discovers a local Home Assistant instance via network tool calls, queries device APIs, writes a responsive HTML/CSS/JS dashboard from scratch, and deploys a local server for verification.This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
🔗 Download Muse Glimmer on @huggingface: huggingface.co/meta-models
🔗 Read the technical blog: go.meta.me/museglimmer
🔗 Find resources: developer.meta.com/ai/models/muse-glimmer/ -
AI at Meta reposted
Alexandr Wang
@alexandr_wang
1/ big announcement today: we will be releasing an open weight version of muse spark 1.2 soon.
we also are releasing muse glimmer, a 30B agentic model with open weights under apache 2.0. muse glimmer can run on 24GB of VRAM without losing agentic reliability. 🧵 -
AI at Meta reposted
Mark Zuckerberg
@finkd
I believe everyone should have access to superintelligence, and I wrote a long piece about Meta's philosophy and values for building a positive future for everyone. meta.com/thefutureisforeveryone
-
AI at Meta reposted
Wayne Chi
@iamwaynechi
Muse Spark 1.2 is a frontier model for game development. It matches GPT-5.6-Sol, tying for third place.
Earlier this year, Meta didn’t even have a model capable of making this leaderboard. A huge leap for the team—congrats on an amazing model! -
AI at Meta reposted
Shuchao Bi
@shuchaobi
To understand whether we're making genuine progress on reasoning, we entered our AI models in five international STEM Olympiad competitions this year.
The results:
🏅 Asian Physics Olympiad (APhO): Perfect score on the theory exam — gold medal
🏅 International Physics Olympiad (IPhO): Perfect score on the theory exam — gold medal
🥇 International Mathematical Olympiad (IMO): Gold medal, top 4% of human participants
🥇 International Chemistry Olympiad (IChO): Gold-medal level performance
🥇 Romanian Masters of Mathematics (RMM): Gold-medal level performance
Three of these (APhO, IPhO, IMO) were live competitions and our solutions were submitted under real competition conditions and graded by the official judges using the same marking criteria applied to student contestants.
A few things about the approach:
• Models were internally trained versions from the Muse Spark family
• Zero tool use: no search, no code interpreter, no calculator
• Multi-agent orchestration with parallel reasoning
We are excited about where this reasoning capability goes next; frontier research level across scientific domains and personal superintelligence.
Super grateful to the organizing committees of APhO, IPhO, and IMO for supporting our live participation. We have deep respect for the contestants and organizers behind these competitions. 🙏
And proud of the MSL team that pulled this together! -
AI at Meta
@AIatMeta
To understand whether we're making genuine progress on reasoning, we entered our AI models in five STEM Olympiad competitions.
The results:
🏅 Asian Physics Olympiad (APhO): Perfect score, theory exam
🏅 International Physics Olympiad (IPhO): Perfect score, theory exam
🥇 International Mathematical Olympiad (IMO): Gold medal
🥇 International Chemistry Olympiad (IChO): Gold-medal-level performance
🥇 Romanian Masters of Mathematics (RMM): Gold-medal-level performance
The types of problems in the Olympiad competitions are exceptionally hard, demanding deep chains of reasoning, creative insight, and flawless argumentation. To test pure reasoning capability, we disallowed all tool use, meaning no search, no coding, and no calculator.
We have deep admiration for the contestants and committees behind these competitions, and are grateful for their support in enabling our participation. -
AI at Meta reposted
Vals AI
@ValsAI
Muse Spark 1.2 just cracked the top 5 on the Vals Index, at just $0.69 per test. This is 3x cheaper than Kimi and 10x or more cheaper than Fable, Opus, and 5.6 Sol.
-
AI at Meta reposted
Zi Lin
@suzzzylin
🎮 This entire Avo Lawn game was built with Muse Spark 1.2 + Muse Code. 🥑
Now it’s your turn—use Muse Spark 1.2 to build your own game and see what you can create.
To play: research.meta.ai/artifacts/introducing-muse-code-and-muse…
Check out our blog post: research.meta.ai/blog/introducing-muse-code-and-muse-spar… -
AI at Meta reposted
Artificial Analysis
@ArtificialAnlys
Meta has released Muse Spark 1.2. It's their third release in four months and scores 54 on the Artificial Analysis Intelligence Index, significantly improving agentic knowledge work capabilities over prior releases and putting Meta next to SpaceXAI in a tie for third place amongst US labs
Muse Spark 1.2 (xhigh) lands at 54, up 3 points from Muse Spark 1.1 (51) and 11 points from Muse Spark 1.0 (43, April). It enters effectively tied with GPT-5.5 (xhigh, 55) and Grok 4.5 (high, 54), narrowly behind current frontier models Claude Opus 5 (max, 61), Claude Fable 5 (max w/ fallback, 60), GPT-5.6 Sol (max, 59), and Kimi K3 (max, 57)
Congratulations to @AIatMeta, @finkd, and @alexandr_wang on the release!
Key Takeaways:
➤ Muse Spark 1.2 gets closer to the frontier on agentic knowledge work. At Muse Spark 1.1's launch, we noted agentic knowledge work as its clearest gap; Muse Spark 1.2's gains help to close this. Its GDPval-AA v2 Elo rose 260 points to 1631, #5 among all models we have benchmarked and ahead of Claude Opus 4.8 (max, 1588). Terminal-Bench 2.1 gained 2 points (78% to 80%), and Tau3-Bench Banking rose 2 points (25% to 27%)
➤ Among the most cost-efficient models at its intelligence level. Muse Spark 1.2 costs $0.40 per Intelligence Index task at Meta's unchanged $1.25/$4.25 per 1M token pricing, with only Grok 4.5 (high, $0.37) and GPT-5.6 Sol (medium, $0.39) cheaper in its intelligence cluster - GPT-5.6 Terra (max, $0.51), Kimi K3 (max, $0.86), and GPT-5.5 (xhigh, $1.18) all cost more per task. The cost increase over Muse Spark 1.1 ($0.29 per task) is driven by increased token usage per Intelligence Index task
➤ AA-Omniscience abstention rate increases. The score rose from 18 to 22 as the hallucination rate fell 10 points (38% to 28%) and the attempt rate dropped from 82% to 67%. This heavy abstention (not answering questions when unsure) now drives both the low hallucination rate and a lower accuracy (41% to 38%)
➤ Scientific Reasoning results remain largely unchanged. CritPt notably gained 3 points (15% to 18%), while SciCode fell 2 points (58% to 56%), and Humanity's Last Exam fell 1 point (45% to 44%)
Other model details:
➤ Context window: 1M tokens, unchanged from Muse Spark 1.1
➤ Pricing: unchanged from Muse Spark 1.1: $1.25/$4.25 per 1M input/output tokens, with cache hits discounted to $0.15 per 1M
➤ Availability: Meta's first-party API at launch -
AI at Meta reposted
alignedai
@alignedai
@AIatMeta needs to share this:
muse-spark-1.2 pricing vs muse-spark-1.2-contributor it is much much much cheaper almost free if you are okay with training: great for open source contributors
Input: 12.5×
Cached input: 75×
Output: 21.25×
Put another way:
Input: 92% cheaper
Cached input: 98.67% cheaper
Output: 95.29% cheaper -
AI at Meta reposted
Mark Zuckerberg
@finkd
Releasing Muse Code in beta today. It's a terminal coding agent that takes on complete software engineering tasks across large repos: planning changes, writing code, validating the results. Powered by Muse Spark 1.2, a coding-focused model update.
-
AI at Meta reposted
Alexandr Wang
@alexandr_wang
muse code in beta is live. first coding agent from msl, built on muse spark 1.2.
install: curl -fsS dev.meta.ai/install.sh | bash
here's what you should know: -
AI at Meta
@AIatMeta
Introducing Muse Code (beta), a terminal coding agent built for long-horizon software engineering, powered by our new Muse Spark 1.2 model.
Muse Code plans, implements, and validates complex, multi-file changes across large repositories with persistent sub-agents that solve difficult problems faster, more accurately, and with less intervention.
🧵👇Post not available here, view on X
AI at Meta
@AIatMeta
Muse Spark 1.2 has improved coding capabilities compared to its predecessor. We significantly scaled up training compute on coding tasks while expanding training environment diversity, delivering improvements in code generation, complex debugging, and end-to-end developer workflows.
The model was co-trained with Muse Code to optimize performance when paired together, and focused on tasks like whole-repo generation, large projects, and auto-research.
AI at Meta
@AIatMeta
In long-horizon stress testing, Muse Code iteratively optimized GPU kernels over 1,000+ tool calls (up to 24 hours) on @nvidia Hopper GPUs, delivering very competitive performance gains for KDA and MLA relative to baseline Triton implementations.
AI at Meta
@AIatMeta
Here’s an example of Muse Code’s multimodal visual coding capabilities. In this demo, the user inputs a fly-through video of a home into the terminal as an mp4 file. Muse Code interprets the video and produces a visually rich website with booking capabilities.
This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
Muse Spark 1.2 is available today in Muse Code and in Meta Model API, with expanded global access and many new features on the horizon.
➡️ Learn more: go.meta.me/musecode -
AI at Meta
@AIatMeta
To accelerate scientific discovery and support @ENERGY’s Genesis Mission, the @BerkeleyLab-led SYNAPS-I project is using SAM 3 and DINOv3 to automate image segmentation.
By pairing DINOv3’s global semantic context and fine-grained spatial localization with SAM 3’s pixel-level boundary extraction, the researchers are able to compress 3D volume labeling from a month of manual effort to ~15 minutes.
Learn more about their work: go.meta.me/01aed3 -
AI at Meta reposted
Alexandr Wang
@alexandr_wang
Muse Spark 1.1 is now available on OpenRouter!
This was highly requested by developers! Give it a whirl and let us know!
Meta for Developers
@MetaforDevs
Developer choice is core to what we're building.
We’re excited to share that Muse Spark 1.1 is now available on @OpenRouter for US-based developers.
Get started today 👉 openrouter.ai/meta/muse-spark-1.1 -
AI at Meta
@AIatMeta
We heard you and are happy to announce that Muse Spark 1.1 is now available on @OpenRouter for US-based developers.
We look forward to seeing what the community builds.
Lorenzo Nuvoletta
@nuvolore
@OpenRouter when Muse Spark 1.1?
AI at Meta
@AIatMeta
Get started: go.meta.me/e3b99d
-
AI at Meta
@AIatMeta
To demonstrate Meta AI's advanced reasoning and multimodal capabilities, we submitted a model to participate in the Asian Physics Olympiad’s theoretical exam. We’re happy to share that our model achieved a perfect score of 30/30, tying with the top 3 student contestants.
We appreciate the APhO committee for letting our model participate in the competition: apho2026.kr/en/index.html -
AI at Meta
@AIatMeta
We gave a few leaders early access to Muse Spark 1.1, here's what they had to say:
-
AI at Meta reposted
rahul
@0interestrates
muse spark 1.1 just built minecraft for me inside julius
link below if you want to tryThis media couldn't be displayed. See it on the original post.
Alexandr Wang
@alexandr_wang
Muse Spark 1.1 outperforms Opus 4.8 and Grok 4.5 on some nice out of distribution evals :)
khaled
@eltokh7
Muse Spark 1.1 seems like a very good model. I tested it on Stata Benchmark and it ranks 4th (!) beating Opus 4.7/4.8, tied with GPT 5.5.
I like this benchmark because it often catches seemingly good model performing poorly on OOD tasks
Alexandr Wang
@alexandr_wang
1/ muse spark 1.1 is an industry-competitive agentic and coding model. across many agentic evals it rivals gpt-5.5 and opus-4.8.
available now through the new meta model api and in meta ai. 🧵 -
AI at Meta reposted
Meta for Developers
@MetaforDevs
AI developers - we’ve published a technical guide covering how to get started with Muse Spark on Meta Model API. Muse Spark is a multimodal reasoning model built for agentic tasks, coding, computer use and long-context workflows.
See what you can build 👉 dev.meta.ai/resources/blog/build-with-muse-spark -
AI at Meta reposted
Rayan Krishnan
@RayanKrishnan
Meta made a “minor” release to Muse Spark, there’s nothing minor about it. Lots to parse here:
- This model is so fucking cheap I almost don’t believe it. In practice we see it’s 1/10 the cost of both Fable and GPT 5.5. If you thought OS models would compete away margins, just wait till you see this. It’s somehow cheaper to use MS 1.1 than host your own OS model…
- Coding improvements are significant. This was a real shortcoming in 1.0. But 1.1 sees a ~50% improvement in VibeCodeBench and ~10% improvement in SWE Bench. Not quite SOTA, but at this cost/latency it is still incredibly compelling.
- Speaking of latency, wow this model is fast. Across our benchmarks, we find it to be 1/4 the latency of Opus 4.8 and 1/2 the latency of GPT 5.5. I would expect Meta to have incredible web infra, but really don’t know what witchcraft they’re pulling to host the model for such fast inference at high rate limits.
- There is a public API. This is the first time Meta has released a model through a hosted API. I’m expecting lots of AI natives to hot-swap and rapidly test this model as a replacement. We’ll soon see if it's performant enough for those production uses.
- Speaking of AI natives, it’s been a wild week for Harvey’s legal benchmark. Grok 4.5 held the SOTA position for ~24 hours at 12% before MS 1.1 unseated it with a big jump up to ~20%. I suspect many internal evals will see surprising results like this. Glad to collab with @harvey @gabepereyra @nikogrupen @ItsJulioPereyra on this eval.
- Intelligence is more jagged than ever, even within individual domains like legal and coding. Every application and user benefits from staying dynamic. There an edge in picking the right model/system for each task. -
AI at Meta reposted
Zhiqing Sun
@EdwardSun0909
Muse Spark 1.1 is #4 on the overall vals index eval and fastest model in top 10!
-
AI at Meta reposted
Alexandr Wang
@alexandr_wang
if you wanna try computer use for yourself on your own machine, use this code!
github.com/meta-models/meta-model-cookbook/tree/main/03_u…
Alexandr Wang
@alexandr_wang
3/ computer use: it can operate desktop, browser, and mobile. muse spark 1.1 is trained to know when to automate and when to use interfaces directly. it scripts when that’s faster, clicks when direct interaction is simpler, and batches actions at each step.
This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Shengjia Zhao
@shengjia_zhao
Today we are launching Muse Spark 1.1, an upgrade to muse spark 1 that greatly improves agentic, coding, multimodal, and computer use capabilities. We're also launching the Meta Model API in public preview.
ai.meta.com/blog/introducing-muse-spark-meta-model-api/ -
AI at Meta reposted
Alexandr Wang
@alexandr_wang
1/ muse spark 1.1 is an industry-competitive agentic and coding model. across many agentic evals it rivals gpt-5.5 and opus-4.8.
available now through the new meta model api and in meta ai. 🧵 -
AI at Meta
@AIatMeta
We’re excited to introduce Muse Spark 1.1, a significant upgrade from the first Muse Spark model we released earlier this year.
Along with this release, we are launching a public preview of the new Meta Model API where developers can access Muse Spark 1.1.
The model is also available now in "Thinking" mode in the Meta AI app and on meta.ai.
Learn more: go.meta.me/ff8e2c
AI at Meta
@AIatMeta
Muse Spark 1.1 is a multimodal reasoning model built for agentic tasks, with major gains in tool and computer use, coding, and multimodal understanding.
Post not available here, view on X
AI at Meta
@AIatMeta
Muse Spark 1.1 excels at multi-app computer-use workflows by maintaining context across extended sessions and intelligently choosing between scripting, direct UI interaction, and batched actions at each step. It’s able to navigate unfamiliar interfaces with minimal human intervention.
The dinner party demo below illustrates this: when friends update their availability mid-booking, Muse Spark 1.1 notices these changes when placing the dinner order and makes necessary updates without user intervention.This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
Muse Spark 1.1 delivers substantial performance leaps over our first model on complex feature implementation, end-to-end development tasks, and codebase search and understanding.
AI at Meta
@AIatMeta
Muse Spark 1.1 is used across Meta in coding and research workflows, scoring competitively with leading models on Meta's internal coding benchmark.
Our researchers are now automating model development and evaluation tasks by leveraging Muse Spark 1.1 in their workflows.
AI at Meta
@AIatMeta
Muse Spark 1.1 also excels in perception and multimodal reasoning, inspecting visual and audio inputs, preserving details across long workflows, and acting on them in real execution environments. It shows particular strengths in visual-to-code generation, rich image/video captioning, and agentic computer use.
In this demo, using video shot from a smartphone, Muse Spark 1.1 extracts useful photos and reasons about the product to operate a user's browser and make a Facebook Marketplace listing on the user's behalf.This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Alongside the release of Muse Image, we’re sharing an early preview of Muse Video. It offers competitive performance in prompt adherence, visual fidelity, and temporal consistency.
We’re investing in areas with current performance gaps, such as audio-video synchronization and physically accurate fast motion.
AI at Meta
@AIatMeta
Introducing Muse Image and Muse Video, the first media generation models developed by Meta Superintelligence Labs.
Muse Image is our most advanced image generation model yet. It follows instructions faithfully, edits with precision, composes from multiple references, and draws on Instagram for social context. It also brings agentic tool use capabilities to image generation and integrates with Muse Spark.
You can try Muse Image in the Meta AI app and web, as well as in Instagram Stories and WhatsApp – starting in limited countries with more locations on the way.
Today we’re also previewing Muse Video, which is built upon the same pretraining base as Muse Image to deliver exceptional visual fidelity with native audio support.
Learn more about both models: go.meta.me/7f4427This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Muse Image works as an agent rather than a direct prompt-to-image model: it invokes tools, self-refines, improves with scaled test-time compute, and pairs with Muse Spark for collaborative media generation.
🧵👇
AI at Meta
@AIatMeta
Introducing Muse Image and Muse Video, the first media generation models developed by Meta Superintelligence Labs.
Muse Image is our most advanced image generation model yet. It follows instructions faithfully, edits with precision, composes from multiple references, and draws on Instagram for social context. It also brings agentic tool use capabilities to image generation and integrates with Muse Spark.
You can try Muse Image in the Meta AI app and web, as well as in Instagram Stories and WhatsApp – starting in limited countries with more locations on the way.
Today we’re also previewing Muse Video, which is built upon the same pretraining base as Muse Image to deliver exceptional visual fidelity with native audio support.
Learn more about both models: go.meta.me/7f4427This media couldn't be displayed. See it on the original post.Post not available here, view on X
AI at Meta
@AIatMeta
Muse Image demonstrates emergent self-refinement within its chain of thought, adaptively executing local edits, complete re-generation, or tool use. Rather than being explicitly programmed, this behavior emerged during RL training as a strategy to optimize image quality and maximize reward.
AI at Meta
@AIatMeta
Content Seal is built into the Meta AI app and meta.ai — every generated image carries a hidden provenance signal that stays intact through cropping, compression, and resizing.
We are previewing a public identification tool to verify the presence of this watermark on images created by the Meta AI app or meta.ai: meta.ai/identification -
AI at Meta reposted
Arena.ai
@arena
Exciting news: Meta’s Muse Image just claimed #2 in the Image Arena!
Muse Image from @AIatMeta now ranks second only to OpenAI's GPT Image 2, outperforming Nano Banana, Grok Imagine, MAI Image, and many other leading image models.
It holds #2 across the board: Text-to-Image, Single-Image Edit, and Multi-Image Edit. Congrats to the Meta team on this incredible milestone!
AI at Meta
@AIatMeta
Introducing Muse Image and Muse Video, the first media generation models developed by Meta Superintelligence Labs.
Muse Image is our most advanced image generation model yet. It follows instructions faithfully, edits with precision, composes from multiple references, and draws on Instagram for social context. It also brings agentic tool use capabilities to image generation and integrates with Muse Spark.
You can try Muse Image in the Meta AI app and web, as well as in Instagram Stories and WhatsApp – starting in limited countries with more locations on the way.
Today we’re also previewing Muse Video, which is built upon the same pretraining base as Muse Image to deliver exceptional visual fidelity with native audio support.
Learn more about both models: go.meta.me/7f4427This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Alexandr Wang
@alexandr_wang
1/ releasing muse image today — the first image generation model from MSL. it's agentic: pairs with muse spark to reason through your prompt, search the web, and plan before it generates. people get what they meant on the first try. live now in the Meta AI app.
-
AI at Meta
@AIatMeta
Introducing Muse Image and Muse Video, the first media generation models developed by Meta Superintelligence Labs.
Muse Image is our most advanced image generation model yet. It follows instructions faithfully, edits with precision, composes from multiple references, and draws on Instagram for social context. It also brings agentic tool use capabilities to image generation and integrates with Muse Spark.
You can try Muse Image in the Meta AI app and web, as well as in Instagram Stories and WhatsApp – starting in limited countries with more locations on the way.
Today we’re also previewing Muse Video, which is built upon the same pretraining base as Muse Image to deliver exceptional visual fidelity with native audio support.
Learn more about both models: go.meta.me/7f4427This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Jean-Rémi King
@JeanRemiKing
We’re happy to announce 2 releases today:
- 🧠Brain2qwerty v1 is published at @NatureNeuro
- 🚀 Brain2Qwerty v2 is now publicly released
Explore how we decode sentences from non-invasive brain recordings: facebookresearch.github.io/brain2qwerty/
Links:
📄v1 Nature Neuro: www.nature.com/articles/s41593-026-02303-2
📑v2 Meta preprint: facebookresearch.github.io/brain2qwerty/assets/brain2qwer…
💻Code: github.com/facebookresearch/brain2qwerty
📊Data: huggingface.co/datasets/bcbl190626/SpanishBCBL
📝Blog: ai.meta.com/blog/brain2qwerty-brain-ai-human-communication/
🧵Thread:
Jarod Levy
@JarodLevy
🧠⌨️ Decode language from brain activity without surgery. 🧠⌨️
Brain2Qwerty V1 is officially published in Nature Neuroscience. Today, we're releasing Brain2Qwerty V2.
We achieve unprecedented performance for a non-invasive MEG setup.
Details below 🧵👇 -
AI at Meta
@AIatMeta
We’re sharing the next major milestone in our non-invasive brain-to-text decoder research: Brain2Qwerty v2.
Building on v1, which was published today in @Nature, Brain2Qwerty v2 is the highest-performing end-to-end pipeline capable of real-time sentence decoding from raw brain signals. It advances beyond character-level performance to decoding words and semantics, enabling accuracy for overall communication.
We believe this research has the potential to make a real difference for the millions of people who suffer from brain lesions or disorders that prevent them from communicating.
🧵👇
AI at Meta
@AIatMeta
We trained Brain2Qwerty v2 on ~22,000 sentences from 9 volunteers, each recorded for 10 hours wearing an MEG device while typing.
By using end-to-end deep learning on raw brain signals from MEG devices and fine-tuning LLMs, the system effectively bridges the gap between noisy neural data and coherent language.
The results are promising:
- Avg word accuracy of 61% across participants
- 78% word accuracy and 50%+ of sentences decoded with ≤ 1 word error for the top-performing participant
- Performance scales log-linearly with data volume
AI at Meta
@AIatMeta
To help accelerate neuroscience breakthroughs, we're releasing the full training code for Brain2Qwerty v1 and v2, and our partner, @bcbl_, is releasing the v1 dataset.
Learn more and explore the artifacts here: go.meta.me/42ed9c
AI at Meta
@AIatMeta
For clarification, Brain2Qwerty v1 was published earlier today in @NatureNeuro.
-
AI at Meta
@AIatMeta
Big congrats to our SAM 3D team for receiving a Best Paper Honorable Mention at #cvpr26! This prestigious recognition underscores their incredible work pushing the boundaries of computer vision.
Read the paper here: arxiv.org/abs/2511.16624 -
AI at Meta
@AIatMeta
Today we’re announcing an agreement with Amazon Web Services to bring tens of millions of AWS Graviton cores to our compute portfolio.
This partnership marks an expansion of our diversified AI infrastructure and will help scale systems behind Meta AI and agentic experiences that serve billions of people.
Learn more: go.meta.me/2bc5c5 -
AI at Meta reposted
Summer Yue
@summeryue0
🚀 Muse Spark Safety & Preparedness Report for Meta AI is out.
We start with our pre-deployment assessment under Meta's Advanced AI Scaling Framework, covering chemical and biological, cybersecurity, and loss of control risks. Our assessment flagged potentially elevated chem/bio risk, so we implemented safeguards and validated mitigations before deployment - bringing residual risk to within acceptable levels.
Beyond the Framework, we also share findings and early explorations of model behavior (honesty, intent understanding, etc.), jailbreak robustness, eval awareness, and more.
We're sharing this report to give a closer look at how we evaluate advanced AI safety. Always more work to do, and we welcome feedback from the community.
ai.meta.com/static-resource/muse-spark-safety-and-prepare… -
AI at Meta
@AIatMeta
🔜
Alexandr Wang
@alexandr_wang
the muse spark API will be coming soon!
we have been thrilled with the amount of excitement amongst developers who want to try muse spark inside their agentic harnesses
stay tuned! -
AI at Meta
@AIatMeta
Check out some cool ways the community has been putting Muse Spark to work (and play) 🧵👇
1/
Pietro Schirano
@skirano
Ok this is actually pretty impressive and I truly didn't see any model doing this before or being able to do it to this extent.
When I asked Muse Spark from Meta to convert this image into code, it cut out the assets from the screens so it could use them correctly!Post not available here, view on X
AI at Meta
@AIatMeta
5/
Nainish Rai
@Nain1sh
That clip is the part most people will underestimate.
Image-to-code was already impressive
What Meta’s Muse Spark seems to be doing is one level higher:
it’s not just recreating pixels, it’s inferring product logic.
I gave it a calendar screenshot and I am blown
Pietro Schirano
@skirano
Ok this is actually pretty impressive and I truly didn't see any model doing this before or being able to do it to this extent.
When I asked Muse Spark from Meta to convert this image into code, it cut out the assets from the screens so it could use them correctly! -
AI at Meta reposted
Artificial Analysis
@ArtificialAnlys
Meta is back! Muse Spark scores 52 on the Artificial Analysis Intelligence Index, behind only Gemini 3.1 Pro, GPT-5.4, and Claude Opus 4.6. Muse Spark is the first new release since Llama 4 in April 2025 and also Meta's first release that is not open weights
Muse Spark is a new model from @Meta evaluated on Artificial Analysis. We were given early access by Meta to independently benchmark the model. It is the first frontier-class model from Meta since Llama 4 Maverick was released in April 2025, and notably the first @AIatMeta model that is not being released as open weights. The release follows Meta's reorganization of its AI efforts under Meta Superintelligence Labs, and signals that Meta is re-entering the frontier race after roughly a year of relative quiet.
For context, Llama 4 Maverick and Scout scored 18 and 13 respectively on the Artificial Analysis Intelligence Index as non-reasoning models at the time of their release, while Muse Spark scores 52. Muse Spark essentially closes the gap between to the frontier in a single release.
The model is not open source and is not yet accessible via an API but Meta has shared they expect this to come soon. Meta is also integrating Muse Spark into their first party products including their Meta AI chat product, Facebook, Instagram and Threads.
Key takeaways from our benchmarks:
➤ Muse Spark scores 52 on the Artificial Analysis Intelligence Index, placing it within the top 5 models we have benchmarked. It sits ahead of Claude Sonnet 4.6, GLM-5.1, MiniMax-M2.7, Grok 4.20 and behind Gemini 3.1 Pro Preview, GPT-5.4 and Claude Opus 4.6
➤ Muse Spark is notably token efficient for its intelligence level. It used 58M output tokens to run the Intelligence Index, comparable to Gemini 3.1 Pro Preview (57M) and notably lower than Claude Opus 4.6 (Adaptive Reasoning, max effort, 157M), GPT-5.4 (xhigh, 120M) and GLM-5 (110M)
➤ Muse Spark is the second-most capable vision model we have benchmarked. It scores 80.5% on MMMU-Pro, behind only Gemini 3.1 Pro Preview (82.4%)
➤ Muse Spark performs strongly on reasoning and instruction-following evaluations. It scores 39.9% on HLE, trailing only Gemini 3.1 Pro Preview (44.7%) and GPT-5.4 (xhigh, 41.6%). The model also achieved 5th highest in CritPT with a score of 11%, an eval that is focused on difficult physics research questions. This is substantially above above Gemini 3 Flash (9%) and Claude 4.6 Sonnet (3%)
➤ Agentic performance does not stand out. On GDPval-AA, our evalaution focused on real world work tasks, Muse Spark scores 1427, behind both Claude Sonnet 4.6 at 1648 and GPT-5.4 at 1676, but ahead of Gemini 3.1 Pro Preview at 1320. On On TerminalBench Hard, Muse Spark trails Claude Sonnet 4.6, GPT-5.4, and Gemini 3.1 Pro. Muse Spark joins others in achieving a high τ²-Bench Telecom score of 92%
Key model details:
➤ Modalities: Multimodal including text and vision input, text output
➤ License: Proprietary, Meta's first frontier model not released as open weights
➤ Availability: No public API at the time of publishing. Meta expects to provide API access soon. Meta has started integration into their first party AI offering Meta AI and inside Facebook, Instagram, and Threads -
AI at Meta
@AIatMeta
To build personal superintelligence, our model’s capabilities should scale predictably and efficiently. Below, we share how we study and track Muse Spark’s scaling properties along three axes: pretraining, reinforcement learning, and test-time reasoning. 🧵👇
Let’s start with pretraining. Over the last 9 months, we rebuilt our pretraining stack with improvements to model architecture, optimization, and data curation, enabling us to increase the capability we can extract from every unit of compute. To rigorously evaluate our new recipe, we fit a scaling law to a series of small models and compare the training FLOPs required to hit a specific level of performance.
The results: we can reach the same capabilities with over an order of magnitude less compute than our previous model, Llama 4 Maverick, making Muse Spark significantly more efficient than the leading base models available for comparison.Post not available here, view on X
AI at Meta
@AIatMeta
To spend more test-time reasoning without drastically increasing latency, we can scale the number of parallel agents that collaborate to solve hard problems. While standard test-time scaling has a single agent think for longer, scaling Muse Spark with multi-agent thinking enables superior performance with comparable latency.
AI at Meta
@AIatMeta
With Muse Spark, we are on a predictable and efficient scaling trajectory. We look forward to sharing increasingly capable models on the path to personal superintelligence soon.
-
AI at Meta reposted
Shengjia Zhao
@shengjia_zhao
Excited to share what we’ve been building at Meta Superintelligence Labs! We just released Muse Spark, our first AI model. It's a natively multimodal reasoning model and the first step on our path to personal superintelligence. We've overhauled our entire stack to support scaling, and this is just the beginning.
ai.meta.com/blog/introducing-model-meta-superintelligence… -
AI at Meta
@AIatMeta
Introducing Muse Spark, the first in the Muse family of models developed by Meta Superintelligence Labs.
Muse Spark is a natively multimodal reasoning model with support for tool-use, visual chain of thought, and multi-agent orchestration.
Muse Spark is available today at meta.ai and the Meta AI app. We’re also making it available in private preview via API to select partners, and we hope to open-source future versions of the model.
Learn more: go.meta.me/43ea00Post not available here, view on X
AI at Meta
@AIatMeta
We're also releasing Contemplating mode, which orchestrates multiple agents that reason in parallel. This allows Muse Spark to compete with the extreme reasoning modes of frontier models such as Gemini Deep Think and GPT Pro.
Contemplating will be rolling out gradually in meta.ai.
AI at Meta
@AIatMeta
Muse Spark is built from the ground up to integrate visual information across domains and tools. It achieves strong performance on visual STEM questions, entity recognition, and localization, enabling interactive experiences like troubleshooting your home appliances with dynamic annotations.
AI at Meta
@AIatMeta
Personal superintelligence will help people learn about their health. We collaborated with 1,000+ physicians to curate training data that enables more factual and comprehensive responses. It can generate interactive displays that unpack and explain health information such as the nutritional content of various foods or muscles activated during exercise.
-
AI at Meta reposted
Alexandr Wang
@alexandr_wang
1/ today we're releasing muse spark, the first model from MSL. nine months ago we rebuilt our ai stack from scratch. new infrastructure, new architecture, new data pipelines. muse spark is the result of that work, and now it powers meta ai. 🧵
-
AI at Meta
@AIatMeta
We’re releasing SAM 3.1: a drop-in update to SAM 3 that introduces object multiplexing to significantly improve video processing efficiency without sacrificing accuracy.
We’re sharing this update with the community to help make high-performance applications feasible on smaller, more accessible hardware.
🔗 Model Checkpoint: go.meta.me/8dd321
🔗 Codebase: go.meta.me/b0a9fb
AI at Meta
@AIatMeta
The core innovation in SAM 3.1 is object multiplexing, allowing the model to track up to 16 objects in a single forward pass. Previously, each object required its own dedicated pass, but with multiplexing, SAM 3.1 processes all tracked objects together, eliminating redundant computation and memory bottlenecks.
This approach doubles the processing speed for videos with a medium number of objects, increasing throughput from 16 to 32 frames per second on a single H100 GPU. -
AI at Meta
@AIatMeta
Today we're introducing TRIBE v2 (Trimodal Brain Encoder), a foundation model trained to predict how the human brain responds to almost any sight or sound.
Building on our Algonauts 2025 award-winning architecture, TRIBE v2 draws on 500+ hours of fMRI recordings from 700+ people to create a digital twin of neural activity and enable zero-shot predictions for new subjects, languages, and tasks.
Try the demo and learn more here: go.meta.me/tribe2
AI at Meta
@AIatMeta
Without any retraining, TRIBE v2 can reliably predict the brain responses of individuals it has never seen before, achieving a nearly 2-3x improvement over previous methods for both movies and audiobooks
We’re releasing the model, codebase, paper, and demo to help researchers advance neuroscience, apply brain insights to build better AI, and use computational simulation to speed up breakthroughs in neurological disease diagnosis and treatment.
🔗 Paper: go.meta.me/210503
🔗 Model: go.meta.me/ea1cff
🔗 Code: go.meta.me/873d02 -
AI at Meta reposted
Engineering at Meta
@Meta_Engineers
Today we’re announcing a new partnership with @Arm to collaborate on the development of multiple generations of purpose-built CPUs to support our compute and AI infrastructure.
The first generation of the chip that we co-developed, the Arm AGI CPU, delivers more than 2x performance per rack compared with x86 platforms. The Arm AGI CPU will also be available to the broader AI ecosystem through Arm and Meta will be releasing our board and rack designs for this CPU under the Open Compute Project later this year.
Learn more about our partnership: go.meta.me/15e3b8 -
AI at Meta
@AIatMeta
We’re announcing Canopy Height Maps v2 (CHMv2), an open source model for high-resolution global forest canopy mapping, developed in partnership with the @WorldResources.
CHMv2 leverages our DINOv3 Sat-L vision model, specifically optimized for satellite imagery, to deliver substantial improvements in accuracy, detail, and global consistency.
🔗 Learn more: go.meta.me/70d2e9
AI at Meta
@AIatMeta
CHMv2 is already supporting public sector efforts in the United States, Europe, and beyond. By making these advances open source, we aim to accelerate research and inform carbon offsetting, reforestation, and land management decisions globally.
🔗 Read the paper: go.meta.me/9a9e42
🔗 Download the model: go.meta.me/2edd52 -
AI at Meta
@AIatMeta
Custom silicon is critical to scaling next-gen AI. We’re detailing the evolution of the Meta Training and Inference Accelerator (MTIA), our homegrown silicon family designed to power the next era of AI experiences.
Traditional chip cycles span years, but model architectures change in months. To close this gap, we’ve accelerated MTIA development to release four generations in just two years.
See our roadmap and tech specs here: go.meta.me/16336d -
AI at Meta
@AIatMeta
Meta 🤝 AMD
Today we’re announcing a multi-year agreement with @AMD to integrate their latest Instinct GPUs into our global infrastructure. With approximately 6GW of planned data center capacity dedicated to this deployment, we’re scaling our compute capacity to accelerate the development of cutting-edge AI models and deliver personal superintelligence to billions around the world.
Learn more: go.meta.me/220f12 -
AI at Meta
@AIatMeta
ICYMI: @alexandr_wang spoke at the India AI Impact Summit where he shared Meta’s vision for personal superintelligence and how developers in India are already using AI to solve major societal challenges.
See highlights 👇 and then watch his full speech here:This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Our Chief AI Officer @alexandr_wang will take the stage at the India AI Impact Summit.
Date: Thursday, February 19
Time: 1:53pm IST // 12:23am PST
Watch the livestream here: www.youtube.com/live/WgW7cC-kHgY -
AI at Meta
@AIatMeta
Our team is heading to India this week for the AI Impact Summit & Expo 🇮🇳
Stop by the Meta booth (Exhibition Hall 3, Booth No. 3.7) to meet our team and experience:
📚 Demos of research, including Omnilingual Automatic Speech Recognition (ASR) and SeamlessExpressive
⚡ Lightning talks from experts on how AI is unlocking real-world benefits across language, accessibility and health
👓 Hands-on demos with our latest AI glasses including the Oakley Meta Vanguard
We look forward to seeing you there! -
AI at Meta reposted
Pierre Fernandez
@pierrefdz
We're thrilled to share the open source release of Meta Seal, a comprehensive, SOTA, and MIT-licensed suite of AI watermarking research, models, & training code.
Learn more in the 🧵 below and explore the artifacts here:
facebookresearch.github.io/meta-seal -
AI at Meta
@AIatMeta
We’re open-sourcing Perception Encoder Audiovisual (PE-AV), the technical engine that helps drive SAM Audio’s state-of-the-art audio separation.
Built on our Perception Encoder model from earlier this year, PE-AV integrates audio with visual perception, achieving state-of-the-art results across a wide range of audio and video benchmarks. Its native multimodal support can assist people in everyday tasks, including sound detection and richer audio-visual scene understanding.
🔗 Read the paper: go.meta.me/e541b6
🔗 Download the code: go.meta.me/7fbef0 -
AI at Meta
@AIatMeta
We’re hosting a Reddit AMA with the researchers behind SAM 3 + SAM 3D + SAM Audio.
Join us tomorrow at 2pm PT.
www.reddit.com/r/LocalLLaMA/comments/1pp9w31/ama_with_the… -
AI at Meta
@AIatMeta
🔉 Introducing SAM Audio, the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts.
We’re sharing SAM Audio with the community, along with a perception encoder model, benchmarks and research papers, to empower others to explore new forms of expression and build applications that were previously out of reach.
🔗 Learn more: go.meta.me/568e5dThis media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
SAM Audio represents a significant advancement in audio separation technology, outperforming previous models across a wide range of benchmarks and tasks.
AI at Meta
@AIatMeta
Discover what’s possible with SAM Audio, SAM 3D, and SAM 3 in the Segment Anything Playground: www.aidemos.meta.com/segment-anything/
-
AI at Meta
@AIatMeta
We’re in San Diego this week for #neurips2025!
Stop by the Meta booth (#1223) to meet our team and check out:
🔎 Demos of our latest research including DINOv3 and UMA
⚡ Lightning talks from researchers behind SAM 3, Omnilingual ASR and more (see schedule below)
👓 Hands-on demos with our latest AI glasses including the Meta Ray-Ban Display
Our team is also sharing 19+ papers and 13+ workshops this week. We hope to see you there. -
AI at Meta
@AIatMeta
SAM 3D is helping advance the future of rehabilitation.
See how researchers at @CarnegieMellon are using SAM 3D to capture and analyze human movement in clinical settings, opening the doors to personalized, data-driven insights in the recovery process.
🔗 Learn more about SAM 3D: go.meta.me/305985This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
SAM 3’s ability to precisely detect and track objects is helping @ConservationX measure the survival of animal species around the world and prevent their extinction.
🔗 Learn more about the work: ai.meta.com/blog/segment-anything-conservation-x-wildlife…This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
We partnered with @ConservationX to build the SA-FARI dataset with 10,000+ annotated videos including over 100 species of animals.
We’re sharing this dataset to help with conservation efforts around the globe.
🔗 Find it here: www.conservationxlabs.com/sa-fari -
AI at Meta reposted
Nikhila Ravi
@nikhilaravi
As a part of the SAM 3 release, we’ve partnered with @roboflow to accelerate applying SAM 3 for real-world use cases. This includes automating visual labeling tasks, fine-tuning for novel use cases and deploying an API. Highlights of what you can do with SAM 3 on Roboflow🧵
-
AI at Meta
@AIatMeta
The Segment Anything Playground is a new way to interact with media. Experiment with Meta’s most advanced segmentation models, including SAM 3 + SAM 3D, and discover how these capabilities can transform your creative projects and technical workflows.
Check out some inspo and tips in the 🧵 below, then head over to the Playground to get started: aidemos.meta.com/segment-anything/Post not available here, view on X
AI at Meta
@AIatMeta
padphone
@lepadphone
So much fun! SAM 3D! You can extract a 3D object directly from an image!And add effects!
This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
Eike Drescher
@eikedrescher
Okay this new model is insane.
Generate an image, then give it to the model to turn it into a 3D model with matching texture in seconds.
Creativity on Spielwerk will be endless with this -
AI at Meta
@AIatMeta
We’re advancing on-device AI with ExecuTorch, now deployed across devices including Meta Quest 3, Ray-Ban Meta, Oakley Meta Vanguard and Meta Ray-Ban Display.
By eliminating conversion steps and supporting pre-deployment validation in PyTorch, ExecuTorch accelerates the path from research to production, ensuring consistent, efficient AI across a diverse hardware ecosystem.
Read the full technical deep dive: ai.meta.com/blog/executorch-reality-labs-on-device-ai/ -
AI at Meta
@AIatMeta
Collecting a high quality dataset with 4M unique phrases and 52M corresponding object masks helped SAM 3 achieve 2x the performance of baseline models. Kate, a researcher on SAM 3, explains how the data engine made this leap possible.
🔗 Read the SAM 3 research paper:This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Introducing SAM 3D, the newest addition to the SAM collection, bringing common sense 3D understanding of everyday images. SAM 3D includes two models:
🛋️ SAM 3D Objects for object and scene reconstruction
🧑🤝🧑 SAM 3D Body for human pose and shape estimation
Both models achieve state-of-the-art performance transforming static 2D images into vivid, accurate reconstructions.
🔗 Learn more: go.meta.me/305985This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
We’re sharing model checkpoints, an evaluation benchmark, human body training data, and inference code with the community to support creative applications in fields like robotics, interactive media, science, sports medicine, and beyond.
🔗 SAM 3D Body: github.com/facebookresearch/sam-3d-body
🔗 SAM 3D Objects: github.com/facebookresearch/sam-3d-objects
AI at Meta
@AIatMeta
SAM 3D enables accurate 3D reconstruction from a single image, supporting real-world applications in editing, robotics, and interactive scene generation.
Matt, a SAM 3D researcher, explains how the two-model design makes this possible for both people and complex environments.
🔗 Read the SAM 3D Objects research paper: go.meta.me/8c08ca
🔗 Read the SAM 3D Body research paper: go.meta.me/5e60edThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Meet SAM 3, a unified model that enables detection, segmentation, and tracking of objects across images and videos. SAM 3 introduces some of our most highly requested features like text and exemplar prompts to segment all objects of a target category.
Learnings from SAM 3 will help power new features in Instagram Edits and Vibes, bringing advanced segmentation capabilities directly to creators.
🔗 Learn more: go.meta.me/591040This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
We’re sharing SAM 3 under the SAM License so others can use it to build their own experiences. Alongside the model, we’re releasing a new evaluation benchmark, model checkpoint, and open-source code for inference and fine-tuning. These resources are designed to support advanced applications in media editing, scientific analysis, and beyond.
🔗 Download the models: github.com/facebookresearch/sam3
AI at Meta
@AIatMeta
We've partnered with @Roboflow to enable people to annotate data, fine-tune, and deploy SAM 3 for their particular needs. Try it here: roboflow.com
AI at Meta
@AIatMeta
SAM 3 tackles a challenging problem in vision: unifying a model architecture for detection and tracking. Christoph, a researcher on SAM 3, shares how the team made it possible.
🔗 Read the SAM 3 research paper: go.meta.me/6411f7This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Today we’re excited to unveil a new generation of Segment Anything Models:
1️⃣ SAM 3 enables detecting, segmenting and tracking of objects across images and videos, now with short text phrases and exemplar prompts.
🔗 Learn more about SAM 3: go.meta.me/591040
2️⃣ SAM 3D brings the model collection into the 3rd dimension to enable precise reconstruction of 3D objects and people from a single 2D image.
🔗 Learn more about SAM 3D: go.meta.me/305985
These models offer innovative capabilities and unique tools for developers and researchers to create, experiment and uplevel media workflows. -
AI at Meta
@AIatMeta
Introducing Meta Omnilingual Automatic Speech Recognition (ASR), a suite of models providing ASR capabilities for over 1,600 languages, including 500 low-coverage languages never before served by any ASR system.
While most ASR systems focus on a limited set of languages that are well-represented on the internet, this release marks a major step toward building a truly universal transcription system.
🔗 Learn more: go.meta.me/f56b6eThis media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
Today we’re releasing a full suite of models and a dataset:
1️⃣ Omnilingual ASR: A suite of ASR models ranging from 300M to 7B parameters, supporting 1600+ languages
2️⃣ Omnilingual w2v 2.0: a 7B-parameter multilingual speech representation model that can be leveraged for other downstream speech-related tasks
3️⃣ Omnilingual ASR Corpus: a unique dataset spanning 350 underserved languages that was curated in collaboration with our global partners
🔗 Download the models + dataset: github.com/facebookresearch/omnilingual-asr
By open sourcing these models and dataset, we aim to break down language barriers, expand digital access, and empower communities worldwide.Post not available here, view on X
AI at Meta
@AIatMeta
Omnilingual ASR was made possible by combining the capabilities of several other models developed by Meta. Matt Setzler, a researcher on the project, breaks it all down here.
This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
Head over to the Omnilingual demo to explore the languages in the dataset: aidemos.atmeta.com/omnilingualasr/language-globe
-
AI at Meta reposted
Engineering at Meta
@Meta_Engineers
Today we’re announcing our next state-of-the-art data center in El Paso, Texas, that will have the ability to scale to 1GW. This new data center will help us to deliver top-tier AI models and product experiences as we build toward superintelligence.
Learn more: -
AI at Meta
@AIatMeta
New from Meta FAIR: Code World Model (CWM), a 32B-parameter research model designed to explore how world models can transform code generation and reasoning about code.
We believe in advancing research in world modeling and are sharing CWM under a research license to help empower the community to build upon our work.
➡️ Read the technical report: ai.meta.com/research/publications/cwm/
➡️Download the open weights: huggingface.co/facebook/cwm
➡️Download the code: github.com/facebookresearch/cwm -
AI at Meta
@AIatMeta
Meta Connect 2025 is here! Watch the keynote livestream tonight @ 5 pm PT to see the future of AI wearables and beyond: www.meta.com/connect/
-
AI at Meta
@AIatMeta
Introducing DINOv3: a state-of-the-art computer vision model trained with self-supervised learning (SSL) that produces powerful, high-resolution image features. For the first time, a single frozen vision backbone outperforms specialized solutions on multiple long-standing dense prediction tasks.
Learn more about DINOv3 here: ai.meta.com/blog/dinov3-self-supervised-vision-model/This media couldn't be displayed. See it on the original post.Post not available here, view on X
AI at Meta
@AIatMeta
To help foster innovation and collaboration in the computer vision community, we’re releasing DINOv3 under a commercial license with a full suite of pre-trained backbones, adapters, training and evaluation code, and (much!) more.
Find them here: github.com/facebookresearch/dinov3
AI at Meta
@AIatMeta
We're excited to share that we have Day-0 support in Hugging Face Transformers for DINOv3 so people can easily leverage the full family of models.
Find out more on @huggingface here: huggingface.co/docs/transformers/main/en/model_doc/dinov3 -
AI at Meta
@AIatMeta
🏆 We're thrilled to announce that Meta FAIR’s Brain & AI team won 1st place at the prestigious Algonauts 2025 brain modeling competition.
Their 1B parameter model, TRIBE (Trimodal Brain Encoder), is the first deep neural network trained to predict brain responses to stimuli across multiple modalities, cortical areas, and individuals. The approach combines pretrained representations of several foundational models from Meta – text (Llama 3.2), audio (Wav2Vec2-BERT from Seamless) and video (V-JEPA 2) – to predict a very large amount (80 hours per subject) of spatio-temporal fMRI brain responses to movies acquired by the Courtois NeuroMod project
Download the code: github.com/facebookresearch/algonauts-2025
Read the paper: www.arxiv.org/abs/2507.22229
Learn about the challenge: algonautsproject.com/index.html
Download the data: www.cneuromod.ca -
AI at Meta
@AIatMeta
The Meta FAIR Chemistry team continues to make meaningful strides.
1️⃣ Today we’re announcing FastCSP, a workflow that generates stable crystal structures for organic molecules. This accelerates material discovery efforts and cuts down the time to design molecular crystals from months to days.
Read the paper: ai.meta.com/research/publications/fastcsp-accelerated-mol…
The workflow will be available soon here: github.com/facebookresearch/fairchem
AI at Meta
@AIatMeta
2️⃣ We’re also releasing the Open Molecular Crystals (OMC25) dataset, comprised of 25 million structures, that was created to enable the FastCSP workflow.
Read the paper: ai.meta.com/research/publications/open-molecular-crystals…
Find the dataset: huggingface.co/facebook/OMC25
We’re excited to share these advances, developed in partnership with @CarnegieMellon, and see how the community uses them to progress in fields like electronics and healthcare. -
AI at Meta
@AIatMeta
We’re excited to introduce the Open Direct Air Capture 2025 dataset, the largest open dataset for discovering advanced materials that capture CO2 directly from the air.
Developed by Meta FAIR, @GeorgiaTech, and @cusp_ai, this release enables rapid, accurate screening of carbon capture materials and can help accelerate climate solutions using AI.
Explore the full dataset here: huggingface.co/facebook/ODAC25 -
AI at Meta
@AIatMeta
Today Mark shared Meta’s vision for the future of personal superintelligence for everyone.
Read his full letter here: meta.com/superintelligenceThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
We're excited to have @shengjia_zhao at the helm as Chief Scientist of Meta Superintelligence Labs. Big things are coming! 🚀
See Mark's post: www.threads.com/@zuck/post/DMiwjXJSYCd -
AI at Meta
@AIatMeta
We're rapidly expanding our AI infrastructure and have adopted a novel approach of building weather-proof tents to house GPU clusters. This enables us to get new data centers online in months instead of years. 🚀
Read more in this @FastCompany article: www.fastcompany.com/91369896/meta-is-using-tents-to-build… -
AI at Meta
@AIatMeta
We’re thrilled to see our advanced ML models and EMG hardware — that transform neural signals controlling muscles at the wrist into commands that seamlessly drive computer interactions — appearing in the latest edition of @Nature.
Read the story: www.nature.com/articles/s41586-025-09255-w
Find more details on this work and the models on @github: github.com/facebookresearch/generic-neuromotor-interface -
AI at Meta reposted
The AI Alliance
@thealliance_ai
🚨 New open-source drop: The AI Alliance is now supporting Llama Stack, a modular AI application framework developed by Meta.
Built for portability, developer choice, and real-world deployment.
Details ⬇️
🔗 thealliance.ai/blog/ai-alliance-accelerating-open-source-… -
AI at Meta
@AIatMeta
Meta FAIR recently released the Seamless Interaction Dataset, the largest known high-quality video dataset of its kind, with:
4,000+ diverse participants
4,000+ hours of footage
65k+ interactions
5,000+ annotated samples
This dataset of full-body, in-person, face-to-face interaction videos represents a crucial stepping stone to understanding and modeling how people communicate and behave when they’re together—advancing AI's ability to generate more natural conversations and human-like gestures.
Download the dataset on @huggingface: huggingface.co/datasets/facebook/seamless-interaction
Learn more about the dataset: www.aidemos.meta.com/seamless_interaction_dataset -
AI at Meta
@AIatMeta
This week we shared an open source AI tool that will help accelerate the discovery of high-performance, low-carbon concrete. See the full story in the thread below.
You can also find research artifacts for this project here:
1️⃣ Technical report with details of the model and optimization algorithm: arxiv.org/abs/2310.18288
2️⃣ Open source SustainableConcrete repository with the associated data and code github.com/facebookresearch/SustainableConcrete
Engineering at Meta
@Meta_Engineers
We’re proud to share that we’ve developed an open-source AI tool to design concrete mixes that are stronger, more sustainable, and faster to deploy. The tool uses Bayesian optimization with Meta’s BoTorch and Ax frameworks, and was built in collaboration with @Amrize and @UofIllinois.
Read the full story: engineering.fb.com/2025/07/16/data-center-engineering/ai-… -
AI at Meta
@AIatMeta
"Our mission with the lab is to deliver personal superintelligence to everyone in the world. So that way, we can put that power in every individual's hand." - Mark
Watch Mark's full interview with The Information as he goes deeper on Meta's vision for superintelligence and investment in AI compute infrastructure.
The Information
@theinformation
The Information | TITV | July 15th, 2025 x.com/i/broadcasts/1YpKkBZkNyExj
-
AI at Meta
@AIatMeta
Today Mark announced Meta's major AI compute investment.
See his post: www.facebook.com/share/v/1AnKhQouDb/ -
AI at Meta
@AIatMeta
🚀New from Meta FAIR: today we’re introducing Seamless Interaction, a research project dedicated to modeling interpersonal dynamics.
The project features a family of audiovisual behavioral models, developed in collaboration with Meta’s Codec Avatars lab + Core AI lab, that render speech between two individuals into diverse, expressive full-body gestures and active listening behaviors, allowing the creation of fully embodied avatars in 2D and 3D.
These models have potential to create more natural, interactive virtual agents that can engage in human-like social interactions across a variety of settings.
Learn more: ai.meta.com/research/seamless-interaction/
AI at Meta
@AIatMeta
We’re also publicly releasing the Seamless Interaction Dataset, with 4,000+ participants and 4,000+ hours of interactions, making it the largest known video dataset of its kind.
This dataset enables our audiovisual behavioral models to understand and generate human-like social behaviors, and represents a crucial stepping stone to understanding and modeling how people communicate and behave when they’re together.
We’re sharing it here to help the research community advance their work: github.com/facebookresearch/seamless_interaction
AI at Meta
@AIatMeta
One more thing… you can also check out this technical report detailing our methodology to build motion models on the dataset, along with an evaluation framework for this type of model: ai.meta.com/research/publications/seamless-interaction-dy…
AI at Meta
@AIatMeta
Head to our blog to go deeper on the full story: ai.meta.com/blog/seamless-interaction-natural-conversatio…
-
AI at Meta reposted
Meta for Developers
@MetaforDevs
Tired of manual prompt tweaking? Watch the latest Llama tutorial on how to optimize your existing GPT or other LLM prompts for Llama with `llama-prompt-ops`, the open-source Python library!
In this video, Partner Engineer Justin Lee demonstrates installation, project setup, migrating your first prompt, and analyzing performance gains.
Watch now to discover:
✨ Why systematic prompt optimization is crucial for migrating from GPT to Llama.
💻 A live code walkthrough of `llama-prompt-ops` in action for a customer service classification task.
Watch the full tutorial here: dev.meta.ai/llama/resources/videos/optimize-llama-prompts -
AI at Meta reposted
Meta for Developers
@MetaforDevs
Take your AI development skills to the next level with our latest course on deeplearning.ai, "Building with Llama 4", taught by @AndrewYNg and Amit Sangani, Director of Partner Engineering for Meta's AI team.
In this comprehensive course, you'll learn how to harness the power of Llama 4, which enables deployment easier than before and achieves more advanced multi-modal understanding by prompting over multiple images.
You'll discover how to:
- Build applications that reason over visual content, detect objects, and answer image grounding questions with precision
- Understand the Llama 4 prompt format especially the new image related tokens
- Use long context to process entire books and research papers without needing to chunk the data
- Optimize your prompts with the Llama prompt optimization tool
- Create high-quality training data with the Llama Synthetic Data Kit
With hands-on experience using Llama 4 through Meta's official API and other inference providers, you'll be able to build more powerful applications.
Start learning now at deeplearning.ai and unlock the full potential of Llama 4! www.deeplearning.ai/courses/building-with-llama-4This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
The response to our first-ever Llama Startup Program was astounding, and after reviewing over 1,000 applications we’re thrilled to announce our first group.
This eclectic group of early-stage startups are ready to push the boundaries of what’s possible with Llama and drive innovation in the GenAI market. We’ll offer them support with access to the Llama technical team and cloud credit reimbursements to help offset the cost of building with Llama.
Learn more about the Llama Startup Program: ai.meta.com/blog/llama-startup-program-first-cohort -
AI at Meta
@AIatMeta
For #cvpr2025, dive into the latest research papers from some of the brightest minds in AI 👇
AI at Meta
@AIatMeta
Sonata: Advancing Self-Supervised Learning for 3D Point Representations
Sonata represents a significant leap forward in the field of 3D self-supervised learning. By identifying and addressing the geometric shortcut and introducing a flexible, efficient framework, it’s an exceptionally robust 3D point representation.
This work advances the state of the art and sets the stage for future innovations in 3D perception and its applications.
Learn more ➡️ www.projectaria.com/news/introducing-sonata/
AI at Meta
@AIatMeta
Reading Recognition in the Wild: A Dataset for Understanding Human Behaviors During Reading from an Egocentric Sensor Suite
This large multimodal dataset features video, eye gaze, and head pose sensor outputs, created to help solve the task of reading recognition from wearable devices. Notably, this is the first egocentric dataset to feature high-frequency eye-tracking data collected at 60 Hz.
Explore ➡️ www.projectaria.com/news/introducing-reading-recognition-… -
AI at Meta
@AIatMeta
Introducing V-JEPA 2, a new world model with state-of-the-art performance in visual understanding and prediction.
V-JEPA 2 can enable zero-shot planning in robots—allowing them to plan and execute tasks in unfamiliar environments.
Download V-JEPA 2 and read our research paper ➡️ ai.meta.com/vjepa/ -
AI at Meta
@AIatMeta
Our vision is for AI that uses world models to adapt in new and dynamic environments and efficiently learn new skills.
We’re sharing V-JEPA 2, a new world model with state-of-the-art performance in visual understanding and prediction.
V-JEPA 2 is a 1.2 billion-parameter model, trained on video, that can enable zero-shot planning in robots—allowing them to plan and execute tasks in unfamiliar environments.
Learn more about V-JEPA 2 ➡️ai.meta.com/blog/v-jepa-2-world-model-benchmarks/
As we continue working toward our goal of achieving advanced machine intelligence (AMI), we’re also releasing three new benchmarks for evaluating how well existing models can reason about the physical world from video.
Learn more and download the new benchmarks ➡️ai.meta.com/blog/v-jepa-2-world-model-benchmarks/This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Aria Gen 2 glasses mark a significant leap in wearable technology, offering enhanced features and capabilities that cater to a broader range of applications and researcher needs. We believe researchers from industry and academia can accelerate their work in machine perception, contextual AI, robotics & more using Aria Gen 2.
Aria Gen 2 details + sign up for availability updates ➡️ ai.meta.com/blog/aria-gen-2-research-glasses-under-the-ho…This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
NVIDIA AI Developer
@NVIDIAAIDev
📣 Blackwell sets a new inference speed world record — A single NVIDIA DGX B200 server with eight #nvidiablackwell GPUs can generate over 1,000 tokens per second (TPS) per user on the Llama 4 Maverick model, the largest and most powerful model in the @AIatMeta Llama 4 family. ⚡⏱️
Additionally, a system with eight Blackwell GPUs can also deliver up to 72,000 tokens/second in a maximum throughput scenario.
🏆 Blackwell is the first platform to achieve this model performance, demonstrating how it delivers the best combination of throughput, output speed and accuracy for LLM token generation. 🏎️🏁
See our tech blog for details ➡️ nvda.ws/4kRJAH1 -
AI at Meta
@AIatMeta
Meta FAIR and Rothschild Foundation Hospital present a groundbreaking study mapping how language representations emerge in the brain, revealing striking parallels with LLMs.
This research offers unprecedented insights into the neural development of language, showing how AI models like wav2vec 2.0 and Llama 4 mirror the brain's language processing.
Discover how these findings pave the way for new frameworks in understanding human intelligence and developing clinical tools for language support.
📄 Read the full research paper: ➡️
go.fb.me/trxfbcThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
🚀Applications are open for the Llama Startup Program!🚀
We're thrilled to announce the Llama Startup Program, a new initiative designed to empower early-stage startups to innovate and build generative AI applications with Llama.
Why Join the Llama Startup Program?
☑️Cloud reimbursements to offset costs.
☑️Hands-on technical support from Llama experts to help you leverage Llama’s capabilities.
☑️A vibrant community and direct access to resources to help your startup thrive.
Who Should Apply?
Any incorporated, U.S.-based early-stage startup with less than $10 million in funding and at least one developer on staff.
Applications are open until May 30, 2025, at 6 p.m. PT
Learn more and apply today! ➡️go.fb.me/8rn4dh -
AI at Meta
@AIatMeta
Introducing Adjoint Sampling, a new learning algorithm that trains generative models based on scalar rewards.
Based on theoretical foundations developed by FAIR, Adjoint Sampling leads to a highly scalable practical algorithm, and can become the foundation for further research into highly scalable sampling methods.
Read our research paper on Adjoint Sampling and download the model, code, and benchmark ➡️ go.fb.me/q5l4cz -
AI at Meta
@AIatMeta
Exciting news coming out of Microsoft Build: Coming soon, the Llama herd of models will be direct first-party offerings in Azure AI Foundry, hosted and sold directly by Microsoft—with all the SLAs Azure customers expect from any Microsoft product.
We’re thrilled to make it even easier for enterprises to build with Llama! #msbuild 🦙 -
AI at Meta
@AIatMeta
We’ve released Open Molecules 2025 (OMol25), a new Density Functional Theory (DFT) dataset for molecular chemistry, and Meta's Universal Model for Atoms (UMA), a machine learning interatomic potential.
These tools will accelerate molecular and materials discovery, unlocking new possibilities for innovation and impact.
OMol25 is the largest and most diverse dataset of high accuracy quantum chemistry calculations for biomolecules, metal complexes, and electrolytes.
UMA is trained on over 30 billion atoms to provide more accurate predictions and improved understanding of molecular behavior.
Download the papers, models, and datasets for OMol25 and UMA ➡️ go.fb.me/q5l4czThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Announcing the newest releases from Meta FAIR. We’re releasing new groundbreaking models, benchmarks, and datasets that will transform the way researchers approach molecular property prediction, language processing, and neuroscience.
1️⃣ Open Molecules 2025 (OMol25): A dataset for molecular discovery with simulations of large atomic systems.
2️⃣ Universal Model for Atoms: A machine learning interatomic potential for modeling atom interactions across a wide range of materials and molecules.
3️⃣ Adjoint Sampling: A scalable algorithm for training generative models based on scalar rewards.
4️⃣ FAIR and the Rothschild Foundation Hospital partnered on a large-scale study that reveals striking parallels between language development in humans and LLMs.
Read more ➡️ go.fb.me/q5l4czThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
CATransformers is a carbon-driven neural architecture and system hardware co-design framework. Using CATransformers, we discover greener CLIP models that achieve an average of 9.1% reduction potential in total lifecycle carbon emissions while maintaining accuracy (or increasing accuracy) and latency.
This research is the first to look into carbon-driven neural architecture and system hardware co-design. It is enabled by a first-of-its-kind architectural carbon modeling tool – ACT, which we developed at FAIR.
Check out:
Our paper ➡️ go.fb.me/nedmh0;
code repository ➡️ go.fb.me/7jcp6q;
and the additional carbon design tools and research artifacts in Sustainable AI ➡️go.fb.me/csee32This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Following the success of its ICML 2024 tutorial, we're now releasing Part 4 of Physics of Language Models—a research effort from FAIR at Meta to uncover universal laws of AI through controlled, scientific experimentation.
In Part 4, we challenge today's architecture design paradigm—often driven by noisy, real-world pretraining—by introducing synthetic pretraining playgrounds that enable precise, apples-to-apples comparisons across model families.
Leveraging this framework, the paper presents 12 key results—most notably, the discovery that Canon layers, lightweight components that add “horizontal residual links” across tokens, can significantly improve reasoning and generalization in Transformers, Mamba, GLA, and beyond.
Zeyuan Allen-Zhu, Sc.D.
@ZeyuanAllenZhu
(1/8)🍎A Galileo moment for LLM design🍎
As Pisa Tower experiment sparked modern physics, our controlled synthetic pretraining playground reveals LLM architectures' true limits. A turning point that might divide LLM research into "before" and "after." physics.allen-zhu.com/part-4-architecture-design/part-4-1 -
AI at Meta
@AIatMeta
Introducing Collaborative Reasoner: a framework to improve collaborative reasoning in language models.
Collaborative Reasoner paves the way for developing social agents that can partner with humans and other agents.
Read the research paper and download the code.This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
We’re releasing model weights for our 8B- parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability.
Learn more about how Dynamic Byte Latent Transformer is paving the way for groundbreaking developments in the field of language modeling.
Read the research paper, and download the model and code. go.fb.me/je2t32 -
AI at Meta reposted
Engineering at Meta
@Meta_Engineers
Meta and NVIDIA have teamed up to supercharge vector search on GPUs by integrating NVIDIA cuVS into Faiss v1.10, Meta’s open-source library for similarity search. This collaboration brings groundbreaking performance improvements:
🔹 IVF indexing: NVIDIA cuVS boosts build times by up to 4.7x and slashes search latency by as much as 8.1x.
🔹 Graph indexing: CUDA ANN Graph (CAGRA) outpaces CPU HNSW build times by up to 12.3x and reduces search latency by up to 4.7x.
Faiss, developed by Meta FAIR, has been a game-changer in vector search, seamlessly switching between GPUs and CPUs. Now, with NVIDIA's cutting-edge contributions, Faiss 1.10.0 offers even more flexibility and power.
Curious about the benchmarks and the future of vector search? Dive into the full blog post to explore the details and see how this partnership is pushing the boundaries of what's possible. Read the blog post:
engineering.fb.com/2025/05/08/data-infrastructure/acceler… -
AI at Meta
@AIatMeta
Introducing Meta Locate 3D: a model for accurate object localization in 3D environments.
Learn how Meta Locate 3D can help robots accurately understand their surroundings and interact more naturally with humans.
You can download the model and dataset, read our research paper, and even try a demo! go.fb.me/je2t32This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks.
Learn more about how PLM can help the open source community build more capable computer vision systems.
Read the research paper, and download the code and dataset: go.fb.me/je2t32This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Meta Newsroom
@MetaNewsroom
We’re excited to announce the 10 international recipients of the second Llama Impact Grants and celebrate how they’re using open source AI to drive drive innovation and economic growth.
about.fb.com/news/2025/04/llama-impact-grant-recipients/This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Introducing Meta Perception Encoder: a vision encoder setting new standards in image & video tasks. It excels in zero-shot classification & retrieval, surpassing existing models.
Learn more about Meta Perception Encoder, read the research paper, and download the code and dataset go.fb.me/je2t32 -
AI at Meta
@AIatMeta
Curious about the tech behind Edits? Our latest blog post explores how Meta Segment Anything Model (SAM) 2.1 is enabling the Cutouts feature in the new Edits app.
Learn more: ai.meta.com/blog/instagram-edits-cutouts-segment-anything -
AI at Meta
@AIatMeta
Meet Solo Tech, one of the 10 international recipients of the second Llama Impact Grants.
Solo Tech uses Llama to offer offline, multilingual AI support for underserved rural communities with limited internet access. This grant will help them to equip 50 rural centers with AI tools while empowering local professionals and advancing the development of physical AI solutions.
Read more about this year’s winners and the exciting technologies they’ve created! ➡️ about.fb.com/news/2025/04/llama-impact-grant-recipients/This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
“We built this place on open source…”
Meta Chief Product Officer Chris Cox took to the stage to kick off LlamaCon 2025, reflecting on our long legacy of open source contributions. 🧵Post not available here, view on X
AI at Meta
@AIatMeta
Cox also gave a special shoutout to our partners, who’ve helped make it possible to get started building with Llama right off the bat—regardless of your development environment. Because the Llama stack is modular, it’s easy to plug and play and switch between component parts. That makes development a lot easier. And we’re continuing to ask what we can do to make Llama better for you.
AI at Meta
@AIatMeta
And we want to help businesses scale. That’s why Llama 4 packs a lot of performance into as small a package as possible.
-
AI at Meta reposted
Meta for Developers
@MetaforDevs
We’re excited to announce we’ve opened up slots to participate in a limited preview of Llama API - our developer platform for Llama app development. This is just step 1 for our API, and we look forward to hearing the community's feedback on it as we continue to iterate.
Llama API has easy one-click API key creation, interactive playgrounds to explore Llama models, and dedicated compatibility endpoints for easy integration - it’s free to use during this preview period, so get started today!
Join the waitlist: dev.meta.ai/join_waitlist
Learn more about Llama API: dev.meta.ai
Read more on our blog: ai.meta.com/blog/llamacon-llama-news/ -
AI at Meta reposted
Engineering at Meta
@Meta_Engineers
We’re sharing an early view into how we’re building Private Processing, a new technology that will allow WhatsApp users to leverage powerful optional AI features – like summarizing unread messages or editing them – so that no one, including Meta and WhatsApp can access them. We welcome feedback as we keep hardening this technology in the coming weeks.
Our engineering blog focuses on the threat model and security and privacy design requirements at the core of Private Processing.
engineering.fb.com/2025/04/29/security/whatsapp-private-p… -
AI at Meta
@AIatMeta
That’s a wrap on the LlamaCon 2025 keynote!
In just over two years, Llama has surpassed 1 billion downloads and established itself as the open ecosystem leader in AI.
We’re continuing to support the growth and development of the Llama ecosystem with today’s announcements:
The Llama API in Preview: The best features of closed-model APIs with the flexibility of open source.
The AI Defender Program: State-of-the-art tools to detect and prevent AI-generated threats.
Meet the Llama Impact Grant Winners driving transformative change with open-source AI.
Learn more about today’s announcements and how to apply for the Llama API Preview ➡️ go.fb.me/so7u4j -
AI at Meta
@AIatMeta
Today at LlamaCon, we announced the 10 international recipients of the second Llama Impact Grants!
The Llama Impact Grants are aimed at fostering innovation and creating economic opportunities through open-source AI.
This year’s recipients showcase a diverse range of solutions, including a Llama-powered chatbot to enhance public access to civic services, real-time error detection for pharmacy operations, and a multilingual study tool for students all over the globe.
Read more about this year’s winners and the exciting technologies they’ve created! ➡️ go.fb.me/o6gs1r -
AI at Meta
@AIatMeta
Major updates from LlamaCon!
We’re advancing AI security with new open-source Llama protection tools and new AI- powered solutions for the defender community.
Developers can now access:
-- Llama Guard 4, a customizable safeguard that supports protections for text and image understanding across modalities.
-- Llama Firewall, a security guardrail tool that helps build secure AI systems by detecting and preventing risks like prompt injection, insecure code, and risky LLM plug-in interactions.
-- Two new versions of Llama Prompt Guard: Prompt Guard 2 86M, which improves performance in jailbreak and prompt injection detection, and Prompt Guard 2 22M, a smaller, faster version that reduces latency and compute costs with minimal performance trade-offs.
We’re also investing in new AI-enabled solutions to help the community enhance their security systems.
-- CyberSecEval 4 is our latest suite of cybersecurity benchmarks for AI systems.
-- The Llama Defender Program will help trusted partners access a variety of open, early-access, and closed AI-solutions to address different security needs.
Learn more about our new open-source protection tools and how we’re advancing AI privacy and security: ➡️ go.fb.me/9ru1vc -
AI at Meta reposted
Meta for Developers
@MetaforDevs
🔴 We’re LIVE - LlamaCon 2025! Join us for a keynote, fireside chats, and the latest on the Llama collection of models. Watch now: www.facebook.com/MetaforDevelopers/ #llamacon2025
-
AI at Meta reposted
Meta for Developers
@MetaforDevs
🔔 Reminder: LlamaCon 2025 is LIVE tomorrow at 10:15 AM PDT! Join us for keynotes, fireside chats, and the latest on the Llama collection of models. Be there to witness the future unfold. Learn more: dev.meta.ai/llama/events/llamacon/2025 #llamacon2025
-
AI at Meta
@AIatMeta
📷 Hello Singapore! Meta is at #iclr2025 EXPO 📷
Meta will be in Singapore this week for #iclr25! Stop by our booth to chat with our team or learn more about our latest research.
Things to know:
📷 Find us @ Booth #l03 (Rows 3-4, Columns L-M) in Hall 2.
📷 We're sharing 50+ publications & 15 workshops.
That’s not all, we are actively hiring researchers to join us and help us build tomorrow’s reality:
📷 AI Research Assistant (PhD) (Paris) - meta.careers/3YLca3Q
📷 Postdoctoral Researcher (PhD) - Core Learning (Paris) - meta.careers/448CE2W
📷 Research Scientist, 3D Generative AI (PhD) - meta.careers/4cPhbOQ
📷 AI Research Scientist, Language - Generative AI - meta.careers/3GpoiRW
#ai #phd #research #metacareers -
AI at Meta reposted
Opennote
@opennote_me
Opennote utilizes the Llama 4 family for higher accuracy to support learners. Come find us at LlamaCon on April 29th to learn more about how we're empowering a new kind of personalized education!
www.llama.com/events/llamacon/2025/ -
AI at Meta reposted
Engineering at Meta
@Meta_Engineers
As AI workloads continue to scale in size and complexity, the demands on our underlying systems have never been higher. Building reliable systems for AI is now a foundational engineering challenge.
Join us at the @Scale: Systems & Reliability conference where they will bring together experts from AMD, Clockwork Systems, Google, Meta, Microsoft, Netflix, NVIDIA, Pinterest, Pure Storage, and union.ai to share deep technical insights into how they’re solving these problems at scale. The two-track program will focus on systems architecture, reliability engineering, and the real-world constraints of running AI in production.
Don’t miss this is a rare opportunity to learn from the teams building the backbone of modern computing. Register today:
atscaleconference.com/events/scale-systems-reliability/ -
AI at Meta reposted
Meta for Developers
@MetaforDevs
At #llamacon2025, we're not just celebrating technology – we're celebrating the open source community that makes it all possible. Join us as we recognize the transformative impact of our developer community and the amazing things they've achieved with Llama. You’ll hear the latest on the Llama collection of models and tools, and get a sneak-peek on what's to come. Get on the list to get notified with more LlamaCon updates: dev.meta.ai/llama/events/llamacon/2025
-
AI at Meta
@AIatMeta
🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception.
1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks.
2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks.
3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments.
4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability.
5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models.
Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️ go.fb.me/je2t32This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Your first look at what’s coming up for LlamaCon on April 29th! Mark will be sitting down with Microsoft Chairman and CEO @satyanadella to discuss the latest trends in AI for devs; and with @databricks Co-Founder and CEO, Ali Ghodsi on open source AI + advice for founders.
AI at Meta
@AIatMeta
Get on the list to get notified with more LlamaCon updates ⬇️
go.fb.me/LlamaCon2025 -
AI at Meta
@AIatMeta
The power of Llama 4 🤝 The simplicity of Vertex AI
What will you build?
Google Cloud Tech
@GoogleCloudTech
Introducing Llama 4 on Vertex AI Model Garden—deploy with 1-click!
- Vertex AI now supports Llama 4 Scout & Maverick models from Meta
- To get started, access Llama 4 Scout & Maverick via fully managed Vertex AI Model-as-a-service API endpoints (in preview)
#googlecloudnext -
AI at Meta reposted
Artificial Analysis
@ArtificialAnlys
Llama 4 Intelligence Index Update: We have now replicated Meta’s claimed values for MMLU Pro and GPQA Diamond, pushing our Intelligence Index scores for both Scout and Maverick higher
Key update details:
➤ We noted in our first post 48 hours ago that we noticed discrepancies between our measured results and Meta’s claimed scores for our multi-choice eval datasets (MMLU Pro and GPQA Diamond)
➤ After further experiments and and close review, we have decided that in accordance with our published principle against unfairly penalizing models where they get the content of questions correct but format answers differently, we will allow Llama 4’s answer style of ‘The best answer is A’ as legitimate answer for our multi-choice evals
➤ This leads to a jump in score for both Scout and Maverick (largest for Scout) in 2/7 of the evals that make up Artificial Analysis Intelligence Index, and therefore a jump in their Intelligence Index scores
➤ Scout’s Intelligence Index has moved from 36 to 43, and Maverick’s Intelligence Index has moved from 49 to 50.
Overall, we continue to conclude that both Scout and Maverick are very impressive models and a significant contribution to the open weights AI ecosystem.
While DeepSeek V3 0324 maintains a small lead over Maverick, we continue to note that Maverick has ~half the active parameters (17B vs 37B), and ~60% of the total parameters (402B vs 671B), while also supporting image inputs.
All our tests have been performed on the Hugging Face release version of the Llama 4 weights for both Scout and Maverick, including testing via a range of third party cloud providers. None of our eval results are based on the experimental chat-tuned model provided to LMArena (Llama-4-Maverick-03-26-Experimental).
We can also share that we have observed third party cloud APIs generally stabilizing over the last 48 hours. We will soon release endpoint-level comparison data to allow developers to understand whether any cloud providers are still serving versions of Llama 4 with accuracy issues. -
AI at Meta
@AIatMeta
With vLLM via pip, run any of the models in the Llama 4 family with a simple command.
Red Hat AI
@RedHat_AI
Llama 4 Herd is here!
It brings a lot of goodies, like MoE architecture and native multimodality, enabling developers to build personalized multimodal experiences.
With Day 0 support in vLLM, you can deploy Llama 4 with @vllm_project now!
Let's dig into it.
(a thread) -
AI at Meta reposted
Arena.ai
@arena
BREAKING: Meta's Llama 4 Maverick just hit #2 overall - becoming the 4th org to break 1400+ on Arena!🔥
Highlights:
- #1 open model, surpassing DeepSeek
- Tied #1 in Hard Prompts, Coding, Math, Creative Writing
- Huge leap over Llama 3 405B: 1268 → 1417
- #5 under style control
Huge congrats to @AIatMeta — and another big win for open-source! 👏 More analysis below⬇️
AI at Meta
@AIatMeta
Today is the start of a new era of natively multimodal AI innovation.
Today, we’re introducing the first Llama 4 models: Llama 4 Scout and Llama 4 Maverick — our most advanced models yet and the best in their class for multimodality.
Llama 4 Scout
• 17B-active-parameter model with 16 experts.
• Industry-leading context window of 10M tokens.
• Outperforms Gemma 3, Gemini 2.0 Flash-Lite and Mistral 3.1 across a broad range of widely accepted benchmarks.
Llama 4 Maverick
• 17B-active-parameter model with 128 experts.
• Best-in-class image grounding with the ability to align user prompts with relevant visual concepts and anchor model responses to regions in the image.
• Outperforms GPT-4o and Gemini 2.0 Flash across a broad range of widely accepted benchmarks.
• Achieves comparable results to DeepSeek v3 on reasoning and coding — at half the active parameters.
• Unparalleled performance-to-cost ratio with a chat version scoring ELO of 1417 on LMArena.
These models are our best yet thanks to distillation from Llama 4 Behemoth, our most powerful model yet. Llama 4 Behemoth is still in training and is currently seeing results that outperform GPT-4.5, Claude Sonnet 3.7, and Gemini 2.0 Pro on STEM-focused benchmarks. We’re excited to share more details about it even while it’s still in flight.
Read more about the first Llama 4 models, including training and benchmarks ➡️ go.fb.me/gmjohs
Download Llama 4 ➡️ go.fb.me/bwwhe9 -
AI at Meta
@AIatMeta
Take a look under the hood of Llama 4 Scout and Llama 4 Maverick – our most advanced AI models yet 🧵
Post not available here, view on X
AI at Meta
@AIatMeta
Llama 4 Scout and Llama 4 Maverick’s industry-leading performance is in large part thanks to distillation from Llama 4 Behemoth, our most powerful model yet.
Be on the lookout for more details on Llama 4 Behemoth at a future date!
AI at Meta
@AIatMeta
We can’t wait to see the rich experiences people build in the new Llama ecosystem!
Even more details on the Llama 4 herd in the model card ➡️go.fb.me/pti6fg -
AI at Meta
@AIatMeta
Today is the start of a new era of natively multimodal AI innovation.
Today, we’re introducing the first Llama 4 models: Llama 4 Scout and Llama 4 Maverick — our most advanced models yet and the best in their class for multimodality.
Llama 4 Scout
• 17B-active-parameter model with 16 experts.
• Industry-leading context window of 10M tokens.
• Outperforms Gemma 3, Gemini 2.0 Flash-Lite and Mistral 3.1 across a broad range of widely accepted benchmarks.
Llama 4 Maverick
• 17B-active-parameter model with 128 experts.
• Best-in-class image grounding with the ability to align user prompts with relevant visual concepts and anchor model responses to regions in the image.
• Outperforms GPT-4o and Gemini 2.0 Flash across a broad range of widely accepted benchmarks.
• Achieves comparable results to DeepSeek v3 on reasoning and coding — at half the active parameters.
• Unparalleled performance-to-cost ratio with a chat version scoring ELO of 1417 on LMArena.
These models are our best yet thanks to distillation from Llama 4 Behemoth, our most powerful model yet. Llama 4 Behemoth is still in training and is currently seeing results that outperform GPT-4.5, Claude Sonnet 3.7, and Gemini 2.0 Pro on STEM-focused benchmarks. We’re excited to share more details about it even while it’s still in flight.
Read more about the first Llama 4 models, including training and benchmarks ➡️ go.fb.me/gmjohs
Download Llama 4 ➡️ go.fb.me/bwwhe9 -
AI at Meta
@AIatMeta
One of the very interesting challenges with AI models for robotics is the constraints you're working with when deploying models that need to run in realtime on-device.
AI at Meta
@AIatMeta
We shared more details on the Meta PARTNR work to unlock human-robot collaboration in this post ➡️ go.fb.me/073dkm
-
AI at Meta
@AIatMeta
New agents benchmark: CollaborativeAgentBench is the first benchmark studying collaborative LLM agents that work with humans across multi-turn collaboration on realistic tasks in backend programming & frontend design ⬇️
go.fb.me/owr0xj
AI at Meta
@AIatMeta
As part of this work, we’re also releasing SWEET-RL, a novel RL algorithm for long-horizon & multi-turn tasks which can perform better credit assignments.
Our experiments demonstrate that SWEET-RL achieves a 6% absolute improvement in success & win rates on CollaborativeAgentBench compared to other state-of-the-art multiturn RL algorithms, enabling Llama-3.1-8B to match or exceed the performance of GPT4-o in realistic collaborative content creations ⬇️
github.com/facebookresearch/sweet_rl
AI at Meta
@AIatMeta
More details on both of these releases in the full paper published on arXiv ➡️ go.fb.me/c487vv
-
AI at Meta
@AIatMeta
Llama has now been downloaded over 1 Billion times!
A note to:
The researchers at Meta training these models — and those building on the research in other labs.
The developers and enthusiasts on r/LocalLlama, @huggingface and more; experimenting with new models and creating derivatives.
The small startups and big enterprises alike who are creating a new wave of AI-powered products, built with Llama.
The global AI community.
Your actions speak louder than words, thank you for making it abundantly clear — a billion times over — that open source AI is how we'll create the next wave of world changing technologies, together. 🦙❤️ -
AI at Meta
@AIatMeta
New ads ranking research from Meta researchers. Compared to prior work, UKDSL can enable models to learn from a much larger set of unlabeled data, improving performance while being computationally efficient ➡️ go.fb.me/xrl0ja
-
AI at Meta
@AIatMeta
Llama models were used to develop India's first open source audio language model — Shuka v1 ➡️ go.fb.me/4bbs7t
-
AI at Meta
@AIatMeta
AI is helping researchers identify therapies for cancer patients. @orakldotbio trained our DINOv2 model on organoid images to more accurately predict patient responses in clinical settings. This approach outperformed specialized models and is helping accelerate their research.
AI at Meta
@AIatMeta
We shared more on Orakl Oncology's work with the open source DINOv2 model from Meta FAIR in this post ⬇️
ai.meta.com/blog/orakl-oncology-dinov2-accelerating-cance… -
AI at Meta reposted
8VC
@8vc
Our friends @Meta are taking part in the 8VC Llama Stack Innovation Challenge!
First challenge: 3/7-4/19. Use Llama Stack to build desktop, field, and edge AI applications that run locally for privacy and performance. Join now:
www.llamastackchallenge.com -
AI at Meta
@AIatMeta
New dataset from researchers at Meta — uCO3D, or UnCommon Objects in 3D, is the largest publicly-available object-centric dataset for 3D deep learning and 3D generative AI.
More on this project ➡️ go.fb.me/8u86hq
AI at Meta
@AIatMeta
Highlights of uCO3D:
• 170K videos depicting diverse objects from all directions.
• Objects spanning ~1000 categories — grouped into 50 super-categories.
• Full original videos annotated with object segmentation, camera poses & point clouds.
• 3D Gaussian Splat reconstructions.
• Captions obtained with a large VLM.
• Significantly improved annotation quality and size vs previous datasets of this kind.
Documentation and the development kit ⬇️
github.com/facebookresearch/uco3d -
AI at Meta
@AIatMeta
By sharing some of the insights and challenges in developing the Meta PARTNR demo, we hope to contribute to the development of the next wave of innovation in human-robot collaboration.
Research paper ➡️ go.fb.me/prlg14
Dataset and code ➡️ go.fb.me/k9dzc0This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Blended Labs, an EdTech company in Germany, is using Llama 3.1 + 3.2 models to enable a wide range of AI-native flows for personalized learning pathways, real-time feedback, instant educational content generation and social gamification ⬇️ ai.meta.com/blog/blended-labs-ai-driven-schools-with-llama/
-
AI at Meta
@AIatMeta
Research paper from Meta FAIR and @bcbl_ researchers – Brain-to-Text Decoding: A Non-invasive Approach via Typing ➡️ go.fb.me/o8rhmv
-
AI at Meta
@AIatMeta
Llama is giving @SevillaFC an edge in scouting the next wave of soccer stars. Together with IBM they created Scout Advisor — a generative AI-driven scouting tool designed and built on watsonx, with Llama 3.1 ➡️ go.fb.me/gbx2h5
-
AI at Meta
@AIatMeta
Introducing Aria Gen 2, next generation glasses that we hope will enable researchers from industry and academia to unlock new work in machine perception, contextual AI, robotics and more.
Aria Gen 2 details + sign up for availability updates ➡️ go.fb.me/8rku3b -
AI at Meta
@AIatMeta
Meta PARTNR is a benchmark for planning and reasoning in embodied multi-agent tasks. This large-scale human and robot collaboration benchmark was core to our recent demos and also informs our work as scientists and engineers pushing this field of study forward.
This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
Meta PARTNR dataset and code ⬇️
github.com/facebookresearch/partnr-planner/ -
AI at Meta
@AIatMeta
Inspired by Project Aria and Ego-Exo4D from Meta FAIR, researchers at @GeorgiaTech developed EgoMimic, a new algorithmic framework that utilizes human data and robot data for humanoid robot development ➡️ go.fb.me/96j5ba
-
AI at Meta
@AIatMeta
Audiobox Aesthetics is a model for unified automatic quality assessment for speech, music and sound. Try the demo on @huggingface ➡️ go.fb.me/fq6brx
-
AI at Meta
@AIatMeta
In support of @UNESCO’s work, we’re inviting collaborators to join us in democratizing language technology and building more inclusive AI systems with the Language Technology Partner Program ➡️ go.fb.me/ccrklu
-
AI at Meta
@AIatMeta
A closer look at the evolution of the research from Meta FAIR that led to our latest open source work for human-robot collaboration.
Details on Meta PARTNR ➡️ go.fb.me/ufdanxThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
April 29, see you at the first-ever LlamaCon. 🦙 go.fb.me/LlamaCon
& we'll see you again later this year at Meta Connect, September 17-18. -
AI at Meta
@AIatMeta
Meta FAIR researchers, in collaboration with @bcbl_ are sharing two breakthroughs that show how AI can help advance our understanding of human intelligence.
1️⃣ Research that successfully decodes the production of sentences from non-invasive brain recordings.
2️⃣ A study toward understanding the neural mechanisms that coordinate language production in the human brain.
AI at Meta
@AIatMeta
We're excited to share these breakthroughs with the neuroscience community and hope that it will help to inspire and unlock new research in this important space.
More details on this work and access to the research papers ➡️ go.fb.me/9dx9nz -
AI at Meta
@AIatMeta
Our Automated Compliance Hardening (ACH) tool hardens platforms against regressions with LLM-based test generation. More on how this works and why it matters at Meta ➡️ go.fb.me/jyaab2
AI at Meta
@AIatMeta
Read the paper ➡️ go.fb.me/5xpy6h
-
AI at Meta
@AIatMeta
Starting today, SAM 2.1 is available in #amazonsagemaker JumpStart!
Joelle Pineau
@joellepineau
We've also updated SAM to make it more easily accessible to developers and artists everywhere. SAM 2.1 is now available on Amazon SageMaker JumpStart, making it easier to deploy and integrate into your applications and workflows. Check out updates here: ai.meta.com/blog/segment-anything-2/
-
AI at Meta
@AIatMeta
New open source release from Meta FAIR: Audiobox Aesthetics was trained on 562 hours of audio aesthetic data annotated by professional raters across four dimensions to create a model that enables the automatic evaluation of aesthetics for speech, music and sound.
AI at Meta
@AIatMeta
Audiobox Aesthetics has already been used to enhance our work on Meta Movie Gen and we’re excited about how this research will be able to support the development of more sophisticated generative audio models. More details in this post ⬇️
go.fb.me/ye5aqi -
AI at Meta
@AIatMeta
Meta PARTNR is a research framework supporting seamless human-robot collaboration. Building on our research with Habitat, we’re open sourcing a large-scale benchmark, dataset and large planning model that we hope will enable the community to effectively train social robots.
This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
More on our newest releases and impact of the open source work developed by Meta FAIR ➡️ go.fb.me/l9c28m
-
AI at Meta
@AIatMeta
Today we’re celebrating 10 years of the Meta FAIR lab in Paris by sharing a collection of new models, datasets and some exciting milestones in the impacts of open source — all laddering up to our ongoing work to achieve Advanced Machine Intelligence (AMI).
1️⃣ Meta PARTNR is a framework for human-robot collaboration that builds on our existing work in this space with a new dataset and a large planning model enabling robots to accomplish complex tasks alongside humans.
2️⃣ Meta Audiobox Aesthetics enables the automatic evaluation of audio aesthetics, providing a comprehensive assessment of audio quality across speech, music and sound.
3️⃣ Open Source Machine Translation Benchmark is a carefully crafted collection with the aim of building an unprecedented multilingual machine translation benchmark for the community.
4️⃣ Two new breakthrough studies using AI to further our understanding of language in the brain.This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
In addition to these releases, we’re also sharing updates on how our research is being put into action in the world — including a new Language Technology Partner Program and how our work on Seamless Communication research is being used in WhatsApp.
Our latest work to advance AMI ➡️ go.fb.me/yqtr30
How we’re using AI to decode language from the brain and advance our understanding of human communication ➡️ go.fb.me/govnn7 -
AI at Meta reposted
Cerebral Valley
@cerebral_valley
🕘 12 hours and we'll be opening the doors for the @AIatMeta Llama Hackathon in Oslo with more than $30,000 in cash and prizes up for grabs
All hackers will have access to H100 compute from @nebiusai !
Remember to tag us in content across the weekend so we can repost! -
AI at Meta reposted
Meta for Developers
@MetaforDevs
Altana is driving global supply chain efficiencies by using Llama for tariff code classifications with a chatbot to guide users in selecting the right tariff code. Learn more about how Altana leverages Llama to drive flexibility in their global deployment at the link below ⬇️
-
AI at Meta
@AIatMeta
Using the open source DINOv2 model, a medtech company founded by two pediatric cardiologists developed tools to help clinicians identify or rule out signs of congenital heart defects in children faster and more accurately.
AI at Meta
@AIatMeta
How BrightHeart uses Meta’s DINOv2 to transform fetal heart screenings ➡️ go.fb.me/wx8nyt
-
AI at Meta reposted
Ahmad Al-Dahle
@Ahmad_Al_Dahle
We want Meta AI to feel more useful for our users every single day – so we are rolling out a greater level of personalization for Meta AI on Facebook, Messenger and Instagram today.
Lots more on this update here:
about.fb.com/news/2025/01/building-toward-a-smarter-more-… -
AI at Meta
@AIatMeta
Today, we’re publishing the first stable release of Llama Stack.
With this release Llama Stack now includes:
• Streamlined upgrades w/ backwards compatibility for future API versions.
• Automated verification for supported providers.
Live in the repo ⬇️
github.com/meta-llama/llama-stack -
AI at Meta
@AIatMeta
With a stack leveraging Segment Anything 2, an RTX 4090 and a collection of open source models and utilities, Josephine Miller is creating runway-ready fashion content ➡️ go.fb.me/slwyw5
-
AI at Meta
@AIatMeta
This hackathon will focus on themes of science & innovation + multilinguality. Winning teams can receive up to $15K USD in prizes in addition to mentorship from teams at Meta!
Cerebral Valley
@cerebral_valley
Kicking off 2025 with an official Llama 3.3 hackathon in Oslo 🇳🇴
24 hours, thousands of $$$ CASH in prizes, live DJs
H100s for EACH team provided by @nebiusai
@AIatMeta infra and research team on site to support 👀
sign up below 👇 -
AI at Meta
@AIatMeta
OpenBioLLM-8B and OpenBioLLM-70B are new fine-tuned Llama models developed by Saama to streamline tasks that can accelerate clinical trials, opening up new possibilities in personalized medicine. More details in their research paper ➡️ go.fb.me/x3iq84
AI at Meta
@AIatMeta
How Llama is helping Saama deliver new possibilities in personalized medicine and data-driven care ➡️ go.fb.me/pfq4x7
-
AI at Meta
@AIatMeta
Today we’re announcing the recipients of our LLM Evaluation research grants. These four projects will each receive $200K in grant funding from Meta to further their work in novel new work in evaluations over the next year.
1️⃣MMRLU: Massive Multitask Regional Language Understanding — @ABosselut, @EPFL
2️⃣Evaluating and Advancing Complex, Real-world Reasoning in Large Language Models — @armancohan, @Yale
3️⃣Modular Multi-modal Agents that Can Reason — @georgiagkioxari, @Caltech
4️⃣CodeArena: A Diverse Interactive Programming and Code Reviewing Environment for Evaluating Large Language Models — @saikatdutta2012, @CornellCIS
Congratulations to the grant recipients, we look forward to your progress in this space in 2025!
AI at Meta
@AIatMeta
You can find more details on these projects and the scope of this grant program from Meta ➡️ go.fb.me/q7sw1x
-
AI at Meta
@AIatMeta
In December, @SnowflakeDB AI Research announced SwiftKV, a new approach that reduces inference computation during prompt processing. Today they're making SwiftKV-optimized Llama models available on Cortex AI that reduce inference costs by up to 75%!
Snowflake
@Snowflake
Introducing Snowflake-Llama models with SwiftKV optimizations!
SwiftKV optimizations developed and integrated into vLLM improve LLM inference throughput to lower the cost. Snowflake-derived models, based on @Meta’s Llama 3.3 70B and Llama 3.1 405B base models, are now available for serverless inference in Cortex AI with an inference cost reduction of up to 75%.
Learn how SwiftKV achieves this performance: www.snowflake.com/en/blog/up-to-75-lower-inference-cost-l… -
AI at Meta
@AIatMeta
Today we’re excited to share that our work on SeamlessM4T from Meta FAIR was published in the latest issue of @Nature ➡️ go.fb.me/hmea6y
AI at Meta
@AIatMeta
More details on this work and access to the model ⬇️
github.com/facebookresearch/seamless_communication -
AI at Meta
@AIatMeta
Using the DINOv2 open source model from Meta FAIR, @virgosvs developed EndoDINO, a foundation model that delivers SOTA performance across a range of GI endoscopy tasks ➡️ go.fb.me/h0q0ke
AI at Meta
@AIatMeta
The Virgo team has shared more details on EndoDINO in the research paper ➡️ go.fb.me/ubckg8
-
AI at Meta
@AIatMeta
Released by @RealityLabs Research at #eccv2024, Nymeria is a large-scale multimodal egocentric dataset for full-body motion understanding with potential applications in VR/MR headsets, smart glasses and more.
More on this work + access to the dataset ➡️ go.fb.me/0znnvb -
AI at Meta
@AIatMeta
The @NVIDIA Project DIGITS personal AI supercomputer will enable developers to prototype, fine-tune and inference some of our most advanced Llama models locally.
NVIDIA AI Developer
@NVIDIAAIDev
"By making @AIatMeta Llama models open source, we're committed to democratizing access to cutting-edge AI technology. With Project DIGITS, developers can harness the power of Llama locally, unlocking new possibilities for innovation and collaboration.”
-- @Ahmad_Al_Dahle, VP, GenAI at Meta -
AI at Meta
@AIatMeta
The team at Inarix is using open source AI models from Meta FAIR to turn smartphones into pocket laboratories for farmers. Building a foundational model on top of DINOv2, the platform enables farmers to assess crop value in real time ➡️ go.fb.me/dov53u
-
AI at Meta
@AIatMeta
New research from Meta FAIR — Meta Memory Layers at Scale. This work takes memory layers beyond proof-of-concept, proving their utility at contemporary scale ➡️ go.fb.me/3lbt4m
AI at Meta
@AIatMeta
This GitHub repo contains a reference implementation of this work ⬇️
github.com/facebookresearch/memory -
AI at Meta
@AIatMeta
Newly published research for generative retrieval for recommendations from teams at Meta.
- Preference Discerning with LLM-Enhanced Generative Retrieval ➡️ go.fb.me/evvcu8
- Unifying Generative and Dense Retrieval for Sequential Recommendation ➡️ go.fb.me/i7l955 -
AI at Meta
@AIatMeta
New from Meta FAIR — Byte Latent Transformer: Patches Scale Better Than Tokens introduces BLT, which for the first time, matches tokenization-based LLM performance at scale with significant improvements in inference efficiency & robustness.
Paper ➡️ go.fb.me/w23lmz
AI at Meta
@AIatMeta
More in the Byte Latent Transformer repo on GitHub ⬇️
github.com/facebookresearch/blt -
AI at Meta
@AIatMeta
SemiKong, a model built with Llama, is the world's first open source semiconductor-focused LLM. With this work @aitomatic is enabling semiconductor companies to build Domain-Expert Agents to capture and scale their deep domain expertise ➡️ go.fb.me/9yq4mq
-
AI at Meta
@AIatMeta
Through experimentation @LinkedIn found EON-8B, a domain-adapted version of Llama 3.1 8B, to be 75x and 6x cost effective in comparison to GPT-4 and GPT-4o respectively.
More on their domain-adapted foundation model work ➡️ go.fb.me/curuy3 -
AI at Meta
@AIatMeta
New research from Meta FAIR: Large Concept Models (LCM) is a fundamentally different paradigm for language modeling that decouples reasoning from language representation, inspired by how humans can plan high-level thoughts to communicate.
AI at Meta
@AIatMeta
More details on this research in the full paper ➡️ go.fb.me/mn2vvw
-
AI at Meta
@AIatMeta
Introducing Meta Video Seal: a state-of-the art comprehensive framework for neural video watermarking. Try the demo ➡️ go.fb.me/1ihqor
AI at Meta
@AIatMeta
With this release we’re making the Video Seal model available under a permissive license, alongside a research paper, training code and inference code.
github.com/facebookresearch/videoseal -
AI at Meta
@AIatMeta
As we wrap up 2024, we're sharing an update on our progress with Llama and the impact it’s having around the world.
Read the full update here ➡️ go.fb.me/nf5b34
A few highlights from 2024
📈 Llama has been downloaded over 650M times, doubling in just three months.
🌏 License approvals for Llama have more than doubled globally, with significant growth in emerging markets.
🤗 There are now over 85,000 Llama derivative models on @HuggingFace alone — a 5x increase from the start of the year.
❤️ We’re continuing to see Llama being used across the industry with new examples and innovation from @Blocks, Accenture and @LinkedIn — among others.
Open source AI is shaping the future. As we look to 2025, the pace of innovation will only increase as we work to make Llama the industry standard for building on AI. -
AI at Meta
@AIatMeta
The @SpotifyEng team continues to push cutting-edge product experiences with AI — smaller Llama models and fine-tunes are playing an important role in their experimentation and how they deliver on work across recommendations, AI DJ and more. research.atspotify.com/2024/12/contextualized-recommendat…
-
AI at Meta
@AIatMeta
New research from Meta FAIR — Meta Explore Theory-of-Mind: Program guided adversarial data generation for theory of mind reasoning. This work includes a new research paper, code & a dataset on @HuggingFace.
Details + eight more new releases from FAIR ➡️ go.fb.me/750ao2 -
AI at Meta reposted
Ahmad Al-Dahle
@Ahmad_Al_Dahle
We released Llama 3.3, a new 70B model that delivers the performance of our 405B model but is easier & more cost-efficient to run, just a couple of weeks ago and the developer community is already finding ways to use it to build better 🔥 Cool work from @NVIDIAAIDev!
NVIDIA AI Developer
@NVIDIAAIDev
🌟 Boost @AIatMeta's Llama 3.3 70B inference throughput by 3x with Tensor RT-LLM optimizations including speculative decoding, in-flight batching, KV caching, custom FP8 quantization, and more. 🦙
Technical deep dive ➡️ nvda.ws/4iCqt3d ✨ -
AI at Meta
@AIatMeta
Fine-tuning Llama 3.1, researchers at @MBZUAI built BiMediX2, an Arabic-English VLM for medical use cases that excels in both text and visual tasks — including interpreting medical images from X-Rays, CT scans, MRIs and more ➡️ go.fb.me/amadbx
-
AI at Meta
@AIatMeta
New release from Meta FAIR — Meta Motivo is a first-of-its-kind behavioral foundation model for controlling virtual physics-based humanoid agents for a wide range of complex whole-body tasks.
The model is capable of expressing human-like behaviors and achieves performance competitive with task-specific methods and outperforms state-of-the-art unsupervised RL and model-based baselines.
Try the demo ➡️ go.fb.me/3zgx27
Get the model and code ➡️ go.fb.me/ulrz1e
We’re excited about how this research could pave the way for fully embodied agents, leading to more lifelike NPCs, democratization of character animation and new types of immersive experiences.This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
More details, including links to the research paper and eight other new open source releases from FAIR ⬇️
go.fb.me/7novp9 -
AI at Meta
@AIatMeta
Wrapping up the year and coinciding with #neurips2024, today at Meta FAIR we’re releasing a collection of nine new open source AI research artifacts across our work in developing agents, robustness & safety and new architectures. More in the video from @jpineau1.
All of this work is part of FAIR’s continued work towards the goal of achieving advanced machine intelligence
A few highlights from what we’re releasing today:
• Meta Motivo: A first-of-its-kind behavioral foundation model that controls the movements of a virtual embodied humanoid agent to perform complex tasks.
• Meta Video Seal: a state-of-the art comprehensive framework for neural video watermarking.
• Meta Explore Theory-of-Mind: A program-guided adversarial data generation for theory of mind reasoning.
• Meta Large Concept Models: A fundamentally different training paradigm for language modeling that decouples reasoning from language representation.
And much more!
We’re excited to share this work with the research community and look forward to seeing how it inspires new innovation across the field.
Details and access to everything released by FAIR today ➡️ go.fb.me/28i46qThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Following #neurips2024 from your feed? Add these 10 papers from researchers at Meta to your reading list.
1️⃣ ReplaceAnything3D: Text-Guided object replacement in 3D scenes with compositional scene representations: go.fb.me/bfb0q0
2️⃣ emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation: go.fb.me/8id2bl
3️⃣ Unified Speech Recognition: A Single Model for Auditory, Visual, and Audiovisual Inputs: go.fb.me/0q6h9f
4️⃣ Déjà Vu Memorization in Vision–Language Models: go.fb.me/7z99lv
5️⃣ On improved Conditioning Mechanisms and Pre-training Strategies for Diffusion Models: go.fb.me/nxd0fj
6️⃣ Nearest Neighbor Speculative Decoding for LLM Generation and Attribution: go.fb.me/19k7ei
7️⃣ Rainbow Teaming: Open-Ended Generation of Diverse Adversarial Prompts: go.fb.me/fcbxgn
8️⃣ HOI-Swap: Swapping Objects in Videos with Hand-Object Interaction Awareness: go.fb.me/ptf5df
9️⃣ You Don’t Need Domain-Specific Data Augmentations When Scaling Self-Supervised Learning: go.fb.me/sgxvfr
🔟 Online Learning with Sublinear Best-Action Queries: go.fb.me/5ly349 -
AI at Meta reposted
-
AI at Meta
@AIatMeta
We're at @NeurIPSConf this week showcasing some our latest research across GenAI, FAIR, @RealityLabs Research and more. This year researchers from across Meta had 47+ publications accepted, are taking part in 7+ different talks/workshops/panels and we'll be showcasing a number of demos on some new work.
📍Visit us at Booth 433 near the center of the expo floor.
A few workshop highlights coming up this week
• Streamlining Computer Vision Data Annotation with SAM 2.1
• AI-Driven Speech, Music and Sound Generation
• Video-Language Models
• Adaptive Foundation Models: Evolving AI for Personalized and Efficient Learning
• Socially Responsible Language Modelling Research
• Responsibly Building Next Generation of Multimodal Foundation Models
• Safe Generative AI
• Workshop on Touch Processing
See you at #neurips2024! -
AI at Meta
@AIatMeta
Introducing SPDL: Faster AI model training with thread-based data loading. This framework-agnostic data loading solution utilizes multi-threading to achieve high-throughput in a regulator Python interpreter. More details ➡️ go.fb.me/pgo4xj
AI at Meta
@AIatMeta
The library is available in the repo on GitHub ⬇️
github.com/facebookresearch/spdl -
AI at Meta
@AIatMeta
As we continue to explore new post-training techniques, today we're releasing Llama 3.3 — a new open source model that delivers leading performance and quality across text-based use cases such as synthetic data generation at a fraction of the inference cost.
AI at Meta
@AIatMeta
Improvements in Llama 3.3 were driven by a new alignment process and progress in online RL techniques. This model delivers similar performance to Llama 3.1 405B with cost effective inference that’s feasible to run locally on common developer workstations.
AI at Meta
@AIatMeta
Llama 3.3 is available now from Meta and on @huggingface — and will be available for deployment soon through our broad ecosystem of partner platforms.
Model card ➡️ go.fb.me/eezbpw
Download from Meta ➡️ go.fb.me/q6i41y
Download on HF ➡️ go.fb.me/y5rcam -
AI at Meta
@AIatMeta
Today in partnership with @LEDLouisiana, we announced our plans for our newest and largest datacenter in Richland Parish, Louisiana which will play a vital role in accelerating our AI progress and support training future open source LLMs.
AI at Meta
@AIatMeta
More details here ➡️ go.fb.me/zpqs8t
-
AI at Meta
@AIatMeta
Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors + many tasks. The family of models was pre-trained on a large dataset of 460K+ tactile images using SSL.
To foster new research, we've released code, a dataset, pre-trained models & a paper on this work ➡️ go.fb.me/hmlavg
AI at Meta
@AIatMeta
You can find more on Meta Sparsh, and more of our recently announced robotics AI research in this post ➡️ go.fb.me/yj8cu5
-
AI at Meta
@AIatMeta
IBM watsonx provides a studio for AI builders worldwide to train, validate, tune & deploy AI models. The platfrorm is enabling developers from the financial industry to sports scouting to build impressive and impactful things with Llama ➡️ go.fb.me/e6eilh
-
AI at Meta
@AIatMeta
As part of our continued work to help assure the future security of deployed cryptographic systems, we recently released new code that will enable researchers to benchmark AI-based attacks — and compare them to new and existing attacks going forward ⬇️
github.com/facebookresearch/LWE-benchmarking
AI at Meta
@AIatMeta
You can find more details on the original research in the paper ➡️ go.fb.me/vpmfl4
-
AI at Meta
@AIatMeta
Following the release of our latest system level safeguards, today we're sharing new research papers outlining work on Llama Guard 3 1B & Llama Guard 3 Vision that support input/output safety on the edge and in multimodal prompts.
AI at Meta
@AIatMeta
Our hope in releasing this research openly is that it helps practitioners build better safeguard models and inspires further research in LLM safety.
Llama Guard 3 1B paper ➡️ go.fb.me/5ofm27
Llama Guard 3 Vision paper ➡️ go.fb.me/2hitev -
AI at Meta
@AIatMeta
969 tok/sec, impressive work from @cerebras! We're excited to see what kinds of new applications developers can build with our most advanced Llama model at this inference speed!
Artificial Analysis
@ArtificialAnlys
Cerebras is capable of offering Llama 3.1 405B at 969 output tokens/s and they have announced they will soon be offering a public inference endpoint 🏁
We have independently benchmarked a private endpoint shared by @cerebras and have measured 969 output tokens/s, >10X faster than the median provider we benchmark.
Cerebras have announced they will be conducting trials with select inference customers in Q4 '24 and will be offering access to all customers of their serverless inference offering in Q1 '25.
The endpoint will be offered at $6 / 1M input tokens & $12 / 1M output tokens. While the endpoint we benchmarked had a 16k context window, Cerebras have shared that they will be supporting the model's full 128k context window.
Link to our analysis of Llama 3.1 405B providers below 👇 Cerebras' endpoint will be present as soon as it is launched to the public. -
AI at Meta
@AIatMeta
The NVIDIA team shared more on how they optimized Llama 3.2 on-device and vision models for performance and cost-efficiency from data-center scale all the way to low-power edge devices.
NVIDIA AI Developer
@NVIDIAAIDev
🦙 Llama 3.2 model collection from @AIatMeta accelerated with NVIDIA #tensorrt and TensorRT #llm ⚡
✅ reduced cost and latency
✅ unparalleled throughput
✅ optimal end-user experience
Tech Blog: ➡️ developer.nvidia.com/blog/llama-3-2-full-stack-optimizati… 🌟 -
AI at Meta
@AIatMeta
The community is doing impressive work and the Llama shoutouts feed on @ProductHunt is a great source of inspiration!
Product Hunt 😸
@ProductHunt
Llama 405B 3.1 is the world’s largest open-source AI model.
“The availability of powerful, openly accessible models like Llama 3 is driving incredible innovation across industry." — @Omnifact_AI makers
Do you use Llama? Tell us how by giving it a shout-out on its product hub 🧵 👇 -
AI at Meta reposted
Science Robotics
@SciRobotics
Scientists have developed a framework that enables robots to estimate 3D shapes of unfamiliar everyday objects by combining visual and tactile information. @CMU_Robotics @AIatMeta
Read more in Science #robotics: www.science.org/doi/10.1126/scirobotics.adl0628 -
AI at Meta
@AIatMeta
Whether you're at #emnlp2024 in person or following from your feed, here are 5️⃣ research papers being presented by AI research teams at Meta to add to your reading list.
1️⃣ Distilling System 2 into System 1: go.fb.me/5l9832
2️⃣ Altogether: Image Captioning via Re-aligning Alt-text: go.fb.me/1eanji
3️⃣ Beyond Turn-Based Interfaces: Synchronous LLMs for Full-Duplex Dialogue: go.fb.me/e25irp
4️⃣ Memory-Efficient Fine-Tuning of Transformers via Token Selection: go.fb.me/c67v9h
5️⃣ To the Globe (TTG): Towards Language-Driven Guaranteed Travel Planning: go.fb.me/9cknbp -
AI at Meta
@AIatMeta
Newly published in this issue of Science Robotics today from Meta FAIR: NeuralFeels with neural fields — Visuotactile perception for in-hand manipulation ➡️ go.fb.me/2cv7r6
Science Robotics
@SciRobotics
The November issue of Science #robotics is out!
The cover features a multi-fingered robot that rotates a wooden die to pick up tactile data. A #neuralfield-based framework combines this touch data with camera vision to perceive the shape of the object.
www.science.org/toc/scirobotics/9/96 -
AI at Meta
@AIatMeta
Together w/ @Reskill, we hosted the first Llama Hackathon in India bringing together 270+ developers & 25+ mentors from across industries creating in 75+ projects in just 30h of hacking! See the recap and details on some of the top projects here ➡️ go.fb.me/nmsa9c
AI at Meta
@AIatMeta
Interested in joining the next hackathon? We're kicking off tonight, online and in San Francisco with @lablabai!
lablab.ai
@lablabai
🌉✨ Hello San Francisco!
Just landed in the City by the Bay, and the excitement is through the roof! Tomorrow, the Llama Impact Hackathon kicks off at MindsDB office, and this is set to be the hackathon of the year! 🚀💥
Get ready to witness groundbreaking innovation as brilliant minds come together to create next-gen solutions. This isn’t just any hackathon—it’s where the future is built, and we’re taking you along for the ride! 📸
📲 Stay tuned for exclusive live updates, epic behind-the-scenes moments, and a front-row seat to every high-energy, game-changing moment! Make sure you’re following us for all the action because it’s going to be legendary!
💡 Still haven’t registered? This is your LAST CHANCE! Don’t miss out on making an impact—join us for an unforgettable journey: lu.ma/1mkqg22a
#llama #sanfrancisco #aihackathon #innovation @MetaforDevs @AIatMeta @restackio @togethercompute @pyautogen @Chi_Wang_ @qingyun_wu @SnowflakeDB @llama_index @thealliance_ai -
AI at Meta
@AIatMeta
We're at #corl2024 this week in Munich presenting our latest robotics research.
On the ground in in Munich? We're demoing our work on Meta Sparsh & Meta Digit 360 + more at our booth.
Following from your feed? Read more about this work ➡️ go.fb.me/7kcesj -
AI at Meta
@AIatMeta
Join us in San Francisco (or online) this weekend for a Llama Impact Hackathon! Teams will be spending two days building new ideas and solutions with Llama 3.1 + Llama 3.2 vision and on-device models.
Three challenge tracks for this hackathon:
1️⃣ Expanding Low-Resource Languages
2️⃣ Reducing Barriers for Llama Developers
3️⃣ Navigating Public Services
Join us and build for a chance to win awards from a $15K prize pool ⬇️
go.fb.me/vnzbd3 -
AI at Meta
@AIatMeta
Today at Meta FAIR we’re announcing three new cutting-edge developments in robotics and touch perception — and releasing a collection of artifacts to empower the community to build on this work.
Details on all of this new work ➡️ go.fb.me/mmmu9d
1️⃣ Meta Sparsh is the first general-purpose encoder for vision-based tactile sensing that works across many tactile sensors and many tasks. Trained on 460K+ tactile images using self-supervised learning.
2️⃣ Meta Digit 360 is a breakthrough artificial fingertip-based tactile sensor, equipped with 18+ sensing features to deliver detailed touch data with human-level precision and touch-sensing capabilities.
3️⃣ Meta Digit Plexus is a standardized platform for robotic sensor connections and interactions. It provides a hardware-software solution to integrate tactile sensors on a single robot hand and enables seamless data collection, control and analysis over a single cable.
The potential impact of expanding capabilities and components like these for the open source community ranges from medical research to supply chain, manufacturing and much more. We’re excited to continue this work with the broader community.This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
To make these advancements more accessible for different applications, we’re partnering with @GelSight and Wonik Robotics to develop and commercialize these touch-sensing innovations.
We’re excited about how this will enable the community to contribute and drive progress in this space.
AI at Meta
@AIatMeta
Additionally, looking towards the future, we’re releasing PARTNR: a benchmark for Planning And Reasoning Tasks in humaN-Robot collaboration. Built on Habitat 3.0, it’s the largest benchmark of its kind to study and evaluate human-robot collaboration in household activities
By providing a standardized benchmark and dataset we hope to enable new research on robots that can not only operate in isolation, but in collaboration with people.
Details and code ➡️ go.fb.me/59neqh -
AI at Meta reposted
Ahmad Al-Dahle
@Ahmad_Al_Dahle
Great to visit one of our data centers where we're training Llama 4 models on a cluster bigger than 100K H100’s! So proud of the incredible work we’re doing to advance our products, the AI field and the open source community. We’re hiring top researchers to work on reasoning, code generation, and more - come join us!
www.metacareers.com/jobsearch/?teams[0]=Generative+AI -
AI at Meta
@AIatMeta
Since launching in March of last year, @codegptAI has been downloaded over 1.4M times with users in 180+ countries. It's one of the top players in the AI for developers space and Llama models have been a big part of that. go.fb.me/e0m38k
-
AI at Meta
@AIatMeta
We previously shared our research on Layer Skip, an end-to-end solution for accelerating LLMs from researchers at Meta FAIR. It achieves this by executing a subset of an LLM’s layers and utilizing subsequent layers for verification and correction. We’re now releasing inference code and fine-tuned checkpoints for this work.
Model weights on @huggingface ➡️ go.fb.me/6wza9p
More details ➡️ go.fb.me/s8lary
We hope that releasing this work will open up new areas of experimentation and innovative new research in optimization and interpretability. -
AI at Meta
@AIatMeta
New open source release — Meta Open Materials 2024: a new open source model and dataset from Meta FAIR to facilitate inorganic materials discovery.
The Open Materials 2024 models deliver results putting them at the top of the MatBench-Discovery leaderboard. They use the EquiformerV2 architecture and come in three different sizes: 31M, 86M and 153M.
Get the models on @huggingface ➡️ huggingface.co/fairchem/OMAT24
The Open Materials 2024 dataset contains over 100 million Density Functional Theory calculations focused on structural and compositional diversity — making it one of the largest open datasets of its kind to train these types of models.
Get the dataset on Hugging Face ➡️ huggingface.co/fairchem/OMAT24
We’re happy to share this work openly with the community excited for how this work could enable further research breakthroughs in AI-accelerated materials discovery.
AI at Meta
@AIatMeta
More details on all of the new models, datasets and code released by Meta FAIR last week ➡️ ai.meta.com/blog/fair-news-segment-anything-2-1-meta-spir…
-
AI at Meta
@AIatMeta
We want to make it easier for more people to build with Llama — so today we’re releasing new quantized versions of Llama 3.2 1B & 3B that deliver up to 2-4x increases in inference speed and, on average, 56% reduction in model size, and 41% reduction in memory footprint.
Details on our new quantized Llama 3.2 on-device models ➡️
ai.meta.com/blog/meta-llama-quantized-lightweight-models
While quantized models have existed in the community before, these approaches often came at a tradeoff between performance and accuracy. To solve this, we Quantization-Aware Training with LoRA adaptors as opposed to only post-processing. As a result, our new models offer a reduced memory footprint, faster on-device inference, accuracy and portability — while maintaining quality and safety for developers to deploy on resource-constrained devices.
The new models can be downloaded now from Meta and on @huggingface.
AI at Meta
@AIatMeta
We used two different techniques for quantizing these models.
Quantization-Aware Training with LoRA adaptorsprioritizing accuracy.
SpinQuant, a post-training quantization method which prioritizes portability.
Both versions are available for download as part of this release. -
AI at Meta
@AIatMeta
We’re continuing to see exciting results as we work with our Meta Movie Gen models, here are some more examples of what they can do 🧵
Post not available here, view on X
AI at Meta
@AIatMeta
Bust a move!
AI at Meta
@AIatMeta
That’s all for now, but we’re excited to share more. You can see even more breakdowns and examples of what Meta Movie Gen can do in the full research paper ➡️ ai.meta.com/research/publications/movie-gen-a-cast-of-med…
-
AI at Meta reposted
Han Fang
@Han_Fang_
Excited to share a new benchmark from our team- this eval set, *Multi-IF*, enables benchmarking LLMs for Multi-Turn and Multilingual Instructions Following, which is something that the LLM community been waiting for.
Link to paper: arxiv.org/abs/2410.15553 -
AI at Meta
@AIatMeta
We recently released Meta Lingua, a lightweight and self-contained codebase designed to train language models at scale. Lingua is designed for research and uses easy-to-modify @PyTorch components in order to try new architectures, losses, data and more.
AI at Meta
@AIatMeta
The code is openly available under BSD-3 in the Meta Lingua repo on GitHub ⬇️
go.fb.me/mkmtcz -
AI at Meta
@AIatMeta
🆕 New video – Knowledge Distillation with Llama 3.1 405B. In this extended discussion, @nazeri2010 & @subramen delve into the importance of fine-tuning — and how Llama 405B can be used to generate synthetic data. Full video on YouTube ➡️ youtu.be/kxx6TfpAkEU
-
AI at Meta reposted
Cerebral Valley
@cerebral_valley
Come work on codegen problems with @FactoryAI and @AIatMeta this weekend!
Coding is required (AI or not). Looking forward to seeing your solutions 🤖
H100s being provisioned by @nebiusai
w/ @convex @LambdaAPI @brave in partnership with @TEDAI2024! link below 👇 -
AI at Meta
@AIatMeta
Today we released Meta Spirit LM — our first open source multimodal language model that freely mixes text and speech.
Many existing AI voice experiences today use ASR to techniques to process speech before synthesizing with an LLM to generate text — but these approaches compromise the expressive aspects of speech. Using phonetic, pitch and tone tokens, Spirit LM models can overcome these limitations for both inputs and outputs to generate more natural sounding speech while also learning new tasks across ASR, TTS and speech classification.
We hope that sharing this work will enable the research community to further new approaches for text and speech integration.
AI at Meta
@AIatMeta
More details, including links to the research paper, model weights and code 👇
go.fb.me/luyk0t -
AI at Meta
@AIatMeta
Open science is how we continue to push technology forward and today at Meta FAIR we’re sharing eight new AI research artifacts including new models, datasets and code to inspire innovation in the community. More in the video from @jpineau1.
This work is another important step towards our goal of achieving Advanced Machine Intelligence (AMI).
What we’re releasing:
• Meta Spirit LM: An open source language model for seamless speech and text integration.
• Meta Segment Anything Model 2.1: An updated checkpoint with improved results on visually similar objects, small objects and occlusion handling. Plus a new developer suite to make it easier for developers to build with SAM 2.
• Layer Skip: Inference code and fine-tuned checkpoints demonstrating a new method for enhancing LLM performance.
• SALSA: New code to enable researchers to benchmark AI-based attacks in support of validating security for post-quantum cryptography.
• Meta Lingua: A lightweight and self-contained codebase designed to train language models at scale.
• Meta Open Materials: New open source models and the largest dataset of its kind to accelerate AI-driven discovery of new inorganic materials.
• MEXMA: A new research paper and code for our novel pre-trained cross-lingual sentence encoder with coverage across 80 languages.
• Self-Taught Evaluator: a new method for generating synthetic preference data to train reward models without relying on human annotations.
Access to state-of-the-art AI creates opportunities for everyone. We’re excited to share this work and look forward to seeing the community innovation that results from it.
Details and access to everything released by FAIR today ➡️ go.fb.me/hgtkelThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
As detailed in the Meta Movie Gen technical report, today we’re open sourcing Movie Gen Bench: two new media generation benchmarks that we hope will help to enable the AI research community to progress work on more capable audio and video generation models.
Movie Gen Video Bench is the largest and most comprehensive benchmark ever released for evaluating text-to-video generation. It includes a collection of 1,000+ prompts that cover concepts ranging from detailed human activity to animals, physics, unusual subjects and more — with broad coverage across different motion levels.
Movie Gen Audio Bench is a first-of-its-kind benchmark aimed at evaluating video-to-audio and (text+video)-to-audio generation. It includes 527 generated videos and associated sound effects and music prompts covering a diverse set of ambient environments and sound effects.
To enable fair and easy comparison to our models for future works, these new benchmarks include non cherry-picked generated videos and audio from Movie Gen. In releasing these new benchmarks we hope to promote fair & extensive evaluations in media generation research to enable greater progress in this field.
AI at Meta
@AIatMeta
More details in the Movie Gen Bench repo ⬇️
go.fb.me/cppbmy -
AI at Meta
@AIatMeta
Today, we’re sharing initial results from our work with @Blumhouse and select creators as we continue to develop our Meta Movie Gen models.
We’re excited to expand this pilot program in collaboration with the creative industry in 2025 ➡️ go.fb.me/0qzo8m
Jason Blum
@jason_blum
We worked with a few filmmakers - including @aneeshchaganty -and had them test out @meta AI tool Meta Movie Gen. check out what aneesh put together in: i h8 ai
youtu.be/4iIQHZ19El4 -
AI at Meta
@AIatMeta
Openly sharing research creates a lasting effect. We're proud of the impact this work had across the industry last year — and the impact it continues to have today.
Yann LeCun
@ylecun
The three most cited papers in 2023?
Llama, Llama2, Segment Anything Model.
All from @AIatMeta. -
AI at Meta
@AIatMeta
New AI research from Meta – CoTracker3 Simpler and Better Point Tracking by Pseudo-Labelling Real Videos.
More details ➡️ go.fb.me/xiyc63
Demo on @huggingface ➡️ go.fb.me/yzuqd0
Building on our previous work on CoTracker, this new model demonstrates impressive tracking results where points can be tracked for a long time even when they're occluded or leave the field of view. CoTracker3 achieves state-of-the-art, outperforming all recent point tracking approaches on standard benchmarks — often by a substantial margin.
We've released the research paper, code and a demo on Hugging Face — along with models available under an A-NC license to support further research in this space. -
AI at Meta
@AIatMeta
Announced today — Lenovo AI Now is a new on-device AI agent, built with Llama 3.1 to enable capabilities ranging from document management and summarization, to device control and content generation.
Exciting to see this kind of AI innovation from the team at @Lenovo. 🦙
Daryl Cromer
@DarylCromer
The advances we demo at #lenovotechworld aren’t just technical feats. They represent a strategic vision for the future of computing.
This year, we showed off a world where AI is personalized, productive, protected, and for all. lnv.gy/3Nu5S2A -
AI at Meta reposted
Jason Weston
@jaseweston
Today we are releasing code, models & data from the Self-Taught Evaluator paper, a method to train LLM judges with synthetic preference data.
Better model trained with DPO: huggingface.co/facebook/Self-taught-evaluator-llama3.1-70B
Synthetic preference data: huggingface.co/datasets/facebook/Self-taught-evaluator-DP…
Code for training and inference: github.com/facebookresearch/RAM/tree/main/projects/self_t…
Since we released the paper detailing the method to generate synthetic data, the community has also used this approach to build improved RMs (huggingface.co/Skywork/Skywork-Critic-Llama-3.1-8B).
Our DPO model is a strong LLM judge on RewardBench, despite not using any human annotation in training data creation. We are releasing the training data, training and evaluation code to reproduce our results.
The model is also available as an evaluator on the AlpacaEval leaderboard, as one of the top-ranked evaluators in terms of human agreement rate: github.com/tatsu-lab/alpaca_eval/blob/main/src/alpaca_eva…
You can also read the original paper here: arxiv.org/abs/2408.02666 -
AI at Meta
@AIatMeta
📣 New course now available on @DeepLearningAI: Introducing Multimodal Llama 3.2! The course covers both Llama 3.1 & Llama 3.2 and includes detailed rundowns on multimodal prompting, custom tool calling, Llama Stack + more.
Take the 1h course for free ⬇️
www.deeplearning.ai/short-courses/introducing-multimodal-… -
AI at Meta
@AIatMeta
Training Llama 3.1 on clinician-created synthetic data, using prompt engineering techniques and RAG; Neuromnia developed Nia: a human-centric AI co-pilot to support work on some of the most pressing challenges for autism care ➡️ go.fb.me/ow8n1d
-
AI at Meta reposted
Alex Reibman 🖇️
@AlexReibman
Meta invited 13 AI startups using Llama3 to Singapore to show how open source AI can change the world
They put $125,000 on the line.
Here’s what we saw from the @cerebral_valley x @AIatMeta Llama Impact Grant Finalists in Singapore (🧵): -
AI at Meta reposted
Ahmad Al-Dahle
@Ahmad_Al_Dahle
Excited to expand access to Meta AI with our roll-out in 21 new countries globally, starting today with the UK, Brazil as well as new countries in Latin America and Asia. Bringing Meta AI to more of our users around the world is one of our top priorities and I'm excited for our users in these new markets
-
AI at Meta
@AIatMeta
As part of Meta Movie Gen, we trained a 13B parameter audio generation model that can take a video + optional text prompts to generate high quality audio — including ambient sound, foley & instrumental background music — all synced to the video. Details ➡️ go.fb.me/vgkswc
-
AI at Meta reposted
Daniel DeTone
@ddetone
Interested in 3D object detection and egocentric vision? We open sourced a small yet challenging dataset called Aria Everyday Objects (AEO). We use it as one of the tasks for benchmarking a new class of Egocentric 3D Foundation Models we are working on: arxiv.org/abs/2406.10224
-
AI at Meta
@AIatMeta
More examples of what Meta Movie Gen can do across video generation, precise video editing, personalized video generation and audio generation.
This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
We’ve shared more details on the models and Movie Gen capabilities in a new blog post ➡️ go.fb.me/4b6eii
-
AI at Meta
@AIatMeta
🎥 Today we’re premiering Meta Movie Gen: the most advanced media foundation models to-date.
Developed by AI research teams at Meta, Movie Gen delivers state-of-the-art results across a range of capabilities. We’re excited for the potential of this line of research to usher in entirely new possibilities for casual creators and creative professionals alike.
More details and examples of what Movie Gen can do ➡️ go.fb.me/kx1nqm
🛠️ Movie Gen models and capabilities
Movie Gen Video: 30B parameter transformer model that can generate high-quality and high-definition images and videos from a single text prompt.
Movie Gen Audio: A 13B parameter transformer model that can take a video input along with optional text prompts for controllability to generate high-fidelity audio synced to the video. It can generate ambient sound, instrumental background music and foley sound — delivering state-of-the-art results in audio quality, video-to-audio alignment and text-to-audio alignment.
Precise video editing: Using a generated or existing video and accompanying text instructions as an input it can perform localized edits such as adding, removing or replacing elements — or global changes like background or style changes.
Personalized videos: Using an image of a person and a text prompt, the model can generate a video with state-of-the-art results on character preservation and natural movement in video.
We’re continuing to work closely with creative professionals from across the field to integrate their feedback as we work towards a potential release. We look forward to sharing more on this work and the creative possibilities it will enable in the future.This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
As part of our continued belief in open science and progressing the state-of-the-art in media generation, we’ve published more details on Movie Gen in a new research paper for the academic community ➡️ go.fb.me/toz71j
-
AI at Meta
@AIatMeta
Following #eccv2024 from your feed? Here are 7️⃣ examples of interesting research work being presented by teams working on AI across Meta 🧵
Post not available here, view on X
AI at Meta
@AIatMeta
3️⃣ uCAP: An Unsupervised Prompting Method for Vision-Language Models: go.fb.me/wj2ja4
AI at Meta
@AIatMeta
4️⃣ Sapiens: Foundation for Human Vision Models: go.fb.me/5uksso
This media couldn't be displayed. See it on the original post.Post not available here, view on X
AI at Meta
@AIatMeta
6️⃣ ADen: Adaptive Density Representations for Sparse-view Camera Pose Estimation: go.fb.me/9brdhb
AI at Meta
@AIatMeta
7️⃣ Rasterized Edge Gradients: Handling Discontinuities Differentially: go.fb.me/kz2d83
-
AI at Meta
@AIatMeta
📣 New paper from GenAI and Meta FAIR. CGPO uses Mixture of Judges and consistently outperforms SOTA RLHF approaches across various tasks. More details and key results in the full thread 🧵
Han Fang
@Han_Fang_
A new RLHF paper from our team- The Perfect Blend: Redefining RLHF with Mixture of Judges arxiv.org/abs/2409.20370
-
AI at Meta
@AIatMeta
We’re excited to share the first official distribution of Llama Stack! It packages multiple API Providers into a single endpoint for developers to enable a simple, consistent experience to work with Llama models across a range of deployments.
Details ➡️ go.fb.me/xfi7g3 -
AI at Meta
@AIatMeta
1yr ago we began seeking proposals from around the world to use open source AI to address global challenges. Now, we're excited to announce the recipients of our first grants ranging from education projects in India to healthcare in Sub-Saharan Africa ➡️ go.fb.me/pd36be
-
AI at Meta
@AIatMeta
We’re on the ground at #eccv2024 in Milan this week to showcase some of our latest research, new research artifacts and more. Here are 4️⃣ things you won’t want to miss from Meta FAIR, GenAI and Reality Labs Research this week whether you’re here in person or following from your feed.
1️⃣ We’re releasing SAM 2.1 an upgraded version of the Segment Anything Model 2 — and the SAM 2 Developer Suite featuring open source tools for training, inference and demos. New artifacts are live in the repo on GitHub ➡️ go.fb.me/mk6ofh
2️⃣ We’re supporting 10+ presentations and workshops in areas like computer vision for smart glasses and the metaverse, 3D vision for eCommerce, egocentric research with Project Aria and more.
3️⃣ We’re presenting seven orals at ECCV — in addition to the 50+ publications from researchers at Meta that were accepted for this year’s conference. Look out for more details on some of these papers later this week.
4️⃣ Demos and discussions with Meta researchers at our booth all week — come by our booth to discuss projects like SAM 2, Ego-Exo4D, DINOv2 and more. -
AI at Meta
@AIatMeta
Llama 3.2 features 11B & 90B models, our first multimodal Llama models with support for vision tasks. These models can take in both image and text prompts to deeply understand and reason on inputs.
AI at Meta
@AIatMeta
Details on Llama 3.2 11B & 90B vision models — and the full collection of new Llama models ⬇️
AI at Meta
@AIatMeta
📣 Introducing Llama 3.2: Lightweight models for edge devices, vision models and more!
What’s new?
• Llama 3.2 1B & 3B models deliver state-of-the-art capabilities for their class for several on-device use cases — with support for @Arm, @MediaTek & @Qualcomm on day one.
• Llama 3.2 11B & 90B vision models deliver performance competitive with leading closed models — and can be used as drop-in replacements for Llama 3.1 8B & 70B.
• New Llama Guard models to support multimodal use cases and edge deployments.
• The first official distro of Llama Stack simplifies and supercharges the way developers & enterprises can build around Llama to support agentic applications and more.
Details in the full announcement ➡️ go.fb.me/229ug4
Download Llama 3.2 models ➡️ go.fb.me/w63yfd
These models are available to download now directly from Meta and @HuggingFace — and will be available across offerings from 25+ partners that are rolling out starting today, including @accenture, @awscloud, @AMD, @azure, @Databricks, @Dell, @Deloitte, @FireworksAI_HQ, @GoogleCloud, @GroqInc, @IBMwatsonx, @Infosys, @Intel, @kaggle, @NVIDIA, @OracleCloud, @PwC, @scale_AI, @snowflakeDB, @togethercompute and more.
With Llama 3.2 we’re making it possible to run Llama in even more places, with even more flexible capabilities. We’ve said it before and we’ll say it again: open source AI is how we ensure that these innovations reflect the global community they’re built for and benefit everyone. We’re continuing our drive to make open source the standard with Llama 3.2. -
AI at Meta
@AIatMeta
Developer are already doing impressive things using Llama 3.2, like this project that uses our new vision models to go from 🖼️ -> 📱.
Eric Ciarla (hiring)
@ericciarla
napkins.dev turns screenshots into React + Tailwind design code using Llama 3.2 vision 👀
I built a supercharged version that uses @firecrawl to fetch screenshots from any website.
Such a cool project by @nutlope and @togethercompute! -
AI at Meta
@AIatMeta
Ready to start working with our new lightweight and multimodal Llama 3.2 models? Here are a few new resources from Meta to help you get started. 🧵
Post not available here, view on X
AI at Meta
@AIatMeta
To support the new capabilities of Llama 3.2, we released new Llama Guard 3 1B and 11B vision models to support safety & responsibility in lighter edge deployments and multimodal use cases.
Llama Trust & Safety ➡️ go.fb.me/mt0kbl
AI at Meta
@AIatMeta
The first Llama Stack distro release packages multiple API Providers that work well together to provide a single endpoint for developers. This enables a simple, consistent experience to work with Llama models on-prem, cloud, single-node and on-device ⬇️
go.fb.me/ci7y5w -
AI at Meta reposted
NVIDIA AI Developer
@NVIDIAAIDev
🙌 In collaboration with @AIatMeta, we are optimizing the🦙Llama 3.2 collection of open models with NVIDIA NIM microservices to accelerate flexible #ai experiences -- delivering high throughput and low latency across millions of GPUs worldwide -- from workstation computing, to data center, to the edge.
⚡Read more in our technical blog➡️ nvda.ws/3N07n8E ✨ -
AI at Meta reposted
Ahmad Al-Dahle
@Ahmad_Al_Dahle
Our Llama Stack Distribution is a huge step forward in how we support developers with a single endpoint. We are now sharing with the community a simplified and consistent experience that will enable them to work with Llama models in multiple environments, including on-prem, cloud, single-node, and on-device
-
AI at Meta
@AIatMeta
With Llama 3.2 we released our first-ever lightweight Llama models: 1B & 3B. These models empower developers to build personalized, on-device agentic applications with capabilities like summarization, tool use and RAG where data never leaves the device.
AI at Meta
@AIatMeta
More details, reference applications and model downloads ➡️ go.fb.me/ve6w1n
-
AI at Meta
@AIatMeta
A few technical insights on the new Llama vision models we’re releasing today 🦙🧵
Post not available here, view on X
AI at Meta
@AIatMeta
Evaluating performance on extensive human evaluations and benchmarks, results suggest that Llama 3.2 vision models are competitive with leading closed models on image recognition + a range of visual understanding tasks.
AI at Meta
@AIatMeta
This is just a small slice of what’s new with our Llama vision models. You can find more details in the full model card published on GitHub ⬇️
go.fb.me/v4tyja -
AI at Meta reposted
Ahmad Al-Dahle
@Ahmad_Al_Dahle
📣 You can now have a conversation with Meta AI using voice. It’s super fast, connected to the web, natural and conversational and even comes with celebrity voice options from Awkwafina, Kristen Bell, John Cena, and more. What voice speaks to you? (pun intended 😆)
This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
A few technical insights on our lightweight Llama 3.2 1B & 3B models. 🦙🧵
AI at Meta
@AIatMeta
Even With their lightweight size, Llama 1B & 3B have a range of capabilities and were built to run on mobile devices & lightweight edge deployments. They empower developers to build personalized & private, on-device agentic applications.
AI at Meta
@AIatMeta
These lightweight Llama models were pretrained on up to 9 trillion tokens. One of the keys for Llama 1B & 3B however was using pruning & distillation to build smaller and more performant models informed by powerful teacher models.
Pruning enabled us to reduce the size of extant Llama models while recovering as much knowledge and performance as possible.
Knowledge distillation uses a larger network to impart knowledge on a smaller network.
AI at Meta
@AIatMeta
The lightweight Llama 3.2 models shipping today include support for @Arm, @MediaTek & @Qualcomm to enable the developer community to start building impactful mobile applications from day one.
AI at Meta
@AIatMeta
We’re seeing exciting performance from these new models, with results that outperform Gemma 2 2.6B and Phi 3.5-mini models on a range of tasks even at smaller sizes!
AI at Meta
@AIatMeta
Combined, training these lightweight Llama models required 916K GPU hours on NVIDIA H100-80GB. As part of Meta’s commitment starting in 2020, we’ve maintained net zero greenhouse gas emissions in our global operations and matched 100% of the electricity use from the training operations with renewable energy.
Because we’re releasing these models openly, the training energy use and greenhouse gas emissions will not need to be incurred by others.
AI at Meta
@AIatMeta
It’s still early days for these models and we’re excited for the innovations ahead. The Llama 1B & 3B weights being released today are based on BFloat16 numerics. Our teams are actively exploring quantized variants that will run even faster and we hope to share more on that soon.
-
AI at Meta
@AIatMeta
📣 Introducing Llama 3.2: Lightweight models for edge devices, vision models and more!
What’s new?
• Llama 3.2 1B & 3B models deliver state-of-the-art capabilities for their class for several on-device use cases — with support for @Arm, @MediaTek & @Qualcomm on day one.
• Llama 3.2 11B & 90B vision models deliver performance competitive with leading closed models — and can be used as drop-in replacements for Llama 3.1 8B & 70B.
• New Llama Guard models to support multimodal use cases and edge deployments.
• The first official distro of Llama Stack simplifies and supercharges the way developers & enterprises can build around Llama to support agentic applications and more.
Details in the full announcement ➡️ go.fb.me/229ug4
Download Llama 3.2 models ➡️ go.fb.me/w63yfd
These models are available to download now directly from Meta and @HuggingFace — and will be available across offerings from 25+ partners that are rolling out starting today, including @accenture, @awscloud, @AMD, @azure, @Databricks, @Dell, @Deloitte, @FireworksAI_HQ, @GoogleCloud, @GroqInc, @IBMwatsonx, @Infosys, @Intel, @kaggle, @NVIDIA, @OracleCloud, @PwC, @scale_AI, @snowflakeDB, @togethercompute and more.
With Llama 3.2 we’re making it possible to run Llama in even more places, with even more flexible capabilities. We’ve said it before and we’ll say it again: open source AI is how we ensure that these innovations reflect the global community they’re built for and benefit everyone. We’re continuing our drive to make open source the standard with Llama 3.2. -
AI at Meta reposted
Juan Pino
@juanmiguelpino
FAIR is hiring Research Interns early this year! Feel free to apply here: www.metacareers.com/jobs/1199049864714465/
-
AI at Meta
@AIatMeta
New research from Meta FAIR: MoMa — Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts ➡️ go.fb.me/kz3b0c
This paper introduces modality-aware sparse architectures for early fusion, mixed-modality foundation models and opens up several promising directions for future research. -
AI at Meta
@AIatMeta
Fragmented regulation means the EU risks missing out on the rapid innovation happening in open source and multimodal AI. We're joining representatives from 25+ European companies, researchers and developers in calling for regulatory certainty ➡️ euneedsai.com
-
AI at Meta
@AIatMeta
With the release of Llama 3.1 405B, @TogetherCompute built LlamaCoder — an open source web app that can generate an entire app from a prompt. The repo has now been cloned by hundreds of devs on GitHub and starred 2K+ times. More on this project ➡️ go.fb.me/p5o0x0
-
AI at Meta
@AIatMeta
We recently shared an update on the growth of the Llama. Tl;dr: downloads are growing fast, our major cloud partners are seeing rapidly increasing usage of Llama on their platforms and we're seeing great adoption across industries! Read the full update ➡️ go.fb.me/d01004
-
AI at Meta reposted
Arena.ai
@arena
Due to strong community interest, we've collaborated with @AIatMeta to compare the bf16 and fp8 versions of Llama-3.1-405b in Chatbot Arena!
With over 5K community votes, both versions show similar performance across the board:
- Overall: 1266 vs 1266
- Hard prompts: 1267 vs 1271
- Instruction following: 1269 vs 1266
In coding/longer queries, bf16 gets slightly higher score, but remains within the confidence intervals.
This is great news for the community: fp8 version could closely match bf16 performance while significantly reducing costs.
Leaderboard link in the below post👇 -
AI at Meta
@AIatMeta
On the latest episode of the Boz To The Future podcast, media artist and director, @RefikAnadol shared how his studio used Llama as part of "Large Nature Model: A Living Archive". Read more on the project and watch the whole conversation ➡️ go.fb.me/pfhg9i
This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
"Exo's use of Llama 405B and consumer-grade devices to run inference at scale on the edge shows that the future of AI is open source and decentralized." - @mo_baioumy
Alex Cheema
@alexocheema
2 MacBooks is all you need.
Llama 3.1 405B running distributed across 2 MacBooks using @exolabs_ home AI cluster -
AI at Meta
@AIatMeta
Join us for 30h of hacking with Llama in Bengaluru! In addition to prizes at the event, top projects will also receive support to submit applications for our 2024 Llama Impact Grants where they will have the chance to win a $500k grant to support their work.
Reskilll
@Reskilll
🚀 The AI Hackathon with @Meta Llama is LIVE! 💡 Join us on 19-20 Oct, to innovate, collaborate, and solve real-world challenges. Whether it's building for Bharat or pushing the edge of AI, this is your moment to shine!
👉 Register now: reskilll.com/hack/aihack
#buildwithllama -
AI at Meta
@AIatMeta
Upeo Labs is aiming to solve local challenges in Kenya using AI. Their Somo-GPT app is designed as a support tool for high school students, teachers and parents — built with Llama 3 & 3.1 ➡️ go.fb.me/ttcljg
-
AI at Meta
@AIatMeta
The ecosystem around Llama is continuing to push the limits. SambaNova Cloud is setting a new bar for inference on 405B and it’s available for developers to start building today.
SambaNova
@SambaNovaAI
📣 Announcing the world’s fastest AI platform
SambaNova Cloud runs Llama 3.1 405B @ 132t/s at full precision
✅ Llama 3.1 405B @ 132 tokens/sec
✅ Llama 3.1 70B @ 570 tokens/sec
✅ 10X Faster Inference than GPUs
Start developing #fastai ➡️ cloud.sambanova.ai
@AIatMeta -
AI at Meta reposted
Joelle Pineau
@joellepineau
I’m excited to share a new AI Coding Competition from Meta and Microsoft Research building on Meta’s annual Hacker Cup! The most capable LLMs to date will be challenged to solve these questions. We invite major players in the code generation space to join.
Soumith Chintala
@soumithchintala
Hacker Cup – one of the preeminent coding competitions started an AI track w/ Meta & Microsoft
problems are hardddd – only a handful of engineers reliably solve them – requires deep algorithmic knowledge, reasoning, planning and fast execution – to solve 5 problems in 30 minutes, multiple times over 5 rounds. As of today, AI fails miserably.
We hope this competition can be a big venue that rallies academic labs, industrial researchers and students to meaningfully advance AI coding capabilities.
Would love to see more major players in the code generation space join the Hacker Cup AI code competition – @openAI, @anthropicAI, @googledeepmind, @cognition_labs @cursor_ai @replit @sourcegraphCody @codeiumdev.
Register for the practice round Starting 20th: www.facebook.com/codingcompetitions/hacker-cup/2024/pract…
The Discord community has grown to >2k folks. Partnering with Autogen, Langchain and SWE-agent – there are multiple starter kits showcasing baseline accuracy of modern models on Hacker Cup problems.
Join the Discord community for further rules and details discord.gg/gSupVz7bMc -
AI at Meta
@AIatMeta
We're at #interspeech2024 — if you're on the ground in Greece this week, stop by our booth to explore SeamlessExpressive, MAGNeT, EMG and more with our research teams!
🔗 Following the conference from your feed? Here are links to 5️⃣ interesting papers we're presenting to add to your reading list.
1️⃣ Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning: go.fb.me/httkop
2️⃣ Navigating the Mine Field of MT Beam Search in Cascaded Streaming Speech Translation: go.fb.me/3v42k5
3️⃣ Configurable Field of View Speech Enhancement with Low Compute and Low Distortion for AR Glasses: go.fb.me/wdb9gt
4️⃣ Towards measuring fairness in speech recognition: go.fb.me/y1k4kw
5️⃣ MSRS: Training Multimodal Speech Recognition Models from Scratch with Sparse Mask Optimization: go.fb.me/0dxi3j -
AI at Meta
@AIatMeta
We're still accepting proposals for our LLM Evaluations Grant until this Friday, September 6th — recipients will get $200K in funding to support this work. More details ➡️ go.fb.me/82ft4d
-
AI at Meta reposted
Ahmad Al-Dahle
@Ahmad_Al_Dahle
On the heels of the update I shared on Llama yesterday, we’re also seeing Meta AI usage growing FAST with 185M weekly actives! 🚀
-
AI at Meta
@AIatMeta
Open source AI is the way forward and today we're sharing a snapshot of how that's going with the adoption and use of Llama models.
Read the full update here ➡️ go.fb.me/e7odag
🦙 A few highlights
• Llama is approaching 350M downloads on @HuggingFace. More than 10x compared to this time last year.
• Llama has been downloaded 20M times in the last month. This makes Llama hands down the leading open source model family.
• Cloud service providers are seeing huge demand for Llama. Token usage across our largest cloud providers has more than doubled since May.
• Llama models are being adopted across the industry. @Accenture, @ATT, @DoorDash, @GoldmanSachs, @Infosys, @KPMG, @NianticLabs, @Nomura, @Shopify, @Spotify and @Zoom are just a handful of strong examples.
Open source AI is how we ensure that the benefits of AI extend to everyone, and Llama is leading the way. -
AI at Meta
@AIatMeta
New research paper from Meta FAIR – Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model.
@violet_zct, @liliyu_lili and team introduce this recipe for training a multi-modal model over discrete and continuous data. Transfusion combines next token prediction with diffusion to train a single transformer over mixed-modality sequences. Our experiments show that Transfusion scales significantly better than traditional approaches and demonstrate that scaling to 7B parameters and 2T multi-modal tokens produces a model that is on par with similar scale language and diffusion models.
Paper ➡️ go.fb.me/4vnybn
AI at Meta
@AIatMeta
More details on this work in this thread from @violet_zct.
Chunting Zhou
@violet_zct
Introducing *Transfusion* - a unified approach for training models that can generate both text and images. arxiv.org/pdf/2408.11039
Transfusion combines language modeling (next token prediction) with diffusion to train a single transformer over mixed-modality sequences. This allows us to leverage the strengths of both approaches in one model. 1/5 -
AI at Meta
@AIatMeta
Announced today, @NVIDIA NIM Agent Blueprints include sample applications, reference code, customization documentation and a Helm chart for deployment — everything enterprises need to build and deploy custom apps using Llama 3.1 405B.
NVIDIA
@nvidia
Announcing NVIDIA NIM Agent Blueprints, reference applications for every enterprise to make their own #ai. They equip developers with apps for building generative AI use cases such as digital humans, PDF data extraction, and virtual screening. nvda.ws/3X2RenB
-
AI at Meta
@AIatMeta
Verified by @ArtificialAnlys, @cerebras Inference is capable of serving Llama 3.1 70B at 450 tokens/sec and Llama 3.1 8B at 1,850 tokens/sec!
Cerebras
@cerebras
Introducing Cerebras Inference
‣ Llama3.1-70B at 450 tokens/s – 20x faster than GPUs
‣ 60c per M tokens – a fifth the price of hyperscalers
‣ Full 16-bit precision for full model accuracy
‣ Generous rate limits for devs
Try now: inference.cerebras.ai
AI at Meta
@AIatMeta
More details in this thread from @ArtificialAnlys.
Artificial Analysis
@ArtificialAnlys
Cerebras has set a new record for AI inference speed, serving Llama 3.1 8B at 1,850 output tokens/s and 70B at 446 output tokens/s.
@cerebras has just launched their API inference offering, powered by their custom wafer-scale AI accelerator chips.
Cerebras Inference is achieving the fastest speeds we have ever benchmarked on Artificial Analysis for Llama 3.1 8B and 70B. Pricing is also competitive at $0.1 per 1M tokens for Llama 3.1 8B and $0.6 per 1M tokens for Llama 3.1 70B. Cerebras is currently serving both models with an 8K context window (compared to the the Llama 3.1 series’ native 128k context).
Cerebras’ Llama 3.1 8B offering is nearly 10x faster than the speeds offered by OpenAI, Google and Anthropic for their current small models - GPT-4o mini, Gemini 1.5 Flash and Claude 3 Haiku.
Cerebras Inference is powered by the Cerebras WSE-3, a custom 5nm AI chip built on a unique wafer-scale design. A single WSE-3 chip is over 50x larger in total area than a Nvidia H100 and hosts 900,000 cores with 44GB of on-chip memory (SRAM).
Faster AI inference enables a new generation of AI applications, from sophisticated agentic workflows to instant search experiences.
See below for further analysis & links to our benchmarking 👇 -
AI at Meta
@AIatMeta
As part of the release of Llama 3.1, we also released new trust & safety research including CyberSecEval 3. We've published our research on this work to continue the conversation on empirically measuring LLM cybersecurity risks & capabilities.
Paper ➡️ go.fb.me/yv32a9 -
AI at Meta
@AIatMeta
Segment Anything Model 2 (SAM 2) is a foundation model from Meta FAIR for promptable visual segmentation in images & videos.
Available now for anyone to build on for free, open source under an Apache license.
Try the demo ➡️ go.fb.me/ve0y8o -
AI at Meta
@AIatMeta
🆕 New course on @DeepLearningAI: Improving Accuracy of LLM Applications ➡️ go.fb.me/zfwvd8
Created in collaboration with DL, Meta & @LaminiAI, this free course covers topics like evaluation frameworks, instruction & memory fine-tuning, LoRA + training data generation. -
AI at Meta
@AIatMeta
"Though Spotify and Meta use AI in different ways, we agree that thoughtful, clear and consistent regulation can foster competition and innovation while also protecting people and giving them access to new technologies that empower them."
The Economist
@TheEconomist
Europe is “particularly well placed” to make the most of a coming wave in open-source AI, argue the tech CEOs. Yet fragmented regulation is “hampering innovation and holding back developers” econ.st/4fWLHHU
Illustration: Sam Kerr -
AI at Meta
@AIatMeta
New research from Meta FAIR: UniBench is a unified implementation of 50+ VLM benchmarks spanning a comprehensive range of carefully categorized capabilities from object recognition to spatial awareness, counting and much more.
Research paper ➡️ go.fb.me/fa97z9
AI at Meta
@AIatMeta
We've published the comprehensive set of tools and scripts for evaluating VLM models and benchmarks in the UniBench repo ⬇️
github.com/facebookresearch/unibench -
AI at Meta reposted
Philipp Schmid
@_philschmid
Meta changed the game with the release of Llama 3.1 405B! Now, you can easily deploy @AIatMeta Llama 3.1 405B on @googlecloud Vertex AI! 🚀 This means you GPT-4 level capabilities running in-house, giving you full control. ✅
TL;DR:
🧠 Meta Llama 3.1 405B offers 128K token context and advanced capabilities
📊 Covers full deployment lifecycle: setup, registration, deployment, and inference
💾 Use of FP8 precision to enable single-node deployment on H100 GPUs
🔓 Learn how to request quota for Google Cloud's A3 High-GPU machines with 8 x H100
🛠️ Deploy step-by-step using Hugging Face's Text Generation Inference (TGI) container
💰 Includes resource management tips to control costs for Vertex AI
Blog: huggingface.co/blog/llama31-on-vertex-ai
Great work by @alvarobartt. Stay tuned; we are working on a similar GKE version! 🤗 -
AI at Meta
@AIatMeta
🆕 Research paper from GenAI at Meta: Imagine yourself: Tuning-Free Personalized Image Generation.
Research paper ➡️ go.fb.me/wre8f0
Want to try it? The feature is available now as a beta in Meta AI for users in the US. -
AI at Meta reposted
Ahmad Al-Dahle
@Ahmad_Al_Dahle
I'm so proud of the unique, technically-driven culture within GenAI that enables my team to drive big ideas that push the state-of-the-art AI forward while also putting them in practice to deliver high-impact products at scale across the company.
How this culture shaped Llama 3.1 at @Meta: www.metacareers.com/life/how-ai-research-and-a-culture-of… -
AI at Meta
@AIatMeta
A closer look at how we're enabling greater developer velocity for machine learning work at Meta.
Engineering at Meta
@Meta_Engineers
How do we keep machine learning engineers moving fast at Meta?
The key lies in minimizing time to first batch (TTFB).
Learn more about AI Lab, our internal framework for testing ML workflows, and how it improves developer velocity across AI.
engineering.fb.com/2024/07/16/developer-tools/ai-lab-secr… -
AI at Meta
@AIatMeta
Using structured weight pruning and knowledge distillation, the @NVIDIAAI research team refined Llama 3.1 8B into a new Llama-3.1-Minitron 4B.
They're releasing the new models on @huggingface and shared a deep dive on how they did it ➡️ go.fb.me/b2h2c8 -
AI at Meta
@AIatMeta
Last call — applications close this Friday ➡️ go.fb.me/cl9rjs
This 4-month AI accelerator is designed for European startups developing advanced AI solutions with open-source foundation models. Our aim is to accelerate the development and market entry of these projects. -
AI at Meta
@AIatMeta
Following #acl2024nlp from your feed? Here are 5️⃣ papers to know about from AI researchers at Meta 🧵⬇️
AI at Meta
@AIatMeta
MuTox: Universal MUltilingual Audio-based TOXicity Dataset and Zero-shot Detector ➡️ go.fb.me/y7vrjg
AI at Meta
@AIatMeta
Are Female Carpenters like Blue Bananas? A Corpus Investigation of Occupation Gender Typicality ➡️ go.fb.me/cdfzig
AI at Meta
@AIatMeta
LM Transparency Tool: Interactive Tool for Analyzing Transformer Language Models ➡️ go.fb.me/5ngnnp
AI at Meta
@AIatMeta
LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding ➡️ go.fb.me/96bbg1
AI at Meta
@AIatMeta
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants ➡️ go.fb.me/irdq2z
-
AI at Meta
@AIatMeta
🦙 New video on our open approach to trust & safety with Llama Guard 3, Prompt Guard & more. This extended discussion dives deep into system-level safety and how developers can build safer experiences from the start.
Watch the full video ➡️ www.youtube.com/watch?v=IvjLXGR7-vM -
AI at Meta
@AIatMeta
LLM Evaluations are an important area of work — today we're announcing a new LLM Evaluation Research Grant to foster further innovation in this area.
Recipients will get $200K in funding to support this work. We're accepting proposals until September 6 ➡️ go.fb.me/eym3xq -
AI at Meta
@AIatMeta
SAM 2 from Meta FAIR is the first unified model for real-time, promptable object segmentation in images & videos. Using the model in our web-based demo you can segment, track and apply effects to objects in video in just a few clicks.
Try SAM 2 ➡️ go.fb.me/7w0i4c -
AI at Meta
@AIatMeta
Miss the conversation between Mark Zuckerberg and Jensen Huang at #siggraph2024? Watch the whole conversation on AI and The Next Computing Platforms ⬇️
www.youtube.com/watch?v=w-cmMcMZoZ4 -
AI at Meta
@AIatMeta
📣 Today we're opening a call for applications for Llama 3.1 Impact Grants!
Until Nov 22, teams can submit proposals for using Llama to address social challenges across their communities for a chance to be awarded a $500K grant.
Details + application ➡️ go.fb.me/smw6xc
AI at Meta
@AIatMeta
The Llama Impact Grant program is growing
This year we're expanding the Llama Impacts Grant program by hosting a series of virtual events and in-person hackathons, workshops and trainings around the world — and providing technical guidance and mentorship to prospective applicants.
These programs will support organizations in Egypt, Hong Kong, India, Indonesia, Japan, the Kingdom of Saudi Arabia, Korea, Latin America, North America, Pakistan, Singapore, Sub-Saharan Africa, Taiwan, Thailand, Turkey, the United Arab Emirates and Vietnam.
Organizations participating in each of these events will be considered for a specialized award of up to $100K in addition to being considered for an open call award of up to $500K.
We hope to see you there!
AI at Meta
@AIatMeta
We’re inspired by the diverse projects we’ve seen developers undertake around the world to positively impact their communities by building with Llama and we're excited to support a new wave of global community impact with the Llama 3.1 Impact Grants.
-
AI at Meta reposted
South Park Commons
@spc
The SPC-@AIatMeta Llamathon kicks off this evening! Teams are competing for over $50k in prizes, judged by @meta's @Ahmad_Al_Dahle, SPC Partner @adityaag, @baseten CEO @tuhinone, and @newcomputer CEO @sjwhitmore.
Final demos are open to the public, join us on Sunday! -
AI at Meta
@AIatMeta
🆕 Try experimental demos featuring our latest AI research!
• Create video cutouts & apply effects in a few clicks.
• Hear what you sound like in another language.
• Bring drawings to life.
• Create a story w/ AI-generated voices & sounds.
AI Demos ➡️ go.fb.me/39k5c0 -
AI at Meta
@AIatMeta
The #algoperf competition was designed to find better training algorithms to speed up neural network training across a diverse set of workloads.
🎉 We’re proud to share that teams from Meta took first place across both external tuning and self-tuning tracks!
MLCommons
@MLCommons
@MLCommons #algoperf results are in! 🏁
$50K prize competition yielded 28% faster neural net training with non-diagonal preconditioning beating Nesterov Adam. New SOTA for hyperparameter-free algorithms too! Full details in our blog. mlcommons.org/2024/08/mlc-algoperf-benchmark-competition/
#aioptimization #ai
AI at Meta
@AIatMeta
More on the Schedule Free approach that won the self-tuning track.
Aaron Defazio
@aaron_defazio
Schedule-Free Wins AlgoPerf Self-Tuning Track 🎉
I'm pleased to announce that Schedule-Free AdamW set a new SOTA for self-tuning training algorithms, besting AdamW and all other submissions by 8% overall.
Try it out: github.com/facebookresearch/schedule_free
MLCommons
@MLCommons
@MLCommons #algoperf results are in! 🏁
$50K prize competition yielded 28% faster neural net training with non-diagonal preconditioning beating Nesterov Adam. New SOTA for hyperparameter-free algorithms too! Full details in our blog. mlcommons.org/2024/08/mlc-algoperf-benchmark-competition/
#aioptimization #ai
AI at Meta
@AIatMeta
More on the Distributed Shampoo approach that won the external tuning track.
AK
@_akhaliq
A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
paper page: huggingface.co/papers/2309.06497
Shampoo is an online and stochastic optimization algorithm belonging to the AdaGrad family of methods for training neural networks. It constructs a block-diagonal preconditioner where each block consists of a coarse Kronecker product approximation to full-matrix AdaGrad for each parameter of the neural network. In this work, we provide a complete description of the algorithm as well as the performance optimizations that our implementation leverages to train deep networks at-scale in PyTorch. Our implementation enables fast multi-GPU distributed data-parallel training by distributing the memory and computation associated with blocks of each parameter via PyTorch's DTensor data structure and performing an AllGather primitive on the computed search directions at each iteration. This major performance enhancement enables us to achieve at most a 10% performance reduction in per-step wall-clock time compared against standard diagonal-scaling-based adaptive gradient methods. We validate our implementation by performing an ablation study on training ImageNet ResNet50, demonstrating Shampoo's superiority over standard training recipes with minimal hyperparameter tuning. -
AI at Meta reposted
Ahmad Al-Dahle
@Ahmad_Al_Dahle
Strong debut for Llama 3.1 405B! Tying for 3rd overall on the @lmsysorg leaderboard today! Tied for first place in English-only evals, coding and a few others 🏆
Wins for 70B & 8B as well, #9 and #29 respectively, both punching well above their weights (pun intended).
Arena.ai
@arena
Exciting news! @metaai's Llama-3.1 results are here🔥
The Llama-3.1 series, extensively tested over the past week, has gathered over 10K community votes.
Now, Llama-3.1-405B has climbed to #3 on the Overall Arena leaderboard, marking the first time an open model has ranked in the top 3!
Huge congrats to @metaai for this incredible launch & milestone in AI! We also thank @anyscalecompute for hosting the Llama-3.1 models for us.
More category breakdown below👇 -
AI at Meta
@AIatMeta
Along with the Meta Segment Anything Model 2 (SAM 2), we also released SA-V: a dataset containing ~51K videos and >600K masklet annotations.
We’re sharing this dataset with the hope that this work will help accelerate new computer vision research ➡️ go.fb.me/0boivt -
AI at Meta
@AIatMeta
Introducing Meta Segment Anything Model 2 (SAM 2) — the first unified model for real-time, promptable object segmentation in images & videos.
SAM 2 is available today under Apache 2.0 so that anyone can use it to build their own experiences
Details ➡️ go.fb.me/p749s5This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
In addition to the new model, we’re also releasing SA-V, a dataset that’s 4.5x larger + has ~53x more annotations than the largest existing video segmentation dataset.
We hope this work will help accelerate new computer vision research ➡️ go.fb.me/yck7bu
AI at Meta
@AIatMeta
Like the original SAM, SAM 2 can be applied out of the box to a diverse range of real-world use cases and we’re excited to see what developers build with it.
Try the demo ➡️ go.fb.me/2z6k3v
Get the code ➡️ go.fb.me/e2f88y -
AI at Meta
@AIatMeta
RT @MetaNewsroom: Time to customize 🎨We’re rolling out AI Studio, a place where creators can make an AI extension of themselves to answer c…
-
AI at Meta reposted
Together AI
@togethercompute
Tutorial: How to do function calling with Llama 3.1!
We'll go over an example of how to do tool calls for Llama 3.1 models (8B, 70B, and 405B).
docs.together.ai/docs/llama-3-function-calling -
AI at Meta reposted
Amazon Web Services
@awscloud
Llama 3.1 models from @AIatMeta—now available on #aws! ☁️
Offered in three sizes, the models are great for a range of use cases from mobile apps to enterprise solutions. Get started with Llama 3.1 models in #amazonbedrock & #amazonsagemaker JumpStart.
🔗 go.aws/3Yl7PFu -
AI at Meta
@AIatMeta
As part of our support of open science, we've published the full Llama 3 research paper covering a range of topics.
• Model training
• Model architecture
• Results of our ongoing work on integrating image/video/speech capabilities
• Much more
Paper ➡️ go.fb.me/l5f55z
AI at Meta
@AIatMeta
We hope that sharing this research will help the larger research community understand the key factors of foundation-model development and contribute to a more informed discussion about the future of foundation models in the general public.
-
AI at Meta
@AIatMeta
Ready to start working with Llama 3.1? Here are a few new resources from the Llama team to help you get started. 🧵
Post not available here, view on X
AI at Meta
@AIatMeta
With Llama 3.1 we’ve also released a new reference system that includes several sample agentic applications to accelerate the responsible development of new and innovative applications
These applications are open source and can be used by the community as a platform to build upon.
Llama agentic system ⬇️
go.fb.me/q0cjcb
AI at Meta
@AIatMeta
Looking ahead we’re aiming to provide developers and platform providers a standard and well-maintained interface to Llama models to improve interoperability. To support this, we’ve released a RFC for something we’re calling “Llama Stack”, a new set of APIs that includes an agentic system and toolchain components.
We’re excited to grow the ecosystem around Llama and lower barriers for new entrants. We look forward to hearing your feedback ⬇️
go.fb.me/kql2gw -
AI at Meta reposted
Andrej Karpathy
@karpathy
Huge congrats to @AIatMeta on the Llama 3.1 release!
Few notes:
Today, with the 405B model release, is the first time that a frontier-capability LLM is available to everyone to work with and build on. The model appears to be GPT-4 / Claude 3.5 Sonnet grade and the weights are open and permissively licensed, including commercial use, synthetic data generation, distillation and finetuning. This is an actual, open, frontier-capability LLM release from Meta. The release includes a lot more, e.g. including a 92-page PDF with a lot of detail about the model:
ai.meta.com/research/publications/the-llama-3-herd-of-mod…
The philosophy underlying this release is in this longread from Zuck, well worth reading as it nicely covers all the major points and arguments in favor of the open AI ecosystem worldview:
"Open Source AI is the Path Forward"
www.facebook.com/4/posts/10115716861061241/?rdid=VE0wPWaJ…
I like to say that it is still very early days, that we are back in the ~1980s of computing all over again, that LLMs are a next major computing paradigm, and Meta is clearly positioning itself to be the open ecosystem leader of it.
- People will prompt and RAG the models.
- People will finetune the models.
- People will distill them into smaller expert models for narrow tasks and applications.
- People will study, benchmark, optimize.
Open ecosystems also self-organize in modular ways into products apps and services, where each party can contribute their own unique expertise. One example from this morning is @GroqInc , who built a new chip that inferences LLMs *really fast*. They've already integrated Llama 3.1 models and appear to be able to inference the 8B model ~instantly:
x.com/karpathy/status/1815809753660154047
And (I can't seem to try it due to server pressure) the 405B running on Groq is probably the highest capability, fastest LLM today (?).
Early model evaluations look good:
ai.meta.com/blog/meta-llama-3-1/ x.com/alexandr_wang/status/1815775286195331411
Pending still is the "vibe check", look out for that on X / r/LocalLlama over the next few days (hours?).
I expect the closed model players (which imo have a role in the ecosystem too) to give chase soon, and I'm looking forward to that.
There's a lot to like on the technical side too, w.r.t. multilingual, context lengths, function calling, multimodal, etc. I'll post about some of the technical notes a bit later, once I make it through all the 92 pages of the paper :)
Alexandr Wang
@alexandr_wang
1/Meta just released Llama3.1 405B!
@scale_AI partnered deeply with @Meta on this release:
🥇 SEAL Evaluations: Based on our evals
🥇 on IF
🥈 on Math
#4 on Coding
💼 Enterprise partnership for custom Llama models
🤖 Data Foundry partnership on RLHF & SFT
👇 -
AI at Meta reposted
Databricks
@databricks
Thrilled to offer the @AIatMeta Llama 3.1 series of models on Databricks! These models expand context length to 128K, add multilingual capabilities + include Llama 3.1 405B — the largest + highest-quality openly available foundation model. dbricks.co/4dcJpC3
-
AI at Meta
@AIatMeta
More technical details on the new Llama 3.1 models we released today. 🦙🧵
Post not available here, view on X
AI at Meta
@AIatMeta
In addition to Llama 3.1 models, we’re also releasing new resources to support trust and safety to enable developers to build responsibly from the start.
Llama Guard 3 brings improved performance and multilingual support.
Prompt Guard is a multi-label model to help developers detect and respond to prompt injection and jailbreak inputs.
CyberSecEval 3 brings new evaluations for social engineering via spear phishing, autonomous offensive cyber operations, and image-based prompt injection.
AI at Meta
@AIatMeta
It’s still early days for Llama and we’re excited to share even more in the months to come. You can find more details on today’s new releases in the updated model card ⬇️
go.fb.me/krbww9 -
AI at Meta reposted
Amazon Web Services
@awscloud
Next-level innovation, delivered with #aws #generativeai. ☁️💡💻
Now on #amazonbedrock, @AIatMeta’s Llama 3.1 models. Ideal for enterprise applications with improved reasoning support in 8 languages & 128K context length.
👉 go.aws/3WyP6F3 -
AI at Meta reposted
NVIDIA AI Developer
@NVIDIAAIDev
👀 @AIatMeta Llama 3.1 405B trained on 16K NVIDIA H100s - inference is #tensorrt #llm optimized⚡
🦙 400 tok/s - per node
🦙 37 tok/s - per user
🦙 1 node inference
➡️ nvda.ws/3LB1iyQ✨ -
AI at Meta
@AIatMeta
Starting today, open source is leading the way. Introducing Llama 3.1: Our most capable models yet.
Today we’re releasing a collection of new Llama 3.1 models including our long awaited 405B. These models deliver improved reasoning capabilities, a larger 128K token context window and improved support for 8 languages among other improvements. Llama 3.1 405B rivals leading closed source models on state-of-the-art capabilities across a range of tasks in general knowledge, steerability, math, tool use and multilingual translation.
The models are available to download now directly from Meta or @huggingface. With today’s release the ecosystem is also ready to go with 25+ partners rolling out our latest models — including @awscloud, @nvidia, @databricks, @groqinc, @dell, @azure and @googlecloud ready on day one.
More details in the full announcement ➡️ go.fb.me/tpuhb6
Download Llama 3.1 models ➡️ go.fb.me/vq04tr
With these releases we’re setting the stage for unprecedented new opportunities and we can’t wait to see the innovation our newest models will unlock across all levels of the AI community.This media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
Training a model as large and capable as Llama 3.1 405B was no simple task. The model was trained on over 15 trillion tokens over the course of several months requiring over 16K @NVIDIA H100 GPUs — making it the first Llama model ever trained at this scale.
We also used the 405B parameter model to improve the post-training quality of our smaller models.Post not available here, view on X
AI at Meta
@AIatMeta
We’ve also updated our license to allow developers to use the outputs from Llama models — including 405B — to improve other models for the first time.
We’re excited about how this will enable new advancements in the field through synthetic data generation and model distillation workflows, capabilities that have never been achieved at this scale in open source.
AI at Meta
@AIatMeta
As Mark Zuckerberg shared in an open letter this morning: we believe that open source will ensure that more people around the world have access to the benefits and opportunities of AI, that power isn't concentrated in the hands of a small few, and that the technology can be deployed more evenly and safely across society.
That’s why we continue to take steps on the path for open source AI to become the industry standard.
Read the letter ⬇️
go.fb.me/ceql4u -
AI at Meta
@AIatMeta
We recently announced JASCO, a music-generation model with improved controllability using conditioning inputs like chords or beat.
We've shared more details on this work in the research paper ➡️ go.fb.me/sou2ox -
AI at Meta reposted
-
AI at Meta reposted
Gavin
@GavinSherry
Significant expansion of the state of the art for open models today as @GroqInc releases 8b and 70b @AIatMeta Llama model fine tunes with open weights. As applications of gen AI become more sophisticated, high performance tool use/function calling is key.
Rick Lamers
@ricklamers
I’ve been leading a secret project for months … and the word is finally out!
🛠️ I'm proud to announce the Llama 3 Groq Tool Use 8B and 70B models 🔥
An open source Tool Use full finetune of Llama 3 that reaches the #1 position on BFCL beating all other models, including proprietary ones like Claude Sonnet 3.5, GPT-4 Turbo, GPT-4o and Gemini 1.5 Pro.
This has been months of hard work from me, my great colleagues at Groq and our awesome collaborators over at Glaive.
The model has been trained on synthetic data only. This is a powerful full finetune, not a LoRA. Yes, we've checked rigorously for overfitting using the LMSYS described robust decontamination techniques, they only score 5.6% on SFT synthetic data and 1.3% on synthetic DPO data.
Now available on the Groq API for blazing fast speeds of 1050 tok/s for 8B and 330 tok/s for the 70B model or download the open source weights from Hugging Face to start exploring & tinkering.
Check out the full blog post for more details, find all links in the reply below. -
AI at Meta
@AIatMeta
Some context on why our smallest Llama 3 model went from 7B → 8B. More details on the changes to the tokenizer in the full conversation with @astongzhangAZ ➡️ youtu.be/Tmdk_H2WDj4
-
AI at Meta
@AIatMeta
Mark your calendar for this discussion on July 29th at SIGGRAPH!
NVIDIA
@nvidia
We’re excited to announce that our CEO Jensen Huang will be joined by @Meta CEO Mark Zuckerberg to discuss how research enables AI breakthroughs at #siggraph2024. Attend the discussion to learn about the intersection of #generativeai and virtual worlds. nvda.ws/3W3nOoI
-
AI at Meta
@AIatMeta
In April we published a paper on a new training approach for better & faster LLMs using multi-token prediction. To enable further exploration by researchers, we’ve released pre-trained models for code completion using this approach on @HuggingFace ⬇️
go.fb.me/dm1giu -
Ahmad Al-Dahle
@Ahmad_Al_Dahle
I am thrilled to welcome @rsalakhu to @AIatMeta as our newest VP of Research in GenAI! I’ve known Russ for a number of years, including our time together at Apple and couldn’t be more excited for what’s ahead as he helps us deliver on some of our big bets for AI agents.
Russ Salakhutdinov
@rsalakhu
I am very excited to start working with GenAI team at @Meta, focusing on multimodal LLM agents, joining together with my amazing CMU colleagues Jing Yu Koh @kohjingyu and Daniel Fried @dan_fried!
AI at Meta
@AIatMeta
Exciting news — welcome to the team, Russ! 🎉
-
AI at Meta
@AIatMeta
📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min.
Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space.
Details in the technical report ➡️ go.fb.me/ry96lnThis media couldn't be displayed. See it on the original post.
AI at Meta
@AIatMeta
We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system.
Meta 3D AssetGen ➡️ go.fb.me/n87zde
Meta 3D TextureGen ➡️ go.fb.me/gngy5i -
AI at Meta
@AIatMeta
New video out today! Understanding the Meta Llama 3 Tokenizer with @astonzhangAZ from the Llama research team. This conversation dives into the change from SentencePiece to Tiktoken and what that enables for our latest models.
Watch the full video ➡️ youtu.be/Tmdk_H2WDj4 -
AI at Meta
@AIatMeta
Today we’re announcing Meta LLM Compiler, a family of models built on Meta Code Llama with additional code optimization and compiler capabilities. These models can emulate the compiler, predict optimal passes for code size, and disassemble code. They can be fine-tuned for new optimizations and compiler tasks.
@HuggingFace repo ➡️ go.fb.me/tdd3dw
Research paper ➡️ go.fb.me/85zwgy
LLM Compiler achieves state-of-the-art results on code size optimization and disassembly. This work shows that AI is learning to optimize code and can assist compiler experts in identifying opportunities to apply optimizations.
We’re releasing LLM Compiler 7B & 13B models under a permissive license for both research and commercial use in the hopes of making it easier for developers and researchers alike to leverage this in their work and carry forward new research in this space. -
AI at Meta
@AIatMeta
📣 We're opening applications for the Meta Llama Impact Innovation Awards, a program to recognize & support organizations using Llama to drive social impact in Africa, the Middle East, Turkey, Asia Pacific & Latin America.
Details & application ➡️ go.fb.me/akx9ik -
AI at Meta
@AIatMeta
Last week we released Meta Chameleon: a new mixed-modal research model from Meta FAIR.
Get the models ➡️ go.fb.me/4m87kk
The 7B & 34B safety tuned models we’ve released can take any combination of text and images as input and produce text outputs using a new early fusion approach. While some LLMs have separate image and text encoders or decoders, Chameleon is one of the first publicly released approaches using a single unified architecture.
We’re releasing Chameleon models under a research license to help democratize access to foundational mixed-modal models & further research on early fusion.
Approach & training details in the paper ➡️ go.fb.me/u75dq8 -
AI at Meta
@AIatMeta
📣 Just announced in Paris: Together with @HuggingFace & @Scaleway, we're launching a new accelerator for AI startups in Europe based at @JoinStationF!
Startups can apply until August 16 ⬇️
Ahmad Al-Dahle
@Ahmad_Al_Dahle
We just announced a new AI accelerator with @HuggingFace & @Scaleway to support European startups. Enabling more innovation with open technologies is what moves our industry forward and I'm excited to see what these startups build with open source models.
Apply here: europeanaistartupprogram.splashthat.com -
AI at Meta
@AIatMeta
Following #cvpr2024 from your feed this week? Here are 6️⃣ papers to know about from AI researchers at Meta ⬇️
AI at Meta
@AIatMeta
Relightable Gaussian Codec Avatars ➡️ go.fb.me/gdtkjm
This work presents Relightable Gaussian Codec Avatars, a method to build high-fidelity relightable head avatars that can be animated to generate novel expressions.
AI at Meta
@AIatMeta
URHand: Universal Relightable Hands ➡️ go.fb.me/1lmv7o
A high-fidelity Universal prior for Relightable Hands built upon light-stage data. It generalizes to novel viewpoints, poses, identities, and illuminations, which enables quick personalization from a phone scan.
AI at Meta
@AIatMeta
RoHM: Robust Human Motion Reconstruction via Diffusion ➡️ go.fb.me/ogm92y
An approach for robust 3D human motion reconstruction from monocular RGB(-D) videos in the presence of noise and occlusions
AI at Meta
@AIatMeta
PlatoNeRF: Discerning Reality in Plato's Cave from Single-View Two Bounce Time of Flight ➡️ go.fb.me/tju5fo
A method to recover scene geometry from a single view using two-bounce signals captured by a single-photon lidar.
AI at Meta
@AIatMeta
HybridNeRF: Efficient Neural Rendering via Adaptive Volumetric Surfaces ➡️ go.fb.me/tzik3j
A method that combines strengths of both surface & volume representations to improve view synthesis quality while reducing rendering time.
AI at Meta
@AIatMeta
Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wild ➡️ go.fb.me/0wcu84
Both the world's largest dataset of human motion in the wild, and the largest dataset of motion-language descriptions. -
AI at Meta
@AIatMeta
With the release of Llama 2, the Meta Llama team developed a training technique called Ghost Attention (GAtt) which uses RLHF to fine-tune model responses keeping the initial instructions in mind — resulting in in AI models that are much better at retaining initial instructions in multi-turn conversations.
This approach caught the eye of SAIF CHECK's team who went on to build a model evaluation system using Meta Llama 3 to help companies stay aware of potential risks and compliance with local laws in the markets where their technology is used. More on how they implemented this ➡️ go.fb.me/05xhsw -
AI at Meta
@AIatMeta
As part of our releases this week, Meta FAIR introduced JASCO. This model differs from other text-to-music approaches with improved controllability using conditioning inputs like chords or beat.
Details and samples ➡️ go.fb.me/tkp5fz -
AI at Meta reposted
Edward Miller
@TweetEdMiller
Introducing, HOT3D.
HOT3D is a new dataset from our team at Meta Reality Labs Research, to explore vision-based methods for hand-object interaction.
www.projectaria.com/datasets/hot3d/
1/ -
AI at Meta
@AIatMeta
Today is a good day for open science.
As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and help advance AI in a responsible way. More in the video from @jpineau1.
What we’re releasing:
🦎 Meta Chameleon
7B & 34B language models that support mixed-modal input and text-only outputs.
🪙 Meta Multi-Token Prediction
Pretrained Language Models for code completion using Multi-Token Prediction.
🎼 Meta JASCO
Generative text-to-music models capable of accepting various conditioning inputs for greater controllability. Paper available today with a pretrained model coming soon.
🗣️ Meta AudioSeal
An audio watermarking model that we believe is the first designed specifically for the localized detection of AI-generated speech, available under a commercial license.
📝 Additional RAI artifacts
Including research, data and code to measure and improve the representation of geographical and cultural preferences and diversity in AI systems.
We believe that access to state-of-the-art AI creates opportunities for everyone – not just a small handful of Big Tech companies. We’re excited to share this work and to see how the community learns, iterates and builds using this technology.
Details and access to everything released by FAIR today ➡️ go.fb.me/tzzvfgThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Are you building something cool with Meta Llama models? Already launched something that's having an impact in your community? We'd love to hear about it!
Share your Llama story ➡️ go.fb.me/umvtvc -
AI at Meta
@AIatMeta
Together with @cerebral_valley, we hosted the first-ever Meta Llama 3 Hackathon. This hackathon brought together 350+ attendees and saw 50+ projects built in 24h. See the recap and details on the top projects here ➡️ go.fb.me/o5yw4u
This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
LangChain
@LangChain
Recipes for open source / local agents w/ Llama 3
Since the release of Llama 3, we've seen high interest in building agents that run reliably and / or locally (e.g., on your laptop). We've partnered with @meta to release several new recipes for Llama 3 agents using LangGraph.
1/ We show how to build LangGraph tool-calling agents, using @groq, which supports fast inference and tool-calling.
2/ We show how to RAG agents using LangGraph and @groq, capable of complex self-corrective control flow.
3/ We show how to take the RAG agent and make it run locally using @nomic_ai embeddsm, and @ollama.
➡️ Code:
github.com/meta-llama/llama-recipes/tree/main/recipes/use…
📽️ Video:
www.youtube.com/watch?v=j2OAeeujQ9M -
AI at Meta
@AIatMeta
Built with Meta Llama, FoondaMate is a fast-growing, always-on study aid for students. The flexibility & open ecosystem around Llama is helping the team create a greater impact for the 3 million students already using the tool in emerging markets today ➡️ go.fb.me/i32auy
This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Newly published today in @Nature: No Language Left Behind (NLLB) is an AI model created by researchers at Meta capable of delivering high-quality translations directly between 200 languages – including low-resource languages.
Read more in Nature ⬇️
go.fb.me/7j8o4p -
AI at Meta
@AIatMeta
Now available as an @NVIDIAAI NIM inference microservice, Meta Llama 3 is equipping healthcare developers, researchers and companies to innovate responsibly across a wide variety of applications.
NVIDIA Healthcare
@NVIDIAHealth
Harness the power of Meta Llama 3 NIM for your #healthcare solutions! Optimized by NVIDIA, it’s changing lives one application at a time. #digitalhealth #generativeai
nvda.ws/4aMrpwA -
AI at Meta
@AIatMeta
Want more in-depth information on Meta Llama 3? We've shared additional details in the model card ➡️ go.fb.me/s4k825
We also plan to publish a detailed research paper in the coming months. -
AI at Meta
@AIatMeta
📝 New from FAIR: An Introduction to Vision-Language Modeling.
Vision-language models (VLMs) are an area of research that holds a lot of potential to change our interactions with technology, however there are many challenges in building these types of models. Together with a set of collaborators across academia, we’re releasing ‘An Introduction to Vision-Language Modeling’ — we hope that this new resource will help anyone who would like to enter this field to better understand the mechanics behind mapping vision to language.
Full paper ➡️ go.fb.me/ncjj6t
This guide covers how VLMs work, how to train them and approaches to evaluation — and while it primarily covers mapping image to language, it also discusses how to extend VLMs to videos.
We hope that releasing this guide will inspire and enable more work in this space. -
AI at Meta
@AIatMeta
🆕 Want to start building with Meta Llama models? We just published a series of step-by-step tutorials to help you get started with Llama 3 on Linux, Windows, Mac and more.
Watch the videos on YouTube ➡️ go.fb.me/fiq831 -
AI at Meta
@AIatMeta
The @NianticLabs team is using Meta Llama to generate reactions in real time in Peridot, transforming their adorable creatures into responsive AR pets that exhibit smart behaviors and the unpredictable nature of real animals.
How Niantic is using Llama ➡️ go.fb.me/21k8n0 -
AI at Meta
@AIatMeta
6️⃣ days to go — We’ve already seen 2.3k+ submissions for the Meta Comprehensive RAG Benchmark Challenge, get your submission in before the deadline this week!
Reality Labs at Meta
@RealityLabs
Join forces to help reduce LLM hallucinations! Enter the @Meta Comprehensive RAG (CRAG) Challenge in KDD Cup 2024 🚀 It’s time to improve LLMs with real-time & accurate information using RAG. www.aicrowd.com/challenges/meta-comprehensive-rag-benchma…
-
AI at Meta
@AIatMeta
Newly published work from FAIR, Chameleon: Mixed-Modal Early-Fusion Foundation Models.
This research presents a family of early-fusion token-based mixed-modal models capable of understanding & generating images & text in any arbitrary sequence.
Paper ➡️ go.fb.me/7rb19n -
AI at Meta
@AIatMeta
More details on our recent multi-token prediction research. ⬇️
Badr Youbi Idrissi
@byoubii
What happens if we make language models predict several tokens ahead instead of only the next one? In this paper, we show that multi-token prediction boosts language model training efficiency. 🧵 1/11
Paper: arxiv.org/abs/2404.19737
Joint work with @FabianGloeckle -
AI at Meta
@AIatMeta
We were blown away by the creativity, talent and dedication of the 350+ hackers who joined us in San Francisco for two days of building with Meta Llama 3 in our hackathon with @cerebral_valley.
Details on our winners and a few highlights 🧵Post not available here, view on X
AI at Meta
@AIatMeta
Congratulations to our winning teams!
🥇 Open Glass AI: Open source smart glasses built with $20 of parts.
🥈 Deb8: An AI agent debate arena.
🥉 Team AAA: Discovery of new jailbreaking methods for Llama 3.
See these and more in the gallery of projects ➡️ go.fb.me/maxd1m
AI at Meta
@AIatMeta
It's hard to believe these new models were released less than one month ago. It's still early days and we can't wait to see how the community will continue to build in new ways with Llama 3!
-
AI at Meta
@AIatMeta
🏆 Congratulations to first place from the #llama3hackathon this weekend: Open Glass AI!
More details and open source code ➡️ openglass.ai
It’s inspiring to see such innovative work from the open source community, built with Meta Llama 3!
Nik Shevchenko
@kodjima33
You can now turn any glasses into AI smart glasses for just $20
At today's hackathon we built Open Glass AI
It will then record your life and remember people names, count calories, live translate, and much more
Ant it's fully open source. Link 👇
AI at Meta
@AIatMeta
Amazing work across the board from everyone at #llama3hackathon this weekend!
Whether you joined us this weekend or not, we’d love to see what you’re building with Llama 3 in the replies! ⬇️ -
AI at Meta
@AIatMeta
No better way to kick off the weekend than building with this incredible community!
Cerebral Valley
@cerebral_valley
Incredible start to our Llama 3 hackathon with @AIatMeta at @SHACK15sf this morning!
#llama3hackathonThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
There are few fields in medicine that require more precision or data than radiation oncology. RadOnc-GPT is a fine-tuned LLM, built with Meta Llama 2, that has the potential to significantly improve radiation therapy decision-making.
More details ➡️ go.fb.me/ma1vim
AI at Meta
@AIatMeta
Building with an open model enabled the team behind RadOnc-GPT to fine-tune the model on their records using local GPUs. This means that no patient data is ever shared outside of their secure network — a requirement for data security in healthcare settings.
-
AI at Meta
@AIatMeta
Vision Transformers Need Registers ➡️ arxiv.org/abs/2309.16588
🏆 Recipient of ICLR Outstanding Paper Award
AI at Meta
@AIatMeta
Flow Matching on General Geometries ➡️ arxiv.org/abs/2302.03660
🏅 ICLR Outstanding Paper honorable mention
AI at Meta
@AIatMeta
Demystifying CLIP Data ➡️ arxiv.org/abs/2309.16671
AI at Meta
@AIatMeta
Revisiting Feature Prediction for Learning Visual Representations from Video ➡️ arxiv.org/abs/2404.08471
-
AI at Meta
@AIatMeta
New research from FAIR: Better & Faster Large Language Models via Multi-token Prediction
Research paper ➡️ go.fb.me/wty7gj
We show that replacing next token prediction tasks with multiple token prediction can result in substantially better code generation performance with the exact same training budget and data — while also increasing inference performance by 3x.
While similar approaches have previously been used in fine-tuning to improve inference speed, this research expands to pre-training for large models, showing notable behaviors and results at these scales. -
AI at Meta
@AIatMeta
The Meta Llama 3 Hackathon is this weekend in SF with @Cerebral_Valley! Get on the list ➡️ go.fb.me/em3p78
What to expect
• Two days of building alongside the best hackers in AI
• Hands on support from the Llama team
• Talks from some of the top names in the industry -
AI at Meta
@AIatMeta
We continue to be amazed by how organizations of all sizes are building with Meta Llama models — from education to generative AI assistants for business and all the way to medical applications ⬇️
go.fb.me/9tspzb -
AI at Meta
@AIatMeta
We're in Vienna for #iclr2024, stop by our booth to chat with our team or learn more about our latest research this week.
📍Booth A15
This year, teams from Meta are sharing 25+ publications and two workshops. Here are a few booth highlights to add to your agenda this week 🧵Post not available here, view on X
AI at Meta
@AIatMeta
Want to talk about TorchRL? We have a few options for you at #iclr2024.
1️⃣ Decision making algorithms made easy with TorchRL
At the Meta booth, May 9 @ 13:45
2️⃣ TorchRL presentations + Q&A.
2x daily sessions at the Meta booth @ 10:00 and 15:00
AI at Meta
@AIatMeta
In addition to these talks, you can come by our booth to try demos of MAGNeT, Segment Anything (SAM) and more!
-
AI at Meta
@AIatMeta
As part of our focus on developing Meta Llama 3 in a responsible way, we’ve created a number of resources to help others use it responsibly as well — like CyberSec Eval 2.
Research paper ➡️ go.fb.me/p7fun2
AI at Meta
@AIatMeta
CyberSec Eval 2 expands on our previous work by measuring an LLM’s susceptibility to prompt injection, automated offensive cybersecurity capabilities and propensity to abuse a code interpreter — in addition to the existing evaluations.
More on Meta Llama Trust & Safety ➡️ go.fb.me/wa4sct -
AI at Meta
@AIatMeta
Newly published today in @ACSCentSci — Meta and @GeorgiaTech researchers released a dataset + SOTA AI models to help accelerate research on Direct Air Capture — a key technology to combat climate change ➡️ go.fb.me/eojy3k
AI at Meta
@AIatMeta
OpenDAC23 is the largest dataset of Metal Organic Frameworks characterized by their ability to adsorb CO2 in the presence of water — an order of magnitude larger than any other pre-existing dataset at this precision.
More on the dataset + AI models ⬇️
go.fb.me/tjpspx
AI at Meta
@AIatMeta
There’s much more work to be done in this space and we hope that this research and these new resources will help accelerate research across the field.
-
AI at Meta
@AIatMeta
In addition to other improvements, this release enables running Meta Llama 2 7B efficiently on devices like the iPhone 15 Pro, Samsung Galaxy S24 and other edge devices — it also includes early support for Llama 3 8B.
More details on ExecuTorch Alpha ⬇️
PyTorch
@PyTorch
Introducing ExecuTorch Alpha ⚡
ExecuTorch Alpha is focused on deploying large language models and large ML models to the edge, stabilizing the API surface, and improving installation processes.
Learn more in our latest blog: pytorch.org/blog/executorch-alpha/?hss_channel=tw-7765855… -
AI at Meta
@AIatMeta
Join us for the Meta Llama 3 Hackathon in San Francisco from May 11-12!
Ahmad Al-Dahle
@Ahmad_Al_Dahle
Excited to share that we're hosting the first ever Llama 3 Hackathon with @cerebral_valley + @SHACK15sf in San Francisco. Prizes include a total of $10K+ in cash + partner credits to kickstart projects.
Register to join us May 11-12: partiful.com/e/p5bNF0WkDd1n7JYs3m0A -
AI at Meta
@AIatMeta
Researchers at @ICepfl & @YaleMed teamed up to build Meditron, an LLM suite for low-resource medical settings. With Llama 3, their new model outperforms most open models in its parameter class on benchmarks like MedQA & MedMCQA.
More details ➡️ go.fb.me/6vfi21
AI at Meta
@AIatMeta
You can find more information on Llama-3[8B]-MeditronV1.0, including a preprint here ➡️ go.fb.me/oij0nw
-
AI at Meta
@AIatMeta
It's been exactly one week since we released Meta Llama 3, in that time the models have been downloaded over 1.2M times, we've seen 600+ derivative models on @HuggingFace and much more.
More on the exciting impact we're already seeing with Llama 3 ➡️ go.fb.me/xsqzz8 -
AI at Meta
@AIatMeta
Starting today, we’re rolling out Meta AI with Vision on Ray-Ban Meta. Details on the new styles, features and more we announced this morning ➡️ go.fb.me/ejkqvs
Ahmad Al-Dahle
@Ahmad_Al_Dahle
Multimodal Meta AI is rolling out widely on Ray-Ban Meta starting today! It's a huge advancement for wearables & makes using AI more interactive & intuitive.
Excited to share more on our multimodal work w/ Meta AI (& Llama 3), stay tuned for more updates coming soon. -
AI at Meta
@AIatMeta
Ready to start working with Meta Llama 3? Here are a few things to help you get started. 🧵
Post not available here, view on X
AI at Meta
@AIatMeta
Build safe and responsible experiences with our new Meta Llama trust and safety tools.
Along with Llama 3, we released Llama Guard 2, Code Shield and CyberSec Eval 2. They’re available as part of the model download on our website and you can find more details here ➡️
AI at Meta
@AIatMeta
What are some of the best Llama 3 tutorials, tools and resources you've seen in the community? Share them in the replies!
-
AI at Meta
@AIatMeta
In addition to Llama 3, today we’re also publishing a new paper: Imagine Flash: Accelerating Emu Diffusion Models with Backward Distillation ➡️ go.fb.me/g4r584
This work from GenAI researchers is enabling new image generation features in Meta AI on @WhatsApp & web.
AI at Meta
@AIatMeta
Want to try these updated Imagine features in Meta AI? More details ⬇️
go.fb.me/em5kto -
AI at Meta
@AIatMeta
More technical details on the new Meta Llama 3 models announced today. 🦙🧵
Post not available here, view on X
AI at Meta
@AIatMeta
In addition to Llama 3, we also released new Meta Llama trust & safety tools featuring Llama Guard 2, Code Shield and Cybersec Eval 2 — plus an updated Responsible Use Guide & Getting Started Guide, new recipes and more. You can find more of these updates on the Llama website ➡️ go.fb.me/taeox3
AI at Meta
@AIatMeta
This is just the start for Llama 3 and we’re excited to share even more in the months to come — including a new research paper with deeper insights into this work.
You can find more details on today’s new models in the model card ⬇️
github.com/meta-llama/llama3/blob/main/MODEL_CARD.md -
AI at Meta
@AIatMeta
Introducing Meta Llama 3: the most capable openly available LLM to date.
Today we’re releasing 8B & 70B models that deliver on new capabilities such as improved reasoning and set a new state-of-the-art for models of their sizes.
Today's release includes the first two Llama 3 models — in the coming months we expect to introduce new capabilities, longer context windows, additional model sizes and enhanced performance + the Llama 3 research paper for the community to learn from our work.
More details ➡️ go.fb.me/i2y41n
Download Llama 3 ➡️ go.fb.me/ct2xkoPost not available here, view on X
AI at Meta
@AIatMeta
Llama 3 8B & 70B models are just the beginning of what we’re working to release for Llama 3. Our largest models currently in the works are 400B+ parameters and while they’re still in active development, we’re excited about how this work is trending.
-
AI at Meta reposted
Reality Labs at Meta
@RealityLabs
Join forces to help reduce LLM hallucinations! Enter the @Meta Comprehensive RAG (CRAG) Challenge in KDD Cup 2024 🚀 It’s time to improve LLMs with real-time & accurate information using RAG. www.aicrowd.com/challenges/meta-comprehensive-rag-benchma…
-
AI at Meta
@AIatMeta
For Mathpresso, making 1:1 personalized education available for everyone through an AI tutor has been a long-standing goal. MathGPT uses Llama 2 to create a platform for highly personalized learning.
Ahmad Al-Dahle
@Ahmad_Al_Dahle
I’ll be sharing more on Llama 3 very soon. It’s so cool to see what the community is already building with Llama 2 though. One of my favorites: @team_qanda & @UpstageAI used it to build a math-specific LLM to make personalized learning more accessible! ai.meta.com/blog/llama-2-mathgpt-mathpresso-qanda-upstage…
-
AI at Meta
@AIatMeta
Today we’re releasing OpenEQA — the Open-Vocabulary Embodied Question Answering Benchmark. It measures an AI agent’s understanding of physical environments by probing it with open vocabulary questions like “Where did I leave my badge?”
More details ➡️ go.fb.me/7vq6hm
All of today’s state-of-art vision+language models (VLMs) fall well short of human performance.
In fact, for questions that require spatial understanding, today’s VLMs are nearly “blind” – access to visual content provides only minor improvements over language-only models.
We hope that OpenEQA motivates additional research into helping AI understand and communicate about the world it sees.
AI at Meta
@AIatMeta
We’re excited about the future of embodied AI. At FAIR, we’re working to build world models capable of performing well on OpenEQA — and we welcome others to join us in that effort.
Read the research paper ➡️ go.fb.me/wfrq31
Get the benchmark ➡️ go.fb.me/r403y1 -
AI at Meta
@AIatMeta
Introducing the next generation of the Meta Training and Inference Accelerator (MTIA), the next in our family of custom-made silicon, designed for Meta’s AI workloads.
Full details ➡️ go.fb.me/kwahjuPost not available here, view on X
AI at Meta
@AIatMeta
Because we control the whole stack, over time we can achieve greater efficiency on models for Meta’s products compared to commercially available GPUs.
We're continuing to improve performance/Watt as we build up and deploy MTIA chips.
AI at Meta
@AIatMeta
MTIA is a part of our growing investment in AI infrastructure and will complement our existing and future AI infrastructure to deliver new and better experiences across our products and services.
We’re only at the beginning of this journey and we’re excited about what's ahead. -
AI at Meta
@AIatMeta
We just released an update to the Ego-Exo4D dataset for video learning & multimodal perception research. Ego-Exo4D V2 includes more videos coupled with Aria machine perception services, new annotations & more.
Details on Ego-Exo4D V2 ➡️ go.fb.me/cirzj9
AI at Meta
@AIatMeta
With this new release, Ego-Exo4D V2 includes nearly 1.3k hours of first and third-person video, with updated annotations, making it both the largest publicly-available manually-labeled egocentric body & hand pose dataset and the largest collection of video segmentation masks.
AI at Meta
@AIatMeta
The research team will present this paper at #cvpr2024 ➡️ go.fb.me/pl6paw
We’re excited to share this with the community as part of our continued support of open science. -
Benetech
@Benetech
Benetech has been selected as one of the 20 finalists for the Llama Impact Grants funded by @Meta in the category of education. Thank you, @AIatMeta , for providing us with this opportunity. For more information, please visit: dev.meta.ai/llama/llama-ai-innovation/
#llamaimpactgrants
AI at Meta
@AIatMeta
Congratulations! 🎉 We're excited to see you at the finalist workshop next week.
-
AI at Meta
@AIatMeta
Announced today: @MLCommons is adopting Meta Llama 2 70B for MLPerf Inference v4.0 ➡️ mlcommons.org/2024/03/mlperf-llama2-70b/
The benchmark is a standard for measuring ML & AI performance across domains and we're excited to support the community in using Llama 2 as part of the benchmark suite. -
AI at Meta
@AIatMeta
Serving billions of tokens from their hosted LLM endpoints + customers' custom models, @OctoAICloud is using Llama Guard to support safety for their customers at scale + their own trust & safety work ⬇️
www.nvidia.com/en-us/ -
AI at Meta
@AIatMeta
Today we’re introducing SceneScript, a novel method for reconstructing environments and representing the layout of physical spaces from @RealityLabs Research.
Details ➡️ ai.meta.com/blog/scenescript-3d-scene-reconstruction-real…
SceneScript is able to directly infer a room’s geometry using end-to-end machine learning and represent it using language. Compared to previous approaches, this results in representations of physical scenes that are compact, complete, interpretable and extensible.
AI at Meta
@AIatMeta
SceneScript uses next token prediction like an LLM, but instead of natural language it predicts architectural tokens. To train it, we created a synthetic dataset of 100,000 unique indoor environments.
More on the Aria Synthetic Environments dataset ➡️ www.projectaria.com/datasets/ase/
AI at Meta
@AIatMeta
We believe SceneScript represents a significant milestone on the path to true AR glasses that will bridge the physical and digital worlds. We’re thrilled about how this work will help shape the future of AI and ML research.
-
AI at Meta
@AIatMeta
Learn prompting best practices, few-shot and chain-of-thought prompting, how to implement safe AI practices with Llama Guard and more — the "Prompt Engineering with Llama 2" course is open now on @deeplearningai.
Get started with the free course ➡️ www.deeplearning.ai/courses/prompt-engineering-with-llama-2 -
AI at Meta reposted
Shishir Patil
@shishirpatil_
🌀Check out RAFT: Retrieval-Aware Fine Tuning! A simple technique to prepare data for fine-tuning LLMs for in-domain RAG, i.e., question-answering on your set of documents 📄 Exciting collaboration with @berkeley_ai 🤝 @Azure 🤝 @AIatMeta
MSFT-Meta blog: techcommunity.microsoft.com/t5/ai-ai-platform-blog/raft-a…
Read more: gorilla.cs.berkeley.edu/blogs/9_raft.html
Code: github.com/ShishirPatil/gorilla/tree/main/raft
Tianjun Zhang
@tianjun_zhang
📢 Excited to release RAFT: Retriever-Aware FineTuning for domain-specific RAG, a three-way collaboration between @berkeley_ai @Azure and @AIatMeta! 🤝
Drawing parallels between LLMs and students in open-book (RAG) 📔 and closed-book exams (SFT) 🧠, we present a better recipe for fine-tuning a base LLM for RAG-focused challenges. Discover how RAFT prepares LLMs to excel with a specific document set, mirroring students’ prep for finals! 🎓 -
AI at Meta
@AIatMeta
Just announced with @GovTimWalz & @CityofRosemount — we're building a new AI-focused data center in Rosemount, MN. More details ➡️ www.facebook.com/RosemountDataCenter/posts/pfbid036ZVPxai…
Governor Tim Walz
@GovTimWalz
I just announced that Meta will build a new data center in Rosemount, bringing dozens of jobs and invigorating the local economy.
This news is a testament to Minnesota’s commitment to making our state a top place for business and innovation. -
AI at Meta
@AIatMeta
Recently released by researchers at Meta, the Multi-Modal Conversations in Smart Glasses dataset includes >25h of two-sided conversations to support research in areas that could unlock new possibilities for future smart glasses.
More details ➡️ ai.meta.com/datasets/mmcsg-dataset/ -
AI at Meta
@AIatMeta
Today we're sharing new details on our latest advancements in infrastructure for AI. More details at the link below ⬇️
Engineering at Meta
@Meta_Engineers
Introducing our two new 24k GPU clusters! These clusters will support our current and next-gen AI models, including Llama 3, and help us push the boundaries of AI research.
engineering.fb.com/2024/03/12/data-center-engineering/bui… -
AI at Meta
@AIatMeta
🎧New episode of the Lex Fridman Podcast is out now.
In @ylecun's third appearance on the podcast he touches on approaches to next generation AI systems, open source, the path to AGI and more.
Lex Fridman
@lexfridman
Here's my conversation with Yann LeCun (@ylecun) about AI, importance of open source, limits of LLMs, why AI doomers are wrong, and the path to AGI. This was a fun and fascinating technical conversation!
It's here on X in full, and is up on YouTube, Spotify, and everywhere else. Links in comment.
Timestamps:
0:00 - Introduction
2:18 - Limits of LLMs
13:54 - Bilingualism and thinking
17:46 - Video prediction
25:07 - JEPA (Joint-Embedding Predictive Architecture)
28:15 - JEPA vs LLMs
37:31 - DINO and I-JEPA
38:51 - V-JEPA
44:22 - Hierarchical planning
50:40 - Autoregressive LLMs
1:06:06 - AI hallucination
1:11:30 - Reasoning in AI
1:29:02 - Reinforcement learning
1:34:10 - Woke AI
1:43:48 - Open source
1:47:26 - AI and ideology
1:49:58 - Marc Andreesen
1:57:56 - Llama 3
2:04:20 - AGI
2:08:48 - AI doomers
2:24:38 - Joscha Bach
2:28:51 - Humanoid robots
2:38:00 - Hope for the futureThis media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
FAIR researchers recently released V-JEPA, a method for teaching machines to understand and model the physical world by watching videos. The code is available under a CC-BY-NC license to enable the research community to build on this work.
GitHub Repo ⬇️
github.com/facebookresearch/jepa -
AI at Meta
@AIatMeta
At Meta, we believe in the power of AI to advance the state of the art and to connect the world. We’re proud to sign this letter with @svangel today and are committed to our open approach to AI ⬇️
openletter.svangel.com -
AI at Meta
@AIatMeta
Together with @AndrewYNg and the deeplearning.ai team, we're excited to launch this new, free course taught by @asangani7. More in the announcement below ⬇️
DeepLearning.AI
@DeepLearningAI
Prompt Engineering with Llama 2, a short course built with @AIatMeta, is live! 📣
Learn prompting best practices, advanced techniques, how to use Code Llama as a pair programmer, and how to implement safe AI practices, all in one course!
Join now: www.deeplearning.ai/courses/prompt-engineering-with-llama… -
AI at Meta
@AIatMeta
The MediaTek Dimensity 9300 and 8300 SoCs are fully integrated and optimized to support Llama 2 7B applications — MediaTek is demonstrating this for the first time at #mwc2024.
MediaTek
@MediaTek
At #mwc2024, #mediatek showcases on-device Generative AI with the Llama 2 LLM created by @AIatMeta. Leveraging our latest APUs, NeuroPilot AI & Dimensity 9300 and 8300 SoCs for enhanced privacy & lower costs. Experience it at Booth 3D10 in Hall 3. www.mediatek.com/blog/mediatek-dimensity-demos-on-device-… #llama2
-
AI at Meta
@AIatMeta
We believe that V-JEPA is an important step on the path to advancing machine intelligence. As part of our continued support of responsible open science, we've published a paper outlining this work for the research community.
V-JEPA research paper ➡️ ai.meta.com/research/publications/revisiting-feature-pred… -
AI at Meta
@AIatMeta
Today we're releasing MMCSG — a dataset with >25h of two-sided conversations captured using Project Aria.
Download ➡️ ai.meta.com/datasets/mmcsg-dataset/
MMCSG could help researchers solve important challenges for future smart glasses including ASR, target speaker identification & more.
AI at Meta
@AIatMeta
The MMCSG dataset features multi-channel audio, video and IMU data from Project Aria that could aid in research for a diverse set of tasks for smart glasses.
We’re releasing it as part of the CHiME-8 challenge. More details & how to participate ➡️ www.chimechallenge.org/current/task3/ -
AI at Meta
@AIatMeta
Today we’re releasing V-JEPA, a method for teaching machines to understand and model the physical world by watching videos. This work is another important step towards @ylecun’s outlined vision of AI models that use a learned understanding of the world to plan, reason and accomplish complex tasks.
Details ➡️ ai.meta.com/blog/v-jepa-yann-lecun-ai-model-video-joint-e…
We're releasing a collection of V-JEPA vision models trained with a feature prediction objective using self-supervised learning. The models are able to understand and predict what is going on in a video, even with limited information.
It learns by predicting missing or obscured parts of a video in its internal feature space. Unlike generative approaches that fill in missing pixels, this flexible approach enables up to 6x improvements in training and sample efficiency.
The models were pre-trained on entirely unlabeled data, and a small amount of labeled data can be used to train a task-specific prediction head on top after pre-training.
Our results show that, using a frozen backbone, our top V-JEPA models achieve 82.0% on Kinetics-400, 72.2% on Something-Something-v2 and 77.9% on ImageNet1K — competitive with or exceeding previous leading video models.
We believe that this work is an important milestone on the path to advancing machine intelligence.
AI at Meta
@AIatMeta
In continuing with our belief in responsible open science, we’re releasing V-JEPA under a CC-BY-NC license to enable the research community to learn and build from this work.
Get the code 👇
github.com/facebookresearch/jepa -
AI at Meta
@AIatMeta
Researchers at Meta recently shared MAGNeT, a single non-autoregressive transformer model for text-to-music & text-to-sound generation capable of generating audio on-par with the quality of SOTA models — at 7x the speed.
MAGNeT is open source as part of AudioCraft. Hear audio samples and get more details on this work ➡️ pages.cs.huji.ac.il/adiyoss-lab/MAGNeT/
AI at Meta
@AIatMeta
Unlike prior non-autoregressive modeling work, MAGNeT doesn't require semantic token conditioning, model cascading or audio prompting — it employs a full text-to-audio using a single non-autoregressive Transformer.
Paper ➡️ arxiv.org/abs/2401.04577
Code ➡️ github.com/facebookresearch/audiocraft/blob/main/docs/MAG… -
AI at Meta
@AIatMeta
To support Music’s Biggest Night, The Recording Academy teamed up with IBM to build ‘AI Stories with @IBMwatsonx'.
This generative AI content engine was built using Llama 2 and The Recording Academy’s own trusted data, all in just a matter of weeks. ⬇️
digiday.com/media-buying/the-recording-academy-and-ibm-ar… -
AI at Meta
@AIatMeta
Congratulations to @ylecun for being selected as a recipient of the 2024 #time100ai Impact Award, recognizing global leaders who have gone above & beyond to move their industries — and the world — forward.
See the full list & details on @TIME ⬇️
time.com/collection/time100-impact-awards/
AI at Meta
@AIatMeta
Read more in @TIME's latest piece on Yann ⬇️
time.com/6691705/time100-impact-awards-yann-lecun/ -
AI at Meta
@AIatMeta
Together with the Ego4D consortium, we recently released Ego-Exo4D: A diverse, large-scale multi-modal, multi-view, video dataset and benchmark.
Learn more about the work ➡️ ai.meta.com/blog/ego-exo4d-video-learning-perception/
Access the dataset ➡️ ego-exo4d-data.org
This work could help to advance AI models' understanding of complex human skills & enable new applications for AR systems, robotics & more. -
AI at Meta
@AIatMeta
Ready to start building with Llama? This resource covers everything you need: getting the models, fine tuning, community resources, FAQs, common troubleshooting & much more.
Get started ➡️ ai.meta.com/llama/get-started/ -
AI at Meta
@AIatMeta
We believe in the power of open source — and the community around it.
Soumith Chintala
@soumithchintala
If you have questions about why Meta open-sources its AI, here's a clear answer in Meta's earnings call today from @finkd
-
AI at Meta
@AIatMeta
Today, Mark Zuckerberg shared the latest on our vision for building the most advanced AI products and services in our Q4 earnings call. Here are a few highlights on our progress in AI — and how our teams are positioned to deliver on this work.
🧵Post not available here, view on X
AI at Meta
@AIatMeta
We’re continuing our long-standing strategy to build and open source software infrastructure.
Earlier this week we released new, more performant versions of Code Llama to the community — available under the same license as Llama 2. We believe in the power of open source to unlock innovation in the industry while also driving benefits to our work by helping us to learn and improve quickly.
AI at Meta
@AIatMeta
Today we’re releasing Code Llama 70B: a new, more performant version of our LLM for code generation — available under the same license as previous Code Llama models.
Download the models ➡️ ai.meta.com/resources/models-and-libraries/llama-downloads/
• CodeLlama-70B
• CodeLlama-70B-Python
• CodeLlama-70B-Instruct
AI at Meta
@AIatMeta
With hundreds of millions of people interacting with AI services across our products, Meta has a unique opportunity to develop the most advanced AI products and services in the world by learning from one of the strongest data and feedback loops in the industry.
Want to build with us? You can find open roles working on AI here ⬇️
www.metacareers.com/jobs?teams[0]=Generative+AI&teams[1]=… -
AI at Meta
@AIatMeta
Today we’re releasing Code Llama 70B: a new, more performant version of our LLM for code generation — available under the same license as previous Code Llama models.
Download the models ➡️ ai.meta.com/resources/models-and-libraries/llama-downloads/
• CodeLlama-70B
• CodeLlama-70B-Python
• CodeLlama-70B-Instruct
AI at Meta
@AIatMeta
CodeLlama-70B-Instruct achieves 67.8 on HumanEval, making it one of the highest performing open models available today.
CodeLlama-70B is the most performant base for fine-tuning code generation models and we’re excited for the community to build on this work. -
AI at Meta reposted
Vaibhav (VB) Srivastav
@reach_vb
Alrighty! W2V-BERT 2.0: Speech encoder for low-resource languages! 🔥
With < 15 hours of audio, you can beat Whisper and get your own SoTA ASR model!
> Pre-trained on 4.5M hours of data.
> 600M parameters.
> 143+ languages.
> 10-30x faster than Whisper.
> Best part: MIT license ⚡
@AIatMeta has been on a roll with the latest audio releases. 💪 -
AI at Meta
@AIatMeta
Together with @GovHolcomb, today we announced that Meta will be building a new AI-focused data center in Jeffersonville, IN. It will be one of the first built on our next generation design to help us continue to develop & deploy AI at scale.
Details ➡️ www.facebook.com/JeffersonvilleDataCenter/posts/pfbid0XUr…
AI at Meta
@AIatMeta
This next generation data center design will support:
• GPUs & custom in-house silicon
• Direct-to-chip liquid cooling
• High density racks
• Colocation of servers & network
More in our 2023 announcement ➡️ about.fb.com/news/2023/05/metas-infrastructure-for-ai/
AI at Meta
@AIatMeta
🌳 Like all of Meta’s data centers, the Jeffersonville Data Center will be supported by 100% renewable energy.
-
AI at Meta
@AIatMeta
Introducing 'Prompt Engineering with Llama 2' — an interactive guide covering prompt engineering & best practices for developers, researchers & enthusiasts working with large language models.
Access the notebook in the llama-recipes repo ➡️ github.com/meta-llama/llama-cookbook/blob/main/examples/P… -
AI at Meta
@AIatMeta
We're accepting proposals for the Audiobox Responsible Generation Grant until February 2nd. Grant recipients will get $50k in funding + access to Audiobox models for safety & responsibility research.
More details and how to apply ➡️ ai.meta.com/research/audiobox-responsible-generation-grant/ -
AI at Meta
@AIatMeta
📝 Recently published paper from researchers at Meta: Mosaic-SDF for 3D Generative Models.
More details ➡️ lioryariv.github.io/msdf/
Paper ➡️ arxiv.org/abs/2312.09222
We introduce Mosaic-SDF (M-SDF), a simple novel 3D shape representation for generative models. M-SDF approximates an arbitrary Signed Distance Function with a set of small volumetric grids with different centers and scales.
This representation is:
- Fast to compute
- Parameter efficient
- Compatible with Transformer-based architectures.
We’re excited about how this research could contribute to more effective and efficient 3D generative models. -
AI at Meta
@AIatMeta
Meta and @GeorgiaTech researchers released a dataset + AI models to help accelerate research on Direct Air Capture — a key technology needed to combat climate change.
Get the models & dataset ➡️ open-dac.github.io
OpenDAC23 is the largest ever dataset of it's kind at the DFT level of accuracy and we hope that this work will help to accelerate research across this important field of study. -
AI at Meta
@AIatMeta
Applications are now open for our 2024-2025 AI Mentorship Program! This research collaboration with @CarnegieMellon, @nyuniversity, @UW and @Mila_Quebec gives PhD students at these universities the opportunity to collaborate with research teams at Meta that are advancing the state of AI.
📝 Applications
• CMU ➡️ www.metacareers.com/jobs/position-not-available/
• NYU ➡️ www.metacareers.com/jobs/position-not-available/
• UW ➡️ www.metacareers.com/jobs/position-not-available/
• Mila ➡️ www.metacareers.com/jobs/position-not-available/ -
AI at Meta
@AIatMeta
SeamlessExpressive enables high-quality speech translation that maintains the original speaker's vocal style, tone and unique expressions in translated outputs.
More documentation on our @huggingface repo ⬇️ huggingface.co/facebook/seamless-expressive -
AI at Meta
@AIatMeta
You can now try Audiobox, our new foundation research model for audio generation that can generate audio using a combination of voice inputs and natural language text prompts.
Try the demo ➡️ audiobox.metademolab.com -
AI at Meta
@AIatMeta
To close out 2023, here are 10 of the most interesting AI research advancements we shared on our feed this year — and where you can find more details on the work.
1️⃣ Segment Anything (SAM)
A step toward the first foundation model for image segmentation.
Details: aidemos.meta.com/segment-anything/
2️⃣ DINOv2
The first method for training computer vision models that uses self-supervised learning to achieve results matching or exceeding industry standards.
Details: dinov2.metademolab.com
3️⃣ Llama 2
The next generation of our open source large language model, available for free for research and commercial use.
Details: developer.meta.com/ai/
4️⃣ Emu Video & Emu Edit
Generative AI research for high quality, diffusion-based text-to-video generation & controlled image editing with text instructions.
Details: ai.meta.com/blog/emu-text-to-video-generation-image-editi…
5️⃣ I-JEPA
Self-supervised computer vision that learns to understand the world by predicting it. The first model based on a component of @ylecun's vision to make AI systems learn and reason like animals and humans.
Details: ai.meta.com/blog/yann-lecun-ai-model-i-jepa/
6️⃣ Audiobox
Our new foundation research model for audio generation.
Details: audiobox.metademolab.com
7️⃣ Brain decoding - toward real-time reconstruction of visual perception
Using MEG, this AI system can decode the unfolding of visual representations in the brain with an unprecedented temporal resolution.
Details: ai.meta.com/blog/brain-ai-image-decoding-meg-magnetoencep…
8️⃣ Open Catalyst demo
A service that allows researchers to accelerate work in material sciences by enabling them to simulate the reactivity of catalyst materials faster than existing computational methods.
Details: open-catalyst.metademolab.com
9️⃣ Seamless Communication
A new family of AI translation models that preserve expression and deliver near-real time streaming translations.
Details: ai.meta.com/research/seamless-communication/
🔟 ImageBind
The first AI model capable of binding data from six modalities at once. A breakthrough that brings machines one step closer to the human ability to bind together information from many different senses.
Details: imagebind.metademolab.com -
AI at Meta
@AIatMeta
As we wrap up what has been a monumental year for AI, what was the most exciting advancement, publication, research breakthrough or AI-powered product you saw in 2023?
-
AI at Meta
@AIatMeta
Meet Ego-Exo4D, the largest ever public dataset of its kind for research on video learning & multimodal perception.
Details ➡️ ai.meta.com/blog/ego-exo4d-video-learning-perception/
This work could help advance AI models' understanding of complex human skills to enable new AR applications, robotics & more. -
AI at Meta reposted
Jean-Rémi King
@JeanRemiKing
2023: highlights from our Brain team @AIatMeta in a quick thread:
-
AI at Meta
@AIatMeta
SeamlessStreaming uses a learned read/write policy to enable delivery of fast & accurate translations even when faced with differences in language structure in many language pairs.
Details on Seamless ➡️ ai.meta.com/resources/models-and-libraries/seamless-commu…
Try it on @HuggingFace ➡️ huggingface.co/facebook/seamless-streaming -
AI at Meta
@AIatMeta
As part of FAIR’s continued support of open science and participation in the research community, we’ve published a paper on our new foundation model for audio generation, Audiobox.
Read the paper ➡️ ai.meta.com/research/publications/audiobox-unified-audio-…
AI at Meta
@AIatMeta
We’re currently accepting applications for the Audiobox Responsible Generation Grant. Recipients will get $50k in funding & access to Audiobox models for safety & responsibility research.
Details ➡️ ai.meta.com/research/audiobox-responsible-generation-grant/ -
AI at Meta
@AIatMeta
SeamlessStreaming is an AI translation model that can deliver state-of-the-art results on streaming translation with <2 seconds of latency. One core piece of our latest Seamless Communication research work by teams at FAIR.
More on this project ➡️ ai.meta.com/research/seamless-communication/ -
AI at Meta
@AIatMeta
Purple Llama aims to help level the playing field for building safe & responsible AI experiences.
Get Purple Llama ➡️ www.llama.com/purple-llama/
It includes:
• CyberSecEval
• Llama Guard
• Tools for insecure code detection & testing for cyber attack compliance
• Two white papers -
AI at Meta
@AIatMeta
To help fuel new research in the community around video learning and egocentric perception, together with the Ego4D consortium we’ve published a new research paper covering our work on Ego-Exo4D.
Access the full paper ➡️ arxiv.org/abs/2311.18259 -
AI at Meta
@AIatMeta
We believe that open science is crucial to continuous innovation and building AI in a way that benefits everyone. As part of our continued effort in the research community we've published a new paper on our newest Seamless Communication work.
Paper ➡️ ai.meta.com/research/publications/seamless-multilingual-e… -
AI at Meta
@AIatMeta
Together with the Ego4D consortium, today we're releasing Ego-Exo4D, the largest ever public dataset of its kind to support research on video learning & multimodal perception — including 1,400+ hours of videos of skilled human activities.
Download ➡️ ego-exo4d-data.org
AI at Meta
@AIatMeta
Using Project Aria, Ego-Exo4D includes not just video, but time-aligned seven-channel audio, IMU, eye gaze, head poses & 3D point clouds of the environment.
More on this work by FAIR, @meta_aria & 15 university partners ➡️ ai.meta.com/blog/ego-exo4d-video-learning-perception/ -
AI at Meta
@AIatMeta
Here are 6️⃣ papers from AI research teams at Meta that you should know about at #neurips2023 ⬇️
Post not available here, view on X
AI at Meta
@AIatMeta
5️⃣ EgoEnv: Human-centric environment representations from egocentric video ➡️ arxiv.org/abs/2207.11365
To facilitate human-centric environment understanding, we present an approach that links egocentric video and the environment by learning representations that are predictive of the camera-wearer's (potentially unseen) local surroundings.
AI at Meta
@AIatMeta
6️⃣ Exploring Why Object Recognition Performance Degrades Across Income Levels and Geographies with Factor Annotations ➡️ arxiv.org/abs/2304.05391
We studied a range of modern vision models, finding that performance disparities are most associated with differences in texture, occlusion, and images with darker lighting and illustrate how insights from our factor labels can surface mitigations to improve models' performance disparities. -
AI at Meta
@AIatMeta
Starting today you can try our new foundation research model for audio generation. The demo includes Zero shot TTS, Text to sound effects, Infilling and more!
Try Audiobox ➡️ audiobox.metademolab.com
AI at Meta
@AIatMeta
Today we’re also opening applications for the Audiobox Responsible Generation Grant. Recipients will receive $50k in funding & access to Audiobox models for safety & responsibility research.
Details ➡️ ai.meta.com/research/audiobox-responsible-generation-grant/ -
AI at Meta
@AIatMeta
We're in New Orleans for #neurips2023, stop by our booth to chat with our team or learn more about our latest research.
📍Booth 1203
This year, teams from Meta are sharing 60+ publications and four workshops. You can see more info on what we're sharing at the conference here ➡️ -
AI at Meta
@AIatMeta
Last week we introduced SeamlessStreaming — an AI translation model that can deliver streaming translation with <2 seconds of latency. One of the core pieces of our recent Seamless Communication announcement.
More details on this work ➡️ ai.meta.com/research/seamless-communication/This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Zheqing (Bill) Zhu
@ZheqingZhu
Thrilled to announce Pearl – our Production-ready Reinforcement Learning AI Agent Library – now open-source! Crafted by the Applied Reinforcement Learning team @AIatMeta.
GitHub: github.com/facebookresearch/pearl
Paper: chs6.short.gy/pearl_paper
Website: pearlagent.github.io
1/8 -
AI at Meta
@AIatMeta
Announcing Purple Llama — A new project to help level the playing field for building safe & responsible generative AI experiences.
Purple Llama includes permissively licensed tools, evals & models to enable both research & commercial use.
More details ➡️ ai.meta.com/blog/purple-llama-open-trust-safety-generativ…Post not available here, view on X
AI at Meta
@AIatMeta
In fostering a collaborative approach, we will be partnering with @MLCommons, the AI Alliance, @Microsoft, @Amazon, @Google, @IBM, @HuggingFace & many others.
Together we believe that community involvement will contribute to ongoing improvement and effectiveness of these tools.
AI at Meta
@AIatMeta
We believe in transparency, open science and cross-collaboration and the launch of Purple Llama is yet another step towards creating an open AI ecosystem.
We look forward to the continued work with our partners and the community at large to build on these foundations. -
AI at Meta
@AIatMeta
Introducing Audiobox — Meta’s new foundation research model for audio generation.
Details ➡️ ai.meta.com/blog/audiobox-generating-audio-voice-natural-…
Succeeding Voicebox, Audiobox advances generative AI for audio by unifying generation and editing capabilities for speech, sound effects and soundscapes. -
AI at Meta
@AIatMeta
Building on our longstanding investments in exploratory AI research and open access to AI is part of what enables us to bring technology from the lab to product faster — for example, the Emu technology behind Imagine or new automatic red teaming research which will eventually help us further improve safety across our AIs.
Meta
@Meta
Today, we’re sharing updates to our core AI experiences and new capabilities you can discover across our family of apps. Read all about it here: about.fb.com/news/2023/12/meta-ai-updates/
-
AI at Meta
@AIatMeta
SeamlessExpressive, a new AI translation model by research teams at Meta, enables high-quality speech translation that maintains the speaker's vocal style, tone and unique expressions in translated outputs.
Try the demo with your own voice ➡️ seamless.metademolab.com/expressive -
AI at Meta
@AIatMeta
Today we're announcing the AI Alliance, together with @IBM and 50+ global organizations across the industry.
This group will focus on fostering open science and enabling the acceleration of responsible innovation in AI.
More on the AI Alliance ➡️ ai.meta.com/blog/ai-alliance/ -
AI at Meta
@AIatMeta
Introducing Ego-Exo4D — a foundational dataset and benchmark suite focused on skilled human activities to support research on video learning and multimodal perception. It's the largest ever public dataset of its kind.
More details ➡️ ai.meta.com/blog/ego-exo4d-video-learning-perception/This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
SeamlessM4T v2 is now in 🤗Transformers — thank you to @reach_vb and the @huggingface team for the collaboration!
Yoach
@yoachlacombe
And boom, just like that, the new version of SeamlessM4T has already been integrated into 🤗 transformers! @huggingface @metaai
Use it right now with minimal installation and just a few lines of code!
Links below ⬇️ -
AI at Meta
@AIatMeta
Yesterday we introduced SeamlessExpressive — a new model that preserves unique vocal styles & expression for speech translation, built on our SeamlessM4T v2 foundation model.
More details on the family of Seamless Communication models ➡️
ai.meta.com/research/seamless-communication/This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Today we're sharing the next milestone in our Seamless Communication research — a new family of AI translation models that preserve expression and deliver near-real time streaming translations.
More on this new work ➡️ ai.meta.com/blog/seamless-communication
More on the individual models 🧵This media couldn't be displayed. See it on the original post.Post not available here, view on X
AI at Meta
@AIatMeta
Combining the strength of these three models, we're also introducing Seamless, a unified model that merges the quality and multilinguality of SeamlessM4T v2, the low latency of SeamlessStreaming and the expression preservation of Seamless expressive into one unified system.
AI at Meta
@AIatMeta
In addition to these models, we're sharing new datasets, watermarking research & papers on this work ➡️ ai.meta.com/research/seamless-communication/
We believe open science is crucial to AI translation that benefits everyone & we look forward to continuing this work with the research community. -
AI at Meta
@AIatMeta
10 years of FAIR.
10 years of advancing the state of the art in AI through open research.
We're celebrating the 10th anniversary of Meta's Fundamental AI Research team and continuing that legacy by sharing our work on three exciting new research projects today.
Details below 🧵Post not available here, view on X
AI at Meta
@AIatMeta
Today we're also sharing updates on three important categories of socially responsible AI research. This includes ROBBIE, a new tool to help provide a fuller picture of fairness in LLMs across 12 different demographic axes and five LLMs.
Details ➡️ ai.meta.com/blog/fair-progress-and-learnings-across-socia…
AI at Meta
@AIatMeta
Beginning FAIR’s second decade, the organization continues to push forward with the same spirit of open science that jump-started the organization in 2013 — we’re as excited as ever about the work that lies ahead.
Read more in the new post by @jpineau1 ⬇️
ai.meta.com/blog/fair-10-year-anniversary-open-science-meta/ -
AI at Meta
@AIatMeta
As we approach the 10th anniversary of FAIR, @jpineau1 sat down to share a look at why openness and open science matter at Meta.
This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Today the @MLCommons AlgoPerf working group, including researchers from Meta, are introducing a standardized & competitive benchmark designed to provide objective comparisons & quantify progress in the development of new training algorithms.
Details ➡️ mlcommons.org/2023/11/mlc-algoperf-training-algorithms-co… -
AI at Meta
@AIatMeta
Ready to start building with Llama 2? This new resource covers everything you need: getting the models, fine tuning, community resources, FAQs, common troubleshooting & much more.
Get started ➡️ ai.meta.com/llama/get-started/ -
AI at Meta
@AIatMeta
Today we’re sharing two new advances in our generative AI research: Emu Video & Emu Edit.
Details ➡️ ai.meta.com/blog/emu-text-to-video-generation-image-editi…
These new models deliver exciting results in high quality, diffusion-based text-to-video generation & controlled image editing w/ text instructions.
🧵Post not available here, view on X
AI at Meta
@AIatMeta
2️⃣ Emu Edit
This new model is capable of free-form editing through text instructions. Emu Edit precisely follows instructions and ensures only specified elements of the input image are edited while leaving areas unrelated to instruction untouched. This enables more powerful editing and enables more effective iteration.
Details ➡️ emu-edit.metademolab.com
To train the model we developed a dataset of 10M synthesized samples of input images, instructions and target outputs — the largest dataset of its kind to date. As a result the model demonstrates a new state-of-the-art in both qualitative and quantitative evaluations across a range of image editing tasks.
AI at Meta
@AIatMeta
While this work is still fundamental research, we see exciting potential for future use cases for this technology to enhance the way we share, communicate and express ourselves in creative ways in our family of apps. We’re excited to continue pushing this field of work forward.
-
AI at Meta
@AIatMeta
New AI research paper from Meta — MART, or Multi-round Automatic Red-Teaming is a framework for improving LLM safety that trains an adversarial and target LLM through automatic iterative adversarial red-teaming.
Details in the paper ➡️ arxiv.org/abs/2311.07689
AI at Meta
@AIatMeta
We evaluated MART using both public benchmarks and new self-annotated test datasets. Results demonstrate that it can reach a safety level close to ChatGPT with only 2k seed prompts during training with minimal detrimental impact on model helpfulness.
While this work still falls a bit behind state-of-the-art models like Llama 2-chat-70b, we're excited about the potential impact of this field of research for the future. -
AI at Meta reposted
Morgan McGuire
@morgymcg
The Llama 2 Getting Started guide from @AIatMeta is really comprehensive, with plenty of code examples for fine-tuning and inference
Delighted to see @wandb added there as the logger of choice 🤩 See the guide from Meta here: ai.meta.com/llama/get-started/
From what I can tell, W&B has been used during pretraining for almost every foundation model out there today - open and closed, LLM as well as multi-modal/text to image. And its also been used in many many many of the fine-tuned downstream open source models.
Our eng team is currently working on a few goodies that'll be released this quarter including significant perf improvements, workspace design and more, its going to be an exciting few months for wandb 😉 -
AI at Meta
@AIatMeta
Two days left to complete your Llama Impact Grant application, don't miss the November 15th deadline!
AI at Meta
@AIatMeta
Applications for Llama Impact Grants are now open!
Today until Nov 15, you can submit a proposal for using Llama 2 to address challenges across education, environment & open innovation for a chance to be awarded a $500K grant.
Details + application ⬇️ -
AI at Meta
@AIatMeta
We're introducing new stereo models for MusicGen. By extending the delay codebook pattern to cover tokens from both left & right channels, these models can generate stereo output with no extra computational cost vs previous models.
Try MusicGen on 🤗 ➡️ huggingface.co/spaces/facebook/MusicGen
AI at Meta
@AIatMeta
With this new release, we're excited to share that MusicGen Stereo is now available in the @HuggingFace Transformers library and the paper has been accepted at #neurips2023!
MusicGen in Transformers ➡️ huggingface.co/docs/transformers/model_doc/musicgen
Paper ➡️ arxiv.org/abs/2306.05284 -
AI at Meta reposted
Jeff Wang 👨🚀
@jffwng
🤝 Excited about the work we’re doing to support more open source AI startups!
Fun fact: We used our SeamlessM4T model to generate the English translations for the announcement video subtitles! Try the model with your own text or audio on @huggingface: huggingface.co/spaces/facebook/seamless_m4t
clem 🤗
@ClementDelangue
Support happy to support open-source AI startups in Paris with @AIatMeta @ylecun @Scaleway @joinstationf.
@huggingface is a great example that you can build a thriving open-source startups in AI and we hope the next ones might be incubated there!
techcrunch.com/2023/11/08/meta-hugging-face-open-source-a… -
AI at Meta
@AIatMeta
We're excited to announce the launch of this new accelerator program dedicated to open source AI working together with @huggingface, @Scaleway & @joinstationf!
clem 🤗
@ClementDelangue
Support happy to support open-source AI startups in Paris with @AIatMeta @ylecun @Scaleway @joinstationf.
@huggingface is a great example that you can build a thriving open-source startups in AI and we hope the next ones might be incubated there!
techcrunch.com/2023/11/08/meta-hugging-face-open-source-a… -
AI at Meta
@AIatMeta
Excited for the #axiosaisummit today — Ahmad Al-Dahle will be onstage to discuss some of the broad benefits & risks of AI, Meta's generative AI strategy & our perspective on open vs closed approaches to LLMs.
Live starting at 2pm PT ➡️ axiosaisummitsf-virtual.splashthat.com -
AI at Meta
@AIatMeta
We're proud to be part of this multidisciplinary group working to move AI safety forward. By aligning on benchmarks we can ensure these systems are not only cutting-edge, but also safe & reliable, to benefit society.
More on the AI Safety Working Group ⬇️
mlcommons.org/2023/10/mlcommons-announces-the-formation-o… -
AI at Meta
@AIatMeta
Want to build with Llama 2 but don't know where to begin? We put together a new resource that covers everything you need to get started, ranging from getting the models to fine tuning, community resources, FAQs, troubleshooting & more!
Get started with Llama 2 ⬇️ -
AI at Meta
@AIatMeta
Today, Meta & @GeorgiaTech researchers are releasing a new dataset + associated AI models to help accelerate research on Direct Air Capture — a key technology needed to combat climate change.
Paper ➡️ arxiv.org/abs/2311.00341
Models & dataset ➡️ open-dac.github.ioPost not available here, view on X
AI at Meta
@AIatMeta
We’re also releasing new state-of-the-art versions of our ML models developed for the Open Catalyst project, trained on the OpenDAC23 dataset — plus a set of 200+ promising MOF sorbents that we’ve identified.
More on the previous @OpenCatalyst work ⬇️
AI at Meta
@AIatMeta
Today we're releasing the Open Catalyst Demo to the public — this new service will allow researchers to accelerate work in material sciences by enabling them to simulate the reactivity of catalyst materials ~1000x faster than existing computational methods using AI.
Demo ⬇️
AI at Meta
@AIatMeta
We’re excited about these advancements in this space, but there is still plenty of work to be done — we hope that these new resources will help accelerate research across the field.
-
AI at Meta reposted
MLCommons
@MLCommons
Announcing the formation of the AI Safety working group. Making #ai safer for everyone. mlcommons.org/en/news/formation-ai-safety-working-group/ @MLCommons @AnthropicAI @CoactiveAI @Google @IntelAI @intelnews @inflectionAI @AIatMeta @Microsoft @OpenAI @NVIDIAA @joavanschoren @percyliang
-
AI at Meta
@AIatMeta
We're proud to share that our work on SeamlessM4T — the first all-in-one, multilingual multimodal translation model — was recognized today as part of @TIME's Best Inventions of 2023 list!
More details and the full #timebestinventions list ➡️ time.com/collections/best-inventions-2023/ -
AI at Meta reposted
Joelle Pineau
@joellepineau
This is one of the most comprehensive, nuanced and inclusive frameworks for responsibly building and deploying AI models through an open approach. PAI's leadership has been invaluable in bringing together many different opinions and offering clear guidance for AI model builders.
Partnership on AI
@PartnershipAI
Foundation models have become a cornerstone of AI research and development. We need a dynamic framework to enable responsible innovation while ensuring transparency.
Today, we’re proud to announce PAI's Guidance for Safe Foundation Model Deployment: partnershiponai.org/modeldeployment/ -
AI at Meta
@AIatMeta
Today we’re announcing Habitat 3.0, Habitat Synthetic Scenes Dataset and HomeRobot — three major advancements in the development of social embodied AI agents that can cooperate with and assist humans in daily tasks.
More details on these announcements ➡️ ai.meta.com/blog/habitat-3-socially-intelligent-robots-siro/This media couldn't be displayed. See it on the original post.Post not available here, view on X
AI at Meta
@AIatMeta
3️⃣ The HomeRobot library is a new platform for reproducible robotics research, with a focus on Open-Vocabulary Mobile Manipulation as its north star task. It provides a user-friendly software stack for navigation and manipulation capabilities, supporting both simulation and physical-world experiments. The key features include transferability, modularity, and baseline agents
Code ➡️ github.com/facebookresearch/home-robot
AI at Meta
@AIatMeta
We’ve made considerable progress toward our vision of socially intelligent robots in recent years, but there’s still important work to do. The interaction between humans & robots opens up new challenges & possibilities, and we’re excited to continue this important research.
-
AI at Meta
@AIatMeta
Published today in Nature Machine Intelligence — GenBench is an effort led by AI researchers at Meta that aims to make state-of-the-art generalization testing the new status quo for NLP work.
Read more about the work in @NatMachIntell ➡️ go.nature.com/3rXmzfM -
AI at Meta
@AIatMeta
Today we're sharing new research that brings us one step closer to real-time decoding of image perception from brain activity.
Using MEG, this AI system can decode the unfolding of visual representations in the brain with an unprecedented temporal resolution.
More details ⬇️
AI at Meta
@AIatMeta
We're excited about this research and hope that one day it may provide a stepping stone toward non-invasive brain-computer interfaces in a clinical setting that could help people who have lost their ability to speak.
-
AI at Meta
@AIatMeta
Announced today: we're open sourcing ExecuTorch in collaboration with the PyTorch Foundation and industry partners — it's an end-to-end solution for enabling on-device inference capabilities across mobile and edge devices including wearables, phones and more.
PyTorch
@PyTorch
Announcing ExecuTorch 🚀
ExecuTorch offers a compact runtime with a lightweight operator registry to cover the PyTorch ecosystem of models, and a streamlined path to execute PyTorch programs on edge devices.
Details: pytorch.org/blog/pytorch-edge-enabling-on-device-inferenc… -
AI at Meta
@AIatMeta
Applications for Llama Impact Grants are now open!
Today until Nov 15, you can submit a proposal for using Llama 2 to address challenges across education, environment & open innovation for a chance to be awarded a $500K grant.
Details + application ⬇️ -
AI at Meta
@AIatMeta
Newly published work from Meta researchers in @NatMachIntell today! Read the open-access paper at the link below ⬇️
Jean-Rémi King
@JeanRemiKing
`Decoding speech perception from non-invasive brain recordings`,
led by the one an only @honualx
is just out in the latest issue of Nature Machine Intelligence:
- open-access paper: www.nature.com/articles/s42256-023-00714-5
- full training code: github.com/facebookresearch/brainmagick -
AI at Meta
@AIatMeta
We're happy to share that our Segment Anything paper was honored with a Best Paper: Honorable Mention at #iccv2023 today!
You can read the full paper, see additional details and try the demo here ➡️ aidemos.meta.com/segment-anything/ -
AI at Meta
@AIatMeta
🦙 You can now access Code Llama via Amazon SageMaker JumpStart!
Danilo Poccia
@danilop
Code Llama code generation models from Meta are now available via Amazon SageMaker JumpStart 👉 To deploy inference with one click aws.amazon.com/blogs/machine-learning/code-llama-code-gen… #aws #machinelearning #ml #ai #genai #llm
-
AI at Meta
@AIatMeta
We're at #iccv2023 this week to connect with the research community and share some of our latest research.
Here are 5️⃣ papers that Meta researchers are sharing and where you can read more even if you're not attending the conference.
🧵Post not available here, view on X
AI at Meta
@AIatMeta
4. The Stable Signature: Rooting Watermarks in Latent Diffusion Models ➡️ arxiv.org/abs/2303.15435
AI at Meta
@AIatMeta
5. Diffusion Models as Masked Autoencoders ➡️ arxiv.org/abs/2304.03283
-
AI at Meta reposted
Meta for Developers
@MetaforDevs
The Meta Connect TL;DR on AI: We’re building Meta AI into our apps so we’re all more creative, expressive and productive.
-
AI at Meta
@AIatMeta
There's a lot to talk about with Llama 2 at #metaconnect2023. We've published a new post on our blog on the past, present and future of the Llama ecosystem covering some of the updates we shared at Connect and more ⬇️
AI at Meta
@AIatMeta
P.S. Want to start building your own project with Llama 2? Here's the full CoLab notebook from our workshop at #metaconnect2023 today ➡️ github.com/meta-llama/llama-cookbook/blob/main/examples/G…
-
AI at Meta
@AIatMeta
Ready for day two of #metaconnect2023?
Join us for lightning talks on the Llama ecosystem, AI powering our next-generation product experiences & more starting at 11:15am PT!
📆 See the full schedule: metaconnect.com
⚡ Watch the lightning talks: facebook.com/metafordevelopers -
AI at Meta
@AIatMeta
In addition to all of the new product announcements at #metaconnect2023, you heard about some of the research and AI models that helps bring these new features to life.
Here's a look at some of the work you should know about + the research papers where you can learn more ⬇️Post not available here, view on X
AI at Meta
@AIatMeta
Code Llama: Open Foundation Models for Code ➡️ ai.meta.com/research/publications/code-llama-open-foundat…
A version of Llama 2, fine-tuned for generating and discussing code.
AI at Meta
@AIatMeta
Segment Anything ➡️ arxiv.org/abs/2304.02643
This popular model released earlier this year is an important component of the upcoming Backdrop feature in Instagram. -
AI at Meta
@AIatMeta
Code Llama is free for both research and commercial use and we've made three different models available:
- Code Llama
- Code Llama - Python
- Code Llama - Instruct
More details on each of these models and how you can download them ➡️ ai.meta.com/blog/code-llama-large-language-model-coding/ -
AI at Meta
@AIatMeta
Last month we announced SeamlessM4T, a foundational multimodal model for speech translation that can perform tasks across speech-to-text, speech-to-speech and more for up to 100 languages depending on the task.
More details on this work ➡️ ai.meta.com/blog/seamless-m4t/ -
AI at Meta
@AIatMeta
We recently released Belebele, a first-of-its-kind multilingual reading comprehension dataset. It's parallel for 122 language variants, enabling direct comparison of how well models understand different languages.
Dataset ⬇️
github.com/facebookresearch/belebele -
AI at Meta
@AIatMeta
📣 Llama 2 and Code Llama are now on #kagglemodels!
Kaggle
@kaggle
🤖 New on #kagglemodels! Introducing Llama 2 from @MetaAI: a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. 📚 Explore, share, and upvote your favorite notebooks. Happy Kaggling!
goo.gle/3PDlvqA -
AI at Meta
@AIatMeta
We've expanding access to DINOv2 by releasing the training code and model weights under the Apache-2 license.
Details on this and more of our recent work to advance computer vision research and fairness in AI ⬇️ -
AI at Meta reposted
MyoSuite
@MyoSuite
(1/8) In July, we presented SAR at #rss2023. We show that SAR enables SOTA high-dim control by applying the neuroscience of muscle synergies to reinforcement learning!
Check out our thread on SAR below 👇
Site (code, vids): sites.google.com/view/sar-rl/home
Paper: arxiv.org/abs/2307.03716 -
AI at Meta
@AIatMeta
Congratulations @ylecun for being selected as one of the #time100ai for 2023. See the full list and a short interview with Yann on @TIME ➡️ time.com/collections/time100-ai/6309052/yann-lecun/
-
AI at Meta
@AIatMeta
Anyscale Endpoints enables AI application developers to easily swap closed models for the Llama 2 models — or use open models along with closed models in the same application.
ray
@raydistributed
The team @MetaAI has done a tremendous amount to move the field forward with the Llama models. We're thrilled to collaborate to help grow the Llama ecosystem.
www.anyscale.com/blog/anyscale-and-meta-collaborate-to-ad… -
AI at Meta
@AIatMeta
As part of our continued belief in the value of an open approach to today's AI, we've published a research paper with more information on Code Llama training, evaluation results, safety and more.
Code Llama: Open Foundation Models for Code ➡️ arxiv.org/abs/2308.12950 -
AI at Meta
@AIatMeta
Last week we released FACET, a new comprehensive benchmark dataset for evaluating the fairness of models across a number of different vision tasks, constructed of 32K images from SA-1B, labeled by expert annotators.
Read the paper ➡️ ai.meta.com/research/publications/facet-fairness-in-compu… -
AI at Meta
@AIatMeta
Announcing Belebele, a first-of-its-kind multilingual reading comprehension dataset. This dataset is parallel for 122 language variants, enabling direct comparison of how well models understand different languages.
Dataset ➡️ github.com/facebookresearch/belebele
AI at Meta
@AIatMeta
Belebele is composed of carefully crafted multiple-choice questions & answers based on FLORES-200 passages. This work enables the evaluation of NLP systems and large language models in high and low-resource languages.
More details in the paper ⬇️
arxiv.org/abs/2308.16884 -
AI at Meta
@AIatMeta
Today we’re announcing two new updates in our computer vision work — a new, expanded license for our DINOv2 model and the release of FACET, a comprehensive new benchmark dataset to help evaluate and improve fairness in vision models.
More details ➡️ ai.meta.com/blog/dinov2-facet-computer-vision-fairness-ev…
🧵
AI at Meta
@AIatMeta
To support innovation in computer vision, we’re making DINOv2 available under the Apache 2.0 license + releasing a collection of DINOv2-based dense prediction models for semantic image segmentation and monocular depth estimation.
Try our updated demo ➡️ dinov2.metademolab.com
AI at Meta
@AIatMeta
We’re also releasing FACET, a comprehensive benchmark dataset to evaluate fairness of models across different vision tasks involving people. It consists of 32K images, labeled by expert annotators for demographic & physical attributes.
Explore FACET ➡️ facet.metademolab.com -
AI at Meta
@AIatMeta
We believe that AI models benefit from an open approach, both in terms of innovation and safety. Releasing models like Code Llama means the entire community can evaluate their capabilities, identify issues & fix vulnerabilities. github.com/facebookresearch/codellama
-
AI at Meta reposted
Vittorio Caggiano
@CaggianoVitt
💪The biggest release so far!
🧩300+ tasks to challenge the best Reinforcement Learning algorithms to solve real human motor intelligence challenges!
Baselines both on upper and lower limbs!
Try it! ⭐️
github.com/MyoHub/myosuite -
AI at Meta
@AIatMeta
New on @huggingface — CoTracker simultaneously tracks the movement of multiple points in videos using a flexible design based on a transformer network — it models correlation of the points in time via specialized attention layers.
🤗 Try CoTracker ➡️ huggingface.co/spaces/facebook/cotracker
AI at Meta
@AIatMeta
CoTracker can track every pixel in a video, points sampled on a regular grid on any video frame or manually selected points. In our testing it compares favorably against state-of-the-art point tracking methods in both efficiency & accuracy.
Code ➡️ github.com/facebookresearch/co-tracker -
AI at Meta
@AIatMeta
🦙 Llama 2 and Code Llama models are now available in the Vertex AI Model Garden — more details from @GoogleCloudTech ⬇️
Google Cloud Tech
@GoogleCloudTech
Vertex AI, your one-stop shop for building #generativeai apps, just got some upgrades:
🔹 Access 100 large models in Model Garden, including Llama 2 from @MetaAI
🔹 Model and tuning upgrades for PaLM 2, Imagen, and Codey
& more ↓ #googlecloudnext cloud.google.com/blog/products/ai-machine-learning/vertex… -
AI at Meta
@AIatMeta
In the interest of open science and sharing our research, we've published a paper outlining the work on our recently released SeamlessM4T all-in-one multilingual & multimodal translation model.
Read the full paper ➡️ ai.meta.com/research/publications/seamlessm4t-massively-m… -
AI at Meta reposted
Robert Nishihara
@robertnishihara
Just tried out Code Llama (34B) on Anyscale Endpoints.
Impressive work from @MetaAI, and I'm proud to see our team at @anyscalecompute ship this the same day.
Try it out: app.endpoints.anyscale.com -
AI at Meta
@AIatMeta
We evaluated Code Llama against existing solutions on both HumanEval & MBPP.
- It performed better than open-source, code-specific LLMs & Llama 2.
- Code Llama 34B scored the highest vs other SOTA open solutions on MBPP — on par w/ ChatGPT.
More info ➡️ ai.meta.com/blog/code-llama-large-language-model-coding/ -
AI at Meta
@AIatMeta
You can try Code Llama now in the Code Llama playground @huggingface space — it's also available in the Hugging Face ecosystem, starting with transformers version 4.33.
Philipp Schmid
@_philschmid
Code Llama with @huggingface🤗 Yesterday, @MetaAI released Code Llama, a family of open-access code LLMs!
Today, we release the integration in the Hugging Face ecosystem🔥
Models:
👉 huggingface.co/codellama
blog post:
👉 hf.co/blog/codellama
Blog post covers how to use it! -
AI at Meta
@AIatMeta
Today we’re releasing Code Llama, a large language model built on top of Llama 2, fine-tuned for coding & state-of-the-art for publicly available coding tools.
Keeping with our open approach, Code Llama is publicly-available now for both research & commercial use.
More ⬇️ -
AI at Meta
@AIatMeta
SeamlessM4T represents a significant breakthrough in the field of speech-to-speech & speech-to-text by addressing the challenges of limited language coverage & a reliance on separate systems.
More details ➡️ ai.meta.com/blog/seamless-m4t/This media couldn't be displayed. See it on the original post. -
AI at Meta reposted
Hugging Face
@huggingface
🔥 The new SeamlessM4T models from @MetaAI are now available on Hugging Face! 👇
huggingface.co/models?search=facebook/seamless-m4t
Vaibhav (VB) Srivastav
@reach_vb
SeamlessM4T by @MetaAI is removing language barriers via high-quality translation. 🚀
Allowing people from across the world to communicate effortlessly through speech and text! 🤗
One model to rule them all! ♥️
Try it out now: huggingface.co/spaces/facebook/seamless_m4t -
AI at Meta
@AIatMeta
Introducing SeamlessM4T, the first all-in-one, multilingual multimodal translation model.
This single model can perform tasks across speech-to-text, speech-to-speech, text-to-text translation & speech recognition for up to 100 languages depending on the task.
Details ⬇️
AI at Meta
@AIatMeta
Compared to cascaded approaches, SeamlessM4T's single system approach reduces errors & delays, increasing translation efficiency & quality, delivering state-of-the-art results.
Want to see it for yourself, try the demo ➡️ seamless.metademolab.com
AI at Meta
@AIatMeta
We believe SeamlessM4T represents a significant breakthrough and as part of our open approach, today we're publicly releasing this work under a CC BY-NC 4.0 license so that others can continue to build on this important field of study.
Get the code ⬇️
github.com/facebookresearch/seamless_communication -
AI at Meta
@AIatMeta
4️⃣ Interesting research papers we’re presenting at #interspeech2023 in Dublin this week.
Want to see the full list? More on our Interspeech page ➡️ ai.meta.com/events/interspeech-2023/
🧵Post not available here, view on X
AI at Meta
@AIatMeta
EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis ➡️ arxiv.org/abs/2308.05725v1
A high-quality expressive speech dataset for textless speech synthesis — includes read speech & improvised dialogues rendered in 26 spontaneous expressive styles.
AI at Meta
@AIatMeta
Handling the Alignment for Wake Word Detection: A Comparison Between Alignment-Based, Alignment-Free & Hybrid Approaches ➡️ arxiv.org/abs/2302.08950
This paper focuses on understanding alignment's role in developing a wake-word system that answers a generic phrase. -
AI at Meta reposted
Homanga Bharadhwaj @ CoRL
@mangahomanga
How can we learn a single robot manipulation agent capable of non-trivial skills beyond pick/place in 100s of scenes?
We show how this is possible without spending years on data collection!
robopen.github.io
w/@jdvakil @m0hitsharma, Abhinav Gupta, @shubhtuls,@Vikashplus
AI at Meta
@AIatMeta
🤖 New robotics research from Meta AI & @CMU_Robotics — RoboAgent can acquire a wide diversity of non-trivial skills + generalize them to hundreds of unseen scenarios — all w/ an order of magnitude less data than prior works in this space.
More details ➡️ robopen.github.io -
AI at Meta
@AIatMeta
🤖 New robotics research from Meta AI & @CMU_Robotics — RoboAgent can acquire a wide diversity of non-trivial skills + generalize them to hundreds of unseen scenarios — all w/ an order of magnitude less data than prior works in this space.
More details ➡️ robopen.github.io
AI at Meta
@AIatMeta
As part of this work, we're open-sourcing RoboSet, a large, high-quality robotics dataset collected with commodity hardware, to support and accelerate open source research in robot learning.
Get the dataset ⬇️
robopen.github.io/roboset/ -
AI at Meta
@AIatMeta
ImageBind by Meta AI is capable of binding information from six modalities. It equips machines with a holistic understanding that connects objects in photos with how they will sound, their 3D shape, temperature & how they move.
More on this research ➡️ ai.facebook.com/blog/imagebind-six-modalities-binding-ai/ -
AI at Meta
@AIatMeta
📚 New research from Meta AI — Shepherd is a language model specifically tuned to critique model responses & suggest refinements. It goes beyond the capabilities of untuned models to identify diverse errors & suggest improvements.
Read the paper ➡️ arxiv.org/abs/2308.04592 -
AI at Meta
@AIatMeta
New demo available now at the link in Anwar's tweet. More details on this work ➡️ ai.meta.com/blog/muavic-audio-visual-speech-translation-b…
ANWAR 🍉
@anwarvic_
🎙️ Exciting news🌍🗣️ I'm thrilled to share that my team and I at @MetaAI have created a deme to showcase our cutting-edge audio-visual speech models in action! 📽️
You can try out our demo yourself using our GitHub repo 🚀🚀:
github.com/facebookresearch/muavic/tree/main/demo 🧵 -
AI at Meta
@AIatMeta
Great read from the team at @anyscalecompute on fine-tuning Llama 2.
kourosh hakhamaneshi
@CyrusHakha
🚀 Exploring Llama-2’s Quality: Can we replace generalist GPT-4 endpoints with specialized OSS models? Dive deep with our technical blogpost to understand the nuances and insights of fine-tuning OSS models.
🔗www.anyscale.com/blog/fine-tuning-llama-2-a-comprehensive…
🧵 Thread 1/N👇 -
AI at Meta
@AIatMeta
AudioCraft by Meta AI is a one-stop codebase for generative audio consisting of three models: MusicGen, AudioGen & EnCodec — supporting both compression + generation of high-quality music and sound effects from text..
Get the code ⬇️
github.com/facebookresearch/audiocraft/ -
AI at Meta
@AIatMeta
We’re excited for even more people to be able to build with Llama 2 on watsonx.ai!
IBM News
@IBMNews
Today IBM announced it will host @MetaAI's Llama 2-chat 70 billion parameter model in the watsonx․ai studio, furthering their collaboration on open innovation for #ai. Learn more: ibm.co/3DPvouA
-
AI at Meta
@AIatMeta
Today we're sharing our work on PUG, new research from Meta AI on photorealistic, semantically controllable datasets using Unreal Engine for robust model evaluation.
More details & dataset downloads ➡️ pug.metademolab.com
AI at Meta
@AIatMeta
Even the most recent CV models are still struggling w/ basic object classification tasks that are easy for humans. With the new PUG datasets, we can correctly assess and find ways to improve the robustness of these models.
Research Paper ⬇️
arxiv.org/abs/2308.03977 -
AI at Meta
@AIatMeta
Want even more updates on our latest research papers, datasets and more? Subscribe to the Meta AI newsletter to get a regular digest of AI news and updates.
Subscribe ⬇️ -
AI at Meta
@AIatMeta
Hearing community feedback & following internal research & analysis, we've pushed two new updates to the Llama repo to reduce false refusal rates seen with Llama 2-Chat models & improve token sanitization. Full details ➡️ github.com/facebookresearch/llama/blob/main/UPDATES.md
-
AI at Meta
@AIatMeta
Last week, we released the Open Catalyst demo. This work enables scientists to simulate the reactivity of catalyst materials ~1000x faster than existing computational methods — and at a scale of catalyst surface-adsorbate combinations impossible to explore without AI.
Demo ⬇️ -
AI at Meta
@AIatMeta
Today we're sharing details on AudioCraft, a new family of generative AI models built for generating high-quality, realistic audio & music from text. AudioCraft is a single code base that works for music, sound, compression & generation — all in the same place.
More details ⬇️ -
AI at Meta
@AIatMeta
Today we're releasing the Open Catalyst Demo to the public — this new service will allow researchers to accelerate work in material sciences by enabling them to simulate the reactivity of catalyst materials ~1000x faster than existing computational methods using AI.
Demo ⬇️ -
AI at Meta
@AIatMeta
We believe an open approach is the right one for the development of today's Al models.
Today, we’re releasing Llama 2, the next generation of Meta’s open source Large Language Model, available for free for research & commercial use.
Details ➡️ dev.meta.ai -
AI at Meta
@AIatMeta
Introducing ImageBind by Meta AI: the first AI model capable of binding data from six modalities at once. This breakthrough brings machines one step closer to the human ability to bind together information from many different senses.
More on this new open source work ⬇️ -
AI at Meta
@AIatMeta
Today we're releasing the Segment Anything Model (SAM) — a step toward the first foundation model for image segmentation.
SAM is capable of one-click segmentation of any object from any photo or video + zero-shot transfer to other segmentation tasks ➡️ ai.meta.com/blog/segment-anything-foundation-model-image-… -
AI at Meta
@AIatMeta
Meta AI researchers show how current language models differ from the human brain & highlight the role of long-range & hierarchical predictions.
Read the open accessed article in Nature ➡️ go.nature.com/3ZfH7eK -
AI at Meta
@AIatMeta
New in Nature Human Behavior, Meta AI researchers show how current language models differ from the human brain & highlight the role of long-range & hierarchical predictions.
We hope these findings will help inform the next generation of AI ➡️ go.nature.com/3SKb3gX -
AI at Meta
@AIatMeta
Today we're publicly releasing LLaMA, a state-of-the-art foundational LLM, as part of our ongoing commitment to open science, transparency and democratized access to new research.
Learn more & request access ➡️ ai.meta.com/blog/large-language-model-llama-meta-ai/ -
AI at Meta
@AIatMeta
ROSCOE is a first-of-its-kind suite of metrics for scoring step-by-step reasoning. We hope this work provides a foundation that enables scalable systematic evaluation and benchmarking of new language models.
Read the paper ⬇️
arxiv.org/abs/2212.07919 -
AI at Meta
@AIatMeta
See what the humans behind #cicerobymetaai have to say about the breakthrough AI agent they built: @polynoamial, @em_dinan, @alex_h_miller, @adamlerer, @anton_bakhtin, @ml_perception and @joespeez.
For more on CICERO, read our blog: ai.meta.com/blog/cicero-ai-negotiates-persuades-and-coope…This media couldn't be displayed. See it on the original post.Post not available here, view on X
AI at Meta
@AIatMeta
Meta AI’s @anton_bakhtin discusses how he and his team used Reinforcement Learning to teach CICERO the best moves for the millions of possible actions that could be made on any given board state.
This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Save the date for our #cicerobymetaai Reddit AMA! @polynoamial, @em_dinan, @adamlerer, 3X Diplomacy World Champion @TheGoffy & team will be answering questions this week — ask us anything!
🌎 r/machinelearning
🗓️ December 8, 2022
🕘 10am PT
Reply below with your questions 👇 -
AI at Meta
@AIatMeta
5️⃣ interesting things we’re sharing at #neurips2022 this week and how you can see them even if you’re not at the conference.
🧵/6 -
AI at Meta
@AIatMeta
🤝 Forming alliances: 3X Diplomacy World Champ @thegoffy and @adamlerer compare their interactions w/ #cicerobymetaai when forming alliances at the start of their games. Watch the full video: ai.meta.com/research/cicero/diplomacy/
Do you think CICERO made the right decision to ally with Adam? -
AI at Meta
@AIatMeta
#cicerobymetaai generates strategic, free-form dialogue by:
🔮 Predicting the moves other players are likely to make
🔄 Creating a plan based on those predictions
💬 Generating messages
🤖 Filtering the final messages for clarity and value
Read more on our blog ⬇️ -
AI at Meta
@AIatMeta
Meta AI’s @polynoamial and @anton_bakhtin talk about strategic reasoning and how it enables #cicerobymetaai to predict moves from billions of possibilities.
Want to know how CICERO uses planning to find opportunities for mutually beneficial cooperation? Read more on our blog ⬇️ -
AI at Meta
@AIatMeta
Ever wonder how we got to where we are today with AI? Games have always been a proving ground for AI due to their complexity — our work on CICERO included. Only through advancements in strategic reasoning and NLP was CICERO made possible.
Learn more about #cicerobymetaai 👇 -
AI at Meta
@AIatMeta
Meta AI presents CICERO — the first AI to achieve human-level performance in Diplomacy, a strategy game which requires building trust, negotiating and cooperating with multiple players.
Learn more about #cicerobymetaai: ai.meta.com/blog/cicero-ai-negotiates-persuades-and-coope… -
AI at Meta
@AIatMeta
Using HyperTree Proof Search we created a new neural theorem solver that was able to solve 5x more International Math Olympiad problems than any previous AI system & best previous state-of-the-art systems on miniF2F & Metamath.
More in our new post ⬇️ -
AI at Meta
@AIatMeta
Announcing the ESM Metagenomic Atlas — the first comprehensive view of the ‘dark matter’ of the protein universe. Made possible by ESMFold, a new breakthrough model for protein folding from Meta AI.
More in our new blog ➡️ ai.meta.com/blog/protein-folding-esmfold-metagenomics/
1/3 -
AI at Meta
@AIatMeta
(1/3) Until now, AI translation has focused mainly on written languages. Universal Speech Translator (UST) is the 1st AI-powered speech-to-speech translation system for a primarily oral language, translating Hokkien, one of many primarily spoken languages. ai.meta.com/blog/ai-translation-hokkien/
-
AI at Meta
@AIatMeta
Get faster, more flexible inference on GPUs using our newly open-sourced AITemplate, a revolutionary new inference engine that delivers up to 12X performance improvements on NVIDIA GPUs & 4X on AMD GPUs compared to eager-mode within Pytorch.
Learn more: ai.facebook.com/blog/gpu-inference-engine-nvidia-amd-open… -
AI at Meta
@AIatMeta
We’re pleased to introduce Make-A-Video, our latest in #generativeai research! With just a few words, this state-of-the-art AI system generates high-quality videos from text prompts.
Have an idea you want to see? Reply w/ your prompt using #metaai and we’ll share more results. -
AI at Meta
@AIatMeta
Models are increasingly data hungry, but do we really need all that data? @SuryaGanguli, @arimorcos and team show, in theory and practice, that we can beat power law scaling and achieve exponential scaling re: data if we can appropriately rank the importance of each datapoint.
-
AI at Meta
@AIatMeta
(1/4) Meet BlenderBot 3, the first publicly available 175B-parameter chatbot with model weights, code & datasets. It can chat about nearly any topic & is designed to learn & improve by conversing with people in the real world.
Try the interactive demo: ai.facebook.com/blog/blenderbot-3-a-175b-parameter-public… -
AI at Meta
@AIatMeta
What if the internet was a place where everyone could communicate with anyone? In this short clip, @Schrep and Necip Fazil Ayan talk about #nllb and opportunities of the future where people could consume any info on the internet. Watch their full convo: www.youtube.com/watch?v=xbDZRy8pH8E
-
AI at Meta
@AIatMeta
When using Make-A-Scene’s sketch inputs, AI artist @soficrespo91 said she could iterate quickly across new ideas—be it a jellyfish in the shape of a flower or some other hybrid lifeform.
-
AI at Meta
@AIatMeta
We asked AI artists @refikanadol, @soficrespo91, @artBoffin, & @_ScottEaton_ to use it as part of their creative process. “The additional control with the sketch enhances my imagination by offering groundbreaking approaches to SOTA generative AI models,” Refik told us.
This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
Excited to announce Make-A-Scene, our latest research tool Mark Zuckerberg just shared. Make-A-Scene is an exploratory concept that gives creative control to anyone, artists & non-artists alike to use both text & sketches to guide AI image generation: ai.facebook.com/blog/greater-creative-control-for-ai-imag…
-
AI at Meta
@AIatMeta
What makes our NLLB-200 translation model an AI breakthrough?
📝 Translates b/t 200 languages w/verified high quality
📈 Automatic dataset for low-resource languages
📊 New open-source evaluation tools to assess quality in all 200 languages
ai.meta.com/research/no-language-left-behind/
(1/4) -
AI at Meta
@AIatMeta
Today Meta AI is sharing OPT-175B, the first 175-billion-parameter language model to be made available to the broader AI research community. OPT-175B can generate creative text on a vast range of topics. Learn more & request access: ai.facebook.com/blog/democratizing-access-to-large-scale-…
-
AI at Meta
@AIatMeta
Building systems that can securely reason over private data to answer questions or reason about the world is challenging & important. Meta is introducing a new data set, ConcurrentQA, and a new privacy methodology to encourage research in these areas.ai.facebook.com/blog/building-systems-to-reason-securely-…
-
AI at Meta
@AIatMeta
Chief AI Scientist Yann LeCun (@ylecun) is sketching an alternate vision for building human-level AI. LeCun proposes that the ability to learn “world models” — internal models of how the world works — may be the key. Learn more: ai.meta.com/blog/yann-lecun-advances-in-ai-research/
-
AI at Meta
@AIatMeta
Meta is announcing the AI Research SuperCluster (RSC), our latest AI supercomputer 💻 for AI research. RSC will allow our researchers to do new, groundbreaking experiments in #ai. Learn more about RSC and the important role it will play: ai.meta.com/blog/ai-rsc/
This media couldn't be displayed. See it on the original post. -
AI at Meta
@AIatMeta
At #neurips2021 we’re sharing results of the Image Similarity Challenge, an open research competition to create better systems to identify manipulated images. We’re also sharing a unique million-image data set created by Meta AI. ai.facebook.com/blog/detecting-manipulated-images-the-ima…
-
AI at Meta
@AIatMeta
Meta AI researchers are presenting 83 papers at #neurips2021, including eight as spotlights and five as orals. Learn more about wav2vec, Habitat 2.0, and more here: ai.facebook.com/blog/-meta-ai-research-at-neurips-2021-em…
-
AI at Meta
@AIatMeta
We’re releasing NeuralProphet, a scalable and easy-to-use open source framework for hybrid forecasting models. Built in #pytorch, NeuralProphet produces accurate, interpretable time series forecasts quickly.
ai.facebook.com/blog/neuralprophet-the-neural-evolution-o… -
AI at Meta
@AIatMeta
The researchers behind Meta AI’s open source Detectron #computervision library (which recently received the Everingham Prize for contributions to the CV community) discuss how the project came about, how the OS community has contributed, & what comes next.ai.facebook.com/blog/detectron-everingham-prize/
-
AI at Meta
@AIatMeta
We're releasing XLS-R, a self-supervised multilingual model trained on 128 languages for a variety of speech tasks.
XLS-R sets a new state of the art on several speech recognition benchmarks, foreign-to-English speech translation & language identification.
ai.facebook.com/blog/xls-r-self-supervised-speech-process… -
AI at Meta
@AIatMeta
With this new partnership, @paperswithcode aims to make it easier to access open-source code and ML datasets from ACL papers. A special thanks to the @aclanthology team for the collaboration.
Papers with Code
@paperswithcode
🎉 Papers with Code partners with ACL!
Access code and datasets directly from ACL papers.
Huge thanks to @mjpost and @mmbollmann for the collaboration. -
AI at Meta
@AIatMeta
We built & open sourced the first-ever multilingual model to win the prestigious WMT competition, showing this approach is the future of machine translation. One-model-for-many-languages is simpler, more scalable, and can help deliver better translations. ai.facebook.com/blog/the-first-ever-multilingual-model-to…
-
AI at Meta
@AIatMeta
Today, as part of a larger tactile-sensing ecosystem, we’re announcing two major advances: DIGIT, a commercially available touch-sensing hardware produced in partnership with GelSight, and ReSkin, a replaceable, low-cost tactile skin. Read more about our work in touch sensing:
-
AI at Meta
@AIatMeta
Ever wondered if you already added an ingredient when cooking a meal? Or what to attach next when assembling a dresser? Facebook AI has built Anticipative Video Transformer, a model that can understand sequences of events & suggest the next step. Details:
ai.facebook.com/blog/anticipative-video-transformer-impro… -
AI at Meta
@AIatMeta
Congratulations to the Detectron team Ross Girshick, Yuxin Wu, Ilija Radosavovic, Alexander Kirillov, Georgia Gkioxari, Francisco Massa, Wan-Yen Lo, Piotr Dollár, & Kaiming He for winning the PAMI Everingham Prize at #iccv2021. Learn about the platform: ai.facebook.com/tools/detectron2/
-
AI at Meta
@AIatMeta
We are launching the Open Catalyst Challenge, an open AI research competition to build new machine learning models that will help scientists discover new catalysts for efficient, economical green energy storage.
Learn more: ai.facebook.com/blog/open-catalyst-challenge-using-ai-to-… -
AI at Meta
@AIatMeta
We are releasing pretrained HuBERT speech representation models and code for recognition and generation. By alternating clustering and prediction steps, HuBERT learns to invent discrete tokens representing continuous spoken input.
Learn more: ai.facebook.com/blog/hubert-self-supervised-representatio… -
AI at Meta
@AIatMeta
Excited to announce the expansion of a long-standing collaboration with @SCSatCMU. The FRAIM program gives PhD students at CMU a unique opportunity to perform their research in collaboration with their thesis adviser and a Facebook researcher. Learn more: ai.meta.com/blog/facebook-ai-and-facebook-reality-labs-an…
-
AI at Meta
@AIatMeta
Come watch @ylecun talk about "The Energy-Based view of Self-Supervised Learning" at #gtc21 on Tuesday April, 13th at 12:00pm PDT. Register here: gtc21.event.nvidia.com/user/login?ref=%2Fmedia%2FThe%20En… #nvidiagtc
-
AI at Meta
@AIatMeta
Facebook AI has built TimeSformer, a new architecture for video understanding. It’s the first based exclusively on the self-attention mechanism used in Transformers. It outperforms the state of the art while being more efficient than 3D ConvNets for video.ai.facebook.com/blog/timesformer-a-new-architecture-for-v…
-
AI at Meta
@AIatMeta
Facebook wants AI to be open to everyone with the curiosity to make a positive impact. To build a new path into AI, we’re launching Rotational AI Science & Engineering, a 24-month program for experienced engineers from a variety of disciplines. Learn more: ai.facebook.com/blog/facebook-ais-raise-program-an-innova…
-
AI at Meta
@AIatMeta
We’re open-sourcing a new system to train computer vision models using Transformers. Data-efficient image Transformers (DeiT) is a high-performance image classification model requiring less data & computing resources to train than previous AI models. ai.facebook.com/blog/data-efficient-image-transformers-a-…
-
AI at Meta
@AIatMeta
Hate speech can come in many forms, including memes that combine text & images. We launched the Hateful Memes Challenge, a first-of-its-kind competition, to help the AI community find new ways to detect multimodal hate speech. Learn about the winners here: ai.facebook.com/blog/hateful-memes-challenge-winners
-
AI at Meta
@AIatMeta
Facebook's AI Residency program, which gives residents 12 months of practical experience in AI working with leading researchers, is accepting applications until January 31st! Please apply today: www.facebook.com/careers/jobs/?q=AI Residency
-
AI at Meta
@AIatMeta
AI bots have bested humans in both chess and poker but the algorithms used to win each game were very different. Today we introduce ReBeL, a major step towards a single AI algorithm that can play all games including chess, Go, poker, Liar's Dice and more.
ai.facebook.com/blog/rebel-a-general-game-playing-ai-bot-… -
AI at Meta
@AIatMeta
Today we announced our partnership with @OpenMinedOrg to offer developers a new series of #pytorch privacy and machine learning courses:
- Privacy and Society
- Foundations of Private Comp.
- Enterprise Federated Learning
- Federated Learning on Mobile
ai.facebook.com/blog/facebook-ai-openmined-partner-on-new… -
AI at Meta
@AIatMeta
We’ve launched the Deepfake Detection Challenge, an open, collaborative initiative to accelerate development of new technologies to detect deepfakes and manipulated media. The challenge features a new, unique data set of 100K-plus videos for researchers. ai.facebook.com/blog/deepfake-detection-challenge-launche…
-
AI at Meta
@AIatMeta
Facebook AI researchers are sharing an all-attention layer to simplify the Transformer model and an adaptive attention span method to make it more efficient. Even with a much simpler architecture, these methods match or improve state-of-the-art results. ai.facebook.com/blog/making-transformer-networks-simpler-…
-
AI at Meta
@AIatMeta
New research from Facebook AI shows that neural networks can learn linguistic fundamentals by training on the interaction between individual letters rather than whole words. Read more: ai.facebook.com/blog/teaching-ai-systems-to-learn-languag… #researchinbrief
-
AI at Meta
@AIatMeta
Facebook AI and @CarnegieMellon researchers have built Pluribus, the first AI bot to beat elite poker pros in 6 player Texas Hold’em. This breakthrough is the first major benchmark outside of 2 player games and we’re sharing specifics on how we built it. ai.facebook.com/blog/pluribus-first-ai-to-beat-pros-in-6-…
-
AI at Meta
@AIatMeta
We're open sourcing PyRobot, a lightweight, high-level interface that lets #ai researchers get up and running with #robotics experiments in just hours. No specialized robotics expertise needed! ai.facebook.com/blog/open-sourcing-pyrobot-to-accelerate-…
-
AI at Meta
@AIatMeta
We’re open sourcing PyTorch-BigGraph, a tool that makes it much faster and easier to produce graph embeddings for extremely large graphs. Quickly produce high-quality embeddings without specialized computing resources like GPUs or huge amounts of memory. ai.facebook.com/blog/open-sourcing-pytorch-biggraph-for-f…
-
AI at Meta
@AIatMeta
A big congratulations to our Chief AI Scientist @ylecun on receiving the ACM 2018 A.M. Turing Award alongside Yoshua Bengio and @geoffreyhinton! Read Yann's reflections on the early and ongoing work that led to today's deep learning revolution. ai.facebook.com/blog/-turing-award-presented-to-yann-lecu…





















































































































































































































































































































































































































































