We benchmarked Genie, powered by Genie Ontology, against two frontier agents on enterprise data tasks. Here's what we found.
In collaboration with @turingcom, we developed a benchmark that tests more than table queries. Agents had to use business knowledge spread across notebooks, dashboards, and saved SQL queries in a live Databricks workspace, running each agent five times per task.
Genie passed 91% of runs, compared with 45% and 58% for the other agents, while using less than half the tokens and finishing 3โ4ร faster.
The key difference is business context. A valid SQL query can still produce the wrong answer if it uses the wrong definitions or calculation rules.
Genie Ontology retrieves and prioritizes business knowledge, helping agents find and apply the right context instead of relying on table schemas alone.
Explore the benchmark and methodology: www.databricks.com/blog/genie-genie-ontology-delivers-16-โฆ
Databricks
Databricks, Inc. is an American data software and artificial intelligence company headquartered in San Francisco, California. It was founded in 2013 by the original creators of Apache Spark, an open-source framework that was commercialized as Spark through the company. It offers cloud computing-based data analytics solutions, and can run on Amazon Web Services, Microsoft Azure, and Google Cloud Platform. More on Wikipedia
-
Databricks
@databricks
-
Databricks
@databricks
New AI models now launch about once a week. Picking the right one is getting harder.
Today we're launching the ๐๐ฎ๐๐ฎ๐ฏ๐ฟ๐ถ๐ฐ๐ธ๐ ๐๐ ๐๐ป๐ฑ๐ฒ๐ , a public resource that let's you explore which models companies use, where spending goes, and which coding agents deliver the best quality for the cost.
Customers have repeatedly asked us how new models compare and what we're seeing across enterprise AI adoption to help inform their own investments. So we're sharing anonymized usage from thousands of enterprises on Unity Gateway, plus a coding-agent benchmark built on our private codebase.
www.databricks.com/blog/introducing-databricks-ai-index-sโฆ -
Databricks reposted
Patrick Wendell
@pwendell
1/ Today weโre publishing the Databricks AI Index, showing trends from enterprises who manage AI with our Unity Gateway. Data covers >10,000 companies with broad representation (Digital Natives, Fortune 500, Global 2000, etc...). Enterprise AI consumption is changing quite a bit:
-
Databricks
@databricks
Gartnerยฎ has named Databricks a Leader in the 2026 Magic Quadrantโข for Data Lakehouse Platforms and the only vendor in the Visionary quadrant for the 2026 Garterยฎ Magic Quadrantโข for Cloud Operational Database Management Systems.
For us, this reflects a broader shift in the market. Operational and analytical workloads are increasingly converging, and we believe Databricks is building for that future with the lakehouse and lakebase.
Read the reports: www.databricks.com/lp/databricks-recognized-data-lakehousโฆ -
Databricks
@databricks
Introducing Publish to Power BI for Unity Catalog metric views!
Teams can now define business metrics once in Databricks and publish them directly to Power BI, bringing the same governed definitions to the reports, dashboards, and AI agents they already use.
Instead of maintaining metric logic across multiple tools, teams can work from a single source of truth, with Power BI models automatically kept in sync as definitions evolve.
Learn more: www.databricks.com/blog/unity-catalog-metric-views-now-poโฆ -
Databricks
@databricks
From a small Berkeley research lab to a new 235,000+ square-foot home in San Francisco.
We've officially opened One Sansome, our new global HQ and a hub for the teams advancing AI research and building products like Genie, Lakebase, and Unity Gateway.
It's part of our $1B+ commitment to San Francisco and the next chapter in our story.
Take a look inside: www.databricks.com/blog/databricks-doubles-down-ai-producโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
I am 10x better at my job compared to a year ago. I run all of the company on Genie. But the reason it's really powerful is the Agentic Ontology, which is constantly being curated and evolved for the whole company. This helps our agents have much higher quality and significantly less cost. This is how it works:
www.databricks.com/blog/genie-genie-ontology-delivers-16-โฆ -
Databricks reposted
Newcomer
@NewcomerMedia
Stopping model distillation will be "impossible," said @alighodsi
This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
๐ฝ Spotted in Times Square.
Databricks on the @Nasdaq tower, celebrating the inaugural AI 100. -
Databricks
@databricks
AI is moving beyond answering questions. It's writing code, analyzing data, and taking on entire business processes.
But powerful models alone aren't enough. They need access to the right company data, business context, and governance.
That's what our partnership with @OpenAI brings together:
โข Accelerating work for business users with ChatGPT + Genie
โข Coding with enterprise-level governance through Codex and Unity Gateway
โข Transforming business processes with GPT models and Databricks Apps
Three ways to bring frontier AI into the enterprise, built around the data and controls businesses already rely on.
See how it all works together: www.databricks.com/blog/openai-and-databricks-enterprise-โฆ -
Databricks reposted
Julia Neagu
@juliaaneagu
I am hiring a Researcher for my team at @databricks AI Research.
If you have a deep instinct for measuring complex systems and want to build self-improving agents at the frontier, I'd love to talk.
Link below ๐ -
Databricks
@databricks
Databricks ranked #3 on @NewcomerMedia and @BessemerVP's inaugural AI 100 list of the world's top private AI companies.
AI agents are starting to do more than answer questions. To be useful at work, they need to understand your business, operate within its governance requirements, and act on trusted data.
That's what we're building with the Databricks Data + AI Platform.
Thanks to Newcomer and Bessemer for the recognition!
Eric Newcomer
@EricNewcomer
Here's the AI 100
@NewcomerMedia + @BessemerVP -
Databricks
@databricks
Gemini 4 Hydrogen is available on Databricks on Day 0.
Pair it with Carbon: Carbon plans and coordinates, Hydrogen executes and verifies sub-agent tasks. Google reports 2.5x faster task completion than Gemini 3.8 Flash.
Govern both through Unity Gateway ๐ซก
Google DeepMind
@GoogleDeepMind
Meet Gemini 4 Hydrogen: built for rapid coding, multimodal synthesis, and everyday workflows.
It finishes tasks 2.5x faster than 3.8 Flash and surpasses Argon on the @ArtificialAnlys Intelligence Index. -
Databricks
@databricks
Your business context can now come with you into ChatGPT.
With the new Genie plugin for ChatGPT, ask complex questions like why activation is low or which accounts are at risk. Genie uses your business ontology to interpret metrics, finds the right data, runs SQL, and can route deeper investigations to domain-specific Genie Agents. You get answers backed with rich citations.
Long-running agents like Dots can also bring that context into their own runtime as they work on long running tasks.
Get started with the Genie Plugin in ChatGPT today: openai.com/business/plugins/databricks/This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Genie Agents can now analyze thousands of documents alongside governed data and take action inside your tools.
A table might show margins declining, but the explanation could be buried in analyst reports.
With unstructured data analysis now in public preview, Genie Agents can connect those findings in one conversation, with page-level citations.
The next step is action. Native MCP connectors are now generally available, letting agents take those insights further by creating tickets, updating records, and posting messages across enterprise tools.
www.databricks.com/blog/enterprise-context-action-genie-aโฆ -
Databricks
@databricks
The first-ever @Gartner_inc Magic Quadrantโข for Data Lakehouse Platforms is here, and Databricks has been named a Leader!
In our opinion, this is a major milestone for the lakehouse architecture, which we believe validates the category we pioneered, and we're proud to see it as a category in a Magic Quadrant.
Explore the full report: www.gartner.com/doc/reprints?id=00ThR00000TGVkTUAX&ct=261โฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
Lakebase will mark a phase shift in database technology! It'll enable LTAP, true multi-master, etc.
Nikita | Scaling Lakebase Postgres
@nikitabase
There are two unclimbable mountains in database world: 1 Combined transactional/analytical processing 2 true multi-master scale out
We are making significant progress on both in Lakebase -
Databricks reposted
Matei Zaharia
@matei_zaharia
Genie has transformed how I work as CTO at Databricks, even more than coding agents. It connects across production data, GitHub, Drive, Slack and the web, and automatically learns from this data (Genie Ontology), so I can ask it to do stuff like:
- Tell me how competitors position vs each of our products and which critiques are valid
- Find when and why a design decision was made
- Find bugs based on production events + code changes
- Prototype code changes that would speed up our slowest services in production
Really, it can do so much stuff that I would never even bother to ask a person that it totally changes how you work and the size of tasks you can take on directly. Learn more about our latest release of Genie: www.databricks.com/blog/new-genie-autonomous-ai-complex-eโฆ -
Databricks
@databricks
Introducing Databricks Genie plugins for ChatGPT, Claude, Microsoft Copilot Cowork and Grok Bot!
More data doesn't automatically mean better answers. An AI agent may find the right data but still use the wrong context.
Now, your agents can tap into Genie to access governed business context, investigate questions across data and documents, and return answers with citations, all within their existing workflow.
Build your Ontology once. Bring it to the AI tools your teams already use.
www.databricks.com/blog/bring-your-business-context-chatgโฆ -
Databricks
@databricks
๐ก๐ฒ๐ ๐ถ๐ป ๐๐ฒ๐ป๐ถ๐ฒ ๐ข๐ป๐ฒ: dynamic dashboards and slides, more ways to search, org directories, shareable skills, tracing, and more!
Work rarely stays in one application. Genie One brings search, finished work, and actions across connected tools into one home for AI cowork, grounded in Genie Ontology.
Through Unity Gateway, admins can trace sources and actions, control tool access and approvals, and manage usage and costs, helping teams scale AI cowork confidently.
www.databricks.com/blog/genie-one-ai-cowork-home-everyone -
Databricks reposted
TechCrunch
@TechCrunch
At 12,000 employees, AI Ghodsi is the first to admit that he can't know everyone and that they are unlikely to confess the things that go wrong to him. But he doesn't need them to. He uses Databricks' newly revised Genie agent for that.
techcrunch.com/2026/11/11/databricks-new-ai-agent-tells-cโฆ -
Databricks
@databricks
Genie Ontology is now Generally Available.
Most business knowledge isn't formally modeled. It lives in dashboards, SQL queries, notebooks and documents. Genie Ontology learns from everyday work, combines that context with governed Unity Catalog semantics, and ranks sources by authority so agents use trusted information.
What's new:
- ๐๐ฒ๐ป๐ถ๐ฒ ๐ฆ๐ฒ๐ฎ๐ฟ๐ฐ๐ต: Search enterprise knowledge across Google Drive, Jira, Confluence and Workday
- ๐๐ ๐๐ฒ๐ฟ๐ป๐ฎ๐น ๐ธ๐ป๐ผ๐๐น๐ฒ๐ฑ๐ด๐ฒ ๐๐ผ๐๐ฟ๐ฐ๐ฒ๐ (Beta): Bring in business logic from Power BI
- ๐ข๐ฟ๐ด๐ฎ๐ป๐ถ๐๐ฎ๐๐ถ๐ผ๐ป๐ฎ๐น ๐ฑ๐ถ๐ฟ๐ฒ๐ฐ๐๐ผ๐ฟ๐ถ๐ฒ๐: Add people, teams and reporting relationships
- ๐จ๐ป๐ถ๐๐ ๐๐ฎ๐๐ฎ๐น๐ผ๐ด ๐๐ผ๐บ๐ฎ๐ถ๐ป๐ ๐ฎ๐ป๐ฑ ๐ฃ๐ฎ๐ด๐ฒ๐: Now GA
- ๐ข๐ป๐๐ผ๐น๐ผ๐ด๐ ๐ ๐ฎ๐ป๐ฎ๐ด๐ฒ๐ฟ: Coming soon in Beta for curation and governance
In a benchmark developed with @turingcom, Genie with Genie Ontology delivers 1.6ร the accuracy with less than half the tokens.
www.databricks.com/blog/announcing-ga-genie-ontology -
Databricks reposted
Ali Ghodsi
@alighodsi
A year ago, I ran @databricks totally differently from today. Getting stuff done at Databricks involved calling ppl, scheduling meetings, and lots of back and forth.
Today, I just wake up and use Genie, which works for me in the background. I often just use the phone app to queue up work in the background.
Three examples from just this week:
โ Org charts. How do we flatten the org? It literally found me the hotspots where many projects had gotten stuck. Turns out the data was already in the ontology graph.
โ New internal project everyone raves about (Keanu). Genie monitored the slack channel, got all the insights, correlated them with the source code, and gave me a dashboard of what I needed.
โ New culture survey. Used ontology to figure out from the org chart, work output, and survey scores, which leaders are AI pilled. Why certain scores (e.g. work-life balance) are so low.
These are things that used to take me hours and many meetings, often waiting for the data science team. This is possible because Genie has access to an Agentic Ontology, so it proactively does all the work in the background for me.
Learn more about our next-generation release of Genie:
databricks.com/blog/new-genie-autonomous-ai-complex-enterโฆ -
Databricks
@databricks
Starting in one hour ๐ง
Databricks
@databricks
Something's loading...
Tomorrow, join Databricks Co-founder and CEO @alighodsi, @OpenAI Co-founder and President @gdb, and other special guests for DATA + AI LIVE and a first look at the next generation of Genie, the data smart AI coworker.
Context is just the beginning.
9 AM PT. Save your spot:
www.linkedin.com/events/data-ailive-contextisjustthebeg75โฆ -
Databricks
@databricks
๐๐ป๐๐ฟ๐ผ๐ฑ๐๐ฐ๐ถ๐ป๐ด ๐๐ต๐ฒ ๐ป๐ฒ๐ ๐๐ฒ๐ป๐ถ๐ฒ: an always-on, autonomous AI coworker that proactively handles long-running work within your organization's guardrails.
AI assistants can answer questions and run analyses. But most enterprise work is complex and continuous, requiring teams to track changes, follow up, and take action.
Genie Ontology is now generally available, providing the shared business context behind it. The agentic ontology now includes new knowledge sources and new ways to curate and govern that context.
New capabilities across Genie Agents and plugins extend that same context to more workflows and AI tools.
Here's what's new: www.databricks.com/blog/new-genie-autonomous-ai-complex-eโฆ -
Databricks
@databricks
Gemini 4 Carbon. Day 0 on Databricks.
Google's strongest model for complex coding, scientific reasoning, and long-running agent workflows is available on Databricks the same day it opened to developers.
In our enterprise-document testing, Carbon scored 66.7% on OfficeQA Pro v2, compared with 57.8% for Gemini 4 Argon, our previous best Gemini result.
Now put it to work on your own data. Unity Gateway handles access, usage limits, and spend tracking across Carbon and every other model your teams use. -
Databricks
@databricks
Something's loading...
Tomorrow, join Databricks Co-founder and CEO @alighodsi, @OpenAI Co-founder and President @gdb, and other special guests for DATA + AI LIVE and a first look at the next generation of Genie, the data smart AI coworker.
Context is just the beginning.
9 AM PT. Save your spot:
www.linkedin.com/events/data-ailive-contextisjustthebeg75โฆ -
Databricks reposted
Ankit Mathur @ankit_math
Iโm speaking at the @aiDotEngineer about agent infra for the next generation of agents!
Join me Wednesday, 11:45AM on the main stage
Session details here: ai.engineer/code/2026/schedule?view=list&session=1373459 -
Databricks
@databricks
Your app data is already in Postgres. Why move it somewhere else just to search it?
Lakebase Search brings vector, BM25 full-text, and hybrid search into the same database as your operational data. You can combine search with live data using SQL, without a separate search engine or ETL pipeline to maintain.
Now generally available on AWS and Azure. www.databricks.com/blog/lakebase-search-state-art-full-teโฆ -
Databricks
@databricks
๐ Heading to AI Engineer Code Summit? Come build with us!
Tomorrow, our own Elise Gonzales and @bradfordc are hosting a hands-on @omnigent_ai workshop.
You'll build a GitHub CI workflow that connects specialist agents across models and coding harnesses to review PRs, coordinate repairs, and validate changes. Leave with version-controlled agent configurations and a runnable workflow you can adapt to your own projects.
Workshop details โ
ai.engineer/code/2026/schedule?session=1373449
AI.Engineer ๐ CODE
@aiDotEngineer
From review comments to tested fixes.
Build a PR review and repair workflow with @omnigent_ai, led by Elise Gonzales and @bradfordc of @databricks.
Agent roles, permissions, repairs and validation. You leave with a runnable workflow.
Nov 10 at AIE CODE, San Francisco.
Workshop add-on required.
Apply: ai.engineer/code -
Databricks
@databricks
Claude Fable 5.2 lands on Databricks on Day 0.
Built for coding, finance and science, it sets a new high on our OfficeQA Pro v2 benchmark.
Run long-running agents on governed data, with Unity Gateway controlling calls across 70+ models.
Claude
@claudeai
Introducing Claude Fable 5.2 and Claude Mythos 5.2, designed to tackle the most daunting technical challenges.
Theyโre capable collaborators on ambitious projects in many fields, and show improvements in areas like coding, reasoning, and vision.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
We started by giving engineers access to the most expensive AI coding models and as many tokens as they wanted. Adoption took off. So did costs.
At Databricks, we've since reduced AI coding unit costs by up to 90% in some cases through more efficient models, better routing, spend visibility and less token overhead.
Our co-founder @pwendell explains what worked and how we kept developers moving. www.databricks.com/blog/ai-bill-coming -
Databricks
@databricks
๐ Document Intelligence REST APIs for parsing, extraction, and classification are now GA.
Apps and agents can process documents as they arrive, extract structured data, and surface optional citations for review. Plus, ai_decide is in Beta for routing.
www.databricks.com/blog/power-real-time-applications-and-โฆ -
Databricks
@databricks
A great Genie demo is just the beginning. Here's how to turn early momentum into trusted, organization-wide adoption.
โ Start with one team and a clear set of business questions
โ Test answers against known-correct results
โ Refine business definitions based on feedback
โ Expand to adjacent teams as accuracy and governance checks are met
Read the step-by-step guide: www.databricks.com/blog/how-roll-out-genie-one-step-step-โฆ -
Databricks
@databricks
You ship code in seconds and build apps, agents, and AI products faster than ever. So why does your database still take hours to provision?
Lakebase is a new category of serverless Postgres database built for the way teams write software today, with instant branching, separate compute and storage, and architecture designed to scale with app and agent workloads.
Read ๐๐ข๐ฌ๐ฆ๐ฃ๐ข๐ด๐ฆ ๐๐ฐ๐ณ ๐๐ถ๐ฎ๐ฎ๐ช๐ฆ๐ด to learn:
โข Why traditional databases break down under modern app and agent workloads
โข How separating compute from storage changes cost, speed, and reliability
โข What instant branching and cloning unlock for development teams
โข How the lakebase architecture fits alongside your lakehouse for unified transactional and analytical work
www.databricks.com/resources/ebook/lakebase-for-dummies -
Databricks
@databricks
You can write data back to Databricks without leaving Excel.
Use the Databricks add-in for Excel to make changes and publish them to Unity Catalog tables, with write permissions enforced.
Here's how it works โ
www.youtube.com/watch?v=EH2vgQfd6VQThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Agents can build software. But what about the databases behind it?
Databricks VP of Engineering and @neondatabase co-founder @nikitabase joined @MTSlive to talk about database branching, serverless architecture, and building for both AI agents and enterprise workloads. -
Databricks
@databricks
Data prep doesn't have to start with code.
Lakeflow Designer lets you prepare and transform data directly in Databricks using a visual, no-code interface.
Great walkthrough from @joshbogran.
Josue Bogran
@joshbogran
As a long time fan of making @databricks accessible to everyone, I love how it is easier and easier for business users with limited technical background to use many of Databricks' capabilities. Check out Lakeflow Designer: youtu.be/IkgV9KWGksA
-
Databricks
@databricks
Enterprise AI is only as useful as the data and business context behind it.
At #dataaiworldtour 2026, see how organizations are building AI apps and agents grounded in their enterprise data, while maintaining control over usage, costs, and choice.
Join Databricks leaders, customers and partners for the latest on Genie, Agent Bricks, Lakebase and Unity Gateway.
13 free, one-day events remain across North America, Europe and Asia.
Find a stop near you: www.databricks.com/dataaisummit/worldtour -
Databricks
@databricks
Spatial SQL and spatial joins are now supported on Lakehouse//RT!
In SpatialBench, queries ran up to 38X faster at 50 concurrent users than a traditional cloud data warehouse, among queries it could complete.
www.databricks.com/blog/geospatial-queries-are-38x-fasterโฆ -
Databricks
@databricks
Introducing Apache Sparkยฎ 4.3, now available in Databricks Runtime 19!
The release brings major new capabilities across real-time processing, history-preserving pipelines, small-data performance, Spark Connect, and SQL.
Whatโs new:
- Bring state to Real-Time Mode with streaming aggregation and transformWithState
- Preserve history with SCD Type 2 Auto CDC
- Iterate faster on small data with Project Feather
- Reach Spark from more applications with expanded Spark Connect capabilities
It also begins a new quarterly feature-release cadence, bringing completed improvements to users sooner.
Get started: www.databricks.com/blog/introducing-apache-spark-43-now-aโฆ -
Databricks
@databricks
Multi-statement transactions are now GA on Databricks, supporting Delta Lake and Apache Iceberg!
Run multi-step warehouse workflows atomically, directly on the lakehouse, without needing a separate warehouse.
www.databricks.com/blog/transactions-are-generally-availaโฆ -
Databricks
@databricks
Kimi K3.1 Pro is available on Databricks on day 0.
Build governed AI apps and agents on Lakehouse data with Kimi K3.1 Pro and 70+ other models. Unity Gateway lets you govern, monitor and secure calls, and test models without changing app code.
Kimi.ai
@Kimi_Moonshot
Releasing the model weights of Kimi K3.1 Pro: huggingface.co/moonshotai/Kimi-K3.1-Pro
We'll keep advancing open intelligence. -
Databricks
@databricks
We benchmarked Lakebase Search on 1M to 4M passages to understand how vector search performs as the index grows. Here's what we learned ๐
Cache size relative to the vector index mattered more than row count. When the cache roughly matched the index, 95โ98% of page reads avoided storage and warm vector search p50 latency stayed between 11 and 23 ms.
As datasets grow, sizing the cache alongside the vector index helps maintain low-latency search.
www.databricks.com/blog/sizing-lakebase-search-lessons-reโฆ -
Databricks
@databricks
Your Iceberg tables shouldn't be locked into a single catalog.
REGISTER and UNREGISTER enable transfers between catalogs without copying data, while reducing split-brain risk.
More on the open standard: www.databricks.com/blog/unlocking-data-portability-prevenโฆ -
Databricks
@databricks
Join Databricks Co-founder and CEO @alighodsi and @OpenAI co-founder and President @gdb, and other special guests at DATA + AI LIVE to hear exciting announcements about the next generation of Genie, the data smart AI coworker.
Get a first look on Nov 11 at 9 AM PT. Save your spot: www.linkedin.com/events/7516902543436939264 -
Databricks
@databricks
Somehow, buying AI tokens became an engineering problem.
Less time managing spend. More time shipping with Unity Gateway!
Yuchen Jin
@Yuchenj_UW
AI bills are exploding everywhere.
Since joining Databricks, I've seen brilliant engineers across the industry (Distinguished Engineers, Berkeley/MIT/Stanford PhDs) spend months figuring out where to buy AI tokens.
Let me save you some time.
Choose Databricks AI Gateway:
- Fast open-source and proprietary models, available on Day 0.
- Smart Routing cut our internal coding costs by 35%.
- Easily track spending and set budgets across teams.
Spend less time managing AI tokens. Spend more time building. -
Databricks
@databricks
Stripe Data Pipeline now supports real-time sync to Lakebase Postgres!
With updates arriving within seconds, apps can use SQL to manage feature access, display billing details, and deliver personalized offers.
www.databricks.com/blog/stripe-data-pipeline-now-syncs-reโฆ -
Databricks
@databricks
AI research is changing as agents take on more of the experimentation loop.
Instead of manually running every trial, our researchers increasingly use agents to propose changes, launch parallel experiments, evaluate results, and decide what to try next.
Across our AI Functions research workloads, training jobs have grown 8x.
At that scale, launch latency and GPU reliability become critical. Here's how we're using AI Runtime to keep up with the pace of agent-driven research.
www.databricks.com/blog/how-our-ai-research-team-uses-ai-โฆ -
Databricks
@databricks
More ways to build, validate, and manage data preparation workflows in Lakeflow Designer ๐ซก
Our October roundup highlights the latest enhancements:
โข Guardrails for data quality checks, with control over what happens when checks fail
โข No-code operators for cleaning and deduplication
โข Multi-table joins in a single operator
โข Parameterized inputs and outputs
โข Visual version history to easily review workflow changes
www.databricks.com/blog/whats-new-lakeflow-designer-octobโฆ -
Databricks
@databricks
[DEMO] Your AI agents can query data. But do they understand what it means?
See how Genie Ontology, Genie One, MCP, and Unity Gateway help agents use trusted business context with guardrails in place.
Watch the demo: youtu.be/ZuLAAdIjeeE -
Databricks
@databricks
We're excited to expand our partnership with @SAP this week at #sapteched!
AI needs business context, and much of it lives in SAP systems. The new SAP Application Data Foundation simplifies access to cloud and on-premises application data in SAP Databricks, helping reduce custom pipelines, TCO, and time to value.
With Genie, Lakebase, Unity Gateway, and Lakeflow coming to the platform, teams can put that data to work across analytics, apps, and AI agents.
www.databricks.com/blog/databricks-and-sap-unleash-end-enโฆ -
Databricks
@databricks
Agents shouldn't have to relearn the same facts every session.
Agent Memory on Agent Bricks combines session history with distilled long-term memories. A background pipeline extracts durable facts, removes duplicates, and replaces information contradicted by newer conversations. Lakebase provides low-latency access.
In our internal benchmarks of enterprise data tasks, this memory architecture tripled agent pass rates while using 31% fewer tokens compared to agents without memory.
www.databricks.com/blog/introducing-agent-memory-databricks -
Databricks reposted
MTS
@MTSlive
Databricks VP @nikitabase argues Claude Code is just the beginning, and the next wave of AI software factories will require an entirely new infrastructure stack:
"Claude Code was all the rage, still all the rage. But now we're talking about AI factories. We're moving from a tool that helps you generate code better to a platform where you can ship software as a factory."
"But the place you ship software to is still some sort of infrastructure. The AI factory of the future will work a lot better on this agentic infrastructure."
"State, such as database state, is paramount, and itโs probably one of the harder things to solve."
@databricks @neondatabaseThis media couldn't be displayed. See it on the original post.
Nikita | Scaling Lakebase Postgres
@nikitabase
Can a single database architecture satisfy both vibe-coded and large scale enterprise apps?
The same approach makes small database ultra cheap to run and branch can also make a large one faster and easier to operate. We call this architecture Lakebase. -
Databricks
@databricks
.@nikitabase is going live to talk all things Lakebase and @neondatabase. Come listen in!
MTS
@MTSlive
ASTRA GETS DISTILLED | ECONOMICS OF INTELLIGENCE | MISTRAL LARGE 4 x.com/i/broadcasts/1RKZzBavaRDKB
-
Databricks
@databricks
โJust because the model looks better on the benchmarks doesn't mean it actually got better on your very specific use case.โ
Model launches make headlines. Our Chief AI Scientist @jefrankle gets into the research, RL, evals, and tradeoffs behind them with @readtechnically.
Technically
@readtechnically
"You never quite know what you're going to get when you push the frontier."
But what does pushing the frontier actually look like day-to-day? What do AI researchers...actually do?
On Ep 2 of Technically Speaking, @jefrankle (Chief AI Scientist @databricks) & @meganreyno get into it:
โ How he runs his team: "If I don't have numbers, I don't believe you."
โ Why you should ship before you feel ready: "you need to ship the best of what you have at any given time"
โ Who he hires: "people who are never quite satisfied"
๐ฌ Watch the full episode: youtu.be/Qz58c13N7ms
Presented by our friends at @Railway.
Stay tuned for some of our favorite moments... -
Databricks
@databricks
Coding agents can work in parallel. Their databases should too.
Lakebase branches an entire Postgres database in under a second, giving each agent an isolated environment for migrations and testing without copying the parent database.
How it works:
www.databricks.com/blog/lakebase-and-agentic-sdlc-branchiโฆ -
Databricks
@databricks
OBO authorization for Databricks Apps is now GA.
Apps can use the signed-in user's existing Unity Catalog permissions, while API scopes limit what they can do on their behalf.
Build personalized, governed apps without recreating access rules in code:
www.databricks.com/blog/now-ga-building-permission-aware-โฆ -
Databricks
@databricks
Our PMs use Genie One to run weekly adoption reviews, investigate usage spikes, and forecast what happens next.
Genie Ontology gives it the context to know which metrics and sources to trust, so the analysis starts with our business logic instead of from scratch.
A look at how we use it:
www.databricks.com/blog/how-genie-ontology-powers-productโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Great writeup on what Databricks is and how our tech fits into the broader changing nature of work and companies!
-
Databricks
@databricks
Load billions of rows into Lakebase Postgres without competing with live application workloads.
With LTAP, Spark handles bulk loads on separate compute, keeping the primary focused on serving queries. www.databricks.com/blog/load-terabytes-data-minutes-lakebโฆ -
Databricks reposted
a16z
@a16z
Ben Horowitz on Databricks CEO Ali Ghodsi: "You just don't get this good of a market opportunity with this good of an entrepreneur. That's the rarest of rare things."
Despite surpassing a $7 billion run rate and growing 80% year over year, Databricks might be the most under the radar story in Silicon Valley.
Three years ago, every interaction on Databricks involved a human. Today, the company is seeing more queries from agents than people.
Ali believes AGI is already here. Yet inside most companies today, AI still isn't trusted to reliably update records in Salesforce.
"AI does not have an intelligence problem," Ali explains. "It has a context problem."
Even the smartest human would be all but useless without access to the company's data, permission to act, feedback, or the knowledge in other employees' heads. Ali's answer is what he calls a "system of record for agents."
But the bigger question is how agents will change the firm itself.
85 years ago, James Burnham's The Managerial Revolution described how a small class of professional managers centralized the decision-making inside of companies. Today, thanks to a new wave of technology, the craft practitioners at the front lines are regaining responsibility again. The irony is that the decline of managerialism may look more like everyone becoming a manager.
In this issue of Profiles of the Future, @bhorowitz and @mikemcg0 explain how seven Berkeley academics built Databricks, and why it will power the future of the firm: www.a16z.news/p/databricks-and-the-future-of-the -
Databricks
@databricks
What people do at work all day is changing.
Agents can take on more of the work we already know how to do, while people closest to the problem gain more room to investigate and act without waiting on layers of hierarchy.
a16z's @bhorowitz and @mikemcg0 explore why the system of record powering agents matters so much to that shift, and why Databricks is well-positioned to power it.
Read the full article: www.a16z.news/p/databricks-and-the-future-of-the -
Databricks
@databricks
Now available on Databricks: GPT-6.1 Terra.
On our OfficeQA Pro v2 benchmark, it shows a large quality improvement and sits on the quality-cost pareto frontier.
Use it, or any of 70+ other models, on the data already in your Lakehouse to build governed AI apps and agents.
Unity Gateway governs, monitors, and secures every call from a single control plane.
Try GPT-6.1 Terra โ
docs.databricks.com/aws/en/release-notes/product/2026/octโฆ -
Databricks
@databricks
Finance teams spend too much time figuring out why numbers changed.
Genie One helps them investigate variances, cash flow, close exceptions, and spend using their own business context and governed data.
www.databricks.com/blog/how-genie-one-reshapes-work-finanโฆ -
Databricks
@databricks
What if agent memory didnโt need another sync pipeline?
Join @rxin, Databricks Co-founder and Chief Architect, to unpack the LTAP architecture for agentic apps:
โข Transactions + analytics read the same copy of data
โข Agent memory, application state + historical data share the same permissions
โข Runs on standard Postgres with existing drivers, extensions + ORMs
Register: www.databricks.com/resources/webinar/emerging-blueprint-aโฆ -
Databricks
@databricks
AI is getting more autonomous, and governance has to keep up. Teams need control over what AI can access and do, a handle on rising AI costs and the freedom to choose the best models, agents and tools.
The Big Book of AI Governance shows how leading organizations manage all three at enterprise scale without slowing innovation.
Download the eBook โ
www.databricks.com/resources/ebook/big-book-of-ai-governance -
Databricks
@databricks
[DEMO] With the Databricks Excel Add-in, bring the right Databricks data into Excel with more flexibility and less repetitive work:
โ Generate cascading filter values to narrow data before importing
โ Reuse existing Databricks SQL queries directly in Excel
โ Use custom functions like DATABRICKS.SQL and DATABRICKS.Table to import data into your workbook
Watch the full demo to see how they work: youtu.be/GKQt543lGDg -
Databricks
@databricks
A 2,500 GB database with a 20 GB hot working set doesnโt need 2,500 GB of RAM.
That principle runs through Lakebase Postgres cost optimization: size around what your application actually needs.
โฆ Sync only the working set your app queries
โฆ Match Snapshot, Triggered or Continuous sync to freshness requirements
โฆ Size compute so hot data fits in cache
โฆ Set PITR and snapshots around actual recovery needs
The full guide breaks down how to keep costs predictable while maintaining the performance, availability and developer experience applications need: www.databricks.com/blog/practical-guide-cost-optimizationโฆ -
Databricks
@databricks
What if the next big leap in AI agents comes from better memory, not bigger models?
@theDeepView explores MemCurrent. In our internal benchmark of 114 enterprise tasks, agent success rose from 22.3% without memory to 68.4% with episodic and derived memory. -
Databricks
@databricks
Every new agent can become another integration, policy set and observability stack to maintain.
As agents take actions across data, models, tools and business systems, that fragmentation gets expensive fast. The better pattern is shared infrastructure for choice, context and control:
1๏ธโฃ Agent Bricks for building, governing and optimizing agent fleets
2๏ธโฃ Omnigent for composing agents across harnesses
3๏ธโฃ Unity Gateway for centralized access, cost controls and observability
www.databricks.com/blog/how-scale-agentic-applications-wiโฆ -
Databricks
@databricks
With Unity Catalog managed tables, you can keep your data in cloud storage you own, at a location you control.
โ Set managed storage locations at the metastore, catalog, or schema level
โ Change where new tables land as requirements evolve
โ Choose the destination when converting external tables to managed
Read our guide to storing Unity Catalog managed tables: โโ www.databricks.com/blog/your-data-your-storage-your-rulesโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Databricks AI Runtime (AIR) is now GA, offering an easy and super-fast way to launch GPU workloads. Unlike provisioning your own GPU servers, you get GPUs with your code in seconds, with easy access to all your data. This is especially relevant now that agents can automate much of AI training, and want to scale up/down experiments quickly. Read how companies like Robinhood, Superhuman, Factset and Merck have been using AIR to accelerate AI training: www.databricks.com/blog/ai-runtime-generally-available
-
Databricks
@databricks
Databricks and @nvidia are expanding our collaboration so enterprises can customize open models on their own data and take them all the way to production.
With AI Runtime, developers can use NVIDIA NeMo, NGC containers and new Nemotron cookbooks to train and fine-tune models on serverless NVIDIA GPUs alongside governed enterprise data. Nemotron 3.5 lightning and Super VL are also ready to load, adapt and serve on Databricks from day one.
Customize with governed enterprise data. Serve in production. All on Databricks.
www.databricks.com/blog/databricks-ai-runtime-nvidia-traiโฆ -
Databricks
@databricks
AI Runtime is now generally available, bringing serverless, on-demand GPUs directly into Databricks to power the next generation of AI development.
As AI teams scale model training and agent-driven experimentation, they need GPU infrastructure that can keep pace. AI Runtime delivers seconds-level launch latency, reliable multinode training, and Unity Catalog governance on every workload.
Hundreds of customers, including Robinhood, PicPay, Flo Health and FactSet already use it to ship deep learning models to production.
Accelerate AI innovation, from experimentation to production โ www.databricks.com/blog/ai-runtime-generally-available -
Databricks
@databricks
Introducing MemCurrent, a persistent memory architecture designed to help production agents stop starting from zero.
MemCurrent combines episodic memory with derived memory across three access patterns:
โข Plugins to log and load context automatically
โข Tools the agent calls on demand
โข An offline โdreamingโ pipeline that consolidates memory in the background
Agents carry forward user preferences, prior corrections, metric definitions and successful workflows instead of rediscovering them every session.
On our internal benchmark built from real enterprise data, MemCurrent triples the agent's pass rate while using 31% fewer tokens and running 26% faster. It's built into Agent Bricks' Memory offering and already powers memory in Genie.
Read the research: www.databricks.com/blog/memcurrent-designing-persistent-mโฆ -
Databricks
@databricks
More than 1 million Genie Agents were created in 2026. Which ones should you build first?
Across dozens of rollouts, the agents that get adopted fastest share a clear pattern: tightly scoped domains, high-frequency repetitive questions, and governed data with strong metadata.
One team built a risk and portfolio Q&A agent that saw usage climb before it even reached production. Another had a working agent live in weeks because the demand and data were already there.
We put together a simple rubric to help you score and rank candidate workflows before you build ๐
www.databricks.com/blog/how-choose-your-first-genie-agentโฆ -
Databricks
@databricks
DeepSeek V4.1 Flash 1017 is now available on Databricks as a new endpoint.
Same architecture, updated weights, with substantial improvements across reasoning, coding, agentic tasks and visual benchmarks.
Databricks
@databricks
DeepSeek 4.1 Flash is on Databricks the day it ships.
On OfficeQA Pro V2, it lands on the Pareto frontier, making it a strong open-source option for enterprise document reasoning.
You can point it at the data already in your Lakehouse and use it to build governed AI apps and agents from day one.
โณ Every call routes through Unity Gateway
โณ Access, spend, and performance stay under one view
โณ The same control layer applies across @deepseek_ai and every other model you run
docs.databricks.com/aws/en/release-notes/product/2026/sepโฆ -
Databricks
@databricks
Open table formats are important. But they donโt answer the harder question: who actually controls the data, and can you move it without copying everything somewhere else?
Thatโs the standard we use for openness in Unity Catalog.
Your managed tables can live in customer-owned storage. The best table features work on those tables. And with REGISTER and UNREGISTER in Private Preview, tables can move between catalogs while the underlying data stays in place.
For us, an open catalog should give you storage ownership, full capabilities on the tables you own, and a clean way out.
www.databricks.com/blog/what-makes-catalog-open-unity-catโฆ -
Databricks
@databricks
New York is becoming one of Databricksโ biggest AI hubs. ๐ฝ
Weโre expanding at 5 Bryant Park to ~120,000 square feet across five floors, including a dedicated Engineering and Research floor.
With teams building technologies behind Genie, Unity Gateway and CustomerLake, our momentum in NYC is only growing.
New York Post
@nypost
AI company Databricks doubling footprint at 5 Bryant Park nypost.com/2026/10/18/business/ai-company-databricks-doubโฆ
-
Databricks
@databricks
[DEMO] With Git worktrees and Lakebase Postgres database branching, each coding agent gets its own isolated, copy-on-write branch to run migrations, test changes, and experiment without affecting other environments.
GitHub Actions then creates a fresh database branch per PR to validate migrations and preview the app before anything reaches production.
Watch the full workflow: www.youtube.com/watch?v=RPsyHKiWaPg -
Databricks reposted
New York Post
@nypost
AI company Databricks doubling footprint at 5 Bryant Park nypost.com/2026/10/18/business/ai-company-databricks-doubโฆ
-
Databricks reposted
Nikita | Scaling Lakebase Postgres
@nikitabase
Can a single database architecture satisfy both vibe-coded and large scale enterprise apps?
The same approach makes small database ultra cheap to run and branch can also make a large one faster and easier to operate. We call this architecture Lakebase. -
Databricks
@databricks
The energy has been electric at #dataaiworldtour 2026, and weโre not even halfway through!
Next up:
๐ฌ๏ธ Thu, Oct 29 โ Chicago
๐ฉ๐ช Wed, Nov 4 โ Munich
๐ Tue, Nov 10 โ Atlanta
๐ณ๐ฑ Tue, Nov 10 โ Amsterdam
๐ฌ๐ง Wed, Nov 11 โ London
Across each stop, learn how organizations are grounding AI in enterprise data and business context, governing data and AI usage, and putting apps, agents and analytics into production.
Find a stop near you: www.databricks.com/dataaisummit/worldtour -
Databricks
@databricks
Saturday night under the lights at Databricks Field at California Memorial Stadium.
Cal vs. Wake Forest. Databricks on the field, on the helmets and in the stands.
Kickoff at 7:30 PM PT.
#gobears ๐ป -
Databricks
@databricks
Restoring a 100 TB database with Lakebase Postgres takes seconds.
How?
A branch-based restore is a metadata operation. It creates a branch at a point in time, referencing immutable history that already lives in decoupled storage. No copying data, no replaying WAL. Recovery is near-instant regardless of database size, and simple enough for agents to use in branching and undo workflows.
www.databricks.com/blog/lakebase-postgres-branch-based-reโฆ -
Databricks
@databricks
Decide faster. TypeSafe's Jev-1.14 is now available on Databricks.
Jev isn't a text generator. It's a structured decision model. It classifies, scores, and returns calibrated probabilities, resolving each decision in roughly 70 to 500 milliseconds, 20 to 200 times faster and up to 400 times lower cost than standard LLMs. For Databricks customers, that means real-time decisioning across millions of records at a fraction of the cost.
With our frictionless access, you can get started testing Jev right away. Put Jev to work directly on the data in your Lakehouse through ai_classify and ai_decide. Tag documents, route records, and score decisions across millions of rows, with every call governed, monitored, and secured by Unity Gateway.
Try Jev โ dbricks.co/3TQncpg -
Databricks
@databricks
The fifth edition of the Big Book of Data Engineering is here.
This one covers how to bring ingestion, transformation, and orchestration onto a single governed platform, build millisecond-latency streaming pipelines at scale, and use built-in AI agents to accelerate pipeline authoring and resolve data failures.
Includes real-world examples from NAB, Panasonic, Toyota, AccuWeather, Daikin, and Coinbase.
๐ Download now: www.databricks.com/resources/ebook/big-book-of-data-enginโฆ -
Databricks
@databricks
Congrats to @reflection_ai on the Beam launch. Excited to see what builders create ๐ซก
Reflection
@reflection_ai
Beam is now available across platforms, with open weights under the Apache 2.0 license - in collaboration with an ecosystem of 40+ partners.
We're releasing:
- Weights, tokenizer, and reference implementation
- BF16, FP8 and NVFP4 weights and a DFlash2 drafter
- The open source harness we built and trained Beam on: Mirror CLI
Weights and model card on Hugging Face: huggingface.co/reflection -
Databricks reposted
Neon
@neondatabase
Neon now has realtime, built by the team behind Electric. Turn any SQL query into a live query, joins and aggregates included. All inside Postgres, and ready for agents.
Itโs in public beta and available in all Neon plans. Give it a try and tell us what you think! -
Databricks
@databricks
We published a step-by-step playbook for rolling out Genie One across your organization ๐
The teams that get this right tend to start small: one team, one governed data domain, a set of questions with known-correct answers. They earn trust with a handful of users, act on feedback, then widen deliberately.
The playbook walks through each phase, from a first-team pilot to org-wide AI coworkers, with governance and evaluation built into every step.
www.databricks.com/blog/how-roll-out-genie-one-step-step-โฆ -
Databricks
@databricks
The more AI tools you add, the harder it gets to answer a basic question: how much are you actually spending, and on what?
Unity Gateway gives you one control plane for all of it. Define access and spending once across your models, agents, MCP servers, and tools. Route multiple models behind a single endpoint. Swap providers without changing anything for users.
Every request gets logged, so you can see cost per model, per user, per tool.
๐ Learn more about Unity Gateway: docs.databricks.com/aws/en/ai-gateway/
๐ GitHub repo for this series: github.com/viktoriasemaan/agentic-ai-explained-labsThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Gemini 4 Argon is available on Databricks today, day 0๏ธโฃ.
We had early access and ran it through our internal benchmarks. It's the strongest @Google Gemini model we've tested, with the best results on our internal coding tasks and OfficeQA Pro V2, our flagship enterprise agentic benchmark.
Point it at the data already in your Lakehouse. Unity Gateway handles governance, monitoring, and security for every call.
Try Gemini 4 Argon โ docs.databricks.com/aws/en/release-notes/product/2026/octโฆ -
Databricks
@databricks
Game predictions. Player comparisons. Live Excitement Scores. Vibe Checks. FOX Sports AI delivers all of it to fans during major live sporting events, built on Databricks Lakebase.
Today weโre excited to announce a multi-year strategic partnership with Fox Corporation, making Databricks FOX's platform for data, AI apps, and agents. Sports AI is just the start. FOX is also using Lakebase, Genie Code, Unity Gateway, and Genie Ontology across streaming, content recommendations, and more.
Read the full story: www.databricks.com/company/newsroom/press-releases/fox-coโฆ -
Databricks
@databricks
AI that can query your data but doesn't understand your business is just a faster way to get wrong answers.
We built Genie Ontology to close that gap. It teaches AI how your business actually runs, what each metric means, which sources are authoritative, and what each person is allowed to see.
See how it works: www.databricks.com/resources/webinar/closing-the-ai-conteโฆ -
Databricks reposted
Reynold Xin
@rxin
Super excited to welcome the Responsive team to @Databricks/@neondatabase to help take Lakebase Postgres to the next level. The best database is a lakebase!
Apurva Mehta
@apurva1618
Iโm excited to announce that Responsive has been acquired by Databricks to accelerate the development of Lakebase and Neon!
We couldn't be more excited to join the Lakebase team. We've long admired their technical vision, and the more we got to know them, the more impressed we became by their ambition, execution, and momentum. It feels like a natural home for us.
I want to thank Responsiveโs customers, investors, and especially the team. More than anything, Iโm grateful for the trust youโve placed in us through the good times and the tough times.
Onward and upward! -
Databricks
@databricks
Stateful streaming queries on Databricks can now be repartitioned without rebuilding the checkpoint or losing state.
Stop the query, set the new partition count, restart. State redistributes automatically ๐
www.databricks.com/blog/announcing-demand-state-repartitiโฆ -
Databricks
@databricks
Welcome to Databricks! Excited to build whatโs next for Lakebase together ๐ค
Apurva Mehta
@apurva1618
Iโm excited to announce that Responsive has been acquired by Databricks to accelerate the development of Lakebase and Neon!
We couldn't be more excited to join the Lakebase team. We've long admired their technical vision, and the more we got to know them, the more impressed we became by their ambition, execution, and momentum. It feels like a natural home for us.
I want to thank Responsiveโs customers, investors, and especially the team. More than anything, Iโm grateful for the trust youโve placed in us through the good times and the tough times.
Onward and upward! -
Databricks
@databricks
[DEMO] Have a conversation with Genie One. Then save it as a Genie Agent that remembers everything you discussed.
In this demo, we build a blog performance monitoring agent by walking Genie One through a bi-weekly reporting workflow once. Genie picks up the blog URLs, fiscal year definitions, and the two-week comparison format.
From there, the conversation becomes a Genie Agent that runs the same report with a single prompt and can be scheduled for automatic delivery to your inbox.
- One conversation
- A reusable agent
- No reprompting
www.youtube.com/watch?v=bbd-GpsqvbE -
Databricks
@databricks
#dataaiworldtour 2026 continues around the globe.
Learn how leading organizations are putting AI into production by grounding models in enterprise data and business context.
Hereโs where weโre headed next:
๐ช๐ธ Wed, Oct 14 โ Madrid
๐ค Wed, Oct 14 โ Dallas
๐ฌ๏ธ Thu, Oct 29 โ Chicago
๐ฉ๐ช Wed, Nov 4 โ Munich
๐ Tue, Nov 10 โ Atlanta
๐ณ๐ฑ Tue, Nov 10 โ Amsterdam
๐ฌ๐ง Wed, Nov 11 โ London
๐จ๐ฆ Tue, Nov 17 โ Toronto
๐ฌ Wed, Nov 18 โ Los Angeles (Anaheim)
๐ฝ Thu, Nov 19 โ New York City
๐ฎ๐น Tue, Nov 24 โ Milan
๐ฏ๐ต Fri, Nov 27 โ Tokyo
๐จ๐ญ Tue, Dec 1 โ Zurich
๐๏ธ Tue, Dec 1 โ Washington D.C.
๐ธ๐ช Wed, Dec 2 โ Stockholm
๐ซ๐ท Tue, Dec 8 โ Paris
Each stop is free, with technical sessions, product demos and hands-on learning.
Find your city:
www.databricks.com/dataaisummit/worldtour -
Databricks
@databricks
Admins can now configure coding agents in one place with Unity Gateway.
Default models, MCP servers, skills, Smart Routing, spending policies โ all centrally managed so developers don't have to set up anything themselves.
Developers just type ug claude or ug codex and go.
Smart Routing picks the right model. Budget tracking is built in. And when a better model drops, admins roll it out across every agent at once.
Watch the full demo: youtu.be/w4FDK9dbTeE -
Databricks
@databricks
In this 2-hour hands-on course, Andreas Kretz walks through how to build end-to-end data pipelines on Databricks using Spark Declarative Pipelines and Lakeflow Designer.
Along the way, you'll:
โ๏ธ Learn the fundamentals of Delta Lake and Unity Catalog
โ๏ธ Build a Bronze โ Silver โ Gold pipeline using the medallion architecture
โ๏ธ See how declarative pipelines handle dependencies and orchestration automatically
โ๏ธ Build pipelines visually with Lakeflow Designer
โ๏ธ Explore how Databricks Assistant and Genie can accelerate development
www.youtube.com/watch?v=nrfP2_frM5k -
Databricks
@databricks
A cloud agent may outlive the request, worker, container or deployment that started it.
This reference implementation pairs Temporal with Lakebase Postgres so recorded work survives worker replacement, evidence and review state stay queryable, and human decisions can arrive days later. Unity Catalog remains the governed policy source through synced tables.
See how to build it:
www.databricks.com/blog/build-durable-agents-temporal-andโฆ -
Databricks
@databricks
Off-the-shelf industry data models give you a starting point. They donโt capture the specific language, rules and relationships that define your business.
Vibe Data Modeling takes a different approach. The open-source agent helps teams build, validate and evolve business-specific data models using roughly 250 modeling rules, while keeping data modelers and business stakeholders in the loop.
In this video, see how teams can start with 40 industry models as a baseline, then iterate toward models that better reflect how their business actually works.
www.youtube.com/watch?v=z2K-6okx-_gThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
A new @Replit integration with Databricks accelerates the development of business apps and deployment on live, governed enterprise data.
A four-step setup guide walks Databricks admins, Replit org admins, and end users through going from zero to a governed production app in 15 minutes.
Get started: www.databricks.com/blog/how-build-governed-enterprise-appโฆ -
Databricks
@databricks
Workday Data Connect federation is now in Beta in Unity Catalog.
Unify people and finance data from @Workday with the rest of your enterprise data in Databricks and govern it.
Teams on Workday Data Cloud get zero-copy, read-only access to the HR and finance tables Workday shares.
Databricks runs the queries, Unity Catalog governs access, lineage, and auditing, and teams can combine current people and financial data with the rest of their enterprise data for analytics and AI, including Genie-powered natural-language exploration, workforce analytics, and financial planning on trusted, governed data. www.databricks.com/blog/announcing-workday-data-connect-fโฆ -
Databricks
@databricks
Anthropic's latest model, Claude Haiku 5.5, is now being made available, as a Day 0 launch, on Databricks!
It is the cheapest, fastest, and most capable small model Anthropic has ever released. On Databricks' OfficeQA Pro V1 benchmark, Claude Haiku 5.5 delivers ~15% higher quality than Haiku 4.5 at a fraction of the cost.
Run Haiku 5.5 & 60+ other models on the data that already sits in Databricks and power your agentic apps and agents. Unity Gateway takes care of governing, monitoring, and securing every call as you scale.
Try Claude Haiku 5.5 โ dbricks.co/3TQncpg -
Databricks
@databricks
What if AI could figure out the right business context without waiting for a fully built ontology?
Genie Ontology does that by inferring relevant context across your data and assets to answer open-ended questions.
Advancing Analyticsโ @MrSiWhiteley digs into how OntoRank chooses what to trust, why certified assets still matter, and what that means for data governance.
Watch the full video: www.youtube.com/watch?v=voZXeHP2qWQThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
How do you stop an agent from overspending or taking one risky action too many?
Omnigent policies can control both cost and behavior by checking actions before they happen. They can set spending limits, restrict tool usage, and track accumulated risk across a session so the next action can require approval once a threshold is reached.
๐ Learn more in the blog: www.databricks.com/blog/contextual-policies-omnigent-usinโฆ
๐ GitHub repo for this series: github.com/viktoriasemaan/agentic-ai-explained-labsThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
โฝ @adidas knows that the best insights don't just answer questions, but help you ask better ones.
With Databricks Genie, adidas helps analysts spend less time crunching data and more time uncovering insights, helping teams make smarter decisions and ultimately design better products.
Hear more about how adidasโ product innovation runs on data.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Databricks is bringing databases up to AI speed.
โLakebase, a ground-up rearchitecture of databases, can spin them up and shut them down at AI speeds, facilitating the multitude of small, fast workloads of AI-driven development.โ
Excited to see Lakebase in @FastCompany's Next Big Things in Tech issue. dbricks.co/4zfhoov -
Databricks
@databricks
IP Functions are now GA on Databricks!
Every firewall, load balancer, and application server generates records keyed on IP addresses. Analyzing that data in SQL used to mean regex hacks, custom UDFs, and brittle bitwise math.
Now you can parse, validate, and join IPv4 and IPv6 addresses and CIDR blocks with built-in SQL functions. They're optimized in Photon.
โก Up to 3.1x faster, 6.4x cheaper CIDR joins in benchmarks versus another leading cloud data warehouse.
IP Functions are a critical building block for our Security Lakehouse vision: threat detection, investigation, and network analytics on one governed copy of your data.
Learn more: www.databricks.com/blog/ip-functions-are-generally-availaโฆ -
Databricks
@databricks
Your data team deserves more than dashboards.
๐ The Big Book of Data Warehousing and BI is a practical guide to building the foundation for faster time-to-insight, stronger governance and AI/BI readiness on the Databricks Lakehouse.
Inside:
โข Reference architecture and code samples
โข Migration strategies and dimensional modeling
โข Performance and cost optimization at scale
โข Governance with Unity Catalog
โข BI integrations and ways to extend BI with AI
Download the eBook: www.databricks.com/resources/ebook/big-book-data-warehousโฆ -
Databricks
@databricks
Genie One just got a major set of updates across context, data access, collaboration, and automation. ๐ง
Here's what you can do now:
โข Ask questions with business-aware context built in. Genie Ontology is enabled by default
โข Apply your org's data conventions to every prompt with workspace instructions
โข Upload Word docs, images, CSVs, spreadsheets, and PDFs directly into your workflow
โข Query Unity Catalog tables inside Genie with schema preview and one-click access requests
โข Automate recurring work with scheduled tasks that reference past runs for consistent outputs
@YoussefMrini walks through all of it in under 3 minutes:
www.youtube.com/watch?v=hRayT1rQPcAThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Ever tried getting Claude Code and Codex to actually work together without playing copy-paste between terminals?
@leonvz takes Omnigent, our new open-source meta-harness, for a spin to show how multiple coding agents can share sessions, rules and security policies in one system.
He demos forking work across agents, multi-agent review and debate with Debby, and splitting implementation across subagents with Polly.
Watch the full walkthrough:
www.youtube.com/watch?v=gYtQ1LKSgXY -
Databricks
@databricks
What changes when more of your Postgres working set stays in DRAM instead of falling through to slower cache and storage layers?
For fixed-size Lakebase Postgres computes with CU >= 80, we now set shared buffers to 75% of DRAM and disable the local file cache, keeping hot pages in the lowest-latency access path.
In production, large endpoints have seen up to 2x throughput, fewer reads from the storage layer and lower latency after the change.
See how weโre improving Lakebase Postgres compute caching:
www.databricks.com/blog/improving-lakebase-postgres-compuโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
Everyone has been obsessed by Jev and what it can do, and they should be! Fast typed decisions >> slow text generation. It's a complete game changer. But how do you do that with all the data you have?
We just dropped ๐๐_๐๐๐๐๐๐(), which runs decision models natively on all your data in @databricks . Now you can run system one decisions on all your big data, see screenshot.
www.databricks.com/blog/introducing-aidecide-make-fast-deโฆ -
Databricks reposted
Tasso Argyros
@tasso
Not every marketer is familiar with Databricks today, but that's about to change!
Marketing agents simply do not work without real-time customer+business context. Databricks' CustomerLake is quickly becoming the cornerstone of the marketing stack of the future, providing just that.
It was great discussing all of that on stage at Braze's Forge conference. Thank you for having me, @jon_hyman! -
Databricks
@databricks
Coding tasks arenโt equally difficult, so why send every one to the same model?
Smart Routing evaluates each task separately and selects the lowest-cost model capable of doing the job, helping balance model quality, latency and cost.
In this demo, Omnigent splits an app build across planning, backend and frontend work, routes each task to a different model, and runs some of them in parallel.
Learn more: www.databricks.com/blog/smart-routing-unity-ai-gateway-maโฆ
GitHub repo for this series: github.com/viktoriasemaan/agentic-ai-explained-labsThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Jane Zhang
@jjanezhang
๐ Introducing Databricks AI Decide: make fast decisions on your governed data
Following the TypeSafe AI Jev launch, weโve seen increasing demand for a fast, low-cost API that turns raw text into structured decisions. However, many of our enterprise customers are unable to use Jev due to data privacy and access concerns.
AI Decide is our enterprise-grade function for fast decisions on customerโs governed data. It is supported for batch use cases like processing millions of documents with SQL and for realtime applications like model routing through our REST API. Starting early next week, customers will also be able to govern permissions on the ai_decide function through Databricks Unity Gateway.
A big shoutout to @mattydtweetz @ivanzhouyq @nihit_desai @hanlintang for getting this new function launched in less than a week! -
Databricks
@databricks
How much of your AI workload is really just making a decision?
ai_decide is a new Databricks AI Function built for fast, structured decisions over governed data. It classifies, scores and chooses what happens next in a fraction of a second, with lower latency and cost than an LLM on similar tasks.
Use it for model routing, document processing, agent evaluations and real-time app logic ๐ www.databricks.com/blog/introducing-aidecide-make-fast-deโฆ -
Databricks
@databricks
Agentic apps are putting new pressure on the data stack.
Join Databricks Co-founder and Chief Architect @rxin to explore why Postgres is the foundation for a new data processing architecture, and how LTAP lets transactions and analytics read from the same copy of data.
Learn how to:
- Bring agent memory, application state and historical data under the same permissions
- Remove sync intervals as a bottleneck in the agent memory loop
- Maintain compatibility with existing Postgres drivers, extensions and ORMs
Youโll also see the architecture in action through demos and enterprise patterns.
Live November 10โ12. Register now: www.databricks.com/resources/webinar/emerging-blueprint-aโฆ -
Databricks reposted
Reynold Xin
@rxin
Excited to announce our new partnership with @DecagonAI to bring richer enterprise data intelligence directly into customer conversations.
AI agents are only as useful as the context they can access.
Enterprises already have an incredibly rich record of their customers in Databricks. Orders, payments, product usage, preferences, and countless other signals all help explain who a customer is and what they need.
Through this partnership, Decagon agents can access governed data from the Databricks when they need it, while insights from those conversations can flow back into Databricks and become useful across the rest of the business.
Weโre excited to work with the Decagon team to make enterprise customer agents more context aware while keeping data governance at the center.
decagon.ai/blog/decagon-and-databricks -
Databricks reposted
Decagon
@DecagonAI
Weโre partnering with @Databricks to bring enterprise data intelligence into every Decagon customer conversation.
Agents can access governed customer data directly from a companyโs lakehouse, while conversation insights flow back into Databricks.
This gives agents richer context in every conversation and teams a more complete view of their customers.
Decagon is also a launch partner for Databricksโ new Transactable Marketplace and will be available through Databricks Marketplace. -
Databricks reposted
Omnigent
@omnigent_ai
Omnigent v0.16.0 is now available! ๐
This release updates desktop onboarding, the workspace browser, sandbox controls, and agent configuration.
๐งญ Redesigned desktop onboarding
๐๏ธ Unified workspace browser
๐ฆ Sandbox copy-on-write and clones
๐ Admin sharing and Slack defaults
๐งฉ Pi prompt controls, plus native images for supported harnesses
Full release notes ๐ omnigent.ai/releases/0.16.0
#omnigent #aiagents #opensource -
Databricks
@databricks
Governance should be as portable as your data.
Two new Apache Icebergโข specs help make that possible:
โก๏ธ Read restrictions give catalogs a standard way to delegate enforcement to trusted engines
โก๏ธ Catalog labels make governance and business context metadata portable across federated catalogs
Together with centralized enforcement through Cross-Engine ABAC, enterprises now have practical options for governing data consistently across engines and catalogs.
See how each model works and when to use it:
www.databricks.com/blog/unifying-governance-across-engineโฆ -
Databricks
@databricks
Two new frontier models just landed on Databricks.
@OpenAI GPT-6.1 Sol and @SpaceXAI Grok 4.7 are both live today.
GPT-6.1 Sol leads the cost-quality Pareto frontier on OfficeQA Pro v2. Grok 4.7 reaches the frontier at enterprise document parsing. Two benchmark leaders, available the day they ship.
Frontier models are shipping faster than ever. Unity Gateway keeps you right there with them. It picks the right model for the right task, governs every call, and controls costs across GPT-6.1 Sol, Grok 4.7, and 60+ other frontier and open models already on Databricks.
Try GPT-6.1 Sol and Grok 4.7 today: docs.databricks.com/aws/en/release-notes/product/2026/sepโฆ -
Databricks
@databricks
AI doesnโt have an intelligence problem. It has a context problem.
When business context is scattered across dashboards, documents, tickets and chats, users struggle to get fast, trusted answers and data teams stay stuck fielding ad hoc requests.
See what it takes to close that gap with a unified context layer that helps AI deliver trusted answers, act autonomously and give teams back time. Go under the hood of Genie Ontology and see the approach in action with a product demo.
Watch on-demand: www.databricks.com/resources/webinar/closing-the-ai-conteโฆ -
Databricks reposted
Patrick Wendell
@pwendell
We've moved to an approach @databricks that gives "Day 1" access to 12,000 employees whenever a new frontier model is released. Very tricky to do while avoiding massive cost spikes and quality regressions. We've written up our approach if others are interested (see below).
-
Databricks
@databricks
At Databricks, we want employees using the best models on Day 1. That means moving quickly when models like Opus 5.5 and GPT-6 Sol launch, while evaluating real-world usage and managing the cost impact across thousands of employees.
Our AI engineering team uses Unity Gateway to manage access, spend and model selection at scale, then determines which models belong in our AI stack.
Learn how we roll out frontier models across Databricks: www.databricks.com/blog/how-databricks-rolls-out-frontierโฆ -
Databricks
@databricks
.@AnthropicAI's Claude Sonnet 5.5 is now available on Databricks across AWS, Azure and GCP, governed by Unity Gateway.
It improves efficiency over Sonnet 5 for coding and agentic use cases, and reached Opus 5-level accuracy on document understanding, parsing and search. It joins Claude Opus 5.5, Claude Fable 5.1 and 60+ open-source and frontier models on Databricks.
Build domain-specific agents with Agent Bricks, deploy them as Databricks Apps with Lakebase-powered memory, and govern every call through Unity Gateway.
See documentation: docs.databricks.com/aws/en/release-notes/product/2026/sepโฆ -
Databricks
@databricks
AI agents need fast, accurate search at massive scale. Lakebase Search is now GA, bringing scalable vector and BM25 full-text search directly into Postgres.
- New frontier for price-performance, latency, and recall on VectorDBBench
- 4x cheaper than running pgvector for the same workload
- True pay-per-use with zero compute cost when idle
www.databricks.com/blog/lakebase-search-state-art-full-teโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
We just tested the latest AI models on 2,400 engineers. The cost/quality frontier just shifted massively.
The TL;DR:
โข Opus 5.5: Our new daily default - higher quality and 20% cheaper than prior baselines.
โข GPT-6 Luna: Shockingly capable and 20x cheaper than Opus 5.5 for high-volume routing.
Must-read for anyone managing production AI workloads ๐
Patrick Wendell
@pwendell
Crazy few weeks for model releases! Our findings @Databricks show several new models meaningfully advance the pareto frontier. Results below (online workload analysis of N=2,400 engineers, plus offline evals):
1. Two of the three models released last week clearly expand the cost/quality frontier: Opus 5.5 and GPT-6 Luna.
2. Opus 5.5 is now the highest quality mid-tier model. It is better than all prior Opus models, better than GPT-6 Sol, and better than GPT-5.6 Sol.
3. Opus 5.5 reduces same-task costs consistently by 20% in both offline and online analysis. This is against a baseline of Opus 4.8, the prior least-cost Opus model (Opus 5.0 was a bit of a dud with high costs and barely noticeable quality improvements).
4. Due to best-in-class quality and lower costs, Opus 5.5 is a strong candidate as an โevery day defaultโ model for coding, and we are now encouraging it for this purpose at Databricks.
5. GPT-6 Luna is very, very, very cheap. It was at least 20 times cheaper per-task than Opus 5.5 in every offline benchmark we tested and in observed online use.
6. GPT-6 Luna is surprisingly capable given how cheap it is. On one of our most difficult evaluation suites it roughly matches Opus 4.6 performance, while being 99.3% cheaper per-task than Opus 4.6 was at that time. That's a 100X cost reduction in ~9 months! This finding is preliminary and we are still evaluating Luna quality on a broader set of offline and online tests.
Our production setup: Unity Gateway to route workloads across models and trace agentic interactions. A mix of end-user harnesses including: Omingent (meta-harness), Claude Code, Codex, and Cursor. -
Databricks reposted
Patrick Wendell
@pwendell
Crazy few weeks for model releases! Our findings @Databricks show several new models meaningfully advance the pareto frontier. Results below (online workload analysis of N=2,400 engineers, plus offline evals):
1. Two of the three models released last week clearly expand the cost/quality frontier: Opus 5.5 and GPT-6 Luna.
2. Opus 5.5 is now the highest quality mid-tier model. It is better than all prior Opus models, better than GPT-6 Sol, and better than GPT-5.6 Sol.
3. Opus 5.5 reduces same-task costs consistently by 20% in both offline and online analysis. This is against a baseline of Opus 4.8, the prior least-cost Opus model (Opus 5.0 was a bit of a dud with high costs and barely noticeable quality improvements).
4. Due to best-in-class quality and lower costs, Opus 5.5 is a strong candidate as an โevery day defaultโ model for coding, and we are now encouraging it for this purpose at Databricks.
5. GPT-6 Luna is very, very, very cheap. It was at least 20 times cheaper per-task than Opus 5.5 in every offline benchmark we tested and in observed online use.
6. GPT-6 Luna is surprisingly capable given how cheap it is. On one of our most difficult evaluation suites it roughly matches Opus 4.6 performance, while being 99.3% cheaper per-task than Opus 4.6 was at that time. That's a 100X cost reduction in ~9 months! This finding is preliminary and we are still evaluating Luna quality on a broader set of offline and online tests.
Our production setup: Unity Gateway to route workloads across models and trace agentic interactions. A mix of end-user harnesses including: Omingent (meta-harness), Claude Code, Codex, and Cursor. -
Databricks
@databricks
For decades, operational and analytical systems have been optimized separately for good reason. Transactions rely on fast row-based access, while analytics is optimized around columnar storage and broad scans.
But now, AI agents are putting pressure on that boundary. They need to act on live operational data while also using data from the analytical side.
LTAP changes where those workloads meet. It unifies them at the storage layer, with a hotter tier that keeps data in row format for operational access and a cooler tier that holds it in columnar format for analytical reads. Specialized compute can handle each workload independently.
The architectural shift is simple: keep the specialized engine for each job while bringing the operational and analytical representations of the same data together underneath them.
www.databricks.com/blog/40-year-old-database-rule-agents-โฆ -
Databricks
@databricks
91% of enterprises already have two or more AI coding tools active today. Managing that sprawl is the harder problem.
A scalable agent strategy needs three things:
Choice: to build on any model, harness, or framework
Context: so every agent works from the same governed context
Control: to govern models, tools, MCP servers, skills, and agents in one place
Get the practical framework to scale agent fleets with less fragmentation: www.databricks.com/resources/ebook/operationalizing-agentโฆ -
Databricks
@databricks
Genie Ontology works on day one, but the quality of its answers improves as the business context underneath it gets stronger.
A practical path is to build that context layer by layer:
โณ Strengthen the data foundation
โณ Enrich metadata
โณ Model critical business semantics
โณ Curate trusted assets
โณ Govern access
โณ Evaluate and improve over time
You donโt need to tackle everything at once. Start with one high-value domain, harden the definitions and sources that matter most, then expand as you learn.
Read the guide: www.databricks.com/blog/operationalizing-genie-ontology-yโฆ -
Databricks
@databricks
Ready to sharpen your data and AI skills this fall?
The Databricks Advanced Learning Festival runs through October 14, with self-paced learning pathways across Data Engineering, Data Analytics, Machine Learning, Generative AI Engineering, Apache Sparkโข and Data Warehousing.
Complete at least one listed pathway during the event window to receive 50% off any Databricks Certification and 20% off a yearly Databricks Academy Labs subscription!
Explore the pathways and enroll through Customer Academy: community.databricks.com/t5/learning-events/databricks-adโฆ -
Databricks
@databricks
Databricks Field at California Memorial Stadium makes its debut tonight. Cal vs. Clemson on ESPN.
Go Bears. ๐ ๐ป @CalAthletics -
Databricks reposted
Cal Athletics
@CalAthletics
Checking in from @databricks Field at California Memorial Stadium ๐
-
Databricks
@databricks
More AI tools usually means more questions: whoโs using what, whatโs it costing, and is it actually working well?
In this webinar, Matei Zaharia and Kasey Uhlenhuth show how Unity Gateway helps teams see and control AI usage across models, agents, harnesses, and workflows.
They also cover how Omnigent lets builders combine and share the coding agents and SDKs they already use, while leaders keep governance, cost, and quality in check.
Watch now: www.databricks.com/resources/webinar/govern-ai-spend-scaleThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
We found and eliminated an estimated $1.2M a year in wasted AI spend and lost productivity in one hour.
Here's how ๐
Using Unity Gateway tracing and Genie One, we identified seven small MCP-server bugs that were quietly driving:
โข ~$499K/year in wasted tokens
โข ~12,000 engineering hours/year in agent wait time
โข 1,409 tool errors in a single 24-hour window
Genie One turned the trace data into a ranked list of what to fix, and a coding agent helped close the loop in an hour. www.databricks.com/blog/how-we-eliminated-1-million-year-โฆ -
Databricks
@databricks
Here's how to run Jev-style decision models directly on governed data with Databricks ๐
Serve open-weight models like SemIf-OpenJev on serverless GPUs with AI Runtime + Model Serving, then call them directly from SQL or Lakeflow jobs using ai_query to return structured classifications and probability scores.
โณ Pick your model
โณ Select Serverless GPU
โณ Click Run All
One importable notebook. Swap in your own data and decision criteria from there.
www.databricks.com/blog/running-open-jev-sql-databricks -
Databricks reposted
Cal Athletics
@CalAthletics
What started in Bear Territory is back where it all began ๐ป๐งฑ
Proud to announce a new partnership with @databricks and the โDatabricks Field at California Memorial Stadium.โ Databricks is now the Official Enterprise Data + AI platform for Cal Athletics.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
A new model comes out roughly every five days. The best model for a coding task today may not be the best or most cost-effective choice a few months from now.
The new Unity Gateway CLI helps organizations keep up with that pace.
Developers can keep working in Claude Code, Codex, OpenCode and other coding agents, while admins centrally manage models, tools, policies and budgets in Unity Gateway. When a better option emerges, teams update the configuration once and the CLI rolls it out across supported agents.
Now with the Unity Gateway CLI, teams can:
โข Set default models, MCP servers, skills, Smart Routing and spending policies centrally
โข Launch approved coding agents with one command and automatically apply organization settings
โข Track spend and capture traces across supported coding agents
www.databricks.com/blog/deploy-and-manage-coding-agents-sโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
All seven Databricks co-founders began our journey together at UC Berkeley. We started the company in a room in Soda Hall, moved to a small office on Addison Street, and spent our first few years in Berkeley before eventually heading to SF. Two of our co-founders are still on the faculty.
Today we announced Databricks Field at California Memorial Stadium, our first collegiate athletics sponsorship.
Berkeley shaped everything about how this company thinks, and this is our way of investing in the next generation of students and builders who'll do their best work on that campus.
Go Bears!
www.databricks.com/company/newsroom/press-releases/soda-hโฆ -
Databricks
@databricks
Today, weโre proud to announce Databricks as the new sponsor of Cal Bears Field! ๐ป
All seven of our co-founders are Cal alumni. The earliest lines of what would become Databricks were written at Berkeleyโs Soda Hall, fueled by late nights and a shared belief that data and AI could accelerate human progress.
This sponsorship is our way of investing in the next generation of researchers and builders whoโll have their own breakthroughs there.
Our mission has always been to democratize data and AI. It started at Cal. Weโre glad to help it continue there.
Go Bears. ๐
www.databricks.com/company/newsroom/press-releases/soda-hโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
At the beginning of this year, big portions of @databricks started running on Genie. When finance started doing all their work with Genie, we noticed that they were combining Genie with a Live Cloud Spreadsheet called Row Zero. This combination is really powerful. We met the Row Zero team and were blown away. Today, we're excited to announce that we've agreed to acquire Row Zero. Stay tuned for an awesome experience of Genie + Row Zero:
www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
Big news: @GetRowZero is joining Databricks! ๐
Weโre bringing a native, fully governed spreadsheet experience to Databricks Genie, combining the flexibility of spreadsheets with enterprise-grade security and lineage powered by Unity Catalog.
Finance, operations, sales, and marketing teams will be able to work, model scenarios, and collaborate using standard spreadsheet logic without leaving their data and AI foundation.
Welcome to the team, Row Zero! ๐
www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
Give coding agents room to experiment without putting production data at risk.
Lakebase Branching creates isolated, short-lived database environments that capture both schema and data, so agents can test changes without affecting production.
Watch how to set up an agentic branching workflow with the Databricks CLI and AGENTS.md, compare changes against the parent branch, and move approved updates through CI/CD.
youtu.be/jLX5LBzEDGcThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Genie One MCP is a new way to bring governed business context into the AI assistants and coding agents your teams already use.
It connects MCP-compatible clients like ChatGPT, Claude and Microsoft Copilot to Genie One, so they can work with approved definitions, trusted data relationships and permission-aware access.
Our latest walkthrough covers how to set it up, how identity and access controls work, and best practices for managing and monitoring it in production: www.databricks.com/blog/genie-one-mcp-give-any-ai-agent-rโฆ -
Databricks
@databricks
Exciting day for Databricks customers! Weโre launching three new frontier models on Databricks today.
โณ @OpenAI's GPT-6 Sol and GPT-6 Luna, with strong performance at lower cost and a higher Pareto frontier on the OfficeQA Pro benchmark
โณ @AnthropicAI's Claude Opus 5.5, with substantial improvements in cost efficiency and strong performance on enterprise document parsing tasks
The industryโs best models are shipping faster than ever. Putting them into production and scaling your AI footprint means governing every model call, controlling costs, monitoring performance, and using the right model for the right task.
Unity Gateway gives you one governance layer across every model, so you can govern and audit requests, set budgets, track costs, and choose the best model for each job.
docs.databricks.com/aws/en/release-notes/product/2026/sepโฆ -
Databricks
@databricks
Databricks Genie One MCP is now generally available!
Teams working in ChatGPT, Claude, Cursor, or custom agents can now use one interface to access structured and unstructured data, insights, and answers from Genie One, grounded in governed business context from Genie Ontology.
Key highlights:
โข ๐๐จ๐ง๐ฌ๐ข๐ฌ๐ญ๐๐ง๐ญ ๐๐ฎ๐ฌ๐ข๐ง๐๐ฌ๐ฌ ๐๐จ๐ง๐ญ๐๐ฑ๐ญ across agents, with shared definitions and domain semantics
โข ๐๐ข๐๐ก, ๐๐๐ญ๐-๐ฌ๐ฆ๐๐ซ๐ญ ๐๐ฑ๐ฉ๐๐ซ๐ข๐๐ง๐๐๐ฌ including questions, results, visualizations, and Genie Ontology citations
โข ๐๐๐ง๐ญ๐ซ๐๐ฅ๐ข๐ณ๐๐ ๐ ๐จ๐ฏ๐๐ซ๐ง๐๐ง๐๐ through Unity Gateway, with fine-grained policies and audit logging
Genie One MCP brings trusted business context into the tools teams already use.
www.databricks.com/blog/genie-one-mcp-now-generally-availโฆ -
Databricks
@databricks
Databricks Chief Information Officer Naveen Zutshi has been named to TIME's 2026 Executives of the Year: Tech & Data list!
@TIME highlights Naveen's mission to make every Databricks employee a builder with Genie, while strengthening the data governance behind how Genie accesses and acts on company data.
Congratulations to Naveen and all 50 leaders shaping the future of technology, AI, cybersecurity, and digital innovation.
Explore the full list: time.com/collection/executives-of-the-year-tech-data/2026โฆ -
Databricks
@databricks
Databricks CEO and co-founder @alighodsi joined @bhalligan on Long Strange Trip to share his journey to CEO, how to hire and scale, and where the next unlock in enterprise AI is.
"You need to capture the enterprise context - every meeting that's being recorded, every email - then feed it to your AI."
That's the missing piece that will allow organizations to move from using AI as a chatbot to having thousands of AI agents that work with each other and autonomously to move work forward.
Watch the full episode: www.youtube.com/watch?v=k7wPdCNfljQThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Starting an agentic app shouldnโt mean starting from scratch.
Databricks DevHub gives developers:
โณ Ready-to-use templates
โณ Docs and step-by-step guidance
โณ Agent prompts you can copy into Cursor, Claude Code, Codex, or another coding agent
Build with Databricks Apps, Lakebase, Agent Bricks, and more.
Build agentic applications in minutes, not months: developers.databricks.com -
Databricks reposted
Ali Ghodsi
@alighodsi
Super impressive how @Superhuman scales their AI infra:
blog.superhuman.com/scaling-gec-inference/ -
Databricks
@databricks
[DEMO] Define features once, then use the same definitions through training and production.
See how Databricks Feature Store helps teams build batch and streaming features with Feature Views, create training sets with automatic point-in-time joins, and productionize those features with built-in governance and observability.
Plus, see how Genie Code and MLflow support iteration along the way.This media couldn't be displayed. See it on the original post. -
Databricks reposted
a16z
@a16z
Databricks' @alighodsi on why most companies wouldn't even notice if frontier AI models stopped advancing:
"The models are smart enough, but they just don't have the context that exists inside any organization. They have not been in every meeting. They don't know what's in everybody's heads. They don't know all the processes."
"There's always a couple of employees who know everything in every organization. You go tap on their shoulder, and everybody's like, 'Oh my God, what would happen if he or she quits?' [The models] don't have that context."
"If you just fused that and gave that context to the AI models... I think there are so many productivity gains you could get for any organization on the planet. For that, we actually don't need smarter models."
"We don't need a smarter model that can solve Navier-Stokes or conjectures or do better on Humanity's Last Exam."
"If the frontier doesn't advance, it doesn't actually matter, I think, for the vast majority of organizations on the planet. They're just so far behind in the adoption curve of actually automating things and getting value out of this stuff."
@alighodsiThis media couldn't be displayed. See it on the original post.
a16z
@a16z
Databricks' @alighodsi on AI risk and adoption:
Ali isn't losing sleep over the existential risk debate.
He says a number of conditions would all have to be true simultaneously to enable an actual runaway takeoff scenario, and currently several opposite conditions exist.
Each frontier training run requires significantly more resources. Power, GPUs, engineers - and some attempts fail, burning up huge piles of money with them. Until that reverses, he doesn't see the self-improving loop happening.
Cyber is what he's watching most closely and where he anticipates real impact. Most orgs are not equipped for the coming change in agentic capabilities. The time between a vulnerability being published and being weaponized has collapsed from years to hours.
On adoption, he believes most companies don't need a smarter model. The models are already smart enough. The gap is context they don't absorb - the things an employee who's worked at a company for five years learned by osmosis.
If the frontier stopped advancing today, he thinks it wouldn't meaningfully change the value most are extracting from AI anyway.
In conversation with a16z's Martin Casado and Sarah Wang:
00:00 Intro
00:48 Why Ali places the AI risk near zero
05:05 The word "pacing" was a mistake
10:50 What 10k agents and $100m can do
12:20 What would change his mind on AI risk
14:20 More GPUs, more ways to fail
18:05 US export controls on PlayStations
20:10 The damage everyone expected by now
24:30 Public vulnerabilities weaponized in hours
30:15 Why labs can't grade each other
37:15 Why most of RSI isn't actually RSI
40:05 Why nobody really needs a smarter model
41:50 The AI use cases nobody argues about
47:30 Google Search solved this 25 years ago
50:55 Nobody has privileged knowledge now
55:10 Same model, new harness, 2x cost
58:15 Open source: 5% of spend, 60% of tokens
1:05:30 90% of new databases are created by agents
YouTube: youtu.be/GzEtpAKYRvE
@databricks @martin_casado @sarahdingwangThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
๐ฐ The Databricks Advanced Learning Festival runs September 16 through October 14, with learning pathways across data engineering, analytics, machine learning, generative AI, Apache Sparkโข, and data warehousing.
Complete all modules in at least one pathway during the event window to receive 50% off any Databricks Certification and 20% off a yearly Databricks Academy Labs subscription!
Register and start learning: community.databricks.com/t5/learning-events/databricks-adโฆ -
Databricks
@databricks
โI think that right now, the existential risk is close to zero. So why freak everybody out?โ
Databricks CEO and co-founder @alighodsi joined @a16z General Partners @martin_casado and @sarahdingwang for a conversation on AI risk, what's actually slowing enterprise adoption, and where companies are already seeing value.
Listen to the full episode: www.youtube.com/watch?v=GzEtpAKYRvEThis media couldn't be displayed. See it on the original post. -
Databricks reposted
a16z
@a16z
Databricks' @alighodsi on AI risk and adoption:
Ali isn't losing sleep over the existential risk debate.
He says a number of conditions would all have to be true simultaneously to enable an actual runaway takeoff scenario, and currently several opposite conditions exist.
Each frontier training run requires significantly more resources. Power, GPUs, engineers - and some attempts fail, burning up huge piles of money with them. Until that reverses, he doesn't see the self-improving loop happening.
Cyber is what he's watching most closely and where he anticipates real impact. Most orgs are not equipped for the coming change in agentic capabilities. The time between a vulnerability being published and being weaponized has collapsed from years to hours.
On adoption, he believes most companies don't need a smarter model. The models are already smart enough. The gap is context they don't absorb - the things an employee who's worked at a company for five years learned by osmosis.
If the frontier stopped advancing today, he thinks it wouldn't meaningfully change the value most are extracting from AI anyway.
In conversation with a16z's Martin Casado and Sarah Wang:
00:00 Intro
00:48 Why Ali places the AI risk near zero
05:05 The word "pacing" was a mistake
10:50 What 10k agents and $100m can do
12:20 What would change his mind on AI risk
14:20 More GPUs, more ways to fail
18:05 US export controls on PlayStations
20:10 The damage everyone expected by now
24:30 Public vulnerabilities weaponized in hours
30:15 Why labs can't grade each other
37:15 Why most of RSI isn't actually RSI
40:05 Why nobody really needs a smarter model
41:50 The AI use cases nobody argues about
47:30 Google Search solved this 25 years ago
50:55 Nobody has privileged knowledge now
55:10 Same model, new harness, 2x cost
58:15 Open source: 5% of spend, 60% of tokens
1:05:30 90% of new databases are created by agents
YouTube: youtu.be/GzEtpAKYRvE
@databricks @martin_casado @sarahdingwangThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Databricks
@databricks
Databricks CEO and co-founder @alighodsi joined @EdLudlow on Bloomberg Tech to discuss the AI pacing debate and why he believes the existential risk to humanity today is close to zero.
On where companies should focus their efforts today, Ghodsi shares, โAI models are great at breaking in, and they have all these targets to go through. We have to make huge investments in cybersecurity and protect our software systems."
Lakewatch is purpose-built to help defend against those risks.
Watch the full segment: www.youtube.com/watch?v=onrApadm2RU -
Databricks
@databricks
Data + AI World Tour is underway! ๐
We kicked off the tour this week with stops in Sรฃo Paulo, Singapore, and Sydney, with 17 more cities still to come.
Join us to hear the latest from Databricks leaders, technical experts, customers, and partners, then dive into sessions on AI apps and agents, analytics, governance, and more.
Find an event near you: www.databricks.com/dataaisummit/worldtour -
Databricks
@databricks
Getting an answer is only the start. The next step is turning that insight into something you can share, reuse, and act on.
Genie One is adding more ways to keep that work in one place:
โข Turn conversations into collaborative documents
โข Save repeatable workflows as Genie Agents
โข Bring in more enterprise context with Genie Ontology snippets and file uploads
โข Take actions through connected MCP tools
Thereโs also a new desktop app, so Genie One is easier to keep close while you work.
Learn more: www.databricks.com/blog/beyond-answers-new-genie-one-featโฆ -
Databricks reposted
Neon
@neondatabase
The Neon backend is GA. A complete set of primitives for apps and agents built around the database, with open standards, no lock-in, and branching-first by design.
Starting with: Lakebase Postgres, Object Storage, Functions, Managed Better Auth, and AI Gateway. More to come.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Databricks CEO and co-founder @alighodsi joined @EdLudlow on Bloomberg Tech to discuss the AI pacing debate and why he believes the existential risk to humanity today is close to zero.
On where companies should focus their efforts today, Ghodsi shares, โAI models are great at breaking in, and they have all these targets to go through. We have to make huge investments in cybersecurity and protect our software systems."
Lakewatch is purpose-built to help defend against those risks.
Watch the full segment: www.youtube.com/watch?v=onrApadm2RU -
Databricks
@databricks
Modernizing recurring SQL ETL doesnโt require rewriting the workflows you already rely on.
Declarative ETL is coming directly into Lakehouse, so SQL practitioners can keep working in familiar SQL workflows while using declarative patterns for common recurring tasks:
โณ APPEND for incremental ingestion
โณ AUTO CDC for change data capture
โณ REPLACE WHERE for targeted batch refreshes
Databricks handles the incremental processing, update logic, scheduling, and orchestration needed to run them reliably.
www.databricks.com/blog/modernizing-sql-etl-lakehouse-decโฆ -
Databricks reposted
Brian Halligan
@bhalligan
Ali Ghodsi never wanted to be CEO. In 2015, he was interviewing for a professor job at Berkeley when the @Databricks board handed him the interim title. Revenue that year was $1.5M.
This episode with @alighodsi will go down as one of my favorites. 10 things I took away:
1. Focus the entire company, orders of magnitude of attention, on its single biggest bottleneck. Like a laser, almost to an extreme. The cycle is 1-3 years, not weeks. If your focus changes weekly, then youโre just in firefighting mode.
2. There is nothing worse than a conflict-averse CEO. They are wonderful people, but they are in the wrong job. Conflict is the gym for a CEO: nobody likes it, but everyone has to go.
3. Study your enemy carefully, understand their weaknesses and apply your strengths to those weaknesses. Snowflake had 2x his revenue. He didnโt copy them. He found three weaknesses (proprietary, no AI, expensive) and hammered them account by account for four years. Watch the competition, never follow it.
4. The concept of a Lakehouse was ridiculed internally and online. No one wanted to market with this new term. So he made the whole company religious about it anyway, killed the ads that converted better without the word, and put it in the sales comp plan. It worked. All hands on deck, no exceptions.
5. Be willing to take a step back for a much bigger vision, even when the company is already succeeding. At multiple hundreds of millions in ARR, he was unhappy, because the vision he pitched investors wasnโt the company he was running. So he took one step back to go ten forward.
6. On the flat org, player-coach model that a lot of people have talked about this year: โitโs BS.โ Separate how the company thinks (AI, ontology) from how the humans get managed (they are after all, still humans). His staff meets 3x a week. I asked if it could just be coordinated in a Google doc. His answer: do you meet your wife and kids, or coordinate that in a Google doc?
7. His test for a sales leader: can they build the car, or just drive it? Ron Gabrisko, the Databricks CRO, had seen $0โ50M and $50โ100M+, and hadnโt changed jobs in 10 years prior to joining. Now he has been the CRO for over a decade. He built and drove the car the whole way. That almost never happens.
8. Hire execs ahead of the curve because by the time you need them, itโs too late. A real search takes 6-12 months. The extra time helps you increase false negatives and decrease false positives. Do an insane number of backdoor references because 80% of โfront doorโ references are bs.
9. The best salespeople are not super technical, so stop trying to force them to be. Square peg, round hole. The best win with professional aggression, high EQ, and mapping the real power base (how decisions get made high up in an organization), not technical depth.
10. Yes, your best AEs will annoy people. One of the first at Databricks got a meeting nobody could get, but got banned from the customerโs building for it. He told Ali, โwhat are you complaining about? I got the meeting.โ Professionally aggressive is the bar.
One bottleneck, zero wussing out. He reminds me of @elonmusk that way.
Chapters
0:00 โ Introduction
1:22 โ The secret CEO search and why the board bet on a founder
4:11 โ Professor or CEO? Always taking the harder option
8:18 โ Pour everything into one bottleneck
12:16 โ Killing PLG and learning what great enterprise sellers actually have
19:09 โ Hiring ahead of the curve: sales leaders, execs, and back-door references
27:02 โ The Snowflake rivalry: study your enemy, never copy them
33:22 โ Lakehouse: conviction, ridicule, and the case for second acts
41:02 โ The killer instinct and why conflict-averse CEOs fail
44:10 โ Dunbar's number and rethinking the org chart around AI
48:00 โ AGI is already here โ enterprises just use it as a chatbot
52:55 โ Does he still code? Two days for a connector vs. three quarters
57:18 โ A day in the life, and why the Monday meeting isn't theater
1:04:53 โ Why Databricks will go public, just not yet
1:08:09 โ Get over conflict aversion, or don't be CEO
1:11:07 โ Brian's takeaways
Link to more in the comments.This media couldn't be displayed. See it on the original post. -
Databricks reposted
Brian Halligan
@bhalligan
Ali Ghodsi never wanted to be CEO. In 2015, he was interviewing for a professor job at Berkeley when the @Databricks board handed him the interim title. Revenue that year was $1.5M.
This episode with @alighodsi will go down as one of my favorites. 10 things I took away:
1. Focus the entire company, orders of magnitude of attention, on its single biggest bottleneck. Like a laser, almost to an extreme. The cycle is 1-3 years, not weeks. If your focus changes weekly, then youโre just in firefighting mode.
2. There is nothing worse than a conflict-averse CEO. They are wonderful people, but they are in the wrong job. Conflict is the gym for a CEO: nobody likes it, but everyone has to go.
3. Study your enemy carefully, understand their weaknesses and apply your strengths to those weaknesses. Snowflake had 2x his revenue. He didnโt copy them. He found three weaknesses (proprietary, no AI, expensive) and hammered them account by account for four years. Watch the competition, never follow it.
4. The concept of a Lakehouse was ridiculed internally and online. No one wanted to market with this new term. So he made the whole company religious about it anyway, killed the ads that converted better without the word, and put it in the sales comp plan. It worked. All hands on deck, no exceptions.
5. Be willing to take a step back for a much bigger vision, even when the company is already succeeding. At multiple hundreds of millions in ARR, he was unhappy, because the vision he pitched investors wasnโt the company he was running. So he took one step back to go ten forward.
6. On the flat org, player-coach model that a lot of people have talked about this year: โitโs BS.โ Separate how the company thinks (AI, ontology) from how the humans get managed (they are after all, still humans). His staff meets 3x a week. I asked if it could just be coordinated in a Google doc. His answer: do you meet your wife and kids, or coordinate that in a Google doc?
7. His test for a sales leader: can they build the car, or just drive it? Ron Gabrisko, the Databricks CRO, had seen $0โ50M and $50โ100M+, and hadnโt changed jobs in 10 years prior to joining. Now he has been the CRO for over a decade. He built and drove the car the whole way. That almost never happens.
8. Hire execs ahead of the curve because by the time you need them, itโs too late. A real search takes 6-12 months. The extra time helps you increase false negatives and decrease false positives. Do an insane number of backdoor references because 80% of โfront doorโ references are bs.
9. The best salespeople are not super technical, so stop trying to force them to be. Square peg, round hole. The best win with professional aggression, high EQ, and mapping the real power base (how decisions get made high up in an organization), not technical depth.
10. Yes, your best AEs will annoy people. One of the first at Databricks got a meeting nobody could get, but got banned from the customerโs building for it. He told Ali, โwhat are you complaining about? I got the meeting.โ Professionally aggressive is the bar.
One bottleneck, zero wussing out. He reminds me of @elonmusk that way.
Chapters
โ Introduction
โ The secret CEO search and why the board bet on a founder
โ Professor or CEO? Always taking the harder option
โ Pour everything into one bottleneck
โ Killing PLG and learning what great enterprise sellers actually have
โ Hiring ahead of the curve: sales leaders, execs, and back-door references
โ The Snowflake rivalry: study your enemy, never copy them
โ Lakehouse: conviction, ridicule, and the case for second acts
โ The killer instinct and why conflict-averse CEOs fail
โ Dunbar's number and rethinking the org chart around AI
โ AGI is already here โ enterprises just use it as a chatbot
โ Does he still code? Two days for a connector vs. three quarters
โ A day in the life, and why the Monday meeting isn't theater
โ Why Databricks will go public, just not yet
โ Get over conflict aversion, or don't be CEO
โ Brian's takeaways
Link to more in the comments.This media couldn't be displayed. See it on the original post. -
Databricks reposted
Patrick Wendell
@pwendell
Today we rolled out Astra to every engineer at Databricks (N=~3500). Some notes that may be helpful to others:
1. Astra unambiguously out performs our previous highest-end models (Opus 5, Sol 5.6) on highly complex tasks, especially those related to high level system design or long range horizontal tasks.
2. Engineers given Astra increased overall coding spend by around 60% compared to baseline.
3. It is not clear Astra meaningfully improves on medium/low complexity coding tasks compared to earlier models. We suspect those tasks are mostly saturated (i.e. perfectly executed) by existing models.
4. We learned above by piloting Astra with around 200 users to gain signal on both quality and cost. We use Unity Gateway to do cohort-based experiments for all new models.
5. We give engineers a sub-budget specific to Astra to encourage them to use Astra selectively on complex tasks while preferring lower cost models for everyday tasks. Our engineers are able to mix-and-match tools and models within their overall budget envelope (we also allow for increased budgets through various mechanisms). These budgets are defined in Unity Gateway and regularly revisited.
Note: We do not have robust comparisons of Astra-vs-Fable because we have net yet rolled out Fable widely due to data retention policies. -
Databricks reposted
Omnigent
@omnigent_ai
Omnigent v0.14.0 is now available! ๐
This release makes it easier to work across GitHub repositories, configure sessions, and keep track of ongoing work.
๐ Multi-repo GitHub PRs and sandboxes
๐๏ธ Redesigned composer
๐ช Claude SDK /compact
๐๏ธ Gensee, Kubernetes, CockroachDB
๐ Approvals that survive restarts
Learn more ๐ omnigent.ai/releases/0.14.0
#omnigent #aiagents #opensource -
Databricks
@databricks
Give AI the right business context, and it can deliver more trusted answers and help teams take action with confidence.
Join us on Sept. 23 to learn how to:
โข Enable a living context graph that continuously infers business terms, entities, and KPIs
โข Ensure AI delivers trusted answers based on each userโs access
โข Turn insights into autonomous actions, agents, and apps, no code required
โข Bring context-aware AI into Slack, Teams, mobile, and MCP-based experiences
RSVP: dbricks.co/4yD0dgp -
Databricks
@databricks
What if an agent could branch, rewind, or query a past Postgres state without copying the database first?
Lakebase Postgres makes transaction history addressable by treating the WAL as the source of truth and decoupling compute from storage.
That means:
โข Branch from a specific LSN with copy-on-write
โข Restore to an earlier LSN without copying data back
โข Query past database states directly within the history window
For agentic workloads, that makes isolated, reversible database workflows much lighter weight.
www.databricks.com/blog/object-storage-wal-lakebase-postgโฆ -
Databricks reposted
Youssef Mrini
@YoussefMrini
August brought a massive wave of updates to Databricks Genie One, focusing on seamless collaboration, broader mobile access, and smarter enterprise workflows. From native PDF exports and Model Context Protocol (MCP) write capabilities to default Ontology integration, these new features make it easier than ever to transform raw data into actionable business intelligence.
Here is a breakdown of everything new in @Databricks Genie One this month ๐ ๐บ
#databricks #genieoneThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
With LakeFlow Designer, citizen data users and technical teams can take a visual, no-code approach to building production-ready data transformation pipelines.
See the latest updates in action, including spreadsheet-style result edits, new input and output options, AI-powered features, code visibility, lineage highlights, and visual revision history.
dbricks.co/4xNurgp -
Databricks reposted
Leon van Zyl
@leonvz
I made Claude Code and Codex debate a plan, then let a third agent build it.
All in Omnigent, Databricks' new open-source layer for running coding agents together. Setup, session forking, security policies, full build.
youtu.be/gYtQ1LKSgXY -
Databricks
@databricks
A recommendation is useless if the user has already clicked away. โฑ๏ธ
That's why Databricks and @Redisinc have partnered to deliver in-session personalization by combining Databricks Real-Time Mode (RTM) for continuous processing with Redis for sub-millisecond serving, without managing a separate streaming engine.
Explore the joint architecture, performance benchmarks, and code snippets: redis.io/blog/delivering-real-time-personalization-with-dโฆ -
Databricks
@databricks
Why size Postgres for a peak you rarely reach?
Lakebase Postgres autoscaling watches CPU, memory, and the databaseโs working set, then resizes compute to match the workload in real time.
Because storage and compute are separated, CPU and memory can be added or removed on a running VM without stopping Postgres or dropping connections.
That means capacity can scale up when demand rises and scale down when it falls, so you stop paying for compute you no longer need.
www.databricks.com/blog/autoscaling-lakebase-postgres -
Databricks
@databricks
As organizations scale their data and AI ambitions, many are rethinking the role of the traditional enterprise data warehouse.
This eBook explores how teams can modernize with:
โข Elastic scalability without costly hardware upgrades
โข More flexible cloud-based cost models
โข Support for real-time analytics, AI, and machine learning
โข Open source technologies that help reduce vendor lock-in
You'll also learn how Databricks' structured migration approach uses POCs, MVPs, and Databricks-native tools to help minimize risk and accelerate the journey to a modern data platform.
www.databricks.com/resources/ebook/migrate-your-legacy-daโฆ -
Databricks
@databricks
The Databricks SSH tunnel lets developers work from VS Code, Cursor, or the terminal while running code on Databricks compute.
You can:
โข Work directly with files in your Databricks workspace
โข Use serverless compute, GPU-enabled compute, or an existing cluster
โข Give coding agents access to your workspace files
โข Set up a base environment with the dependencies you need
No more switching back and forth between your IDE and workspace.
Watch the full demo: dbricks.co/4dwUSPoThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
The hard part of enterprise AI isnโt getting an answer. Itโs getting an answer that understands how your business actually works.
Genie One uses unified context from Genie Ontology to connect governed data, business definitions, documents, applications, and operational systems into a shared view.
That helps teams:
โข Ask questions in the tools they already use
โข Get answers grounded in trusted data and business terms
โข Carry that context into follow-up work
โข Turn recurring decisions into actions and agents
See how it works: www.databricks.com/blog/unified-context-missing-layer-entโฆ -
Databricks
@databricks
CMSPI cut payment optimization work from 30โ40+ hours to about 30 minutes with Lakebase Postgres.
Lakebase stores user and contextual state, while the Lakehouse handles the analytical data and analysis. That lets consultants save drafts, compare scenarios, and work with transaction-level precision without losing context.
In the first six months of the Lakebase-enabled PROM rollout, CMSPI identified approximately $27M in realized incremental savings for existing clients, now being implemented.
Watch their Data + AI Summit session to hear the story: www.databricks.com/customers/CMSPI/lakebase -
Databricks reposted
Reynold Xin
@rxin
The best database for agents and recommended by agents is Lakebase Postgres on neon.com
Theo Otz
@Totzenberger
#1 in Claude Code, Codex and Cursor. Still first for GPT-6 Astra and Fable 5.1
@neondatabase ripped our leaderboard of which database agents choose.
Agents cite easy setup, branching and lower compute bills through scale-to-zero.
Every run open ๐
armature.tech/leaderboards -
Databricks
@databricks
DeepSeek 4.1 Flash is on Databricks the day it ships.
On OfficeQA Pro V2, it lands on the Pareto frontier, making it a strong open-source option for enterprise document reasoning.
You can point it at the data already in your Lakehouse and use it to build governed AI apps and agents from day one.
โณ Every call routes through Unity Gateway
โณ Access, spend, and performance stay under one view
โณ The same control layer applies across @deepseek_ai and every other model you run
docs.databricks.com/aws/en/release-notes/product/2026/sepโฆ -
Databricks reposted
Redis
@Redisinc
Two systems, one job: continuous compute and instant serving. @Databricks Real-Time Mode computes state as events happen. Redis serves it in sub-millisecond time. Full pattern and code walkthrough here: redis.io/blog/delivering-real-time-personalization-with-dโฆ
-
Databricks
@databricks
Marketing teams already have the data. The harder part is turning it into something they can act on quickly.
Genie One helps marketers work directly with governed business data across five common workflows:
โข Campaign and channel performance
โข Funnel attribution
โข 360 customer insights
โข Omnichannel planning
โข Business reporting on the go
Teams can ask questions in plain language, reuse repeatable analyses, and schedule recurring reviews without rebuilding the work each time.
Explore five ways marketers are using Genie One: www.databricks.com/blog/five-ways-marketers-can-use-genieโฆ -
Databricks
@databricks
Data + AI World Tour 2026 kicks off next week. ๐
We're heading to 20 cities for free, one-day events focused on the newest innovations in AI and practical ways to advance your data and AI strategy.
Hear from Databricks leaders, technical experts, customers, and partners, then go deeper with technical breakouts and hands-on learning across AI apps and agents, data warehousing, BI, and more!
Find your city:
www.databricks.com/dataaisummit/worldtour -
Databricks
@databricks
AI is showing up everywhere. The next step is making sure teams can actually see whatโs being used, what it costs, and whether itโs working.
@matei_zaharia and @kuhlenhuth walk through how Unity Gateway helps teams answer questions like:
โข Whoโs using what?
โข Whatโs it costing?
โข Is it delivering quality outcomes?
They also cover how Omnigent helps builders safely combine and share the coding agents and SDKs they already use.
Watch now: www.databricks.com/resources/webinar/govern-ai-spend-scale -
Databricks reposted
Turner Novak ๐๐งข
@TurnerNovak
New @ThePeelPod with Ron Gabrisko, CRO of @databricks
Ron joined Databricks at less than $1M in revenue and helped build it to a $7B+ run-rate over the next decade.
We go inside the 13-year journey from a small startup founded by seven PhDs to a $190B company.
We hit on all their biggest decisions, the mistakes, what they got right, and what he wishes he knew earlier.
Ron's the rare CRO who's scaled a business from early startup to near-public company, runs his team on the product he sells, and has lots of advice around early sales motions and building and scaling a sales team.
Full episode here + links below.
0:00 From under $1M to $7B+ in revenue
1:07 Seven founders and three big bets
2:49 Why going cloud-only was contrarian
5:14 Monetizing open source: "what will they pay for?"
11:40 What Databricks actually is
14:17 Genie, the AI he runs the business on
19:20 It's the data context, not the model
21:36 The early AI bet, before LLM's
26:32 Why enterprise AI beats consumer AI
30:00 Automating his own sales org
32:18 How Ben Horowitz pitched him
33:48 Why seven co-founders is an advantage
35:54 Teaching the CEO sales: org charts and MEDDIC
42:08 Biggest sales mistakes and four growth stages
45:14 Why technical products need technical sellers
47:21 The seller profile: technical, gritty, no short stints
50:45 Back-channeling references that don't BS you
53:32 Hiring 40 reps and why PLG didn't convert
58:07 How a16z opened enterprise doors
1:05:47 Why he gives POC's away for free
1:08:50 Raising prices to match value
1:11:34 Why he killed seat-based pricing
1:14:37 Build for enterprise requirements early
1:16:46 Consumption selling and the six-month planning cycle
1:19:54 Expanding internationally without breaking it
1:23:38 The four C's of enterprise AI
1:26:54 Why messy data blocks AI adoption
1:29:07 Forward deployed engineers: what makes them win
1:31:56 When does Databricks go public?
1:33:36 LL Cool J, Michael Jordan, and never losing a gameThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
The Replit-Databricks integration is now generally available, with new native Lakebase support!
Now, you can use @Replit to build full-stack Databricks Apps on live, governed enterprise data. Replit Agent can automatically provision a Lakebase database, while AI-proposed schema changes require human approval.
Build, deploy, and iterate in one flow.
See it in action: replit.com/blog/databricks2026This media couldn't be displayed. See it on the original post. -
Databricks reposted
Replit โ
@Replit
Building context-rich enterprise apps just got easier. The Replit and @databricks integration is now generally available with native Lakebase support. Create full-stack apps with live warehouse data and a managed database layer. All governed inside Databricks.
Read the announcement โ replit.com/blog/databricks2026 -
Databricks
@databricks
Complex document extraction gets hard fast when youโre working across hundreds of pages, thousands of line items, or schemas that require reasoning.
AI Extract Precision Mode is built for those workloads. Across benchmarks spanning roughly 9,000 complex documents, it reached 94.7% extraction accuracy and outperformed the strongest frontier-model chunk-and-merge baseline by seven points.
Designed to stay accurate as documents and schemas get more complex โ๏ธ
See how Precision Mode handles complex document extraction: www.databricks.com/blog/databricks-document-intelligence-โฆ -
Databricks reposted
Omnigent
@omnigent_ai
Omnigent v0.13.0 is now available! ๐
This release is focused on tightening the loop between your agents, your code, and the infrastructure they run on.
๐ GitHub PR panel in the session workspace
๐ผ๏ธ Built-in Canvas board of live session cards
๐ฆ New managed sandboxes: libkrun microVMs and self-reclaiming Kubernetes
โก Instant session switching
๐ Jcode as a first-class ACP harness
Full release notes ๐ github.com/omnigent-ai/omnigent/releases/tag/v0.13.0
#omnigent #aiagents #opensource -
Databricks
@databricks
What happens when thousands of devices start streaming events at once?
This demo shows a simpler real-time IoT architecture using:
โข Zerobus Ingest for ingestion
โข Lakebase Postgres for low-latency serving
โข Databricks Apps for the front end and back end
Thousands of concurrent IoT events. Live sensor data from phones around the world. No Kafka or Kinesis setup.
See the architecture in action: www.youtube.com/watch?v=cfX6gLpE6XEThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Nikita | Scaling Lakebase Postgres
@nikitabase
Large Postgres compute nodes now run up to 2ร faster and with lower latency
neon.com/blog/improving-lakebase-compute-cache-part-1 -
Databricks
@databricks
Embedding an AI/BI Dashboard is easy. Making sure every viewer sees only the data theyโre entitled to is harder.
This guide shows how to securely share a single dashboard across external partners and internal teams, while enforcing per-viewer access with:
โณ A centralized entitlements table
โณ __aibi_external_value for viewer-specific scope
โณ Group-based access for internal users
โณ Row-level security and column masking
โณ Default-deny controls and protection for direct SQL access
One dashboard, one set of access rules, without maintaining separate dashboards for every customer or team.
Read the guide: www.databricks.com/blog/beyond-embedding-how-secure-aibi-โฆ -
Databricks
@databricks
Agentic tools are changing the cost of trying an idea.
OpenClaw creator @steipete and @OpenAI's Codex engineering lead @thsottiaux discuss how developers can now prototype ideas that once felt too expensive to pursue, test them earlier, and use what they learn to make better decisions faster.
Watch the full conversation on how AI agents are transforming software engineering:
www.databricks.com/resources/webinar/agents-work-shippingโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Effective enterprise data agents require search that is both accurate and fast.
Thatโs why weโre introducing ๐๐ฑ๐ฎ๐ฝ๐๐ถ๐๐ฒ ๐๐ป๐๐๐ฟ๐๐ฐ๐๐ฒ๐ฑ-๐ฅ๐ฒ๐๐ฟ๐ถ๐ฒ๐๐ฒ๐ฟ, which combines the speed of parallel retrieval with the performance of sequential search while maintaining strict cost and latency guarantees.
The goal is simple: spend additional search steps only when they are useful.
Databricks
@databricks
Across seven held-out internal and external benchmarks:
โณ More than 2x faster than leading third-party and open-source models at comparable performance
โณ An average of 2.5 steps, and less than 6 seconds latency, even for the hardest tasks
โณ Pareto-optimal across a range of retrieval budgets
Databricks
@databricks
Adaptive Instructed-Retriever returns quickly when the evidence is clear and uses sequential search only when harder requests require it.
Read the research: www.databricks.com/blog/adaptive-instructed-retriever-froโฆ -
Databricks
@databricks
When an AI agent grabs the wrong revenue table, the problem often isnโt the prompt. Itโs missing business context.
Genie Agents turn trusted context into domain-specific AI agents from a single prompt, reasoning across governed data, documents, and files in Unity Catalog.
A good starting loop:
One focused use case โ benchmark against known answers โ curate the context when results miss โ expand from there.
The prompt gets you started. Trusted context is what makes the agent reliable.
www.databricks.com/blog/designing-effective-genie-agents-โฆ -
Databricks reposted
Nikita | Scaling Lakebase Postgres
@nikitabase
Great summary of Lakebase architecture
Debasish (เฆฆเงเฆฌเฆพเฆถเฆฟเฆธเง) Ghosh ๐ฎ๐ณ
@debasishg
Sunday morning reading - a @VLDBconf 2026 paper on Lakebase from Databricks .. a very nice overview of the architecture that belongs to the same family as any system that treats object storage as the durable backplane and puts a low-latency cache/log in front of it.
Here are some points on how Lakebase handles durability and failure handling, things that differ so subtly across similar platforms like Aurora ..
โข Commit point. Lakebase does not fsync WAL on the Postgres compute node. COMMIT returns when a quorum of safekeepers - typically two of three, in different AZs - has flushed that WAL record to local disk. Pageservers and object storage are not in that handshake.
โข What each layer is allowed to lose. Compute can vanish at any time, it holds no durable state. A pageserver is a cache, so losing its NVMe does not drop committed transactions. Durability of recent writes sits on safekeeper disks until those segments are uploaded to object storage.
โข The tail window. After SUCCESS, new WAL exists only on the safekeeper quorum. S3 catches up later, tracked by backup LSN. If a quorum of those flushed SK copies is destroyed before that upload, acknowledged writes are gone. That is the window, it is not closed at commit time.
โข Compute and pageserver failure. Compute crash, scale-to-zero, and failover are 0 data loss because a new compute attaches to the same log. Pageserver NVMe loss does not drop committed transactions, another pageserver can reconstruct pages from WAL and from layers already in object storage.
โข Object storage as the long-term copy, not the commit copy. Once backup LSN has passed a segment, Safekeeper-local WAL can be dropped and history lives in the lake. Branching and Point in time recovery use that LSN-addressable history. They do not move the commit rule: SUCCESS still means quorum disk flush, not an S3 PUT. -
Databricks
@databricks
You can now run, debug, and scale Databricks workloads without leaving your local IDE or CLI.
Connect VS Code, Cursor, or your terminal directly to Serverless, AI Runtime, and dedicated clusters to work with Python and SQL on Databricks compute.
You can also browse Unity Catalog, keep files and dependencies in sync with the workspace, and use coding agents with full workspace context.
Fewer context switches. A faster development loop for data engineering and ML. www.databricks.com/blog/run-debug-and-scale-databricks-woโฆ -
Databricks
@databricks
AI needs context to understand how your business actually runs.
Join our upcoming webinar to learn how Genie Ontology helps bring that context together so AI can deliver trusted answers, act autonomously, and give teams back time.
Youโll learn how to:
โ Build a living context graph across business terms, entities, and KPIs
โ Deliver trusted answers based on each userโs access
โTurn insights into autonomous actions, agents, and apps
โ Bring context-aware AI into Slack, Teams, mobile, and MCP-based experiences
Hear directly from Databricks experts and see Genie Ontology in action. RSVP: www.databricks.com/resources/webinar/closing-the-ai-conteโฆ -
Databricks
@databricks
Tired of choice overload? With so many AI models available, itโs easy to just default to the most capable (and most expensive) option for every coding task.
Smart Routing in Unity Gateway takes the guesswork out by automatically matching your tasks to the right model based on complexity. It uses lightweight models for simple edits and reserves frontier models for the heavy lifting.
Paired with Omnigent, it automatically matches your task with the best model and coding harness so developers can stay focused on writing code.
High-quality results. 30%+ lower task costs. www.databricks.com/blog/smart-routing-unity-ai-gateway-maโฆ -
Databricks
@databricks
Better AI agents need better context.
๐ฐ The Databricks Certified Context Engineer Associate certification validates the skills needed to curate context and build reliable, production-grade agentic systems.
Weโre also expanding agent-focused training with courses on fundamentals, retrieval, and evaluation, plus official guidance for using AI tools to prepare for Databricks certification exams.
Explore the certification and training: www.databricks.com/blog/skills-gap-behind-agentic-ai-and-โฆ -
Databricks
@databricks
You ship code in seconds and build apps, agents, and AI products faster than ever. So why does your database still take hours to provision?
Lakebase is a new category of serverless Postgres database built for the way teams write software today, with instant branching, separate compute and storage, and architecture designed to scale with app and agent workloads.
Read ๐๐ข๐ฌ๐ฆ๐ฃ๐ข๐ด๐ฆ ๐๐ฐ๐ณ ๐๐ถ๐ฎ๐ฎ๐ช๐ฆ๐ด to learn:
โข Why traditional databases break down under modern app and agent workloads
โข How separating compute from storage changes cost, speed, and reliability
โข What instant branching and cloning unlock for development teams
โข How the lakebase architecture fits alongside your lakehouse for unified transactional and analytical work www.databricks.com/resources/ebook/lakebase-for-dummies -
Databricks
@databricks
GPT-6 Astra, @OpenAI's most powerful model, has landed as a day-zero release on Databricks!
This is OpenAI's biggest leap in agentic reasoning and your teams can put it to work on production data today.
โ In our internal evaluations, Astra achieves state-of-the-art quality at great efficiency on Databricks' OfficeQA Pro, OfficeQA Pro V2, and Document Processing benchmarks.
โ Every call to GPT-6 Astra flows through Unity Gateway:
โณ same governance
โณ same audit trail
โณ same cost controls you already know and trust across Claude, Gemini, Grok and every other model on Databricks.
Try GPT-6 Astra - see documentation: docs.databricks.com/aws/en/release-notes/product/2026/sepโฆ -
Databricks
@databricks
The biggest AI coding cost lever isnโt using less AI. Itโs using more efficient models as they become available.
That takes more than picking a cheaper model once. Teams need to keep evaluating price and performance, preserve flexibility across models and harnesses, route work intelligently, and reduce the token overhead surrounding each task.
At Databricks, Smart Routing has reduced average task cost by more than 30% while roughly matching the quality of the most expensive model in the working set.
Learn more about managing AI coding costs at scale: www.databricks.com/blog/managing-ai-coding-costs-scale -
Databricks reposted
Ivan Zhou
@ivanzhouyq
We evaluated GPT 6 Astra at @databricks and it claims the new SOTA on our OfficeQA Pro & Pro V2 benchmarks, using our Genie harness. It also improves significantly from gpt 5.6 sol on the $ per task. Throughout our benchmarks, it shows a clear step up on data reasoning and document understanding for enterprises.
It also has become my daily driver on @omnigent_ai. It is a great model to collaborate with and get things done reliably.
Congrats to @OpenAI. The model will come to our Unity Gateway and smart routing soon! -
Databricks
@databricks
Super excited to see GPT-6 Astra being rolled out to enterprises!
We've been testing @OpenAI's GPT-6 Astra during early access - it achieves state-of-the-art on Databricks' OfficeQA Pro, OfficeQA Pro V2, and Document Processing benchmarks.
GPT-6 Astra is coming soon to Databricks through Unity Gateway. -
Databricks reposted
Nikita | Scaling Lakebase Postgres
@nikitabase
www.vldb.org/pvldb/vol19/p4385-pandis.pdf
This is the foundation of Lakebase architecture pioneered by @neondatabase
We just presented it at @VLDBconf - the main database scientific conference and also covered it on the @VLDBconf keynote by a @databricks cofounder @rxin -
Databricks
@databricks
We found and eliminated an estimated $1.2M a year in wasted AI spend and lost productivity in one hour.
Here's how ๐
Using Unity Gateway tracing and Genie One, we identified seven small MCP-server bugs that were quietly driving:
โข ~$499K/year in wasted tokens
โข ~12,000 engineering hours/year in agent wait time
โข 1,409 tool errors in a single 24-hour window
Genie One turned the trace data into a ranked list of what to fix, and a coding agent helped close the loop in an hour. www.databricks.com/blog/how-we-eliminated-1-million-year-โฆ -
Databricks reposted
Omnigent
@omnigent_ai
Omnigent v0.12.0 is now available! ๐
This release is focused on meeting your existing tools and workflows where they already live.
๐ฅ Import Claude Code, Codex, and other CLI sessions into the web UI
๐ Projects now drive new sessions
๐ฑ Refreshed mobile and wide-screen UI
๐ Antigravity, plus Devin and Grok Build in the New Chat picker
๐ฅ๏ธ Run your host as a service on macOS and Linux
Full release notes ๐ omnigent.ai/releases/0.12.0
#omnigent #aiagents #opensource -
Databricks
@databricks
#vldb2026 is underway, and Databricks is here as a Gold Sponsor.
Weโre sharing what weโre building for the future of agent-native data infrastructure, including:
โข a keynote from Databricks co-founder @rxin on why the agentic future demands Lakebase Postgres
โข AutoLiquid and Ultron query optimization
โข Lakehouse//RT, Lakebase, and LTAP
โข conversations with the database community on the ground
Still ahead: sessions and demos on Lakebase, @ApacheSpark Structured Streaming, and Enzyme.
If youโre at VLDB, come find the team ๐ -
Databricks
@databricks
Day 0 access unlocked: Gemini 3.8 Flash is officially live on Databricks!
@Google's latest model sets a new standard for internal document parsing and dominates our OfficeQA Pro benchmark, making it a powerhouse for complex enterprise data.
The best part?
โ Run it directly on your Lakehouse data
โ Enforce unified governance with Unity Gateway
โ Monitor, scale, and route calls across all your custom AI apps
Build governed AI apps with Gemini 3.8 Flash today: docs.databricks.com/aws/en/release-notes/product/2026/sepโฆ -
Databricks reposted
Delta Lake
@DeltaLakeOSS
Join us next Tuesday for the Delta Lake Community Meetup! ๐
Stephen Carman (@databricks) will cover Deletion Vector support in Change Data Feed using Kernel, Tyler Croy (Buoyant Data) will share key features and enhancements in delta-rs 1.0.
Bring your questions for a live Q&A with the maintainers.
๐๏ธ Tuesday, Sept 8
๐ 9:00 AM PT
Register ๐ luma.com/delta-7kbm
#deltalake #opensource #openlakehouse -
Databricks
@databricks
Databricks DevHub is the new home for developers looking to build working apps or agents faster. โก
Start with ready-to-use templates, follow step-by-step guidance, and build with Databricks Apps, Lakebase, Agent Bricks, and more.
Build agentic apps in minutes: -
Databricks
@databricks
Claude Fable 5.1, @AnthropicAI's most capable model, is available as a day 0 release on Databricks!
Claude Fable 5.1 joins Claude Opus 5, Claude Sonnet 5, and 30+ open-source and frontier models on Databricks.
With Unity Gateway, you can now connect Claude Fable 5.1 to your coding agents and get smart routing, centralized cost controls, and observability in a single pane of glass: docs.databricks.com/aws/en/release-notes/product/2026/sepโฆ -
Databricks
@databricks
AI does not need a perfect enterprise model before it can begin delivering value. Genie Ontology uses the governed assets you already have to help organizations get started from day one.
Over time, deliberate curation strengthens that business context, making answers more accurate, authoritative, and trustworthy.
In this guide, we outline six practical ways to operationalize Genie Ontology, covering areas such as:
- Stronger business semantics
- Clear authority signals
- Effective governance
- Continuous evaluation
The best approach is to start small. Choose one high-value domain, model the critical โheadโ of the business, and let Genie infer the long tail.
Then expand based on the questions users ask, the areas where ambiguity remains, and the opportunities where stronger context can improve decision-making.
It is a practical, iterative approach to helping AI better understand how your business operates. www.databricks.com/blog/operationalizing-genie-ontology-yโฆ -
Databricks
@databricks
What if documents, images, audio, and video could behave like any other column in your lakehouse?
FILE type makes unstructured data native to your tables, so teams can query and process multimodal data while applying the same fine-grained access controls and security policies used for standard tables.
And because FILE is being built in the open, weโre working with the community to bring support directly to Parquet, Delta Lake, Apache Iceberg, and Apache Sparkโข.
Learn more: www.databricks.com/blog/introducing-file-type-native-coluโฆ -
Databricks
@databricks
โGenie is a game changer. Genie helps me go from ideation to production faster, quicker, and without any errors.โ
Hear directly from users on how theyโre using Genie to ask better questions, get to answers faster, and work across the tools they already use ๐งThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Databricks has been named to @MadronaVenturesโ 2026 Intelligent Applications 40 list!
Weโre honored to be recognized among the top private companies building with and enabling the AI applications shaping our future. Databricks is also the only company to appear on every IA40 list.
Featured today on the NYSE floor alongside fellow #ia40 honorees ๐ธ
Databricks
@databricks
Explore the full list here: www.ia40.com/the-list
-
Databricks
@databricks
Can object storage sit underneath a transactional database and make it easier for agents to work with?
This question is what started Lakebase Postgres. The answer does not just depend on how fast your object store is, but rather where you place the source of truth.
See how we architected Lakebase Postgres and why when Postgres is architected this way, it becomes an evolution of traditional OLTP systems thatโs built to handle agentic workloads: www.databricks.com/blog/object-storage-wal-lakebase-postgโฆ -
Databricks
@databricks
๐ We've been busy shipping new features! @karpovlabs and Holly Smith are here to unpack whatโs new and how it all fits together.
In the latest Over Architected, they break down the newest Databricks updates, show how they work, and explore how they all fit together in one architecture.
Covered in this episode:
โข Lakehouse//RT
โข Omnigent
โข Managed agent memory
โข Open Sharing
โข Managed disaster recovery
โข New Lakeflow connectors
โข LTAP
โข New model support
Watch the full episode: youtu.be/-uocW5O30MQ -
Databricks
@databricks
Getting a prototype working is one thing. Getting it ready for production is where things get complicated.
This guide gives you practical examples, code snippets, and repeatable patterns to help you move faster.
Inside:
โข Turn notebooks and prototypes into real applications
โข Serve analytical data and application state through a transactional layer
โข Build secure, governed apps without custom infrastructure
โข Deploy and operate apps with production-ready patterns
Download the guide ๐: www.databricks.com/resources/ebook/hands-guide-apps-databโฆ -
Databricks
@databricks
Your data. Your context. Real outcomes.
Attend #dataaiworldtour 2026 to learn how organizations are grounding AI in enterprise data and business context.
Hear the latest product announcements and customer insights, join technical breakouts, and explore practical ways to build and run AI apps, agents and analytics at scale.
Find a city near you: www.databricks.com/dataaisummit/worldtour -
Databricks
@databricks
GLM 5.3 is available as a day 0 release on Databricks!
GLM 5.3 is the smartest open-weight model available today and joins GLM 5.3 Flash and 30+ open-source and frontier models available natively on Databricks.
We host GLM 5.3 on secure GPUs owned by Databricks so you can use the most intelligent models with your most secure data.
With Unity Gateway, you can connect GLM 5.3 to your coding agents and get smart routing, centralized cost controls, and observability in a single pane of glass.
docs.databricks.com/aws/en/release-notes/product/2026/august -
Databricks
@databricks
More AI tools usually means more questions: whoโs using what, whatโs it costing, and is it actually working well?
@matei_zaharia and @kuhlenhuth show how Unity Gateway helps teams see and control AI usage across models, agents, harnesses, and workflows.
They also cover how Omnigent lets builders combine and share the coding agents and SDKs they already use, while leaders keep governance, cost, and quality in check.
Watch now: www.databricks.com/resources/webinar/govern-ai-spend-scale -
Databricks
@databricks
๐ Weโre heading to #vldb2026 next week as a Gold Sponsor!
Databricks Co-Founder and Chief Architect @rxin will open the conference with a keynote on the โthird golden ageโ of database engineering, including Lakebase and LTAP.
Our engineering and research teams will also be sharing work on:
- Lakebase and serverless Postgres
- Spark Structured Streaming
- Automatic Lakehouse optimization
- History-based query optimization
- Incremental materialized view maintenance
Stop by the Databricks booth to meet the team, talk through the papers, and see what weโre building for the agentic era.
www.databricks.com/blog/building-ai-era-lakebase-streaminโฆ -
Databricks reposted
Ivan Zhou
@ivanzhouyq
We are very excited about GLM 5.3 Flash, the latest frontier model in the efficient tier:
- On OfficeQA Pro and Pro V2, GLM 5.3 Flash outperforms DeepSeek V4 Flash 0731 and GPT 5.6 Luna. We are especially impressed to see it push out the quality-cost pareto frontier for both benchmarks.
- We also evaluated its new vision capabilities on an internal enterprise document parsing benchmark. It delivers strong performance approaching Gemini 3.6 Flash, with solid results on the structured documents and tables.
You can try GLM 5.3 Flash on the @databricks serving platform today! -
Databricks
@databricks
.@Zai_org's latest open-weight model, GLM 5.3 Flash, is now available on Databricks!
GLM 5.3 Flash joins 30+ open-source and frontier models on Databricks. On Databricksโ OfficeQA Pro v2 benchmark, it delivers 10% higher quality than GLM-5.2 at just one-tenth the cost, pushing out the quality-cost-pareto frontier. With new multimodal support, it can now read figures and verify web pages at coding.
Run GLM 5.3 Flash where your data already lives โ governed, secure, and ready for custom AI apps and agents. Control access, spend, and observability across all your AI with Unity Gateway.
docs.databricks.com/aws/en/release-notes/product/2026/august -
Databricks
@databricks
We asked a frontier agent to count the local maxima on a chart. It looked at the image, thought for 50 seconds, and got it wrong: 17 instead of 18.
Then we gave Databricks Genie the same chart, but first extracted its values into structured JSON with ai_parse_document. Genie got the right answer.Post not available here, view on X
Databricks
@databricks
We tested a fix: parse charts into structured JSON at ingestion, index it with ai_prep_search, and let a lightweight 300M-parameter text embedding model do the retrieval. Across two chart-heavy benchmarks, this approach beat four multimodal embedding models up to 10x its size.
Databricks
@databricks
Chart-JSON enrichment will power Genie One to answer questions over PDFs for databricks customers. It will also be available in ai_parse_document soon. Pair it with ai_prep_search to build agentic retrieval systems that actually get the numbers right.
www.databricks.com/blog/enhancing-agent-retrieval-structuโฆ -
Databricks
@databricks
Databricks Co-Founder and CEO @alighodsi has been named to the 2026 TIME100 AI list!
TIME highlights Ali in their AI leaders category saying, โas AI agents change how organizations work, Databricks is giving those agents access to secure, governed enterprise data on which to operate."
Congratulations to Ali and all of this yearโs #time100ai honorees!
View the full list: time.com/collection/time100-ai/2026/ali-ghodsi/ -
Databricks
@databricks
.@SpaceXAI's latest model, Grok 4.6, is now available on Databricks!
Grok 4.6 sets a new state-of-the-art performance standard with Genie harness on Databricks' OfficeQA Pro v2 benchmark, our flagship benchmark for complex data reasoning tasks on enterprise documents.
Run Grok 4.6 where your data already lives - governed, secure, and ready for custom AI apps and agents built with the data in your Lakehouse. Govern every call, monitor performance, and scale securely across your AI apps with Unity Gateway.
docs.databricks.com/aws/en/release-notes/product/2026/august -
Databricks reposted
Neon
@neondatabase
The Neon CLI is moving fast. In the last weeks, we added tooling for agents, Postgres debugging, branch-first workflows, and tons more
Check out what's new: neon.com/blog/just-landed-in-the-neon-cliThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
[DEMO] Give an AI agent the right context, tools, and guardrails, and it can do a lot more than answer questions.
Watch how to build a store operations agent that pulls from enterprise context and MCP servers, traces behavior in MLflow, turns follow-up work into a recurring weekly task, and stays governed through Unity Gateway.
Built with Agent Bricks, Omnigent, and the OpenAI Agents SDK.
www.youtube.com/watch?v=9KA3_rW9o08 -
Databricks reposted
Omnigent
@omnigent_ai
On Tuesday, Sept 1 in SF, we're spending an evening on the layer above the agent. ๐
An agent with a shell, a budget, and write access to your repo is infrastructure. Infrastructure gets policies. Live Omnigent demos.
Three breakout slots, two tracks each. Speakers from @OpenHandsDev, @cursor_ai, @databricks, @OpenAI, @modal, and @ollama.
๐๏ธ Tues, Sept 1 | 3:30โ9:00 PM PT
๐ Terra Gallery, 511 Harrison St, SF
๐๏ธ luma.com/agenticaiobsnightsf-9-1
#aiagents #aisecurity #omnigent -
Databricks
@databricks
.@NBCUniversal modernized its data infrastructure to support the speed and scale of a modern media business, where major content launches, awards shows, and live events can drive sudden spikes in analytics demand.
Working with Databricks and EXL, NBCUniversal moved to a unified platform for data engineering, analytics, and ML, with job-specific compute that lets pipelines scale independently instead of competing for pre-reserved capacity.
That move delivered:
- 30% lower overall data infrastructure costs
- 300+ analysts onboarded to Databricks SQL
- Greater flexibility to scale for high-traffic events while reducing the time teams spend managing infrastructure
www.databricks.com/blog/nbcuniversals-seamless-migration-โฆ -
Databricks
@databricks
What if you could connect who owns your infrastructure with what it costs in one query?
With Backstage running on Lakebase, Lakehouse Federation can join live ownership data with system.billing.usage.
That means:
โข One SQL query for ownership + cost
โข Ephemeral branches show up as their own billing line items
โข Engineering teams can see dev costs by branch, developer, and sprint
Explore the one-query FinOps pattern:
www.databricks.com/blog/backstage-lakebase-part-3 -
Databricks reposted
Neon
@neondatabase
Postgres on S3 is the right design, but even more interesting is making WAL the source of truth. This is how our storage works - we wrote a deep dive, summary on thread: neon.com/blog/wal-s3-lakebase-storage-for-the-era-of-agents
-
Databricks
@databricks
40,000+ attendees. 20 cities. One global data and AI community.
Starting in September, Data + AI World Tour brings a full day of new ideas, technical learning, and hands-on experiences to a city near you. Hear the latest advancements from Databricks leaders, customers, partners, and technical experts, and explore practical ways to advance your data and AI strategy.
Find your city: www.databricks.com/dataaisummit/worldtour -
Databricks
@databricks
Genie is changing how teams get answers from their data.
In this DataFramed conversation, Databricks Co-Founder and Chief Architect @rxin shares how he now uses Genie to investigate product metrics directly, and why that experience depends on the right data model, ontology, and governance underneath it.
He also digs into Lakebase Postgres, LTAP, and how databases are evolving as agents become a primary persona.
www.youtube.com/watch?v=US6Z_buKizk -
Databricks
@databricks
[DEMO] More models, coding agents, and MCP tools usually means more places to keep track of.
Unity AI Gateway gives admins one place to see usage and costs, set budgets, control which MCP tools agents can access, and block sensitive PII before it reaches an external model.
Amber Roberts walks through the setup, including dashboards, shared and per-user budgets, MCP controls, and input guardrails.
www.youtube.com/watch?v=ujYLgYlo6XM -
Databricks
@databricks
DevConnect is back on tour for H2 2026, built for experienced Databricks builders who want a closer look at whatโs worth shipping next.
Expect deep dives into:
โข Lakehouse//RT, LTAP, Disaster Recovery, Multi Table Transactions, Catalog Managed Commits, and open table interoperability
โข MCPs, Unity AI Gateway, ZeroOps, and Omnigent to cut boilerplate, reduce context switching, and keep costs in check
โข Apps, Genie, and custom chat dashboards to put more builds in the hands of non-data teammates
Find a stop near you and register: www.databricks.com/events?event_type=devconnect®ion=all -
Databricks
@databricks
Working with multiple AI agents shouldnโt mean rebuilding the same setup every time.
Omnigent is Databricksโ open-source meta-harness that gives agents a shared layer for orchestration, control, and collaboration. Switch agents without losing context, route tasks intelligently, set contextual policies and spend controls, and add human approval where it matters.
@YoussefMrini and Quentin Ambard sit down with Databricks co-founder and CTO @matei_zaharia to show how it all comes together.
www.youtube.com/watch?v=sk6HBdmVmL8 -
Databricks
@databricks
For decades, transaction processing and analytics have lived in separate systems that need to stay in sync.
LTAP brings them together at the storage layer. Data sits in open object storage in an open table format, with a single copy that different engines can use for different workloads.
Need transactions? Use Postgres. Need analytics? Use Lakehouse engines.
The result is a simpler architecture for developers and coding agents, without maintaining separate OLTP and analytics copies.
Learn more about LTAP: www.databricks.com/blog/lakebase-ltap-rethinking-databaseโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Your AI is smart enough. The missing piece is context.
Join Databricks on September 23 to see how Genie Ontology helps AI understand how your business actually works.
Youโll learn how to:
โข Build a living context graph across business terms, entities, and KPIs
โข Deliver trusted answers based on each userโs access
โข Turn insights into autonomous actions, agents, and apps
โข Bring context-aware AI into Slack, Teams, mobile, and MCP-based experiences
Save your seat: www.databricks.com/resources/webinar/closing-the-ai-conteโฆ -
Databricks
@databricks
Better data engineering means spending less time managing fragile pipelines and fragmented tools, and more time delivering high-quality data for AI, BI, and analytics.
The Big Book of Data Engineering, 4th Edition brings together practical guidance, code snippets, and real-world examples covering:
โ Scalable ETL patterns
โ Orchestration across data, analytics, and AI
โ Pipeline observability
โ Optimizing Databricks investments and data costs
โ Lakeflow and the Data + AI Platform to manage data pipelines
See how companies across healthcare, financial services, retail, and entertainment are building intelligent batch and streaming data pipelines.
Download the eBook: www.databricks.com/resources/ebook/big-book-of-data-enginโฆ -
Databricks
@databricks
As agentic automation helps developers get more done, the role is evolving toward higher-level decisions about what to build, how systems should work, and where taste and creativity matter most.
Databricks Co-founder @pwendell, OpenClaw creator @steipete, and Codex engineering lead @thsottiaux discuss what that shift means for enterprises building, governing, and scaling fleets of AI agents in production.
Watch the full conversation: www.databricks.com/resources/webinar/agents-work-shippingโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
What does it take to run data behind products used by one billion people every week?
For @OpenAI, Databricks serves as a governed, multicloud foundation across Azure and AWS, powering analytics, marketing, finance, trust and safety, and critical security operationsโfrom threat detection to incident response across high-volume infrastructure.
Beyond using Databricks as its underlying data platform, OpenAI is also a strategic partner. Through the partnership, business users already using ChatGPT Work can use Genie MCP to talk to enterprise data.
Explore how OpenAI runs data at scale on Databricks: www.databricks.com/customers/openai -
Databricks reposted
Ali Ghodsi
@alighodsi
An extremely important functionality for agents is to simply extract fields out of PDFs. This turns out to be harder than people think because LLMs are primarily trained on predicting the next tokens. This leads them to "autocorrect" things that they shouldn't autocorrect. We launched an AI Extract capability that just excels at doing just this task with very high accuracy (95% vs 87% for others) and extremely low cost. Check out this blog on how we did it. The function can of course be called directly from SQL and be used throughout the platform.
www.databricks.com/blog/databricks-document-intelligence-โฆ -
Databricks
@databricks
Turning a hand-drawn sketch into a working dashboard sounds a little like magic ๐ช
With Genie Code, you can upload a photo of your sketch and ask it to build the dashboard. Genie searches the financial data and other relevant workspace assets you have access to, builds datasets, creates the visualizations, and resolves issues along the way.
When the build is complete, Genie Code summarizes what it created, shows which datasets it used, and suggests next steps like publishing, adding filters, or making changes.
From sketch to dashboard, with Genie Code doing the heavy lifting. docs.databricks.com/aws/en/dashboards/manage/dashboard-agent -
Databricks reposted
Omnigent
@omnigent_ai
Omnigent 0.10.0 is now available! ๐
๐ป Run several sandbox providers at once
๐ค Devin harness and Copilot subscription support
๐ฐ New usage page to track session costs, daily spend, and breakdowns by harness and model
๐จ Manage sessions from the web UI
โก๏ธ Switching conversations and terminals is now instant
๐ Full details, bug fixes, and upgrade notes:
github.com/omnigent-ai/omnigent/releases/tag/v0.10.0
#omnigent #aiagents -
Databricks
@databricks
Your data. Your context. Real outcomes.
Attend #dataaiworldtour 2026 to learn how organizations are grounding AI in enterprise data and business context.
Hear the latest product announcements and customer insights, join technical breakouts, and explore practical ways to build and run AI apps, agents and analytics at scale.
Find a city near you: www.databricks.com/dataaisummit/worldtour -
Databricks
@databricks
๐ At the Databricks Grounded Reasoning Cup, academic teams from Stanford, UMass, Yale and other universities tackled a previously unseen corpus and set of tasks to answer one of the hardest questions in AI evaluation: how well do performance improvements on a benchmark generalize to similar, real-world tasks?
Stanfordโs winning team achieved 63.3% accuracy through an end-to-end agent optimization strategy combining a library of reusable skills, targeted document-representation fallbacks, and adaptive verification.
See the techniques that set apart the winning teams: www.databricks.com/blog/evaluating-ai-agents-live-groundeโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
The biggest opportunity with an AI coworker is moving beyond one-off tasks to repeatable business workflows.
Genie One works across governed company data and connected tools to help teams:
โข Automate business reviews and reporting
โข Prepare meeting briefs and follow-ups
โข Keep operational documents current
โข Monitor key signals and trigger alerts
Start with one recurring workflow, refine it based on real usage, then package proven patterns as reusable skills or agents across the organization.
Get started with Genie One: www.databricks.com/blog/get-started-genie-one-top-ai-cowoโฆ -
Databricks
@databricks
The next generation of databases may be built as much for agents as for developers.
Databricks VP of Engineering @nikitabase joins Itโs About Data to unpack the idea behind @neondatabase that now powers Lakebase: separating compute and storage for Postgres OLTP.
The conversation explores how object storage can make operational data available to downstream systems, why developer-first database architecture matters, and what changes when agents start provisioning databases, creating branches, and managing application state themselves.
Tune in to the full episode: www.youtube.com/watch?v=zpqM-YWrXB4 -
Databricks
@databricks
At Databricks, thousands of engineers use coding agents every day, and that makes AI spend one of the fastest-growing line items in R&D.
We found that one budget could not do two jobs well. So we split the problem:
1. A daily budget catches runaway spend, with self-serve increases when usage is intentional
2. A monthly budget governs extraordinary spend, with project-based, manager-approved increases
Because every coding agent routes through Unity AI Gateway, the same controls apply across tools and models, with usage metered in one place.
The goal is not to slow AI adoption. It is to give engineers room to build while keeping spend visible and controlled. www.databricks.com/blog/how-databricks-manages-its-own-coโฆ -
Databricks
@databricks
โWith coding agents, youโre putting this jetpack on and going 10,000 miles an hour, doing things you were never able to do before.โ
In this conversation, @OpenAIโs @steipete and @thsottiaux join Databricks Co-founder @pwendell to unpack what comes next as agents move beyond code authoring into observability, operational work, and long-running responsibilities across software and data systems.
Watch the full conversation: www.databricks.com/resources/webinar/agents-work-shippingโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Two days. Three hands-on trainings. More ways to build with Databricks.
Join the virtual Databricks AMER Learning Festival on August 19โ20 and choose from sessions on:
โข Getting started with Lakebase
โข Building SQL analytics and BI workflows
โข Modern data warehousing
Learn directly from Databricks experts, explore architectural guidance and deployment best practices grounded in real customer use cases, and get live answers to your questions.
Register: www.databricks.com/resources/webinar/databricks-amer-learโฆ -
Databricks
@databricks
Getting started with Databricks Apps can be as simple as giving your coding agent the right prompt.
DevHub prompts can help check your environment, set up what you need, scaffold an app, and deploy it to your Databricks workspace. Then, use templates to keep building without starting over.
For example, the Genie Analytics app template adds a chat interface so users can query data in your Databricks workspace using natural language.
Explore now: developers.databricks.comThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Neon
@neondatabase
New in Neon this week:
- The @ElectricSQL team joins us
- An `inspect_database` tool for agents
- A Herdr panel
- Tons of @vercel updates: Neon skills in the Vercel CLI, AI gateway in AI SDK, Agent Plugins package
- More additions to the Neon CLIThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Omnigent
@omnigent_ai
Selecting the right model for a task, and for every subagent it spawns, is a decision you shouldn't have to make by hand on every run.
Smart Routing makes it automatic. Turn it on once, and Omnigent routes each task and its subagents to the best model and harness for the job:
๐น Open Source: an LLM classifier picks the best model
๐น @databricks: powered by AI Gateway smart routing
Learn more ๐ omnigent.ai/docs/build/routing
#omnigent #opensource #aiagents #llmops #codingagents -
Databricks
@databricks
Runaway AI spend can start with a retry loop or an uncontrolled agent experiment. AI Spend Controls in Unity AI Gateway help teams catch it early.
Organizations can set budget alerts and hard spend caps by user, use case, workspace, or account. Combined with Databricks budgets and cost data logged to Unity Catalog system tables, teams gain visibility and accountability across models, agents, MCPs, and providers.
Learn how to monitor, contain, and govern AI spend at scale: www.databricks.com/blog/introducing-ai-spend-controls-uniโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
This is how Smart Routing working on our AI Gateway, super simple idea, lowers cost about 30% without giving up on quality!
Databricks
@databricks
Introducing Smart Routing in Unity AI Gateway.
Stop overpaying for AI. Smart Routing matches each coding task to the right model and harness based on what the task needs, so higher-cost models can differentiate on intelligence while lower-cost models differentiate on cost and performance.
Match frontier quality and cut task costs by 30%+.
www.databricks.com/blog/smart-routing-unity-ai-gateway-maโฆ -
Databricks
@databricks
Itโs time to scale AI.
Join #dataaiworldtour 2026 in a city near you for a free, one-day event focused on moving AI beyond experimentation with governed data, models, apps and agents.
Hear the latest announcements, learn from customers and technical experts, and explore practical ways to put enterprise AI into production.
Find your city: www.databricks.com/dataaisummit/worldtour -
Databricks
@databricks
This morning, Databricks Co-Founder and CEO @alighodsi joined CNBC's @jonfortt to discuss our recent funding and how Lakebase, our serverless Postgres database built for AI agents, along with Genie and Unity AI Gateway, give organizations the context, control and choice they need to scale AI.
โDuring big transitions like this, itโs good to be able to just focus on your business. If there is so much demand, just build for the future,โ said Ghodsi.
Watch the full conversation: www.cnbc.com/2026/08/13/databricks-funding-round-190-billโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
I got this question so many times today. "How can you grow 80% at $7B?"
The true answer is that we're finally seeing a breakthrough with AI agents starting to work in the enterprise.
The AIs have been super smart for a while, but have lacked basic context that's in people's heads, or in some SaaS system-or-record. A lot of organizations are deploying FDEs to capture this context, or Ontology, and feed it to the AI. This is labor intensive and expensive. We just automated that with Genie Ontology.
Once you have that enterprise context graph, an AI agent like Genie becomes magical. I find myself no longer waiting for answers from my CRO, CFO, CMO, CHRO etc, I just keep queuing up questions on the phone while sitting in meetings. It'd frankly addictive.
Our customers are starting to do the same, over 70% of all queries on the platform are now generated by Genie agents. This fuels more questions to the platform, which drives consumption, which drives revenue. That's the simple answer. -
Databricks
@databricks
.@Google's latest model, Gemini 3.7 Flash, is now available on Databricks!
Gemini 3.7 Flash delivers significant improvements in document parsing over version 3.6, and it now leads among Gemini models on our internal Databricks coding benchmark.
Run Gemini 3.7 Flash where your data already lives - governed, secure, and ready for custom AI apps and agents built with the data in your Lakehouse.
Govern every call, monitor performance, and scale securely across your AI apps with Unity AI Gateway: docs.databricks.com/aws/en/release-notes/product/2026/august -
Databricks
@databricks
Introducing Smart Routing in Unity AI Gateway.
Stop overpaying for AI. Smart Routing matches each coding task to the right model and harness based on what the task needs, so higher-cost models can differentiate on intelligence while lower-cost models differentiate on cost and performance.
Match frontier quality and cut task costs by 30%+.
www.databricks.com/blog/smart-routing-unity-ai-gateway-maโฆ -
Databricks reposted
CNBC
@CNBC
Databricks wraps $5 billion funding round at $190 billion valuation www.cnbc.com/2026/08/13/databricks-funding-round-190-billโฆ
-
Databricks
@databricks
CEO @alighodsi claims AGI already arrived, with the fortune now buried in context the models don't have, writes Victor Dey for Forbes.
Today we closed $5 billion in financing at a $190 billion valuation. The capital is going toward Genie, Lakebase, and Unity AI Gateway, the three bets we're making on what enterprises actually need from AI: access to the context buried across a business, databases built for agents, and control over token spend.
"Unity AI Gateway lets you route all of your tokens through one system and set budgets for different groups or individuals. We call it switching from token maxing to value maxing," says Ghodsi.
More from @Forbes writer @iamVictorDey: www.forbes.com/sites/victordey/2026/08/13/databricks-hitsโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
Today, we announced that we crossed $7B in revenue run-rate, growing over 80% year over year in Q2.
We also shared:
๐ $100M+ revenue run-rate for Lakebase
๐ $1.5B+ revenue run-rate for Lakehouse, growing over 100% year over year
๐ Continued positive adjusted free cash flow
And we raised $5B in our latest fundraise.
Weโll use this capital to invest in:
1๏ธโฃ Lakebase, our serverless Postgres database built for AI agents
2๏ธโฃ Genie, our AI coworkers that actually understand your business data
3๏ธโฃ Unity AI Gateway, our multi-AI governance solution that helps control costs
@iamVictorDey shares more in @Forbes:
www.forbes.com/sites/victordey/2026/08/13/databricks-hitsโฆ -
Databricks
@databricks
Today, weโre pleased to share strong momentum across our business, including crossing $7B in revenue run-rate and achieving >80% year-over-year growth in Q2.
We also shared:
โข >$100M revenue run-rate for Lakebase
โข >$1.5B revenue run-rate for Lakehouse
โข Closed $5B in new strategic funding at a $190B valuation
This new capital will fuel investments in Genie, Lakebase and Unity AI Gateway so we can help customers scale AI with greater context, control and choice.
Learn more: www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks reposted
Omnigent
@omnigent_ai
Omnigent v0.9.0 is now available! ๐
๐งญ Smart routing (@databricks AI Gateway + OSS)
๐จ Refreshed web UI
๐งฐ More sandbox and deployment control
๐ค Grok Build harness + example agents
๐ nimble_extract and nimble_research builtins
๐ Full details, bug fixes, and upgrade notes:
github.com/omnigent-ai/omnigent/releases/tag/v0.9.0
#omnigent #aiagents -
Databricks
@databricks
Classifying text against taxonomies with 100,000+ labels creates a hard tradeoff between accuracy, cost, and maintainability.
We tested three approaches across vendor normalization, company deduplication, and biomedical entity linking:
โข Vector search
โข Vector search followed by AI Classify
โข Direct frontier model calls with prompt caching
The AI Classify workflow delivered five points higher average accuracy than the next-best direct frontier model at roughly one-hundredth of the per-document cost.
The pattern is simple: retrieve the most relevant labels first, then classify.
Explore the benchmark and workflow: www.databricks.com/blog/scaling-document-classification-1โฆ -
Databricks
@databricks
As AI usage grows, the harder question is not how many tokens teams consume. It is whether that spend is delivering value.
Join Databricks Co-Founder and CTO @matei_zaharia and Product Director @kuhlenhuth to see how Unity AI Gateway gives IT decision-makers visibility, guardrails, and spend control across every model, agent, harness, and workflow.
Youโll also learn how the Omnigent meta-harness helps builders safely combine and share the coding agents and SDKs they already use while leaders maintain control over governance, cost, and quality.
Register to join us tomorrow: www.databricks.com/resources/webinar/govern-ai-spend-scale -
Databricks
@databricks
[DEMO] Shift your organization from the old world of โtokenmaxxingโ to the new era of โvaluemaxxingโ with Unity AI Gateway.
At #dataaisummit, Databricks Software Engineer @ankit_math showed how real-time budget policies can guide developers toward more token-efficient models, Omnigent can route work based on task complexity and quality needs, and centralized agent tracing in Unity Catalog can help teams govern usage and stay in control.
Watch the full demo: www.youtube.com/watch?v=AkNMTbKgsaU -
Databricks reposted
Ali Ghodsi
@alighodsi
Excited to share that we've acquired ElectricSQL, the team behind PGlite. Agents need super fast Postgres and this team built an amazing WASM (WebAssembly) implementation of postgres that runs in your browser, but can sync back with Postgres instances asynchronously. Exactly what blazing fast AI agents today need. Excited to supercharge our ๐๐๐ค๐๐๐๐ฌ๐ ๐๐จ๐ฌ๐ญ๐ ๐ซ๐๐ฌ offering with these capabilities.
www.databricks.com/blog/electric-joins-databricks-bring-wโฆ -
Databricks
@databricks
Weโre excited to announce that @ElectricSQL, the maker of PGlite, is joining Databricks to bring WASM Postgres to AI agent sandboxes.
Together, weโre excited to extend Databricks' Postgres capabilities from the lakehouse to the edge.
Electric is leading the way in pioneering backend technology purpose-built for agents. With PGlite, every agent gets its own WASM Postgres build right inside the sandbox where it runs, providing ultra low latency access to local context. And Electricโs real-time sync engine synchronizes distributed state back to a central Lakebase, enabling teams of agents to collaborate without losing track of shared context.
Please join us in welcoming the Electric team! www.databricks.com/blog/electric-joins-databricks-bring-wโฆ -
Databricks reposted
Zach Wilson
@Zachly
Since so many companies are adopting Databricks, data engineers and AI engineers should be learning the platform
In this 5-week course, we cover all the things you need to learn:
- Spark, real-time streaming with Delta Live Table and Spark Streaming
- Iceberg and Delta table and lake house architecture
- AgentBricks and building AI agents to automate processes
- tying it all together with high-quality data and guarantees!
You'll have access to an entire paid Databricks workspace!
You can join at www.dataexpert.io/program/databricks-ai-data-engineer-booโฆ right now -
Databricks
@databricks
Long-running AI agents often bring a growing stack of queues, schedulers, caches, and monitoring tools.
@CLAconnect took a Databricks-native approach, using Lakebase Postgres as the orchestration backbone for durable task queues, retries, rate-limit-aware scheduling, real-time observability, and per-task cost attribution. Databricks Apps, Lakeflow Jobs, MLflow, and Unity Catalog Volumes complete the end-to-end architecture.
The pattern supports a production document-processing workflow that reduces extraction time from hours to minutes, with no external infrastructure for queueing, orchestration, or observability.
Explore the architecture: www.databricks.com/blog/simplify-ai-agent-orchestration-lโฆ -
Databricks
@databricks
Data + AI World Tour is back!
Join 40,000+ attendees across 20 cities for a full day with Databricks executives and leaders, technical experts, customers, and partners.
Hear the latest product announcements and customer insights, explore sessions on AI apps, agents, analytics, governance, data warehousing, BI, and more, and take part in hands-on learning.
๐ Find a city near you: www.databricks.com/dataaisummit/worldtourThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Neon
@neondatabase
New in Neon this week:
- More models in AI Gateway, including Kimi K3
- A refreshed console layout
- New neon api-keys and neon profiles commands
- New NAT gateway IPs / VPCs in eu-central-1This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
The latest testing from our research team found that data agents can improve accuracy and lower cost at the same time.
We evaluated Genie Code against three leading general-purpose coding agents on 401 tasks distilled from real internal usage. Each agent used their own harness, the latest models from leading frontier labs, Databricks MCP, and had the same 20-minute task budget.
Genie Code was both the most accurate agent we tested and the cheapest, delivering a correct answer at less than half the cost of other agents. Genie Code achieved the highest accuracy at 76.6%, and the lowest mean cost at $0.55 per task.
The advantage came from context. Semantic search, persistent memory, and workspace understanding helped Genie Code avoid the inefficient exploration that drove more errors, timeouts, and higher costs for general coding agents. www.databricks.com/blog/why-frontier-data-agent-outperforโฆ -
Databricks
@databricks
โIf your AI coding costs are growing exponentially, it reverses the efficiency benefits of having AI tool adoption.โ
Databricks co-founder and VP of Engineering Patrick Wendell joined @tbpn to share what heโs learned about deploying AI coding tools at scale โ and why the efficiency frontier is bigger than the intelligence frontier.ย
โBy far, our favorite way to control cost is to adopt newer, more cost-efficient models. But we also use techniques like smart routing, spend controls and context optimization that let us get more out of every token.โ
Watch Patrick, Jordi and John talk about how to control spending without sacrificing productivity: www.youtube.com/live/sV1y4AP6NEo -
Databricks
@databricks
That's a wrap on Black Hat 2026 ๐ฉ
The conversations this week reinforced our belief that the future of agentic security has to be open: open frameworks for securing AI, open data to help defend against evolving threats, and an open, governed foundation for security operations. And as a founding member of the Open Secure AI Alliance, we're excited to keep advancing that vision through open research and continued innovation in Lakewatch โ our open security lakehouse.
Thanks to everyone who stopped by to explore what's next! -
Databricks
@databricks
A slow-burn attack can make every step look harmless while the full session quietly adds up to data theft.
Omnigentโs contextual policies track what the agent has done, then block the outbound action once session risk crosses the threshold. The agent cannot disable or weaken the guard because enforcement lives in the runtime, and any denial wins.
See how Omnigent stops the attack: www.databricks.com/blog/blocking-slow-burn-attacks-contexโฆ -
Databricks reposted
Patrick Wendell
@pwendell
Today @databricks we're publishing a detailed analysis of techniques we used to drastically reduce our internal AI spend while aggressively growing adoption. Savings come from layering in several techniques, which combine to drive unit costs down as much as 90% in some scenarios. Tl;dr, the wins come from:
1. Shifting defaults to more efficient models, including OSS models such as GLM. Maximum intelligence models simply aren't needed for many coding tasks, and "good enough" models are quickly becoming very cheap. We shift traffic between models using Unity AI Gateway. Approximate savings: 50% or more.
2. Using smart routing to automate model selection. Routing can further squeeze efficiency by dynamically selecting the model or harness that can most efficiently execute a particular task. Our task-level routing leverages @omnigent_ai. Approximate savings: 30%.
3. Providing user visibility and adaptive budgeting. Every user can see how much they spend, and users receive hints on how to contain spend. Heavy spenders encounter progressive friction as they ratchet spend above certain levels. Approximate savings: 10%.
4. Managing context bloat by pruning tool call results and tuning harness settings. Extraneous context costs $$ and delivers no value. Tuning cache settings also help lower average token costs. Approximate savings: 10%. -
Databricks
@databricks
AI coding tools deliver immense value but deploying them at scale has led to a major challenge: exponentially growing costs.
Databricks co-founder and VP of Engineering at Databricks, @pwendell, outlines what strategies the Databricks team uses to manage AI coding costs at scale.
Across Databricks and other early AI adopters, four techniques are emerging as a consistent playbook for bringing costs down:
- Adopting more efficient and OSS models
- Dynamic model routing
- Empowering individuals and teams to make better consumption decisions
- Optimizing context management
See the full playbook www.databricks.com/blog/managing-ai-coding-costs-scale -
Databricks
@databricks
What separates an AI assistant that gives answers from one that can support real business decisions?
Shared, governed context.
Genie One works across Databricks data, documents, SaaS applications, and operational systems, while Genie Ontology provides a living map of the business terms, metrics, entities, and relationships behind the work.
That gives teams answers grounded in governed, real-time data and a path to act on them in tools like Slack, Microsoft Teams, mobile, and dashboards.
Explore how unified context makes AI decision-ready: www.databricks.com/blog/unified-context-missing-layer-entโฆ -
Databricks
@databricks
Panther CEO and founder Jack Naglieri says it best โ using AI to build in the open is a good pattern for cyber teams.
At Black Hat 2026, he joined Detection Engineering Weekly's Zack Allen and Nebulock's Damien Lewke on the Decibel Game Day panel to explore the trends reshaping cybersecurity right now.
"Companies have bespoke requirements for certain tools, but for large foundational things, they should really think hard about it โ and if there's a benefit of building in the open, I highly recommend that they build in the open."
With Panther now part of Databricks, proven operational SOC workflows and 100+ out-of-the-box integrations will be part of Lakewatchโs open data foundation, so teams can investigate every alert at machine speed.
www.databricks.com/blog/databricks-completes-acquisition-โฆ -
Databricks
@databricks
At Black Hat 2026, author and analyst Allie Mellen joined attendees at our booth to discuss the shifts AI has brought to cybersecurity, and what practitioners can learn from it. It's a theme that runs parallel to her newest book, Code War โ which explores how cyberattacks can be employed as deliberate, strategic instruments, and how businesses can respond.
That gap between how fast attacks move and how fast defenses respond is exactly what Databricks' Lakewatch closes โ unifying security, IT, and business data on an open, governed foundation so AI agents can detect, triage, and hunt at machine speed.
Thank you to everyone who stopped by โ and to Allie for hosting her book signing with us! -
Databricks
@databricks
Moonshot AI's latest open-weight model, Kimi K3, is now available on Databricks through Unity AI Gateway. @Kimi_Moonshot
Run Kimi K3 where your data already lives - governed, secure, and ready for custom AI apps and agents built with the data in your Lakehouse.
Unity AI Gateway lets you deploy Kimi K3 with enterprise-grade access controls. Govern every call, monitor performance, and scale securely across your AI apps. Test Kimi K3 alongside other frontier models without changing your application code.
The open-weight frontier just arrived on Databricks. Try it today. www.databricks.com/blog/kimi-k3-moonshot-ai-now-availableโฆ -
Databricks
@databricks
Operational workloads such as fraud detection, IoT monitoring, and security signal processing require decisions in milliseconds, not seconds. โก๏ธ
Spark Real-Time Mode brings sub-second latency to the same Structured Streaming APIs teams already use, enabling low-latency detection pipelines without adopting a separate specialized streaming engine.
Explore the anomaly detection pattern:
www.databricks.com/blog/ultra-fast-anomaly-detection-usinโฆ -
Databricks
@databricks
Move from tokenmaxxing to valuemaxxing.
Join Databricks Co-founder and CTO @matei_zaharia and Product Director @kuhlenhuth to learn how Unity AI Gateway gives IT leaders visibility, guardrails, and spend control across every model, agent, harness, and workflow. Youโll also see how Omnigent helps builders safely combine and share the coding agents and SDKs they already use.
Live on August 13. Register now: www.databricks.com/resources/webinar/govern-ai-spend-scalโฆ -
Databricks
@databricks
What if the biggest barrier to useful enterprise AI is not intelligence, but context?
Generic AI can handle broad productivity tasks, yet trusted data work depends on knowing which definitions, sources, and business rules matter. This guide explores that context gap and how Genie brings governed business data into the work teams already do.
It also shows how analysts can shape that experience through three customer stories across retail, enterprise data, and supply chain.
Download the guide โ www.databricks.com/resources/guide/data-smart-ai-coworker -
Databricks
@databricks
[DEMO] Agentic coding is moving faster than ever. Your database needs to keep up.
Lakebase Branching creates isolated, ephemeral database environments that let AI coding agents experiment and iterate without putting production data at risk.
See how branching works, why it's fast and cost-efficient, and how to set up an agentic workflow with the Databricks CLI and AGENTS.md.
www.youtube.com/watch?v=jLX5LBzEDGc -
Databricks
@databricks
Today, we're announcing General Availability of Unity AI Gateway, giving enterprises the cost, control, and choice they need to manage AI spend and enforce security across every AI agent and asset.
Thousands of customers are already running it. Over a quadrillion tokens have passed through the gateway in the past year.
Enterprise AI governance has changed. You're no longer managing a handful of models โ you're governing a sprawling estate of agents and apps that can access data, call tools, and take action on their own.
Unity AI Gateway serves as the central hub for any AI asset, including external agents, MCPs, skills, and coding assistants, and delivers end-to-end observability and granular cost attribution across models, providers, teams, and applications. www.databricks.com/blog/unity-ai-gateway-generally-available -
Databricks
@databricks
We're at @BlackHatEvents in Las Vegas this week, making the case for open as a new paradigm for agentic security: open frameworks for securing AI systems, open data for using AI to defend against them.
Come find us at Booths #5106 / #2167 and see the security lakehouse in action.
We are also excited to share that we have completed the acquisition of @runpanther. Panther's proven SOC workflows now run directly on Lakewatch, our open security lakehouse โ giving security teams petabyte-scale telemetry, real-time context, and autonomous AI agents on one open, governed foundation.
This is the complete blueprint for the modern agentic SOC โ ready for the speed and scale of modern threats. dbricks.co/4hLAjBM -
Databricks
@databricks
Databricks joins the Open Secure AI Alliance to advance AI safety and security, alongside @nvidia and other industry leaders.
The alliance is built on a simple but powerful premise: AI safety and security research should be shared openly, and the tools it produces should be built on open systems.
Databricks brings governed data, model and agent capabilities, and open tools and frameworks for security, governance, red teaming, and cyber defense.
Read more about what Databricks is bringing to the alliance and how we're securing the agentic era together www.databricks.com/blog/databricks-joins-open-secure-ai-aโฆ -
Databricks
@databricks
Omnigent is an open source AI meta-harness that gives teams one place to compose, control, and collaborate across agent workflows.
Bring together coding agents including Codex, Claude, Cursor, Pi, Antigravity, and your own custom agents. Add dynamic guardrails, run agents in isolated remote sandboxes, and share live sessions by URL so teammates can review, comment, and steer agents together in real time.
Omnigent is available now. Start orchestrating your agents: omnigent.ai -
Databricks reposted
Ali Ghodsi
@alighodsi
@databricks has the fastest and lowest latency on Kimi K3 (max)! Great job by Databricks AI team!
artificialanalysis.ai/models/kimi-k3/providers -
Databricks
@databricks
Genie One puts your business data, dashboards, and apps in your pocket.
Available on iOS and Android, it lets you:
โ๏ธ Ask questions in natural language
โ๏ธ Explore dashboards
โ๏ธ Access Databricks Apps
โ๏ธ Schedule tasks
Everything runs on the same governed data, business context, permissions, and network security as the web experience, so you can get trusted answers and act on them wherever work happens.
Download Genie One on mobile:
www.databricks.com/blog/take-insights-anywhere-genie-one-โฆ -
Databricks
@databricks
Glaspoort designed a CI/CD pattern for the Lakebase database behind its operational application.
Development and acceptance branch directly from production, while every pull request gets a fresh, disposable database branch. CI replays migrations, deploys the new app image to staging, and tests it against the migrated branch before anything reaches a real environment.
With migrations as the single source of truth, Glaspoort reports 10x more iterations, with use cases that once took a full team months now going live with a small team in days.
Explore the technical design: www.databricks.com/blog/branching-databases-code-cicd-patโฆ -
Databricks
@databricks
The agentic era demands context engineering, and Databricks is making it easier to build those skills.
The new Databricks Certified Context Engineer Associate exam is the industryโs first certification focused on context engineering. Weโve also added courses on agent fundamentals, retrieval agents, and agent evaluation, plus official guidance for using AI tools to prepare for certification exams.
Explore the new certification and training resources ๐ฐ: www.databricks.com/blog/skills-gap-behind-agentic-ai-and-โฆ -
Databricks
@databricks
Ready to build something new with Databricks?
Join the virtual Databricks AMER Learning Festival on August 19โ20 for hands-on sessions covering Lakebase, SQL analytics and BI, and data warehousing.
Youโll learn directly from Databricks experts, explore architecture and deployment best practices grounded in real customer use cases, and get live answers to your questions along the way.
Register: www.databricks.com/resources/webinar/databricks-amer-learโฆ -
Databricks
@databricks
AI is changing what data teams are expected to build. Increasingly, the focus is on AI applications, agents, and automations that turn data into action.
Thatโs why dataexpert.io founder @Zachly is launching a free six-hour Databricks boot camp starting August 3, covering:
โข Building data systems with Lakebase and Postgres
โข Working with unstructured data, vector search, and retrieval
โข Building AI agents with Agent Bricks
The course runs entirely in Databricks Free Edition and is designed for beginners and practitioners building practical AI data engineering skills.
Join here: learn.dataexpert.io/program/the-one-week-beginners-databrโฆ -
Databricks
@databricks
Omnigent helps teams move beyond one developer, one model, and one laptop by making agent work persistent, collaborative, and portable across harnesses.
In this #dataaisummit 2026 session, see how Omnigent supports shared context, reusable agents, multi-agent collaboration, intelligent routing, and governance through Unity AI Gateway.
Watch the full session: www.databricks.com/dataaisummit/session/secure-portable-cโฆ -
Databricks
@databricks
More than 500,000 people have used Databricks Free Edition to learn, experiment, and build with data and AI. Now they have even more to build with.
Free Edition includes:
โ Agent Bricks
โ Genie Code
โ Serverless GPUs
โ Lakebase
โ Lakeflow Designer
With every core Databricks practitioner feature in one place, builders have a complete, free toolkit for end-to-end data and AI projects.
Start building with Free Edition today: www.databricks.com/blog/whats-coming-next-free-editionThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
AI can discover and weaponize vulnerabilities in hours, while many security teams still operate on patch cycles measured in days or weeks.
This eBook shows how a security lakehouse approach can help teams:
โข Consolidate vulnerability data, SBOMs, asset inventories, and multicloud telemetry on an open, OCSF-native foundation
โข Use defensive AI agents for triage, exposure assessment, telemetry hunting, and an initial pass at detection rules
โข Compress the exploit window with real-time analytics and multiyear searchable retention at up to 60% lower TCO
Download the eBook: www.databricks.com/resources/ebook/security-lakehouse-outโฆ -
Databricks
@databricks
Genie Code goes beyond code generation to support data engineering across authoring and production.
In this #dataaisummit 2026 session, see how builders use Genie Code to create Spark Declarative Pipelines and Lakeflow Jobs, while Genie ZeroOps proactively monitors production workflows, diagnoses issues, and validates proposed fixes in a sandbox before changes reach production.
Watch the full session: www.databricks.com/dataaisummit/session/agentic-data-engiโฆ -
Databricks reposted
Omnigent
@omnigent_ai
Omnigent 0.7.0 is now available! ๐
The release adds four major features:
โฐ Automations (Scheduled Tasks) for recurring agent tasks
๐ First-class Projects with default session settings
๐๏ธ Voice dictation in the composer
๐งญ Smarter routing for harness and model selection
๐ Read the full release notes for bug fixes and breaking changes: github.com/omnigent-ai/omnigent/releases/tag/v0.7.0
#omnigent #opensource #aiagents #codingagents -
Databricks
@databricks
Arsalan Tavakoli, Databricks Co-Founder and SVP of Field Engineering, joined @Bloomberg The Close to discuss how the AI conversation is shifting from token maxxing to value maxxing as enterprises increase focus on ROI, governance, and choosing the right model for each use case.
"We are seeing a shift in our customers. They are asking: How do you control cost? How do you govern AI usage? We have a product called Unity AI Gateway that is specifically for this. Customers want to balance the right model to the right use case at any given time."
Watch the full interview: www.bloomberg.com/news/videos/2026-07-28/databricks-co-foโฆ -
Databricks
@databricks
Most agentic apps never make it past the prototype stage.
Join Databricks co-founder @pwendell, OpenClaw creator @steipete, @OpenAI's Codex Engineering Lead @thsottiaux, and @Stellantis' Head of Agentic AI, Hugo Sechier for a live discussion on what it takes to build, deploy, and manage production-grade fleets of AI agents.
What they'll cover:
โข What separates a demo from a production agent
โข How to govern agents across your organization
โข How to manage data securely at scale
โข How leading teams are operationalizing agentic AI
Register today: www.databricks.com/resources/webinar/agents-work-shippingโฆ -
Databricks
@databricks
Feature logic often gets rebuilt across experimentation, training, and serving, creating duplicated code, training-serving skew, and more infrastructure to operate.
Feature Views give teams one managed definition for experimentation, training, batch inference, and real-time serving. Databricks generates point-in-time-accurate training data, manages production pipelines, serves streaming features with 200ms end-to-end p99 latency, and governs features in Unity Catalog.
Learn more: www.databricks.com/blog/introducing-feature-views -
Databricks
@databricks
AI spend is climbing faster than the value it creates.
Join Databricks Co-founder and CTO @matei_zaharia and Product Director @kuhlenhuth to learn how Unity AI Gateway helps organizations move from token maxing to value maxing. See how it already governs more than 1 quadrillion tokens annually, with Omnigent providing open, multi-harness flexibility for developers.
Live on August 13. Register now: www.databricks.com/resources/webinar/govern-ai-spend-scalโฆ -
Databricks
@databricks
For forty years, transactional and analytical databases were treated as separate systems, connected by pipelines that moved data between them. As AI agents generate more database activity, that architecture is being reconsidered around speed, scale, and a single copy of governed data.
Databricks Co-Founder and Chief Architect @rxin joined @DataCampโs DataFramed podcast to discuss LTAP, Lakebase, real-time analytics, governance for AI agents, self-service analytics with Genie, and more.
Watch the full conversation: www.youtube.com/watch?v=US6Z_buKizkThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Ali Ghodsi
@alighodsi
This is one of those unintuitive things. Agents that cook longer are often worse. Genie just gets to the results faster. Ontology will be key to getting these agents the context they need to get the answers right quickly.
Julia Neagu
@juliaaneagu
We found that improving data agent quality also improves efficiency. Sometimes more is less: agents that take long, exploratory random walks are often less likely to arrive at the right answer.
We put Genie Code head-to-head against three leading general-purpose coding agents on 400+ real user data tasks.
Result below ๐ -
Databricks
@databricks
Our fifth customer hackathon gave teams a week to build with Databricks Genie across real technical use cases.
Across ten projects, they explored three ways to use Genie:
โข Ask governed data questions with Genie Agents
โข Build data, analytics, and ML workflows with Genie Code
โข Compose Genie Agents into larger agent systems
Teams built a supervisory layer that routed questions across data spanning 190 tables and more than 300 views, a governance intelligence platform with Genie Code, an overnight supply-chain brief using 17 live public feeds, and more.
Explore the projects: www.databricks.com/blog/ask-build-compose-what-our-5th-geโฆ -
Databricks
@databricks
What if teams could generate and validate business data models in days, then iterate on them in minutes?
In this #dataaisummit session, Cary Moore and Roberto Bruno Martins show how Vibe Data Modeling produced a 679-table enterprise model across 21 domains, then paired it with Metric Views to make Genie Spaces cheaper, faster, and more accurate.
Watch this session, explore more technical breakouts, and catch the keynotes on demand โ
www.databricks.com/dataaisummit/session/vibe-your-data-moโฆ -
Databricks reposted
Databricks AI Research
@DbrxMosaicAI
New research from Databricks shows that data agents can improve accuracy and lower cost at the same time.
We evaluated Genie Code against three leading general-purpose coding agents on 401 tasks distilled from real internal usage. Each agent used their own harness, the latest models from leading frontier labs, Databricks MCP, and had the same 20-minute task budget.
Genie Code was both the most accurate agent we tested and the cheapest, delivering a correct answer at less than half the cost of other agents. Genie Code achieved the highest accuracy at 76.6%, and the lowest mean cost at $0.55 per task.
The advantage came from context. Semantic search, persistent memory, and workspace understanding helped Genie Code avoid the inefficient exploration that drove more errors, timeouts, and higher costs for general coding agents.
www.databricks.com/blog/why-frontier-data-agent-outperforโฆ -
Databricks reposted
Neon
@neondatabase
What's new this week in Neon๐ฝ
- 'neon inspect db': 14 read-only Postgres diagnostics from the CLI
- also in the CLI: new 'neon snapshots' command and flags for 'neon projects create'
- Neon MCP server now queries Functions + Object Storage logs
- New guides on neon.ts + building on Functions and AI GatewayThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Connecting Amazon S3 data to Databricks now takes just a few clicks.
The new external location creation flow makes one of the most important setup steps much easier, helping teams establish a secure, governed connection to S3 in minutes instead of working across multiple consoles.
Less time configuring infrastructure. More time building with your data.
www.databricks.com/blog/connect-amazon-s3-data-databricksโฆ -
Databricks
@databricks
.@AnthropicAI's Claude Opus 5 is now available where your data already lives - governed, secure, and ready for custom AI applications and agents built with the data in your Lakehouse.
On Databricks' internal coding bench, Opus 5 achieved SOTA performance. It delivers major gains in agentic coding, professional knowledge work, and long-horizon reasoning, with stronger performance per token across effort levels. Teams can build agents that handle complex workflows with fewer iterations and meaningfully lower cost, all governed by Unity AI Gateway
Put Claude Opus 5 to work on your most important data, securely and at production scale. docs.databricks.com/aws/en/release-notes/product/2026/july -
Databricks
@databricks
What used to take a year to build when @arikaplan1 was a Major League Baseball executive can now come together in a couple of hours.
In this demo, Ari walks through a cricket application that brings together Databricks Apps, Genie, Lakebase, Lakehouse tables, Unity Catalog, Lakeflow, and MLflow to support interactive dashboards, predictive analytics, a cricket-specific intelligence assistant, and data pipeline monitoring.
The demo focuses on cricket, but the same approach can apply across finance, healthcare, retail, and CPG.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Weโre expanding our decade-long strategic partnership with @Microsoft through the 2030s to help enterprises build AI grounded in their own business context.
Our partnership is stronger than ever ๐ค. Databricks is deepening its use of Azure Databricks and Azure Cobalt, while Microsoft continues to integrate the Databricks Data + AI Platform across its products. This means bringing capabilities like Genie directly into customer workflows through products like Microsoft 365, Teams and Copilot.
Together, weโre helping customers scale enterprise AI with greater context, control, choice, cost efficiency, and reliability. www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
Go from a pre-built template to a deployed Databricks App using @Replit's agent.
This demo shows how to open a Genie Analytics template from DevHub directly in Replit, build the app with Databricks data, test the Genie chat, and deploy it to Databricks. Once deployed, the app includes the built-in security and governance available with every Databricks App.
Request access to the private preview โ replit.com/partners/databricks
Watch the demo and explore the template gallery on DevHub โ developers.databricks.com -
Databricks
@databricks
Lakebase starts with a simple architectural shift: separate Postgres compute from the write-ahead log and data files that traditionally live on the same machine.
Externalizing those components makes compute stateless and enables durable writes, elastic scaling, simpler high availability, and instant branching.
That same design creates the foundation for LTAP. Operational data can be stored once in open columnar formats and read by both Postgres and Lakehouse engines, so analytics stays current without CDC pipelines, a second copy, or added load on transactional workloads.
Databricks co-founder @rxin explains how the architecture works and what it makes possible.
www.databricks.com/blog/lakebase-ltap-rethinking-databaseโฆ -
Databricks
@databricks
Customer-facing dashboards and embedded analytics often rely on a separate real-time serving layer for low-latency, high-concurrency workloads, adding complexity, governance risk, and infrastructure overhead.
In this #dataaisummit session, Databricksโ Himanshu Raja and Matthew Holzapfel explore how Lakehouse//RT can serve high-concurrency, end-user analytics directly from the lakehouse through customer case studies and benchmarks.
Watch this session, other featured sessions, and the full keynotes on demand ๐
www.databricks.com/dataaisummit/session/speed-scale-lakehโฆThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Neon
@neondatabase
We recently made Lakebase Search available on Neon: hybrid vector and full-text search built for agents.
One half of that is lakebase_text. Here's why we built it, and why Postgres' default BM25 solution isn't enough ๐งต -
Databricks
@databricks
Googleโs Gemini 3.6 Flash is now available on Databricks!
In Databricks internal evaluations, it classified documents more accurately than Gemini 3.5 Flash and performed especially well on long-form patents and text-heavy documents. For document parsing, medium effort delivered similar quality to high effort while using about 32% fewer total tokens. It also landed on the cost-quality frontier in our OfficeQA Pro agent harness benchmark.
Congrats to the @Google Gemini team on this release. We canโt wait to see what you build with it! docs.databricks.com/aws/en/release-notes/product/2026/july -
Databricks reposted
Omnigent
@omnigent_ai
Omnigent 0.6.0 is released! ๐
๐ Richer file viewing: inline PDF preview + review comments, find-in-file, markdown & notebook previews
๐จ Custom themes: guided editor + new Nord palette
๐ฅ Import your Claude Code & Codex chats
๐งญ Transcript navigation bar
๐ฌ Slack integration: run & approve sessions inline
๐ช Desktop app now available on Windows & Linux
Read more about it โก๏ธ omnigent.ai/releases/0.6.0
#omnigent #opensource -
Databricks
@databricks
Building beautiful, on-brand dashboards just got easier ๐
Dashboard and workspace themes in AI/BI let you customize fonts, colors, and visualization palettes for a cohesive experience.
Apply a theme to one dashboard, or set it once at the workspace level and have it carry across every dashboard.
See how it works:
www.databricks.com/blog/design-beautiful-dashboards-aibi -
Databricks
@databricks
โ๏ธ Your Unity Catalog managed tables can now stay current with best-practice features automatically.
Auto Upgrades observes how each table is used, verifies workload compatibility, and applies eligible GA features when the table is ready. That means better performance, reliability, interoperability, and cost savings without manual compatibility checks or ALTER TABLE work.
Every upgrade remains visible, reversible, and configurable per table.
www.databricks.com/blog/automatic-upgrades-best-practice-โฆ -
Databricks reposted
Omnigent
@omnigent_ai
New model, same rebuild problem.
In this clip, @dennylee breaks down why that keeps happening: harnesses change, models change, but agent memory, context, and configuration should not have to start over.
Omnigent keeps that portable across harnesses and models, so you can use what each model and harness does best without rebuilding from scratch.
โถ๏ธ Full conversation: youtu.be/MQqV-v5HqaU?t=1467
#aiagents #omnigent #opensourceThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Congratulations to the winners of the 2026 Built-On Databricks Startup Challenge!
๐ฅ VisionHeight earned the Grand Prize for its Agentic Threat Intelligence platform
๐ฅ @linkup took second place for its production-grade Web Search API for AI
๐ฅ @AI_Intelo placed third for its agentic workforce for retail merchandising and planning
Explore their solutions and watch the finalist presentations from #dataaisummit: www.databricks.com/blog/celebrating-winners-2026-built-daโฆ -
Databricks
@databricks
You ship code in seconds and build apps, agents, and AI products faster than ever. So why does your database still take hours to provision?
Lakebase is a new category of serverless Postgres database built for the way teams write software today, with instant branching, separate compute and storage, and architecture designed to scale with app and agent workloads.
Read ๐๐ข๐ฌ๐ฆ๐ฃ๐ข๐ด๐ฆ ๐๐ฐ๐ณ ๐๐ถ๐ฎ๐ฎ๐ช๐ฆ๐ด to learn:
โข Why traditional databases break down under modern app and agent workloads
โข How separating compute from storage changes cost, speed, and reliability
โข What instant branching and cloning unlock for development teams
โข How the lakebase architecture fits alongside your lakehouse for unified transactional and analytical work
www.databricks.com/resources/ebook/lakebase-for-dummies -
Databricks
@databricks
Missed the #dataaisummit 2026 keynote?
This five-minute recap covers every major product announcement, including:
- Genie One, Ontology, App Builder, and ZeroOps
- Lakehouse//RT powered by Reyden
- LTAP
- Unity AI Gateway
- Omnigent
- CustomerLake
- And more
See what you missed, then explore the full keynotes, demos, and select sessions on demand โ www.databricks.com/dataaisummitThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Ali Ghodsi
@alighodsi
Highly recommended interview with @matei_zaharia about open source @omnigent_ai . Meta-harnesses are the future!
Jamin Ball
@jaminball
Next up on @AltimeterCap First Pass: A conversation with @matei_zaharia from @databricks on Omnigent
Agents are in their infancy, and so are the ways we develop and build them. Omnigent is a meta-harness aimed at solving many of the gaps in agent development todayThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
More than 5,000 students applied. Now it's time to meet the inaugural Databricks Student Fellows.
Selected for their campus leadership and hands-on technical expertise, these fellows will bring data and AI learning to their universities through workshops, hackathons, mentorship, and community building.
Meet five standout fellows whose work spans AI research, data engineering, and developer communities โ
www.databricks.com/blog/welcoming-first-cohort-databricksโฆ -
Databricks
@databricks
At #dataaisummit 2026, we introduced Genie Code for machine learning โ new, extended support for the entire ML lifecycle.
Genie Code is now natively integrated with the complete Databricks ML stack, including feature engineering, model training, serving, and monitoring.
Learn more: www.databricks.com/blog/whats-new-ai-platform-agents-ml-eโฆ -
Databricks reposted
Neon
@neondatabase
What shipped this week:
- Support for passkey login
- A neon-diff command that shows your agents changes between branches
- Expanded private networking capacity in three AWS regions
- Object Storage, Functions, AI Gateway are beta
All in our Friday changelog:This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Databricks CEO @alighodsi joined @CNBC's 'The Exchange' to break down the company's new $188B valuation, and what's fueling accelerating revenue across regions and products.
That includes more companies adopting tools like Unity AI Gateway to manage spend and access across models, and Genie to get trusted answers and actions from their business data.
"Everybody wants to do cost controls. And they want to control their budgets."
Watch here: www.youtube.com/watch?v=1fm21MPNxHI -
Databricks reposted
Ali Ghodsi
@alighodsi
We're raising funding at $188 billion valuation to double down on our AI strategy focused on three priorities:
1๏ธโฃ Unity AI Gateway - our multi-AI governance solution that helps control costs.
2๏ธโฃ Genie - our AI coworkers that actually understand your business data.
3๏ธโฃ Lakebase - our serverless Postgres database specifically for AI agents.
www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
Weโre excited to announce that Databricks is raising strategic funding, valuing the company at $188 billion.
Weโll use this new capital to accelerate our AI offerings for customers, including:
- Unity AI Gateway, our multi-AI governance solution that helps enterprises govern and control the costs of their AI
- Genie, our AI coworker that turns business data into trusted answers and actions
- Lakebase, our serverless Postgres database built for AI agents
www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks reposted
Linda Vivah (Haviv)
@lindavivah
โก Lakebase vs Lakehouse in < 90 seconds. Why do you need both?
Michael Armbrust (@michaelarmbrust ), Distinguished Engineer at @databricks, is back for another tech walk to break it downThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Matei Zaharia
@matei_zaharia
Lots of new goodies in Apache Spark 4.2: Metric Views, GEOGRAPHY and GEOMETRY types, AutoCDC in Spark Declarative Pipelines, and more, from 1900 total commits. Available today on Databricks: www.databricks.com/blog/introducing-apache-spark-42
-
Databricks
@databricks
What does it take to move AI agents from prototype to production?
Databricks' Amber Roberts and Craig Wiley walk through the full agent lifecycle, showing how to build, evaluate, deploy, and scale production-ready AI agents with Agent Bricks, AI Functions, and Genie Code.
Watch this session, the keynotes, and more #dataaisummit 2026 content on demand โ
www.databricks.com/dataaisummit/session/how-build-and-manโฆ -
Databricks reposted
Box
@Box
The Box MCP server is now available in the @databricks Marketplace.
Data analysts and data scientists can now pull unstructured content from Box directly into their Databricks workflows through Genie. Structured vendor metrics and contract terms in one place. No platform switching. No data duplication.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Genie One is now available on iOS and Android, bringing the data-smart AI coworker wherever business decisions happen.
Business users can chat with Genie, explore dashboards, access Databricks Apps, and get grounded answers on the go, all with the same permissions, identity controls, and network security they rely on across Databricks.
Put trusted insights in your teamโs pocket.
Get started today: www.databricks.com/blog/take-insights-anywhere-genie-one-โฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Neon is evolving with three new backend functions now in beta, all branchable like the database! Object Storage, Functions and AI Gateway all ready for agents to safely work with to build the next generation of apps.
This is what the next wave of cloud infra for agentic development will look like.
Neon
@neondatabase
Today we're opening up the beta of our first 3 new products: Object Storage, Functions, and AI Gateway
Together with our database and Managed Better Auth (our auth service), they form the first version of our backend platform -
Databricks
@databricks
Teams no longer have to choose between multi-engine flexibility, performance, and centralized governance.
External access to Unity Catalog managed Delta tables is now in Public Preview. Engines like Apache Spark, Apache Flink, and DuckDB, can create, read, and write to the same governed copy of data. Behind the scenes, Predictive Optimization improves query performance and lowers storage costs.
Migrating to UC managed tables is easy - simply upgrade your external tables with ALTER TABLE SET MANAGED.
www.databricks.com/blog/how-unity-catalog-managed-tables-โฆ -
Databricks
@databricks
.@thinkymachines' first open-weights model, Inkling, is now available on Databricks through Unity AI Gateway.
As a day zero launch partner, Databricks gives enterprise teams access to a model that excels at coding and agentic reasoning and supports multimodal inputs.
Teams can customize Inkling for their business, govern it with centralized security, permissions, cost controls, and observability, and connect it to coding agents including Cursor and OpenCode.
Start building with Inkling on Databricks โ www.databricks.com/blog/inkling-thinking-machines-lab-nowโฆ -
Databricks reposted
Omnigent
@omnigent_ai
Slow-burn attacks hide data theft inside steps that each look normal on their own.
This blog walks through the attack on a vendor-review agent in Omnigent. Without a contextual policy, the outbound email goes through. With session risk tracking, it gets blocked, and the agent cannot turn the policy off.
๐ www.databricks.com/blog/blocking-slow-burn-attacks-contexโฆ
#omnigent #aisecurity #opensource -
Databricks
@databricks
"The agent is completely useless if you can't share sessions with someone and have history and have search and all this layer on top of it for collaboration."
Databricks co-founders @matei_zaharia and @rxin joined @latentspacepod to discuss where AI infrastructure is headed.
They unpack why Databricks built Omnigent as an open-source meta-harness, why LTAP unifies storage instead of query engines, and why AI agents need live operational context from databases as they take on more real-world work.
Listen to the full conversation.
www.youtube.com/watch?v=Yp_u1NpbkJgThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Jamin Ball
@jaminball
Next up on @AltimeterCap First Pass: A conversation with @matei_zaharia from @databricks on Omnigent
Agents are in their infancy, and so are the ways we develop and build them. Omnigent is a meta-harness aimed at solving many of the gaps in agent development todayThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
AI assistants are great at handling general tasks, but they miss the critical data context that defines your business.
Learn how Genie helps bridge the AI context gap, what analysts own when building with Genie, and explore practical examples from three organizations putting data-smart AI to work.
www.databricks.com/resources/guide/data-smart-ai-coworker -
Databricks
@databricks
Discover, install, and run third-party data and AI applications directly in your Databricks workspace.
With Apps on Databricks Marketplace, you can:
- Install third-party apps in just a few clicks
- Run them natively while keeping your data in your environment
- Inherit the security, auditing, and fine-grained access controls of Unity Catalog
Explore Apps on Databricks Marketplace, now in Public Preview:
www.databricks.com/blog/announcing-apps-databricks-marketโฆ -
Databricks
@databricks
One agent is just the start. Running fleets of AI agents is the next challenge.
Join Databricks co-founder @pwendell, @OpenAI's @steipete (creator of OpenClaw) and Engineering Lead for Codex, @thsottiaux, plus @Stellantis' Hugo Sechier, for a live conversation on building and deploying agentic apps at scale.
Learn how to govern AI agents with fine-grained permissions and full auditability, and hear how Stellantis is operationalizing agentic AI across the enterprise.
Register today:
www.databricks.com/resources/webinar/agents-work-shippingโฆ -
Databricks
@databricks
Lakehouse//RT is built for workloads where milliseconds matter.
Powered by the Reyden engine, it delivers millisecond query performance directly on the lakehouse. Preview users have seen up to 16ร better performance than dedicated real-time serving layers, with response times as low as 10 ms on smaller datasets.
www.databricks.com/blog/introducing-lakehousert-real-timeโฆ -
Databricks
@databricks
The biggest announcements and technical sessions from #dataaisummit are now available on demand.
Catch keynotes and select sessions featuring the latest innovations, including:
โข Omnigent
โข Unity AI Gateway
โข Genie Ontology
.. & much more
Explore the technologies shaping the next generation of AI apps and agents:
www.databricks.com/dataaisummitThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
As AI teams adopt more autonomous agents, one challenge becomes clear: they don't naturally work together.
Omnigent is an open-source meta-harness that sits above individual agent harnesses, routing work across multiple agents through a single orchestration layer.
Instead of managing agents in isolation, teams can compose different models and agent harnesses into unified workflows, with shared governance and collaboration built in.
Explore the project on GitHub: github.com/omnigent-ai/omnigentThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Omnigent
@omnigent_ai
Omnigent 0.5.0 is Released!
Highlights in this release:
๐ฑ Omnigent for iOS apps.apple.com/us/app/omnigent/id6783102694
๐งฉ Generic ACP harness
๐ Command palette & richer search
๐จ More appearance & customization setting
๐ฌ Message steering & queuing
โธ๏ธ Kubernetes deployment
๐ Embedded browser
Enjoy!
Read more about this release: omnigent.ai/releases/0.5.0 -
Databricks
@databricks
OpenAI GPT-5.6 Sol, GPT-5.6 Terra, and GPT-5.6 Luna are now available as Databricks-hosted models through Model Serving.
Built for complex problem-solving, coding, and budget-friendly workloads, the GPT-5.6 series uses fewer tokens to complete tasks, making the models highly efficient and cost-effective.
Access all three through Foundation Model APIs on a pay-per-token basis. docs.databricks.com/aws/en/release-notes/product/2026/july -
Databricks
@databricks
"Every stateful system has got to have the ability to create a staging environment, branch what you have, and give agents permission to make mistakes."
Databricks' VP @nikitabase joins ๐๐ต'๐ด ๐๐ฃ๐ฐ๐ถ๐ต ๐๐ข๐ต๐ข to discuss why branching and version control are becoming foundational for AI-native software development, how teams can manage schema drift as AI accelerates development, and the architectural ideas behind Lakebase.
Watch the full conversation:
www.youtube.com/watch?v=ZB2sVr7ds4U -
Databricks
@databricks
Genie One is the data-smart AI coworker that helps business users move from insight to action.
With Genie Agents, teams can turn prompts into shareable, autonomous agents that reason over structured and unstructured data. Genie Ontology provides the context layer that helps those agents identify trustworthy sources and understand enterprise knowledge.
Together, they deliver AI that's grounded in business context, with higher accuracy and performance.
www.databricks.com/blog/introducing-genie-one-genie-ontolโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
Gartnerโs Magic Quadrant for Analytics and Business Intelligence (BI) is out, and Databricks was named a Visionary in our first appearance, the highest debut for any vendor in this MQโs 20+ year history.
BI has already changed. Anyone can drill from a signal down to the truth behind it and agentic loops make sure every answer has the full story. Thatโs where we're ahead with Genie and AI/BI. I use it every day to see the key signals, understand what changed and why, and decide what to do about it.
Huge congratulations to the teams, and thank you to our customers. -
Databricks
@databricks
The best of #dataaisummit is now available on demand.
Watch keynotes and select sessions featuring the latest product announcements, technical deep dives, and expert conversations.
Start watching:
www.databricks.com/dataaisummit -
Databricks
@databricks
โThe attackers are now hyper-automated with agents and large language models that can find vulnerabilities that haven't yet been found by the people who wrote the software.โ
Databricksโ @krioukov and NABโs Patrick Wright joined @theCUBE to discuss what security looks like in the age of AI.
Their conversation covers how broader data context, automation, and agentic workflows can help security teams move beyond manual investigations toward machine-speed defense.
www.youtube.com/watch?v=MBx51ULw98c -
Databricks reposted
Ali Ghodsi
@alighodsi
At 11k employees, our AI costs are going up. Which model & harness should we use to lower cost but also retain great quality?
We didn't want to blindly trust public benchmarks. So we ran a comprehensive evaluation on our tasks, code base, infra. It's been produced by more than 3,000 software engineers, spans 3 hyperscalar clouds and many languages and tasks.
The results are surprising. We find that for the SAME mdoel, the choice of harness can significantly save costs (~2x). We also find that GLM 5.2 performs extremely well. We run Omnigent in front of these and can easily multiplex different harnesses and models for different tasks.
Check it out:
www.databricks.com/blog/benchmarking-coding-agents-databrโฆ -
Databricks
@databricks
We benchmarked coding agents on real engineering tasks across Databricks' multi-million line codebase to better understand the relationship between cost and performance.
The benchmark surfaced several key findings. Top-tier performance now comes from a mix of proprietary and open models, token pricing is a poor proxy for real-world cost, and harness choice can dramatically impact both cost and quality.
Read how we built the benchmark and what we learned โ www.databricks.com/blog/benchmarking-coding-agents-databrโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
We benchmarked coding agents on our own internal tasks at Databricks and learned a lot!
There are many surprising opportunities to lower cost and increase quality, and many models including open source ones are truly competitive now. ๐งต -
Databricks
@databricks
Agent Bricks has expanded into a comprehensive agent platform for developers.
The latest capabilities are designed to help solve three critical challenges in production AI agents:
1๏ธโฃ Choice
2๏ธโฃ Context
3๏ธโฃ Control
New capabilities include broader model support, managed agent memory, MCP connectivity, secure sandboxes, and Unity AI Gateway for governance, monitoring, and cost controls, helping developers focus on building production AI agents.
www.databricks.com/blog/agent-bricks-dais-2026 -
Databricks reposted
Neon
@neondatabase
Happy 30th birthday Postgres! ๐
What an accomplishment, almost nothing in tech has stayed relevant for 30 years.
From humble beginnings as a Berkeley research project to becoming the default for everything from side projects to massive production systems.
30 years later, the database and the community have more momentum than ever. It's why we built Neon on Postgres, serverless, but 100% the Postgres you love. ๐ -
Databricks
@databricks
Meet Genie, your data-smart AI coworker.
Generic AI assistants don't know your business. Genie does.
Grounded in your business context, Genie helps every team find trusted insights and turn answers into action. www.databricks.com/genie -
Databricks
@databricks
The next evolution of Lakeflow brings ingestion, transformation, and orchestration together in a unified platform, fully integrated and centrally governed by Unity Catalog.
New capabilities include Lakeflow Designer, Genie ZeroOps, 100+ Lakeflow Connect connectors, expanded Zerobus Ingest interfaces, Real-Time Mode for Spark Declarative Pipelines, and enhanced Lakeflow Jobs orchestration.
A unified, real-time data foundation for agentic AI.
www.databricks.com/blog/lakeflow-new-era-agentic-data-engโฆ -
Databricks
@databricks
Omnigent now supports contextual policies, enabling session-aware governance for AI agents.
Instead of evaluating actions one at a time, contextual policies track what has happened throughout a session to determine whether the next action should proceed. That enables richer controls such as per-session budgets, dynamic risk scoring, and least-privilege access.
As a meta-harness, Omnigent applies these policies across supported agent harnesses, including Claude Code, Codex, and custom agent frameworks.
Learn more: www.databricks.com/blog/contextual-policies-omnigent-usinโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Most coding agents have very limited features for controlling security: just a list of actions to allow, deny, or ask users on. In @omnigent_ai, we introduced Contextual Policies, which can track *state* about a session to manage both security and cost in a far more flexible way.
-
Databricks
@databricks
๐ง Genie Code is expanding to support more complex, agentic data and ML work on Databricks.
New capabilities include:
โ A full-page command center to manage complex, multi-threaded work with thread status, review points, and quick access to instructions, skills, and connectors.
โ Native intelligence across MLflow, Model Serving, and compute, turning the same agent you already use into a specialist for production ML engineering.
Coming soon, scheduled tasks will let Genie Code run work autonomously and hand back the results for review.
See it in action: www.databricks.com/blog/whats-new-genie-code-data-ai-summโฆ -
Databricks
@databricks
Data + AI Summit 2026 marked another milestone in the @OpenAI and Databricks partnership.
Keynotes, executive conversations, customer stories, a hackathon, and the Grounded Reasoning Cup showcased how OpenAI's frontier intelligence and Databricks' enterprise context and governance are helping organizations build production-ready AI.
Explore the biggest moments from the summit, real-world customer deployments, and what's next for the partnership. www.databricks.com/blog/openai-and-databricks-dais-2026-mโฆ -
Databricks
@databricks
After decades of building databases, Databricks VP of Engineering @nikitabase believes it's time to rethink one of their fundamental assumptions.
In this episode of the ๐๐ต'๐ด ๐๐ฃ๐ฐ๐ถ๐ต ๐๐ข๐ต๐ข podcast, Nikita discusses why separating compute and storage is the next major architectural shift for operational databases, how storing data on object storage opens it to downstream systems, and why the rise of AI agents is changing how developers build softwareโand what they need from a database.
Watch the full conversation: www.youtube.com/watch?v=zpqM-YWrXB4 -
Databricks
@databricks
#dataaisummit 2026 may be over, but the keynotes and select breakout sessions are now available on demand!
Catch up on this year's top product announcements, technical sessions, and customer stories: www.databricks.com/dataaisummit -
Databricks
@databricks
Say hello to Omnigent ๐
Databricks' open-source meta-harness helps developers orchestrate AI coding workflows across multiple coding agents, making it easy to use the right model for each task.
In this video, @cole_medin explains why meta-harnesses are becoming an important part of modern AI coding and demonstrates how Omnigent orchestrates coding assistants with shared sessions, guardrails, and human-in-the-loop workflows.
www.youtube.com/watch?v=oGE_Dwz-rMk -
Databricks reposted
Linda Vivah (Haviv)
@lindavivah
โณ 90 second crash course on @databricks โ biggest launches across the Data + AI stack
This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
[DEMO] Agentic coding is moving faster than ever. Your database needs to keep up.
Lakebase Branching creates isolated, ephemeral database environments that let AI coding agents experiment and iterate without putting production data at risk.
See how branching works, why it's fast and cost-efficient, and how to set up an agentic workflow with the Databricks CLI and AGENTS.md. www.youtube.com/watch?v=jLX5LBzEDGc -
Databricks
@databricks
Introducing Genie App Builder for AI-assisted creation with all Databricks context.
Genie App Builder is a purpose-built AI app authoring tool with native awareness of your data assets, Unity Catalog semantics and workspace context.
It's part of a Databricks suite of products and capabilities that brings governed app vibe coding to enterprises.
Learn more: www.databricks.com/blog/enabling-governed-vibe-coding-entโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
My co-founder @rxin personally wrote this really good paper that explains the main idea behind postgres Lakebase as well as LTAP. It almost serves as a primer on how transactional databases are built and how Lakebase and LTAP work. Maybe more importantly, what are the tradeoffs, and what are you giving up by adopting this new approach. Highly recommended reading:
www.databricks.com/blog/lakebase-ltap-rethinking-databaseโฆ -
Databricks
@databricks
#dataaisummit 2026 was packed with product announcements, hands-on training, and technical insights.
Missed a session?
Catch up on Genie One, LTAP, CustomerLake, and more by watching the keynotes and select breakout sessions on-demand: www.databricks.com/dataaisummit -
Databricks
@databricks
Full-text search indexes are now available in Beta on Databricks Runtime 18.2.
Create a search index with a single SQL statement to accelerate substring and keyword queries, with no query hints or application changes required.
Teams are already seeing 100x+ faster substring search queries against petabyte-scale tables.
Learn how it works:
www.databricks.com/blog/accelerate-search-queries-full-teโฆ -
Databricks reposted
Yuchen Jin
@Yuchenj_UW
Databricks ranks #1 on NVIDIAโs SOL-ExecBench kernel leaderboard, in the L1 single operation track, powered by KDA (Kernel Design Agents) ๐
Whatโs crazy is: we 100% leveraged AI agents to beat the competition.
This is a sneak peek at recursive self-improvement. The core frameworks we used were KDA, Humanize, and Omnigent: Claude writes code, Codex reviews. Together, they enabled agents to run autonomously for as long as possible. The key is setting up the right framework to let the agents cook.
This work was driven by @leshenj15 at Databricks, in collaboration with NVIDIA and MIT HAN Labโs @LigengZhu and @DongyunZou03 .
Databricks AI is like a neolab. Join us if youโre cracked! -
Databricks
@databricks
See the latest updates in Unity AI Gateway: Databricksโ governance solution for AI assets, models, agents, LLM endpoints, MCP servers, Skills, and coding agents.
Now you can create a centralized inventory of all your AI assets with the agent registry in Unity AI Gateway.
Register external agents, agents built on Databricks, MCPs, and Skills to create a comprehensive system of record.
www.databricks.com/blog/ai-governance-data-ai-summit-2026โฆ -
Databricks reposted
Linda Vivah (Haviv)
@lindavivah
โก What are Declarative Pipelines in < 90 seconds?
Let's walk with @michaelarmbrust , Distinguished Engineer @databricks who led the design & development of Declarative Pipelines + created Spark SQL, Structured Streaming, Delta Lake, & much more as he breaks it down!
๐ก TLDR: instead of telling the system HOW to do every step, you just tell it WHAT you want to exist. Spark figures out the how.
The technology itself is open source in Apache Spark, and Databricks offers a managed version on top called Lakeflow Spark Declarative Pipelines
It was such a blast getting to chat with Michael! Did you know he was also the 9th employee at Databricks?!This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
.@AnthropicAI's Claude Sonnet 5 is now available on Databricks, governed by Unity AI Gateway, across AWS, Azure, and GCP!
It brings near-Opus intelligence with top performance on Agentic Search and Document AI multimodal extraction benchmarks plus advanced reasoning and thinking modes for complex tasks. The same balance of capability, cost, and speed teams already rely on Sonnet for.
Databricks customers can build agents on Sonnet 5 that are specific to their domain. Agents deploy as Databricks Apps with Lakebase-powered memory so agents maintain context across sessions.
Build your first long-running agent with Agent Bricks: docs.databricks.com/aws/en/release-notes/product/2026/june -
Databricks
@databricks
Most data teams run two systems: one database for transactions, another for analytics, with data copied between them. It works, but the pipelines are brittle, the copies drift, and governance gets complicated.
At this year's Data + AI Summit, we announced LTAP, a new architecture that does away with the second copy entirely. With LTAP, transactions and analytics run on a single copy of your data, stored in open formats that both sides read directly. Analytics always sees the freshest data your application just wrote, with no CDC, no mirroring, and no slowdown to your transactional workload.
Databricks co-founder @rxin walks through the architecture that makes this possible, starting at the storage layer of a traditional database and building from Lakebase up to LTAP.
www.databricks.com/blog/lakebase-ltap-rethinking-databaseโฆ -
Databricks reposted
Reynold Xin
@rxin
I find the Lakebase design for serverless Postgres very elegant, so I spent some time explaining how it works in this blog.
The blog starts by explaining how databases really persist data (with a write-ahead-log and data files that are updated async), and how Lakebase separates storage and compute by externalizing those two components. It ends with how the Lakebase architecture naturally leads to LTAP, enabling OLTP and analytical workloads against a single governed copy of data.
My goal was to make it readable by anyone curious about how these systems work, not just database and storage experts. That turned out to be a lot more challenging than I first thought. Database storage is one of the most complex areas in computer science (the ARIES paper cited in blog was the hardest paper I personally ever had to read). The first draft had too little detail and I couldn't land the ideas. The second had too much and I'd lost anyone who isn't already a storage expert. This is the third draft, and I'd love feedback on whether the depth feels right.
www.databricks.com/blog/lakebase-ltap-rethinking-databaseโฆ -
Databricks
@databricks
.@Ecolab built its Retail Intelligence application on Databricks and @AnthropicAI's Claude to unify nine siloed data sources into a single intelligence engine.
Built as a native Databricks App with Lakebase Postgres and Unity Catalog, the solution cuts compliance report compilation from two weeks to under two minutes while delivering cited, real-time answers from 700-page FDA food safety manuals for frontline retail staff.
Read how Ecolab is powering retail intelligence with AI agents: www.databricks.com/blog/how-ecolab-rebuilt-retail-intelliโฆ -
Databricks
@databricks
We are thrilled to share that Databricks has been named a @usnews Best Company to Work For! ๐
In addition to making the Overall list, Databricks was also recognized as one of the:
- Best Companies to Work For in Information Technology
- Best Companies to Work For in the West
๐งฑ Thank you to all Bricksters for fostering a culture where we can innovate, collaborate, and grow together every day.
careers.usnews.com/companies/databricks-960 -
Databricks
@databricks
The next frontier for AI isn't building a single agent. It's running fleets of AI agents across the enterprise.
Join Databricks, @OpenAI, and @Stellantis for a live discussion on what it takes to ship agentic apps at scale.
Hear the latest on building accurate, governed agents, what developers need to trust AI agents, and how one of the world's largest automakers is industrializing agentic AI across the enterprise.
Register now:
www.databricks.com/resources/webinar/agents-work-shippingโฆ -
Databricks reposted
Jason โจ๐พSaaStr.Aiโจ Lemkin
@jasonlk
.@databricks co-founder Arsalan Tavakoli at SaaStr AI 2026 did a deep dive on where B2B is really going.
His top point:
๐Any business with a monopoly today won't have one in 12 to 24 months.
Three things broke pricing power at the same time:
1. The cost of building software collapsed
A new entrant builds on top of data that's already ingested and governed, and ships fast.
2. The low end got good
AI plus third-party APIs turns the cheap one-workflow tool into something real. "You get what you pay for" is breaking.
3. Migration cost collapsed
Migrations used to die on the vine: save 50%, but the migration costs 5x the savings. Now LLMs read legacy code, convert it, and validate the output. Databricks does enterprise-grade migrations in 30 days. Once switching is cheap, lock-in stops defending your price.
A few other things he said that are true on the front lines, not on X:
- Everyone is token maxing
Spend is going straight up. Almost no one knows the ROI. The companies winning budget tie AI to an outcome. Standing up agents earns zero points.
- The real bottleneck on enterprise AI isn't the model. It's context
And context is not data. It's every definition someone learned by asking a colleague, buried in emails and transcripts, going stale by the day.
- BI is basically dead
One car maker just put 70,000 employees on Genie. Not the 5% who write SQL. The 95% who run the business and now get answers in 30 seconds.
If you're attacking an incumbent, the wedge is finally there. If you're the incumbent, lock-in is not a strategy anymore
youtu.be/Gv6Eq0Q1O_U -
Databricks
@databricks
At #dataaisummit, @matei_zaharia, Co-founder and CTO at Databricks, announced Omnigent: an open meta-harness that sits as a layer above your agents and makes them interoperable parts of a powerful system.
Omnigent provides a common interface to compose multiple agents, enforce advanced policies, and collaborate in real-time across your team.
www.databricks.com/blog/introducing-omnigent-meta-harnessโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Building beautiful dashboards just got easier.
New dashboard and workspace themes in AI/BI make it easy to customize fonts, colors, and visualization palettes for a consistent, on-brand experience.
Apply a theme to a single dashboard, or set a workspace theme once and have it automatically apply across every dashboard in your workspace.
See how it works: www.databricks.com/blog/design-beautiful-dashboards-aibi -
Databricks
@databricks
Databricks Free Edition just got even better for builders.
New in Free Edition:
โ Agent Bricks
โ Genie Code
โ Serverless GPUs
โ Lakebase
โ Lakeflow Designer
With these additions, Free Edition now includes every core Databricks practitioner feature, giving users a complete, free toolkit for building end-to-end data and AI projects.
Start building with Free Edition today: www.databricks.com/blog/whats-coming-next-free-editionThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
As data volumes and complexity grow, data engineers need scalable ways to build, manage, and optimize pipelines.
๐ The Big Book of Data Engineering covers proven patterns for scaling ETL, orchestrating data and AI workloads, implementing observability, and managing pipelines with Lakeflow.
You'll also see how organizations across Healthcare, Financial Services, Retail, and Entertainment are building intelligent batch and streaming data pipelines.
www.databricks.com/resources/ebook/big-book-of-data-enginโฆ -
Databricks reposted
Omnigent
@omnigent_ai
We are happy to announce #omnigent v0.3.0!
Major new features
๐ค Seven new agent harnesses: #hermes (SDK + native TUI), #github #copilot (SDK), #opencode, #goose, #qwencode, #kiro, and #kimicode; plus #antigravity promoted to a full SDK + native #agy CLI harness
๐ชข Native-harness parity across the fleet: compaction, cost/token tracking, resume, true fork with history, in-session model switching, and tool-approval / AskQuestion web cards, for #cursor, #codex, #qwen, #pi, #hermes, #goose, and #opencode
๐ฅ๏ธ Omnigent Desktop: now manages the server + runner automatically
๐๏ธ Projects workspace:vgroup sessions into Projects and drag between them, plus a Settings surface and per-harness run-mode memory
๐งญ Intelligent model router to pick the right model per turn
๐ฆ More deploy & sandbox targets: host on #databricks Apps + #lakebase #postgres, #aws #bedrock provider, on-demand #kubernetes runner #pod sandbox, and a #boxlite managed host
๐ช Native #windows support
๐ต๏ธ Custom #agent Creation UI
๐ In-app #mcp management from Agent Info, sys_session_share agent-facing session sharing, and web UX polish โ shortcuts overlay, pinned-session hotkeys, image lightbox
Read details about this release: github.com/omnigent-ai/omnigent/releases/tag/v0.3.0 -
Databricks
@databricks
AI upskilling works best when learning is continuous, hands-on, and accessible across the organization.
Thatโs why weโre launching Databricks Academy Pro with unlimited access to:
โข Self-paced learning
โข Live instructor-led training
โข Hands-on labs and certification opportunities
Built to help teams continuously develop data and AI skills as platforms, tools, and governance requirements evolve. www.databricks.com/blog/why-talent-transformation-missingโฆ -
Databricks
@databricks
Still catching up on everything from #dataaisummit 2026?
Last week, leading experts, researchers, and open source contributors from Databricks and across the community shared the latest innovations, product announcements, and technical insights shaping the future of data and AI.
Catch keynotes, breakout sessions, and technical talks from this year's event on-demand: www.databricks.com/dataaisummit -
Databricks reposted
Ali Ghodsi
@alighodsi
Update from my post from 2 months ago when Genie Code just passed the threshold of being half the code generated on @databricks. Attached the new update from today, AI is now 3x the code written by humans on the platform!
Ali Ghodsi
@alighodsi
Just got this internal email on Genie Code progress! For the first time, we have MORE code written by Genie Code than by humans on the platform.
-
Databricks
@databricks
Shipping a data or AI application shouldnโt require months of DevOps work.
This hands-on guide shows how to build, deploy, and operate production-ready applications on Databricks using transactional data layers, built-in governance, and repeatable deployment patterns.
You'll get end-to-end application examples, code snippets, and practical guidance for moving from notebooks and prototypes to production ๐
www.databricks.com/resources/ebook/hands-guide-apps-databโฆ -
Databricks
@databricks
We recently announced Genie ZeroOps, a new AI background agent that monitors your production workloads, investigates issues, and suggests fixes.
As organizations deploy more pipelines, models, dashboards, and apps, maintaining production workloads has become a growing challenge. Genie ZeroOps monitors production assets, automatically investigates issues using platform intelligence, and suggests fixes that are tested in a sandbox environment before they reach production.
Genie ZeroOps helps teams scale agentic ops while staying in control.
Coming soon in Private Preview. www.databricks.com/blog/introducing-genie-zeroops -
Databricks
@databricks
Databricks co-founders @matei_zaharia and @rxin joined @latentspacepod following #dataaisummit to discuss the ideas shaping the next generation of data and AI, including Omnigent, LTAP, Lakebase, agent security, open formats, and what it takes to build for the agent era.
Watch the full conversation for a behind-the-scenes look at the thinking behind some of this year's biggest announcements. www.youtube.com/watch?v=Yp_u1NpbkJg -
Databricks
@databricks
In this 2-hour hands-on course, @andreaskayy walks through how to build end-to-end data pipelines on Databricks using Spark Declarative Pipelines and Lakeflow Designer.
Along the way, you'll:
โ๏ธ Learn the fundamentals of Delta Lake and Unity Catalog
โ๏ธ Build a Bronze โ Silver โ Gold pipeline using the medallion architecture
โ๏ธ See how declarative pipelines handle dependencies and orchestration automatically
โ๏ธ Build pipelines visually with Lakeflow Designer
โ๏ธ Explore how Databricks Assistant and Genie can accelerate development
www.youtube.com/watch?v=nrfP2_frM5k -
Databricks reposted
Yuchen Jin
@Yuchenj_UW
You may have heard that GLM-5.2 at 328 token/s is cool,
How about 392?
Databricks is now #1 in inference speed for GLM-5.2 on Artificial Analysis. It's a great model, and we did a lot of optimizations. -
Databricks
@databricks
Databricks Co-founder and Chief Architect @rxin announces LTAP (Lake Transactional/Analytical Processing) at #dataaisummit 2026.
LTAP is a new data processing architecture that unifies OLAP and OLTP on a single copy of data in the lake, eliminating ETL, replicas, and pipelines by design.
www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks reposted
Latent.Space
@latentspacepod
Why the Frontier Ecosystem must be Open โ Matei Zaharia and Reynold Xin, Databricks www.latent.space/p/databricks
@databricks cofounders @matei_zaharia and @rxin explain why Databricks is moving into the infrastructure layer for enterprise agents, how Omnigent creates a shared harness for coding agents and custom agents, why LTAP and Lakebase rethink the split between operational and analytical databases, why agent security needs contextual policies and spend controls, and why the future of software may be as simple as getting the right data in place and putting agents on top.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
You ship code in seconds and build apps, agents, and AI products faster than ever. So why does your database still take hours to provision?
Lakebase is a new category of serverless Postgres database built for the way teams write software today, with instant branching, separate compute and storage, and architecture designed to scale with app and agent workloads.
Read ๐๐ข๐ฌ๐ฆ๐ฃ๐ข๐ด๐ฆ ๐๐ฐ๐ณ ๐๐ถ๐ฎ๐ฎ๐ช๐ฆ๐ด to learn:
โข Why traditional databases break down under modern app and agent workloads
โข How separating compute from storage changes cost, speed, and reliability
โข What instant branching and cloning unlock for development teams
โข How the lakebase architecture fits alongside your lakehouse for unified transactional and analytical work
www.databricks.com/resources/ebook/lakebase-for-dummies -
Databricks
@databricks
We're proud to be named a Leader in the 2026 Gartnerยฎ Magic Quadrantโข: AI Platforms for Data Science and Machine Learning!
Databricks is positioned highest in Ability to Execute and furthest in Completeness of Vision for the second year in a row. If you're evaluating AI platforms, this is the report to start with.
Get the report: www.databricks.com/resources/analyst-research/gartner-mq-โฆ -
Databricks reposted
Y Combinator
@ycombinator
When electric motors were invented, factories didn't become dramatically more productive overnight. The biggest gains came years later, after people redesigned factories around the new technology.
@databricks co-founder and Chief Architect Reynold Xin (@rxin) believes AI is creating a similar shift in software.
In this fireside with YC's @sdianahu, Reynold explains how AI agents are reshaping engineering organizations, why startups have an advantage in building AI-native products, and why the next generation of infrastructure needs to be lightweight, scalable, and built for agentic workloads from day one.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Databricks co-founder and CEO @alighodsi joined @EdLudlow on @BloombergTV to make the case that enterprise AI is already smart enough. What is holding agents back is context, not raw intelligence, and that is the gap Genie Ontology is built to close.
"We really want to infuse context into the existing AIs. When you can do that, magic happens," said Ghodsi.
Watch the full interview: www.youtube.com/watch?v=n8lhvIIaEUQ -
Databricks reposted
Natalie Fratto
@NatalieFratto
5 million people watched my latest @chartsncrafts video explaining Databricks ๐ฑ so I decided to one-up myself in a p2 trying to explain the entire AI stackโฆ
Models! Harnesses! A fancy new open source meta-harness!
Thrilled to partner with @databricks on this one to help unveil Omnigent which I believe is going to entirely change the AI landscape.
Hope you find it helpfulThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
We're launching a new Databricks Startup Program!
Qualifying venture-backed startups can now receive up to $200K in credits across Databricks and @neondatabase, giving founders access to the app backend, data, and AI stack they need to go from idea to product-market fit.
The program also includes:
โข One application to access the full Databricks platform
โข Hands-on technical guidance to help teams architect and ship faster
โข Go-to-market support, partner access, and founder community connections
Wondering if you qualify? Learn more about the program and apply today: www.databricks.com/blog/announcing-new-databricks-startupโฆ -
Databricks
@databricks
Most agentic apps never make it past the prototype stage.
Join Databricks co-founder @pwendell, OpenClaw creator @steipete, @OpenAI's Thibault Sottiaux, and @Stellantis' Head of Agentic AI, Hugo Sechier for a live discussion on what it takes to build, deploy, and manage production-grade fleets of AI agents.
What they'll cover:
โข What separates a demo from a production agent
โข How to govern agents across your organization
โข How to manage data securely at scale
โข How leading teams are operationalizing agentic AI
Register today: www.databricks.com/resources/webinar/agents-work-shippingโฆ -
Databricks
@databricks
One-to-one personalization has long been a goal in marketing. The obstacle was always cost. You could never give every customer their own dedicated team of marketers.
Agents change that math. Last week at #dataaisummit, we introduced CustomerLake, an agentic customer data platform that assigns multiple autonomous agents to each customer, analyzing behavior and deciding the right offer, message, channel, and timing in real time, continuously rather than campaign by campaign.
"Agents are collapsing the layers," says @Tasso Argyros, our VP of engineering.
@KendraEBarnett covers the full story for @ADWEEK: www.adweek.com/media/databricks-launches-an-agentic-challโฆ -
Databricks
@databricks
From June 15โJuly 6, 2026, Databricks Customer Academy is hosting a three-week learning event dedicated to data engineering, analytics, machine learning, and generative AI.
Complete all modules in at least one self-paced learning pathway during the event window to receive a 50% discount on any Databricks Certification and 20% off a yearly Databricks Academy Labs subscription ๐ฐ.
Start learning: community.databricks.com/t5/learning-events/advanced-learโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Nice overview and tutorial on Omnigent: www.youtube.com/watch?v=oGE_Dwz-rMk
-
Databricks
@databricks
Missed the #dataaisummit 2026 keynotes? Weโve got you covered.
Full keynote replays and select breakout sessions are now available on-demand to help you catch up on the biggest moments from the week.
Start watching: www.databricks.com/dataaisummit -
Databricks
@databricks
Databricks co-founder and CEO @alighodsi announces Genie Ontology at #dataaisummit - an automatic context layer.
Genie Ontology extracts snippets of knowledge from tables, queries, dashboards, pipelines, and connected apps, and organizes that knowledge into a living graph of how a company works and what the data inside actually means.
Genie has context about where to look, what to trust, and how to answer in a way that reflects how the company actually uses its data. That includes metric definitions, business terms, unique calculations, and the relationships between concepts, metrics, tables, and teams.
Learn more: www.databricks.com/blog/introducing-genie-one-genie-ontolโฆ -
Databricks
@databricks
New security capabilities announced at #dataaisummit help organizations securely scale Genie and AI experiences, simplify network security and connectivity, and expand compliance coverage across clouds and regulated environments.
Highlights include:
โข GA of Automated Identity Management for Microsoft Entra ID on AWS and GCP
โข New Context-Based Ingress and Inbound Private Link capabilities for identity-aware network security
โข Expanded compliance coverage across Azure Serverless, AWS GovCloud, HITRUST, and additional global regions
These advancements help organizations adopt AI with security, governance, and compliance built in. www.databricks.com/blog/whats-new-databricks-platform-secโฆ -
Databricks
@databricks
We're bringing millisecond performance directly to the lakehouse.
Databricks Co-founder and Chief Architect @rxin introduces Lakehouse//RT, Databricksโ new real-time data warehouse designed for operational analytics, BI and app serving, and observability workloads.
Lakehouse//RT is powered by Reyden, a breakthrough new engine for real-time workloads that require immediate responsiveness at high concurrency.
Learn more: www.databricks.com/blog/introducing-lakehousert-real-timeโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
We just released Omnigent 0.2 with a ton of improvements from the past 5 days! Here's what's new according to Omnigent. Major additions are @cursor_ai CLI and @antigravity harnesses, lots of new sandbox providers, and secret-free sandboxing via API proxy. github.com/omnigent-ai/omnigent/releases/tag/v0.2.0
-
Databricks
@databricks
That's a wrap on #dataaisummit 2026.
Whether you attended in person or followed along virtually, thank you for making this year's Summit the best one yet.
Safe travels home, we'll see you all back here next year! ๐ -
Databricks reposted
#DataAISummit
@Data_AI_Summit
As #dataaisummit comes to a close, we asked attendees one final question.
What was your favorite moment from the Expo floor?
Watch their answers, then tell us yours. -
Databricks
@databricks
Announcing OpenSharing SecureConnect to simplify networking configuration for data sharing
OpenSharing introduces a Databricks-managed proxy for storage access. Providers configure storage access once, making it easier to onboard new recipients without the firewall changes and network coordination that often slow down data sharing.
Optionally, data providers can use NCC for SecureConnect to access provider storage over private connectivity.
Now in Public Preview. www.databricks.com/blog/introducing-opensharing-secureconโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
Excited to have Grok available on our platform!
-
Databricks
@databricks
Stanford University is the 2026 Databricks Grounded Reasoning Cup champion! ๐
The inaugural Grounded Reasoning Cup at #dataaisummit 2026 is in the books, with Stanford taking 1st, UMass Amherst earning 2nd, and Yale University securing 3rd after six high-intensity rounds of live AI agent competition over 200+ years of U.S. Treasury data.
Teams mentored by @AnthropicAI, @OpenAI, and @GoogleDeepMind built agents that tackled messy historical PDFs, multimodal chart interpretation, and web-augmented reasoning on real government data.
Thank you to @USAFacts, the U.S. Treasury, our student teams from 11 universities, and everyone who joined live. -
Databricks
@databricks
Databricks co-founder and CEO @alighodsi recaps everything you need to know from Tuesday's keynote in 60 seconds.
We introduced the agentic data foundation: Lakehouse//RT, Lakebase Disaster Recovery Vector Search, LTAP, Lakeflow.
The context layer: Genie Ontology, Unity AI Gateway, OpenSharing, Omnigent OSS, Agent Bricks.
Tools for agentic dev work: Genie One, Genie Code, and Genie Agents.
And apps: Lakewatch for your SIEM and Customer Lake for your CDP.
Watch the full keynote: www.databricks.com/dataaisummit -
Databricks
@databricks
"Ali Ghodsi wants to rebuild the stack itself," writes @iamVictorDey for @Forbes.
For 40 years, every data stack has carried the same split: one set of systems to run the business, another to analyze it. The real bottleneck for agentic AI isn't model intelligence. It's that divide.
At #dataaisummit, we introduced LTAP (Lake Transactional/Analytical Processing): both transactional and analytical engines running on a single copy of data, in an open format. One data, zero compromises, zero copies.
It's built on Lakebase, our serverless Postgres database. Across the platform, agents now create roughly 80% of databases.
"Our primary user is already the agent," says Databricks co-founder and CEO @alighodsi.
Read the full story: www.forbes.com/sites/victordey/2026/06/16/databricks-ceo-โฆ -
Databricks
@databricks
Apps on Databricks Marketplace are now in Public Preview.
This is a new way for organizations to discover, deploy, and use data and AI applications. Instead of moving data to an application, the application comes to the data.
Organizations can now install and run third-party apps directly inside their Databricks workspaces, where applications operate within secure, governed environments.
For providers, Apps on Marketplace create a new way to securely distribute and monetize data and AI applications across thousands of Databricks customers worldwide. www.databricks.com/blog/announcing-apps-databricks-marketโฆ -
Databricks
@databricks
Congratulations to the winners of the #dataaisummit Apps & Agents for Good Hackathon!
Over two days, participants used Lakebase, Agent Bricks, and Databricks Apps to build solutions powered by data from Virtue Foundation, tackling challenges related to healthcare access and infrastructure across India.
๐ฅ ๐ญ๐๐ ๐ฃ๐น๐ฎ๐ฐ๐ฒ: ๐๐ฎ๐๐ฎ ๐ฅ๐ฒ๐ฎ๐ฑ๐ถ๐ป๐ฒ๐๐ ๐๐ฒ๐๐ธ
- A Databricks App that helps non-technical data stewards, NGO analysts, and healthcare planners profile, prioritize, and review facility datasets so they can be trusted for downstream decisions.
๐ฅ ๐ฎ๐ป๐ฑ ๐ฃ๐น๐ฎ๐ฐ๐ฒ: ๐๐๐ฐ๐น๐ฒ๐ฝ๐ถ๐๐
- Turned 10,000 messy Indian healthcare records into trusted decisions for patients, planners, and hospitals, with every answer cited and each uncertainty shown.
๐ฅ ๐ฏ๐ฟ๐ฑ ๐ฃ๐น๐ฎ๐ฐ๐ฒ: ๐๐ฎ๐ฟ๐ฒ ๐ฆ๐ถ๐ด๐ป๐ฎ๐น
- AI-powered facility search, location insights, and trust signals to help families find trusted care faster and make confident decisions.
Thank you to our partners at Virtue Foundation and @OpenAI for making this event possible. -
Databricks
@databricks
๐ The Grounded Reasoning Cup is live at #dataaisummit 2026!
Over the next few hours, 12 teams from leading universities go head-to-head in a live AI agent championship, tackling real-world enterprise reasoning challenges using models from @GoogleDeepMind, @AnthropicAI, and @OpenAI.
Teams have spent months building their agents, but today's test set is entirely new โ putting their ability to generalize under pressure in real time.
Head to Hackers Corner in Moscone West to watch, and hear from special guests including @matei_zaharia, @Steven_Ballmer, and leaders from across the AI industry. -
Databricks
@databricks
For data engineers, data scientists, ML engineers, and analysts, context matters.
A useful AI agent needs to understand not just the code, but the data it depends on, the assets it may affect, and the environment where it will run.
Thatโs why we built Genie Code. With Genie Code, teams can bring AI-native development into the same platform they use for data engineering, analytics, machine learning, and production AI.
Genie Code uses relevant notebooks, SQL queries, Lakeflow pipelines, Unity Catalog metadata, permissions, lineage, and compute as it works.
And now itโs more powerful, with new features for complex, multi-threaded work.
See what's new in Genie Code: www.databricks.com/blog/whats-new-genie-code-data-ai-summโฆ -
Databricks
@databricks
.@rxin, Databricks Co-founder and Chief Architect and Jack Naglieri, Founder and CEO of @runpanther took the stage at #dataaisummit to discuss security built for the agentic era.
Panther delivers what legacy SIEMs can't: AI SOC agents that triage and investigate every alert, and broad data source coverage that captures the full spectrum of security telemetry. -
Databricks
@databricks
Justin DeBrabant, Director of Product, walks through the questions that led to the latest set of Databricks releases for agentic app dev.
โHow do we unlock the next wave of builders without sacrificing security, governance or budgets?โ Introducing: Genie App Builder
โWe need more cost-effective infrastructure for light-weight apps.โ Introducing: Serverless micro-Apps
โHow do we get vibe coding tools to understand our business?โ Introducing: App Spaces
www.databricks.com/blog/enabling-governed-vibe-coding-entโฆ -
Databricks
@databricks
New capabilities across the Databricks AI Platform help ML teams tackle some of the most challenging parts of building production machine learning systems.
We're announcing advances in ML engineering, deep learning, and real-time inference:
โข Genie Code now comes with upgraded intelligence for ML engineering and native integrations across every Databricks ML Platform component: feature engineering, model training, serving, and monitoring
โข AI Runtime, a unified deep learning platform for large-scale training and fine-tuning on serverless GPUs
โข High-QPS Model Serving, enabling efficient, low-latency inference for production applications
These capabilities bring new support for machine learning development, large-scale training, and production inference on Databricks.
www.databricks.com/blog/whats-new-ai-platform-agents-ml-eโฆ -
Databricks
@databricks
Vibe coding is changing who can build software, but enterprise teams need more than just speed. They need context and control.
At Data + AI Summit 2026, we announced three new capabilities for application development on Databricks that bring it all together:
- ๐๐ฝ๐ฝ ๐ฆ๐ฝ๐ฎ๐ฐ๐ฒ๐: group-level governance, permissions and cost controls that every app inherits automatically
- ๐๐ฒ๐ป๐ถ๐ฒ ๐๐ฝ๐ฝ ๐๐๐ถ๐น๐ฑ๐ฒ๐ฟ: turn a plain-language description or screenshot into a production-ready Databricks App, grounded in your data
- ๐ฆ๐ฒ๐ฟ๐๐ฒ๐ฟ๐น๐ฒ๐๐ ๐บ๐ถ๐ฐ๐ฟ๐ผ ๐ฎ๐ฝ๐ฝ๐: a new micro VM-based runtime powering apps that start fast and scale to zero when idle, making infrequently used apps more economically viable
More builders. More apps. Better governance. www.databricks.com/blog/enabling-governed-vibe-coding-entโฆ -
Databricks
@databricks
โYou can use any coding tool and any model thatโs available to you, but as you reach the upper limit of your token limit, you see a reminder of real-time budgets and a recommendation to switch to a more token-efficient model.โ
@ankit_math, software engineer at Databricks, demos Unity AI Gateway to secure, observe, and govern your AI assets, from MCPs to models to external agents. -
Databricks
@databricks
.@satyanadella, Chairman and CEO of @Microsoft, on the importance of enterprise context, the pace of innovation today, and the future of value creation with AI.
Nadella joined @alighodsi, co-founder and CEO of Databricks for a discussion shared with attendees at #dataaisummit on turning frontier models into real-world results and the Microsoft x Databricks partnership.
โWeโre enabling every enterprise to fully participate at the frontier with their own IP,โ said Nadella. -
Databricks
@databricks
As AI moves from experiments to production, governance has to cover more than models. Teams need to see how AI is used, control what agents can access, and guard against new threats.
At Data + AI Summit 2026, we're introducing the Unity AI Gateway partner ecosystem.
We're proud to welcome some of the most trusted names in AI security, identity, and observability: @alice_dot_io, @CrowdStrike, HiddenLayer, @Netskope, @openlayerco, @PaloAltoNtwks, @Zscaler, @Okta, @pingidentity, @saviynt, @NomaSecurity, @cyera_io and @ObsidianAudits.
Together, these partners help you govern AI consistently across providers and frameworks. www.databricks.com/blog/building-open-ecosystem-ai-governโฆ -
Databricks
@databricks
โTeam are stuck building infrastructure, not agents.โ
@kuhlenhuth, Director of PM at Databricks, walks through how Agent Bricks helps developers get unstuck so they can focus on building thousands of agents. -
Databricks
@databricks
We are excited to announce the next evolution of Agent Bricks as our agent platform.
Agent Bricks has expanded into a comprehensive platform for building agents with any model and any harness, accessing data anywhere, and confidently deploying and controlling agents in production.
Agent Bricks provides the building blocks developers need to build impactful agents, including secure sandboxes, agent memory, token capacity, and managed infrastructure.
The platform is open by design, supporting any model, any harness, and any data source. We also offer a managed version of Omnigent, our open source meta-harness, to orchestrate different harnesses.
We believe the future of agents requires data and AI on a single platform, making it easier to build and operate agents in production.
We can't wait to see what you build! www.databricks.com/blog/agent-bricks-dais-2026 -
Databricks
@databricks
Over 500,000 people have used Databricks Free Edition to learn, experiment, and build with data and AI. Today, we're making it a lot more powerful.
Free Edition now includes five new products:
๐๐ฒ๐ป๐ถ๐ฒ ๐๐ผ๐ฑ๐ฒ โ generates, runs, and iterates on code autonomously on your behalf
๐ฆ๐ฒ๐ฟ๐๐ฒ๐ฟ๐น๐ฒ๐๐ ๐๐ฃ๐จ๐ โ access to GPUs for deep learning, fine-tuning, and inference workloads
๐๐ฎ๐ธ๐ฒ๐ฏ๐ฎ๐๐ฒ โ a fully managed Postgres-compatible database built for data apps and AI agents
๐๐ด๐ฒ๐ป๐ ๐๐ฟ๐ถ๐ฐ๐ธ๐ โ pre-built, composable components for building production-ready AI agents
๐๐ฎ๐ธ๐ฒ๐ณ๐น๐ผ๐ ๐๐ฒ๐๐ถ๐ด๐ป๐ฒ๐ฟ โ build data pipelines visually, without starting from a blank page
Free Edition now covers every core Databricks practitioner feature. Sign up and start building: www.databricks.com/blog/whats-coming-next-free-edition -
Databricks
@databricks
Databricks co-founder and CTO @matei_zaharia demos Omnigent, a meta-harness to combine, control, and share your agents. โAI needs a layer to work above the harness and the meta harness layer will benefit from being open.โ
-
Databricks reposted
#DataAISummit
@Data_AI_Summit
โWe need a new layer above the harness layer - and we think it should be open. Thatโs why we built Omnigent and we open sourced it.โ
@omnigent_ai handles the challenges where a single harness stops.
Our Co-founder and CTO @matei_zaharia shares more at Data + AI Summit. -
Databricks
@databricks
The #dataaisummit Wednesday keynote starts now!
Join us for the more innovations from Databricks, live demos, major announcements, and real-world success stories from leading data and AI companies.
Stream live and follow along: www.databricks.com/dataaisummit/virtual-experience -
Databricks reposted
Matei Zaharia
@matei_zaharia
My Omnigent demo for @Data_AI_Summit literally writes itself.. get two agents to debate and hilarity ensues. Tune into the stream tomorrow morning!
-
Databricks reposted
Jamin Ball
@jaminball
In the @databricks keynote today, @alighodsi talked about why the old "SaaS stack" of database + workflows + UI won't transition to the "Agent Stack." One of the core arguments was agentic workloads span multiple systems of record, so we need something new.
I wrote about exactly this in Jan - called it "Platforms of Platforms." Databricks is building a platform of platforms
Jamin Ball
@jaminball
-
Databricks
@databricks
Databricks Releases General AI Agents for Businesses.
@bellelin_ of @WSJ reports, that Databricks โis pushing further into AI applications for general work with Genie One, an agentic co-worker that helps business teams across finance, marketing, and sales get answers and make decisions from their corporate data.โ
Powering it is Genie Ontology, a real-time graph of an organization's data, documents, apps, and people.
Databricks Co-founder and CEO @alighodsi tells the Wall Street Journal, that context layer is the "secret sauce" โ driving more accurate, faster responses at lower token cost.
Read the latest: www.wsj.com/cio-journal/databricks-releases-general-ai-agโฆ -
Databricks
@databricks
What did attendees think of today's #dataaisummit keynote?
We took that question to the show floor to hear reactions to the announcements, demos, and biggest moments from the morning.
Watch what they had to say, then catch up on today's news: www.databricks.com/dataaisummit/session/tuesday-keynoteThis media couldn't be displayed. See it on the original post. -
Databricks reposted
#DataAISummit
@Data_AI_Summit
Don't forget to stop by and experience interactive demos and activations from our customers โ including FOX Sports, Virgin Atlantic, Rivian, Virtue Foundation, Adidas, 7-Eleven, Trek, TruGreen, and Magnum Ice Cream!
See firsthand how leading organizations are driving growth with Databricks Lakebase, Genie, and more. -
Databricks
@databricks
Shoutout to the real MVPs: the Databricks MVPs! Thanks for all you do to support, teach, and inspire our community. So great to be together again at #dataaisummit.
-
Databricks
@databricks
We need governance built for the agentic era.
As agents increasingly act on enterprise data, governance can no longer stop at access. It has to control what AI can do, give agents the context they need to understand the business, and offer the choice to work across clouds, regions, formats, and platforms.
Today, we're advancing Unity Catalog with:
- Unity AI Gateway to govern models, agents, tools, MCPs, and their runtime interactions
- Glossary and Domains to create a shared semantic foundation for business concepts and context
- Cross-cloud, cross-region governance and expanded interoperability across open formats and more
Now, your foundation is ready for the next generation of AI applications and agents. www.databricks.com/blog/whats-new-unity-catalog-data-ai-sโฆ -
Databricks reposted
Salesforce
@salesforce
We're expanding our partnership with @Databricks to help organizations create a shared foundation for human and agent work.
As work increasingly happens through agents, automation, and conversational interfaces, having a complete, unified view of your business has never been more essential. By connecting governed enterprise data with customer and operational context, Salesforce and Databricks are empowering organizations to turn deep understanding into trusted, seamless action.
โThe challenge is no longer building more agents. Itโs giving agents the trusted data, business context, governance, and workflows required to operate safely at enterprise scale,โ said Rahul Auradkar, President and GM, Data Foundations, Salesforce. โTogether, Salesforce and Databricks are helping customers build a new operating model where humans and agents work side by side to accelerate productivity and business growth.โ
To create this shared foundation, we are expanding our partnership across three key areas:
1. Governed Business Context: We are expanding our Zero Copy integration to extend trust controls across both platforms. With capabilities like Federated Authentication and identity mapping, organizations can ensure users and AI agents operate against the exact same governed enterprise context, permissions, and security controlsโregardless of where the data resides.
2. Cross-Platform Discovery & Action: We are making it effortless to take action without custom integrations. Through Federated Search and bi-directional Model Context Protocol (MCP) integrations, users and agents can seamlessly discover information and work across Salesforce and Databricks.
3. Enterprise Context in the Flow of Work: We are bringing Databricks-powered insights and AI experiences directly into Slack. Whether it's asking Databricks Genie about inventory risks or getting real-time threat alerts through Databricks Lakewatch, teams and agents can access trusted information and accelerate decision-making without ever switching systems.
โSalesforce and Databricks help us bring together fan data from across our business into a trusted foundation for AI. With that context, our teams and agents can better understand each fan, recommend the next best action, and create more personalized experiences across every interaction.โ โ Joey Graziano, Chief Commercial Officer at Pacers Sports & Entertainment.
The gap between reasoning and action is officially closed.
Humans and agents, working side-by-side on a single, trusted foundation.
This is the new operating model for the enterprise. -
Databricks reposted
Matei Zaharia
@matei_zaharia
You can now query your lakehouse data in real time at <10ms latency! Any table, just faster, at 12,000+ QPS, on the existing open data formats. Powered by what @rxin's team affectionally called Reynold's Dream Engine (Reyden).
Databricks
@databricks
Introducing Lakehouse//RT, a real-time data warehouse that delivers millisecond responses at massive scale without data movement.
Support real-time workloads while using the same open formats, governance, and data architecture already powering your analytics and AI. -
Databricks reposted
#DataAISummit
@Data_AI_Summit
๐ Attendees are lined up for the @DeltaLakeOSS: The Definitive Guidebook signing at our DevLounge!
Stop by to meet authors @dennylee, Tristen Wentling, @newfront, and Prashanth Babu and pick up a signed copy. -
Databricks
@databricks
Announcing new OpenSharing and Marketplace capabilities for the AI era.
Data sharing was just the beginning. The next wave is about sharing intelligence, running apps where your data lives, and instant access to the data and AI products you depend on.
At Data + AI Summit, we're introducing OpenSharing, the first open, vendor-neutral protocol for sharing AI assets like Agent Skills and AI models.
We're also expanding Databricks Marketplace, now run partner-built apps with zero data movement, and buy third-party data and AI products with your existing commits.
And with ID resolution for clean rooms, customers can match identities across parties without exposing raw identifiers.
The next era of collaboration is open, interoperable, and built for data and AI. www.databricks.com/blog/announcing-new-opensharing-and-maโฆ -
Databricks
@databricks
โHow do we truly unify transactional and analytical data?โ
@rxin announces LTAP - lake transactional-analytics process - a new data processing architecture that unifies OLAP and OLTP on a single copy of data in the lake, eliminating ETL, replicas, and pipelines by design. -
Databricks
@databricks
โWe made a virtual C-suite. It serves small business owners by creating a suite of agents to help them manage cash flow, investments and more. Standardizing on Lakebase has been critical.โ
Fed Cohen Freue, EVP of AI & Data Operations at Mastercard, on how a unified infrastructure has helped accelerate solutions.
โWe are uncompromising in our approach to how to manage and govern our AI and data. Lakabase built that foundation from the start.โ -
Databricks
@databricks
Databricks Co-founder and Chief Architect @rxin discusses how operational analytics and BI/real-time serving are two workloads that have yet to be unified on a data platform. Until now.
โIโm excited to announce the Lakehouse//RT, a breakthrough new engine for real-time workloads that delivers millisecond responses at massive scale without data movement.โ
โThis is the single largest innovation weโve built since the introduction of Lakehouse.โ -
Databricks
@databricks
Introducing Lakehouse//RT, a real-time data warehouse that delivers millisecond responses at massive scale without data movement.
Support real-time workloads while using the same open formats, governance, and data architecture already powering your analytics and AI. -
Databricks reposted
#DataAISummit
@Data_AI_Summit
Databricks Co-founder and Chief Architect @rxin at #dataaisummit, announcing Reyden: a breakthrough new engine for real-time workloads that require immediate responsiveness at high concurrency.
โThis is the single largest innovation weโve built since the introduction of Lakehouse.โ
www.databricks.com/dataaisummit/watch -
Databricks
@databricks
โSuccess for us isnโt building great dashboardsโor even great AI tools. Itโs making data invisible and decisions smarter.โ
Magesh Bagavathi, Global Chief Data and AI Officer at @PepsiCo, chats with our Co-founder and SVP of Field Engineering Arsalan Tavakoli-Shiraji about how Genie and agentic AI is helping PepsiCo move from forecasting to actually recommending actions in real time. #dataaisummit -
Databricks
@databricks
โMore agents means more data and more complexity,โ says Bilal Aslam, Sr. Director of PM at Databricks. โIโm going to make a bold claim that Lakeflow solves that problem with a unified stack. It gives you an open foundation for AI agents so that you can build your company the future it deserves.โ #dataaisummit
-
Databricks
@databricks
Welcome to the era of agentic data engineering.
Today at the Data + AI Summit, we are excited to announce the next major evolution of Databricks Lakeflow:
- ๐๐ฎ๐ธ๐ฒ๐ณ๐น๐ผ๐ ๐๐ผ๐ป๐ป๐ฒ๐ฐ๐: Connect to 100+ enterprise data sources across SaaS, databases, cloud storage, and more.
- ๐ญ๐ฒ๐ฟ๐ผ๐ฏ๐๐ ๐๐ป๐ด๐ฒ๐๐: Stream high-volume event data via multiple interfaces, including OTEL and Kafka-compatible APIs.
- ๐ฆ๐ฝ๐ฎ๐ฟ๐ธ ๐๐ฒ๐ฐ๐น๐ฎ๐ฟ๐ฎ๐๐ถ๐๐ฒ ๐ฃ๐ถ๐ฝ๐ฒ๐น๐ถ๐ป๐ฒ๐: Batch and streaming, SQL and Python, and now real-time streaming with e2e latencies as low as 5ms.
- ๐๐ฒ๐ป๐ถ๐ฒ ๐๐ผ๐ฑ๐ฒ & ๐๐ฒ๐ป๐ถ๐ฒ ๐ญ๐ฒ๐ฟ๐ผ๐ข๐ฝ๐: Accelerate authoring and reduce operational toil with agentic development.
- ๐๐ฎ๐ธ๐ฒ๐ณ๐น๐ผ๐ ๐๐ผ๐ฏ๐: Orchestrate complex data pipelines and AI agents seamlessly with 50+ integrations.
www.databricks.com/blog/lakeflow-new-era-agentic-data-engโฆ -
Databricks reposted
#DataAISummit
@Data_AI_Summit
โRather than grinding through a loop of trial and error and eating up tokens along the way, Genie goes straight to the ground truth.โ
Elise Georis, Sr. Manager, Product Management at Databricks, demos Genie One in action. -
Databricks
@databricks
Databricks just announced Databricks CustomerLake, an Agentic CDP natively embedded in the Databricks Lakehouse.
"By bringing an AI-native marketing platform directly into the same governed data and AI foundation used by the rest of the business, we equip marketers and data teams with a workforce of agents to deliver the perfect customer experience." -
Databricks
@databricks
โYou want to have all your data, be able to access it in one place, and keep it in an open format,โ says @alighodsi, co-founder and CEO of Databricks. โWeโre calling this an Agent System of Record. And we think that the new system of record is the data + AI platform.โ
-
Databricks
@databricks
Weโre excited to announce that we have agreed to acquire @runpanther, a next-generation AI SOC platform. Panther delivers what legacy SIEMs can't: AI SOC agents that triage and investigate every alert, and broad data source coverage across the full spectrum of security telemetry. Panther accelerates our vision for agentic security operations.
Trusted by leading security teams โ including Anthropic โ Panther has proven it can defend the most demanding, AI-native environments.
Panther marks our third security acquisition as we double down to help organizations defend against increasingly sophisticated AI-driven attackers.
Together, weโll deliver agentic detection and response workflows on an open security lakehouse. This is security built for the agentic era. www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
Introducing Genie ZeroOps, a new AI background agent that monitors your production workloads, investigates issues, and suggests fixes.
As organizations deploy more pipelines, models, dashboards, and apps, maintaining production workloads has become a growing challenge. Genie ZeroOps monitors production assets, automatically investigates issues using platform intelligence, and suggests fixes that are tested in a sandbox environment before they reach production.
Genie ZeroOps helps teams scale agentic ops while staying in control.
Coming soon in Private Preview. www.databricks.com/blog/introducing-genie-zeroops -
Databricks
@databricks
Without the right context, even the most advanced agents fail to give reliable answers. And when context is incomplete, AI will fill the gaps.
โAgents need one system of record, with all of your data and unified governance,โ says Databricks co-founder and CEO, @alighodsi. โThatโs why weโre excited to announce something our research team has been working on - Genie Ontology.โ -
Databricks
@databricks
Meet Genie One, the data-smart AI coworker for business teams.
There's no shortage of AI assistants for business users. What they lack is an AI coworker that understands the business, knows what data to trust, and can turn answers into action.
Genie One is designed to close that gap. It understands where to look, what to trust and how to answer.
It's powered by Genie Ontology, a live context layer that continuously learns your business from your data, AI tools, and the workplace apps you already use โ delivering more accurate answers, faster, at lower token cost.
Marketing, finance, sales, and beyond can now automate and orchestrate their work, grounded in real business data from anywhere, inside and outside Databricks.
Less guessing. More knowing. www.databricks.com/blog/introducing-genie-one-genie-ontolโฆ -
Databricks
@databricks
โAI governance has become a whole company problem,โ says @alighodsi, co-founder and CEO of Databricks. โWeโre super excited to announce one place where you can control all of your spend - itโs called Unity AI Gateway.โ #dataaisummit
-
Databricks
@databricks
As AI spreads across more models, agents, and workflows, organizations need to know what AI is costing, who's using it, and how to keep spend under control โ before overruns happen.
Today, we're introducing new multi-AI cost modeling and budget controls in Unity AI Gateway, so enterprises can manage AI spend across every model and provider from one place.
With Unity AI Gateway, teams can:
โ Monitor AI costs in real time
โ Set proactive budgets before overruns happen
โ Route requests to more cost-effective models when it makes sense
โ Apply fine-grained policies and runtime guardrails across models, agents, MCP servers, and AI skills
Give your teams the flexibility to build with AI โ without losing control of cost, security, or governance.
Stop token-maxxing. Start value-maxxing. www.databricks.com/blog/ai-governance-data-ai-summit-2026โฆ -
Databricks
@databricks
OpenSharing is a new open standard for sharing data and AI assets across platforms and organizations.
Five years ago, we pioneered open data sharing with Delta Sharing, the most widely adopted open protocol for secure zero-copy data sharing.
Today, we're excited about its evolution to OpenSharing. Publish agent skills and AI models via a single open protocol that any partner can consume, with standard APIs for discovery, authorization, and access, regardless of platform
Hosted by @thelinuxfoundation, OpenSharing creates an open foundation for data and AI collaboration. www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
"You no longer need to care about table formats. You should be able to use the right tool for the job."
Ryan Blue, Member of Technical Staff at Databricks and the original creator of @ApacheIceberg, joined Databricks co-founder and CEO @alighodsi onstage at Data + AI Summit to talk about open table format unification and the future of enterprise data architecture. -
Databricks
@databricks
Our Co-founder & CEO @alighodsi kicking off keynote at Data + AI Summit. The worldโs largest data and AI conference.
Watch it live to hear about the latest Databricks updates to help you build AI apps and agents that actually work. www.databricks.com/dataaisummit/watch -
Databricks
@databricks
"Just trying to use the most AI is like maximizing the number of lines of code you write. That's not a good measure of software quality, nor is the number of tokens."
Databricks Chief AI Scientist @jefrankle kicked off tonight's DevConnect Meetup at #dataaisummit 2026 by reflecting on how quickly the AI landscape has evolved since December 2025, with 1,000+ developers, startup founders, and practitioners in the room.
Getting real value from AI โ not just using more of it โ is what tonight is all about.
Four tracks covering agentic systems, emerging AI, and applied data solutions. Let's get started! -
Databricks
@databricks
The excitement around #dataaisummit is building!
We stopped attendees to ask one question: What are you most excited to see this week?This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Builders are gathering for the Apps & Agents for Good Hackathon at #dataaisummit!
Using Lakebase, Agent Bricks, Databricks Apps, and @OpenAI, teams will spend the next two days building agentic data apps for social impact. Good luck to all the participants โ we're excited to see what they create!
Winning teams are announced tomorrow ๐ -
Databricks
@databricks
#dataaisummit 2026 is officially underway!
This week, thousands of data and AI leaders, engineers, analysts, architects, and builders are coming together in San Francisco to explore the future of apps and agents through keynotes, technical sessions, training, and hands-on experiences.
We'll be sharing announcements, highlights, and moments from across the event all week long.
Not in San Francisco? Join the virtual experience here: www.databricks.com/dataaisummit -
Databricks
@databricks
#dataaisummit begins tomorrow, but there's still time to join from anywhere.
Register for the virtual experience to watch keynotes, tune into select sessions, and follow the biggest announcements from the week as they happen.
Save your spot and join us live: -
Databricks reposted
#DataAISummit
@Data_AI_Summit
This week at #dataaisummit, some of the worldโs most innovative companies across every industry are demonstrating how theyโre driving business forward with data, apps and agents.
We're super excited to hear their stories and share them with you! -
Databricks
@databricks
#dataaisummit starts tomorrow!
30,000+ attendees, 800+ sessions, keynotes, meetups, and trainingโall at the worldโs largest data, analytics, and AI conference.
Itโs not too late to join us. Register to attend in San Francisco or virtually: www.databricks.com/dataaisummit -
Databricks
@databricks
A 9,000-mile road trip generates a lot of data.
As part of #road2summit, Vijay Rao, Founder of v4c.ai, is documenting every mile of his cross-country journey with real-time telemetry powered by the Databricks Lakehouse.
Follow along to see how data is powering the trip, and keep an eye out for Vijay at #dataaisummit: www.road2summit.ai/tech-stack
See you next week! -
Databricks reposted
Matei Zaharia
@matei_zaharia
Really excited to open source a new project: Omnigent, a meta-harness for AI agents.
It lets you build multi-agent coding and custom agents, sitting above Claude Code, Codex, Pi, and agent SDKs to let you compose them. It also adds live collaboration and rich control policies. -
Databricks reposted
Linda Vivah (Haviv)
@lindavivah
Databricks just launched the industry's first Context Engineer Associate cert! ๐ป
It assesses your ability to design, assemble, and govern the information AI agent systems receive at inference time: retrieval, memory, tool integration, context-window management, and governance.
The exam is in beta and debuts at @databricks Data + AI Summit where you can be one of the first to take it. It's walk-in at the cert room with one free attempt on-site.
The learning material itself is free, the hands-on labs may vary, and the other Databricks certs will be 50% off on-site as well.
โจI'm excited to attempt it myself! ๐
๐ปYou can also tune in to the Summit virtually for free โจ dataaisummit.databricks.com/flow/db/dais2026/landing/pageโฆ
โจ๐Learn more about the Context Eng Cert here:ย www.databricks.com/learn/certification/context-engineer-aโฆ
Canโt wait to attend this year! LMK if you'll be there in person - Let's meet up!ย ๐
#databrickspartnerThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Introducing ๐ข๐บ๐ป๐ถ๐ด๐ฒ๐ป๐, a meta-harness to combine, control, and share your agents.
The best teams already mix models and harnesses and design loops that drive teams of agents. No single harness can keep up with that alone. So we built the layer above โ we call it a ๐บ๐ฒ๐๐ฎ-๐ต๐ฎ๐ฟ๐ป๐ฒ๐๐.
Omnigent sits above the tools you already use, Claude Code, Codex, Pi, and your own agents, and gives them one shared layer:
โข ๐๐ผ๐บ๐ฝ๐ผ๐๐ถ๐๐ถ๐ผ๐ป: combine models, harnesses, and techniques without rewriting code, and switch between them with one-line changes
โข ๐๐ผ๐ป๐๐ฟ๐ผ๐น: stateful, data-centric policies and cost budgets enforced at the meta-harness layer, not via prompts โ let agents run without watching them
โข ๐๐ผ๐น๐น๐ฎ๐ฏ๐ผ๐ฟ๐ฎ๐๐ถ๐ผ๐ป: share a live agent session via URL with full history, so teammates can review, comment, and steer in real time
Every session is reachable from a terminal, the web, a desktop app, and your phone.
We built Omnigent for our own use at Databricks and are open sourcing it under Apache 2.0. www.databricks.com/blog/introducing-omnigent-meta-harnessโฆ
Databricks
@databricks
Check it out on GitHub today: github.com/omnigent-ai/omnigent
-
Databricks
@databricks
Business users can already use Genie to ask descriptive questions in natural language. Now the same conversational workflow can support predictive analytics too.
By combining Databricks Genie, TabPFN, and Agent Bricks, teams can turn questions like โWhich customers are likely to churn?โ or โWhich promotion is most likely to close this deal?โ into predictive answers in seconds.
Instead of relying on specialized ML workflows and dedicated data science teams, the system dynamically assembles governed Lakehouse data and generates predictions within the same conversational experience.
www.databricks.com/blog/what-happened-what-will-happen -
Databricks reposted
#DataAISummit
@Data_AI_Summit
โฆthereโs still time to register!
Donโt miss the biggest innovations in data and AI across two exciting keynotes, 800+ sessions, hands-on training, and more at #dataaisummit 2026: www.databricks.com/dataaisummit -
Databricks
@databricks
#dataaisummit is less than one week away!
If you're still locking in your schedule, we've highlighted a few sessions worth adding to your agenda. AI agents, production AI, AI-native applications, and the future of the agentic stack will be front and center throughout the week.
Explore the full agenda: www.databricks.com/dataaisummit/agenda -
Databricks reposted
Replit โ
@Replit
Replit and @databricks integration just leveled up.
Build apps where every user sees only what they should. Your HR analyst can build a full org view for the CEO without ever accessing the underlying data.
Public preview is open for sign up! Read more โ -
Databricks reposted
Linda Vivah (Haviv)
@lindavivah
Iโm SO excited to head to @databricks Data + AI Summit (June 15 to 18)!
You can also tune in for free virtually ๐
๐ฅ The keynotes and select sessions stream free, live June 16 to 17 + on-demand after. Register for free virtually here: www.databricks.com/dataaisummit -
Databricks
@databricks
Streaming data into the lakehouse shouldn't require provisioning infrastructure, managing brokers, or tuning partitions.
Zerobus Ingest is a fully managed, serverless, streaming ingest service that accepts data from any producer and writes it directly into Unity Catalog governed Delta tables. Create a table, push data, and query it in seconds.
To demonstrate what's possible, the team used NASA's NEOWISE datasetโrepresenting 200 billion data pointsโto ingest 1 petabyte of data in under 24 hours with zero pre-configuration, sustaining 12 GB/s and 12 million rows per second to a single table.
Read how dynamic partitioning, zero-copy parsing, and a latency-optimized write-ahead log make it possible: www.databricks.com/blog/ingesting-milky-way-petabyte-scalโฆ -
Databricks reposted
Delta Lake
@DeltaLakeOSS
Back by popular demand! ๐ Delta Lake: The Definitive Guide book signing returns to Data + AI Summit 2026.
If you are at Data + AI Summit, come meet the authors, say hi to the Delta Lake community, and pick up a signed copy while supplies last.
๐๏ธ Tuesday, June 16
๐ 2:00โ2:30 PM
๐ Dev Lounge, Data + AI Summit Expo, Moscone Center
Books tend to go quickly,ย so plan to stop by early. Hope to see you there! ๐
#deltalake #dataaisummit #opensource #dataengineering @dennylee @newfront @Data_AI_Summit -
Databricks
@databricks
The agentic AI stack has standards for connecting tools and defining skills, but it still has no standard protocol to share assets across organizations and platforms.
Today that means copying files, custom point-to-point integrations, and fragmented vendor-specific marketplaces.
This week we launched OpenSharing, the next evolution of Delta Sharing and the first open protocol to cover agent skills, AI models, and unstructured data. It is now a Linux Foundation project, available on GitHub.
@fredericl covers the full story for @thenewstack: thenewstack.io/databricks-opensharing-ai-agents/ -
Databricks
@databricks
We are honored to be recognized by @OpenAI with the Data Intelligence Platform Award.
This recognition reflects the work our teams have done together to bring frontier models into the enterprise, grounded in the governed data and context essential for solving complex business problems. We are excited to continue partnering with OpenAI to push the boundaries of enterprise intelligence.
We are looking forward to hosting @gdb, Co-founder and President of OpenAI, at Data + AI Summit. He will join Databricks CEO @alighodsi to discuss why enterprise context is the foundation for capable AI and what the future of agentic data work looks like. -
Databricks
@databricks
AI governance is becoming a data governance challenge, and organizations need a consistent way to govern agents, models, MCP servers, and data together.
Unity Catalog and Unity AI Gateway extend governance across AI systems with identity-aware access controls, runtime policies, guardrails, auditability, observability, and cost intelligence across every agent interaction.
Built on open standards, the approach supports consistent governance across Databricks and third-party AI ecosystems without slowing AI adoption.
Learn more: www.databricks.com/blog/governing-ai-agents-scale-unity-cโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Delta Sharing became one of the most popular ways to exchange data thanks to its open cross-platform nature. Weโve now expanded it to also support any Iceberg client and to share AI assets like agent skills and unstructured data. It needed a new name, so welcome OpenSharing!
-
Databricks reposted
The Linux Foundation
@linuxfoundation
The Linux Foundation has launched the OpenSharing Project, an open protocol for sharing AI assets and data across organizations, platforms, and cloud environments.
Contributed by @databricks, OpenSharing extends Delta Sharing to support the agentic AI era, enabling interoperable exchange of AI models, agent skills, and unstructured data through a common standard.
Learn more: www.linuxfoundation.org/press/linux-foundation-announces-โฆ -
Databricks
@databricks
Announcing OpenSharing, a new open standard for sharing data and AI assets across platforms and organizations.
Five years ago, we pioneered open data sharing with Delta Sharing, the most widely adopted open protocol for secure zero-copy data sharing - used by thousands of partners and customers.
Today, we're excited to announce its evolution to OpenSharing: The first open, vendor-neutral protocol for sharing AI assets, including agent skills, AI models, and unstructured data - in collaboration with partners including @OpenAI, @SAP, @LSEGplc, @stripe, @TheTradeDesk, @Minio, @AmadeusITGroup, @Atlassian, and more.
Enterprises can now use OpenSharing to share AI Assets, on-premises assets, as well as share structured and unstructured data in all formats. Hosted by The @linuxfoundation, OpenSharing creates an open foundation for data and AI collaboration in the agentic era. www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
๐ณ Card fraud happens in seconds, but many detection systems still rely on slow batch processing or complex streaming architectures.
This open-source Solution Accelerator shows how teams can build an end-to-end fraud detection workflow with Spark Real-Time Mode and Lakebase, including low-latency ML scoring, explainable fraud signals, and live monitoring on a unified platform.
With it, organizations can achieve sub-second fraud intervention while reducing operational complexity and avoiding the need for separate streaming infrastructure.
www.databricks.com/blog/how-build-real-time-fraud-detectiโฆ -
Databricks
@databricks
.@AnthropicAI's Claude Fable 5 is now available on Databricks, governed by Unity AI Gateway, across AWS, Azure, and GCP!
Fable 5 sets a new state of the art on OfficeQA Pro at 57.9% and is designed for work that was previously too complex or too long-running to hand to an AI.
Databricks customers can build domain-specific agents on Fable 5 and deploy them as Databricks Apps with Lakebase-powered memory, enabling agents to maintain context across sessions.
Build your first long-running agent with Agent Bricks: www.databricks.com/blog/claude-fable-5-now-available-dataโฆ -
Databricks
@databricks
The Big Book of Data Warehousing and BI looks at why lakehouse architecture is foundational to unifying data, enabling real-time analytics, and preparing for AI across the enterprise.
Explore practical guidance on:
- Migrating from traditional data warehouses
- Modeling data in a lakehouse
- Managing cost and performance at scale
- Governing data while supporting modern BI and analytics workflows
www.databricks.com/resources/ebook/big-book-data-warehousโฆ -
Databricks
@databricks
In just one week, #dataaisummit kicks off in San Francisco!
Join data and AI leaders for four days of technical sessions, keynotes, hands-on training, networking, and product announcements shaping whatโs next across the industry.
If you havenโt registered for the virtual or in-person experience yet, secure your spot today: www.databricks.com/dataaisummit -
Databricks
@databricks
AI workloads create new cost management challenges, from runaway retry loops to uncontrolled agent experimentation.
AI Spend Controls in Unity AI Gateway introduce proactive budget alerts across users, workspaces, use cases, and entire accounts so organizations can monitor and manage AI spend before it becomes a business risk.
Now organizations can apply AI spend controls consistently across coding agents, production agents, overnight batch jobs, models, providers, and AI workloads running throughout the business.
www.databricks.com/blog/introducing-ai-spend-controls-uniโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Thereโs a ton of interest in custom model tuning as agents reach production and scale up. Here is how we made Databricks Knowledge Assistant 3x faster using our new Instructed Retriever model trained end-to-end to do parallel test-time compute. Itโs rolling out to customers now!
Databricks AI Research
@DbrxMosaicAI
Most agentic search systems get better by thinking longer: more tool calls, more reason-act loops, each step waiting on the last. Quality goes up, but so does latency.
Instructed-Retriever-1 takes a different route. Instead of scaling test-time compute sequentially, it scales it in parallel. One retrieval-specialized model fans the work out: it generates multiple query and filter formulations to widen recall, then reranks the merged evidence with a multi-pivot reranker to sharpen precision. Both stages run at once, so searching more broadly no longer means searching more slowly.
The result inside Knowledge Assistant: search time drops more than 3x and answer time 2x, with time to first token around two seconds, and no drop in quality (it matches Claude Sonnet 4.5 retrieval quality on KARLBench). For the people using it, that means far less waiting between question and answer, the freedom to ask more follow-ups, and more of the knowledge base actually surfaced. Rolling out to all customers now, with no reconfiguration.
Read how we did it: www.databricks.com/blog/3x-faster-search-parallel-test-tiโฆ -
Databricks
@databricks
A 9,000-mile road trip. 35 days. 25 cities. One data platform.
As part of #roadtosummit, v4c.ai founder Vijay Rao is making his way to #dataaisummit with every layer of the journey running on the Databricks Lakehouse, including vehicle telemetry, trip analytics, social engagement, and a live AI-powered chatbot.
Next stop: #dataaisummit.
Follow along for live updates: www.road2summit.ai -
Databricks
@databricks
The Databricks Architecture Center is your hub for practical ways to build pipelines, dashboards, and AI models.
Find designs for common data and AI projects across use cases:
- Intelligent Data Warehousing on Databricks
- Reference Architecture for Credit Loss Forecasting
- Telecom Next Best Action Reference Architecture
- and much more!
Chart a faster path from idea to implementation, with patterns teams can build on: www.databricks.com/resources/architectures -
Databricks
@databricks
Lakebase brings operational databases into the same governance layer as analytics.
This walkthrough explores what happens when Backstage, Spotifyโs open-source internal developer portal, runs with Unity Catalog governance across ephemeral Postgres branches.
What changed:
โข Access controls, audit trails, row-level security, and masking policies applied automatically across branches
โข Branch creation, deletion, and cost attribution traced with a single SQL query
โข Developers safely created isolated database branches without exposing sensitive production data
www.databricks.com/blog/backstage-lakebase-part-2 -
Databricks
@databricks
๐ ๏ธ Building apps should be fast. Managing infrastructure shouldnโt slow developers down.
Watch @andrelandgraf from Databricks and Kevin Niparko from @cursor_ai walk through how to build and deploy a production-ready app on Databricks using built-in governance and serverless Postgres.
Youโll see how teams can:
โ Prototype and iterate in real time
โ Branch, scale, and manage transactional data
โ Govern data securely with SSO and Auth
โ Deploy apps where their data already lives
Watch the on-demand webinar โ www.databricks.com/resources/webinar/ending-developer-strโฆ -
Databricks
@databricks
Unity Catalog continues to expand open lakehouse interoperability.
External access to UC managed Delta tables is now in Beta, allowing engines like Apache Spark, Apache Flink, and DuckDB to create, read, and write managed tables with transactional safety and centralized governance.
Credential vending is also now GA, adding M2M OAuth support and automatic credential refresh so external engines can securely access UC-governed data without long-lived static credentials.
www.databricks.com/blog/expanded-interoperability-unity-cโฆ -
Databricks
@databricks
"We don't really need AI to get smarter. What we need is for it to have context."
Databricks co-founder and CEO @alighodsi joined @CarolineHydeTV and @EdLudlow at the Bloomberg Tech event in San Francisco to make case that the real breakthrough will come not from smarter models but from giving AI the data context it needs to perform. That is the problem Databricks Genie is built to solve.
Watch the full interview: www.youtube.com/watch?v=CipJDvsHsKc -
Databricks reposted
Databricks AI Research
@DbrxMosaicAI
Most agentic search systems get better by thinking longer: more tool calls, more reason-act loops, each step waiting on the last. Quality goes up, but so does latency.
Instructed-Retriever-1 takes a different route. Instead of scaling test-time compute sequentially, it scales it in parallel. One retrieval-specialized model fans the work out: it generates multiple query and filter formulations to widen recall, then reranks the merged evidence with a multi-pivot reranker to sharpen precision. Both stages run at once, so searching more broadly no longer means searching more slowly.
The result inside Knowledge Assistant: search time drops more than 3x and answer time 2x, with time to first token around two seconds, and no drop in quality (it matches Claude Sonnet 4.5 retrieval quality on KARLBench). For the people using it, that means far less waiting between question and answer, the freedom to ask more follow-ups, and more of the knowledge base actually surfaced. Rolling out to all customers now, with no reconfiguration.
Read how we did it: www.databricks.com/blog/3x-faster-search-parallel-test-tiโฆ -
Databricks
@databricks
[DEMO] Bring Genie to where your teams already work ๐ง
Genie can now connect directly with Microsoft Teams, M365 Copilot, and SharePoint through a native integration with Copilot Studio. Users can ask questions of their data in natural language and get insights without leaving their workflow.
Learn how to connect Databricks โ add Genie to an agent โ and publish it so teams can access answers in the tools they already use. youtu.be/2zLzCptIr9A -
Databricks
@databricks
Introducing the lab sponsors for the Databricks Grounded Reasoning Cup at #dataaisummit 2026: @AnthropicAI, @OpenAI, and @GoogleDeepMind.
Each lab is partnering with leading academic teams to build agents that tackle grounded reasoning over complex government data using the latest models and tooling.
Meet the teams, see the agents theyโre bringing to the competition, and join us as they push the boundaries of enterprise AI reasoning live on stage! ๐ -
Databricks
@databricks
๐ Weโve been busy shipping new features, and Nick Karpov and Holly Smith are here to break down the highlights in the latest episode of Over Architected.
Covered in this episode:
โข Multi-table transactions
โข Lakeflow Designer
โข AI functions for RAG workflows
โข Vector search improvements
โข AI governance updates
โข New agent capabilities across the platform
Watch the full walkthrough of whatโs new โ
www.youtube.com/watch?v=rPephv4WDlk -
Databricks
@databricks
Join #dataaisummit virtually from anywhere in the world on June 16โ17 ๐
The free virtual experience includes:
โข Full keynotes and select sessions
โข Exclusive online trainings
โข Expert commentary during Summit Live
โข On-demand access after the event
Register now โ -
Databricks
@databricks
Apache Spark unlocked a new era of large-scale data processing. Now serverless compute is making it even easier to run those workloads with greater stability, predictability, and efficiency.
We designed serverless compute by:
โ Separating applications from compute
โ Intelligently routing workloads
โ Dynamically scaling resources
A closer look at the distributed systems architecture powering serverless Spark on Databricks: www.databricks.com/blog/rethinking-distributed-systems-seโฆ -
Databricks
@databricks
Partitioning has been the standard data layout approach for years, but modern lakehouse workloads need something more flexible.
Weโre debunking eight common myths that continue to keep teams tied to partitioning, and exploring why more organizations are moving to Liquid Clustering for better performance, storage efficiency, and data freshness at scale.
Customers running Liquid Clustering at petabyte scale have reported:
โข Faster queries
โข Higher write throughput
โข Fewer small-file problems
โข More efficient storage and fresher data
Learn more: www.databricks.com/blog/debunking-8-data-layout-myths-whyโฆ -
Databricks
@databricks
Lakebase Customer-Managed Keys (CMK) gives organizations more control over how Postgres workloads are secured across both storage and compute layers.
With support for AWS KMS, Azure Key Vault, and Google Cloud KMS, teams can manage their own root of trust, rotate keys seamlessly, and use key revocation to make data cryptographically inaccessible while terminating active compute instances for high-compliance environments.
Learn more: www.databricks.com/blog/take-control-customer-managed-keyโฆ -
Databricks
@databricks
Enterprise data agents face a very different challenge than coding agents.
They must reason across constantly changing tables, dashboards, notebooks, and documents without a clear source of truth or deterministic tests.
This deep dive from the Databricks AI Research team explains how Genie uses specialized knowledge search, parallel thinking, and Multi-LLM orchestration to improve accuracy on real-world enterprise data analysis tasks from 32% to over 90%.
www.databricks.com/blog/pushing-frontier-data-agents-genie -
Databricks
@databricks
Canโt make it to San Francisco for #dataaisummit? Join the virtual experience from anywhere!
Stream the keynotes, watch select sessions, access exclusive online training, and follow expert commentary during Summit Live as major announcements happen in real time.
Register now and tune in from wherever you are ๐ www.databricks.com/dataaisummit/virtual-experience -
Databricks reposted
#DataAISummit
@Data_AI_Summit
Your Data + AI Summit journey awaits!
Attend sessions across all 10 tracks, level up with hands-on trainings, earn a certification, and join the Hackathon alongside thousands of data and AI practitioners.
Complete the full mission list and you might just leave as a Data + AI Summit champion. Start planning your journey and weโll see you in San Francisco ๐. www.databricks.com/dataaisummit -
Databricks
@databricks
.@MazdaUSA built a GenAI assistant on Databricks to help service hotline agents navigate growing diagnostic complexity with faster, more consistent support.
The team brought together vehicle history, recalls, diagnostic data, and service documents into a single governed platform, while building repeatable GenAI evaluations and shared retrieval logic across both the application UI and the agent itself.
See how Mazda built a repeatable foundation for future GenAI applications on governed enterprise data โ
www.databricks.com/blog/legacy-lakehouse-how-mazda-acceleโฆ -
Databricks reposted
Redpoint
@Redpoint
The Redpoint InfraRed 100 is now live.
These are the companies building the infrastructure that powers everything happening in AI right now, from world models and agent runtimes to the sandboxes, databases, and security tools agents depend on.
Congratulations to this year's honorees!
Read the full 2026 InfraRed Report: our state of the union on AI and cloud infrastructure ๐ www.redpoint.com/reports/the-infrared-report-2026/ -
Databricks reposted
Neon
@neondatabase
Big news: Neon is expanding to offer a more complete set of backend primitives for running apps and agents:
โ Database โ Authentication ๐ Storage ๐ Compute ๐ AI Gateway -
Databricks
@databricks
#dataaisummit is where the biggest conversations in data and AI happen.
Hear from the biggest names in AI sharing what theyโre building, deploying, and learning in real time.
Join us in San Francisco or virtually and hear directly from the teams pushing the industry forward. -
Databricks
@databricks
Managed Iceberg, Iceberg v3, and Foreign Iceberg are now GA in Unity Catalog, making Unity Catalog the most comprehensive, interoperable, and production-ready Apache Iceberg catalog.
Whatโs now generally available:
โข Iceberg v3 support with deletion vectors, row tracking, and the VARIANT data type
โข Managed Iceberg tables in Unity Catalog with built-in governance, optimization, and cross-engine access
โข Foreign Iceberg tables that can be discovered, governed, and queried without moving or copying data
โข External sharing to Iceberg REST-compatible clients through the open Delta Sharing protocol
โข & more!
These capabilities bring governed, open, and production-ready Iceberg support together in a single catalog. www.databricks.com/blog/unity-catalog-and-next-era-apacheโฆ -
Databricks
@databricks
.@AnthropicAI's Claude Opus 4.8 is now available where your data already livesโgoverned, secure, and ready for custom AI applications and agents built on your lakehouse data.
In Genie, Opus 4.8 enables deeper multi-step reasoning across structured data and unstructured content in a single response. Teams can build agents that handle complex workflows with fewer iterations and lower cost, all governed through Unity Catalog.
Put Claude Opus 4.8 to work on your most important data securely and at production scale. docs.databricks.com/aws/en/release-notes/product/2026/may -
Databricks reposted
Nikita | Scaling Lakebase Postgres
@nikitabase
How we build in a world where cloud limits are hit daily:
1. HA on both Compute and Storage
2. Hold control plane to same standards as data plane
3. Dependency minimalism
4. Control blast radius
5. Failure simulation
6. Measure everything
7. Build a world-class team with deep operating/scaling experience -
Databricks reposted
Reynold Xin
@rxin
The future of databases is being built directly on top of object stores. We call this the Lakebase architecture.
For a long time, the industry treated data lakes strictly as analytical or offline storage. But the Lakebase architecture is changing that by enabling true operational databases directly on top of the lake.
I believe this is the future of data infrastructure. It is how every database, whether it's an OLTP system or a vector database, should be built moving forward.
Of course, delivering the stringent performance requirements for operational databases on top of object stores require some creative engineering. Really excited to see more real-world examples of this architecture emerging. The team at Zilliz just shared a piece on why they rebuilt their vector database using this exact approach, and it perfectly captures where the industry is heading.
Check it out here: zilliz.com/blog/why-we-built-vector-lakebase -
Databricks
@databricks
Modern analytics can be a lot simpler when your data, governance, and business logic live in one place.
This free one-hour training walks through how to build trusted, AI-powered insights on Databricks using AI/BI Dashboards, Genie spaces, semantic layers, and lakehouse-based analytics workflows.
Take the quiz at the end to earn a Databricks badge for LinkedIn or your rรฉsumรฉ ๐
www.databricks.com/resources/learn/training/analytics-funโฆ -
Databricks
@databricks
๐ Bay Area locals: Itโs not too late to join us at #dataaisummit with a Keynote & Expo Pass.
Get access to live keynotes, hands-on training and certification, interactive demos, networking events, and conversations with 200+ leading data and AI companies!
Donโt miss your chance to be part of the conversation at the largest data + AI event of the year. www.databricks.com/dataaisummit -
Databricks
@databricks
A decade ago, only tech giants had the engineering muscle to get real value out of their data. Databricks was founded to change that. The AI boom accelerated everything.
@hanlintang, Databricks' CTO of Neural Networks: "Companies are already deriving real value from agentic AI. I wouldn't have said that a year ago."
Seven researchers started this at Berkeley. Now we're powering the next chapter. @dhfreedman covers the full story for @Inc: www.inc.com/david-h-freedman/databricks-took-the-lead-racโฆ -
Databricks
@databricks
โค๏ธ @Lovable now integrates with Databricks, providing a natural language interface that allows anyone, regardless of technical skills, to build live applications that can read and write data stored in Databricks.
See how teams can build dashboards, operational tools, internal chatbots, and other custom apps directly on governed Databricks data without ETL, replication, or sync jobs. -
Databricks reposted
Databricks
@databricks
Developers want to build apps, not spend time provisioning infrastructure.
In this video, @andrelandgraf from Databricks and Kevin Niparko from @cursor_ai show how to go from idea to a production-ready app on the Databricks Platform with built-in governance and serverless Postgres.
See how to iterate in real time, manage transactional data, branch fast, and deploy scalable applications where your data already lives ๐
www.databricks.com/resources/webinar/ending-developer-strโฆ -
Databricks
@databricks
Legacy data warehouses were not built for the scale, flexibility, and AI workloads modern teams are trying to support.
This eBook explores how organizations are modernizing on Databricks with:
โข Elastic scalability
โข Lower infrastructure costs
โข Support for real-time analytics, AI, and ML
Learn practical migration strategies using POCs, MVPs, and Databricks-native tools designed to reduce risk and help teams move faster.
www.databricks.com/resources/ebook/migrate-your-legacy-daโฆ -
Databricks reposted
OpenAI Developers
@OpenAIDevs
GPT-5.5 in Codex helps @databricks parse complex customer documents more reliably.
-
Databricks
@databricks
Itโs official: Databricks is recognized as a @FortuneMagazine Best Workplace in the Bay Area for 2026, produced in partnership with @GPTW_US!
In a region defined by technical breakthroughs, this award speaks directly to our mission: solving the toughest problems in data and AI while raising the bar for what a tech workforce can achieve.
See the full list and explore our open roles: www.greatplacetowork.com/best-workplaces/bay-area/2026?caโฆ -
Databricks reposted
Nasdaq Exchange
@NasdaqExchange
Nasdaq congratulates the @CNBC #disruptor50 โ the bold companies shaping what's next.
-
Databricks
@databricks
Developers want to build apps, not spend time provisioning infrastructure.
In this video, @andrelandgraf from Databricks and Kevin Niparko from @cursor_ai show how to go from idea to a production-ready app on the Databricks Platform with built-in governance and serverless Postgres.
See how to iterate in real time, manage transactional data, branch fast, and deploy scalable applications where your data already lives ๐
www.databricks.com/resources/webinar/ending-developer-strโฆ -
Databricks
@databricks
Itโs time to start building your #dataaisummit schedule!
Hear practical lessons from teams at @adidas, @Atlassian, @VirginAtlantic, @Princeton, and more covering AI, governance, interoperability, and production data platforms.
Browse the lineup of real-world data and AI sessions shaping how organizations are building today ๐
www.databricks.com/dataaisummit -
Databricks
@databricks
In one hour, build the foundational knowledge to move beyond basic prompts and apply AI in your organization.
This free training covers:
- Core GenAI concepts and high-value business use cases
- Balancing model quality, speed, and cost
- Building secure, governed applications that prevent hallucinations
- How GenAI powers autonomous AI agents
Pass the quiz and earn a Databricks badge to add to your LinkedIn profile and resume.
www.databricks.com/resources/learn/training/generative-aiโฆ -
Databricks
@databricks
Donโt just write step-by-step Spark code. Build end-to-end data pipelines in Databricks using SQL and declarative pipelines!
This hands-on 2-hour course with @andreaskayy covers:
โข Delta Lake and Unity Catalog fundamentals
โข Bronze โ Silver โ Gold medallion architecture
โข Lakeflow Designer and declarative pipelines
โข Genie and Databricks Assistant workflows
โข Scheduling and streaming with AWS message queues
All through a pipeline that goes from raw ingestion to analytics-ready tables.
www.youtube.com/watch?v=nrfP2_frM5k -
Databricks
@databricks
For decades, operational and analytical databases lived as separate systems because they had to.
This walkthrough explores what happens when Backstage, @Spotifyโs internal developer portal, runs on Databricks Lakebase instead of Postgres, testing how database branching changes the development cycle.
What changed:
โข Production database branches created in about 1 second
โข Point-in-time recovery completed in under 4 seconds
โข Developers testing schema changes against real data instead of mocks
www.databricks.com/blog/backstage-lakebase -
Databricks
@databricks
The Databricks Apps & Agents for Good Hackathon is back at #dataaisummit 2026!
In partnership with @OpenAI, this two-day hackathon brings developers, engineers, and AI builders together to create agentic data applications for social impact using Lakebase, Agent Bricks, and Databricks Apps.
Applications are open for teams of 2โ4 and close on 5/31.
If you're attending Data + AI Summit, apply now to secure your spot โ
events.mlh.com/events/13878-databricks-apps-agents-hackatโฆ -
Databricks
@databricks
๐ง Genie Code brings an autonomous AI partner directly into Lakeflow, helping data engineers build, orchestrate, monitor, and debug pipelines and jobs from a single agent experience.
With natural language, teams can:
โข Generate production-ready pipelines and orchestrate jobs
โข Trace lineage and understand how data flows through pipelines
โข Diagnose failures and review proposed fixes before applying changes
โข Extend existing workflows with Auto Loader, AutoCDC, and medallion architectures while staying aligned with governance and operational standards
www.databricks.com/blog/agentic-data-engineering-genie-coโฆ -
Databricks
@databricks
Data + AI Summit 2026 Session Scheduler is now live!
Ready, set, schedule. Thereโs a lot happening at #dataaisummit, and nowโs your chance to lock in your on-site experience.
Start building your agenda now ๐
www.databricks.com/dataaisummit/agenda -
Databricks
@databricks
Modern analytics needs more than dashboards. It needs a new foundation.
This free one-hour course covers:
โข Delivering trusted, AI-powered insights using unified data, governance, business logic, and the lakehouse
โข AI/BI Dashboards, Genie spaces, semantic layers, and data transformation approaches for modern analytics workflows
โข How to unify analytics workloads on the lakehouse
โข A short quiz to earn a Databricks badge for LinkedIn or your rรฉsumรฉ! ๐ฐ
www.databricks.com/resources/learn/training/analytics-funโฆ -
Databricks
@databricks
"AI doesn't have an intelligence problem. AI has a context problem. The top-of-mind question for every CEO on the planet is: How do we feed it that context? And that context is in the data."
Databricks co-founder and CEO @alighodsi joined @jimcramer on @MadMoneyOnCNBC to discuss how context is the missing piece for enterprise AI agents to reach their potential and how Databricks Genie, built around an ontology graph that maps a company's data, gets them there.
Watch the full segment: www.youtube.com/watch?v=CH7gtn87svI -
Databricks
@databricks
.@SAP Business Data Cloud now automatically syncs semantic metadata and governance tags into Databricks Unity Catalog, making SAP data more understandable, discoverable, and AI-ready from the moment itโs accessed.
Highlights:
โข Automatic sync of descriptions and primary/foreign key relationships into Unity Catalog
โข PersonalData governance tags for fine-grained access controls with ABAC
โข Business context available to AI applications without manual enrichment or tagging
www.databricks.com/blog/unlocking-sap-business-context-daโฆ -
Databricks
@databricks
A new way to experience #dataaisummit.
The Keynote + Expo Pass gives you exclusive access to keynotes, the expo hall, select networking events, and more!
Secure your pass now ๐๏ธ: www.databricks.com/dataaisummit/pricing -
Databricks
@databricks
Leading organizations are reducing sync overhead and pipeline sprawl by running apps, agents, and analytics on the same governed foundation with Databricks Lakebase.
โข @Superhuman replaced custom pipelines syncing Databricks data into Redis and DynamoDB, cutting feature onboarding from three months to two weeks
โข @Replit uses Lakebase and the Databricks AI DevKit to help customers launch production code-generation AI in 3 weeks
โข @yipitdata scaled its AI agent pipeline to process 1M records per hour using Lakebase as its relational system of record inside Unity Catalog
Explore how more teams are reducing the builderโs tax with Lakebase:
www.databricks.com/blog/how-leading-tech-companies-are-kiโฆ -
Databricks
@databricks
Unity AI Gateway is expanding runtime AI governance with new Beta capabilities for AI agents and MCPs.
New in Beta
โข LLM guardrails to enforce customizable safety and compliance policies
โข Payload logging and service policies for MCPs to improve observability and control agent actions
โข Cost controls with per-user alerts and budget limits across models and providers
Organizations can now govern every model call and agent action with consistent policies, full observability, and enforceable cost controls in one unified layer.
Learn more: www.databricks.com/blog/whats-new-unity-ai-gateway-servicโฆ -
Databricks reposted
Databricks AI Research
@DbrxMosaicAI
New research from Databricks: the context window is the only persistent substrate today's LLM agents have, and it floods fast. A single SQL query can return millions of rows that ride along in every subsequent turn, even when only one cell ever mattered. We hit this constraint every day in the agents we run in production, from Genie to Agent Bricks' Supervisor Agent to KARL.
In a new post from the Databricks research team, we introduce MemEx: a programmable Python scratchpad that lets agents transform, slice, and persist tool outputs as typed objects in a live kernel. Same observe-act loop. Different action space.
Across nine frontier and open-weight models on two enterprise agentic tasks (OfficeQA Pro and Enterprise Structured Retrieval):
โข Frontier models (Opus 4.6, Sonnet 4.6, Gemini 3.1 Pro) gain 2 to 5 accuracy points at 25 to 30% lower cost
โข Qwen 122B and Qwen 397B nearly double accuracy at 40 to 50% lower cost
โข Four of the five points on the OfficeQA Pro cost-accuracy Pareto frontier are MemEx configurations
MemEx extends the code-as-action line (CodeAct, Anthropic Programmatic Tool Calling, Cloudflare Code Mode) with persistent scope across turns, eager spawn_agent for parallel sub-agents that share the parent's namespace, typed submit() for validated returns, and live-object scope injection. Built on aroll, the same Databricks agentic rollouts framework already powering those production systems.
MemEx is rolling out across Databricks first-party agents and Agent Bricks soon. If you build on Databricks agents today, you'll be able to try it.
Full write-up: www.databricks.com/blog/memex-programmable-scratchpad-llmโฆ -
Databricks
@databricks
Google's Gemini 3.5 Flash is now available on Databricks!
@Google just released Gemini 3.5 Flash, and Databricks is among the first outside the Gemini Enterprise Agent Platform to offer it. Build and scale agentic AI applications on your enterprise data with the governance and operational tooling your teams need for production.
Congrats to the Google Gemini team on this release. We can't wait to see what you build with it! docs.databricks.com/aws/en/release-notes/product/2026/may -
Databricks
@databricks
Databricks is honored to be named to @CNBC's 2026 #disruptor50, recognizing the most innovative private companies shaping the future of technology.
We're proud to help more than 20,000 organizations build and ship real-world AI, apps and agents โ with Lakebase, Agent Bricks, Genie, and more driving better outcomes.
See the full list: www.cnbc.com/2026/05/19/databricks-cnbc-disruptor-50-rankโฆ -
Databricks
@databricks
At #dataaisummit, Industry Forums bring together leaders and practitioners to discuss the challenges and opportunities shaping their industries today.
Explore sessions across Marketing, Cybersecurity, Financial Services, and more.
๐๏ธ June 15-18: www.databricks.com/dataaisummit/industry/financial-servicโฆ -
Databricks
@databricks
The next generation of Databricks Genie can answer questions beyond the boundaries of a Genie Space, bringing together trusted business logic, dashboards, apps, and enterprise knowledge sources in a single experience.
Also included:
โข Built-in connectors for sources like Google Drive and SharePoint
โข Unified Genie chat across Genie Spaces, dashboards, and apps
โข Native Genie mobile apps for iOS and Android
โข The experience previously known as Databricks One is now part of Genie
The experience is designed to give business users one place to access data and AI across the enterprise.
www.databricks.com/blog/next-generation-databricks-genie -
Databricks
@databricks
Moving data and AI apps from prototype to production should not take months of custom infrastructure work.
This hands-on guide explores how to build โ deploy โ and operate production-ready apps on Databricks using transactional data layers, built-in governance, and repeatable deployment patterns.
Practical examples and code snippets included throughout ๐ www.databricks.com/resources/ebook/hands-guide-apps-databโฆ -
Databricks
@databricks
Introducing Databricks Student Fellows, a new program for students passionate about data, AI, and computer science!
Fellows get hands-on experience with the Databricks platform, opportunities to earn certifications, and the chance to build real-world projects that reflect how companies solve data and AI challenges at scale.
Theyโll also lead hackathons, tech talks, and campus communities while opening pathways to internships and careers across the Databricks ecosystem.
Applications for the first cohort are now open: www.databricks.com/blog/announcing-databricks-student-felโฆ -
Databricks reposted
Julia Neagu
@juliaaneagu
I'm building a new team at @databricks AI Research and we're hiring.
We're focused on one of the hardest open problems in AI right now: how do you measure and continuously improve agents that operate on enterprise data at scale. We're looking for founding engineers to build the flywheel that turns evaluation results directly into better agents โ from development and training all the way to production.
If you want to work on problems that actually matter at the frontier of AI research, I'd love to talk.
Link in comments ๐ -
Databricks
@databricks
Data + AI Summit 2026 is one month away!
Join us in person or virtually for hands-on training, certification opportunities, and a front row seat to the latest innovations across data and AI.
Register: www.databricks.com/dataaisummit -
Databricks
@databricks
[DEMO] Databricks Lakebase brings fully managed, serverless Postgres to the Databricks platform to power data apps and AI agents, fully integrated with the lakehouse.
What youโll learn:
- How Lakebase fills the gap between traditional OLAP and OLTP systems
- The benefits of a serverless Postgres architecture
- How to use Lakebase for data apps, internal tools, and AI agents
youtu.be/UQynsu6qklwThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Lakeflow Designer is a visual, no-code, AI-native way to prepare and analyze data directly on Databricks.
Data stays in place, governed by Unity Catalog from the start, with lineage and permissions intact. Every transformation generates production-ready Python code under the hood.
Breaking transformations into visual operators with previews at every step makes AI-generated data work easier to understand, review, and trust.
Get started: www.databricks.com/blog/announcing-public-preview-lakefloโฆ -
Databricks
@databricks
Databricks is proud to be a Founding Gold Sponsor of @TheOfficialACM Conference on AI and Agentic Systemsโthe first ACM conference dedicated to compound AI and agentic systems, with our co-founder @matei_zaharia on the organizing committee.
Join us May 26โ29 in San Jose for the premier event for rigorous, reproducible research in compound AI architectures, optimization, and deployment.
Register today: www.caisconf.org -
Databricks
@databricks
At @saastr, Databricks Co-Founder Arsalan Tavakoli joined @jasonlk to talk about how AI can support the โother 95%โ of the workforce making day-to-day business decisions.
HR leaders, retail managers, and financial advisors need fast answers but often do not work directly in BI tools or have time to wait on analyst support.
Genie gives teams a natural language interface to ask questions and get governed answers from their data. -
Databricks reposted
#DataAISummit
@Data_AI_Summit
#dataaisummit is only possible because of our partners driving real progress in data and AI.
Weโre grateful for all of our 2026 Advocate sponsors!
Join us June 15โ18 to connect with them in person: dataaisummit.databricks.com/flow/db/dais2026/sponsors/pagโฆ -
Databricks
@databricks
Canโt make it to Data + AI Summit in person? Tune in from anywhere!
Join the Data + AI Summit Virtual Experience for live-streamed keynotes, major announcements, and sessions from across the global data and AI community.
Whatโs included:
โข Live access to keynotes and top sessions
โข On-demand viewing after the event
โข Exclusive online training
โข Summit Live: expert commentary, special guests, and behind-the-scenes insights
Register:
www.databricks.com/dataaisummit/virtual-experience -
Databricks
@databricks
ABAC policies, governed tags, and automated data classification are now generally available in Unity Catalog.
Governance teams define access rules and they apply automatically across the entire data estate. Sensitive data is discovered, tagged, and protected as it's created, with no manual configuration per table.
Together, they deliver consistent, scalable protection with less operational overhead and stronger compliance posture as data grows. www.databricks.com/blog/abac-row-filtering-and-column-masโฆ -
Databricks
@databricks
Today, Catalog Commits is now Generally Available for Unity Catalog managed Delta tables.
Historically, Delta and Unity Catalog operated side-by-side โ Delta managing transactional state at the storage layer, and Unity Catalog governing access at the catalog layer. As organizations scaled across more engines and workloads, this design led to new coordination challenges.
Now, Delta and Unity Catalog are co-evolving to address these challenges and deliver more interoperable, governed, and performant lakehouses.
This massive platform upgrade unlocks:
โข Expanded interoperability: External engines to write directly to UC managed Delta tables
โข Stronger governance: Consistent governance and auditing across engines
โข New features: Multi-table and multi-statement ACID transactions
www.databricks.com/blog/convergence-open-table-formats-anโฆ -
Databricks
@databricks
.@gdb, President and Co-Founder of @OpenAI, will take the keynote stage with Databricks CEO @alighodsi to discuss the state of AI, whatโs next for agentic systems, and the OpenAI x Databricks partnership.
Attend Data + AI Summit in San Francisco to see it live: -
Databricks reposted
#DataAISummit
@Data_AI_Summit
Canโt make it to Data + AI Summit in person? Tune in from anywhere!
Join the Data + AI Summit Virtual Experience for live-streamed keynotes, major announcements, and sessions from across the global data and AI community.
Whatโs included:
โข Live access to keynotes and top sessions
โข On-demand viewing after the event
โข Exclusive online training
โข Summit Live: expert commentary, special guests, and behind-the-scenes insights
Register:
www.databricks.com/dataaisummit/virtual-experience -
Databricks reposted
Matei Zaharia
@matei_zaharia
Cool work from the Databricks Model Serving team and Superhuman, to scale their custom LLM serving to 200K QPS with sub-second P99 latency! Here's how our teams got a +60% throughput gain vs the previous engine to serve over 40 million daily users. sprou.tt/1U9Jjq9glQl
-
Databricks
@databricks
The gap between insight and action is where most BI strategies fall apart.
Genie and Lakebase connect governed data with real business context, giving teams the ability to move from answers to decisions quickly. Shared definitions, strong governance, and systems built for scale are what make it trustworthy.
Companies operationalizing this today are making faster decisions and finding opportunities their competitors are still building spreadsheets to find.
@arikaplan1 breaks down what it really takes to turn data into action: www.databricks.com/blog/how-conversational-analytics-remoโฆ -
Databricks
@databricks
Spreadsheets are still how most business teams plan, analyze, and report. Getting trusted data into them has meant CSV exports, manual workarounds, and duplicated metrics.
The Databricks Excel Add-in and Databricks Connector for Google Sheets change that. Both bring governed lakehouse data directly into the tools teams already use, built on Databricks SQL and Unity Catalog.
Explore both:
โข Excel: www.databricks.com/blog/introducing-databricks-excel-add-โฆ
โข Google Sheets: www.databricks.com/blog/introducing-databricks-connector-โฆ -
Databricks
@databricks
Genie Code is your autonomous AI partner for data work.
โ๏ธ Builds pipelines
โ๏ธ Debugs issues
โ๏ธ Maintains production systems
All while proactively monitoring pipelines and models in the background.
Through Unity Catalog and Lakehouse Federation, Genie Code understands your enterpriseโs data context and governance.
Learn more. www.databricks.com/blog/introducing-genie-code?provider=DB -
Databricks
@databricks
Can't make it to #dataaisummit 2026 in person?
The Virtual Experience runs June 16โ17 with keynotes, curated sessions, and Summit Live, featuring expert commentary and special guests.
Be part of the conversations shaping the future of enterprise AI from anywhere. -
Databricks reposted
#DataAISummit
@Data_AI_Summit
#dataaisummit includes instructor-led, half-day trainings designed to build job-ready skills across data engineering, agents and AI, governance, app development, and more.
Sessions cover the latest technology including Lakebase, Genie, and Agent Bricks, with hands-on experience you can apply immediately.
Validate your expertise with onsite certifications and leave with credentials that demonstrate impact.
Register: www.databricks.com/dataaisummit -
Databricks
@databricks
Agentic applications make better decisions when they can access real-time external intelligence alongside internal data.
The Databricks MCP Marketplace connects agentic applications to live external intelligence inside the Lakehouse. Three examples of what's available:
- @youdotcom for real-time market context and sentiment
- @Moodys for credit research and entity intelligence
- @Cotality for real estate and mortgage expertise
Lakebase keeps agents stateful across multi-step workflows. Genie surfaces decisions in natural language for human review and approval.
Build smarter agents: www.databricks.com/blog/mcp-marketplace-brings-real-time-โฆ -
Databricks
@databricks
[DEMO] What does it look like when thousands of IoT events stream in from mobile phones all over the world and land in a queryable table in milliseconds? No Kafka cluster, no Kinesis, no pipeline duct tape.
We built it and ran it live:
- Zerobus handles ingestion
- Lakebase serves the traces with millisecond latency
- Genie queries the data on the spot
- The whole thing runs as a Databricks App
youtu.be/KK67YgDn9eA -
Databricks reposted
Matei Zaharia
@matei_zaharia
Genie has transformed how Databricks users work with data, with 3x the accuracy of generic agents. We're sharing some of the research behind it and what makes building data agents challenging. Super proud of our research team's impact with this! www.databricks.com/blog/pushing-frontier-data-agents-genie
-
Databricks reposted
Nikita | Scaling Lakebase Postgres
@nikitabase
There are some amazing performance database kernel folks at @databricks on the @neondatabase team
www.databricks.com/blog/how-lakebase-architecture-deliverโฆ -
Databricks
@databricks
Databricks co-founder and CEO @alighodsi on why AI killed the SIEM and the need for an open security lakehouse.
โCyberattacks have transitioned from manual operations to autonomous agents that can exploit vulnerabilities in hours.โ
โTraditional security architecture leaves gaps and unreviewed data. What enterprises need are AI agents to automate detection, triage, and investigation.
Watch the keynote from #rsac2026:
www.databricks.com/resources/webinar/its-time-leave-legacโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
[DEMO] Bring Genie to where your teams already work.
Genie can now connect directly with Microsoft Teams, M365 Copilot, and SharePoint through a native integration with Copilot Studio. Users can ask questions of their data in natural language and get insights without leaving their workflow.
Learn how to connect Databricks โ add Genie to an agent โ and publish it so teams can access answers in the tools they already use. youtu.be/2zLzCptIr9A -
Databricks
@databricks
.@MercedesBenz is rethinking how data powers the shift to electric and connected vehicles.
By moving from siloed systems to a cross-cloud data sharing model, they cut egress costs by 66%, improved data freshness, and made critical after-sales insights more accessible across teams.
Warranty cases that once waited seven days for fresh data now get updates every two days, building a stronger foundation for the "data-defined vehicle." www.databricks.com/blog/mercedes-benz-builds-cross-cloud-โฆ -
Databricks reposted
Josue Bogran
@joshbogran
So very excited to share this demo + presentation with the one and only, Scott Haines, Staff Developer Advocate @databricks. The topic? Zerobus, which is a great option for easily ingesting event data at scale into Unity Catalog.
We do a demo and overview of the technology, talk about how it is similar & different to Kafka, when to use Real-Time Mode vs Zerobus, and much more!
Hope you enjoy this very technical overview!
Link: www.youtube.com/watch?v=UNxJor_w8yE -
Databricks
@databricks
If you're building BI at scale, the Analytics & BI track at #dataaisummit 2026 has sessions worth adding to your schedule. Leaders @Atlassian, @HP, @VirginAtlantic and more will cover the work that is moving their organizations forward:
โ Scaling AI-powered BI from pilot to production
โ Modernizing semantic layers with AI
โ Building trusted generative BI
Join us this June to learn how to turn data into impact: www.databricks.com/dataaisummit -
Databricks
@databricks
Most "agentic AI" is still demoware.
Data work and coding are clear exceptions.
We believe Genie Code will be the standard for agentic data engineering work.
Weโve spent 4+ years building the ideal harness for Genie Code with Spark Declarative Pipelines - so you can build, run, and remediate pipelines in natural language, with the confidence that it's backed by proven patterns and best practices. www.databricks.com/blog/agentic-data-engineering-genie-coโฆ -
Databricks reposted
#DataAISummit
@Data_AI_Summit
If you're building BI at scale, the Analytics & BI track at #dataaisummit 2026 has sessions worth adding to your schedule. Leaders @Atlassian, @HP, @VirginAtlantic and more will cover the work that is moving their organizations forward:
โ Scaling AI-powered BI from pilot to production
โ Modernizing semantic layers with AI
โ Building trusted generative BI
Join us this June to learn how to turn data into impact: www.databricks.com/dataaisummit -
Databricks
@databricks
Encryption at rest is a baseline. Enterprises operating in highly regulated environments must control the root of trust.
Lakebase Customer-Managed Keys offers comprehensive management and control across the entire architecture. And unlike traditional databases, Lakebase CMK manages both persistent storage and ephemeral compute.
Rotate keys with zero downtime. Revoke access as a cryptographic kill switch. Audit key operations inside your own cloud KMS.
Learn how to get started:
www.databricks.com/blog/take-control-customer-managed-keyโฆ -
Databricks
@databricks
Unity Catalog and Google BigQuery now support bidirectional catalog federation, giving customers access to the same copy of data from either platform without duplication or data movement.
Unified governance applies consistently across both, deepening the interoperability between Databricks and @googlecloud โ www.databricks.com/blog/interoperability-between-unity-caโฆ -
Databricks
@databricks
Genie Agent Mode expands the class of questions you can ask of your data. Rather than returning a single query result, it works like a data analyst, planning an approach, testing hypotheses, and iterating toward a well-supported explanation.
Ask things like:
- Why did our churn rate spike in Q3?
- How can we optimize our campaign spend?
- What revenue impact should I anticipate if these two supply lines are interrupted?
Anyone in your organization can now get real answers to their most complex business questions.
www.databricks.com/blog/introducing-genie-agent-mode -
Databricks reposted
#DataAISummit
@Data_AI_Summit
At #dataaisummit, weโll be previewing whatโs next in enterprise AI.
Get a first look at the innovations shaping how teams build, deploy, and scale with data + AI. Plus keynotes, live demos, and sessions from the people pushing it all forward: www.databricks.com/dataaisummit -
Databricks
@databricks
Build the foundational knowledge needed to move beyond basic prompts and apply AI in your organization. The course covers:
- Core GenAI concepts and high-value business use cases
- Balancing model quality, speed, and cost
- Building secure, governed applications that prevent hallucinations
- How generative AI powers autonomous AI agents
Earn a Databricks badge to add to your LinkedIn profile and resume!
www.databricks.com/resources/learn/training/generative-aiโฆ -
Databricks
@databricks
.@MakeMyTrip reduced personalization latency from about 1.23 seconds to 44 ms P50 by adopting Real-Time Mode in Apache Spark Structured Streaming, achieving millisecond performance without adding a second engine.
Processing traveler searches as continuous streams delivered:
- Sub-50 ms P50 latency
- 7 percent lift in click-through rates
- A single Spark pipeline for batch and real-time workloads, reducing duplicated logic and operational overhead
www.databricks.com/blog/how-makemytrip-achieved-millisecoโฆ -
Databricks
@databricks
You want to build, not spend hours setting up infrastructure.
In this webinar, discover how to go from an idea to a production-ready app faster using modern frameworks, real-time iteration, and serverless Postgres.
Join experts from Databricks and @cursor_ai on May 5 (AMER), May 6 (EMEA), or May 7 (APAC) to see how apps can be built and scaled where your data already lives: www.databricks.com/resources/webinar/ending-developer-strโฆ -
Databricks
@databricks
Databricks ranked #2 on the 2026 Enterprise Tech 30 in the Giga Stageโa recognition of the companies redefining enterprise technology and how the world works.
Chosen by 90+ top VCs and industry leaders, this honor reflects the momentum weโre driving behind data + AI innovation and the teams building whatโs next.
Grateful to @Wing_VC and @EricNewcomer for the recognition! www.wing.vc/et30/list -
Databricks
@databricks
How do you move from data prep to insight without relying on traditional BI tools?
In this session, @rgb_prithvi, @Alex_TheAnalyst, and Databricks experts walk through how agentic analytics supports the full workflow on a unified data platform, and how teams build end-to-end analytics without BI licenses.
www.databricks.com/resources/webinar/its-time-leave-legacโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
.@Lovable now integrates with Databricks, enabling teams to build apps on governed data using natural language!
Business users can create dashboards, operational tools, and internal chatbots in hours, with apps that read and write data directly in Databricks. Data remains in Databricks and is queried at runtime, so there is no need for ETL, replication, or sync jobs.
Explore the latest:
www.databricks.com/blog/lovable-databricks-build-data-driโฆ -
Databricks
@databricks
Early-bird pricing for Data + AI Summit ends tomorrow, April 30!
Don't miss your chance to join leaders shaping the future of data and AI with access to keynotes, 800+ breakout sessions, and hands-on training and certification.
Register now to lock in 50% savings. -
Databricks
@databricks
At #rsac2026, Databricks co-founder and CEO @alighodsi showed how agents can take on security workflows that are manual today and often require hundreds of people.
With data in an open security lakehouse, agents can normalize and organize data, monitor and fix pipelines, write detections, enrich signals, and handle triage, investigation, and response across the lifecycle.
Watch the full keynote:
www.databricks.com/resources/webinar/its-time-leave-legacโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Big news: @stripe payments data is now available on Databricks Marketplace.
Activate the Stripe Data Pipeline in minutes, then query live payment data in Databricks to power models, agents and Genie workspaces
โข Deploy an agent that monitors transactions continuously
โข Combine transaction history with behavioral signals to score customers
โข Ask questions like "Show me MRR by geography" and get instant answers
No heavy ETL. Just governed, real-time access to the data that drives your business, and a feedback loop between payments and decision-making. www.databricks.com/blog/stripe-data-now-available-databriโฆ -
Databricks reposted
#DataAISummit
@Data_AI_Summit
#dataaisummit is powered by an amazing ecosystem of partners pushing the industry forward.
Shoutout to all of our 2026 Icon sponsors, weโre excited to showcase what weโre building together!
Join us at #dataaisummit and connect with them in person: dataaisummit.databricks.com/flow/db/dais2026/sponsors/pagโฆ -
Databricks
@databricks
[DEMO] Genie Code is your autonomous AI partner for data work.
Starting from a single prompt, watch as it explores datasets, trains and evaluates models, builds a Lakeflow Spark Declarative Pipeline, and creates an AI/BI dashboard โ all while maintaining enterprise context. -
Databricks reposted
Ali Ghodsi
@alighodsi
๐๐๐ง๐ข๐ is now the most important way to do data analysis in Databricks. What's unique about it is its ability to extract semantics from your entire Lakehouse, enabling it to answer complex data questions that cripple agents without a deep data understanding. We've now added a Mobile version, added Unstructured data processing, as well as enabled it to operate on all your dashboards and notebooks. Check it out:
www.databricks.com/blog/next-generation-databricks-genie -
Databricks
@databricks
Databricks has been named one of TIME's 10 Most Influential Software Companies of 2026.
The recognition reflects where intelligent analytics and enterprise AI are heading: any employee can query their data in natural language, no programming required.
This innovation takes a certain kind of conviction to build. As our CEO Ali Ghodsi puts it: "To win the market, you have to have a non-consensus opinion, and you have to be right."
Our next big bet: databases built for the AI era. time.com/article/2026/04/27/time100-companies-software/ -
Databricks
@databricks
Level up your data + AI skills at #dataaisummit!
Explore 800+ sessions across topics like AI agents, Lakebase, democratizing BI, app development, and more. You can also take onsite certification exams at 50% off to validate your expertise.
Spots are limited. Secure your training and get certified onsite.
www.databricks.com/dataaisummit -
Databricks
@databricks
Database branching in Databricks Lakebase uses copy-on-write storage to create fully isolated environments in seconds without duplicating data.
Most teams rely on shared staging databases or slow pg_dump copies that drift from production and make testing unreliable. Lakebase branches give every developer, pull request, and CI test run its own isolated environment, with instant point-in-time recovery and programmable ephemeral databases for AI agents through the same API.
www.databricks.com/blog/database-branching-postgres-git-sโฆ -
Databricks
@databricks
Data engineering is getting more complex, but it doesn't have to slow you down.
The Big Book of Data Engineering is a practical guide packed with how-tos, code snippets, and real-world examples to help you build and scale pipelines faster and deliver high-quality data for AI, BI, and analytics workloads.
Inside:
- Patterns for scaling ETL pipelines effectively
- Orchestrating data, analytics, and AI workloads
- Implementing observability for your data pipelines
- Using Lakeflow to manage pipelines
www.databricks.com/resources/ebook/big-book-of-data-enginโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
GPT 5.5 and Codex are now available and manageable on Databricks! Both support Unity AI Gateway so you can manage access and costs, add guardrails, secure access to MCPs centrally, and audit usage. www.databricks.com/blog/openai-gpt-55-now-available-databโฆ
-
Databricks
@databricks
With Lakebase, you can spin up an autoscaling OLTP database, connect to it, and start writing data in seconds.
@MrSiWhiteley shows how quickly you can create a database, add data, and start using it โ making it a strong fit for applications and agentic workflows that need fast, transactional state.
www.youtube.com/watch?v=-E_8JDRheIU -
Databricks
@databricks
.@OpenAI GPT-5.5 is now available on Databricks, with Codex coding workflows and model inference fully governed through Unity AI Gateway.
With GPT-5.5 on Databricks, you can:
- Power coding workflows with Codex or other coding agents
- Build custom agents grounded in enterprise data
- Ask business questions in natural language from enterprise data with Genie
- Automate document intelligence pipelines with Lakeflow Spark Declarative Pipelines
Hear more from our co-founder, @pwendell, and OpenAI CRO @dhdresser about how Databricks and OpenAI are bringing frontier AI to the enterprise.
Get started today: www.databricks.com/blog/openai-gpt-55-now-available-databโฆThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Christina Farhat
@farhatchristina
bring your CEO to school day
Apoorv Agrawal
@apoorv03
Thanks @alighodsi for joining MS&E435 yesterday - most # of โahaโ level insights in a single hour ever!
Unfiltered opinions on why software ainโt dead, open source is closing the gap, distillation is inevitable, AGI is already here, and all value will accrue in the application layer.
Always learn a ton from Ali. Full vid soon -
Databricks
@databricks
Lakeflow Designer is now in Public Preview, giving Databricks users a visual, no-code, AI-native way to prepare and analyze data without leaving the platform.
A few things that set it apart:
- Built natively on Databricks and governed by Unity Catalog, so data stays in place from day one
- AI-generated transformations break into discrete visual operators with step-by-step data previews, making it easier to review and trust the output
- No per-user licensing, you only pay for compute
Available now in Public Preview across all workspaces.
www.databricks.com/blog/announcing-public-preview-lakefloโฆ -
Databricks reposted
#DataAISummit
@Data_AI_Summit
โAll we knowโ is that The Chainsmokers are headlining Data After Hours at #dataaisummit 2026!
Register to secure your spot. You wonโt want to miss this. www.databricks.com/dataaisummit/onsite-experience -
Databricks
@databricks
Databricks is excited to partner with @OpenAI on GPT-5.5, their latest frontier model. GPT-5.5 will be available in Unity AI Gateway on launch. You can use it with coding tools such as Codex, or to power your enterprise agents.
GPT-5.5 is state-of-the-art on many benchmarks including OfficeQA Pro, our benchmark for evaluating grounded reasoning on enterprise tasks.
We are partnering with OpenAI to co-launch on Databricks. Hear more from our co-founder @pwendell and OpenAI CRO @dhdresser on GPT-5.5 in Databricks. www.databricks.com/blog/databricks-partners-openai-gpt-55 -
Databricks reposted
Ali Ghodsi
@alighodsi
What will the future of Spark and data engineering look like? How can you radically simplify it with AI? How do you ensure that the AI doesn't screw things up? How do you productionize all this so you can track reliability over time? This is exactly the problem that ๐๐๐ค๐๐๐ฅ๐จ๐ฐ ๐๐๐ฌ๐ข๐ ๐ง๐๐ซ solves, this is the future for data engineering! This is now available for all our customers (public preview)!
You tell the AI what transformations you want your data pipeline! (e.g. "join product data with the pricing table"). It shows you a GRAPH of the transformations which you can verify and approve yourself. Everything is behind the scenes represented by CODE which can be version controlled, productionized, in CI/CD. If you want to, you can review the code as well. Behind the scenes, the pipeline code is just open source ๐๐ฉ๐๐๐ก๐ ๐๐ฉ๐๐ซ๐ค ๐๐๐๐ฅ๐๐ซ๐๐ญ๐ข๐ฏ๐ ๐๐ข๐ฉ๐๐ฅ๐ข๐ง๐๐ฌ (๐๐๐)! Check it out.
www.databricks.com/blog/announcing-public-preview-lakefloโฆ -
Databricks
@databricks
Databricks is a @Gartner_inc Peer Insights Customers' Choice for Analytics and Business Intelligence Platforms.
Modern BI should do more than display dashboards. Databricks AI/BI and Genie give teams trusted data, interactive dashboards, and the ability to use natural language to accelerate analysis across the business.
94% of verified peers say they would recommend Databricks AI/BI and Genie, with a 4.8/5.0 overall rating.
Read the full Gartner Voice of the Customer report to see what customers are saying. www.databricks.com/blog/databricks-recognized-gartnerr-peโฆ -
Databricks reposted
Wiz
@wiz_io
Big move: Wiz brings @databricks into the security graph
We've extended the Wiz Security Graph to include Databricks - so you can finally see how your data, identities, and cloud actually connect.
๐ Full details in the blog: www.wiz.io/blog/wiz-databricks-security-graph -
Databricks
@databricks
Databricks Training and Certification is back at #dataaisummit with a completely revamped course catalog covering AI agents, vibe coding, app development, Lakebase, and more.
New this year, training kicks off with two dedicated learning days before the main conference kicks off. Over 20 hands-on courses, onsite certification exams at 50% off, and attendees who pass earn a customized Databricks Certified jacket and access to the exclusive Certified Lounge.
This is the most substantial training lineup we have brought to Summit yet!
Register by April 30 to save 50% on training. www.databricks.com/blog/get-hands-on-agents-vibe-coding-aโฆ -
Databricks reposted
#DataAISummit
@Data_AI_Summit
Level up your data + AI skills at #dataaisummit!
Explore 800+ sessions across topics like AI agents, Lakebase, democratizing BI, app development, and more. You can also take onsite certification exams at 50% off to validate your expertise. www.databricks.com/dataaisummit -
Databricks
@databricks
At #rsac2026, Databricks co-founder and CEO @alighodsi described a shift in how attacks are happening.
AI agents now move in swarms, scan massive amounts of data, write code quickly, and only need a single success to compromise an organization. At the same time, teams are working with incomplete data, discarding signals, and trying to keep up inside overloaded SOC environments and siloed systems.
His view is that this dynamic changes the role of traditional approaches, and that AI will replace SIEM this year. www.databricks.com/resources/webinar/its-time-leave-legacโฆ -
Databricks
@databricks
80% of enterprise knowledge remains functionally invisible, trapped in PDFs, scanned images, and office documents. That has made intelligent document processing one of the most fragmented problems in data engineering for years.
Databricks Document Intelligence and Lakeflow now give teams a governed, end-to-end way to ingest, parse, and extract structured insights from unstructured documents, all inside Databricks, without the fragile OCR vendors and custom connectors.
See how it works step-by-step: www.databricks.com/blog/building-databricks-document-inteโฆ -
Databricks
@databricks
Agentic and AI Coding Night returns on Thursday, May 7 in San Francisco. This one is engineered for backend and infra engineers, AI engineers, and founders moving beyond basic wrappers and into complex agentic workflows, repository-level reasoning, and high-scale execution.
Speakers from Databricks, @AnthropicAI, @OpenAI, @datafoldcom, and more will cover:
- The core tension and balancing productivity vs. accountability for coding agents
- How to balance individual developer productivity gains vs. enterprise-wide operational risk
- Fireside chat with @rohanvarma from OpenAI on coding and agents
Doors open at 3:30pm. Come build with us! luma.com/agenticaiobsnightsf-5-7 -
Databricks
@databricks
Unity Catalog Business Semantics brings a shared way to define metrics, dimensions, and rules at the data layer.
Instead of definitions living inside BI tools, teams and AI agents can work from the same governed logic across dashboards, queries, and notebooks.
Metric Views provide consistent KPIs with lineage, permissions, and performance optimizations. The core implementation is being open sourced in Apache Spark to support portability across systems.
Unity Catalog Business Semantics is now GA: www.databricks.com/blog/redefining-semantics-data-layer-fโฆ -
Databricks
@databricks
Databricks Unity AI Gateway now lets teams connect agents to external MCP servers like GitHub, Glean, and Atlassian through managed OAuth, with all governance running through Unity Catalog.
Auth has been the consistent bottleneck for enterprise agent deployments, and Unity AI Gateway removes it entirely:
โข Register and control external MCP servers through Unity Catalog with fine-grained permissions and a full audit trail
โข Agents act on behalf of individual users, not overprivileged service accounts, so access stays scoped and traceable
โข Databricks handles the full OAuth lifecycle server-side, across AWS, Azure, and GCP
Hereโs how it works: www.databricks.com/blog/ai-gateway-how-connect-agents-extโฆ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
In this week's video we are building a Full End-to-End ETL Pipeline in @databricks!
This project pulls together everything we've been learning in the past few weeks - data ingestion, building ETL pipelines, and job orchestration.
www.youtube.com/watch?v=SSz7HiyQN1M -
Databricks reposted
#DataAISummit
@Data_AI_Summit
The DevConnect Meetup at #dataaisummit is an evening for devs, startups and experts exploring agentic systems to connect and gain practical insights!
Join us on the first night of Summit for the DevConnect keynote, breakout sessions, and reception: www.databricks.com/dataaisummit -
Databricks
@databricks
Databricks is heading to @AICouncilConf in San Francisco, May 12-14, with three sessions covering some of the most pressing questions in data and AI infrastructure right now.
- @nikitabase keynoting on what data infrastructure actually needs to look like in the AI era
- @kelvich on why AI agents need a new kind of OLTP and how Lakebase is built for it
- Robert Martin-Short leading a workshop on systematic LLM prompt optimization with DSPy
Find us in the Expo Hall if you're there! -
Databricks
@databricks
Lakeflow Connect now includes a Free Tier, featuring:
- 30+ Built-in Connectors: Seamlessly ingest data from SaaS apps and databases
- 100 Free DBUs Daily: Every workspace can ingest up to ~100M records/day at no cost
- Unified Governance: Full lineage and security via Unity Catalog
Give your AI agents the full enterprise context they deserve without the cost.
Get started today: www.databricks.com/blog/accelerate-business-insights-lakeโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
Just got this internal email on Genie Code progress! For the first time, we have MORE code written by Genie Code than by humans on the platform.
-
Databricks
@databricks
If you're new to data engineering on Databricks, this is a good place to start ๐
@Alex_TheAnalyst walks through two ways to easily ingest data into Databricks and the components of modern data workflows.
This video kicks off a data engineering series focused on data ingestion, transformation and more. www.youtube.com/watch?v=hEv5y_s0L3c -
Databricks
@databricks
Developers shouldnโt have to spin up infrastructure just to start building.
In this webinar, engineers from Databricks and @cursor_ai walk through how to build and deploy a production-ready app without managing infrastructure. Youโll see how to work with serverless Postgres, push updates in real time, and handle governance and access without custom pipelines.
Join us on May 5.
www.databricks.com/resources/webinar/ending-developer-strโฆ -
Databricks
@databricks
The era of production-ready coding agents is here, but so is the risk of coding agent sprawl.
Today, weโre introducing Coding Agent Support in Unity AI Gateway to bring these tools under a unified governance layer:
- Centralized Governance across coding agents, LLM interactions and MCP integrations
- Simplified cost management with ability to control rate limits and budgets for every single coding tool.
- Unified observability for AI Coding Tools that gives real-time insights into code metrics and costs
www.databricks.com/blog/governing-coding-agent-sprawl-uniโฆ -
Databricks reposted
#DataAISummit
@Data_AI_Summit
Weโre getting โcloserโ to #dataaisummit 2026โฆ are you ready?
Register today, and stay tuned to see whoโs headlining Data After Hours this year. www.databricks.com/dataaisummit -
Databricks
@databricks
Genie Agent Mode changes the class of questions you can bring to your data.
Instead of returning a single query result, it investigates like a data analyst, planning an approach, testing hypotheses, and iterating toward an explanation. Ask questions like:
- Why did our churn rate spike in Q3?
- How can we optimize our campaign spend?
- What revenue impact should I anticipate if these two supply lines are interrupted?
Now, anyone in your organization can get real answers to their most complex business questions.
Genie Agent Mode is now available. www.databricks.com/blog/introducing-genie-agent-mode -
Databricks reposted
Neon
@neondatabase
Codex just released a big update! Codex for almost everything - including for Neon!
This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Databricks has been named to @Forbes' #ai50 โ a list celebrating the most innovative private AI companies turning ideas into real impact.
We're proud to be building the platform where the world's most ambitious teams are redefining what's possible with data and AI, and grateful to the customers and partners driving this work forward!
Explore the full list: www.forbes.com/lists/ai50/ -
Databricks
@databricks
.@AnthropicAI's Claude Opus 4.7 just landed on Databricks!
Opus 4.7 represents the next generation of enterprise reasoning. On Databricks' OfficeQA Pro benchmark, it demonstrates meaningfully stronger document reasoning, with 21% fewer errors than Opus 4.6 when using source information.
What this means for you:
- Build domain-specific agents with Agent Bricks
- Automate enterprise workflows with fewer iterations
- Deploy securely with built-in governance and observability
Whether you're analyzing documents, automating workflows, or making complex decisions, Opus 4.7 delivers the intelligence enterprises demand.
Get started on Databricks: docs.databricks.com/aws/en/release-notes/product/2026/april -
Databricks
@databricks
Introducing Databricks Document Intelligence: a research-specialized layer that turns raw enterprise documents into structured data your agents can actually reason over.
Across our benchmarks, Document Intelligence delivered the highest end-to-end parsing and extraction quality at 6-8x lower cost, with a 16% average performance gain across every agent framework tested, just from better parsing.
How to get started: www.databricks.com/blog/why-frontier-agents-cant-read-docโฆ -
Databricks reposted
#DataAISummit
@Data_AI_Summit
Data + AI Summit would not be possible without the support of our incredible partners and sponsors!
Shoutout to our 2026 Legend sponsors: @Accenture, @awscloud, @Deloitte, @googlecloud, @Infosys, and @Microsoft.
Register to connect with them June 15-18: dataaisummit.databricks.com/flow/db/dais2026/sponsors/pagโฆ -
Databricks
@databricks
AI agents are already creating ~4x more databases than humans in Lakebase. That shows how quickly software development is changing.
Agents generate, branch, test, and refine applications in rapid cycles, instead of building one system at a time. Many of these databases are short-lived, with compute often lasting only seconds.
This shift changes what databases need. They must support near-zero idle cost, scale instantly from small experiments to production, and work with open systems that agents can reliably use.
Discover what databases need for the agentic era. www.databricks.com/blog/how-agentic-software-development-โฆ -
Databricks
@databricks
AI Gateway in Databricks now extends Unity Catalog governance to agentic AI.
As agents call LLMs, pull data through MCP servers, and invoke external APIs, every step touches sensitive data and audit requirements. With the latest updates to AI Gateway, you can now bring all of that into one governance model:
โข Set access policies once across every LLM and tool
โข Trace the full agent call chain end-to-end
โข Centralize logging for FinOps, engineering, and security
www.databricks.com/blog/ai-gateway-governance-layer-agentโฆ -
Databricks
@databricks
New usage data from 20,000+ global organizations shows how AI agents are being adopted:
โข Multi-agent systems are growing fast, up 327% in under four months
โข 78% of companies are using two or more LLM model families
โข 97% of database testing and dev environments are now created by AI agents
โข Teams using evaluation tools are nearly 6x more likely to reach production, and over 12x with governance
Download the 2026 State of AI Agents to explore the data.
www.databricks.com/resources/ebook/state-of-ai-agents -
Databricks reposted
Sean Kerner @TechJournalist
"RAG works, but it doesn't scale," Michael Bendersky, research director @databricks , told @VentureBeat . "If you want to make your agent even better, and you want to understand why you have declining sales, now you have to help the agent see the tables and look at the sales data. Your RAG pipeline will become incompetent at that task."
venturebeat.com/data/databricks-research-shows-multi-stepโฆ via @VentureBeat -
Databricks
@databricks
It used to take years to weaponize a vulnerability. Now it takes 1.3 days. At #rsac2026, Databricks CEO @alighodsi explained how automated AI swarms โ not human hackers โ are driving that shift.
Watch the full keynote: www.databricks.com/resources/webinar/its-time-leave-legacโฆ -
Databricks reposted
Databricks AI Research
@DbrxMosaicAI
Most enterprise questions don't live in one dataset. They span structured systems and unstructured sources like documents, reviews, and reports.
In our latest research, we show how Agent Bricks Supervisor Agent handles this by decomposing queries across structured and unstructured tools, then synthesizing results over multiple reasoning steps.
The results across STaRK and KARLBench: 20%+ improvement over SoTA baselines, with the biggest gains on tasks requiring tight integration of structured and unstructured data.
All built declaratively โ no custom code, just precise instructions and the right tools. www.databricks.com/blog/agentic-reasoning-practice-makingโฆ -
Databricks
@databricks
The teams building production-ready agents arenโt just experimentingโtheyโre building, orchestrating, and governing them as part of real business systems.
This week, we're announcing new Databricks AI capabilities to help teams do exactly that.
Hereโs a look at whatโs new ๐ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
In this week's lesson we are learning about creating Jobs in @databricks!
Jobs help you orchestrate and automate data pipelines, notebooks, data ingestion within Databricks.
www.youtube.com/watch?v=p4pdx6iWotU -
Databricks
@databricks
Making Data and AI @Lovable.
Lovable now integrates with Databricks, providing a natural language interface that allows anyoneโregardless of technical skillsโto build live data apps can read and write data stored in Databricks.
Bridge the gap between complex data engineering and beautiful, functional front-ends. www.databricks.com/blog/lovable-databricks-build-data-driโฆ -
Databricks
@databricks
CDC and SCD pipelines get complex fast as data scales. Hand-coded MERGE logic grows hard to reason about, maintain, and keep correct over time.
AutoCDC replaces that approach with a declarative model. Teams define the desired behavior, and the platform handles ordering, deduplication, late data, and incremental processing.
โข Fewer lines of code
โข Better handling of late and out-of-order data
โข Improvements in correctness, performance, and cost in production workloads
www.databricks.com/blog/stop-hand-coding-change-data-captโฆ -
Databricks
@databricks
Weโre excited to announce that @satyanadella, Chairman and CEO of @Microsoft, will be joining the #dataaisummit keynote virtually for a special pre-recorded conversation with Databricks CEO @alighodsi on the future of AI, turning innovation into real-world results, and what's next for the Microsoft x Databricks partnership.
Register: www.databricks.com/dataaisummit -
Databricks
@databricks
#dataaisummit 2026 is less than two months away! Join us June 15-18 for practical insights and real-world case studies on transforming your organization with data and AI.
Across 800+ sessions, youโll hear from teams on how to:
โข Build AI agents that are accurate and grounded in your data
โข Develop intelligent apps with a fully managed Postgres database
โข Unify data, analytics, and AI with built-in governance
โฆand more
Explore session previews across nine tracks and register today. www.databricks.com/dataaisummit -
Databricks
@databricks
[DEMO] From prompt to pipeline with Genie Code.
In this demo, Genie Code takes a single prompt and handles the full data workflow:
โข Builds a working pipeline with ingestion and transformations
โข Manages orchestration with Spark Declarative Pipelines, including dependencies, retries, and scheduling
โข Validates the pipeline before execution
โข Generates dashboards, where โAsk Genieโ turns questions into answers on the data
youtu.be/UO0wvGYu5QQThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Databricks serverless compute removes the need to manage clusters across notebooks, Lakeflow Jobs, and pipelines, handling infrastructure and runtime upgrades automatically.
Over the past year, it has improved performance by 80% and cost efficiency by up to 70%, while delivering 89% more successful runs.
Compute is automatically sized and optimized, so teams spend less time on maintenance and more time building data workflows.
See how serverless compute is evolving data engineering. www.databricks.com/blog/evolution-data-engineering-how-seโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
As AI reasoning gets good enough, we think memory will be the next bottleneck for agents. Can your agent improve with more experience?
We call this Memory Scaling, and it's related but different from continual learning. A few examples and challenges:
www.databricks.com/blog/memory-scaling-ai-agents -
Databricks reposted
Amjad Masad
@amasad
Replit now deploys directly to Databricks.
Your apps run inside your Databricks environment while inheriting its security, governance, and data access.
Beta is live. Enterprises are already building with it and seeing massive acceleration in BI and internal tools. -
Databricks
@databricks
Databricks DevConnect 2026 is underway!
Built for developers, DevConnect is a technical meetup focused on the tools and patterns powering production data and AI workloads.
Next stops: Austin, Denver, Munich, and London.
What to expect:
- Deep dives on agentic workflows, MLflow 3.0, Unity Catalog, and more
- Live demos based on real-world use cases
- Time with Product, DevRel, Field Engineers, and MVPs
- Local connections with other developers
Find your city and register.
www.databricks.com/events?event_type=devconnect®ion=all -
Databricks
@databricks
Your guide to building data and AI apps that actually make it to production ๐
As an app developer, you shouldn't have to spend months on DevOps just to get a prototype across the finish line. This ebook shows you how to ship production-ready data and AI apps on the Databricks Platform even faster, using end-to-end examples and code snippets, without learning new infrastructure.
You'll learn how to:
- Move from notebooks and prototypes to real applications
- Serve analytical data and application state through a transactional layer
- Build secure, governed apps without custom infrastructure
- Deploy and operate using repeatable, production-ready patterns
www.databricks.com/resources/ebook/hands-guide-apps-databโฆ -
Databricks
@databricks
Iceberg v3 marks a major step forward for open table formats in unifying the data layer.
With v3 now in Public Preview on Databricks, it enables:
โข High-performance incremental data processing
โข Native support for semi-structured data
โข Interoperability across engines and between formats, without tradeoffs
And this is just the beginning.
Databricks is actively contributing to Iceberg v4, helping evolve the metadata layer to make open data architectures simpler, more scalable, and more unified.
Learn more about why Databricks is the best place to run Iceberg. www.databricks.com/blog/next-era-open-lakehouse-apache-icโฆ -
Databricks
@databricks
Build practical data and AI skills with hands-on training and certification at Data + AI Summit 2026.
Choose from 20+ instructor-led courses with labs on the Databricks Platform, plus onsite certification exams. Topics include AI, data engineering, Lakebase, application development, analytics, governance, and more.
Get 50% off half-day training courses when you register by April 30. www.databricks.com/dataaisummit/agenda?type=paid-trainingโฆ -
Databricks
@databricks
Developers want to write code, not spend time provisioning databases.
In this webinar, experts from Databricks and @cursor_ai build and deploy a production-ready app using modern frameworks, serverless Postgres, and built-in governance.
Youโll see how to build from scratch, push updates in real time, and scale with serverless runtime, with secure access through SSO and Auth.
Register to see how to build apps where your data already lives.
www.databricks.com/resources/webinar/ending-developer-strโฆ -
Databricks
@databricks
Shipping enterprise AI agents means moving from prototypes to something business users can trust and use.
Agent Bricks, Databricks Apps, and Databricks One provide a path to do that.
Build a domain-specific agent on enterprise data with built-in evaluation, deploy it as a secure chat interface with SSO and governed data access, and give users a single place to access it.
See how to move from prototype to production-ready agents ๐ฆ www.databricks.com/blog/ship-quality-enterprise-ai-agentsโฆ -
Databricks reposted
Association for Computing Machinery
@TheOfficialACM
Congratulations to Matei Zaharia on receiving the 2025 #acmprize in #computing! He is recognized for his visionary development of distributed data systems and computing infrastructure. Learn more: awards.acm.org/acm-prize
-
Databricks reposted
TechCrunch
@TechCrunch
Databricks co-founder wins prestigious ACM award, says โAGI is here alreadyโ techcrunch.com/2026/04/08/databricks-matei-zaharia-wins-aโฆ
-
Databricks
@databricks
We're incredibly proud to congratulate our co-founder and CTO, @matei_zaharia, on receiving the ACM Prize in Computing for his development of distributed data systems that have enabled large-scale machine learning, analytics, and AI.
Matei's open-source contributions have fundamentally changed how organizations work with data and AI โ including Apache Sparkโข, Delta Lake, and MLflow. Researchers, nonprofits, startups, and enterprises across every industry have built on the foundation he helped create.
Now he's pushing the frontier further, focusing on building and scaling reliable AI agents through open-source research like DSPy and GEPA.
Matei, this recognition is so well deserved. We're honored to build alongside you every day. awards.acm.org/about/2025-acm-prize -
Databricks
@databricks
Databricks co-founder and CEO @alighodsi joined CNBC anchor @dee_bosa on stage at HumanX today to talk about the race toward super intelligence, where enterprises should be focused instead, and what AI needs to be reliable at scale.
"There is a lot of talk about super intelligence. The models are already pretty smart. But there is a reliability gap in the enterprise. The models are missing the context needed for reliable outputs. We have to give them the enterprise context they need," said Ghodsi. -
Databricks
@databricks
If youโre running Apache Airflow in production, this guide shows how common orchestration patterns map to Lakeflow Jobs, Databricksโ built-in orchestrator.
See how control flow, triggers, parameters, and dynamic execution work when orchestration is integrated with the lakehouse, with examples you can apply directly.
Migrate incrementally using copy-pasteable code, without rewriting existing DAGs all at once. www.databricks.com/blog/how-move-apache-airflowr-databricโฆ -
Databricks reposted
Josue Bogran
@joshbogran
Will dashboards die? What does cybersecurity look like with AI? Why should you use Genie Code instead of Claude for coding inside of @databricks? When will Databricks IPO? Databricks' CEO @alighodsi shared his thoughts on this and more during an interview with me at RSAC, shortly after announcing Lakewatch.
I hope you enjoy this packed video, and thank you again Ali for your time!
Link: youtube.com/watch?v=ABWr00cGOGg&ra=m -
Databricks
@databricks
With coSTAR, we replaced manual agent iteration with an automated test and refine loop.
Agents run against defined scenarios. MLflow captures execution traces, and LLM judges score the results. A coding assistant then updates the agent until it passes the tests.
This cuts validation time from weeks to hours and lets the same tests run in CI and on production traffic, catching regressions from both agent changes and underlying infrastructure.
Explore how we moved from manual reviews to automated evaluation in hours.
www.databricks.com/blog/costar-how-we-ship-ai-agents-dataโฆ -
Databricks
@databricks
Running Scala and Java Spark jobs often requires managing clusters and handling runtime upgrades.
Serverless JARs remove that overhead. Jobs start in seconds and run on the latest supported runtime without cluster management.
With Databricks Connect, you can build and test from your IDE against real data and production-like environments, then deploy with Databricks Asset Bundles. You only pay for the compute you use.
www.databricks.com/blog/develop-and-deploy-serverless-jars -
Databricks reposted
Josue Bogran
@joshbogran
I had the opportunity of interviewing the GM of @databricks' Lakewatch right after the official announcement at RSA. Enjoy this 7-min video: www.youtube.com/watch?v=QZrK8t9MCG8
-
Databricks
@databricks
Genie Code is your autonomous AI partner for data work.
โ๏ธ Builds pipelines
โ๏ธ Debugs issues
โ๏ธ Maintains production systems
All while proactively monitoring pipelines and models in the background.
Through Unity Catalog and Lakehouse Federation, Genie Code understands your enterpriseโs data context and governance.
Take a first look ๐ง -
Databricks
@databricks
Nick Karpov and Holly Smith walk through some of the latest Databricks features - and how they work together under a single architecture. Our R&D teams have been busy.
Recent updates include:
- Three new foundation models in Databricks Foundation Model API support
- Stateless streaming performance improvements
- MLflow traces syncing into Unity Catalog tables
- Multi-statement transactions, supervisor agents, and metric views
Watch the full episode: youtu.be/hw_CJ7bBVN0 -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
Today I'm launching my latest course "Modern Data Workflows with Databricks" on analystbuilder.com!
Databricks is one of the most in-demand platforms in data right now, but getting started can feel overwhelming.
In this course, I'm going to walk you through everything you need to know to actually work in Databricks.
Things like:
- Navigating the Databricks UI and understanding how everything connects
- Building dashboards and sharing them with stakeholders
- Creating ELT pipelines from raw data to clean, ready-to-use tables
- Scheduling and automating your workflows with Jobs
- Using AI features like Genie Spaces and AI Agents
Whether you're trying to break into data engineering or you're an analyst looking to level up, this course will get you there!
Check it out here: www.analystbuilder.com/courses/modern-data-workflows-in-dโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
What does it take to build an AI system that actually improves with expert feedback?
This guide shows how our engineering team built an American football defensive coordinator assistant that answers situational questions using governed play-by-play and roster data, and then gets better with expert feedback.
Instead of guessing what โgood analysisโ means, coaches score the outputs. That feedback reshapes evaluation and steadily improves the systemโs responses.
This is turning domain expertise into a real feedback loop for AI.
www.databricks.com/blog/self-optimizing-football-chatbot-โฆ -
Databricks
@databricks
Lakebase autoscaling adjusts compute dynamically based on CPU load, memory usage, and working set size, within developer-defined limits.
Scaling happens automatically without database restarts, so connections stay open while resources adjust to demand. Paired with scale to zero, it can reduce idle compute spend while still handling bursty workloads.
Explore how Lakebase autoscaling works: www.databricks.com/blog/beyond-provisioning-developers-guโฆ -
Databricks
@databricks
As data estates grow, teams struggle to find, understand, and trust the right data.
The new Discover experience in Unity Catalog brings business context, trust signals, and access into one place.
With domains, intelligent curation, and governed access, users can discover data, analytics, and AI assets aligned to how the business works and move from discovery to action with more confidence.
Now in Beta: www.databricks.com/blog/unified-data-discovery-business-cโฆ -
Databricks
@databricks
Data warehouse migrations are often slowed down by the wrong assumptions.
Focusing only on cost, treating it as SQL code conversion, or migrating all legacy objects can increase cost, extend timelines, and carry forward unnecessary technical debt.
The reality is different. Value comes from:
โข Platform consolidation
โข Enabling AI on governed data
โข Decommissioning legacy systems faster
Explore the 10 data warehouse migration myths and best practices: www.databricks.com/blog/10-data-warehouse-migration-mythsโฆ -
Databricks
@databricks
The DevRel track at Data + AI Summit 2026 is designed for builders.
โ๏ธ A multi-day hackathon where teams build agentic data apps for social impact using Databricks Apps, Lakebase, and Agent Bricks
โ๏ธ DevHub Expo with interactive demos, technical showcases, and community programming
โ๏ธ The Grounded Reasoning Cup where AI agents race to reason over the real-world enterprise
Plus a DevConnect Meetup, sessions, and networking with developers and startups building the next wave of agentic systems. Save your spot:
www.databricks.com/dataaisummit -
Databricks
@databricks
Three beginner-friendly analytics projects you can finish in an afternoon with Databricks Free Edition
โข Analyze a simulated environment using AI/BI Dashboards and AI_Query()
โข Explore sample trends and generate predictions with AI_Forecast()
โข Load open data with Python and explore it using SQL
Each project uses public or sample datasets to build real dashboards and code you can showcase in your portfolio. Start building: www.databricks.com/blog/tutorial-3-free-databricks-analytโฆ -
Databricks
@databricks
[DEMO] Genie Code is your autonomous AI partner for data work.
Starting from a single prompt, watch as it explores datasets, trains and evaluates models, builds a Lakeflow Spark Declarative Pipeline, and creates an AI/BI dashboard โ all while maintaining enterprise context.This media couldn't be displayed. See it on the original post. -
Databricks reposted
Databricks AI Research
@DbrxMosaicAI
Applications are officially open for the Grounded Reasoning Cup at Data + AI Summit 2026! ๐
Weโre looking for students who want to:
- Tackle highโimpact enterprise challenges
- Showcase work to top researchers/engineers (with recruiters in the room)
- Compete for $100k in model credit prizes
Apply here: forms.gle/ijdHDbAJFZpFLi1b7
Competition overview: docs.google.com/document/d/19owtX7-ELUoMRMN_HlgLq2B9Rbx0Cโฆ -
Databricks reposted
Nikita | Scaling Lakebase Postgres
@nikitabase
Agentic coding changes infrastructure requirements. This what is means for databases.
Every service will have these capabilities over time.
www.databricks.com/blog/how-agentic-software-development-โฆ -
Databricks
@databricks
The 2026 Enterprise Tech 30 list is out, and Databricks has been named #2 in the Giga Stage!
Over 90 leading VCs and corporate development leaders selected the #et30, recognizing the top private companies shaping enterprise technology and transforming the future of work.
Thank you @Wing_VC and @EricNewcomer for this honor. www.wing.vc/et30/list -
Databricks
@databricks
The database architecture that made sense in the 1980s doesn't hold up in a world where agents are the primary builders.
The reason is that agentic development doesn't work like traditional development. AI agents now create roughly 4x more databases than human users on Lakebase. Agents spin up databases for experiments, branch them for testing, and discard them when done. About half have a compute lifetime of less than 10 seconds, with high cost sensitivity.
Agents also prefer open source tools like Postgres to proprietary databases. They generate queries, schemas, and integrations far more accurately for systems their training data actually covers.
Here's what databases actually need to look like in the agentic era: www.databricks.com/blog/how-agentic-software-development-โฆ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
In this week's lesson we are starting our Data Engineering in @databricks Series!
We will be covering Ingesting Data, Transforming Data in ETL Pipelines, Automating and Scheduling, and we will end with a Full Project.
youtu.be/hEv5y_s0L3c -
Databricks
@databricks
Get hands-on with what it takes to build and ship real-world data apps and AI agents.
Join us at Databricks AI Days to learn how to:
โข Build AI agents that are accurate, grounded in your data, and designed to work in real scenarios
โข Develop data apps with a fully managed Postgres database that keeps data ready for analytics and intelligent apps
โข Unify data, analytics, and AI with built-in governance and fast, reliable analytics
Stops ahead:
๐Amsterdam
๐Chicago
๐Washington D.C.
๐Paris
๐Bangalore
๐Sydney
๐Frankfurt
& more
www.databricks.com/ai-days?region=amer?utm_source=twitter -
Databricks
@databricks
See how to run operational workloads on the lakehouse using Lakebase, Databricks Apps, and Agent Bricks.
This BrickTalks session covers how teams are building data apps and AI agents on top of serverless Postgres to automate workflows and make data usable in real applications. -
Databricks reposted
Ali Ghodsi
@alighodsi
@JeffDean says it best, the problem in this new agentic era is "tools designed for human speed interaction". That's why we think agents love ๐๐ฎ๐ธ๐ฒ๐ฏ๐ฎ๐๐ฒ ๐ฃ๐ผ๐๐๐ด๐ฟ๐ฒ๐, it can branch, snapshot, scale up and down in a second, orders of magnitude faster than other databases.
www.youtube.com/watch?v=joTYgvRHST0&t=1824s
Read about this architectural shift from Database to Lakebase:
www.databricks.com/blog/what-is-a-lakebase -
Databricks
@databricks
Data engineering is getting more complex, but it doesn't have to slow you down.
The Big Book of Data Engineering is a practical guide packed with how-tos, code snippets, and real-world examples to help you build and scale pipelines faster and deliver high-quality data for AI, BI, and analytics workloads.
Inside:
- Patterns for scaling ETL pipelines effectively
- Orchestrating data, analytics, and AI workloads
- Implementing observability for your data pipelines
- Using Lakeflow to manage pipelines
www.databricks.com/resources/ebook/big-book-of-data-enginโฆ -
Databricks
@databricks
The Databricks Learning Festival is underway!
Complete all modules in at least one self-paced learning pathway in Customer Academy by April 3 to earn:
โข 50% off any Databricks Certification
โข 20% off a yearly Academy Labs subscription
Take advantage of this chance to build real skills in data engineering, analytics, machine learning, and GenAI.
community.databricks.com/t5/learning-events/databricks-leโฆ -
Databricks
@databricks
As schemas evolve, keeping sensitive data correctly labeled gets harder.
At Databricks, LogSentinel uses LLMs on Databricks to classify columns, apply hierarchical and residency-aware labels, and continuously detect drift, creating tickets for violations.
On 2,258 samples, it achieved up to 92% precision and 95% recall for PII and is now informing Data Classification to improve policy enforcement and compliance workflows.
See how:
www.databricks.com/blog/logsentinel-how-databricks-uses-dโฆ -
Databricks
@databricks
Planned maintenance causes more database disruption than actual hardware failures.
Most databases get patched far more often than they experience outages, but every patch means a maintenance window, severed connections, and a cold cache that tanks performance for minutes after restart.
Weโre changing that. This is Part 1 of our series on eliminating the impact of planned maintenance entirely, rolling out automatically over the next few weeks. www.databricks.com/blog/zero-downtime-patching-lakebase-pโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
We've lots of time building agents at Databricks, and developed this coSTAR pattern for it. It works even better with better models and keeps your agent hill-climbing on the hardest tasks from users without regressing. And it's super easy in @MLflowOSS. www.databricks.com/blog/costar-how-we-ship-ai-agents-dataโฆ
-
Databricks
@databricks
Data engineers want AI in their ETL workflows without adding complexity.
With Lakeflow and Agent Bricks AI functions, teams can apply AI directly inside data pipelines to process unstructured data, automate repetitive tasks, and turn raw inputs into usable signals at scale.
Practical examples include:
โข Turning call transcripts into summaries
โข Automating insurance claims processing from emails, PDFs, and images
โข Applying AI transformations directly in ETL pipelines
www.databricks.com/blog/ai-first-approach-data-engineerinโฆ -
Databricks
@databricks
More teams are exploring agentic analytics to simplify how they work with data.
Watch @Alex_TheAnalyst and experts from @AnthropicAI and Databricks break down how agentic analytics is changing how teams work, and learn practical skills for:
- Understanding how agentic analytics spans from data preparation to insight
- Whatโs new across Databricks analytics tools
- Using Genie and Claude to deliver agentic insights
- Building end-to-end analytics workflows without BI seats
www.databricks.com/resources/webinar/its-time-leave-legacโฆThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Ali Ghodsi
@alighodsi
Stop manually moving data between two databases! Moving data from a production database to a lakehouse is super common, and it's brittle, yet people try to do it themselves by using LLMs or by hand. AutoCDC automates this for you and almost always beats the performance of hand rolling this. Read this blog to understand how this works:
www.databricks.com/blog/stop-hand-coding-change-data-captโฆ -
Databricks
@databricks
Modern BI wasnโt built for AI. Fragmented tools, duplicated logic and inconsistent metrics make analytics harder to trust.
A better approach brings data, semantics, dashboards and AI together on a single governed foundation.
This guide explores how modern analytics platforms can:
โข Simplify analytics architecture
โข Improve metric consistency across tools
โข Accelerate real-time insights
โข Let teams ask questions in plain language and get analytical answers
www.databricks.com/resources/guide/your-compact-guide-modโฆ -
Databricks
@databricks
Databricks has been named to @FastCompany's Most Innovative Companies of 2026!
Congratulations to the Bricksters whose work and belief in what we are building made this possible. With recent innovations like Lakebase, Lakewatch, and Genie Code, weโre continuing to push the boundaries of data and AI, and are excited for whatโs ahead.
Proud to be recognized on this year's #fcmostinnovative list. www.fastcompany.com/91502052/databricks-most-innovative-cโฆ -
Databricks
@databricks
Databricks CEO @alighodsi joined @CNBC's @dee_bosa live from #rsac2026 to talk about the company's entry into cybersecurity with Lakewatch, and what he sees as a fundamental shift in how organizations defend themselves.
Attackers are using AI agents to exploit vulnerabilities in a single day, a window that used to be months. "We're fighting agents with agents instead of fighting agents with humans," said Ghodsi.
Watch the full conversation: www.youtube.com/watch?v=M20UjO9ONVM -
Databricks
@databricks
This morning at #rsac2026, Databricks Co-founder and CEO @alighodsi and @a16z Co-founder @bhorowitz took the stage to make the case for a fundamentally different approach to cybersecurity.
AI agents now autonomously read CVEs, construct exploits, and coordinate attacks around the clock. This isn't just about scale, it's about who can attack. As Ben Horowitz put it, "You don't have to be a hacker, you just have to ask an agent the wrong question."
The security stack most organizations rely on today was built for a completely different world, and today's tools force defenders to choose what data to keep and what to throw away while attackers use AI to analyze everything.
The only viable path forward is to fight agents with agents, with all your data in an open security lakehouse as the foundation.
"For the first time in history your ability to investigate vulnerabilities is not limited to the size of your team. We are enabling entirely new methods of defense." โ Ali Ghodsi -
Databricks
@databricks
Our CEO and Co-founder @alighodsi shares why Databricks is entering the cybersecurity market with Lakewatch โ a new open, agentic SIEM.
"The prevailing pricing model is at odds with protecting against this avalanche that's coming our way, because it's just too prohibitively expensive to get all your data in there."
AI has completely changed the security landscape as attackers exploit vulnerabilities at machine speed. Legacy SIEMs create a financial penalty on every byte ingested, forcing teams to drop critical data. Lakewatch unifies security, IT, and business data in a single, governed environment to deploy AI-powered detection and response at petabyte scale and a fraction of the cost.
See why organizations like @Adobe and @NAB are already using it. @jordannovet covers the full story for @CNBC: www.cnbc.com/2026/03/24/databricks-cybersecurity-lakewatcโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
We believe security needs to be open and agent-centric. ๐๐๐ค๐๐ฐ๐๐ญ๐๐ก is built directly on the open data lakehouse pattern. By bringing agentic automation directly to where your open data already lives, we're automating the heavy lifting in the Security Operations Center. As a result, you keep ownership of your data, your agents can operate on absolutely everything, and you get it done in a architecturally cost efficient way.
www.databricks.com/blog/databricks-announces-lakewatch-neโฆ -
Databricks reposted
CNBC
@CNBC
Databricks enters cybersecurity market with Lakewatch launch, bulking up ahead of IPO www.cnbc.com/2026/03/24/databricks-cybersecurity-lakewatcโฆ
-
Databricks
@databricks
Today weโre announcing Lakewatch โ a new open, agentic SIEM.
Security has changed. Attackers now use agents, operating 24/7 at machine scale, while legacy security tools were built for human-speed threats. We need tools where agents work alongside humans to keep up.
Lakewatch brings a new architecture for this agentic era:
โข Ingest and store all enterprise data, including multimodal sources
โข Analyze it alongside business data with full governance
โข Use AI agents to automate detection, investigation, and response
Security requires a fundamental platform shift. This is how teams can fight agents with agents.
www.databricks.com/blog/databricks-announces-lakewatch-neโฆ -
Databricks
@databricks
Tired of using fragmented architectures for your near real-time apps?
Eliminate multi-hop ingestion and complex reverse ETL with a unified end-to-end approach.
โ Zerobus Ingest: Near real-time ingestion (โค5 seconds) that writes event data directly to governed Delta tables
โ Lakebase: Fully managed Postgres database built into Databricks for low-latency operational workloads
โ Databricks Apps: Build and deploy interactive applications within the Databricks Platform
Ingest, build, and deploy applications faster on a single data foundation
www.databricks.com/blog/building-near-real-time-applicatiโฆ -
Databricks
@databricks
We're making warehouse migrations faster and more predictable with Lakebridgeโs latest AI-powered updates.
See whatโs new:
โก๏ธ Synapse support in the assessment profiling tool
โก๏ธ AI-powered SQL conversion
โก๏ธ A guided desktop app that brings assessment, code conversion, and reconciliation into one workflow
www.databricks.com/blog/new-migrations-faster-and-more-prโฆ -
Databricks
@databricks
AI coding tools are getting very good at writing code. But data work is not just code.
Genie Code is built for what happens after. It can build pipelines and models, then keep them running by monitoring pipelines and AI models, triaging failures, and investigating anomalies.
It works with the context data teams actually depend on. So teams can spend less time reacting to issues and more time moving work forward.
www.databricks.com/blog/introducing-genie-code -
Databricks
@databricks
Databricks AI Days are underway, bringing together 15,000+ data and AI leaders to see how modern teams are building and shipping intelligent apps.
This year, the spotlight is on Lakebase: a new category of operational database built for the age of agents, where storage and compute are fully separated and serverless Postgres scales instantly with demand.
Get hands-on with sessions and trainings on building and deploying AI agents with Agent Bricks, powering those agents with Lakebase Postgres, and querying your data in natural language with Genie: www.databricks.com/ai-days?region=amer?utm_source=twitter -
Databricks
@databricks
When dashboards inform board decks, forecasts, and compensation, small errors can have real impact.
This tutorial walks through how to manage Databricks AI/BI dashboards with Git and Asset Bundles so every change is versioned, reviewed, and reversible, with controlled deployment across environments.
Follow a step-by-step workflow to keep updates visible, testable, and safe to deploy without changing how analysts work day to day.
www.databricks.com/blog/tutorial-how-ship-aibi-dashboard-โฆ -
Databricks
@databricks
As data pipelines scale, data engineers spend more time stitching together tools for orchestration, incremental processing, data quality, and backfills.
Spark Declarative Pipelines (SDP) extend declarative processing from individual queries to entire pipelines, allowing Apache Spark to plan and execute them end to end.
By handling dependencies, incremental updates, retries, and recovery natively, SDP reduces glue code and lets data engineers focus on delivering reliable datasets rather than managing workflow complexity.
See why data engineering needs to become end-to-end declarative.
www.databricks.com/blog/spark-declarative-pipelines-why-dโฆ -
Databricks
@databricks
Organizations are under pressure to deliver AI-powered applications while controlling cost, risk and complexity.
In this on-demand webcast, Databricks VP of Product Shanku Niyogi covers:
โข Why intelligent applications strain traditional architectures
โข How Lakebase introduces a new transactional foundation for modern apps
โข How teams can build and scale AI-powered applications without adding architectural sprawl
Watch to learn how to build intelligent apps with Lakebase โ
www.databricks.com/resources/webinar/reinventing-intelligโฆ -
Databricks reposted
Scott Brinker
@chiefmartec
Two ideas from my research project with Databricks fundamentally rewired how I think about martech.
๐ง Mind-bending idea #1: Everything. Is. Data.
Not just customer data. Not just campaign data. Company operations data, content, code, AI models, prompts, agent skills, governance controls โ all of it living on a common data plane, underpinning everything in the business.
This isn't just a universal data layer for classic martech records. It's a universal data layer for everything.
The wildest part? Code as data. When you realize that AI models, prompts, agent workflows, and governance rules can all be managed and manipulated as data โ queried, updated, versioned, orchestrated โ something clicks. Functionality becomes as accessible as any other dataset.
I think of this as the Grand Unified Theory of Martech:
The martech stack doesn't just use data. It is data.
โก Mind-bending idea #2: The new math of integration.
I've spent my entire career wrestling with martech integrations โ as a developer, as a platform leader, as an analyst. Integration has been the bane of martech since the moment there were more than two tools on the landscape. We've made great progress, but there was still a long way to go.
When everything lives on a shared native data substrate, the complexity curve changes fundamentally. Hub-and-spoke integration models are O(n) โ every new connection adds proportional overhead, technical debt, and failure points.
On a common data plane, you're approaching O(log n). Each new integration adds only a minuscule fraction of incremental complexity because everything is already adjacent and accessible.
It's not just faster and easier. Going back to idea #1: when everything is already data on that plane, the integrations themselves become richer and more powerful โ no longer bottlenecked through narrow APIs with partial coverage and perpetual version drift.
This one felt personal. In the best possible way.
There's a lot more in my latest newsletter issue and the report itself โ including the composable canvas architecture framework, the semantic layer, context graphs, and more.
The link to the web version of the newsletter issue is here. You can grab a free copy of the full Databricks report from there too.
www.databricks.com/resources/ebook/new-martech-stack-ai-age
Massive thanks to Tasso Argyros, Katy Yuan, and the entire Databricks team for being such incredible partners on this project. ๐
#marketing #martech #ai -
Databricks reposted
Daytona
@daytonaio
Great evening at @daytonaio AI Builders in @databricks NYC Office๐ฝ
Packed room, insightful talks, and practical insights on AI Engineering from @JukicVedran, @markospetko, @pauljaffre & @GeoffreyHuntley.
Big thanks to @databricks & @sentry, and everyone who joined!๐ -
Databricks
@databricks
Today at #nvidiagtc, weโre introducing AI Runtime, with serverless NVIDIA A10 and H100 GPUs now available on Databricks for training and fine-tuning.
GPU infrastructure has been one of the biggest blockers for teams building advanced AI, from long procurement cycles to complex distributed setups and data bottlenecks. AI Runtime removes that friction:
- On-demand GPUs with no cluster management
- Optimized distributed training with key frameworks pre-installed
- Native integration with Lakeflow, MLflow, and Unity Catalog
With AI Runtime, teams can focus on building and shipping models, not managing infrastructure. www.databricks.com/blog/introducing-ai-runtime-scalable-sโฆ -
Databricks
@databricks
Real-Time Mode for Apache Spark Structured Streaming on Databricks is now generally available.
For ultra-low latency workloads, teams have historically needed to run separate, specialized engines like Apache Flink alongside Spark, duplicating codebases, governance, and operational overhead. RTM eliminates that by bringing millisecond-level latency to the Spark APIs you already use.
Industry-leading companies are already seeing results:
- @coinbase cut end-to-end latency by 80%+ while computing 250+ ML features on a unified Spark engine
- @DraftKings rebuilt fraud detection pipelines for live sports betting with latencies that weren't previously possible
- @makemytrip hit sub-50ms P50 latencies and saw a 7% lift in click-through rates
If you're already on Structured Streaming, a single config update is all it takes to get started. www.databricks.com/blog/announcing-general-availability-rโฆ -
Databricks
@databricks
GPT-5.4 Mini and GPT-5.4 Nano are available on Databricks today.
Both models run on your enterprise data with the governance and operational tooling teams need for production. GPT-5.4 Mini brings meaningful gains over GPT-5 Mini in coding, reasoning, multimodal understanding, and tool use, at more than 2x the speed.
GPT-5.4 Nano is the smallest and most cost-efficient option in the GPT-5.4 family, built for classification, data extraction, ranking, and simpler coding subagents.
Congrats to the @OpenAI team. Looking forward to seeing what our customers build! docs.databricks.com/aws/en/release-notes/product/2026/march -
Databricks
@databricks
At FabCon 2026, Azure Databricks is introducing new capabilities across Lakebase, Lakeflow, and Genie to make it easier to build data and AI applications on Azure.
Whatโs new:
โข Azure Databricks Lakebase is now GA as the operational database for AI agents
โข Lakeflow Connect Free Tier allows you to ingest ~100 million records/workspace/day from many popular enterprise data sources
โข Databricks One Mobile enables access to AI/BI, dashboards, and Genie on-the-go
โข Genie and Genie Code expand AI-powered analytics and enable agentic workflows for data teams
โข Azure Databricks Excel add-in connects Excel directly to governed lakehouse data
Together, these capabilities simplify how data is ingested, governed, and used to power analytics and AI on Azure. www.databricks.com/blog/whats-new-azure-databricks-fabconโฆ -
Databricks
@databricks
The next wave of data and AI innovation will be on full display at Data + AI Summit 2026.
See how teams are using Lakebase, serverless Postgres for apps and AI agents, and Genie, a conversational AI agent for data insights โ plus keynotes, live demos, and sessions from the builders shaping the future.
Join us June 15-18: www.databricks.com/dataaisummit -
Databricks
@databricks
Serverless Workspaces in Azure Databricks are now generally available!
Teams can now spin up fully managed workspaces in minutes โ no VNet design, compute provisioning, or infrastructure setup required.
With serverless compute, Databricks-managed storage, and governance through Unity Catalog built in, @Azure data and AI teams can quickly move from platform setup to delivering analytics, BI, and AI. www.databricks.com/blog/serverless-workspaces-azure-databโฆ -
Databricks
@databricks
"You can think of this as RAG โ but like RAG plus plus plus plus plus plus, all the way up to 200 vector database calls." โ @jefrankle, Chief AI Scientist at Databricks.
We published new research on KARL โ Knowledge Agents via Reinforcement Learning โ a RAG agent trained simultaneously across six distinct enterprise search behaviors. Most pipelines are built for one and fail silently on the others. KARL generalizes across the kinds of ambiguous, fragmented, real-world queries that enterprise search actually demands.
Read more via @VentureBeat: venturebeat.com/data/databricks-built-a-rag-agent-it-saysโฆ -
Databricks
@databricks
Databricks CEO and co-founder @alighodsi is taking the stage at #rsac2026 to address the most critical challenge in security: the shift from manual operations to machine-scale AI automation.
Hear why today's security stack โ built for yesterday's data volumes and human-speed threats โ is no longer enough. Ali will break down what's coming next and why an open, agent-first architecture is the path forward for CISOs. path.rsaconference.com/flow/rsac/us26/keynotesybca/page/yโฆ -
Databricks
@databricks
Delta Sharing now supports Attribute-Based Access Control. Providers can now share these tables directly without creating separate copies, and recipients can apply their own ABAC policies with the guarantee of correct query-time enforcement.
Every read, every policy creation, and every share event is logged in Unity Catalog for auditing and compliance.
Secure data sharing at scale should not require choosing between control and convenience. www.databricks.com/blog/how-delta-sharing-supports-abac-sโฆ -
Databricks
@databricks
Agentic analytics is changing how data teams work, and it's happening faster than expected.
Ken Wong from Databricks, @rgb_prithvi from @AnthropicAI, and other experts discuss how agents built on a unified data platform can support every step of your analytics workflow.
Explore:
- The latest innovations in Lakeflow Designer, Unity Catalog Business Semantics, AI/BI Genie, and more
- How Genie and Claude deliver agentic data insights
- How to build your first agentic analytics workflow for free and never pay for BI seats again
www.databricks.com/resources/webinar/its-time-leave-legacโฆ -
Databricks
@databricks
Most critical enterprise data doesn't live in organized column and rows. It's unstructured โ PDFs, reports, and diagrams. Extracting insights historically meant rules-heavy OCR pipelines that break the changes.
@Alex_TheAnalyst walks through how document processing in Databricks replaces all of that with AI-powered extraction that's flexible, accurate, and easy to maintain.
Watch the full walkthrough: youtu.be/ItzSyfNEptk -
Databricks
@databricks
Push 10+ GB/sec to your lakehouse in under 5 seconds.
With Zerobus Ingest, stream data directly into your lakehouse โ no message bus required.
Less infrastructure to manage, lower costs, and faster access to real-time data.
Key capabilities:
โข Sub-5-second latency for thousands of concurrent connections
โข Supports over 10 GB/sec aggregate throughput to a single table
โข Includes gRPC and REST APIs, plus SDKs for Python, Java, Rust, Go, and Typescript
โข Built-in governance with Unity Catalog
Now generally available:
www.databricks.com/blog/announcing-general-availability-zโฆ -
Databricks
@databricks
In data and AI, validated expertise is becoming a real differentiator โ for career growth, credibility, and visibility.
Professionals with Databricks certifications report tangible outcomes: promotions, expanded opportunities, stronger credibility in leadership discussions, and increased engagement and reach on professional networks. The certification has become a practical lever for moving into higher-responsibility roles and making an impact at scale.
Ready to take the next step? Explore Databricks certifications: www.databricks.com/blog/professional-impact-becoming-dataโฆ -
Databricks
@databricks
One in four Y Combinator startups is already shipping with 95% AI-generated code.
Building at that speed is now possible without creating data silos or stepping outside your existing security controls.
This tutorial walks through how to build a full-stack app inside Databricks using Lakebase for managed Postgres, Databricks Apps as the secure runtime, and AI assistance in your IDE, including a four-step context engineering workflow to make AI coding reliable and consistent. youtu.be/ninPbwHnqkwThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Turn enterprise documents into answers your teams can trust.
With Agent Bricks Knowledge Assistant, teams can:
- Launch a managed knowledge agent in minutes
- Get accurate, page-level citations
- Improve answer quality with Instructed Retrieval
- Apply expert guidance at scale with ALHF
Explore how it works โ
www.databricks.com/blog/agent-bricks-knowledge-assistant-โฆ -
Databricks
@databricks
Data questions don't happen in a vacuum. They come up mid-conversation in Microsoft Teams, in a Slack thread, or inside a custom app. But getting a governed, accurate answer has always meant switching contexts or waiting on someone else.
Databricks Genie now works directly inside the tools your teams already use, including Microsoft Teams, Slack, Confluence, and custom web apps.
With enterprise OAuth, every conversation is authenticated and governed by each user's own data permissions, so the right people see the right data, wherever they're asking. www.databricks.com/blog/access-genie-everywhere -
Databricks
@databricks
What are the defining traits of companies that put their AI initiatives into production?
We looked at actual usage data across 20,000+ customers worldwide to identify the building blocks to a successful enterprise AI strategy.
One key finding: AI evaluation tools have become a powerful lever for producing high-quality outputs required for AI in production. Companies using evaluations tools get nearly 6x more AI projects into production than that donโt.
Get more insights in the 2026 State of AI Agents: www.databricks.com/resources/ebook/state-of-ai-agents -
Databricks
@databricks
For years, data teams have maintained two separate systems:
- A warehouse for multi-step SQL workflows
- A Lakehouse for analytics and AI
That split means duplicate pipelines, higher TCO, and operational complexity.
Today that changes. Databricks now supports multi-statement, multi-table transactions across Delta and Iceberg, with row-level concurrency and no locks. Combined with Stored Procedures and SQL Scripting, customers can confidently migrate mission-critical warehousing workloads to the lakehouse.
Warehousing, analytics, and AI on one architecture. www.databricks.com/blog/transactions-open-lakehouse-unlocโฆ -
Databricks
@databricks
Data + AI Summit is where data, dev and AI teams go to level up.
Whether you're building AI agents, scaling real-time pipelines, or trying to get more projects out of pilot and into production, the 2026 agenda is built for the practitioners doing the actual work.
800+ hands-on sessions and deep technical dives across:
- App Development
- AI/ML & Agents
- Analytics & BI
- Data Engineering & Streaming
- Data Sharing & Collaboration
- Data Warehousing
- Governance & Security
Register today to take advantage of early-bird pricing: www.databricks.com/dataaisummit -
Databricks
@databricks
Databricks CEO and co-founder @alighodsi joined @technology to discuss the launch of Genie Code, an autonomous AI agent built specifically for data teams.
"Just six months ago, we were talking about autocompleting code โ now agents automate the code. The new question is: how do we take the code thatโs been written into production and make sure we're monitoring it?"
Watch the full conversationThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
The next generation of AI agents won't just write software, but operate the data systems that modern businesses depend on.
Genie Code is built for exactly that: an autonomous agent that understands your data, maintains pipelines, diagnoses failures, and keeps things running.
Databricks co-founder and CEO @alighodsi on what makes it different: "It's not about just generating random code snippets, but understanding the entire structure of the data problem and working through the modeling workflow the same way a data scientist or engineer would."
@iamVictorDey covers the full story for @FastCompany: www.fastcompany.com/91505774/exclusive-databricks-launcheโฆ -
Databricks
@databricks
Today we're announcing Genie Code, your autonomous AI partner for data.
Genie Code is a state-of-the-art agent that lets data teams move from prompting a copilot to delegating real work: building pipelines, machine learning models, debugging failures, and shipping dashboards.
This isn't a smarter autocomplete. It's a different kind of AI partner entirely.
Unlike general coding agents that stop once the code is built, Genie Code plans, executes, and iterates across the full data and AI lifecycle inside Databricks. It's purpose-built for data engineering, data science, and BI:
โข More than doubles the success rate of leading coding agents on real-world data science tasks
โข Proactively monitors your pipelines and AI models in the background, triaging failures and fixing issues before a human intervenes
โข Works with your data wherever it lives, across Databricks and external platforms, with full governance and MCP support
This is what the future of data work looks like. www.databricks.com/blog/introducing-genie-code -
Databricks
@databricks
Databricks is acquiring Quotient AI to strengthen the agent evaluation and reinforcement learning capabilities in Genie, Genie Code, and Agent Bricks so customers get more reliable AI agents in production.
Databricks already provides powerful tools for evaluating and improving AI agents. With Quotient, we're strengthening these capabilities across our platform with a continuous evaluation and improvement layer that monitors agent behavior in production, catches issues like hallucinations and broken reasoning before users do, and uses those signals to continuously improve performance over time.
We're excited to welcome the Quotient AI team to Databricks as we continue building the most reliable platform for developing, deploying, and improving agentic systems at scale! www.databricks.com/blog/databricks-acquires-quotient-ai-pโฆ -
Databricks reposted
Jonathan Shriftman
@Shriftman
Last week, I was at the Morgan Stanley TMT conference and heard several fantastic talks from the CEOs of Nvidia, Microsoft, Snowflake, Ramp, Vercel and others.
But the fireside that stuck with me most was @databricks CEO,@alighodsi.
Every part of the Databricks business is accelerating. All of them.
I wanted to share my analysis on why Databricks is one of the best positioned companies for the era of agentic AI (and why both humans & agents are going to use the platform exponentially more)
Jonathan Shriftman
@Shriftman
-
Databricks
@databricks
Access to Google Gemini 3.1 Flash-Lite is now available on Databricks!
Gemini 3.1 Flash-Lite is a brand-new model in the Gemini family โ and Databricks is one of the first places outside of Vertex AI where you can access it. Build and scale GenAI applications on your enterprise data with the governance and operational tooling your teams need for production.
Congrats to the Google Gemini team on this release. We canโt wait to see what you build with it! docs.databricks.com/aws/en/release-notes/product/2026/march -
Databricks reposted
Krista Opsahl-Ong
@kristahopsalong
Most AI benchmarks test reasoning in isolation.
Real enterprise tasks require grounded reasoning:
1๏ธโฃ Find the right documents
2๏ธโฃ Extract the right values
3๏ธโฃ Perform analyses
OfficeQA Pro evaluates this end-to-end. Frontier agents still score <50%.
๐งตPaper & details below! -
Databricks reposted
Databricks AI Research
@DbrxMosaicAI
Most AI benchmarks test reasoning in isolation.
Real enterprise tasks require grounded reasoning:
- Find the right documents
- Extract the right values
- Perform analyses
OfficeQA Pro evaluates this end-to-end. Frontier agents still score <50%.
Paper & details: www.databricks.com/sites/default/files/2026-03/officeqa-tโฆ -
Databricks
@databricks
Data engineering is getting more complex, but it doesn't have to slow you down.
The Big Book of Data Engineering is a practical guide packed with how-tos, code snippets, and real-world examples to help you build and scale pipelines faster and deliver high-quality data for AI, BI, and analytics workloads.
Inside:
- Patterns for scaling ETL pipelines effectively
- Orchestrating data, analytics, and AI workloads
- Implementing observability for your data pipelines
- Using Lakeflow to manage pipelines
www.databricks.com/resources/ebook/big-book-of-data-enginโฆ -
Databricks
@databricks
Ad attribution is a stateful streaming problem.
With Apache Spark Real-Time Mode + transformWithState, you can achieve sub-second latency and handle timers, TTLs, and late data directly in Structured Streaming.
No external engines. Build the entire pipeline in Spark. -
Databricks
@databricks
Now you can author an AI agent and deploy it on Databricks with Agent Bricks Custom Agents!
- Build and iterate locally with your preferred stack
- Improve agent quality with integrated evaluation and CI/CD workflows
- Deploy directly as serverless Databricks Apps to a consistent, governed production environment
- Store and reuse agent state with built-in memory powered by Lakebase
www.databricks.com/blog/custom-agents-now-available-databโฆ -
Databricks reposted
Databricks
@databricks
Lakebase is a new category of operational database that separates compute from storage, giving you serverless Postgres that scales with demand and to zero when idle.
Branch production data in seconds, store everything in open formats, and never worry about vendor lock-in.
Launch the product tour: www.databricks.com/resources/demos/tours/appdev/databrickโฆ -
Databricks
@databricks
Real-time data streaming has always required complicated architectures and weeks of development work to get right. Databricks Zerobus Ingest is designed to change that.
@CRN's @RickWhiting1 spoke with Senior Director of Product Management Bilal Aslam about the general availability of the fully managed, serverless ingest service that streams data directly into the lakehouse with sub-five-second latency.
On what this means for teams building real-time applications: "It's minutes to hours of development, not weeks and months."
Read the full story: www.crn.com/news/software/2026/new-databricks-offering-taโฆ -
Databricks
@databricks
Lakebase is a new category of operational database that separates compute from storage, giving you serverless Postgres that scales with demand and to zero when idle.
Branch production data in seconds, store everything in open formats, and never worry about vendor lock-in.
Launch the product tour: www.databricks.com/resources/demos/tours/appdev/databrickโฆ -
Databricks reposted
Jamin Ball
@jaminball
Awesome job by the @databricks team
My summary:
They trained a model called KARL that beats Claude 4.6 and GPT 5.2 on enterprise knowledge tasks (searching docs, cross-referencing info, answering questions over internal data), at ~33% lower cost and ~47% lower latency.
The key insight: instead of throwing expensive frontier models at enterprise search, you can use reinforcement learning on synthetic data to train a smaller model that's faster, cheaper, AND better at the specific task.
RL went beyond making the model more accurate. I t learned to search more efficiently (fewer wasted queries, better knowing when to stop searching and commit to an answer).
They're opening this RL pipeline to Databricks customers so they can build their own custom RL-optimized agents for high-volume workloads.
I think we'll continue to see data platforms become agent platforms. Databricks' KARL paper is really an agent platform play. The pitch: you already store your enterprise data in the Lakehouse, now Databricks will train a custom RL agent that searches and reasons over it, tuned specifically for your highest-volume workloads (workloads = apps = agents). The business move is closing the loop: data storage โ retrieval โ custom agent training โ serving, all on Databricks. They're turning "your data lives here" into "your agents live here too."
Kudos @alighodsi @matei_zaharia @rxin
Databricks AI Research
@DbrxMosaicAI
Meet KARL: a faster agent for enterprise knowledge, powered by custom reinforcement learning (now in preview).
Enterprise knowledge work isnโt just Q&A. Agents need to search for documents, find facts, cross-reference information, and reason over dozens or hundreds of steps.
KARL (Knowledge Agent via Reinforcement Learning) was built to handle this full spectrum of grounded reasoning tasks. The result: frontier-level performance on complex knowledge workloads at a fraction of the cost and latency of leading proprietary models.
These advances are already making their way into Agent Bricks, improving how knowledge agents reason over enterprise data.
And Databricks customers can apply the same reinforcement learning techniques used to train KARL to build custom agents for their own enterprise use cases.
Read the research โ www.databricks.com/sites/default/files/2026-03/karl.pdf
Blog: www.databricks.com/blog/meet-karl-faster-agent-enterpriseโฆ -
Databricks
@databricks
Your guide to building data and AI apps that actually make it to production ๐
As an app developer, you shouldn't have to spend months on DevOps just to get a prototype across the finish line. This hands-on ebook shows you how to ship production-ready data and AI apps on the Databricks Platform even faster, using end-to-end examples and code snippets, without learning new infrastructure.
You'll learn how to:
- Move from notebooks and prototypes to real applications
- Serve analytical data and application state through a transactional layer
- Build secure, governed apps without custom infrastructure
- Deploy and operate using repeatable, production-ready patterns
www.databricks.com/resources/ebook/hands-guide-apps-databโฆ -
Databricks
@databricks
What does AI inference actually look like in production?
Based on real Databricks usage data across 20,000+ organizations:
- 96% of requests are processed in real time, not batch
- Real-time powers interactive use cases like copilots, customer support, and personalization
- The Tech industry leads in real-time usage, with Healthcare and Life Sciences close behind in time-sensitive scenarios
Explore the full findings:
www.databricks.com/resources/ebook/state-of-ai-agents -
Databricks reposted
Matei Zaharia
@matei_zaharia
This is a great pattern to build your own specialized AI, described in our report.
- Generate synthetic data with current version of model
- Apply efficient large-batch off-policy RL (OAPL)
- Generate harder data with updated model
- Produce efficient, generalizable small model
Databricks AI Research
@DbrxMosaicAI
Meet KARL: a faster agent for enterprise knowledge, powered by custom reinforcement learning (now in preview).
Enterprise knowledge work isnโt just Q&A. Agents need to search for documents, find facts, cross-reference information, and reason over dozens or hundreds of steps.
KARL (Knowledge Agent via Reinforcement Learning) was built to handle this full spectrum of grounded reasoning tasks. The result: frontier-level performance on complex knowledge workloads at a fraction of the cost and latency of leading proprietary models.
These advances are already making their way into Agent Bricks, improving how knowledge agents reason over enterprise data.
And Databricks customers can apply the same reinforcement learning techniques used to train KARL to build custom agents for their own enterprise use cases.
Read the research โ www.databricks.com/sites/default/files/2026-03/karl.pdf
Blog: www.databricks.com/blog/meet-karl-faster-agent-enterpriseโฆ -
Databricks
@databricks
Watch @Alex_TheAnalyst use IDP and the built-in ai_parse_document function to process a PDF directly in Databricks.
For data analysts, documents like medical claims often hold key fields that are hard to query. He shows how to upload a claim, parse it with Spark SQL, and isolate CPT and ICD codes so they can be analyzed inside the platform.
www.youtube.com/watch?v=3rOk2sIp9P4 -
Databricks reposted
VentureBeat
@VentureBeat
Most enterprise RAG agents are optimized for one search task and fail on the others. Databricks built KARL to fix that โ a single agent trained across six search behaviors using reinforcement learning.
venturebeat.com/ai/databricks-built-a-rag-agent-it-says-cโฆ -
Databricks reposted
Manny Bernabe
@MannyBernabe
This is the year vibe coding breaks into the enterprise. What used to take a full team and weeks, I just did in 7 minutes for under $2. This is crazy.
I pulled data from @databricks into @Replit and built a custom data app from scratch: live data points, beautiful UI.
- One prompt
- $1.50
- 7 minutes
Wild! ๐คฏ
If you want to stand out, this is the combo. Pull data securely from Databricks. Build in Replit. Deploy back to Databricks with enterprise security already in place.
Vibe coding just went pro. ๐This media couldn't be displayed. See it on the original post.
Manny Bernabe
@MannyBernabe
Vibe code beautiful data apps in @Replit. Deploy to your enterprise in @databricks.๐ค๐ฅณ
-
Databricks
@databricks
Day-one access to @OpenAI GPT-5.4 is now available on Databricks!
Use GPT-5.4 on Databricks to build and scale GenAI applications on your enterprise data, end to end, with the governance and operational tooling teams need for production.
GPT-5.4 achieved significant accuracy improvements on OfficeQA, a benchmark for grounded reasoning over real-world enterprise documents, driven by stronger tool use and multi-step reasoning. It's also roughly 2x faster than comparable frontier-level agent systems, translating directly to better performance in production document workflows.
Congrats to the OpenAI team on this release. We canโt wait to see what our customers build!
docs.databricks.com/aws/en/release-notes/product/2026/march -
Databricks
@databricks
For years, developers have had to bridge the gap between operational databases and analytics with brittle ETL pipelines. That data tax โ duplicated storage, persistent lag, fragmented governance โ ends today.
Azure Databricks Lakebase is now generally available.
Lakebase is a managed, serverless Postgres built natively into the Databricks Platform on @Azure, sharing the same storage layer as your lakehouse. Instant branching and zero-copy clones accelerate development without compromising governance.
No pipelines to maintain, no data out of sync, one governance model across your entire data estate. www.databricks.com/blog/azure-databricks-lakebase-generalโฆ -
Databricks reposted
Databricks AI Research
@DbrxMosaicAI
Meet KARL: a faster agent for enterprise knowledge, powered by custom reinforcement learning (now in preview).
Enterprise knowledge work isnโt just Q&A. Agents need to search for documents, find facts, cross-reference information, and reason over dozens or hundreds of steps.
KARL (Knowledge Agent via Reinforcement Learning) was built to handle this full spectrum of grounded reasoning tasks. The result: frontier-level performance on complex knowledge workloads at a fraction of the cost and latency of leading proprietary models.
These advances are already making their way into Agent Bricks, improving how knowledge agents reason over enterprise data.
And Databricks customers can apply the same reinforcement learning techniques used to train KARL to build custom agents for their own enterprise use cases.
Read the research โ www.databricks.com/sites/default/files/2026-03/karl.pdf
Blog: www.databricks.com/blog/meet-karl-faster-agent-enterpriseโฆ -
Databricks
@databricks
The Databricks Architecture Center is your hub for practical ways to build pipelines, dashboards, and AI models.
Find designs for common data and AI projects across use cases:
- Intelligent Data Warehousing on Databricks
- Reference Architecture for Credit Loss Forecasting
- Telecom Next Best Action Reference Architecture
- and much more!
www.databricks.com/resources/architectures -
Databricks
@databricks
Great answers start with a well-curated Genie space ๐ง
A Genie space brings together governed data, defined metrics, and business context so teams can ask questions about their data in natural language and get answers grounded in your actual definitions and relationships.
Watch how to take it from setup to production-ready.
youtu.be/DkbvI81fHp4This media couldn't be displayed. See it on the original post. -
Databricks reposted
Manny Bernabe
@MannyBernabe
Killer skill stack right now: vibe coding + @databricks.
Fortune 1000 companies have the data. They don't have enough people building apps on it.
If you can walk in, vibe code on their data, and deploy securely back to Databricks, you're in a different league.
Amateur to pro vibe coder. ๐This media couldn't be displayed. See it on the original post. -
Databricks reposted
Databricks AI Research
@DbrxMosaicAI
New research from Databricks AI Research: FlashOptim cuts training memory by over 50% with no measurable loss in model quality.
Training a model with AdamW typically requires 16 bytes per parameter just for weights, gradients, and optimizer state. FlashOptim brings that down to 7 bytes, or 5 with gradient release. For Llama-3.1-8B finetuning, peak GPU memory drops from 175 GiB to 113 GiB.
Two techniques drive this: improved master weight splitting using tighter ULP-normalized error correction, and companded optimizer state quantization that reduces quantization error and improves convergence.
FlashOptim works as a drop-in replacement for SGD, AdamW, and Lion, supports distributed training with DDP and FSDP2, and is open source.
Paper: arxiv.org/html/2602.23349v1
Source code: github.com/databricks/flashoptim -
Databricks
@databricks
Learn how the best teams are building AI agents at scale.
Data + AI Summit 2026 features 800+ technical sessions on building production agents, agentic architectures, data engineering, governance, and real-world implementations.
See how it's done from the teams building it.
June 15-18 in San Francisco. Register:
www.databricks.com/dataaisummit -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
Tomorrow is the big day!
Be sure to join me to learn more about Agentic AI in Modern Data Workflows - you'll hear from experts at Databricks and Anthropic on all things Analytics and what things are changing.
And you'll get to see me discuss things like Semantic Layers, Agentic AI, personal AI spaces, and more in Databricks!
www.databricks.com/resources/webinar/its-time-leave-legacโฆ -
Databricks
@databricks
Shipping enterprise data and AI apps means handling auth, governance, and deployment from day one.
Databricks Apps and the new AppKit make that simpler. Build in TypeScript with production-ready patterns and run your app directly alongside governed data.
With @Replit integration, you can develop data-aware apps using natural language and deploy straight to Databricks under existing authentication and Unity Catalog controls.
www.databricks.com/blog/ship-enterprise-apps-faster-databโฆ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
IDP (Intelligent Document Processing) in @databricks is an incredibly useful tool to turn your Unstructured Documents into Structured data in a Database.
For the past few weeks weโve been digging into Ai_parse_document, Ai_extract, and Ai_classify and in this video we are putting it all into one easy to follow lesson!
youtu.be/nizvj7xAwq8 -
Databricks
@databricks
Still maintaining two engines for streaming? It's time to simplify.
Now you can get millisecond-level latency using the same Apache Spark APIs you already know.
Using Real-Time Mode (RTM) in Spark Structured Streaming, you get the best of both worlds:
โข Ultra-low latency (millisecond-level p99s) on Spark
โข A unified codebase using the familiar Spark APIs for all your streaming use cases
โข Lower ops overhead by eliminating second-engine complexity
Whether it's fraud detection, instant personalization, or generating real-time context for your AI agents, using RTM to keep your stack unified is the ultimate productivity hack for data teams. www.databricks.com/blog/real-time-mode-ultra-low-latency-โฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
Exactly 10 years ago (Jan 2016), I stepped in as CEO. We had just closed out Q4 with a total of $600k in revenue (screenshot from board deck).
Fast forward a decade.
Q4 audited GAAP Revenue: $1,290M and over $5.4B revenue run-rate ending January.
Iโve never tweeted our exact quarterly financials before, but seeing that $1.29B number cross my desk on my 10-year anniversary hit differently. To the team that built this: thank you. If you're following the data space, you know exactly what this milestone means. ๐๏ธ -
Databricks
@databricks
A new home for the Databricks community is here.
Introducing the Databricks User Groups Platform, a centralized hub for data + AI communities to connect, learn, and grow.
Itโs never been easier to:
- Connect: Join local chapters or virtual interest groups
- Learn: Discover and RSVP for upcoming community events
- Lead: Apply to become an organizer and host your own meetups
Start exploring today: usergroups.databricks.com -
Databricks
@databricks
When the same business metric is calculated five different ways, it slows decisions and creates confusion.
Databricks Metric View helps teams define metrics once in a governed semantic layer, so everyone sees the same trusted numbers in SQL, dashboards, alerts, and Genie.
Customize with AI, publish to Unity Catalog, and give your business a single source of truth for the metrics that matter.
youtu.be/75zcOOk6HowThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Great agents are only part of the equation. You also need a way to coordinate them.
Agent Bricks Supervisor Agent is now GA. It provides a single, governed entry point to orchestrate enterprise agents, route intent based on user questions, and enforce access to data and tools through Unity Catalog.
Built-in learning and evaluation let you continuously improve agent quality over time.
Start building โ www.databricks.com/blog/agent-bricks-supervisor-agent-nowโฆ -
Databricks
@databricks
Legacy BI wasnโt built for the way teams work today. Agentic analytics is.
Join next week's virtual event with @AnthropicAI and @Alex_TheAnalyst to see how agents built on a unified data platform can support the full analytics workflow โ from data prep to insight.
Youโll learn:
- How agentic analytics spans data prep to insight
- Whatโs new across Databricks analytics tools
- How Genie and Claude deliver agentic insights
- How to build end-to-end analytics workflows without BI seats
www.databricks.com/resources/webinar/its-time-leave-legacโฆ -
Databricks reposted
Databricks AI Research
@DbrxMosaicAI
New research from @databricks: LLMs Can Learn to Reason via Off-Policy RL
Optimal Advantage-based Policy Optimization with Lagged Inference policy (OAPL) shows you donโt need strict on-policy training to improve reasoning.
It matches or beats Group Relative Policy Optimization (GRPO), stays stable with large policy lag, and uses ~3ร fewer training generations.
For Databricks customers, itโs a simpler, practical, and equally powerful approach to RL that Databricks is pioneering internally โ and bringing directly to Databricks customers, so enterprises can improve agents using the same methods we use for our in-house agents, without complex infrastructure changes.
arxiv.org/pdf/2602.19362 -
Databricks
@databricks
How do you roll out changes safely at scale without slowing teams down?
To address this, Databricks engineers built SAFE, an internal feature flagging platform that decouples code deployment from feature enablementโmaking it possible to roll out features gradually, mitigate incidents quickly, and keep hundreds of services moving independently.
SAFE now supports more than 25,000 active flags and over 300 million evaluations per second. Lessons learned: pre-evaluate what you can, design for failure by default, and make the safest rollout path the easiest one for engineers to follow.
www.databricks.com/blog/high-availability-feature-flagginโฆ -
Databricks reposted
Replit โ
@Replit
Vibe Code Enterprise Data Apps with Replit + Databricks x.com/i/broadcasts/1kJzDMDdOoWKv
-
Databricks
@databricks
.@FedEx standardized its analytics platform to simplify governance and scale self-service access across a highly distributed global organization.
By automating infrastructure, metadata, and analytics environment provisioning, the platform supports 2,800+ users across 220 automated workspaces and 1,300+ governed data assets.
www.databricks.com/blog/how-fedex-built-scalable-enterpriโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
It's not often the co-founders and I author blog posts together, but we thought this one is important so we took time to write this together with the Neon team. In this blog we outline why we think a new type of database will slowly take over and replace all existing databases, we call it the Lakebase. We cover the WHY and the WHAT here:
๐ ๐๐๐ฐ ๐๐ซ๐ ๐จ๐ ๐๐๐ญ๐๐๐๐ฌ๐๐ฌ: ๐๐๐ค๐๐๐๐ฌ๐
www.databricks.com/blog/what-is-a-lakebase -
Databricks
@databricks
What separates companies that are productionizing AI agents from those that are stagnating?
Our usage data from 20,000+ global organizations shows:
- Companies that actively use AI governance put 12x more AI projects into production
- Companies that are actively using AI evaluation tools put over 6x more AI projects into production
Download the report to explore the data: www.databricks.com/resources/ebook/state-of-ai-agents -
Databricks
@databricks
Databricks DevConnect is back for 2026!
Built for developers, DevConnect is a technical meetup where weโll go deep into the tools and patterns powering production data and AI workloads.
What to expect:
- Deep dives on agentic workflows, MLflow 3.0, Unity Catalog, and more
- Live demos grounded in real-world use cases
- Direct access to Product, DevRel, Field Engineers, and MVPs
- Local networking with fellow developers
Find your city and register: www.databricks.com/events?event_type=devconnect®ion=all -
Databricks
@databricks
App development has completely transformed with agents, but the underlying databases have been largely unchanged since the 1980s.
Meet: Lakebase.
Lakebases are enabled by a fundamentally new design. The core breakthrough is separate storage and compute. Data sits directly in low-cost cloud storage in open formats, while the compute layer runs independently on top. And fully managed, serverless Postgres scales up instantly with demand and down when idle.
Learn about this new era of databases: www.databricks.com/blog/what-is-a-lakebase -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
They're putting me on the big screen!
I'm joining @databricks and @AnthropicAI in a Webinar to talk about Agentic AI in Analytics!
The Data space is changing and there are so many huge things happening that data professionals need to be aware of. Engineers at Databricks and Anthropic will demo and discuss in depth how AI is being added to the Database layer and integrated into workflows.
I'll be demoing how to use AI Agents in Databricks in under 15 minutes - breaking down how AI Agents work, how to build a Semantic Layer, and get insights in your data quickly.
Webinar is March 4th - be sure to sign up!
www.databricks.com/resources/webinar/its-time-leave-legacโฆ -
Databricks
@databricks
What if you could surface new insights from your enterprise data by just asking questions?
Genie Research Agent is built for forward-looking questions. Hereโs how it works:
- Ask a question like โHow can we optimize bookings revenue?โ
- Genie builds a research plan
- Tests each hypothesis
- Iterates as it learns
- Summarizes results in natural language, tables, and visuals
- Export the full research as a PDF for sharing โ -
Databricks
@databricks
While some companies are still piloting GenAI, @Mastercard is running AI inference on ~160B transactions a year โ with just 50ms to score each payment.
In this @VentureBeat podcast episode, Mastercardโs Johan Gerber and Chris Merz break down Decision Intelligence Pro, their RNN-based โinverse recommenderโ that predicts legitimate behavior in real time, and how GenAI honeypots help expose mule accounts.
They also share why moving to Databricks and the cloud was critical to accelerating model development, cutting innovation cycles from months to hours.
www.youtube.com/watch?v=XF5oGJmVhIA -
Databricks
@databricks
Join thousands of your peers for 800+ sessions, keynotes and training at the worldโs largest data, analytics and AI conference.
Data + AI Summit is back in San Francisco, June 15-18! ๐
Register today to take advantage of early bird pricing: www.databricks.com/dataaisummit -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
Take hundreds of unstructured PDFs and turn them into tables in a database with Databricks!
In this video, we are building a full end to end project taking PDFs, classifying them, and extracting data to put into tables.
Check it out!
www.youtube.com/watch?v=jvg60_1JSx0 -
Databricks
@databricks
Push 10+ GB/sec to your lakehouse in under 5 seconds.
Zerobus Ingest is now Generally Available, streaming data directly into your lakehouse โ no message bus required.
This means less infrastructure to manage, lower costs, and faster access to real-time data.
Key capabilities:
โข Sub-5-second latency for thousands of concurrent connections
โข Supports over 10 GB/sec aggregate throughput to a single table
โข gRPC API and REST API (Beta) with production-ready SDKs, plus SDKs for Python, Java, Rust, Go, and Typescript
โข Built-in governance with Unity Catalog
www.databricks.com/blog/announcing-general-availability-zโฆ -
Databricks
@databricks
Turn AI-powered analytics from something that โseems to workโ into something users can trust.
In this example, we built a marketing campaign Genie space and used 13 benchmark questions to systematically improve accuracy โ from 0% at baseline to 100%.
By refining metadata, defining join relationships, clarifying custom metrics like CTR, and documenting domain-specific rules, benchmarks transformed subjective confidence into measurable validation.
If you're building Genie for production, this is the blueprint.
www.databricks.com/blog/how-build-production-ready-genie-โฆ -
Databricks
@databricks
Databricks AI Functions and the Information Extraction Agent Brick help teams unlock critical information trapped in PDFs and documents.
By combining built-in AI with domain-specific agents, teams can quickly extract key data, validate it with experts, and turn unstructured content into reliable, actionable intelligence that is ready for production.
Follow the step-by-step guide to get started. www.databricks.com/blog/building-regulatory-risk-copilot-โฆ -
Databricks
@databricks
Three beginner-friendly analytics projects you can finish in an afternoon with Databricks Free Edition ๐
โข Analyze a simulated environment using AI/BI Dashboards and AI_Query()
โข Explore sample trends and generate predictions with AI_Forecast()
โข Load open data with Python and explore it using SQL
Each project uses public or sample datasets to build real dashboards and code you can showcase in your portfolio. Start building: www.databricks.com/blog/tutorial-3-free-databricks-analytโฆ -
Databricks
@databricks
.@thumbtack reviews tens of millions of messages each year to maintain marketplace trust while meeting strict privacy requirements.
By unifying its GenAI workflows, the team fine-tuned LLMs to detect nuanced policy violations that rules alone couldnโt catch. Precision improved 3.7ร and recall 1.5ร, while shared workflows and privacy-first controls help teams collaborate on trust and safety at scale across a global marketplace.
See how: www.databricks.com/blog/thumbtack-powering-safe-smart-homโฆ -
Databricks
@databricks
Get hands-on with data and AI at Databricks AI Days.
Join us in 38 cities to see how leading companies build data apps and AI agents that ship. Youโll get real-world customer use cases, live demos, and guided training designed for teams early in their Databricks journey.
Find your city โ
www.databricks.com/ai-days?region=amer?utm_source=twitter -
Databricks
@databricks
Built for application developers. Designed for DBAs.
Databricks Lakebase modernizes OLTP with:
- Familiar Postgres semantics for developers
- Automatic scaling and recovery for admins
- Separation of compute and durable state
- One platform for operational, analytical, and AI workloads
Now Generally Available:
www.databricks.com/blog/databricks-lakebase-generally-avaโฆ -
Databricks
@databricks
Google's Gemini 3.1 Pro models are now available on Databricks.
Use Googleโs Gemini 3.1 Pro on Databricks to build and scale GenAI applications on your enterprise data โ end to end, with the governance and operational tooling teams need for production.
Gemini 3.1 Pro delivers top results on OfficeQA, a Databricks benchmark for real-world document Q&A, for grounded Q&A with PDFs. Customers can now extract clear answers, summaries, and key takeaways from enterprise documents like policies, contracts, reports, and manuals.
Databricks is the only platform with Gemini, Claude, and OpenAI. We canโt wait to see what customers build! docs.databricks.com/aws/en/release-notes/product/2026/febโฆ -
Databricks
@databricks
Get hands-on with MCP.
MCP Academy is a practical, half-day training for developers building AI agents. Brought to you by Databricks and @StackLokHQ, youโll learn how to build secure MCP servers, curate trusted registries, and use MCP skills to expand what your agents can do.
๐ Join us in Atlanta, Austin, Boston, Chicago, New York, and San Diego: luma.com/mcpacademy
Databricks
@databricks
๐๏ธ Spots are filling quickly. Register now and use code AGENTBRICKS to save 50%.
-
Databricks
@databricks
Ship enterprise apps faster with Databricks AppKit and @Replit.
AppKit is a TypeScript framework with built-in observability and seamless integration with Databricks services. The new Replit integration lets you develop data-aware apps using natural language and deploy directly to Databricks with Unity Catalog governance built in.
Less code, fewer bugs, faster production. www.databricks.com/blog/ship-enterprise-apps-faster-databโฆ -
Databricks
@databricks
Registration for Data + AI Summit 2026 is now open!
Join us in San Francisco June 15-18 for the worldโs largest data, analytics and AI conference.
โก๏ธ 800+ technical sessions
โก๏ธ Live training on AI, analytics & BI, data engineering and more
โก๏ธ Networking opportunities with global data + AI professionals and experts
โก๏ธ The latest from the leading innovators and researchers in AI
Early Bird pricing runs through April 30! Secure your spot here: www.databricks.com/dataaisummit -
Databricks
@databricks
[DEMO] Explore, filter, and investigate live data in one dashboard.
This walkthrough shows how teams move from high-level metrics to deeper analysis in place.
Apply filters across pages, interact with visuals, drill into detailed records, and ask Genie to explain changes without leaving the dashboard.
youtu.be/dU2AEU3BLMAThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Neon
@neondatabase
Install the Neon plugin to
โข deploy serverless Postgres databases
โข create testing environments with real data
โข restore instantly or roll your app back to a past state
All directly from Cursor
Cursor
@cursor_ai
Extend Cursor with plugins, now available in our marketplace.
-
Databricks
@databricks
.@Anthropicโs Claude Sonnet 4.6 just landed on Databricks.
With Sonnet 4.6 on Databricks, users benefit from Anthropicโs most capable agentic model, while gaining a single view of usage, spend, and performance โ ensuring consistent permissions, guardrails, and rate limits without the need for extra integrations.
What this means for you:
- Build domain-specific agents with Agent Bricks
- Automate enterprise workflows with fewer iterations
- Deploy securely with built-in governance and observability
With Databricks, you get the flexibility to securely run leading models on your data and scale as you grow.
Claude Sonnet 4.6 delivers near-Opus level intelligence. Get started on Databricks: docs.databricks.com/aws/en/release-notes/product/2026/febโฆ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
In this weeks @databricks lesson we are taking a look at ai_classify!
With ai_classify you can classify your files and label them before you actually start extracting your data.
Imagine you have a ton of files in a folder and you want to extract the data, but they're all mixed in with tons of other files - this is how you can easily classify and separate them
youtu.be/bgi96tG2y9U -
Databricks
@databricks
What if your BI tool didn't just answer questions, but helped build the analysis for you?
This is the shift towards agentic analytics that we're driving with Databricks AI/BI, Databricks One, and Genie.
Our latest updates bring intelligent agents that:
- Build dashboards from a single prompt with agentic dashboard authoring
- Conduct deep multi-step research with Genie Research
- Deliver insights at scale through natural language, without deep technical expertise
This is an evolution of how modern analytics is built, shared, and trusted by all. www.databricks.com/blog/whats-new-aibi-february-2026-roundup -
Databricks
@databricks
Which AI use cases are dominating the enterprise landscape?
We looked at usage data from companies across industries. Key findings:
- The top use cases are focused on automating routine operational tasks
- 40% of the top use cases support customer engagement and experience
Explore more Databricks insights in the 2026 State of AI Agents report.
www.databricks.com/resources/ebook/state-of-ai-agents -
Databricks
@databricks
In the latest episode of Over Architected with Nick Karpov and Holly Smith, they walk through some of the most notable updates from Databricks, including:
- New Connectors
- Lakebase autoscaling
- Knowledge Assistant
- Delta Sharing to Iceberg
- & more!
youtu.be/vzu06KGTOrQThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
If you are responsible for data warehousing or BI, you are likely being asked to do more than deliver dashboards. You need to unify data, support real-time analytics, and prepare your organization for AI โ without adding complexity.
The Big Book of Data Warehousing and BI shares practical guidance on how lakehouse architecture helps teams:
- Migrate from traditional data warehouses
- Apply dimensional modeling in a lakehouse
- Manage cost and performance at scale
- Govern data while supporting modern BI workflows
www.databricks.com/resources/ebook/big-book-data-warehousโฆ -
Databricks
@databricks
More teams are exploring agentic analytics to simplify how they work with data.
Join this upcoming virtual event with @AnthropicAI and @Alex_TheAnalyst to see how agentic analytics is changing how teams work โ and learn practical skills for:
- How agentic analytics spans data preparation through insight
- Whatโs new across Databricks analytics tools
- How Genie and Claude deliver agentic insights
- How to build end-to-end analytics workflows without BI seats
www.databricks.com/resources/webinar/its-time-leave-legacโฆ -
Databricks
@databricks
.@AWNetworks ingests more than one trillion security events per day into a petabyte-scale Delta Lake. Late-arriving data and small files made partitioning and Z-ordering hard to operate at this scale.
Thatโs why the team rebuilt the layout using liquid clustering on Unity Catalogโmanaged tables, clustering data as it arrives and aligning it to query patterns.
New data is now queryable within minutes โ reducing reliance on frequent global optimizations, while historical scans remain fast across months of data.
www.databricks.com/blog/arctic-wolfs-liquid-clustering-arโฆ -
Databricks
@databricks
Databricks co-founder and CTO @matei_zaharia on the gap between AI demos and production reality:
โItโs very easy to get a demo that works 50% of the time and think youโve solved the problem. Getting something thatโs highly reliable and diligent in production is much harder.โ
In this conversation with @thejosuebogran, they discuss:
- What LLMs are actually reliable at today
- Why polished demos often fail in real production systems
- The role of feedback loops, evaluation, and human verification
- How to reason about ROI when systems are probabilistic, not deterministic
youtu.be/nGu7ylYpycY -
Databricks
@databricks
Stop context-switching between fragmented data engineering tools. Lakeflow on Azure Databricks unifies ingestion, transformation, and orchestration on a single platform, so you can build faster and ship more reliably.
Data engineers using Lakeflow on Azure Databricks are seeing:
- Pipelines built and deployed up to 25x faster
- Performance improvements up to 90x
- ETL cost reductions up to 83%
- 99.9% orchestration reliability
Powered by serverless compute, Unity Catalog governance, and built-in observability. www.databricks.com/blog/modernize-your-data-engineering-pโฆ -
Databricks
@databricks
Our AI research team evaluated NVIDIA MPS to understand when multi-engine inference on shared GPUs improves throughput for small language models.
They found that:
- MPS is most effective for very small models (โค3B parameters), short-to-medium contexts, and prefill-heavy workloads.
- Throughput gains come from overlapping otherwise underutilized GPU work and reducing idle time during CPU-bound phases.
- The impact varies as model size, context length, and workload characteristics change.
Read the full analysis. www.databricks.com/blog/scaling-small-llms-nvidia-mps -
Databricks
@databricks
AI-driven development is changing the pace at which applications are built. As teams move faster, database management needs to evolve with them.
Databricks co-founder @rxin on what that evolution requires:
โFor the vibe coding trend to take off, you need developers to believe they can actually create new apps very quickly, but you also need the central IT team or DBAs to be comfortable with the tsunami of apps and databases. Classic databases simply wonโt scale to that because they canโt afford to put a DBA per database and per app.โ
Lakebase is built for this.
Thanks to @TechJournalist & @VentureBeat for the conversation. venturebeat.com/data/databricks-serverless-database-slashโฆ -
Databricks
@databricks
Databricks Delta Sharing now has first-class support for Apache Iceberg.
As the most widely adopted open protocol for data and AI sharing, Delta Sharing now lets data providers securely share live Iceberg data from Databricks to any Iceberg-compatible client.
Companies like Navitaire, an Amadeus company, use this capability to deliver governed data products to airlines, giving customers direct access to trusted insights without copying data.
Learn more about this release: www.databricks.com/blog/announcing-first-class-support-icโฆ -
Databricks
@databricks
Enterprise AI needs more than great agents. It needs a way to orchestrate them.
Agent Bricks Supervisor Agent is now GA, giving teams a single, governed entry point to orchestrate enterprise agents.
Route intent, enforce access to data and tools with Unity Catalog, and continuously improve quality with built-in learning and evaluation.
Start building โ www.databricks.com/blog/agent-bricks-supervisor-agent-nowโฆ -
Databricks
@databricks
โItโs rare to see somebody say โI have a lot of agents in production really effectively.โ The place we spend a lot of time on is: How do you govern it and get security? How do you get really high quality out of it? How do you balance cost and quality?โ
Databricks co-founder Arsalan Tavakoli joined @tbpn hosts @johncoogan & @jordihays to discuss the state of AI agents and the challenges enterprises experience as they deploy them at scale.
www.youtube.com/live/3gWC3QWmuUU?t=9929 -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
In this weeks @Databricks lesson we are using IDP (Intelligent Document Processing) to extract data from our Unstructured Documents using ai_extract.
Unstructured files are notoriously difficult to work with, but IDP makes it pretty streamlined all within Databricks! -
Databricks
@databricks
Databricks CEO @alighodsi joined CNBCโs @dee_bosa to discuss the latest funding round and the growing role of AI agents in software development.
โIn the next couple of years, there is going to be more software and more databases created than weโve ever had in the history of mankind,โ said Ghodsi. "We are investing in products like Genie that let you just ask your data questions and get insights, and in Lakebase, a database that caters to agents.โ
Watch the full conversation: youtu.be/Ha3T6JN-0s4 -
Databricks reposted
Deirdre Bosa
@dee_bosa
Databricks is showing us what the AI economy looks like under the hood... and its BOOMING.
80% of databases on their platform are being built by AI agents. Which means AI is building more enterprise software than humans are.
We talk to @alighodsi today. Link to livestream below.
Ali Ghodsi
@alighodsi
I now constantly get questions about the SAAS meltdown, role of AI, system of records etc. I don't have an answer to all these.
But I do know that we saw an acceleration in our business in Q2, Q3, and now finished the year with accelerating Q4.
The question is, why?
Short answer: AI. But the underlying reason is subtle. We are growing fast because we are finally removing the biggest bottleneck in data: the technical barrier to entry.
For years, if you didnโt know SQL, Python, you were locked out of the value chain. That has changed fundamentally with the ๐๐๐ง๐ข๐ ๐๐๐ฆ๐ข๐ฅ๐ฒ, and it is the "secret sauce" behind our recent momentum:
โข ๐๐๐ง๐ข๐: Analysts can query data without any SQL. I use this every day myself.
โข ๐๐๐ญ๐ ๐๐๐ข๐๐ง๐๐ ๐๐๐ง๐ข๐: Builds end-to-end AI models for you, similar to Cursor for ML on your data.
โข ๐๐๐ญ๐ ๐๐ง๐ ๐ข๐ง๐๐๐ซ ๐๐๐ง๐ข๐: Write Spark pipelines, does plumbing, troubleshooting.
We've been talking about DATA + AI democratization, but generative AI finally enabled it in a way that wasn't possible before. That's why we're seeing a market response.
Take ๐๐๐ค๐๐๐๐ฌ๐ ๐๐จ๐ฌ๐ญ๐ ๐ซ๐๐ฌ. We launched this serverless engine for agents and apps recently. At 8 months into its journey, its revenue is already 2x what our Data Warehouse product was at the same stage.
All this taken together, we ended up with the following stats for Q4:
๐ $5.4B Revenue Run-Rate, growing >65% YoY
๐ $1.4B AI Revenue Run-Rate
๐ FCF Positive for the year
๐ NRR >>140%
www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
I now constantly get questions about the SAAS meltdown, role of AI, system of records etc. I don't have an answer to all these.
But I do know that we saw an acceleration in our business in Q2, Q3, and now finished the year with accelerating Q4.
The question is, why?
Short answer: AI. But the underlying reason is subtle. We are growing fast because we are finally removing the biggest bottleneck in data: the technical barrier to entry.
For years, if you didnโt know SQL, Python, you were locked out of the value chain. That has changed fundamentally with the ๐๐๐ง๐ข๐ ๐๐๐ฆ๐ข๐ฅ๐ฒ, and it is the "secret sauce" behind our recent momentum:
โข ๐๐๐ง๐ข๐: Analysts can query data without any SQL. I use this every day myself.
โข ๐๐๐ญ๐ ๐๐๐ข๐๐ง๐๐ ๐๐๐ง๐ข๐: Builds end-to-end AI models for you, similar to Cursor for ML on your data.
โข ๐๐๐ญ๐ ๐๐ง๐ ๐ข๐ง๐๐๐ซ ๐๐๐ง๐ข๐: Write Spark pipelines, does plumbing, troubleshooting.
We've been talking about DATA + AI democratization, but generative AI finally enabled it in a way that wasn't possible before. That's why we're seeing a market response.
Take ๐๐๐ค๐๐๐๐ฌ๐ ๐๐จ๐ฌ๐ญ๐ ๐ซ๐๐ฌ. We launched this serverless engine for agents and apps recently. At 8 months into its journey, its revenue is already 2x what our Data Warehouse product was at the same stage.
All this taken together, we ended up with the following stats for Q4:
๐ $5.4B Revenue Run-Rate, growing >65% YoY
๐ $1.4B AI Revenue Run-Rate
๐ FCF Positive for the year
๐ NRR >>140%
www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks reposted
CNBC
@CNBC
Databricks completes $5 billion funding round at $134 billion valuation www.cnbc.com/2026/02/09/databricks-completes-5-billion-fuโฆ
-
Databricks
@databricks
Today we announced Databricks Q4 results:
* Surpassing $5.4B revenue run-rate, growing >65% year-over-year
* Delivering positive free cash flow over the last 12 months
* Crossing $1.4 billion revenue run-rate for our AI products
Databricks is also completing investments in the company in excess of $7 billion, including ~$5B of equity financing at a $134 billion valuation and ~$2B of additional debt capacity.
โWeโre seeing overwhelming investor interest in our next chapter as we go after two new markets,โ said @alighodsi, co-founder and CEO of Databricks.
โWith this new capital, weโll double down on Lakebase so developers can create operational databases built for AI agents. At the same time, weโre investing in Genie to let every employee chat with their data, driving accurate and actionable insights.โ
www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
[DEMO] Databricks Lakebase brings fully managed, serverless Postgres to the Databricks platform to power data apps and AI agents, fully integrated with the lakehouse.
What youโll learn:
- How Lakebase fills the gap between traditional OLAP and OLTP systems
- The benefits of a serverless Postgres architecture
- How to use Lakebase for data apps, internal tools, and AI agents
youtu.be/UQynsu6qklwThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Most GenAI projects do not struggle because of the technology.
They stall because teams optimize for demos instead of building what is required to run in production.
Hubert Dudek breaks down what teams that actually ship do differently: grounding AI in governed data, defining quality early, and keeping cost visible.
www.sunnydata.ai/blog/why-95-percent-genai-projects-fail-โฆ -
Databricks
@databricks
Data engineers said โmake it faster.โ So we did.
- UC governed queries up to 10x faster
- Geospatial analytics up to 17x faster
- AI Functions up to 85x faster
In 2025, average performance across production analytics workloads improved by up to 40%, with no tuning or query rewrites.
www.databricks.com/blog/2025-review-databricks-sql-fasterโฆ -
Databricks reposted
TBPN
@tbpn
Databricksโ @djpersia says anyone claiming you can just vibe code any software you need isnโt actually in the business of using software in production.
โBuild is easy - maintaining and sustaining it is hard.โ
โIf I can, Iโd much rather buy than build.โ
โFor things like my CRM - that is not something that, if I can help it, Iโm looking to build internally. Iโm happy to use something externally, given that I imagine my needs are similar to many other ones, and there should be things that could meet those needs pretty quickly.โ -
Databricks
@databricks
Weโre proud to be recognized as a Leader in the 2025 IDC MarketScape for Unified AI Governance Platforms!
The IDC MarketScape evaluated vendors on their ability to support unified governance across data, models, and agentic AI systems as organizations move from experimentation to production at scale. Databricks was recognized for its strengths in strategy and comprehensive governance across the AI lifecycle.
Thanks to @IDC for the recognition. Read the excerpt here: www.databricks.com/resources/analyst-research/idc-aigoverโฆ -
Databricks
@databricks
We just launched our new R&D and Engineering hub in New York City! ๐ฝ
We're building on our existing AI teams to create a world-class engineering site in one of the world's top centers for technical talent. NYC represents a major expansion of our engineering capacity as we continue to build the future of data and AI. -
Databricks reposted
Matei Zaharia
@matei_zaharia
Agentic Data Quality Monitoring is now in public preview on @Databricks, powered by Unity Catalog! This next generation of monitoring looks at how your data is used to automatically flag the most important issues without needing manual rules & thresholds. www.databricks.com/blog/data-quality-monitoring-scale-ageโฆ
-
Databricks
@databricks
Claude Opus 4.6 is now available on Databricks!
@AnthropicAI's most advanced model yet is built to power agents that take on real-world workโfrom autonomous coding and cybersecurity to financial analysis and enterprise workflows. And now you can apply it directly to your governed data in Databricks.
With Claude Opus 4.6 on Databricks, you can:
โข Build domain-specific agents with Agent Bricks
โข Run complex analysis from SQL and Python with AI Functions
โข Automate workflows across documents, spreadsheets, and internal data
โข Deploy securely with governance, observability, and scale built in
Get started โ docs.databricks.com/aws/en/release-notes/product/2026/febโฆ -
Databricks
@databricks
Most enterprise data lives in documents that traditional parsing tools canโt fully understand:
โข receipts and invoices
โข dense tables and scanned pages
โข inconsistent, messy layouts
This video walks through ai_parse_document in Agent Bricks, how it evolved from a hackathon project into a production-grade capability, the research behind handling that document diversity, plus a live receipt extraction demo.
youtu.be/kH7p1lr4Be4 -
Databricks
@databricks
AI agents are no longer just writing code. Theyโre building the data layer itself.
New data shows agents now create 80% of enterprise databases and 97% of dev and test environments. This is evidence of a broader shift in data infrastructure - it needs to evolve to support building intelligent apps at machine-speed iteration.
@nikitabase, VP at Databricks and co-founder of @neondatabase, explains what is driving the move to a new kind of database: โThe database is the system of record for AI applications. Itโs no longer just a place to store rows; itโs the persistent memory and coordination layer for multi-agent systems.โ
More from @Forbes writer @iamVictorDey: www.forbes.com/sites/victordey/2026/02/04/databricks-saysโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Agent memory is a simple and powerful way to do continual learning! With the new MemAlign method from Databricks Research, we can build better LLM judges from examples of human ratings, and they scale with more data. Now in Databricks and @MLflow. www.databricks.com/blog/memalign-building-better-llm-judgโฆ
-
Databricks
@databricks
[DEMO] AI-powered Q&A only drives value when it fits naturally into how people already work.
See how AI/BI Genie can be deployed across dashboards, Databricks One, applications and APIs, and multi-agent systemsโso users can ask questions and get answers without leaving their workflow: youtu.be/nXYMZ0X-IykThis media couldn't be displayed. See it on the original post. -
Databricks reposted
VentureBeat
@VentureBeat
Databricks' serverless database slashes app development from months to days as companies prep for agentic AI
venturebeat.com/ai/databricks-serverless-database-slashesโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Lakebase is GA! We think this is going to make it radically simpler and more reliable to work with online databases. You can instantly branch your DB, take snapshots, roll back to a point in time, or create a copy for offline analysis, whether it's humans or AI doing the work.
Databricks
@databricks
Operational databases have long relied on tightly coupled compute and storage. This architecture creates resource contention and pushes teams to manage infrastructure rather than build. As applications become more real time and automated, the transactional layer needs to adapt.
Databricks Lakebase is built for that evolution:
โข Familiar Postgres semantics for app developers
โข Compute separated from durable state
โข Operational data running directly on the lakehouse
โข Serverless autoscaling (including scale to zero), branching, and recovery to match agent-driven workload
Now generally available: www.databricks.com/blog/databricks-lakebase-generally-avaโฆ -
Databricks
@databricks
Operational databases have long relied on tightly coupled compute and storage. This architecture creates resource contention and pushes teams to manage infrastructure rather than build. As applications become more real time and automated, the transactional layer needs to adapt.
Databricks Lakebase is built for that evolution:
โข Familiar Postgres semantics for app developers
โข Compute separated from durable state
โข Operational data running directly on the lakehouse
โข Serverless autoscaling (including scale to zero), branching, and recovery to match agent-driven workload
Now generally available: www.databricks.com/blog/databricks-lakebase-generally-avaโฆ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
In this weeks @databricks lesson we are using IDP to parse our Unstructured Documents using ai_parse_document.
In next weeks lesson we will be looking at ai_extract to then pull that data and put it into columns and rows to make it more usable.
Unstructured files are notoriously difficult to work with, but IDP makes it pretty streamlined all within Databricks!
www.youtube.com/watch?v=3rOk2sIp9P4 -
Databricks
@databricks
Weโve open-sourced Dicer, the auto-sharding system we use at Databricks to run large, stateful services reliably at scale.
Dicer dynamically manages shard assignments to keep services fast and available during restarts, failures, and load shifts.
It now underpins mission-critical systems like Unity Catalog and our SQL query orchestration engine, where itโs eliminated availability dips and kept cache hit rates above 90% in production: www.databricks.com/blog/open-sourcing-dicer-databricks-auโฆ -
Databricks
@databricks
Get trusted answers from enterprise data without leaving your daily work.
@Atlassian's new Databricks Query Runner agent brings conversational analytics into Rovo. Powered by the Databricks AI/BI Genie Conversation API, teams can ask questions in plain English and get governed insights from Databricks directly inside Jira and Confluence: www.databricks.com/blog/databricks-genie-powers-conversatโฆ -
Databricks
@databricks
The Big Book of Data Warehousing and BI looks at why lakehouse architecture is foundational to unifying data, enabling real-time analytics, and preparing for AI across the enterprise.
Explore practical guidance on:
- Migrating from traditional data warehouses
- Modeling data in a lakehouse
- Managing cost and performance at scale
- Governing data while supporting modern BI and analytics workflows
www.databricks.com/resources/ebook/big-book-data-warehousโฆ -
Databricks
@databricks
Learn Databricks in under two hours as @Alex_TheAnalyst walks through the platform end to end, including:
โ Importing files and data sources
โ Exploring SQL Editor and notebooks
โ Building dashboards
โ And trying out AI tools like Genie and the Databricks Assistant
Follow along with Databricks Free Edition: www.youtube.com/watch?v=CoqZTt528ew -
Databricks
@databricks
What if you could ask AI to analyze your data for trends and outliers and it just does it?
In this demo, Databricks Assistant shows how exploratory data analysis can happen directly in the workspace. Switch a notebook to agent mode and the Assistant can find tables, write and run code, create visualizations, and iterate on results, all from a single natural language prompt: youtu.be/E-TC-rj7t0Q -
Databricks
@databricks
We analyzed Agent Bricks usage data to understand how companies are actually using AI agents in real situations.
The key finding: building multi-agent systems is a top use case and grew 327% โ marking the next frontier in enterprise AI.
Learn more about this and other AI trends in the State of AI Agents: www.databricks.com/resources/ebook/state-of-ai-agents -
Databricks
@databricks
Together, Databricks and @PalantirTech are accelerating high-impact AI use cases and outcomes.
In this walkthrough, architects from both teams break down how the integration enables:
- Secure, bidirectional data federation with minimal data movement
- Unified governance through Unity Catalog
- Compute pushdown so workloads run where the data lives
- Tighter integration across analytics, workflows, and operational AI
youtu.be/BsSwqYuok1A -
Databricks
@databricks
Data orchestration is evolving from workflow-first to data-first.
As modern data platforms become more governed and event-driven, orchestration moves closer to the data layer. Lakeflow Jobs is built for this shift, with native triggers, built-in lineage, and AI-ready workflows that eliminate the need to manage schedulers or infrastructure.
See how data-first orchestration simplifies modern pipelines: www.databricks.com/blog/from-airflow-to-lakeflow-data-firโฆ -
Databricks
@databricks
In the State of AI Agents, usage data shows how AI agents are reshaping database operations across production and development workflows.
Key findings:
- 97% of database branches for testing and development are now created by AI agents, reducing setup time from hours to seconds
- 80% of databases on @neondatabase are now created by AI agents, up from 0.1% two years ago
Read the new report: www.databricks.com/resources/ebook/state-of-ai-agents -
Databricks
@databricks
The future of data belongs to agentic analytics, not legacy BI.
In this upcoming virtual event with @AnthropicAI and @Alex_TheAnalyst, see how agentic analytics is changing how teams work โ and learn practical skills for:
- How agentic analytics spans data prep to insight
- Whatโs new across Databricks analytics tools
- How Genie and Claude deliver agentic insights
- How to build end-to-end analytics workflows without BI seats
www.databricks.com/resources/webinar/its-time-leave-legacโฆ -
Databricks
@databricks
Databricks Chief AI Scientist @jefrankle recently joined @radicalvcfund partner @vin_sachi for a Masterclass session on whatโs actually holding enterprise AI back.
Jonathan shares his path from academia to Databricks, why early efficiency breakthroughs now feel โquaint,โ how evaluation has become the missing infrastructure for AI in production, and why adoption is constrained less by talent than by confidence, proof, and measurement.
Listen to the full conversation: radical.vc/jonathan-frankle-on-the-future-of-enterprise-ai/ -
Databricks
@databricks
Agent Bricks Knowledge Assistant is now Generally Available!
You can now deploy a fully managed AI agent grounded in your own documents in minutes and get accurate, cited answers you can trust.
Powered by Databricks AI Research, Knowledge Assistant delivers higher-quality results than traditional RAG, with continuous upgrades, built-in evaluation, and a scalable inference API that improves answer quality over time without requiring teams to rebuild or redeploy their agent.
www.databricks.com/blog/agent-bricks-knowledge-assistant-โฆ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
~80% of all companies data is kept in Unstructured formats. This means it's hard to really use it like you would tabular data!
IDP (Intelligent Document Processing) is focused on making that Unstructured data more accessible and readily available.
In this lesson we take a look at IDP in @databricks and in the next several lessons we will be diving into the code to get data from unstructured to structured.
www.youtube.com/watch?v=ItzSyfNEptk -
Databricks
@databricks
Introducing the 2026 State of AI Agents: a new report that examines enterprise AI trends based on usage data from 20,000+ global organizations.
Get answers to questions like:
โ๏ธ What are the most common AI use cases?
โ๏ธ What are companies getting AI into production doing differently?
โ๏ธ How are AI agents driving database transformation?
Download the report to explore the data: www.databricks.com/resources/ebook/state-of-ai-agents -
Databricks
@databricks
.@7eleven store maintenance technicians keep stores running smoothly by servicing a wide range of equipment โ from food service appliances and refrigeration units to fuel dispensers and Slurpee machines.
To support faster fix times, 7-Eleven built an AI agent that provides instant document access and visual part identification.
By unifying retrieval and image understanding on the lakehouse, 7-Eleven:
- Cut search time by up to 60%
- Improved first-time-fix rates by 25%
- Reduced latency by over 40% after consolidating a complex setup
www.databricks.com/blog/how-7-eleven-transformed-maintenaโฆ -
Databricks
@databricks
[DEMO] Databricks AI Guardrails block sensitive data before it ever leaves your environment.
@dennylee shows how PII like UK National Insurance numbers and credit card data is detected and stopped locally at the serving endpoint, instead of being sent to an external model.
Watch guardrails in action by comparing endpoints with and without protection enabled. youtu.be/EWDkTlMQ3ao -
Databricks
@databricks
Data modeling on the Lakehouse looks different than it did a few years ago.
Which warehouse patterns still hold up? Whatโs evolved? And how does the medallion architecture fit alongside newer, more flexible modeling approaches?
This post breaks down common myths and shares practical guidance for building relational and dimensional models with keys, constraints, and BI-grade performance on Databricks: www.databricks.com/blog/databricks-lakehouse-data-modelinโฆ -
Databricks
@databricks
Speaking at #dataaisummit is a great way to showcase your impact, build credibility, and advance your career.
If youโre working on real problems in data engineering, analytics, or AI, this is a chance to share your work with peers and grow your voice in the community.
Weโre looking for practical talks on unified governance, data intelligence, open lakehouse architectures, responsible GenAI, and automation with AI agents. Submit your proposal by February 13, 2026: www.databricks.com/dataaisummit/call-for-presentations -
Databricks
@databricks
Walk through some of the best security features at Databricks and see how they work together to strengthen a real-world data and AI architecture, including:
- Identity and access protection
- Layered network and perimeter controls
- Securing serverless and AI workloads
Nick Karpov and Holly Smith are joined by Databricks security expert Andy Weaver in this episode of Over Architected: youtu.be/NZ-v9sOQ_GI -
Databricks reposted
Josue Bogran
@joshbogran
I sat down with @databricks CTO and Cofounder @matei_zaharia to cut through the noise in AI, looking at whatโs working, whatโs not, and what business leaders should be thinking about next. For full interview: www.youtube.com/watch?v=nGu7ylYpycY
-
Databricks
@databricks
Open data sharing should not depend on table format or platform.
That's why weโre announcing first-class support for Apache Icebergโข in Databricks Delta Sharing, so data providers can securely share live data to any Iceberg-compatible client and reach customers wherever they are.
Delta Sharing also enables providers to share Iceberg tables that live in external catalogs, extending governed access across the Databricks ecosystem.
See how this makes it easier to collaborate across open data ecosystems. www.databricks.com/blog/announcing-first-class-support-icโฆ -
Databricks
@databricks
Retrieval-based agents are at the heart of many critical enterprise use cases. But traditional RAG fails to translate fine-grained user intent and knowledge source specifications into precise search queries.
The Databricks Research team introduces Instructed Retriever, a novel retrieval architecture that propagates complete system specifications โ from instructions to examples and index schema โ through every stage of the search pipeline.
www.databricks.com/blog/instructed-retriever-unlocking-syโฆ -
Databricks
@databricks
[Demo] Databricks Senior Product Manager Alex Lichen joins @thejosuebogran to walk through Databricks One, a simplified analytics and AI experience built for business users.
In the demo, youโll see how users can:
- Find trusted dashboards and Genie spaces, and ask questions in natural language
- Use dashboards for core KPIs, with Genie handling follow-up analysis
- Drill down from dashboard visualizations using Genie
- Explore Research Agent mode for open-ended questions, with built-in explainability and governance
www.youtube.com/watch?v=JIehm5Fizak -
Databricks
@databricks
Databricks has been named a Leader in two 2025 Gartner Magic Quadrantโข reports for Cloud Database Management Systems and for Data Science and Machine Learning Platforms!
We believe this recognition highlights the strength of our open platform and new capabilities like Lakebase and Agent Bricks that help enterprises use their data to build and deploy AI with speed and confidence.
Download the reports to learn more: www.databricks.com/resources/analyst-research/databricks-โฆ -
Databricks
@databricks
The IDE for Data Engineering is everything you need to author and test data pipelines, directly inside the Databricks Workspace.
The IDE is designed to improve productivity and debugging with features like dependency graphs, built-in data previews and execution insights.
Available now in Public Preview for Lakeflow Spark Declarative Pipelines.
www.databricks.com/blog/new-way-build-pipelines-databrickโฆ -
Databricks
@databricks
Weโre proud to share that Databricks has been named one of @Glassdoorโs Best Places to Work companies for 2026!
We could not do this without each and every single Brickster who helps make Databricks an amazing place to work and innovate! ๐งฑ
See the full list here: -
Databricks
@databricks
Databricks co-founders @matei_zaharia and @istoica05 will be speaking at #scaledml 2026!
This event brings together the creators behind systems like Apache Sparkโข, CUDA, TensorFlow, ImageNet, Tesla FSD, and more to explore large-scale learning, distributed systems, and next-generation AI hardware.
Join us on January 29th: scaledml.org -
Databricks
@databricks
How Strรถer turned fragmented campaign data into a real-time analytics foundation.
Campaign data was spread across brands and delivery systems, making benchmarking, root-cause analysis, and KPI standardization slow and manual. Strรถer unified this data on an elastic analytics architecture, modernizing ETL and BI with a single, shared dataset.
Today, 500+ users run scalable, governed campaign analysis with near real-time insight, consistent metrics, and flexible views across business units and locations.
www.databricks.com/blog/zero-millions-savings-stroer-tranโฆ -
Databricks
@databricks
What started as a hackathon prototype is now how Databricks infrastructure engineers debug thousands of OLTP databases at scale.
The team built an AI agent platform that unifies metrics and logs into a single investigation flow, replacing manual debugging with guided reasoning. This has reduced debugging time by up to 90% and lowered the learning curve for new engineers.
See how: www.databricks.com/blog/how-we-debug-1000s-databases-ai-dโฆ -
Databricks
@databricks
Apache Sparkยฎ 4.1 brings meaningful advancements focused on higher-level data engineering, lower-latency streaming, and more.
Powered by the open source community, key highlights from this release include:
- Spark Declarative Pipelines
- Structured Streaming Real-Time Mode
- PySpark UDFs and Data Sources
- Spark ML on Connect
- SQL Scripting and VARIANT GA
Now available in Databricks Runtime 18.0 Beta: www.databricks.com/blog/introducing-apache-sparkr-41 -
Databricks
@databricks
Get an in-depth walkthrough of ai_parse_document, a new functionality in Databricks Agent Bricks that transforms PDFs into structured, governed, and queryable data for agents.
In this video, Databricks researchers and developers share how it developed from a hackathon project to a production-grade tool, plus the research behind it. Youโll also see a live demo showing how ai_parse_document can extract data from receipts: youtu.be/kH7p1lr4Be4 -
Databricks
@databricks
Todayโs data engineers are stuck in a reactive loop: maintaining fragile pipelines using complex tools while managing constantly shifting priorities.
The Data Engineer Toolkit brings together practical guidance to help data engineers be less reactive and more productive.
Whatโs inside:
- Frameworks for ingestion, transformation, and orchestration
- Visual patterns for ETL vs. ELT and batch vs. streaming pipelines
- Best practices for governance, lineage, and observability
www.databricks.com/resources/ebook/data-engineer-toolkit -
Databricks
@databricks
[DEMO] See how Lakebase acts as the transactional data layer for data and AI apps by bringing fully managed, serverless Postgres into the Databricks lakehouse.
What you'll learn:
- What Lakebase is and how it fits into the Databricks ecosystem
- Why Lakebase uses Serverless Postgres and what that enables
- How to use Lakebase for data apps, internal tools, and AI agents
Databricks Senior Developer Advocate Andre Landgraf walks through the architecture and a live example: www.youtube.com/watch?v=UQynsu6qklwThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Databricks and AWS recently introduced IAM role delegation, removing the usual IAM policy setup, cross-account roles, and long coordination with admins.
Now you can connect your @awscloud account, Databricks handles the delegation automatically, and you can query S3 data immediately.
In this demo, see how to pull Instagram analytics from S3, transform JSON into clean Delta tables, and run analysis in minutes: www.databricks.com/blog/databricks-and-aws-partner-simpliโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Spatial joins are core to geospatial analysis, but theyโre often slow and hard to operate. Built-in Spatial SQL on Databricks now runs spatial joins up to 17ร faster out of the box, with no tuning or external libraries, based on customer-inspired benchmarks ๐
-
Databricks
@databricks
.@BASF Coatings is applying a multi-agent supervisor architecture built with Agent Bricks to bring more structure and specialization to complex enterprise data.
By pairing AI/BI Genie for governed insights on structured data with vector search for unstructured sources, the team built Marketmind, an AI assistant in Microsoft Teams that helps Sales and Marketing move from finding information to acting on it.
Marketmind is already unifying insights, enabling faster decisions, and is on track to support more than 1,000 sales reps worldwide. www.databricks.com/blog/multi-agent-supervisor-architectuโฆ -
Databricks
@databricks
[Demo] Build and evaluate a multi-agent system on Databricks using only natural language.
This demo walks through creating a bookstore assistant that combines structured inventory data, a RAG chatbot for book knowledge, and a web search tool. It shows how agents coordinate tasks through a supervisor and how output quality is improved using labeling sessions, natural language feedback, and built-in evaluation metrics.
youtu.be/U-Ak9Efkl6E -
Databricks reposted
Matei Zaharia
@matei_zaharia
Super excited that weโre open sourcing the Dicer autosharder! Itโs become a critical piece of infrastructure in Databricks thatโs made many of our systems more scalable and reliable, and itโs powered by really cool systems work. www.databricks.com/blog/open-sourcing-dicer-databricks-auโฆ
-
Databricks
@databricks
Building something interesting with data and AI? Put it on stage.
#dataaisummit 2026 Call for Presentations is open. Weโre inviting data engineers, AI pioneers, scientists, analysts, and practitioners to share how theyโre pushing whatโs possible with data and AI.
Whether youโre working with Databricks, open source technologies, or foundational models like Claude, Gemini, and GPT, we want to see what youโve built and hear about the impact itโs made.
Submit your proposal by February 13, 2026
www.databricks.com/dataaisummit/call-for-presentations -
Databricks
@databricks
We recently introduced a set of upgrades to Lakebase that simplify how teams manage operational data for data intelligent applications.
What's new, including exciting @neondatabase feature updates:
- Serverless autoscaling with scale to zero, for dynamic workloads
- Instant database branching for faster, safer development, testing and CI
- Automated backups and point-in-time recovery for fast restore
- Expanded Postgres version support
- A new UI that simplifies everyday workflows
Learn more: www.databricks.com/blog/lakebase-holiday-update -
Databricks
@databricks
What if you could use AI to write and run code, build visualizations, and fix its own bugs? And ask using just natural language?
Databricks Assistant Agent Mode provides AI-powered data analysis and visualizations with simple prompting.
Databricksโ Pearl Ubaru walks through the workflow step by step: www.youtube.com/watch?v=E-TC-rj7t0QThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Analytics teams want to spend more time answering questions and less time tuning systems or tracking down costs.
Recent improvements have made Databricks SQL 5x faster on average, with performance delivered automatically and no index or parameter management required.
Learn how Databricks SQL delivers faster analytics with no tuning. www.databricks.com/blog/sql-databricks-lakehouse-2025 -
Databricks
@databricks
Weโre heading to retailโs biggest stage!
Join us at #nrf2026 to see how retailers are putting AI agents to work across the enterprise with Databricks.
Stop by booth #6429 to explore live demos and see how customers and partners are operationalizing AI in production. -
Databricks
@databricks
The Databricks Learning Festival is back!
Complete a self-paced learning pathway in data engineering, analytics, machine learning, generative AI, Apache Sparkโข, data warehousing, and more.
Finish all modules in at least one pathway to unlock:
- 50% off a Databricks certification
- 20% off an annual Academy Labs subscription
Join us and invest in your data and AI skills - now through Jan 19: community.databricks.com/t5/events/self-paced-learning-feโฆ -
Databricks
@databricks
2026 is shaping up to be a pivotal year for enterprise AI adoption. Hereโs what Databricks leaders see coming next:
- Greater flexibility in model choice, with teams selecting models based on performance and cost for specific workloads
- Governance evolving into the control layer for AI agents, with visibility across data, models, and end-to-end decision flows
- AI development consolidating where trusted, governed, multimodal data already lives, reducing complexity and speeding time to value
- A people-first approach to AI that equips domain experts with specialized tools, helping them stay focused on high-value work
www.databricks.com/blog/top-strategic-priorities-guiding-โฆ -
Databricks
@databricks
Together, Databricks + @PalantirTech are accelerating high-impact AI use cases and outcomes.
In this walkthrough, Benjamin Abood and @chadwahl break down how the integration enables:
- Secure, bidirectional data federation with minimal data movement
- Unified governance using Unity Catalog
- Compute pushdown so workloads run where the data lives
- Tighter integration between analytics, workflows, and operational AI
youtu.be/BsSwqYuok1A -
Databricks
@databricks
Data orchestration is shifting from workflow-first to data-first.
As platforms become more governed and event-driven, orchestration moves closer to the data layer. Lakeflow Jobs reflects this with native triggers, built-in lineage, and AI-ready workflows, without managing schedulers or infrastructure.
See how data-first orchestration simplifies modern pipelines: www.databricks.com/blog/from-airflow-to-lakeflow-data-firโฆ -
Databricks
@databricks
A year after open-sourcing Unity Catalog, open governance is proving its value.
Hundreds of organizations now use UC Open APIs to connect any engine, govern Delta and Iceberg tables, and rely on credential vending for secure, temporary access. With upcoming external writes, expanded credential vending, and UC 0.4, interoperability at scale continues to grow.
Discover how to start building with UC Open APIs: www.databricks.com/blog/year-interoperability-how-enterprโฆ -
Databricks reposted
Business Breakdowns
@bizbreakdowns
Today, we break down @databricks
Alan Tu, PM for the private strategy atย WCM Investment Management, joinedย @ReustleMatt for an appropriate follow-up to our 2023 episode. Learn:
-What the Databricks platformย actually does for customers and their data
-What role they play in the AI ecosystemย
-How WCM'sย partnership formed around a pivotal point in its history -
Databricks
@databricks
Data teams shouldnโt have to change languages to get pipelines into production.
This guide walks through building and deploying real-time ETL entirely in SQL, using streaming tables, materialized views, and declarative workflows to go from prototype to production without handoffs to engineering.
Ship faster and simplify your workflow with the tools you already use: www.databricks.com/resources/ebook/guide-building-etl-pipโฆ -
Databricks
@databricks
Data modeling on the Lakehouse looks different than it did a few years ago.
Which warehouse patterns still apply? Whatโs changed? And how do approaches like the medallion architecture fit alongside newer, more flexible modeling options?
This post breaks down common myths and shares practical guidance for building relational and dimensional models with keys, constraints, and BI-grade performance on Databricks: www.databricks.com/blog/databricks-lakehouse-data-modelinโฆ -
Databricks reposted
Radical Ventures
@radicalvcfund
A new episode of Radical Talks is now live, a special conversation from our AI Masterclass Series, featuring @databricks Chief AI Scientist, @jefrankle.
In this episode, Radical Partner @vin_sachi and Jonathan explore the mechanics of taking AI from idea to impact. Jonathan shares what he learned moving from academia to co-founding Mosaic ML, navigating its $1.3B acquisition, and ultimately leading research inside one of the worldโs most influential data and AI companies. -
Databricks
@databricks
Build an interactive AI/BI dashboard in minutes with Databricks.
See how to create multi-page dashboards, add filters, generate visuals with the Databricks Assistant, use Genie for Q&A, and publish or embed dashboards โ all in one walkthrough.
Watch the full demo: youtu.be/VJH2bfV3D8E -
Databricks
@databricks
Get to know Lakebase, a fully managed Postgres for data apps and agents.
Take the product tour to see how Lakebase delivers a transactional database integrated into the Lakehouse and a fully managed, serverless Postgres experience: www.databricks.com/resources/demos/tours/appdev/databrickโฆ -
Databricks
@databricks
โWhen AI agents fail, it's not because the agent is not able to reason about data, but because the agent is not getting the right data in the first place.โ
Databricks Research Director @bemikelive explains the core challenge behind getting enterprise agents to produce high-quality output and why a newly announced architecture for retrieval-augmented AI agents called Instructed Retriever solves most of the shortcomings of RAG.
Read the full article from @FortuneMagazine to see benchmark test results: fortune.com/2026/01/06/want-ai-agents-to-work-better-imprโฆ -
Databricks
@databricks
Reliable enterprise agents require system-level reasoning when retrieving across heterogeneous knowledge sources. Traditional RAG often fails to consistently follow instructions, schemas, and constraints end to end.
Thatโs why weโre presenting Instructed Retriever, a new retrieval architecture that propagates complete system specifications through every stage of the search pipeline. The approach delivers:
- 35โ50% gains in retrieval recall on instruction-following benchmarks
- 70% improvements in end-to-end answer quality over simplistic RAG, and ~15% over reranking-based approaches
- Strong instruction adherence with small, efficient models suitable for real-world deployment
Together, these results show how system-wide instruction awareness translates directly into more accurate and efficient enterprise agents. www.databricks.com/blog/instructed-retriever-unlocking-syโฆ -
Databricks
@databricks
[Demo] Explore the Knowledge Assistant for unstructured data ๐
See how unstructured documents can be turned into a searchable knowledge layer. The assistant ingests and parses documents from Unity Catalog files or vector search indexes, then uses a RAG chatbot to return answers with direct links back to the source data.
Youโll also see how quality improves over time using simple instructions and labeled feedback.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Databricks Co-founder and CEO, @alighodsi, shares some of the most compelling enterprise AI use cases he is seeing today.
Watch the full conversation for more on what's next for AI agents in business:
www.databricks.com/resources/webinar/build-ai-agents-thatโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
If youโre building with data and AI, nowโs the time to tell the story.
Call for Presentations for Data + AI Summit 2026 is open, and weโre looking for real-world solutions, lessons learned, and bold ideas from data engineers, AI pioneers, data scientists, analysts and researchers.
Lightning talk or breakout, share what youโve built and the impact itโs made! Submit your proposal by February 13, 2026 ๐๏ธ
www.databricks.com/dataaisummit/call-for-presentations -
Databricks
@databricks
OfficeQA is a new benchmark grounded in ~89,000 pages of U.S. Treasury Bulletins that reflects the complex, document-heavy tasks enterprises actually face.
Unlike existing benchmarks, OfficeQA measures economically valuable, real-world reasoning: parsing dense tables, navigating scanned PDFs, and retrieving facts across decades of documents.
The benchmark is now open to the community to drive the next wave of advances in grounded reasoning.
www.databricks.com/blog/introducing-officeqa-benchmark-enโฆ -
Databricks
@databricks
Convert Foreign Tables makes it easier to start using data that lives in other systems, without committing to a full migration. It brings federated data under Unity Catalog governance, so teams can work across systems while staying controlled and safe.
Watch Nick Karpov and Holly Smith break this down alongside other December updates on the latest episode of Over Architected. www.youtube.com/watch?v=chb3ojCAYaU -
Databricks
@databricks
AI agents help teams work smarter, automate everyday tasks, and drive innovation.
In just four short videos, this training covers the fundamentals of AI agents and shows real-world examples of how they create value across industries.
Complete the quiz to earn a Databricks badge and showcase your skills on LinkedIn or your rรฉsumรฉ! ๐ฐ www.databricks.com/resources/training/level-your-ai-agentโฆ -
Databricks
@databricks
Machine learning is evolving fast, and so are the ways teams are putting it to work.
Explore real-world examples โ like preventing stockouts, scaling geospatial analysis, optimizing production, advancing drug discovery, and detecting fraud โ all with ready-to-use code and notebooks: www.databricks.com/resources/ebook/big-book-of-machine-leโฆ -
Databricks
@databricks
Apache Sparkโข 4.0โs transformWithStateInPandas lets stateful streaming pipelines handle schema changes like new fields and type widening while preserving state and avoiding service interruptions.
See how teams can evolve real-time analytics and ship updates without resets or reprocessing.
www.databricks.com/blog/events-insights-complex-state-proโฆ -
Databricks
@databricks
What began as a hackathon prototype is now how Databricks infrastructure engineers debug thousands of OLTP databases at scale.
The team built an AI-driven, agentic platform that unifies metrics, logs, and workflows into a single investigation flow. By centralizing context and layering intelligence on top, engineers move from fragmented, manual debugging to guided reasoning โ cutting investigation time by up to 90% and making it easier for new teammates to get started.
See how: www.databricks.com/blog/how-we-debug-1000s-databases-ai-dโฆ -
Databricks
@databricks
Databricks CEO @alighodsi shared what we'll see in 2026 at the @FortuneMagazine Brainstorm AI event.
Real value for enterprises will come from reasoning over proprietary data. The challenge isnโt access to AI, but applying it securely and effectively inside the enterprise.
Watch the full conversation: www.youtube.com/live/O6OpIMWgddE -
Databricks
@databricks
Serverless Workspaces make it possible to create new Databricks workspaces in seconds, without setting up cloud networking, storage, or clusters.
Teams get immediate access to serverless compute, Default Storage, and their existing Unity Catalogโgoverned data. Cost visibility and budget guardrails are built in, so teams can move fast without changing their security or governance model.
Now available in Public Preview: www.databricks.com/blog/workspaces-seconds-introducing-seโฆ -
Databricks
@databricks
The Databricks Architecture Center is your hub for practical ways to build pipelines, dashboards, and AI models ๐
Find designs for common data and AI projects across use cases:
- Intelligent Data Warehousing on Databricks
- Reference Architecture for Credit Loss Forecasting
- Telecom Next Best Action Reference Architecture
- and much more!
www.databricks.com/resources/architectures -
Databricks
@databricks
Learn Databricks in under two hours as @Alex_TheAnalyst walks through the platform end to end, including:
โ Importing files and data sources
โ Exploring SQL Editor and notebooks
โ Building dashboards
โ And trying out AI tools like Genie and the Databricks Assistant
Follow along with Databricks Free Edition: www.youtube.com/watch?v=CoqZTt528ew -
Databricks
@databricks
.@edmunds sits on rich car shopping data, but turning that lakehouse into a truly connected intelligence layer required a new approach.
Their solution is Edmunds Mind, an AI-native, multi-agent ecosystem on Databricks that shifts the company from passive data and static dashboards to real-time, intelligent automation across car shopping workflows.
Specialized agents like DataDave now reach 95% accuracy on complex analytics, helping drive faster insights, stronger pricing decisions, and more personalized experiences for car buyers: www.databricks.com/blog/lakehouse-digital-mind-architectiโฆ -
Databricks
@databricks
Generative AI is reshaping biotech, accelerating target discovery and transforming drug design ๐งฌ.
Thatโs why we released Genesis Workbench, a blueprint for building biological AI/ML apps on Databricks with foundation models and governed workflows. www.databricks.com/blog/genesis-workbench-blueprint-life-โฆ -
Databricks reposted
Bg2 Pod
@BG2Pod
BG2 Guest Interview. AI Enterprise - Databricks & Glean ๐ฅWhy AIs Fail and Where Real Value Emerges @bg2pod @apoorv03 @alighodsi @jainarvind
---
(00:00) Intro
(01:00) Consumer AI vs. Enterprise Reality
(02:15) Why 95% of AI Projects Fail
(04:15) RBC, Merck, and 7-Eleven Use Cases
(06:45) What Actually Makes AI Work
(07:00) LLMs Are CommoditiesโData Is the Moat
(08:45) Failed AI Bets at Databricks & Glean
(11:00) RPA vs. Generative AI
(14:15) Advice for CIOs Planning AI Budgets
(16:00) AI CapEx and the Revenue Math
(18:00) The Three Camps of AI
(21:00) Making AI Useful Inside Enterprises
(24:30) Why Apps Capture the Value
(30:00) The Future of UI, Voice, and Data Entry
(37:30) Rapid Fire: Winners, Bubbles, Long/ShortThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
๐ Unstructured documents donโt have to stay unreadable to agents.
ai_parse_document turns PDFs into structured, governed, and queryable data with a single SQL command. Tables and diagrams are extracted with AI-generated descriptions + spatial metadata โ making it actionable for Agent Bricks workflows.
Learn more: www.databricks.com/blog/pdfs-production-announcing-state-โฆThis media couldn't be displayed. See it on the original post. -
Databricks reposted
Glean
@glean
โ95% of projects fail in enterprises, but this is what you want. When you are failing, it means you are actually trying.โย
In the latest @BG2Pod Pod episode, @apoorv03, Partner at @Altimeter Capital, sits down with @jainarvind, Founder and CEO at Glean, and @alighodsi, Co-Founder and CEO at @Databricks, to unpack what this shift really means.
This conversation offers a clear blueprint for leaders shaping their AI strategy for 2026 and beyond.
๐๏ธ Watch the full episode: ย glean-it.com/4qmx7gS -
Databricks
@databricks
Unexpected Lakehouse storage costs often come from a few repeat issues: object versioning, lifecycle policies, and inefficient data access paths.
We break down how to spot and fix all three with practical steps that reduce costs without compromising performance: -
Databricks reposted
MLflow
@MLflow
Weโre excited to announce the release of ๐ ๐๐ณ๐น๐ผ๐ ๐ฏ.๐ด, which brings advanced capabilities for evaluating LLM-based applications, particularly for evaluation and observation. ๐
Whatโs New in MLflow 3.8.0?
โ๏ธ ๐ฃ๐ฟ๐ผ๐บ๐ฝ๐ ๐ ๐ผ๐ฑ๐ฒ๐น ๐๐ผ๐ป๐ณ๐ถ๐ด๐๐ฟ๐ฎ๐๐ถ๐ผ๐ป: Prompts can now include model configuration, allowing you to associate specific model settings with prompt templates for more reproducible LLM workflows.
โณ ๐๐ป-๐ฃ๐ฟ๐ผ๐ด๐ฟ๐ฒ๐๐ ๐ง๐ฟ๐ฎ๐ฐ๐ฒ ๐๐ถ๐๐ฝ๐น๐ฎ๐: The Traces UI now supports displaying spans from in-progress traces with auto-polling, enabling real-time debugging and monitoring of long-running LLM applications.
โ๏ธ ๐๐ฒ๐ฒ๐ฝ๐๐๐ฎ๐น ๐ฎ๐ป๐ฑ ๐ฅ๐๐๐๐ฆ ๐๐๐ฑ๐ด๐ฒ๐ ๐๐ป๐๐ฒ๐ด๐ฟ๐ฎ๐๐ถ๐ผ๐ป: New get_judge API enables using DeepEval's evaluation metrics as MLflow scorers, providing access to 20+ evaluation metrics including answer relevancy, faithfulness, and hallucination detection.
๐ก๏ธ ๐๐ผ๐ป๐๐ฒ๐ฟ๐๐ฎ๐๐ถ๐ผ๐ป๐ฎ๐น ๐ฆ๐ฎ๐ณ๐ฒ๐๐ ๐ฆ๐ฐ๐ผ๐ฟ๐ฒ๐ฟ: New built-in scorer for evaluating safety of multi-turn conversations, analyzing entire conversation histories for hate speech, harassment, violence, and other safety concerns.
โก ๐๐ผ๐ป๐๐ฒ๐ฟ๐๐ฎ๐๐ถ๐ผ๐ป๐ฎ๐น ๐ง๐ผ๐ผ๐น ๐๐ฎ๐น๐น ๐๐ณ๐ณ๐ถ๐ฐ๐ถ๐ฒ๐ป๐ฐ๐ ๐ฆ๐ฐ๐ผ๐ฟ๐ฒ๐ฟ: New built-in scorer for evaluating tool call efficiency in multi-turn agent interactions, detecting redundant calls, missing batching opportunities, and poor tool selections.
Check out the full release notes: github.com/mlflow/mlflow/releases/tag/v3.8.0
A big thanks for all of the contributions from the community and MLflow maintainers. ๐ฅณ Happy holidays to all! โ๏ธ
#opensource #mlflow #oss #llm #genai -
Databricks
@databricks
Serverless Snapshot Restoration removes a common interruption in serverless notebooks: idle disconnect.
With this new functionality, Databricks captures and restores your full interactive environment, including both Python and Apache Sparkโข state โ in seconds!
This makes Databricks the first platform to support complete environment restoration for serverless notebooks, enabling seamless continuity between sessions.
www.databricks.com/blog/seamlessly-resume-sessions-serverโฆ -
Databricks
@databricks
Teach Databricks AI/BI Genie the language your business uses ๐ง.
In a Genie space, users define terms and add descriptions or synonyms. As you explain concepts like โperformance bonusโ or โflight risk rate,โ Genie understands the business context and returns clearer answers the next time you ask.
Databricks Senior Technical Product Marketing Manager Pearl Ubaru shows how it works.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
The lakehouse vision has always been about combining open storage with the freedom to use many different engines and tools.
What remained was applying governance and security consistently across all of them.
Thatโs why weโve introduced fine-grained access controls for external engines. Unity Catalog now enforces the same row- and column-level policies everywhere data is accessed, inside Databricks and across external engines, completing unified governance for the open lakehouse: www.databricks.com/blog/completing-lakehouse-vision-open-โฆ -
Databricks
@databricks
BASF Coatings is using a multi-agent supervisor architecture built with Agent Bricks to bring structure and specialization to complex enterprise data.
By combining AI/BI Genie for governed insights on structured data with vector search for unstructured sources, the team created Marketmind, an AI assistant inside Microsoft Teams that helps Sales and Marketing shift from searching for information to acting on it.
Marketmind is already unifying insights, supporting faster decisions, and will soon reach more than 1,000 sales reps worldwide: www.databricks.com/blog/multi-agent-supervisor-architectuโฆ -
Databricks
@databricks
Between large context windows, looping coding agents, and thousands of unnecessary commits, AI costs can quickly add up.
AI Gateway brings order by routing every request through one place, so teams can enforce policies, limits, and governance. With centralized permissions, load balancing, and detailed usage and cost logs, leaders get clear oversight across all AI models.
See how it works in this step-by-step tour: www.databricks.com/resources/demos/tours/data-science/mosโฆ -
Databricks
@databricks
The IDE for Data Engineering is everything you need to author and test data pipelines, directly inside the Databricks Workspace.
The IDE is designed to improve productivity and debugging with features like dependency graphs, built-in data previews and execution insights.
Now available in Public Preview for Lakeflow Spark Declarative Pipelines: www.databricks.com/blog/new-way-build-pipelines-databrickโฆ -
Databricks reposted
Jonathan Frankle
@jefrankle
I'm hiring interns for next summer at @databricks! Specifically on (1) empirical RL at scale on non-verifiable tasks and (2) enabling real people specify the behaviors they want out of AI (e.g., through evals) on highly complex tasks. ๐งต
-
Databricks
@databricks
"Software engineers are not going to stop using AI to build software, and those applications need a database, which is why we built Lakebase. Teams also increasingly want to use agents, which is why we built Agent Bricks. Weโre continuing to invest in these foundations to help customers build data-intelligent applications."
Databricks CEO and co-founder @alighodsi joined @Bloomberg to discuss Databricks' record growth and how our latest funding round will support accelerated investment in products to help customers build AI apps and agents on their proprietary data.
www.bloomberg.com/news/videos/2025-12-16/databricks-ceo-oโฆ -
Databricks
@databricks
Data collaboration is the backbone of modern AI innovation, especially as organizations work with external partners to unlock new insights.
Databricks Clean Rooms enable privacy-centric collaboration by letting partners run shared analysis on sensitive data without exposing raw records or intellectual property. Teams approve the logic together and control what outputs leave the clean room.
Weโve answered the top 10 questions about what Clean Rooms are, how they protect data, and how to get started. www.databricks.com/blog/top-10-questions-you-asked-about-โฆ -
Databricks
@databricks
Databricks Ventures is investing in Lovableโs $330M Series B to power the age of the builder.
As AI transforms how software is created, @Lovable reflects a broader shift toward more accessible, AI-native application development. Their growth highlights the demand for opening software creation to more people, and weโre excited to support their journey ahead! lovable.dev/blog/series-b -
Databricks
@databricks
We're introducing a set of upgrades to Lakebase that simplify how teams manage operational data for Data Intelligent Applications.
What's new, including eagerly-awaited @neondatabase features:
- Serverless autoscaling with scale to zero, for dynamic workloads
- Instant database branching for faster, safer development, testing and CI
- Automated backups and point-in-time recovery for fast restore
- Expanded Postgres version support
- A new UI that simplifies everyday workflows
These updates represent a significant milestone in defining the lakebase category, a serverless database architecture that separates OLTP storage from compute. www.databricks.com/blog/lakebase-holiday-update -
Databricks reposted
Reynold Xin
@rxin
Yesterday we talked about how we got to $1B revenue run rate for our data warehousing business with Lakehouse. Today, we are excited to announce a whole suite of improvements for Lakebase:
โก Autoscalingย that dynamically adjusts compute based on load
๐ Scale to zero, allowing compute to shut down when idle and resume automatically in hundreds of milliseconds
โซ Instant provisioningย to create new database instances in seconds
๐ Instant database branching, enabling git-like workflows with isolated, copy-on-write environments for development, testing, and staging
๐พ Automated backups and point-in-time recoveryย for fast restore and safer operations
๐ Postgres 17, alongside continued Postgres 16 support
๐ฆ Increased storage capacity up to 8TBย for larger production workloads
๐ A new Lakebase UIย that simplifies common workflows
Many of these are made possible by the unique Lakebase architecture that separates storage (in object stores) from compute.
Read more at www.databricks.com/blog/lakebase-holiday-update
Happy holidays! -
Databricks
@databricks
On @TBPN, Databricks CEO and co-founder @alighodsi joined @johncoogan and @jordihays to discuss how model capabilities are converging, and why differentiation increasingly comes from strong data foundations and reasoning over proprietary data. They also talked about how Databricks is helping customers build data-intelligent applications.
Watch now: www.youtube.com/watch?v=6NzwxrOgBrI&t=9825s -
Databricks
@databricks
Learn how to build production-ready data and AI apps with Databricks Apps and Lakebase:
โข Run full-stack apps without managing servers or containers
โข Keep data fresh with Lakebase synced tables that mirror Unity Catalog in seconds
โข Deploy your entire stack as code using Databricks Asset Bundles for consistent releases
๐ www.databricks.com/blog/how-build-production-ready-data-aโฆ -
Databricks
@databricks
Weโre excited to announce the winners of the inaugural Databricks Free Edition Hackathon!
Builders from 16 countries used Free Edition to turn ideas into real demos across data and AI.
1st Place: Narender Kumar โ VidMind, transforming unstructured video into searchable insights
2nd Place: Zoe Booth โ Space weather forecasting to help predict power grid failures
3rd Place: Hasnat Abdul โ An NLP-powered recipe recommendation engine
Explore their projects and try building your own with Databricks Free Edition. www.databricks.com/blog/announcing-winners-inaugural-dataโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
Reynold covers how we went from $0 to $1B ARR in a completely new business we launched just 4 years ago: Data Warehousing. Today, all our focus is on Lakebase Postgres! Read this ๐
Reynold Xin
@rxin
We disclosed today as part of our Series L that our 4-yr old data warehousing business is now >$1B revenue run rate. This is to the best of my knowledge the fastest to $1B DW product in the industry. How did we do it, and whatโs next?
The conventional wisdom is that it would take 5+ years to build a new database (just to release one).
Four years ago, the linked blog announced that Databricks had won the official TPC-DS 100TB benchmark with DBSQL, which was in preview back then. It had the best perf and the best price/perf, and notably beating Snowflake by 12x in price/perf in that benchmark. (Note: we are still the top place on the official TPC-DS benchmark today.)
That blog post launched a contentious "benchmarking war" with a lot of back and forth between vendors, but more importantly it marked the very beginning of our data warehousing business.
To build this business, we assembled the best engineering team and established a new infrastructure product category called Lakehouse that inherits the flexibility and openness of data lakes and performance of data warehouses. Lakehouse is now the standard for data infrastructure, and organizations are migrating from legacy data warehouses to the Lakehouse.
The result so far is a testament to the team and their execution. We have a lot of ideas on how to take performance and usability to the next level, and the team is working hard to make that happen. Expect some big announcements next year. We want to lay the foundation for growing the data warehousing product to a $10B business.
Databricks had operated largely in the โanalyticsโ side of data in the past, and we believe the โoperationalโ side of data (aka โOLTPโ) is also ready for a โLakehouseโ style disruption. A huge chunk of the founding teamโs time is now focusing on โLakebaseโ, a new category of OLTP databases that separates storage (in the lake) from compute. That architecture enables features that have been virtually impossible for databases in the past: instant provisioning, elastic scaling (down to zero), branching, high throughput scan directly from Spark, โฆ
I wonโt go into too much detail about Lakebase here, but we expect a similar trend to happen in the next few years: Lakebase will transform the industry and other OLTP systems will re-architect or position towards it.
The best data warehouse is a lakehouse, and the best database is a lakebase!
www.databricks.com/blog/2021/11/02/databricks-sets-officiโฆ -
Databricks
@databricks
Databricks CEO @alighodsi joined CNBCโs @jonfortt to discuss the future of AI, how organizations are using data-intelligent applications to automate work, and how our Series L funding round will accelerate our development of product innovation.
โWeโre putting [our investments] back into agents, databases, and Lakebase, and into this new category of applications weโre seeing emerge โ what we call data intelligence applications.โ
Watch the full conversation: www.cnbc.com/video/2025/12/16/databricks-ceo-ali-ghodsi-wโฆ -
Databricks
@databricks
Databricks is raising over $4 billion in Series L funding, valuing the data and AI company at $134 billion.
Databricks CEO @alighodsi attributed the companyโs revenue run-rate growth, which is up 55% year-over-year, to the idea that businesses are building data intelligent applications that use AI.
@bellelin_ covers the latest in @WSJ: www.wsj.com/articles/databricks-is-raising-funds-at-134-bโฆ -
Databricks reposted
Ali Ghodsi
@alighodsi
Excited to raise $4B+ in our latest fundraise! We shared that we will primarily be using the capital to invest in:
1๏ธโฃ Lakebase Postgres - serverless database for Agents
2๏ธโฃ Agent Bricks - high quality agents that can reason on enterprise data
3๏ธโฃ Databricks Apps - Data Intelligence Apps built on Lakebase and Agent Bricks
As part of this we also disclosed:
๐ Crossed $4.8B revenue run-rate, over 55% YoY growth
๐ Crossed $1B of revenue run-rate for our Data Warehousing product
๐ Crossed $1B of revenue run-rate for our AI products
๐ Continued to be cash flow positive in the last 12 months
Big thanks to Insight Partners, Fidelity Investments, and J.P. Morgan who led the round.
www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
We are excited to share our strong Q3 results:
- Growing >55% year over year, surpassing $4.8 billion revenue run-rate
- Exceeding $1 billion revenue run-rate for our Data Warehousing business
- Exceeding $1 billion revenue run-rate for our AI products
- Positive free cash flow over the last 12 months
We are also raising an >$4B Series L investment, valuing the company at $134 billion.
With this investment, weโll help customers accelerate the development of Data Intelligent apps.
Congratulations to our employees, customers, partners and investors! www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
Databricks co-founder @rxin sat down with Zeb's VP of Data + AI, @thejosuebogran, to discuss Lakebase and where database technology is heading.
โItโs the right time to think about how we can disrupt and build next-generational databases that are cloud native and agent native.โ
Their conversation covers:
โ The slow pace of change in traditional OLTP systems
โ The new demands introduced by AI agents
โ How the Neon acquisition strengthens the foundation for next-generation data infrastructure
youtu.be/F9exV_HAHyU -
Databricks
@databricks
Interoperability is now a core requirement of modern data architectures. Over the past year, Unity Catalog has expanded its open foundation so teams can connect any engine, enforce a single set of policies, and simplify secure access across formats.
UC now provides:
โข Credential vending for temporary, identity-scoped access
โข Unified governance for Delta Lake and Apache Icebergโข
โข Cross-engine policy enforcement
โข Open APIs for catalog, schema, and access control
See how UC is becoming the control plane for open, federated governance: www.databricks.com/blog/year-interoperability-how-enterprโฆ -
Databricks
@databricks
[Demo] Agent Bricks makes it easier than ever to build and manage AI-powered agents directly on Databricks ๐งฑ.
See how Agent Bricks integrates with MCP servers to help teams connect data, tools, and models seamlessly across the platform.This media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Agent Bricks now connects with Microsoft Agent 365, making it easier to bring governed data and AI into everyday Microsoft 365 workflows.
With @Azure Databricks and Unity Catalog behind the scenes, employees can ask questions and act on live, trusted data directly from Teams, Outlook, or Excel.
Get the information you need right where youโre already working: www.databricks.com/blog/bring-data-intelligence-microsoftโฆ -
Databricks
@databricks
Excited to see Agent Bricks in @CRN's roundup of the top agentic AI platforms of 2025!
Explore the AI innovations shaping the future: www.crn.com/news/ai/2025/10-coolest-agentic-ai-platforms-โฆ -
Databricks
@databricks
Guardrails are a key consideration for AI adoption, as enterprises focus on safety, transparency, auditability, and strong access controls to ensure models operate within trusted boundaries.
Watch @alighodsi dive deep into the future of enterprise AI: www.databricks.com/resources/demos/videos/build-ai-agentsโฆ -
Databricks
@databricks
๐ Python UDTFs in Unity Catalog let you define Python logic once and use it anywhere in your lakehouse, from SQL warehouses to UC clusters to serverless compute.
Theyโre discoverable, shareable, and governed like any other Unity Catalog asset, making it easier to apply advanced logic wherever your data lives.
www.databricks.com/blog/introducing-python-user-defined-tโฆ -
Databricks
@databricks
Weโre excited to share that our customers have day-one access to OpenAI GPT-5.2 on Databricks!
GPT-5.2 delivers strong gains on OfficeQA, our benchmark for grounded enterprise reasoning, and is now available on our platform with native Response API support. Paired with Agent Bricks, teams get a unified way to build governed, trusted, data-aware agents with minimal integration work.
Congrats to the @OpenAI team on this release. We canโt wait to see what our customers build! www.databricks.com/blog/openai-gpt-52-and-responses-api-dโฆ -
Databricks
@databricks
Every successful AI project starts with clean, reliable data.
In this video, Databricks Principal Technical Evangelist Viktoria Semaan explains how the medallion architecture helps teams move from raw data to validated tables to actionable insights at scale.
Try it yourself with a hands-on tutorial that runs entirely on Databricks Free Edition: github.com/viktoriasemaan/data-engineering/tree/main/lakeโฆThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
๐ ai_parse_document is a new AI Function that makes it easy to extract structured content from unstructured documents, so you can leverage all your data with your AI.
Databricks MVP Conner Schiissler tried it across real documents and was impressed by the results: -
Databricks
@databricks
Databricks CEO @alighodsi joined @FortuneMagazine Brainstorm AI 2025 to discuss the future of the AI market, and how Agent Bricks is transforming organizations across industries.
โItโs a commodity now to have AI that has general knowledge, but itโs very elusive to get AI that really understands the proprietary data thatโs inside the enterprise โ thatโs what weโre helping enterprises do with Agent Bricks.โ
fortune.com/2025/12/09/databticks-ceo-1-trillion-valuatioโฆ -
Databricks
@databricks
Weโre proud to share that Databricks is a Leader in two 2025 @Gartner_inc Magic Quadrantโข reports for Cloud Database Management Systems and for Data Science and Machine Learning Platforms!
We believe this recognition highlights the strength of our open platform and new capabilities like Lakebase and Agent Bricks that help enterprises use their data to build and deploy AI with speed and confidence.
Download the reports to learn more: www.databricks.com/resources/analyst-research/databricks-โฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
LLMs are claimed to reach PhD intelligence, but still fail mundane tasks. To understand this challenge, Databricks launched OfficeQA, a benchmark of useful tasks that require reliability&diligence, not specialized knowledge. We're also doing a competition! www.databricks.com/blog/introducing-officeqa-benchmark-enโฆ
-
Databricks
@databricks
Distributed ML is now in Public Preview on both serverless and standard clusters, enabling teams to scale training and tuning workloads without managing dedicated infrastructure.
One unified compute experience with built-in security, fine-grained access control and smooth collaboration across ML workflows: www.databricks.com/blog/announcing-public-preview-distribโฆ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
Databricks.
You can learn it in just 2 hours in this weeks video!
Learn how to:
1. Import Data from flat files and connect to Data Sources
2. Analyze data using SQL Editor and Notebooks
3. Visualize and Create Dashboards
4. Use AI to code and talk with our Databases
The best thing is you can do all of this for Free!
I'll be do more videos on Databricks in the future and may create a "Learn Databricks in under 5 hours (Advanced)" or something like that :)
www.youtube.com/watch?v=CoqZTt528ew -
Databricks
@databricks
Today weโre introducing OfficeQA, a new benchmark grounded in ~89,000 pages of U.S. Treasury Bulletins that reflects the complex, document-heavy tasks enterprises actually face.
Unlike existing benchmarks, OfficeQA measures economically valuable, real-world reasoning: parsing dense tables, navigating scanned PDFs, and retrieving facts across decades of documents.
Even strong agents reach only ~45% accuracy, showing how far the field has to go. The benchmark is now open to the community, and the Databricks Grounded Reasoning Cup in Spring 2026 will challenge teams to push these capabilities forward. www.databricks.com/blog/introducing-officeqa-benchmark-enโฆ -
Databricks
@databricks
Databricks on @googlecloud now supports Axion-based C4A VMs, delivering up to 65% better price-performance and 60% better energy efficiency for SQL, AI/ML and ETL workloads.
C4A works seamlessly with the Databricks lakehouse architecture and integrations like serverless SQL, Lakeflow and Vertex AI to boost performance and efficiency at scale โก๏ธ www.databricks.com/blog/accelerating-data-and-ai-google-aโฆ -
Databricks reposted
MLflow
@MLflow
MLflow 3.7.0 is here and it brings major features and improvements for GenAI Observability, Evaluation, and Prompt Management! ๐๐ฅณ
๐ View the release notes: github.com/mlflow/mlflow/releases/tag/v3.7.0
๐ผ๐๐๐๐ ๐ต๐๐๐๐๐๐๐
โ๏ธ ๐๐ ๐ฝ๐ฒ๐ฟ๐ถ๐บ๐ฒ๐ป๐ ๐ฃ๐ฟ๐ผ๐บ๐ฝ๐๐ ๐จ๐: Manage and search prompts (including version search in traces) directly within the experiment UI.
๐ฌ ๐ ๐๐น๐๐ถ-๐๐๐ฟ๐ป ๐๐๐ฎ๐น๐๐ฎ๐๐ถ๐ผ๐ป: Enhanced mlflow.genai.evaluate now supports assessing conversational AI applications with multi-turn inputs.
โ๏ธ ๐ง๐ฟ๐ฎ๐ฐ๐ฒ ๐๐ผ๐บ๐ฝ๐ฎ๐ฟ๐ถ๐๐ผ๐ป: New side-by-side view in the Traces UI to analyze and debug LLM behavior across runs.
โ ๐๐ฒ๐บ๐ถ๐ป๐ถ ๐ง๐๐ฝ๐ฒ๐ฆ๐ฐ๐ฟ๐ถ๐ฝ๐ ๐ฆ๐๐: Added auto-tracing support for Googleโs Gemini in TypeScript.
๐ฏ ๐ฆ๐๐ฟ๐๐ฐ๐๐๐ฟ๐ฒ๐ฑ ๐ข๐๐๐ฝ๐๐๐ ๐ถ๐ป ๐๐๐ฑ๐ด๐ฒ๐: The make_judge API now supports precise, programmatically consumable structured evaluation results.
๐ฃ ๐ฉ๐ผ๐น๐๐๐ด๐ฒ๐ป๐ ๐ง๐ฟ๐ฎ๐ฐ๐ถ๐ป๐ด: Added auto-tracing support for the @voltagent_dev framework.
Thanks to all the contributions from the community! ๐
Try it out: pip install mlflow==3.7.0
#opensource #oss #mlflow #llm -
Databricks
@databricks
Learn how to build production-ready data and AI apps with Databricks Apps and Lakebase.
Run a full-stack app on Databricks, keep data updated within seconds, and deploy the entire stack as code on one platform: www.databricks.com/blog/how-build-production-ready-data-aโฆ -
Databricks
@databricks
The new IDE for Data Engineering introduces a unified way to build Lakeflow Spark Declarative Pipelines in the Databricks Workspace. Code, dependency graphs, data previews, debugging tools and Git all sit in one place, making pipeline development faster, clearer and easier to iterate on.
Now in Public Preview: www.databricks.com/blog/new-way-build-pipelines-databrickโฆ -
Databricks
@databricks
Dashboards are where your data comes to life. In this video, @Alex_TheAnalyst walks through analyzing a sales dataset in Databricks Free Edition, building bar, pie and line charts, and applying global filtersโall using SQL, notebooks and dashboards.
Follow along step-by-step and build your own transaction dashboard: youtu.be/3DZQopaf8xA -
Databricks
@databricks
[Demo] See how Databricks makes Scala development faster and simpler with Serverless JAR Tasks and the Beta of Serverless Scala Databricks Connect.
This end-to-end demo walks through building, deploying, and running JAR jobs on Serverless compute using Databricks Asset Bundles, with 5 to 10 second startup times, structured streaming support, and no infrastructure to manage: www.youtube.com/watch?v=ndX48yrRHkQThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
โGenAI makes it so easy to create a great demo. But the challenge is not the demo โ itโs getting to production.โ
From the show floor at #awsreinvent, Craig Wiley, Sr. Director of Product for AI/ML at Databricks, explains how the Databricks + AWS partnership helps enterprises move past POCs and into real, governed, high-stakes deployments.
Agent Bricks gives teams the evaluation, governance, and cost optimization needed to ship agents responsibly and at scale on @awscloud. Watch the full conversation: youtu.be/Q6jRdpF6yXE -
Databricks
@databricks
Join this event to see how @MLflow GenAI helps developers build and evaluate agents and NANDA infrastructure to deploy and coordinate the next wave of agentic systems! ๐
MLflow
@MLflow
Developers are shifting gears from single models to full autonomous systems! Ready to master the next era of AI? ๐
Join us on ๐๐ฒ๐ฐ๐ฒ๐บ๐ฏ๐ฒ๐ฟ ๐ต as we deep-dive into two critical pillars powering this transition:
๐น ๐ ๐๐ณ๐น๐ผ๐ ๐๐ฒ๐ป๐๐: Essential for evaluation, monitoring, and quality observability of your generative AI and agent applications.
๐น ๐ก๐๐ก๐๐: Providing the framework for decentralized coordination, identity, resolution, and open-source agent infrastructure.
RSVP ๐ luma.com/kt7mj2t6
#mlflow #genai #aievaluation #opensource #aiops #nanda -
Databricks
@databricks
โOur data estate in 2020 was extremely fragmentedโฆ Databricks became our central lakehouse due to its seamless integration with AWS storage, compute, and activation stack.โ
During yesterdayโs #awsreinvent Partnership Advantage keynote, Sanjay Bhakta, Chief Product & Technology Officer @CondeNast, shared how the publisher is reshaping its future with data and AI.
With Databricks closely integrated with @awscloud at the core of their architecture, Condรฉ Nast is moving from fragmentation to a unified foundation that supports faster innovation. -
Databricks
@databricks
The new Sample Data Exploration experience in Unity Catalog lets you ask natural language questions like โWhich region has the highest sales?โ and get instant answers or visualizations right on the sample data page ๐
Powered by Databricks Assistant, it brings built-in intelligence to every dataset so anyone can quickly assess relevance, accuracy, and value. Now in Public Preview: www.databricks.com/blog/explore-data-instantly-databricksโฆ -
Databricks
@databricks
โWe can give you a good quality on the specific task, because we're cheating and we're doing boring AI, focusing just on specific tasks that you want help with."
Our CEO @alighodsi shares his perspective on why the biggest AI innovations will be achieved with smaller, laser-focused agents trained on an enterprise's own data. Read his insights via @TIME time.com/7338006/ai-agi-databricks-ali-ghodsi/ -
Databricks
@databricks
Databricks now supports Apache Icebergโข v3, giving customers a unified, interoperable, and governed data layer.
Deletion vectors, row-level lineage, and the Variant data type are available on all Unity Catalog managed tables, so teams can run modern workloads on a single copy of data across both Delta and Iceberg ๐ www.databricks.com/blog/advancing-lakehouse-apache-iceberโฆ -
Databricks
@databricks
To get consistent answers from agents, you need quality data, clear instructions, and analytics aligned to your use cases.
At #awsreinvent, @CondeNast's SVP of Engineering, Vikram Palicherla, and VP of Data Engineering, Marcos Casal, shared how theyโre applying these principles to accelerate their data intelligence strategy with agentic solutions on Databricks.
A big thank you to Vikram, Marcos, and Databricks speakers Craig Wiley and Nicolas Pelaez for an insightful session! -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
Databricks.
One of the best platforms on the planet for AI and Data - and in this video we are building a full project using it!
The best part - it's completely free to use. Practice with the SQL Editor, Notebooks, AI, and Data Visualization!
www.youtube.com/watch?v=jegmI_hSx84 -
Databricks reposted
TIME
@TIME
The CEO who believes AGI (artificial general intelligence) is already here time.com/7338006/ai-agi-databricks-ali-ghodsi/
-
Databricks
@databricks
The #awsreinvent Expo is officially open!
Visit the Databricks booth to meet the team, see Agent Bricks in action, and explore whatโs new across data, analytics, and AI. Join our sessions this week to go deeper: www.databricks.com/lp/event/reinvent -
Databricks
@databricks
๐ ai_parse_document now brings state-of-the-art document intelligence directly to Databricks.
With a single SQL function, teams can parse and understand PDFs with leading quality at 3 to 5 times lower cost. The output includes tables, figures, diagrams, layout, and spatial metadata, all governed through Unity Catalog and ready for use in Vector Search, Agent Bricks, and Lakeflow Pipelines: www.databricks.com/blog/pdfs-production-announcing-state-โฆ -
Databricks
@databricks
Weโre excited to share that we took home seven AWS Partner Awards at #awsreinvent 2025! ๐
Thank you to @awscloud for the recognition in these categories:
โข Migration Technology Partner of the Year (Global)
โข Industry Partner of the Year - Energy and Utilities - Technology (Global)
โข Industry Partner of the Year - Financial Services - Technology (Global)
โข Industry Partner of the Year - Retail and Consumer Packaged Goods - Technology (Global)
โข Industry Partner of the Year - Auto and Manufacturing (NAMER)
โข Industry Partner of the Year - Telco, Media, Entertainment, Gaming & Sports (EMEA)
โข Industry Partner of the Year - Telco, Media, Entertainment, Gaming & Sports (APJ)
A special thank you to our joint customers for pushing whatโs possible with data and AI and driving meaningful impact across their organizations! -
Databricks
@databricks
With @OpenAI models, including GPT-5.1, now generally available on Databricks, enterprises can use OpenAIโs frontier intelligence directly where their governed data lives. This brings generation, reasoning, and action together in one secure environment without moving data around.
Teams can explore, apply, automate, and monitor OpenAI models using integrated tools such as Agent Bricks, AI Playground, Lakeflow Pipelines, and AI Gateway โ all within Databricks: www.databricks.com/blog/native-openai-models-now-generallโฆ -
Databricks
@databricks
Weโre live at #awsreinvent in Las Vegas and ready to dive into whatโs next for enterprise AI!
If youโre here this week, connect with us or join our sessions to see how teams are using their data to power AI that delivers real business insights and outcomes.
Stop by Booth #1420 to meet the team, see live demos, and learn how organizations are building high-quality AI agents with Agent Bricks ๐งฑ: www.databricks.com/lp/event/reinvent -
Databricks
@databricks
We've made it easier to scale data governance while keeping sensitive data protected. Now in Unity Catalog, you can define tag-driven policies once and automatically apply row and column controls across all tables using Governed Tags and Data Classification.
Learn more about Attribute-Based Access Control (ABAC) in Unity Catalog, now in Public Preview: www.databricks.com/blog/how-scale-data-governance-attribuโฆ -
Databricks
@databricks
What a night at Texas A&M Universityโs #tamudatathon!
Students learned Databricks in under an hour and spent the night creating projects like semantic search engines, AI-powered safety apps, chatbot integrations, and more. Many teams pushed the limits of Free Edition and kept everything running inside Databricks from start to finish.
Great work from the students!
www.databricks.com/learn/free-editionThis media couldn't be displayed. See it on the original post. -
Databricks
@databricks
Learn to build a full-stack AI application directly inside your Databricks environment without data duplication or external tools.
This tutorial shows how to create a knowledge-testing app using Lakebase, Databricks Apps, and AI-assisted development in your IDE, all within a secure and connected environment. It also covers the 4-step Context Engineering workflow for productive AI coding ๐
youtu.be/ninPbwHnqkw -
Databricks
@databricks
AI adoption is booming, with 72% of workers now using it in their day-to-day work. The next opportunity? Building AI agents for automating repetitive tasks and speeding up tasks that require deep research.
With only 13% of teams having integrated agents into their workflows so far, we've launched two new courses to help you take the next step: AI Agent Fundamentals and Get Started with AI Agents: www.databricks.com/blog/master-ai-agents-new-databricks-tโฆ -
Databricks
@databricks
Edmunds Mind is an AI-native, multi-agent ecosystem built on Databricks. By unifying data and automating expert workflows, @edmunds has moved from static dashboards to real-time, intelligent automation.
See how specialized agents like DataDave now deliver 95% analytic accuracy, driving faster insights, smarter pricing, and more personalized experiences for car buyers:
www.databricks.com/blog/lakehouse-digital-mind-architectiโฆ -
Databricks
@databricks
As AI agents move from prototype to production, success depends on accuracy โ and accuracy depends on whether the agent understands your domain. Evaluation is critical.
Thatโs why we recently introduced token-based pricing for MLflow GenAI evaluation, reducing evaluation costs by up to 95% without any loss in accuracy.
We also open-sourced production-tested evaluation prompts across finance, healthcare, technical documentation, and safety, so teams can build and evaluate domain-specific agents more efficiently: www.databricks.com/blog/build-high-quality-domain-specifiโฆ -
Databricks
@databricks
Using Apache Sparkโข for large-scale data prep and Ray for task parallelism, teams trained and tuned 1,400+ forecasting models in under 30 minutes instead of nearly three hours โ hitting ~95% CPU utilization.
See the full benchmark and workflow:
www.databricks.com/blog/supercharging-ai-model-building-dโฆ -
Databricks
@databricks
Databricks CEO @alighodsi shared that while the industry is fixated on superintelligence, building systems to outsmart the world's brightest minds isn't what companies actually need.
Organizations want to build AI agents to support and automate everyday tasks โ and we already have everything we need to do that today. @BusinessInsider has the full story: www.businessinsider.com/databricks-ceo-agi-superintelligeโฆ -
Databricks
@databricks
With Databricks Free Edition, you can upload your first dataset and start working with it in just a few steps. This walkthrough shows how to create a volume, upload a CSV, and explore your data right inside a workspace.
In his video, @Alex_TheAnalyst demonstrates how to connect external data sources, query in SQL, and build notebooks in Python, R, or Scala, giving you a hands-on look at getting started on Databricks: www.youtube.com/watch?v=QSzqvW4amMc -
Databricks
@databricks
Moodyโs Risk Data Suite is now available on the Databricks Marketplace, giving financial institutions instant access to trusted Moody's Ratings as governed Delta tables.
By joining RDS with internal exposures on the Databricks Platform, banks can modernize credit risk and automate CECL and IFRS 9 provisioning โ enabling faster and more transparent decisions that strengthen compliance, improve risk insight, and enhance customer experience:
www.databricks.com/blog/unlocking-modern-risk-compliance-โฆ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
Databricks.
Genuinely one of the best places to learn how to use AI with data - for free!
Using AI isnโt really optional for most professionals and there arenโt a lot of great platforms to learn it on.
Databricks allows you to use AI with all of your data on Databricks Free Edition!
Check it out!
youtu.be/naFraZ1kMi8 -
Databricks
@databricks
โThereโs a lot of context in the data enterprises have. Itโs proprietary and not available to LLMs. Providing that data as context to agents is going to be the big unlock.โ
Databricks co-founder and CEO @alighodsi explains how combining enterprise data with OpenAIโs models can reshape what AI agents can do in the enterprise.
Watch the full conversation with @OpenAI co-founder and CEO @sama. www.youtube.com/watch?v=gz1sOEETcgE -
Databricks
@databricks
Weโre excited to share that @AnthropicAI's newest model, Claude Opus 4.5, is now supported in Databricks!
Opus 4.5 sets a new standard across coding, agents, computer use, and office tasks. It outperforms both Sonnet 4.5 and Opus 4.1 while delivering Opus-level intelligence at one-third the cost.
More ways for teams to build and experiment with high-quality intelligence, all within Databricks. www.databricks.com/blog/claude-opus-45-here -
Databricks
@databricks
Most teams can prototype an agent, but scaling one you can trust is the real challenge. The latest Agent Bricks updates focus on the pillars that make production possible: accuracy, governance, and openness.
New capabilities now allow teams to:
โข Evaluate agent behavior with MLflow
โข Govern every model and MCP server through a unified layer
โข Extract structured data from PDFs, tables, and figures at scale
See how these upgrades unlock real production agents: www.databricks.com/blog/building-trusted-ai-agents-new-caโฆ -
Databricks
@databricks
Databricks and @awscloud are working together to simplify infrastructure setup for customers.
Automated configuration for classic workspace deployment is the first step. Teams can now create a fully configured environment in minutes, with built-in approvals, least-privilege roles, and consistent security controls. This helps organizations spend less time managing infrastructure and more time building data intelligence on AWS.
www.databricks.com/blog/databricks-and-aws-partner-simpliโฆ -
Databricks
@databricks
Get to know Lakebase, a fully managed Postgres for data apps and agents.
Take the product tour to see how Lakebase delivers a transactional database integrated into the Lakehouse and a fully managed, serverless Postgres experience:
www.databricks.com/resources/demos/tours/appdev/databrickโฆ -
Databricks
@databricks
Build secure, real-time pipelines for IoT, clickstream, and telemetry data without managing external infrastructure.
Now in Public Preview: Zerobus Ingest โ a managed service that streams event data directly into your lakehouse, no message bus required.
- Simplified ingestion
- Latency as low as 5 seconds
- Up to 100 MB/sec per connection
- Native Delta + Unity Catalog integration
www.databricks.com/blog/announcing-public-preview-zerobusโฆ -
Databricks
@databricks
A big week for Azure Databricks at #msignite!
Watch Databricks Co-founder and CEO, @alighodsi, and @Microsoft EVP of Cloud+AI, @scottgu, share how weโre partnering to make AI simple, governed and enterprise-ready.
- Agent Bricks + Agent 365: Build AI agents that operate across Microsoft 365 and Teams using data governed in Unity Catalog.
- Azure Databricks for Azure Government: Government agencies and their partners will get full access to the Databricks platform and AI capabilities in Azure Government.
- AI/BI Genie with Copilot Studio + Microsoft Foundry: Create Genie-powered Copilot Studio agents for Teams and M365, and connect agents to Foundry with secure, governed data.
- SAP Databricks on Azure: Unify SAP and external data for advanced analytics, ML and AI.This media couldn't be displayed. See it on the original post.
Databricks
@databricks
Learn more about this week's news ๐
Agent Bricks + Agent 365: www.databricks.com/blog/bring-data-intelligence-microsoftโฆ
Azure Databricks for Azure Government: www.databricks.com/blog/databricks-partners-microsoft-briโฆ
AI/BI Genie with Copilot Studio + Microsoft Foundry: techcommunity.microsoft.com/blog/analyticsonazure/azure-dโฆ
SAP Databricks on Azure: ignite.microsoft.com/en-US/sessions/BRK136?source=sessions -
Databricks
@databricks
Weโre proud to share that Databricks has been named a Leader in the 2025 @Gartner_inc Magic Quadrantโข for Cloud Database Management Systems for the fifth year in a row!
The Databricks Platform enables everyone in your organization to use data and AI. New innovations like Agent Bricks and Lakebase empower teams to create production-ready AI agents that operate securely on real-time, governed data, all on an open platform.
Download the report to see why we continue to be named a Leader in cloud data management. www.databricks.com/resources/analyst-paper/databricks-namโฆ -
Databricks
@databricks
With continuous evaluation, AI agents evolve from static tools into learning systems that improve over time โ bridging the gap between general AI capabilities and business-specific needs.
That trust comes from evaluation systems that:
- Benchmark real tasks
- Ground outputs in enterprise data
- Track changes over time
Learn the keys to evaluating AI agents: www.databricks.com/blog/key-production-ai-agents-evaluations -
Databricks
@databricks
The way we build and interact with data systems is changing fast. The rise of AI-driven workloads is blurring the line between human and machine developers, especially in how databases are created and managed.
Already, AI agents using @neondatabase create databases four times more often than humans, showing how automation is transforming data management.
@arikaplan1 explains what this means for the future of OLTP and the modern data stack. -
Databricks
@databricks
๐ Developers can now build custom Apache Sparkโข connectors in pure Python with the Python Data Source API. Now GA for Apache Spark 4.0 on Databricks Runtime (DBR) 15.4 LTS and above.
The API supports both batch and streaming workloads, integrates with Unity Catalog for governance, and makes it easy to connect to any external data source without JVM complexity. www.databricks.com/blog/announcing-general-availability-pโฆ -
Databricks
@databricks
High-concurrency, low-latency data warehousing is critical for real-time decisions.
Get practical guidance on architecting a production-grade warehouse. Key considerations, implementation practices, and tuning techniques to help you balance speed, scale, and cost: -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
Databricks.
One of the best platforms for Analytics, Data, and AI. And in this weeks lesson we are learning how to use SQL and build Visualizations!
We will use SQL to get the data we need, build Visualizations in a dashboard, and work with Filters!
www.youtube.com/watch?v=3DZQopaf8xA -
Databricks
@databricks
.@alighodsi and @sama on what organizations can do now to improve their AI outcomes: โMake your data secure, governed, and accessible so AI can actually use it.โ
Watch the full conversation to hear their perspectives on the Databricks and @OpenAI partnership, how AI agents will shape the enterprise, whatโs ahead for GPT-OSS, and more. youtu.be/gz1sOEETcgE -
Databricks
@databricks
โItโs really important that you can govern and secure your data. Once youโve done that, you can build these agents and have them seamlessly integrated across the Azure ecosystem...You donโt have to think about โhow do we make this work?โ Itโs just seamless.โ
At #msignite, Databricks Co-founder and CEO @alighodsi showcased the power of our partnership with @Microsoft and how Azure Databricks makes AI simple, governed, and enterprise-ready.
Databricks
@databricks
Watch the session: youtu.be/Ni8WGOeVbJ8
-
Databricks
@databricks
โThe best part of this demo was the part that wasnโt in the demo. You didnโt do any data engineering, you didnโt do any copying of data, you just got your SAP data product and started to go.โ
Shanku Niyogi and Anavi Nahar demonstrate how @SAP Databricks on Azure brings SAP and external data together to power advanced analytics, AI, and ML, making it easier than ever to build intelligent apps on trusted data. #msignite -
Databricks
@databricks
.@Google's Gemini 3 models are now available on Databricks!
Gemini 3 brings faster reasoning, stronger factual accuracy, and richer multimodal capabilities, from image and video understanding to ultra-long-context RAG, summarization, and classification for both batch and real-time workloads.
With AI Gateway and Agent Bricks, teams can ground Gemini in governed enterprise data and build agents that act on real business context. Gemini CLI support is coming soon to make this even easier.
Databricks is now the only platform with Gemini, Claude, and OpenAI. We canโt wait to see what customers build! www.databricks.com/blog/launching-gemini-3-pro-databricks -
Databricks
@databricks
Weโre super excited for #msignite this week, where weโll be talking about how the most innovative companies in the world are building agents with their data on Azure Databricks! www.databricks.com/blog/azure-databricks-microsoft-igniteโฆ
-
Databricks
@databricks
Databricks now supports Apache Iceberg v3, giving customers a unified and high-performance open data layer!
Iceberg v3 brings key capabilities to all managed tables:
โข Deletion vectors for faster updates
โข Row-level lineage for row-level concurrency
โข Variant data type for flexible semi-structured data
With Unity Catalog, teams can run governed Delta and Iceberg workloads on a single copy of data with full Databricks performance. www.databricks.com/blog/advancing-lakehouse-apache-iceberโฆ -
Databricks
@databricks
Weโre heading to #awsreinvent!
Join Databricks this December in Las Vegas to explore the latest in enterprise AI. Learn how organizations are building high-quality AI agents with Agent Bricks.
Stop by Booth #1420 to meet the team, see live demos, and learn how organizations are powering AI with their data to deliver real business insights and outcomes: www.databricks.com/lp/event/reinvent -
Databricks
@databricks
Evaluating LLMs goes beyond simple benchmarks. Building reliable and safe AI requires a complete view of model quality that combines quantitative metrics, automated LLM judges, and human evaluation for context and nuance.
Learn how leading teams assess performance, safety, and reliability to build trustworthy AI systems: www.databricks.com/blog/best-practices-and-methods-llm-evโฆ -
Databricks
@databricks
Many data teams still rely on cron-style schedules to guess when data is available, which can lead to wasted compute and delayed insights.
Table update triggers in Lakeflow Jobs changes that. Jobs now run automatically as soon as a table is updated, helping teams cut costs, reduce latency, and keep data fresh.
Itโs a more responsive and efficient way to orchestrate pipelines in real time: www.databricks.com/blog/announcing-table-update-triggers-โฆ -
Databricks
@databricks
Manufacturers need real-time visibility to keep equipment running efficiently and avoid costly downtime.
With the Databricks Digital Twin Solution Accelerator, teams can stream live telemetry data using Zerobus Ingest, and build interactive monitoring apps directly in the platform with Databricks Apps.
This enables continuous monitoring, anomaly detection, and predictive maintenance to optimize operations at scale.
Build your own Digital Twin with the Solution Accelerator โ www.databricks.com/blog/how-build-digital-twins-operationโฆ -
Databricks
@databricks
Now itโs even easier to create benchmarks to support AI agent evaluation. Create up to 500 questions and gold-standard answers to evaluate responses against.
Hear about this, thinking traces and other updates for evaluating and refining AI agent outputs.
Watch the latest episode of Over Architected with Holly Smith and Nick Karpov: www.youtube.com/watch?v=F4xK6oH0mfUThis media couldn't be displayed. See it on the original post. -
Databricks reposted
VentureBeat
@VentureBeat
Databricks: 'PDF parsing for agentic AI is still unsolved' โ new tool replaces multi-service pipelines with single function
venturebeat.com/ai/databricks-pdf-parsing-for-agentic-ai-โฆ -
Databricks
@databricks
Data teams shouldnโt need to switch languages just to ship production pipelines.
This guide shows how to build and deploy real-time ETL pipelines entirely in SQLโusing streaming tables, materialized views, and declarative workflows to move from prototype to production without engineering handoffs.
Streamline your workflow and keep shipping faster with the tools you already know: www.databricks.com/resources/ebook/guide-building-etl-pipโฆ -
Databricks
@databricks
ai_parse_document is a new AI Function that makes it easy to extract structured content from unstructured documents, so you can leverage all your data with your AI.
Databricks MVP Conner Schiissler put ai_parse_document() to the test โ and the results were impressive: -
Databricks
@databricks
Enterprises are sitting on massive amounts of SAP and external data, but getting a unified view for analytics and AI has always been a challenge.
In this #msignite session, the speakers will share how SAP Databricks on Azure connects the Databricks Platform with SAP Business Data Cloud to unlock governed, real-time insights without data duplication.
See how teams are modernizing forecasting, exploratory analysis, and BI with trusted SAP and third-party data at scale. ignite.microsoft.com/en-US/sessions/BRK136?source=sessions -
Databricks
@databricks
Databricks CEO @alighodsi sat down with @theCUBE, to talk about AI adoption and how Databricks is focused on helping companies build agents to automate mundane tasks while keeping governance and security front and center.
Watch the full conversation with @furrier: -
Databricks reposted
#DataAISummit
@Data_AI_Summit
Afternoon sessions are underway at #dataaiworldtour NYC, covering whatโs next for data, AI, and AI agents!
The expo floor is packed with attendees visiting sponsor and partner booths. -
Databricks
@databricks
OpenAI GPT-5.1 โ in both Instant and Thinking modes โ is now natively available on Databricks through a single, governed endpoint!
With Agent Bricks and AI Gateway, organizations can securely connect GPT-5.1 to governed data and build reliable, production-ready agents on the Databricks Platform.
Congratulations to the @OpenAI team for their latest innovations in creating a powerful model with the end user in mind. We canโt wait to see what our customers build! www.databricks.com/blog/native-openai-models-now-generallโฆ -
Databricks
@databricks
The #dataaiworldtour NYC keynote spotlighted the latest technologies powering AI Agents, how Databricks customers are building AI with Agent Bricks, and why Lakebase is disrupting the database category.
@LSEGplc's Co-Head of Data & Analytics, Ron Lefferts: โAI is moving fast, and deploying agents effectively is hard. Accuracy has to come first. With Databricks, Delta Sharing, and Agent Bricks powering any model on any cloud, teams can move faster with trusted data at the core.โ
@Rivian's Director of Core Data, Michael Flynn: โIโm using Agent Bricks every day. Iโm particularly interested in Agent Bricks when I think about people who used to not be data people and who weโre now enabling to be data people.โ
Thank you to all of our speakers! ๐ -
Databricks reposted
Nikita | Scaling Lakebase Postgres
@nikitabase
Six months ago we joined Databricks. Today, Lakebase is powering production-grade AI products for multi-billion-dollar enterprises. The pace here is unreal, itโs only possible because the team ships world-class engineering at world-class speed.
-
Databricks reposted
#DataAISummit
@Data_AI_Summit
#dataaiworldtour NYC starts now! ๐ฝ
Thousands of data leaders, innovators, and visionaries are here to explore the next frontier of AI. Weโre super excited to share the latest advancements in AI agents, Agent Bricks, Lakebase, and more. -
Databricks
@databricks
Last chance to join the Databricks Free Edition Hackathon โ your opportunity to build and showcase whatโs possible with data + AI!
Create a 5-minute demo using Free Edition, have it judged by Databricks Co-founder @rxin and other leaders, and compete for prizes up to $1,000.
Submit by Nov 14 โ www.databricks.com/resources/free-edition-hackathon -
Databricks
@databricks
Databricks CEO @alighodsi joined @jimcramer on @CNBC's Mad Money to talk about helping organizations build high quality AI agents on their business data.
โThere's been a lot of focus on super intelligence โ on building the smartest AI possible, and asking it the hardest AI math questions or programing questions. But what we really need is for AI to do mundane tasks. We are focused on how to make sure that agents can reason on these simple tasks. That's why we built Agent Bricks.โ -
Databricks
@databricks
Big things are happening at #dataaiworldtour in NYC, and what better way to kick it off than on the @NasdaqExchange tower in Times Square!
Weโre looking forward to exploring how Databricks customers are scaling agentic AI across their enterprises with Agent Bricks. -
Databricks reposted
Tasso Argyros
@tasso
Big personal update ๐ฅ
After founding & exiting two companies (a database pioneer & a CDP powerhouse), Iโm starting a new chapter: I've joined @databricks!
Iโm here to build and lead their brand-new engineering office, right here in NYC ๐ฝ -
Databricks
@databricks
Sharing live analytics with customers or partners shouldnโt mean creating new user accounts or managing extra licenses.
Now you can embed Databricks AI/BI Dashboards right inside your customer-facing apps โ fully interactive, always live, and powered by Databricks compute, not per-user fees!
Itโs an easy, low-cost way to deploy analytics to thousands of users. Deliver personalized insights at scale with built-in authentication and row-level filtering to keep everything secure and seamless. www.databricks.com/blog/how-embed-databricks-aibi-dashboaโฆ -
Databricks
@databricks
Kubernetes handles most workloads well, but millions of persistent gRPC connections at Databricks scale reveal the limits of default load balancing.
So we built a client-side system with a lightweight control plane and xDS-based service discovery for faster, more balanced, and resilient routing: www.databricks.com/blog/intelligent-kubernetes-load-balanโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Great new capability in Databricks powered by our AI research team! We trained a document parsing system that delivers leading quality at 3-5x lower cost and outperforms leading VLMs like GPT-5 and Claude. This is critical to connect AI to so many kinds of data.
Databricks
@databricks
80% of enterprise data is unstructured, locked in PDFs, reports, and diagrams that traditional tools canโt parse or govern.
Introducing ai_parse_document, state-of-the-art document intelligence on Databricks.
With a single SQL command, teams can now turn any document into structured, queryable data, unlocking context that agents can finally reason over โ at up to 5ร lower cost.
โข Capture every element โ tables, figures, and diagrams โ with AI-generated descriptions and precise bounding boxes
โข Process at scale with Lakeflow and govern everything in Unity Catalog
โข Use parsed data seamlessly across Agent Bricks, Vector Search, and AI/BI
Now in Public Preview! www.databricks.com/blog/pdfs-production-announcing-state-โฆ -
Databricks
@databricks
Serving fine-tuned models efficiently at scale remains a key systems challenge. Learn how our AI research team built a custom inference engine that out-performs open source alternatives by up to 1.8x and delivers fewer errors on common benchmarks.
This engine makes parameter efficient fine-tuning (PEFT) inference work at scale without sacrificing performance or model quality.
www.databricks.com/blog/fast-peft-serving-scale -
Databricks
@databricks
80% of enterprise data is unstructured, locked in PDFs, reports, and diagrams that traditional tools canโt parse or govern.
Introducing ai_parse_document, state-of-the-art document intelligence on Databricks.
With a single SQL command, teams can now turn any document into structured, queryable data, unlocking context that agents can finally reason over โ at up to 5ร lower cost.
โข Capture every element โ tables, figures, and diagrams โ with AI-generated descriptions and precise bounding boxes
โข Process at scale with Lakeflow and govern everything in Unity Catalog
โข Use parsed data seamlessly across Agent Bricks, Vector Search, and AI/BI
Now in Public Preview! www.databricks.com/blog/pdfs-production-announcing-state-โฆ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
Databricks.
One of the best platforms for Analytics, Data, and AI. And in this weeks lesson we are learning how to work with Data!
We will be taking a look at how to connect to data using connectors, use the SQL editor, and use Notebooks.
youtu.be/QSzqvW4amMc -
Databricks
@databricks
Join us at #msignite to explore whatโs next in data, analytics, and AI with Azure Databricks!
See how teams are building smarter with:
- Serverless workspaces and agentic AI using Lakebase and Agent Bricks
- Unified SAP and Azure data for advanced analytics
- Integrated BI and AI across Power BI, Copilot, and Azure AI Foundry
Visit Booth 5410R or join our sessions to see how Databricks and @Microsoft are helping enterprises turn data into intelligence. events.databricks.com/microsoft-ignite-2025 -
Databricks
@databricks
Converting from external to managed tables in Unity Catalog is now easier and faster.
Teams can migrate with minimal downtime while preserving configurations, table history, and control over where data is stored.
Unity Catalog managed tables deliver major benefits โ up to 20x faster queries, 50%+ lower storage costs, and stronger governance with fine-grained access controls and full data lineage.
Learn how to plan your conversion, manage rollbacks, and keep control over your dataโs physical storage location: www.databricks.com/blog/upgrade-your-lakehouse-your-how-gโฆ -
Databricks
@databricks
Submissions are now open for the Databricks Free Edition Hackathon!
Build something incredible with Free Edition and show whatโs possible with data and AI. Whether itโs an AI agent, a machine learning model, or a powerful visualization, this is your opportunity to share your project with the global data + AI community.
Projects will be judged by Databricks leaders @rxin, Franco Patano, Holly Smith, and William Valori. Submit your project by November 14: www.databricks.com/resources/free-edition-hackathon -
Databricks
@databricks
Join Databricks Co-founder and CEO @alighodsi and @OpenAI Co-founder and CEO @sama for an exclusive conversation on building AI agents that deliver real results.
Learn how to:
- Tailor AI agents to your business goals
- Build, train, deploy and continuously improve them faster with Agent Bricks
- Monitor performance continuously and at scale
- Control cost while maintaining quality
Discover how Databricks and OpenAI are helping organizations bring AI agents to production faster and elevate the standard for enterprise AI quality www.databricks.com/resources/webinar/build-ai-agents-thatโฆ -
Databricks
@databricks
Databricks Free Edition is a no-cost environment to explore, experiment, and build with data and AI.
Databricks Solutions Architect @YoussefMrini shows how to ingest data, build dashboards, and train AI models on the same unified platform used by millions of data and AI professionals.
See how to get started building and sharing with the global community. www.databricks.com/learn/free-edition -
Databricks
@databricks
Legacy BI tools come with a ton of hidden costs: performance issues, expensive usage, and ultimately strategic risks to decision-making.
Databricks AI/BI democratizes data-driven decisions with natural language. We migrated 1,300+ dashboards to AI/BI in just 5 months, and achieved:
โข 5x faster performance
โข $880K annual cost savings
โข 80% higher user satisfaction
Explore the migration playbook that made it possible: www.databricks.com/blog/supercharge-your-enterprise-bi-hoโฆ -
Databricks
@databricks
Variant, the native data type for semi-structured data, has been ratified by the Apache Parquetโข community, with support extending across Delta Lake, Apache Icebergโข, and Apache Sparkโข!
Last year, we collaborated with the open source community to create Variant, and were thrilled to see interest from other major open source projects. Now that Variant has been approved, the entire lakehouse ecosystem has a standard, open data type for semi-structured data.
www.databricks.com/blog/introducing-variant-new-open-stanโฆ -
Databricks
@databricks
Weโre excited to announce a strategic partnership with @Celonis to deliver a seamless pathway for Enterprise AI that continuously improves business operations.
The integration connects the Databricks Platform with the Celonis Process Intelligence Platform, creating a continuous learning loop for intelligent action. The foundation is Delta Sharing, our open protocol that lets customers securely share live, governed data between both platforms without copying it.
Together, weโre helping organizations turn process insights into intelligent action: www.celonis.com/news/press/celonis-partners-with-databricโฆ -
Databricks
@databricks
Enterprises can now securely connect AI agents to external tools and data with the new MCP Catalog and Agent Bricks!
โข MCP Catalog lets teams find and manage MCP servers in one place with Unity Catalog governance.
โข MCP in Databricks Marketplace expands your ecosystem with trusted partners like @SPGlobal, @moodysratings, @DunBradstreet and @FactSet.
โข Agent Bricks Multi-Agent Supervisor combines and creates powerful agents that reason over data and take action using servers from your MCP Catalog
Together, they turn disconnected tools into secure, production-ready AI systems: www.databricks.com/blog/accelerate-ai-development-databriโฆ -
Databricks
@databricks
Thousands of powerful data + AI projects have already been built with Databricks Free Edition. Now itโs your turn to join the first Databricks Free Edition Hackathon!
Build AI agents, train ML models, explore data engineering, or create dashboards โ then showcase your work to our team.
Submissions open through Nov. 14: www.databricks.com/blog/databricks-free-edition-hackathonโฆ -
Databricks
@databricks
.@Google's Gemini 2.5 models are generally available on Databricks!
When speed and scale, and multimodal intelligence matter, Gemini models deliver โ ideal for multimodal inputs, long-context RAG, summarization, and classification with fast, cost-efficient throughput.
With AI Gateway and Agent Bricks, teams can unify data, governance, and observability while building agents that act on real business context.
Itโs now easier than ever to bring the power of Gemini models to trusted, production-ready AI systems. www.databricks.com/blog/googles-gemini-models-databricks -
Databricks
@databricks
Enterprises can build intelligent AI agents powered by @OpenAI GPT-5, now generally available on Databricks!
GPT-5 shines even brighter when depth matters most โ from complex reasoning and multi-turn agents to coding and tasks that demand nuance and high-quality judgment.
With Agent Bricks and AI Gateway, teams can securely connect GPT-5 to governed enterprise data, build agents that reason with real context, and maintain unified governance and observability.
GPT-5 on Databricks gives organizations the depth and reliability to power real-world, enterprise-scale AI. www.databricks.com/blog/native-openai-models-now-generallโฆ -
Databricks
@databricks
You can now build intelligent agents with every leading model on Databricks, powered by Agent Bricks.
We know that flexibility fuels innovation, and that every model brings its unique strengths โ whether thatโs cost, performance or speed.
@OpenAI GPT-5 and @Google's Gemini models now join Meta Llama and Claude Sonnet as native models on Databricks. Build agents that combine your data with the best AI model for every task โ with the freedom to switch as models continue to evolve at breakneck speed: www.databricks.com/blog/build-intelligent-agents-every-leโฆ -
Databricks
@databricks
Protecting against data exfiltration is a key part of running a secure data platform โ but analyzing every possible path for unauthorized data movement can be complex, so we created a unified framework to help categorize data exfiltration protection controls and assess risk.
The framework outlines 19 prioritized security controls that give teams a clear, consistent way to strengthen their security strategy.
Take a look: www.databricks.com/blog/unified-approach-data-exfiltratioโฆ -
Databricks
@databricks
Building accurate, trustworthy agents in Agent Bricks starts with better judges โ because AI agents can only be as good as the ones evaluating them.
Weโre excited to streamline creation of domain-specific judges with new MLflow-powered capabilities in Agent Bricks:
โข Systematically align domain-specific evaluators with domain experts using new Tunable Judges
โข Describe evaluations in natural language with Agent-as-a-Judge
โข Easily create and maintain judges with Judge Builder, an intuitive visual workflow
These updates make evaluation an engine for continuous improvement: www.databricks.com/blog/building-custom-llm-judges-ai-ageโฆ -
Databricks reposted
Alex Freberg
@Alex_TheAnalyst
Databricks.
One of the best platforms in the world for Data Analytics and AI - and something you should learn.
This week we are starting our Databricks series to learn how to Work with Data, Building Dashboards, Working with AI, and then Building a Full Project at the end!
And with Databricks Free Edition we get to do all of it for free - can't beat that.
www.youtube.com/watch?v=fNQRQkx1SIQ -
Databricks
@databricks
.@MrSiWhiteley breaks down how semantic metadata and the AI-powered YAML builder in Unity Catalog Metric Views make data exploration clearer and more contextual.
Inconsistent metric definitions across tools and teams have long caused confusion, misalignment, and a lack of trust in data.
With metric views, define metrics once and use them consistently across reporting tools. www.youtube.com/watch?v=A59gkdqScSQ -
Databricks
@databricks
AI agents are shaking up every industry. The stakes are high when deploying agents into production, and the reality is that many projects stall in the pilot phase.
The barrier to production: trust.
This week, weโre announcing new Agent Bricks capabilities that make it easier to build agents that are accurate, governed, and production-ready. Agents you can trust.
Hereโs a look at whatโs new ๐
www.databricks.com/blog/building-trusted-ai-agents-new-caโฆ -
Databricks
@databricks
You asked for it. We built it. A library of architectural diagrams that show practical ways to build pipelines, dashboards, and AI models.
Find designs for common data and AI builds across use cases and industries, including:
- Data Ingestion
- AI Security Framework
- Next Best Action
- and more!
www.databricks.com/resources/architectures -
Databricks
@databricks
How our engineers built versionless Apache Sparkโข โ a new way of running Spark that delivers automatic upgrades, zero code changes, and unmatched stability.
A stable client API + AI-powered release management keeps workloads reliable while still delivering the latest features and fixes. With this innovation, over 2 billion workloads have been upgraded with a 99.99% success rate: www.databricks.com/blog/examining-versionless-apache-sparโฆ -
Databricks
@databricks
With Databricks Free Edition, advanced data and AI tools are accessible to everyone at no cost.
Databricks MVPs have been among the first to push its limits and share what theyโve learned โ from ingesting two billion rows in under six minutes to using it to onboard new consultants.
Read about their experiences: www.databricks.com/blog/learn-experiment-and-build-databrโฆ -
Databricks
@databricks
You canโt protect what you canโt find. Thatโs why weโre excited to launch Data Classification in Public Preview, bringing agentic AI-powered detection of PII and other sensitive data directly into Unity Catalog!
With Data Classification, you can:
โข Continuously discover sensitive data across your lakehouse
โข Automatically classify and tag PII with high accuracy
โข Apply governed tags and ABAC policies to protect data at scale
This is a major step forward in building a secure, trusted foundation for AI and analytics. www.databricks.com/blog/find-sensitive-data-scale-data-clโฆ -
Databricks
@databricks
The new @SAP Business Data Cloud Connect enables bi-directional, live, zero-copy SAP data sharing with Databricks via Delta Sharing โ no data engineering needed.
With just a few clicks to configure, this integration provides enterprises a simple path to AI and analytics on top of SAP business semantics.
Now generally available: www.databricks.com/blog/announcing-general-availability-sโฆ -
Databricks
@databricks
Over 100 enterprises are already seeing real impact from the Databricks and Palantir partnership.
With @PalantirTech's world-class AI Operating System + the Databricks Platform and Agent Bricks, customers are moving from pilots to production-scale AI deployments faster than ever. Our partnership provides a secure, scalable architecture that enables teams to deploy joint AI workflows quickly and with confidence.
See what else our customers are saying: www.databricks.com/blog/beyond-partnership-how-100-customโฆ -
Databricks
@databricks
Announcing Public Preview of Zerobus Ingest, part of Lakeflow Connect: Push event data directly into your lakehouseโno message bus required!
Simplified ingestion. Reduced latency. Built for scale.
- Up to 100 MB/sec per connection
- Latency as low as 5 seconds
- Native Delta + Unity Catalog integration
With Zerobus Ingest, teams can easily build secure, real-time data pipelines for IoT, clickstream, and telemetry data, without the complexity of managing external infrastructure. Learn more: www.databricks.com/blog/announcing-public-preview-zerobusโฆ -
Databricks
@databricks
Data sharing is now central to how organizations collaborate, and Delta Sharing addresses this critical need for secure data collaboration.
Itโs the most widely used open protocol for secure data sharing, allowing teams to exchange live data and AI assets without copies or lock-in. With 300% year-over-year growth and 40% of active shares outside Databricks, adoption continues to accelerate.
Weโve answered the top 10 questions about how Delta Sharing works, its key features, common use cases, and how to get started. www.databricks.com/blog/delta-sharing-top-10-questions-anโฆ -
Databricks
@databricks
The real world is multimodalโand your AI should be too.
See how you can build an end-to-end multimodal pipeline using PySpark, ai_query(), Databricks Vector Search, and Model Serving.
This walkthrough shows you how to do it with a real-world example of a car insurance claim estimator: www.databricks.com/blog/how-build-and-scale-multimodal-aiโฆ -
Databricks
@databricks
AI is moving fast, and the organizations leading the way share one thing in common: a strong data strategy.
What does this look like in practice? We teamed up with MIT @techreview to survey 800 CIOs, CTOs and other technical leaders, and get insight into the most critical pillars of enterprise AI.
Key findings include:
โข 65% of companies have already deployed GenAI โ and momentum is building to scale.
โข 32% of the worldโs largest enterprises are now โdata high-achievers.โ
โข More than half are doubling down on analytics and data-driven decision-making.
Explore the data and C-suite best practices for winning with AI agents: www.databricks.com/resources/whitepaper/mit-technology-reโฆ -
Databricks
@databricks
The pace of innovation in Databricks AI/BI keeps accelerating, and the October roundup is packed with updates that make analytics smarter, faster, and easier to share.
This monthโs highlights include:
- Embedded dashboards for external users
- A smarter, faster Genie with new APIs and improved benchmarking
- Tags and certification for governed, discoverable AI/BI content
- New visuals like funnel and waterfall charts
Read the full October update to see whatโs new and whatโs next in Databricks AI/BI: www.databricks.com/blog/whats-new-aibi-october-2025-roundup -
Databricks
@databricks
AI agents are transforming how teams work โ helping them automate everyday tasks and drive innovation.
In this free Databricks training, learn the fundamentals of AI agents in four short videos:
โข Core components and system types
โข The role of GenAI and LLMs in enterprise apps
โข Real-world applications across industries
โข How to use Databricks AI tools and Agent Bricks to build and deploy agents
Start learning and earn your Databricks badge ๐ฐ: www.databricks.com/resources/training/level-your-ai-agentโฆ -
Databricks
@databricks
New Databricks features are changing how teams build with data and AI โ including Geometry and Geography data types for large-scale geospatial analysis.
With 80+ Spatial SQL functions, these updates make it easier to process and query location data at scale. Just one of several new capabilities Holly and Nick explore in this episode of Over Architected: youtu.be/LSC4nOW7sZk -
Databricks
@databricks
As agents move from prototype to production, success relies on understanding your domain, not just general benchmarks.
We're excited to introduce new token-based pricing in MLflow AI evaluations! Build high-quality, domain-specific agents at 95% lower cost without sacrificing performance.
As part of this launch, we're open-sourcing production-grade prompts โ refined across industry-specific contexts to perform well in real-world scenarios. www.databricks.com/blog/build-high-quality-domain-specifiโฆ -
Databricks
@databricks
Go under the hood of how Databricks Engineers reimagined Distributed Rate Limiting to tackle latency and scaling issues.
The team rebuilt the system with in-memory sharding and client-driven batch reporting, achieving high-throughput enforcement and cutting tail latency by up to 10x: www.databricks.com/blog/high-performance-ratelimiting-datโฆ -
Databricks
@databricks
[Demo] Use Agent Bricks to quickly build a production AI agent that transforms unlabeled text documents into a structured table with extracted information.
With built-in feedback loops and AI-assisted evaluation, the Information Extraction agent continuously improves, accelerating automation while reducing risk and effort.
See how easy it is to build in this demo:
www.youtube.com/watch?v=VEYYgy0HrqM -
Databricks
@databricks
Databricks Assistant now remembers your way of working ๐ง
With Assistant Instructions, you can set your preferences once โ from coding style to data sources โ and theyโll carry across every session. No more repeating setup steps or re-teaching the Assistant each time: -
Databricks
@databricks
Most security teams still work with siloed logs and disconnected tools โ making it harder to see threats and act fast.
By unifying security, IT, and business data in one governed lakehouse, teams can use AI agents built with Agent Bricks to automate analysis, detect issues earlier, and respond in real time.
See how a data-first approach strengthens defense across the enterprise. www.databricks.com/resources/ebook/future-ai-driven-defenโฆ -
Databricks reposted
Matei Zaharia
@matei_zaharia
Fine-tuned (PEFT/LoRA) models can greatly improve quality, but serving them can be challenging due to both numerical and performance issues. Our team has done amazing work to get up to 2x higher throughput and 2-3% better quality than open source engines: www.databricks.com/blog/fast-peft-serving-scale
-
Databricks
@databricks
Advertising is evolving fast. Traditional marketing funnels are transforming, and data is more scattered across platforms and formats than ever.
AI agents help advertisers keep up so they can focus on continuous optimization โ audience segmentation, bidding, and continuous measurement โ vs. reactive tactics.
Learn how Agent Bricks and a partner ecosystem built for advertising empowers marketing teams to quickly create high-quality, domain-specific AI agents tailored to their marketing tasks and data: www.databricks.com/blog/agentic-ai-and-future-advertisingโฆ -
Databricks
@databricks
AI agents are redefining supply chain management โ combining large reasoning models with mathematical optimization to deliver transparent, data-grounded decisions that teams can trust.
See how organizations are using agentic AI to plan smarter and respond faster: -
Databricks
@databricks
[Demo] See how Agent Bricks makes it easy to build custom AI agents that learn and improve with expert feedback ๐งฑ
A knowledge assistant becomes a reliable Q&A chatbot over your documents โ showing how teams can turn enterprise knowledge into intelligent, adaptable assistance.
youtu.be/UGL28vHJhTo -
Databricks
@databricks
Kubernetes handles most workloads with ease โ but managing millions of persistent gRPC connections at Databricks scale pushes the limits of default load balancing.
Thatโs why we built a client-side system with a lightweight control plane and xDS to make routing faster, more balanced, and resilient: www.databricks.com/blog/intelligent-kubernetes-load-balanโฆ -
Databricks
@databricks
Claude Sonnet 4.5 is on Databricks!
Run @AnthropicAIโs latest model directly on your governed data โ to automate GenAI workflows, reason at scale, and build domain-specific agents with Agent Bricks.
www.databricks.com/blog/claude-sonnet-45-here -
Databricks
@databricks
We recently released the SQL Server connector from Lakeflow Connect!
This fully managed connector is designed for reliable, production-grade ingestion with built-in Change Data Capture and Change Tracking.
Learn more: www.databricks.com/blog/announcing-sql-server-connector-lโฆ -
Databricks
@databricks
๐บ๏ธ Analyzing location data at scale just got easier.
Databricks Spatial SQL lets you work with native GEOMETRY and GEOGRAPHY types, run over 80 built-in SQL functions, and perform spatial joins without manual indexing.
Now in public preview: www.databricks.com/blog/introducing-spatial-sql-databrickโฆ -
Databricks
@databricks
โWe asked organizations, โWhat was the value of Agent Bricks?โ They said it delivered โmuch higher accuracy and quality.โโ
Arsalan Tavakoli-Shiraji, Databricks Co-founder & SVP of Field Engineering, joined @business to discuss how the next era of AI and AI agents is driving real business outcomes and value.
Databricks
@databricks
Watch the full interview here: www.youtube.com/watch?v=u2NsNiU1R_c&t=1969s
-
Databricks reposted
#DataAISummit
@Data_AI_Summit
Thank you, London! ๐
The #dataaiworldtour continues in EMEA. Next up, we're saying. Guten tag to Munich on November 4. -
Databricks
@databricks
"We are always focusing on getting customers what they want, where they want, when they want."
๐ฅค @7eleven is transforming how it connects with customers by using data and AI to deliver personalized offers, faster insights, and seamless analytics across marketing campaignsThis media couldn't be displayed. See it on the original post. -
Databricks reposted
#DataAISummit
@Data_AI_Summit
From #dataaiworldtour London ๐ฌ๐ง
@databricks will train 100K people in data & AI across the UK & Ireland by 2028, invest >$10M in the UK & Europe to build AI skills and accelerate adoption of Agent Bricks
Learn more ๐ www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
Enforce consistent, secure tagging across data and AI assets with Governed Tags in Unity Catalog!
Teams are already using Governed Tags to:
๐ท๏ธ Enforce consistent tagging
๐ท๏ธ Improve discovery and compliance
๐ท๏ธ Optimize costs
Now in public preview: www.databricks.com/blog/enforce-consistent-secure-taggingโฆ -
Databricks
@databricks
New research from the Databricks AI research team shows automated prompt optimization can deliver quality improvements on par with supervised fine-tuningโand with lower serving cost.
This research highlights our work to help customers build smarter, self-improving enterprise AI agents that deliver real-world performance without prohibitive retraining costs.
Stay tuned as we continue to push the boundaries of agent optimization with Agent Bricks, our platform for building, evaluating, and deploying production-grade AI agents for enterprise workflows: www.databricks.com/blog/building-state-art-enterprise-ageโฆ -
Databricks
@databricks
Postgres 18 recently shipped, and it's available on @neondatabase!
Deploy it in a few seconds and try the new features: neon.com/blog/postgres-18 -
Databricks
@databricks
Big news: @SAP Business Data Cloud Connect is GA!
Now you can connect SAP Business Data Cloud with Databricks for zero-copy, bidirectional, live data sharing via Delta Sharing.
Together, these capabilities drive faster insights, smarter decisions, and enterprise-wide innovation: www.databricks.com/blog/announcing-general-availability-sโฆ -
Databricks
@databricks
How Databricks Engineers developed a high performance rate limiting system.
The team rebuilt the system with in-memory sharding and client-driven batch reporting to achieve low-latency, high-throughput enforcement. With this approach, they cut tail latency by up to 10x.
See how they did it: www.databricks.com/blog/high-performance-ratelimiting-datโฆ -
Databricks
@databricks
Weโre excited to announce that Databricks has acquired @mooncakelabs to accelerate the vision of Lakebase, a new category of OLTP database built on Postgres and optimized for AI agents!
AI agents are transforming application development, and Lakebase gives developers a single foundation for applications, analytics, and AI โ fully integrated with the Lakehouse and Agent Bricks.
Together, we will build on this innovation, ensuring Postgres data is immediately ready across workloads, without the overhead of ETL pipelines. Please join us in welcoming the team to Databricks! dbricks.co/3IOMj6m -
Databricks
@databricks
Big news: Databricks and @OpenAI are partnering to deliver powerful AI to the enterprise. OpenAI frontier models will now be available natively in Databricks.
This means you can build, evaluate and scale production-grade AI apps and agents on your governed enterprise data, leveraging the latest OpenAI models like GPT-5.
Weโre excited to expand our relationship with OpenAI; Databricks was one of the first to host gpt-oss open models, they use Databricks products and now weโre offering OpenAI models natively on Databricks: www.databricks.com/blog/run-openai-models-directly-databrโฆ -
Databricks
@databricks
Today, weโre excited to announce a strategic partnership with @LSEGplc
to bring AI-ready financial data natively to Databricks via Delta Sharing.
With this collaboration, teams can combine enterprise and LSEG data to rapidly build governed AI agents for investment analytics, risk management, and trading workflows with Databricks Agent Bricks.
Financial services teams often struggle with outdated, batch-based data delivery that is slow, costly and manual. Together, Databricks and LSEG enable enterprises to unify live financial data, powering analytics, AI apps, and agents for faster, more informed decision-making.
Learn more: www.databricks.com/company/newsroom/press-releases/lseg-aโฆ -
Databricks
@databricks
KPMG is using Delta Sharing on Databricks to transform audits. By securely accessing cross cloud data directly in Databricks, @KPMG eliminated data copies and cut query times by 80%.
"Using Delta Sharing has made a noticeable difference to our audit process ... so our audit teams always work from the latest, single source of the truth."
Learn more: www.databricks.com/blog/how-kpmg-uses-delta-sharing-accesโฆ -
Databricks
@databricks
Weโre looking forward to helping scale the next generation of AI startups.
โWith the new accelerator, Databricks wants to go beyond standard venture capital, offering companies mentorship from its executives, and helping them grow, in some cases, even before the startup has a product out.โ
Read more about our new AI Accelerator Program in @Forbes www.forbes.com/sites/richardnieva/2025/09/17/databricks-sโฆ -
Databricks
@databricks
Today weโre excited to announce the Databricks AI Accelerator Program โ an initiative supporting pre-seed and seed-stage AI startups building on Databricks!
Congratulations to the inaugural cohort: Alpha Level, Datalinx AI, Deductive AI, Fleak, and ziggiz
Together with leading VC partners, Databricks is shaping an ecosystem to help founders innovate, scale, and build transformative data + AI applications.
Learn more and apply: www.databricks.com/blog/fueling-next-generation-ai-announโฆ -
Databricks
@databricks
Databricks CEO @alighodsi joined @CNBC to talk about AI adoption, hitting key milestones, data governance, and how new products are powering the next wave of AI innovation.
โWeโre seeing lots of momentum around our AI products, including Agent Bricks, a product that helps you build AI agents in the workplace to automate everyday tasks,โ says Ghodsi. โWeโre seeing a huge uptick in this โ and some of these AI use cases really taking off.โ www.cnbc.com/video/2025/09/08/concerns-around-corporate-dโฆ -
Databricks
@databricks
The future of data science is autonomous, collaborative, and faster than ever.
That's why we're excited to introduce the Data Science Agent for Databricks Assistant, an autonomous partner that plans, executes, and self-corrects entire workflows in your Notebooks and SQL Editor.
Get:
-End-to-end lifecycle support โ from EDA to feature engineering, model training, and evaluation
-Autonomous multi-step execution with full transparency and control
-Deep Unity Catalog integration for governed, production-ready results
-Native to Databricks Notebooks and SQL Editor for a seamless experience
www.databricks.com/blog/introducing-databricks-assistant-โฆ -
Databricks
@databricks
Now GA: Share Materialized Views and Streaming Tables with Delta Sharing!
GA introduces new capabilities:
- Providers can now share views created from MV/STs
- Recipients can create views on top of shared MV/STs
- Recipients can easily build their own data pipelines on top of shared MV/STs
Learn how customers like @Reltio are using this to eliminate redundant pipelines and deliver trusted, insight-ready data instantly: www.databricks.com/blog/now-ga-share-materialized-views-aโฆ -
Databricks
@databricks
We're excited to share that Delta Sharing: An Open Protocol for Cross-Platform Data Sharing was named Best Paper Industry Runner-Up at #vldb2025! www.vldb.org/pvldb/vol18/p5197-puttaswamy.pdf
Catch @matei_zaharia's keynote Thurs (9:15โ10:15 BST) and visit our booth or Careers Site for more information on our open roles across databases and distributed systems: www.databricks.com/company/careers/open-positions?departmโฆ -
Databricks
@databricks
Building apps on Databricks just got a lot easier! ๐๏ธ Learn how Lakebase can serve as the transactional data layer for Databricks Apps.
- Unified stack: Build apps on top of data in your lakehouse with Databricks Apps + Lakebase
- Secure & serverless: Native auth, governance, and access controls included
- Practical guide: Walkthrough the setup of building an App
www.databricks.com/blog/how-use-lakebase-transactional-daโฆ -
Databricks
@databricks
We're excited to share that @TectonAI will soon join Databricks, providing enterprises with fast, reliable, real-time data for deploying AI agents.
Tectonโs technology helps enterprises leverage their mission-critical data to power AI agents for critical use cases.
Bringing Tecton into Databricks will unite the best in online data serving with Databricksโ Agent Bricks, empowering customers to build, deploy and scale AI agents faster and more confidently than ever before.
We're excited to see what you build. www.databricks.com/blog/tecton-joining-databricks-power-rโฆ -
Databricks
@databricks
Databricks DevConnect brings together data practitioners, AI innovators, and developers for technical deep dives, real-world insights, and community connection ๐ค
Join us for live demos, thought-provoking discussions on data engineering and AI, and pushing the boundaries of whatโs possible with Databricks. lu.ma/DevConnectDBX?k=c -
Databricks
@databricks
Our co-founder and CEO @alighodsi joined @CNBC's Power Lunch to discuss our Series K funding round, and how weโre powering agentic AI innovation.
โOur focus is helping organizations build agents that are actually useful and solve the day-to-day tasks organizations are facing,โ said Ghodsi. Watch the full interview: www.cnbc.com/video/2025/08/19/databricks-ceo-on-ai-vcs-arโฆ -
Databricks
@databricks
You can get started with @OpenAI's GPT-5 model today on Databricks with AI Gateway! GPT-5 unlocks new frontiers in reasoning, multimodal understanding, and task execution โ we canโt wait to see what our customers build.
Weโre thrilled to support this incredible week of innovation from OpenAI. www.databricks.com/blog/build-gpt-5-databricks-ai-gateway -
Databricks
@databricks
Weโre excited to partner with @OpenAI to launch their new open source models natively on Databricks!
gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI.
Try both the 20B and 120B today in the Mosaic AI Playground. www.databricks.com/blog/introducing-openais-new-open-modeโฆ -
Databricks
@databricks
โWe're at the dawn of the AI software revolution, and every engineer is becoming an AI engineer.โ
Modern AI apps demand more than legacy databases can offer. At #dataaisummit, @neondatabase CEO and co-founder @nikitabase shared how Databricks and Neon are reshaping database architecture for the AI era with Lakebase.
This fully managed, serverless Postgres database is built to unify operational and analytical data on the lake house. Watch the full keynote conversation to learn more about fast, developer-first Postgres for intelligent applications: www.databricks.com/blog/announcing-lakebase-public-preview -
Databricks
@databricks
Clean Rooms now support multi-party collaborations across all clouds!
The latest advancements in Databricks Clean Rooms help users unlock richer insights. Take a look at what's new:
- Databricks Clean Rooms now GA in GCP, enabling seamless cross-collaborations
- Multi-party collaborations are now GA with advanced privacy approvals
- Leading identity partners using Clean Rooms for privacy-centric Identity Resolution
Learn more: www.databricks.com/blog/whats-new-databricks-clean-rooms -
Databricks
@databricks
.@michaelarmbrust, Distinguished Software Engineer at Databricks, talked to @VentureBeat Apache Sparkโข Declarative Pipelines: a proven declarative API for building robust data pipelines with a fraction of the work.
โYou declare a series of datasets and data flows, and Apache Spark figures out the right execution plan."
venturebeat.com/data-infrastructure/databricks-open-sourcโฆ -
Databricks
@databricks
Announcing Databricks One: a new, streamlined experience that gives business users fast and secure access to data and AI insights.
Databricks One is designed to get powerful tools like AI/BI Dashboards, Genie and Databricks Apps into the hands of business users. A single, intuitive entry point to interact with your data โ without needing to understand clusters, queries, models, or notebooks. www.databricks.com/blog/introducing-databricks-one -
Databricks
@databricks
Databricks AI/BI Genie is now GA! Over 4,000 organizations have already adopted AI/BI Genie in Preview โ including HP Inc., 7-Eleven and SEGA Europe โ to democratize data and to empower their non-technical users.
Building on these innovations, weโre excited to announce the preview of Genie Deep Research โ a new mode designed to address more complex, multi-step โwhyโ questions. -
Databricks
@databricks
.@ThomasOrTK, CEO of @googlecloud, and Databricks CEO and Co-founder @alighodsi discuss a new strategic partnership, the latest Gemini models, and how organizations can build and scale AI agents tailored to their specific domains and data.
โOur partnership is another critical step in helping every enterprise transform their businesses with generative AI,โ said Thomas Kurian. -
Databricks
@databricks
We're excited to announce a strategic AI partnership with Google Cloud to bring Gemini Models natively to the Data Intelligence Platform.
The latest Gemini models will be available as native products within Databricks, empowering organizations to build, deploy and scale AI agents using Google Geminiโs advanced capabilities directly on their enterprise data โ securely and with unified governance โ within their Databricks environment.
www.databricks.com/company/newsroom/press-releases/databrโฆ -
Databricks
@databricks
You can now build scalable pipelines and perform data analysis without writing a single line of code.
Announcing Lakeflow Designer, a visual, no-code pipeline builder that lets business analysts create ETL pipelines using drag-and-drop and natural language. Coming soon to Public Preview. www.databricks.com/blog/announcing-lakeflow-designer-no-cโฆ -
Databricks
@databricks
Declarative Pipelines is going open source!
Weโre excited to bring a proven standard for building reliable, scalable data pipelines with Apache Sparkโข to the community.
Built with openness and composability in mind, Declarative Pipelines allows developers to define what their pipeline should do โ and let Spark determine the how.
Thank you to everyone who contributed - we're thrilled to continue our commitment to open source. www.databricks.com/blog/bringing-declarative-pipelines-apโฆ -
Databricks
@databricks
Today, at #dataaisummit @matei_zaharia introduced major innovations that expand Unity Catalog to business users!
- Unity Catalog Metrics: A single source of truth for business metrics across data engineering, ML and BI
- Unity Catalog Discover: New curated internal marketplace with certifications and metadata
See what's new: www.databricks.com/blog/whats-new-databricks-unity-cataloโฆ -
Databricks
@databricks
โAgents are now creating databases. This agentic era is going to disrupt the whole database industry.โ
Databricks CEO @alighodsi sat down with @dee_bosa today at #dataaisummit to discuss the database market, the Lakebase launch, and the overall AI landscape โ including bottlenecks of AI adoption, the talent war, and more.
Watch the full @CNBC segment here: youtu.be/UKFYmu0gQBw -
Databricks
@databricks
Hanlin Tang, our CTO of Neural Networks, on stage talking about new GenAI capabilities in MLflow 3.0! #dataaisummit
-
Databricks
@databricks
Announcing Agent Bricks: auto-optimize agents for your domain tasks.
Provide a high-level description of the agentโs task, and connect your enterprise data โ Agent Bricks handles the rest.
Agent Bricks builds out an agent system that automatically optimizes against your goals and generates domain-specific synthetic datasets, accelerating agent development without relying on manual labeling or external sources. www.databricks.com/blog/introducing-agent-bricks -
Databricks
@databricks
In just 6 months, customers have created 20,000+ apps across over 2,500 organizations with Databricks Apps.
Today, weโre excited to announce the General Availability of Databricks Apps, enabling all customers to securely build, deploy, and scale interactive data and AI-powered applications natively on the Databricks Data Intelligence Platform. We canโt wait to see what you build! www.databricks.com/blog/announcing-general-availability-dโฆ -
Databricks
@databricks
At #dataaisummit, @nikitabase, Co-founder and CEO of @Neondatabase, and @rxin, Co-founder and Chief Architect of Databricks, discussed the shift to AI agents โ and how weโre building the most developer and AI agent-friendly database platform.
-
Databricks
@databricks
Databricks Co-founder and Chief Architect @rxin shares how Lakebase, a new category of databases, meets the current needs of agentic workloads and developers. โCurrent databases are disconnected from modern workloadsโthis changes that."
-
Databricks
@databricks
Introducing Lakebase, the first fully-managed Postgres database integrated with the lakehouse and built for AI.
Lakebase combines the familiarity of Postgres with the scalability of the lakehouse and the agility of @neondatabaseโs database branching technology. Hundreds of customers are already using Lakebase for a variety of use cases. www.databricks.com/blog/announcing-lakebase-public-preview -
Databricks
@databricks
Databricks launches Free Edition! Explore and learn the latest data and AI technologies for free.
Users can experiment with the full range of use cases โ from building AI agents and applications to analyzing data with SQL โ on the same platform used by millions of professionals.
Weโre proud to help todayโs students and enthusiasts build real skills on real tools in today's competitive AI and ML job market. -
Databricks
@databricks
Tomorrow at #dataaisummit, the keynote stage lights up with leading experts, researchers, open source contributors and special guests. Be among the first to witness the latest breakthroughs from Databricks, and share the success of innovative data and AI companies.
Join us live or virtually at 8AM PT: www.databricks.com/dataaisummit -
Databricks
@databricks
#dataaisummit starts NOW.
Thousands of data engineers, data scientists and data experts are gathered in San Francisco this week to explore the convergence of data and AI. We'll be sharing highlights here.
Couldn't join us in person? Register for a virtual pass ๐: -
Databricks
@databricks
#dataaisummit starts tomorrow! 20,000 attendees, 700+ sessions, keynotes, meetups, and trainingโall at the worldโs largest data, analytics, and AI conference
Itโs not too late to join us. Register to attend in San Francisco or virtually: www.databricks.com/dataaisummit -
Databricks
@databricks
Apache Icebergโข v3 brings advanced new features designed for modern data workloads โ and marks a major step toward format unification!
Updates include:
โ Improved read performance with deletion vectors
โ Easier incremental processing via row lineage
โ Native support for semi-structured and geospatial data
โ Seamless interoperability across Delta Lake, Apache Parquet and Apache Sparkโข
www.databricks.com/blog/apache-icebergtm-v3-moving-ecosysโฆ
Catch Ryan Blue and Daniel Weeks at #dataaisummit as they share how weโre bringing Iceberg v3 features into our managed tables. Join us! -
Databricks
@databricks
Weโre proud to be named a Leader in the 2025 @Gartner_incยฎ Magic Quadrantโข for Data Science and Machine Learning Platforms for the fourth time!
Databricks is positioned highest in Ability to Execute and furthest in Completeness of Vision. We believe this reinforces our reputation as a trusted platform with proven success in Data Science, ML and AI.
๐ Get the report: www.databricks.com/resources/analyst-research/gartner-mq-โฆ -
Databricks
@databricks
We're excited to introduce a collaboration with @Atlassian that unlocks new data sharing capabilities from Atlassian Analytics!
Powered by Delta Sharingโs open protocol, Atlassian customers can securely access and analyze their data from the Atlassian Data Lake with the tools of their choice. This new data share feature opens up practical use cases: BI integration, custom data workflows, cross-team collaboration and more.
www.databricks.com/blog/atlassian-databricks-unlocking-daโฆ -
Databricks
@databricks
Attend #dataaisummit in San Francisco to hear from experts across industries on how theyโre applying the latest data and AI technologies in the real world.
Register for access to:
โ๏ธ Keynotes from expert leaders on the latest advancements and technology trends
โ๏ธ 700+ technical sessions on data intelligence, GenAI, data warehousing and more
โ๏ธ Hands-on training and certifications
โ๏ธ Technical Meetups and networking events
dbricks.co/42BHcgW -
Databricks
@databricks
Itโs official: @SAP Databricks is now GA!
SAP customers can now unlock data intelligence across their SAP data and external sourcesโenabling improved governance, advanced analytics, and AI use cases. Learn more: dbricks.co/4d1tmrY -
Databricks
@databricks
Thereโs still time to join tomorrowโs webinar with Databricks CEO @AliGhodsi, @AnthropicAI CEO @DarioAmodei, and other industry leaders โ and learn how enterprises can build AI apps they can trust.
Explore real-life examples of customers using AI agents to accomplish domain-specific solutions โ and gain best practices for optimizing workflows that provide high-quality results for their specific domain, understand organizational data, and adhere to security and governance protocols.
Donโt miss it โ register now: dbricks.co/4iwJnZ2 -
Databricks
@databricks
Thrilled to welcome the Fennel team to Databricks!
Fennel improves the efficiency and data freshness of feature engineering pipelines for batch, streaming and real-time data. Their innovative approach tackles some of the biggest challenges of feature engineering while optimizing costs.
Integrating Fennelโs capabilities into the Databricks Data Intelligence Platform will help customers quickly iterate on features, deploy #ml models with reliable, real-time data and improve model accuracy. Learn more: dbricks.co/4lzNSDL -
Databricks
@databricks
Catch @alighodsi and Mark Zuckerberg at ๐ฆ #llamacon, where theyโll discuss the importance of open source AI and share advice for founders building AI-powered applications.
This is a canโt-miss event for developers who want to explore the latest in open source AI and best practices from industry leaders.
dbricks.co/4loqZDi -
Databricks
@databricks
We're excited to introduce major updates to Lakehouse Federation!
โ Lakehouse Federation for Google BigQuery now GA
โ Public Preview of Oracle and Teradata connectors
Now, you can connect, discover, govern, and query data from these sources through Unity Catalogโwithout migration or ETL.
dbricks.co/3Fvtljp -
Databricks
@databricks
Weโre wrapping up our Week of Agents with some major updates to AI Functions! Introducing Serverless Batch Inference.
Whether general-purpose or task-specific, AI functions are now fully serverless and production-grade, requiring zero configuration and delivering over 10x faster performance.
See whatโs new ๐
dbricks.co/4iJ8Iym -
Databricks
@databricks
Introducing Genie Conversation APIs: self-serve data insights from your favorite productivity tools and custom-built apps.
With this new suite of APIs, you can programmatically embed AI/BI Genie into popular apps like Slack and Teams or seamlessly integrate it with Mosaic AI Agent Frameworks.
Now in Public Preview on AWS, Azure and GCP! dbricks.co/3FnWwF6 -
Databricks
@databricks
We're excited to announce a new partnership with @SAP that will provide the Databricks Data Intelligence Platform natively within SAPโs newly launched SAP Business Data Cloud.
SAP Databricks will allow customers to use the AI, data warehousing, data engineering and data governance capabilities of Databricks on mission-critical data from SAP.
dbricks.co/4jTRXC1 -
Databricks
@databricks
Weโre excited to announce a major expansion in the Databricks + @confluentinc partnership, enabling real-time data for AI-driven decision-making.
Many organizations struggle to make AI operational because their data is siloed into different systems that werenโt built to work together. New bidirectional integrations between Confluentโs Tableflow and Databricks Unity Catalog will provide consistent, real-time data across operational and analytical systems that is discoverable, secure, and trustworthy.
Our CEO @alighodsi and Confluent CEO @jaykreps share more about this partnership: dbricks.co/3CAPjAx -
Databricks
@databricks
Now GA on Google Cloud: Serverless Compute for notebooks, Workflows and DLT pipelines!
Serverless compute provides practitioners with the speed, scalability, and simplicity needed to address challenges across todayโs data engineering and analytics landscape: -
Databricks
@databricks
Announcing GA of Databricks Clean Rooms โ secure, privacy-centric collaboration on any cloud, region or data platform.
Leading companies like Mastercard and Intuit are already using Clean Rooms to drive privacy-centric data sharing and solve complex challenges.
Clean Rooms is now available on AWS and Azure. See how to get started:
dbricks.co/40PhuDE -
Databricks
@databricks
We're excited to share that you can now run Deepseek-R1 on Mosaic AI Model Serving.
Deepseek-R1, with its reasoning capabilities, has changed the narrative around open-source #llms and is a big milestone in democratizing AI.
With the Databricks Data Intelligence Platform, our customers can leverage Deepseek's state-of-the-art model together with their data to build high-quality AI agent systems.
dbricks.co/4jG7XaQ -
Databricks
@databricks
New goal for the #newyear โ sharing your data + AI expertise with the world.
#dataaisummit Call For Presentations is now open! Weโre looking for data engineers, ML engineers, data scientists and analysts who are pushing the limits of AI, analytics and data engineering.
Submit your proposal by February 3rd ๐ dbricks.co/3Wh1Mx6 -
Databricks
@databricks
Credential vending for #unitycatalog open APIs now in Public Preview.
Benefits include:
- Seamless interoperability across diverse compute engines
- Simplified permissions management
- A foundation for advanced governance features
Learn more๐ dbricks.co/41NaFoe -
Databricks
@databricks
Today, some of the largest companies in the world use Databricks to find and treat diseases and cancer earlier, detect financial fraud, reduce time to mental health intervention, decrease local financial inequality, and much more.
Our CEO Ali Ghodsi spoke with @WSJ about the company's beginnings, and how it became one of the fastest growing companies in tech: dbricks.co/4gjLRJ5 -
Databricks
@databricks
Introducing Serverless Time Series Forecasting in Mosaic AI! Unlock the predictive power of your time series data with 50% better accuracy, enhanced flexibility, and improved governance. dbricks.co/3Vv3uNK
-
Databricks
@databricks
Introducing Hive Metastore and AWS Glue Federation in Unity Catalog. Seamlessly leverage Unity Catalog's advanced features without the overhead of migrating HMS or AWS Glue-managed tables.
Learn more ๐ dbricks.co/49H5Pek -
Databricks
@databricks
Announcing the winners of the Databricks #generativeai Startup Challenge!
- Grand Prize: @vevo_ai
- Second Place: @OrbyAI
- Third Place: @ChipStackAI
- Honorable Mention: Flagler Health
Weโre thrilled to see their continued growth and impact! dbricks.co/3DbIULQ -
Databricks
@databricks
Introducing new synthetic data capabilities in Mosaic AI Agent Evaluation.
Now, developers can create high-quality evaluation data sets based on their proprietary data in just minutes โ without being bottlenecked by SMEs.
How to get started๐www.databricks.com/blog/streamline-ai-agent-evaluation-wiโฆ -
Databricks
@databricks
Thrilled to partner with @AIatMeta on the new Llama 3.3 model on Databricks. Starting next week, our customers will be able to serve the updated model to build agent systems.
Together, we're making AI more accessible & cost-effective for developers & enterprises. -
Databricks
@databricks
Calling all Data + AI Innovators!
dbricks.co/4fy5e08
#dataaisummit 2025 is your chance to showcase your work to 70,000+ peers! ๐
Share insights on:
โ๏ธ Real-time data streaming
โ๏ธ Deep learning & ML
โ๏ธ BI and SQL analytics
โ๏ธ & more! -
Databricks
@databricks
Struggling with unstructured text data across millions of documents? Discover how Databricks simplifies and automates LLM inference, turning vast text into actionable insights at record speed.
Learn more about batch inference on #mosaicai Model Serving: dbricks.co/4eeg1vs -
Databricks
@databricks
Databricks Apps is the fastest way to build applications on the Databricks Data Intelligence Platform!
Now in Public Preview on AWS and Azure, developers can create applications with popular frameworks, serverless deployment, and built-in governance: dbricks.co/40jjV2z -
Databricks
@databricks
Weโre thrilled to partner with @ServiceNow to deliver Zero Copy, bi-directional integration with the Databricks Data Intelligence Platform, powered by Delta Sharing!
This integration will help our customers turn data into instant, AI-powered action.
ServiceNow News
@ServiceNowNews
โ A Zero Copy partnership with @Databricks: supercharges machine learning and AI capabilitiesโ
Databricksโ Delta Sharing will enable ServiceNow to offer Zero Copy, high-bandwidth, bi-directional, and secure integration with the Databricks Data Intelligence Platform so customers can turn data and insights into instant, AI-powered action. โ
Learn more: www.servicenow.com/company/media/press-room/databricks-coโฆ -
Databricks
@databricks
Embedding for AI/BI Dashboards is now available! Seamlessly integrate Databricks AI/BI Dashboards into your internal websites and applications. LINK
Key Features:
- Integration flexibility
- Secure access
- Optimized performance
Learn more: dbricks.co/3Y22dOn -
Databricks
@databricks
Introducing Databricks Apps โ a new way to build internal data + AI applications.
Build data visualizations, AI applications and self-service analytics directly on the Databricks Data Intelligence Platform. Now in Public Preview on AWS and Azure. dbricks.co/4dLsQxa -
Databricks
@databricks
Over 7k customers use #databrickssql as their data warehouse. We recently added new features & performance improvements that make it simpler, faster & lower cost. Including:
- AI-powered performance
- AI Assistant for SQL Analysts
- AI Functions updates
dbricks.co/3XGxZSh -
Databricks
@databricks
Introducing the Databricks Generative AI Startup Challenge โ a competition for startups using #genai to build innovative products powered by the Databricks Data Intelligence Platform!
Participate for a chance to win up to $1M in venture funding & prizes: dbricks.co/3Bd9bso -
Databricks
@databricks
Thrilled to introduce new updates to #mosaicai Gateway! Simplified, secure & governed AI for all your GenAI models.
This release adds advanced features in usage tracking, payload logging & guardrails to help customers accelerate their AI initiatives. dbricks.co/3XClhUs -
Databricks
@databricks
Hybrid search in #mosaicai Vector Search is now GA!
This powerful feature combines the strength of pre-trained embedding models with keyword search flexibility.
Explore how it works and how to use it to improve your search results: www.databricks.com/blog/announcing-hybrid-search-general-โฆ -
Databricks
@databricks
Lakehouse Federation makes it simple for organizations to discover, query, and govern all your data in one place, no matter where it lives
Now in GA, see the latest capabilities in Lakehouse Federation โ and whatโs coming next.
dbricks.co/3A56EQr -
Databricks
@databricks
Databricks Clean Rooms enables collaboration with partners in a privacy-safe manner without relinquishing control over sensitive data.
Key features:
Any language, any workload
Any cloud, no replication
Any scale, any trust level
Learn how it works ๐
dbricks.co/4fykWt0 -
Databricks
@databricks
Thrilled to be named #2 on the 2024 @forbes #cloud100 โ celebrating the worldโs biggest private cloud companies! โ๏ธ
We're honored to help teams solve problems with data + AI. Thank you for the recognition @Forbes @BessemerVP @SalesforceVC! dbricks.co/4d5XIJ0 -
Databricks
@databricks
LakeFlow Connect is now in Public Preview for SQL Server, Salesforce, & Workday!
These connectors provide a simple & efficient way to ingest data into the Data Intelligence Platform, allowing users to spend less time building complex ingestion pipelines. dbricks.co/4dk60gJ -
Databricks
@databricks
Serverless compute is now GA! โ
Focus on writing code while we handle the rest. Enjoy fully managed compute infrastructure with fast workload startup, high reliability, and simple operation.
Learn more about our latest updates: www.databricks.com/blog/announcing-general-availability-sโฆ -
Databricks
@databricks
Thrilled to offer the @AIatMeta Llama 3.1 series of models on Databricks! These models expand context length to 128K, add multilingual capabilities + include Llama 3.1 405B โ the largest + highest-quality openly available foundation model. dbricks.co/4dcJpC3
-
Databricks
@databricks
Now GA: Serverless compute for Databricks Notebooks, Workflows, and Delta Live Tables!
You write the code, and we provide a fully managed compute infrastructure with fast workload startup, high reliability and simple operation. dbricks.co/4bPEVjz -
Databricks
@databricks
Announcing Mosaic AI Agent Framework and Agent Evaluation! Designed to help developers build and deploy high-quality Agentic and RAG apps.
Learn more: dbricks.co/3RWt7VJ -
Databricks
@databricks
We recently announced new Delta Sharing innovations that enable Data + AI success! This includes:
- GA of volume sharing and Cloudflare R2 support
- Cross-platform view sharing
- Sharing for Lakehouse Federation
and more!๐
dbricks.co/4cfLBIP -
Databricks
@databricks
Databricks named a Leader in the 2024 Gartnerยฎ Magic Quadrantโข for Data Science and ML Platforms & positioned highest in Ability to Execute out of all evaluated vendors!
We believe this recognition validates our focus on GenAI & traditional data science dbricks.co/3VLPvU9 -
Databricks
@databricks
A snapshot of new innovations announced at #dataaisummit. New solutions for GenAI, unified governance, data sharing, and more. These include:
- Databricks AI/BI
- Unity Catalog OSS
- New Mosaic AI capabilities
- Databricks LakeFlow
- Shutterstock ImageAI
dbricks.co/4cbHOMA -
Databricks
@databricks
Introducing Databricks LakeFlow, a new solution that simplifies all aspects of data engineering through a simple, unified & intelligent experience. Easily build production-grade data pipelines to scale to the ever-growing demand for reliable #data & #ai. dbricks.co/3VAB5Ge
-
Databricks
@databricks
.@matei_zaharia just open sourced Unity Catalog LIVE at #dataaisummit!
-
Databricks
@databricks
Databricks AI/BI is a new type of BI product that understands your dataโs semantics & democratizes insights:
- AI/BI Dashboards: AI powered, low-code dashboarding
- Genie: learns underlying data, flexibly answers questions
Built on a compound AI system. dbricks.co/3VnMeJc -
Databricks
@databricks
โThe best data warehouse is a lakehouse.โ @rxin live from the #dataaisummit
-
Databricks
@databricks
Announcing Shutterstock ImageAI, powered by Databricks! Text-to-imate GenAI model for the enterprise. Generate high-fidelity, trusted images tailored to your business needs.
Built with Databricks #mosaicai & trained on @Shutterstockโs image repository.
dbricks.co/3VCyP1m -
Databricks
@databricks
โAll of Databricks will be available in serverless,โ says @alighodsi during his keynote on Databricks innovation at #dataaisummit Coming July 1
-
Databricks
@databricks
Databricks to acquire @Tabulario, a data platform from the original creators of Apache Iceberg. Together, we will bring format compatibility to the lakehouse for @DeltaLakeOSS and @ApacheIceberg dbricks.co/458s3n4
-
Databricks
@databricks
Databricks co-founder and CEO @alighodsi is back for another year on the #dataaisummit keynote stage!
Join us to hear his take on the future of #genai, data warehousing, and more โ plus, discover the latest in the Databricks Data Intelligence platform. dbricks.co/3WOMi7g -
Plotly
@plotlygraphs
Our team will be at Databricksโ Data + AI Summit 2024! ๐ As a @databricks Select ISV partner, Plotly brings a production-grade, dynamic, and flexible front end directly into Databricks environments.
From June 10-13, come say hi and meet our team at booth 17. Learn about how Plotly and Dash Enterprise can help you:
โญ Go beyond BIโs limitations of scale, speed, and interactivity
โญ Easily turn notebooks into web apps with our code-first and point-and-click interfaces
โญ Build dashing data apps in minutes with our scalable, secure framework
In the coming weeks, we will share more content and news related to the event so stay tuned! go.plotly.com/databricks-data-ai-summit-2024
#databricks #dataaisummit #datavisualization #plotly #python #data #analytics
Databricks
@databricks
Can't wait for you to join us at #dataaisummit! Great opportunity for attendees to see Databricks + Plotly in action!
-
Databricks
@databricks
Databricks named to the 2024 #forbesai50, the most promising privately-held #ai companies!
Weโre committed to empowering enterprises to use data intelligence to drive productivity & democratize data + AI. Thank you to @forbes for recognizing this impact! dbricks.co/3VVRs0K -
Databricks
@databricks
Meet #dbrx: a general-purpose LLM that sets a new standard for efficient open source models.
Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications. dbricks.co/43xaCMj -
Databricks
@databricks
Weโre committed to building AI that improves lives & unlocks a better future for humanity. Weโve signed the Open Letter: Build AI for a Better Future alongside @SVAngel, @OpenAI, @Microsoft, @Meta, @Google & many others to advocate for the benefits of AI. openletter.svangel.com
-
Databricks
@databricks
Databricks Ventures is excited to share its latest investment โ @Glean! ๐
Weโre thrilled to accelerate their momentum as the industryโs leading AI-powered work assistant, & bring the secure deployment of #ai & knowledge building to all enterprises๐www.glean.com/blog/glean-series-d -
Databricks
@databricks
Databricks Vector Search is in public preview!
Augment your #llm apps and synchronize source data, eliminating the need to write and maintain separate data pipelines.
Find out why our customers already love it and how you can easily get started ๐ dbricks.co/3R9m2A1 -
Databricks
@databricks
Our CEO @alighodsi is keynoting at #signalconf 2023!
Join us for a convo with @twilio CEO @jeffiel, where they'll chat about the current state of #data + #ai (including #llms), our new acquisition of @MosaicML, and more.
Stream it tomorrow at 9am๐
dbricks.co/44t4fbO -
Databricks
@databricks
The trade-offs of Query Optimization is a *perfect* problem for #ai. Chief Architect @rxin walking us through new prediction optimizations in Databricks!
#lakehouseai #dataaisummit -
Databricks
@databricks
Weโre over the moon to announce weโve agreed to acquire @MosaicML, a leading generative AI platform. Together, weโll make generative AI accessible for every organization, so you can build, own & secure models with your data. www.databricks.com/mosaic-news
-
Databricks
@databricks
๐จSOLD OUT ๐จ
Weโve sold out in-person tickets for #dataaisummit! But you can still catch all the keynotes, select technical sessions, and live-streamed community events when you join us virtually! And itโs entirely free. Hurry & register: www.databricks.com/dataaisummit -
Databricks
@databricks
โI do think #ai is going to change everything, and I think itโs going to be mostly positive.โ
Our CEO @alighodsi was named to @FortuneMagazine's Top 13 AI Innovators list! Check out his perspective on the power of open source + #ai โฌ๏ธ
fortune.com/2023/06/13/meet-top-ai-innovators-impact-on-bโฆ -
Databricks
@databricks
Rubicon is joining Databricks!
As companies leverage #ai + #llms, thereโs a growing need for storage solutions that can process diverse data types and integrate the online + offline stack. We look forward to bringing Rubiconโs vision to the Lakehouse! www.databricks.com/blog/welcome-rubicon-databricks-futureโฆ -
Databricks
@databricks
Spotted in @WSJ today!
#generationai is open to all. Every company is a data + #ai company. What will set you apart? -
Databricks
@databricks
Databricks + @ProjectJupyter just took it to a whole new level ๐ฅณ
We're excited to announce that Databricks Notebooks now support ipywidgets and the IPython kernel, bringing the interactivity of the Jupyter ecosystem to the #lakehouse. Learn more โฌ๏ธ
dbricks.co/3Aax151 -
Databricks
@databricks
#automl can help Citizen Data Scientists build ML models quickly. Operationalizing them at scale...not so easy.
Meet Databricks AutoML, a โglass boxโ approach w/ a Citizen Data Science UI for the full ML lifecycle & generated code for experts to customize dbricks.co/3wCKvls -
Databricks
@databricks
Today, weโre introducing the world to the Databricks Feature Store, the first of its kind that is co-designed with a data & #mlops platform. Why are we obsessed? It helps #datateams accelerate ML efforts with simplified feature sharing & discovery. dbricks.co/2RSsFMv
-
Databricks
@databricks
The walls between public clouds are vanishing.
A new open multi-cloud order has risen
from the structures of siloed clouds,
and customers will not rest until
all data teams can thrive together
in an open, unified platform. -
Databricks
@databricks
You asked for it. We made it happen. Dark Theme for Databricks notebook is here!
Itโs been the most requested feature in Databricks history (๐คฏ), so we canโt wait for you to try it out! Let us know what you think ๐
dbricks.co/2Odmcde -
Databricks
@databricks
Today, we want to highlight our one true love: data ๐ #happyvalentinesday
-
Databricks
@databricks
โปโณ|
โณโป| *us when we hear someone
โปโณ| talking about data*
โณโป| _
โปโณ| โข.โข)
โณโป|โ๏พ
โปโณ|
โณโป|
โปโณ| -
Databricks
@databricks
Weโre sponsoring @NAACP_LDF and @PolicingEquity at this yearโs #sparkaisummit. Join us in supporting these organizations and Databricks will match all donations up to $100,000. Letโs show whatโs possible when #datateams stand together. dbricks.co/SAISSF20Donation
-
Databricks
@databricks
Weโre excited to have @rydonahue join Databricks as our VP of Product Design!
Check out his blog post on why he joined Databricks and the potential that design has to play a huge role in making #ai and #bigdata tools more accessible.
dbricks.co/wp200227a
#lifeatdatabricks -
Databricks
@databricks
Itโs not often that someone pens a love letter about your company, but thatโs exactly what @AiimiLtd's Senior Data Scientist just did.
Weโll let him tell you how Databricks stole his heart. ๐ dbricks.co/ex200213a
#valentinesday -
Databricks
@databricks
Databricks is coming to Canada!
@rxin, our co-founder and chief architect, shares with @itworldca why weโre opening an engineering hub in #toronto. dbricks.co/ex200203a
#lifeatdatabricks #careersintech -
Databricks
@databricks
In our latest blog post, we demonstrate how to train hundreds of time series forecasting models in parallel with Facebook Prophet and #apachespark. dbricks.co/wp200127a
-
Databricks
@databricks
ICYMI: @NateSilver538, founder of @FiveThirtyEight and author of The Signal and the Noise, was announced as one of the keynote speakers of #sparkaisummit.
Save your spot: dbricks.co/SAISSF20RegTW -
Databricks
@databricks
As we look back on 2019, it was a year highlighted by new developments in our open source platforms, expanding into new markets and reaching the 1,000 employee milestone.
As we welcome 2020, we're excited to see what the year has in store. dbricks.co/wp200123a
by @rxin -
Databricks
@databricks
We're happy to announce the appointment of David Conte as CFO. David will lead all financial and operational functions at Databricks through our next phase of global growth, bringing with him 30 years of experience in the technology industry. dbricks.co/NewCFO
-
Databricks
@databricks
We're excited to announce that we've raised $400 million to continue our rapid global growth and engineering expansion, an investment that brings our valuation to $6.2 billion. Learn more: dbricks.co/SeriesFfunding
-
Databricks
@databricks
.@brandless is an e-commerce company that makes hundreds of products, yet has a data team fewer than 10 people.
Learn how they used Databricks, #mlflow and Amazon SageMaker to ensure that customers get a personalized shopping experience. dbricks.co/wp190827a
@AWS_Partners -
Databricks
@databricks
Databricks' European Development Center is an engineering hub for development and innovation, and we're announcing a 100 million Euro investment in Amsterdam over the course of three years.
Learn more about this announcement: dbricks.co/EUDevCenter
#sparkaisummit -
Databricks
@databricks
Weโre excited to announce another great speaker for #sparkaisummit in Europe: @OriolVinyalsML, who led the AlphaStar team that created the first agent to beat a professional at the game of StarCraft.
Save your spot now: dbricks.co/SAISeu -
Databricks
@databricks
At Databricks, we build platforms to enable data teams to solve the worldโs toughest problems and we couldnโt do that without our wonderful Databricks Team. Learn more about Alexandra Cong, one of our Software Engineers, and what drew her to Databricks! (www.databricks.com/blog/2019/06/26/brickster-spotlight-meโฆ)
-
Databricks
@databricks
Join our co-founder, @rxin at @scaladays on 6/12. He'll be presenting on "A Story of Unification from @ApacheSpark to #mlflow". Details here:
scaladays.org/schedule/a-story-of-unification-from-apacheโฆ -
Databricks
@databricks
We know that managing cloud infrastructure can be tough, which is why we're introducing Databricks Cloud Automation with the power of Terraform. dbricks.co/2VGySet #devops
-
Databricks
@databricks
Often we ask the question: was it untitled.ipynb or untitled(1).ipynb which created this training run with x% validation accuracy? Announcing the #mlflow notebook sidebar, which helps track revisions to help you reproduce successful experiments: dbricks.co/2DGMqw3
-
Databricks
@databricks
[Blog] Learn how to deploy Azure Databricks clusters in your own custom VNET #cloudsecurity
dbricks.co/2IpedUT -
Databricks
@databricks
A diverse group of #ai innovators will present at #sparkaisummit next month in San Francisco. #iwd2019 Highlight: Keynoter, Timnit Gebru, a Researcher at Stanford University #balanceforbetter #womeninai #iwd2019 Discount Code - TODAY ONLY: WomensDay30
-
Databricks
@databricks
Catch a preview of @rxin's keynote for @SparkAISummit! Join us for the preview webinar: dbricks.co/2tReNCJ
-
Databricks
@databricks
Hear how Devon Energy, ShopRunner and Rue Gilt Groupe are successful implementing data pipelines to feed their AI initiatives on the Data Mastery Tour with @Databricks and @SnowflakeDB. Live events in Dallas, Chicago, Seattle, Boston, NY, SF, and more www.snowflake.com/the-data-mastery-tour/
-
Databricks
@databricks
@GetYourGuide is coming to #sparkaisummit next week to describe Attribution Done Right. Hear about the business and technical challenges that were solved and how the solution was implemented using Spark & Databricks. databricks.com/sparkaisummit/europe
-
Databricks
@databricks
Simplify #marketbasketanalysis using FP-growth on #databricks databricks.com/blog/2018/09/18/simplify-market-basket-anaโฆ
-
Databricks
@databricks
Watch @rxin 's keynote at #sparkaisummit on the introduction of Project Hydrogen: State-of-the-Art Deep Learning on #apachespark databricks.com/sparkaisummit/europe
-
Databricks
@databricks
Identifying Suspicious Behavior in Video with Databricks Runtime for #machinelearning databricks.com/blog/2018/09/13/identify-suspicious-behaviโฆ #keras #tensorflow #sparkdlpipelines
-
Databricks
@databricks
Loan Risk Analysis with #xgboost and Databricks Runtime for Machine Learning databricks.com/blog/2018/08/09/loan-risk-analysis-with-xgโฆ #ml #mllib
-
Databricks
@databricks
Processing Petabytes of Data in Seconds with Databricks Delta #apachespark #databricksdelta #structuredstreaming #sparksql databricks.com/blog/2018/07/31/processing-petabytes-of-daโฆ
-
Databricks
@databricks
Introducing Pandas UDF for PySpark: How to run your native Python code with #pyspark, fast. www.databricks.com/blog/2017/10/30/introducing-vectorizedโฆ
-
Databricks
@databricks
Introducing Data Brickโข: The Building Block of DataBricks' Unified Analytics Platform #databricks #apachespark dbricks.co/2GGBt0i
-
Databricks
@databricks
Introducing Stream-Stream Joins in Apache Spark 2.3: Now Available on Databricks Runtime 4.0 #structuredstreaming www.databricks.com/blog/2018/03/13/introducing-stream-strโฆ
-
Databricks
@databricks
Introducing Low-Latency Continuous Processing Mode in Structured Streaming in Apache Spark 2.3.0 #apachespark www.databricks.com/blog/introducing-real-time-mode-apacheโฆ
-
Databricks
@databricks
Introducing Apache Spark 2.3: Now Available on Databricks Runtime 4.0 Beta
dbricks.co/2t6usAt -
Databricks
@databricks
ICYMI: Introducing Vectorized UDFs for PySpark dbricks.co/2DCFcYR
-
Databricks
@databricks
Take an in-depth look at #meltdown and #spectre to learn how they can be fixed and how they impact Databricks security and performance. dbricks.co/2DFaPks
-
Databricks
@databricks
Meltdown and Spectreโs Performance Impact on Big Data Workloads in the Cloud dbricks.co/2DaaeGy
-
Databricks
@databricks
Databricks Runtimeโs New DBIO Cache Boosts #apachespark Performance: Why NVMe SSDs improve caching performance by 10x dbricks.co/2meuaAy
-
Databricks
@databricks
The Architecture of the Next @CERN Accelerator Logging Service: CERN Big Data (900 GB/day) at Scale with #apachespark dbricks.co/2jUjgQh
-
Databricks
@databricks
Learn how transparent autoscaling of instance storage helps you focus on data, not resource constraints dbricks.co/2iB4LzJ
-
Databricks
@databricks
Spark Summit is Becoming the Spark + AI Summit #apachespark #ai @SparkAISummit dbricks.co/2zUJ7NW
-
Databricks
@databricks
Women in Big Data, Apache Spark and AI: Bay Area Spark Meetup @databricks Summary: With presentation slides and videos #womenintech #100women
dbricks.co/2zJA1Yx -
Databricks
@databricks
Watch the Microsoft Azure Databricks demo video and see how easily your data scientists, data engineers and business users can collaborate dbricks.co/2zGoEiU
-
Databricks
@databricks
Announcing Microsoft Azure Databricks! A fast, easy and collaborative Apacheยฎ Sparkโข based analytics platform optimized for Azure. dbricks.co/2A0HQbU #analytics #azure
-
Databricks
@databricks
Introducing Command Line Interface for Databricks Developers: Work easily with Databricks File System and Workspace dbricks.co/2hdJ9Zv
-
Databricks
@databricks
Introducing Vectorized UDFs for #pyspark #apachespark dbricks.co/2yalEYd
-
Databricks
@databricks
Introducing Vectorized UDFs for #pyspark: How to run your native Python code with PySpark, fast. #python dbricks.co/2z2PLEl
-
Databricks
@databricks
Data scientists: Get a free exclusive preview of select chapters from the upcoming definitive guide for #apachespark
dbricks.co/2fJLYAQ -
Databricks
@databricks
Building Complex Data Pipelines with Unified Analytics Platform #databricks #apachespark dbricks.co/2y3EGT1
-
Databricks
@databricks
Learn about #apachesparkโs Memory Model and Sparkโs State in the Cloud @Spark_Summit dbricks.co/2wwAPOV
-
Databricks
@databricks
Get an exclusive preview of the upcoming definitive guide for #apachespark for free dbricks.co/2j0vTv4
-
Databricks
@databricks
Get an exclusive preview of the upcoming definitive guide for #apachespark for free dbricks.co/2vK8UIY
-
Databricks
@databricks
Watch todayโs @BloombergTV interview regarding the future of #ai and Databricks dbricks.co/2wlzRUv
-
Databricks
@databricks
Databricks Cited As A Strong Performer by @Forrester in Insight PaaS Category #forresterwave dbricks.co/2vBi0sl
-
Databricks
@databricks
โAI has a 1% problemโ says @databricks CEO Ali Ghodsi "There are only about 5 cos who are truly conducting AI todayโ dbricks.co/2vMLgtx
-
Databricks
@databricks
Learn how to easily set up #apacheairflow and trigger #databricks workloads
dbricks.co/2vjkN6L -
Databricks
@databricks
Benchmarking Big Data SQL Platforms in the Cloud #apachespark #databricksruntime dbricks.co/2tenGDh by @databricks
-
Databricks
@databricks
Introducing Apache Spark 2.2: Now available on Databricks Runtime 3.0 #apachespark
dbricks.co/2t1DLRD -
Databricks
@databricks
On-Demand Webinar and FAQ: #apachespark MLlib 2.x: How to Productionize your Machine Learning Models
dbricks.co/2tYjbOc -
Databricks
@databricks
Declarative Infrastructure with #jsonnet Templating Language: How #databricks Provisions Infrastructure #kubernetes
dbricks.co/2sTHxcw -
Databricks
@databricks
Watch today's demo by @michaelarmbrust on new developments in #structuredstreaming from Databricks #sparksummit dbricks.co/2sAKv5f
-
Databricks
@databricks
Making #apachespark the Fastest Open Source Streaming Engine dbricks.co/2scZ69J
-
Databricks
@databricks
A Vision for Making #deeplearning Simple: From machine learning practitioners to business analysts dbricks.co/2s0vZqb
-
Databricks
@databricks
Benefit from what Databricks has learned while helping hundreds of customers use #apachespark: dbricks.co/2rFwHJw #sparksummit
-
Databricks
@databricks
ICYMI: Statistical and Mathematical Functions with DataFrames in Apache Spark dbricks.co/2rbhS19
-
Databricks
@databricks
sparklyr now available in Databricks. Try it now dbricks.co/2rZbgPy
-
Databricks
@databricks
Running Streaming Jobs Once a Day for 10x Cost Savings: Part 6 of Scalable Data @ Databricks dbricks.co/2qcisGN
-
Databricks
@databricks
Join 3,000 #apachespark enthusiasts, June 5-7 in San Francisco, to celebrate the 10th edition of #sparksummit: dbricks.co/2pDWiBH
-
Databricks
@databricks
New Databricks feature: Persistent Clusters to simplify cluster management for analytics. Read the blog: dbricks.co/2pSS1e6
-
Databricks
@databricks
Taking #apachesparkโs #structuredstreaming to Production: Part 5 of scalable data at #databricks dbricks.co/2riGlkL
-
Databricks
@databricks
ICYMI: Working with Complex Data Formats with #structuredstreaming on #apachespark 2.1 dbricks.co/2pPPVuX
-
Databricks
@databricks
Processing Data in #apachekafka with Structured Streaming in #apachespark 2.2 dbricks.co/2piFxbV
-
Databricks
@databricks
Get best practices for deploying @ApacheSpark at scale during #sparksummit 2017โs Enterprise Day: dbricks.co/2paRGj2 #apachespark
-
Databricks
@databricks
Join us for a webinar on workflows and best practices for #deeplearning, #tensorflow, and #apachespark dbricks.co/2paQBrL
-
Databricks
@databricks
Learn how to terminate your runaway Spark SQL queries using Query Watchdog: dbricks.co/2omDVfc
-
Databricks
@databricks
Improve your #apachespark skills. Take our new 2-day Data Engineering training course at #sparksummit 2017: dbricks.co/2oLpJB6
-
Databricks
@databricks
#sparksummit 2017 is < 2 months away! Register now to secure your spot at the world's largest #apachespark event. dbricks.co/2oNHI9R
-
Databricks
@databricks
Apache Spark ranks #8 on the BOSS index #oss dbricks.co/2pmBWsq
-
Databricks
@databricks
Learn how to build a real-time end-to-end integration with #apachekafka in #apachesparkโs Structured Streaming dbricks.co/2nApZxS
-
Databricks
@databricks
Community Voice: Analyse One Year of Radio Station Songs Aired with Apache Spark, Spark SQL, Spotify, and Databricks dbricks.co/2o2ea87
-
Databricks
@databricks
Voice from @Facebook: Using #apachespark for Large-Scale Language Model Training dbricks.co/2lkpabl
-
Databricks
@databricks
Working with Complex Data Formats with #structuredstreaming in #apachespark 2.1 dbricks.co/2mgH4gW
-
Databricks
@databricks
Processing trillion rows per second on a single machine: how can nested loop joins be this fast? #apachespark dbricks.co/2kX8bib
-
Databricks
@databricks
Enable #healthit innovation with #apachespark #machinelearning: How to Anonymize Datasets on Databricks dbricks.co/2kpiUyt
-
Databricks
@databricks
Another record-setting Spark Summit in Boston: A recap of Databricks keynotes and sessions dbricks.co/2k9zC4Z #sparksummit #apachespark
-
Databricks
@databricks
Join @rxin and @Westerflyer for tech-talks at the Amsterdam #apachespark Meetup on Feb 8: dbricks.co/2kwUtCT
-
Databricks
@databricks
Integrating Your Central Hive Metastore with #apachespark on Databricks dbricks.co/2jKQWQE
-
Databricks
@databricks
InfoWorld names Databricks a "Technology of the Year" for 2017 dbricks.co/2kItIIG
-
Databricks
@databricks
Learn how @Viacom uses Databricks for real-time analytics to improve customer experience @Forbes #apachespark dbricks.co/2kxMfHI
-
Databricks
@databricks
Real-time Streaming ETL with Structured Streaming in #apachespark 2.1 dbricks.co/2jL76up
-
Databricks
@databricks
Real-time Streaming ETL with Structured Streaming in #apachespark 2.1: Part 1 of Scalable data @ Databricks dbricks.co/2iX3Cnd
-
Databricks
@databricks
We are expanding internationally to embrace the growing demand for Apache Spark. Learn more here: dbricks.co/2iCVi8w
-
Databricks
@databricks
Here are five reasons why you should attend #sparksummit East in Boston next month: dbricks.co/2jf9RRt
-
Databricks
@databricks
5 talks to attend at @Spark_Summit featuring #apachespark innovators from @Databricks, @Salesforce, and @MHEducation dbricks.co/2iW3xyn
-
Databricks
@databricks
Databricks and Apache Spark Year in Review dbricks.co/2j4qQ88
-
Databricks
@databricks
ICYMI: $1.44 per terabyte: setting a new world record with #apachespark dbricks.co/2gMRnVR
-
Databricks
@databricks
Tutorial on integrating popular #deeplearning frameworks with #apachespark using #gpus on Databricks dbricks.co/2i0SumV
-
Databricks
@databricks
Learn how scalable partitioning in #apachespark 2.1 improves initial query latency in cloud-native architecture dbricks.co/2hpkfrq
-
Databricks
@databricks
Weโve raised another round of funding to advance #datascience and #dataengineering at Scale with #apachespark dbricks.co/2hp5ODL
-
Databricks
@databricks
Make developing #apachespark #scala libraries easier with Databricks: dbricks.co/2hweyIY
-
Databricks
@databricks
Pavel Hardak of @Basho demonstrated the Riak Integration and connector to #apachespark 2.0 dbricks.co/2gLEQmp
-
Databricks
@databricks
How to build #apachespark #etl pipelines with Databricks and #apacheairflow dbricks.co/2gg7Iap
-
Databricks
@databricks
We've updated our website with a new layout and more content - see the latest on Databricks and #apachespark dbricks.co/2gbiaQr
-
Databricks
@databricks
Databricks now offers a #hipaa compliant #apachespark platform in #aws: dbricks.co/2gGkuuq #healthit #medtec
-
Databricks
@databricks
We are currently looking for a rockstar Technology Evangelist to join our growing team. Apply today! dbricks.co/2gELTNc
-
Databricks
@databricks
How To Make Your Mark As A Woman In Big Data dbricks.co/2fhQ8SX by @kmariappan
-
Databricks
@databricks
Weโve launched a comprehensive guide for the Databricks Platform and #apachespark users. Check it out: dbricks.co/2fFIzok
-
Databricks
@databricks
Join @timjhunter for a tech-talk at the Paris #apachespark Meetup! dbricks.co/2elDgqJ
-
Databricks
@databricks
Databricks Voices From #sparksummit EU 2016: A summary of Day 2 dbricks.co/2fjkwMd
-
Databricks
@databricks
GPU Acceleration in Databricks: Speeding Up #deeplearning on #apachespark dbricks.co/2dNlv1Z
-
Databricks
@databricks
Watch #apachespark Continuous Applications in action on Databricks - Demo from the #sparksummit in Brussels dbricks.co/2eFBi7w
-
Databricks
@databricks
Deep Dive into Catalyst Optimizer and Hands-on Lab with Databricksโ @Westerflyer at #sparksummit EU dbricks.co/2etjIDY
-
Databricks
@databricks
7 tips to help you debug #apachespark code faster on Databricks dbricks.co/2dYUFX6
-
Databricks
@databricks
Donโt miss Databricks Chief Technologist & #apachespark creator @matei_zahariaโs keynote at #sparksummit EU dbricks.co/2etjVHf
-
Databricks
@databricks
How to use #apachespark with #awslambda to automate ETL and serve #machinelearning models on Databricks dbricks.co/2e4hqqT
-
Databricks
@databricks
ICYMI: Voice from @CERN: #apachespark 2.0 Performance Improvements Investigated With Flame Graphs dbricks.co/2d2J6eu
-
Databricks
@databricks
Databricks Bi-Weekly #apachespark Digest - 10/4/16: Whatโs happened in the last two weeks dbricks.co/2dFLkRQ
-
Databricks
@databricks
Voice From @CERN: #apachespark 2.0 Performance Improvements Investigated with Flame Graphs dbricks.co/2dV9ig0
-
Databricks
@databricks
Spark Streaming & Machine Learning see a significant growth in production, our #apachespark survey results indicate dbricks.co/2dujQi4
-
Databricks
@databricks
#iotroadshow with @Basho: Learn how #apachespark and #riak TS can help you with your #iot use cases. dbricks.co/2bSR7UP
-
Databricks
@databricks
Upcoming webinar @Dataversity @basho @Databricks: Data Modeling and Shortcuts to Success in Scaling Time Series Apps dbricks.co/2bSOFxN
-
Databricks
@databricks
Find out how @Facebook uses #apachespark at scale: A 60 TB+ production use case dbricks.co/2bDlDDt
-
Databricks
@databricks
Databricks Bi-Weekly Digest - 8/31/16: Whatโs happened in the last two weeks dbricks.co/2bBHJaU
-
Databricks
@databricks
#iotroadshow with @Basho: Learn how #apachespark and #riak TS can help you with your #iot use cases. dbricks.co/2bzcOvT
-
Databricks
@databricks
Databricks powered #machinelearning platform minimized #brexit fallout for investors dbricks.co/2bl7fBK
-
Databricks
@databricks
Learn how to use SparkSession in #apachespark 2.0 dbricks.co/2aUqWuL
-
Databricks
@databricks
Introducing the #riak connector for #apachespark - now with a Databricks notebook example dbricks.co/2aPdjyE
-
Databricks
@databricks
New tutorial: Connecting @Basho #riakts with #apachespark on Databricks dbricks.co/2axAZtk
-
Databricks
@databricks
Structured Streaming in Apache Spark 2.0: A new high-level API for writing continuous applications dbricks.co/2akduAz
-
Databricks
@databricks
Continuous Applications: Evolving Streaming in Apache Spark 2.0 dbricks.co/2akcNY1 by @databricks
-
Databricks
@databricks
Apache Spark 2.0 now Generally Available on Databricks dbricks.co/2agegl6
-
Databricks
@databricks
Databricks Bi-Weekly Digest - 7/18/2016: Whatโs happened in the last two weeks dbricks.co/2a5zpQI
-
Databricks
@databricks
Give us your feeback in our #apachespark Survey dbricks.co/293MusX
-
Databricks
@databricks
.@edmunds deployed #apachespark with Databricks to improve data integrity and customer satisfaction: dbricks.co/29hfNUC
-
Databricks
@databricks
Get started with #apachespark on Databricks with our new step-by-step guide with usage scenarios dbricks.co/29gn9wB
-
Databricks
@databricks
How Databricks is revolutionizing #adtech with #apachespark: dbricks.co/1UBlHne
-
Databricks
@databricks
Share your thoughts in our 2016 Apache Spark Survey. We value your feedback! dbricks.co/28MhZEA
-
Databricks
@databricks
Get familiar with #apachesparkโs key terms and concepts dbricks.co/28Peu3u
-
Databricks
@databricks
Databricks brings its fully managed #apachespark platform to #aws #govcloud dbricks.co/28Jc9mG
-
Databricks
@databricks
#sql Subqueries in #apachespark 2.0: Hands-on examples of scalar and predicate type of subqueries dbricks.co/1tu8dzi
-
Databricks
@databricks
Want an easier way to write an #apachespark application? Check out this introductory tutorial: dbricks.co/1U99Tou
-
Databricks
@databricks
Databricks in the news: This is where the real action in artificial intelligence takes place dbricks.co/1tlfYYO
-
Databricks
@databricks
Want a summary of the best of #sparksummit? Read our wrap-up blog to get the scoop: dbricks.co/1swC1es
-
Databricks
@databricks
Deep learning on #apachespark. Learn how @Yahoo enables distributed deep learning on Spark: dbricks.co/1TY33r6
-
Databricks
@databricks
DataFrames, Datasets, and SQL share the same optimization / execution pipeline via @michaelarmbrust #sparksummit
-
Databricks
@databricks
Databricks Community Edition now Generally Available to Learn and Explore #apachespark dbricks.co/1rbJzC3
-
Databricks
@databricks
#apachespark 2.0 optimizations == faster streaming - #sparksummit demo
-
Databricks
@databricks
A free #apachespark online learning course is about to start, learn how you can sign-up: dbricks.co/25yu86i
-
Databricks
@databricks
Preview #apachespark 2.0 With an Anthology of Technical Assets dbricks.co/22xQ5kd
-
Databricks
@databricks
Apache Spark 2.0 Preview: Machine Learning Model Persistence dbricks.co/1PfUbeE
-
Databricks
@databricks
Genome Variant Analysis using K-Means, ADAM, and #apachespark with Databricks dbricks.co/20vOslo
-
Databricks
@databricks
New from Ovum: How enterprises can tackle advanced analytics with #apachespark - dbricks.co/1Tswj5X
-
Databricks
@databricks
Try Approximate Algorithms in Apache Spark: HyperLogLog and Quantiles dbricks.co/20aQ4Rs
-
Databricks
@databricks
6 Reasons to Attend #sparksummit in San Francisco dbricks.co/1OInbeD
-
Databricks
@databricks
#apachespark 2.0 Technical Preview Now Available on Databricks Community Edition. dbricks.co/1TA9zOM
-
Databricks
@databricks
Meet the creators and drivers of @ApacheSpark at #sparklive in Los Angeles. Spots are limited so RSVP today! dbricks.co/1rl0h2o
-
Databricks
@databricks
Don't miss this @Spark_Summit Keynote by the head of #deeplearning
research at @google. dbricks.co/1VSQaiB -
Databricks
@databricks
New eBook from @Databricks to help you with @ApacheSpark #machinelearning: dbricks.co/1TwZlBa
-
Databricks
@databricks
In case you missed it - New content in Community Edition: Machine Learning with Spark #mooc and two new notebooks. dbricks.co/1Q9ROUa
-
Databricks
@databricks
Today, join Joseph Bradley for GraphFrames: DataFrame-based graphs for Apache Spark dbricks.co/1WM0XI9
-
Databricks
@databricks
Learn how @Databricks is helping @DNVGL with #iot and energy data analytics: dbricks.co/1S4UlGK
-
Databricks
@databricks
Learn how @MetacogInc built a continuous integration system for @ApacheSpark applications with @Databricks: dbricks.co/1UWf2pf
-
Databricks
@databricks
How @Metacoginc implemented Agile @ApacheSpark application development with @databricks: dbricks.co/25zJ70P
-
Databricks
@databricks
The Unreasonable Effectiveness of Deep Learning on Spark dbricks.co/1RClZoZ by @databricks
-
Databricks
@databricks
Get a collection of the best @ApacheSpark content from the @databricks blog in new e-book: dbricks.co/1Utzo8x
-
Databricks
@databricks
Visit @Databricks at #stratahadoop booth 1237. Schedule a personalized demo: dbricks.co/1XSUifl
-
Databricks
@databricks
#devsurvey2016 shows need for @ApacheSpark talent, @Databricks can help: dbricks.co/1LEfox7 by @databricks
-
Databricks
@databricks
Thanks for making #sparksummit a huge success! Read the highlights here: dbricks.co/21bXfKy
-
Databricks
@databricks
An easier way to use @ApacheSpark: Dashboards in @Databricks announced dbricks.co/1Syn31S
-
Databricks
@databricks
How to quickly pivot data with a #dataframe in @ApacheSpark 1.6: dbricks.co/1TQgreR
-
Databricks
@databricks
.@Miklos_C will talk about Operational Tips for Deploying @ApacheSpark at @spark_summit. Register to join him there! dbricks.co/1mghFSV
-
Databricks
@databricks
.@databricks February newsletter: Upcoming @spark_summit, new customer case study, and more. dbricks.co/1SGkKbL
-
Databricks
@databricks
Join @nongli at @spark_summit to learn about #project Tungsten and how it will improve @ApacheSpark performance dbricks.co/1P3WUUT
-
Databricks
@databricks
Deep Learning with @ApacheSpark and @TensorFlo dbricks.co/1ZYQ4Io by @timjhunter
-
Databricks
@databricks
MLlib Highlights in @ApacheSpark 1.6 by Joseph Bradley and xmeng dbricks.co/1Qo60hw
-
Databricks
@databricks
Announcing @ApacheSpark Essentials for the Public Sector workshop dbricks.co/1JIckyQ
-
Databricks
@databricks
Databricks 2015 Year In Review: Democratizing Access to Data dbricks.co/1O35G4Z cc @databricks @ApacheSpark
-
Databricks
@databricks
Introducing @ApacheSpark Datasets dbricks.co/1RbLxOg
-
Databricks
@databricks
Announcing @ApacheSpark 1.6 dbricks.co/1RbLguO
-
Databricks
@databricks
Starting in an hour, Making #bigdata Processing Simple with @ApacheSpark with @matei_zaharia and @rxin dbricks.co/1UAL2vn
-
Databricks
@databricks
Join @matei_zaharia and @rxin for the ACM Learning Webinar Making #bigdata Processing Simple with @ApacheSpark dbricks.co/1UAKYfa
-
Databricks
@databricks
ๆฑไบฌใง @ApacheSpark ใใใผใใซใใใชใฏใซใผใใใฏใใญใธใผใบใชใผใใณใฉใ#2 ใง Xiangrui Meng ใจ็ณๅทๆใ็ปๅฃ dbricks.co/1NQYNAy
-
Databricks
@databricks
We've achieved #bigdata Competency Status from @awscloud and won a new customer in FinTech: dbricks.co/1maN0ag @databricks @LendUpLoans
-
Databricks
@databricks
Upcoming webinar: How @CeltraMobile Optimizes its Advertising Platform with @Databricks dbricks.co/211axug
-
Databricks
@databricks
Try a preview of @ApacheSpark 1.6 in @databricks today: new Dataset API and much more. dbricks.co/1kKOGXx
-
Databricks
@databricks
More @apachespark use cases in digital media - how Elsevier uses @databricks to process digitized content in XML: dbricks.co/1ROkiWs
-
Databricks
@databricks
Learn more about @ApacheSpark TFOCS Optimization Package at @rockthecodeIO
dbricks.co/1ljmP0t -
Databricks
@databricks
Learn how @yesware used @databricks and @ApacheSpark to build a new feature: dbricks.co/1NfDZCF
-
Databricks
@databricks
Tonight, join Pat McDonough for A Sneak Peek into @ApacheSpark 1.6 at Washington DC Area Apache Spark Interactive dbricks.co/1NO0TUG
-
Databricks
@databricks
.@ApacheSpark Meetup Wednesday in Prague, Chicago, Geneva, and Washington DC
dbricks.co/1iwpQIQ -
Databricks
@databricks
Join @SSKapci and @mhfalaki for Spark Day in Istanbul dbricks.co/1MsjUZb @ApacheSpark #sparkr
-
Databricks
@databricks
A new optimization package - TFOCS - is available for @ApacheSpark! dbricks.co/1kmDgIG @databricks
-
Databricks
@databricks
.@rxin's #sparksummiteu keynote: a look ahead at @ApacheSpark development dbricks.co/1Wkz2xs @databricks
-
Databricks
@databricks
New in @databricks - visualizing @ApacheSpark ML models! dbricks.co/1H6X87M x.com/databricks/status/658992930573676544/photo/1
-
Databricks
@databricks
Introducing More @Databricks Notebooks Sharing Options in HTML dbricks.co/1M8SzkY @ApacheSpark
-
Databricks
@databricks
Interactive Audience Analytics With @ApacheSpark and HyperLogLog by @ezhulenev dbricks.co/1Ozha0R
-
Databricks
@databricks
Meet @Databricks and chat about @ApacheSpark at Booth 837 at @awsreinvent in Las Vegas
-
Databricks
@databricks
.@rxin discusses @ApacheSpark 1.5.1 and what do version numbers mean? dbricks.co/1VrDizT
-
Databricks
@databricks
.@rxin discusses @ApacheSpark 1.5.1 and what do version numbers mean? dbricks.co/1VrDkrA
-
Databricks
@databricks
Join @dennylee at the #datapopupseattle on Using @ApacheSpark in Healthcare Predictive Analytics in the OR dbricks.co/1FoOKVJ
-
Databricks
@databricks
Improved Frequent Pattern Mining in @ApacheSpark 1.5: Association Rules and Sequential Patterns [updated] dbricks.co/1Lh0tbz
-
Databricks
@databricks
Want to simplify @ApacheSpark debugging? Real-time monitoring in @databricks notebooks helps: dbricks.co/1LO1mTi x.com/databricks/status/646717368799002624/photo/1
-
Databricks
@databricks
Read about LDA topic modeling improvements in @ApacheSpark: dbricks.co/1YzLAou @databricks
-
Databricks
@databricks
Join @rxin @tathadas and @pwendell Committer night: @ApacheSpark 1.5 and beyond at #stratanyc dbricks.co/1irrXOy
-
Databricks
@databricks
Don't miss the Spark 1.5 DataFrame API Highlights: Date/Time/String Handling, Time Intervals, and UDAFs blog dbricks.co/1OZcQ9y











































































































































































































































































































































































































































































































































































































































































































































































































































































































































































































