Microsoft Fabric Business Intelligence Data Strategy

Fabric Real-Time Intelligence & Eventstreams

Fabric Real-Time Intelligence & Eventstreams
Microsoft Fabric

Real-Time Intelligence in Microsoft Fabric: When Eventstreams Actually Make Sense

⏱️ 11 min read
Microsoft Fabric · Business Intelligence
Real-Time Intelligence in Microsoft Fabric - an Eventstream ingesting data into an Eventhouse KQL database, feeding real-time dashboards and Data Activator alerts, illustrating when streaming architecture genuinely beats scheduled Power BI refresh

Real-Time Intelligence is one of Fabric's five core workloads, and the one least written about - mostly because most teams asking for "real-time" don't actually need it yet.

Ask ten stakeholders why they want "real-time" data and most of them mean something closer to "faster than the overnight batch job we have now." Fabric Real-Time Intelligence - the workload built around Eventstreams, Eventhouse, and Data Activator - solves a genuinely different problem: data that needs to be ingested, analysed, and acted on within seconds of an event happening, not data that's merely inconvenient to wait a few hours for. Confusing the two is the single most common reason Real-Time Intelligence projects either get built when a scheduled refresh would have done the job just as well, or get dismissed as unnecessary complexity when it was actually exactly the right tool.

This guide covers what Real-Time Intelligence actually is architecturally, the specific signals that tell you whether you have a genuine sub-minute latency requirement or a refresh-frequency preference, what the workload replaces when you do need it, and where its current limits mean a different tool is still the better choice.

What "Real-Time" Actually Means in Fabric

Real-Time Intelligence is a single Fabric workload built from four components working together on one governed capacity. Eventstream is the ingestion layer - a declarative, largely no-code pipeline connecting to more than two dozen source types, including Azure Event Hubs, IoT Hub, Kafka and Confluent Cloud, Amazon Kinesis and MSK, Google Pub/Sub, MQTT brokers, and database change data capture from sources like Azure SQL, PostgreSQL, and Cosmos DB. Eventhouse is the storage engine underneath it - a KQL-backed, columnar store evolved from Azure Data Explorer, purpose-built for time-series and high-cardinality event data rather than the relational structure a warehouse or lakehouse assumes. A KQL Database inside that Eventhouse exposes the data for querying, in Kusto Query Language natively or T-SQL through the KQL queryset. And Data Activator sits on top of all of it as a no-code condition-and-action engine - define a threshold, an anomaly pattern, or a rule, and it fires an alert, a Teams message, a Power Automate flow, or an API call the moment the condition is met, continuously, without anyone watching a dashboard.

The Real Question: Do You Have a Latency Problem?

Before evaluating Eventstreams at all, it's worth being honest about which problem is actually being solved. A dashboard that refreshes every few hours and frustrates a stakeholder who wants same-day numbers is a refresh-frequency problem, and it's solved by tightening a scheduled Power BI refresh or moving to Direct Lake mode - neither of which requires standing up a streaming pipeline. A genuine latency problem is different in kind, not just degree: it's a scenario where the value of the data measurably decays within minutes or seconds, and where someone or something needs to act before that decay happens, not just be informed after the fact at the next convenient interval.

"In most organisations, the gap between when something happens and when the business knows about it is measured in hours, because data moves through scheduled extract-load-transform cycles. By the time a pattern shows up in a dashboard, the moment to act on it has often already passed. Real-Time Intelligence exists specifically to close that gap - not to make an already-adequate refresh cycle feel more modern."

Five Signals You Genuinely Need Eventstreams

The action window is measured in seconds or minutes
Fraud detection, SLA breach escalation, patient vital sign monitoring, equipment anomaly alerts - cases where a delayed response has a real, specific cost, not just a preference for fresher numbers.
The data volume is genuinely high-cardinality event data
IoT telemetry, application logs, clickstream, or security event data - the kind of billions-of-small-events workload a KQL database is purpose-built to scan and aggregate quickly, and a relational warehouse handles poorly at the same scale.
You need automated action, not just a faster dashboard
If the end goal is a person watching a screen and reacting manually, a fast dashboard may be enough. If the end goal is an automatic Teams alert, a workflow trigger, or an API call the moment a condition is met, that's specifically what Data Activator is built for.
You're migrating off legacy Power BI streaming datasets
Microsoft has set an end to new creation of legacy push and streaming datasets, with existing ones eventually retiring - any organisation still running push datasets has a firm, dated reason to move to Eventstream-to-Eventhouse now rather than later.
You're currently stitching together a bespoke streaming stack
If your team already runs Kafka, a separate time-series database, and a dashboarding layer independently - each with its own billing, security model, and on-call rotation - that's the exact fragmentation Real-Time Intelligence is designed to consolidate onto one governed capacity.

What Eventstreams Actually Replace

For organisations that do have a genuine streaming requirement, the value proposition is consolidation as much as capability. The traditional real-time stack most enterprises assemble independently - Kafka for ingestion, a dedicated time-series database like ClickHouse for storage, and Grafana for visualisation, or the Azure-native equivalent of Event Hubs feeding a custom Stream Analytics job into a separate database - means every piece has its own billing model, its own security boundary, and its own failure mode. When something breaks at 2am, several different teams get paged for what is, conceptually, one pipeline. Real-Time Intelligence replaces that fragmented assembly with Eventstream, Eventhouse, and Activator running on the same governed Fabric capacity as the rest of the platform, under one security model and one bill.

A Worked Example: Order Cancellation Alerting

A concrete pattern illustrates how the pieces fit together in practice. An e-commerce company mirrors its operational order database into Fabric via change data capture, with those change events flowing into an Eventstream in near real time. Inside the Eventstream, the team applies a filter to isolate only high-value order cancellations, and enriches each event with the customer's tier from a reference dataset. The processed stream routes to two destinations simultaneously: Eventhouse, feeding a live revenue-impact dashboard that updates as cancellations happen, and Data Activator, configured to post an alert directly to the customer-success team's Teams channel whenever a premium-tier customer cancels an order above a defined value threshold. The entire pipeline - filter, enrich, store, alert - runs without a scheduled job anywhere in it, and the customer-success team is notified within seconds of the cancellation happening, not the next morning when someone happens to check a report.

The Latency Tradeoffs You're Actually Choosing Between

Even within Real-Time Intelligence, "real-time" isn't a single latency number - it's a set of architectural choices with real tradeoffs.

PatternTypical latencyBest fit
Power BI DirectQuery to EventhouseSub-10 secondsOperational dashboards needing near-live numbers with full Power BI formatting
Power BI Direct Lake mode30–90 secondsFaster DAX performance where a slightly longer lag is acceptable
Native Fabric Real-Time DashboardsSub-second to a few secondsHigh-frequency operational monitoring - SIEM, trading desks - bypassing Power BI's rendering pipeline entirely
Data Activator alertingSeconds, continuous evaluationAutomated action triggered by a condition, with no dashboard in the loop at all

Choosing between these isn't a technical afterthought - it should be driven by the actual SLA a specific use case needs. Reaching for the lowest-latency option by default when a 30–90 second lag was genuinely acceptable adds architectural complexity without adding real business value.

Where Eventstreams Are Overkill - or Not Yet Ready

Overkill
Standard business reporting refreshed a few times a day
Most financial, sales, and operational reporting genuinely doesn't decay in value minute to minute. Scheduled Power BI refresh or Direct Lake mode against a well-modelled warehouse is simpler, cheaper on Fabric capacity, and easier for a team to maintain than a streaming pipeline nobody needed.
Not Yet Ready
Complex, cross-stream pattern matching
Detecting a pattern like "alert only if Event A happens on one stream and Event B happens on a second stream within five minutes, but only if Event C hasn't happened on a third" is currently better served by Kafka paired with a dedicated stream-processing framework, or Azure Stream Analytics for simpler versions of the same pattern - genuine complex event processing across multiple streams remains a gap in Fabric's current capability.

Decision Framework

A simple gut-check: if the answer to "what happens if this data is three hours old instead of three seconds old" is "nothing meaningfully changes," you almost certainly don't need Eventstreams yet - and building them anyway adds ongoing operational complexity for a latency requirement nobody actually has. If the answer involves a missed fraud window, a safety threshold, an SLA breach, or a customer experience that degrades measurably with delay, that's the genuine signal to invest in the architecture this guide describes.

On the Learning Curve

KQL is a genuinely different query language from SQL, and it's a real adoption cost worth naming honestly. The gap is smaller than it first appears in practice: Eventstream supports standard SQL operators for in-flight transformation, the KQL queryset accepts T-SQL directly, and Fabric's Copilot integration for KQL query authoring lowers the barrier further - but a team planning to build meaningfully on Eventhouse should budget real ramp-up time, not assume existing SQL fluency transfers immediately.

Key Takeaways
  • Real-Time Intelligence is built from four components - Eventstream (ingestion), Eventhouse/KQL Database (storage and query), Real-Time Dashboards, and Data Activator (automated action) - running on the same governed Fabric capacity as the rest of the platform.
  • Most requests for "real-time" data are actually a refresh-frequency preference solvable with scheduled Power BI refresh or Direct Lake mode, not a genuine sub-minute latency requirement that justifies a streaming architecture.
  • Five real signals justify Eventstreams: a genuinely short action window, high-cardinality event data at scale, a need for automated action rather than just a faster dashboard, migration off retiring legacy streaming datasets, or an existing fragmented Kafka/Stream Analytics stack worth consolidating.
  • Even within Real-Time Intelligence, latency is a spectrum of architectural choices - DirectQuery, Direct Lake, native Real-Time Dashboards, and Activator alerting each trade latency against formatting richness and query performance differently.
  • Complex, cross-stream pattern matching within time windows remains a genuine current gap - Kafka with a stream-processing framework, or Azure Stream Analytics for simpler patterns, is still the better fit for that specific scenario.

Numlytics scopes Microsoft Fabric implementations against the workload your data actually requires - Real-Time Intelligence where a genuine latency requirement exists, and a simpler, lower-cost architecture where it doesn't. Explore our Microsoft Fabric migration practice or speak with a certified consultant about whether your use case genuinely needs Eventstreams.

Microsoft Fabric Consulting
Get an honest read on whether you need streaming architecture
Numlytics assesses your actual latency requirements before recommending Eventstreams - sized against your real event volume, action window, and SLA, not a default assumption that faster is always better.
Explore Microsoft Fabric Consulting →