Cribl puts your IT and Security data at the center of your data management strategy and provides a one-stop shop for analyzing, collecting, processing, and routing it all at any scale. Try the Cribl suite of products and start building your data engine today!
Learn more ›Evolving demands placed on IT and Security teams are driving a new architecture for how observability data is captured, curated, and queried. This new architecture provides flexibility and control while managing the costs of increasing data volumes.
Read white paper ›Cribl Stream is a vendor-agnostic observability pipeline that gives you the flexibility to collect, reduce, enrich, normalize, and route data from any source to any destination within your existing data infrastructure.
Learn more ›Cribl Edge provides an intelligent, highly scalable edge-based data collection system for logs, metrics, and application data.
Learn more ›Cribl Search turns the traditional search process on its head, allowing users to search data in place without having to collect/store first.
Learn more ›Cribl Lake is a turnkey data lake solution that takes just minutes to get up and running — no data expertise needed. Leverage open formats, unified security with rich access controls, and central access to all IT and security data.
Learn more ›The Cribl.Cloud platform gets you up and running fast without the hassle of running infrastructure.
Learn more ›Cribl.Cloud Solution Brief
The fastest and easiest way to realize the value of an observability ecosystem.
Read Solution Brief ›Cribl Copilot gets your deployments up and running in minutes, not weeks or months.
Learn more ›AppScope gives operators the visibility they need into application behavior, metrics and events with no configuration and no agent required.
Learn more ›Explore Cribl’s Solutions by Use Cases:
Explore Cribl’s Solutions by Integrations:
Explore Cribl’s Solutions by Industry:
September 25 | 10am PT / 1pm ET
Hold my beer: lessons from one team’s data pipeline journey
Register ›Try Your Own Cribl Sandbox
Experience a full version of Cribl Stream and Cribl Edge in the cloud.
Launch Now ›Get inspired by how our customers are innovating IT, security and observability. They inspire us daily!
Read Customer Stories ›Sally Beauty Holdings
Sally Beauty Swaps LogStash and Syslog-ng with Cribl.Cloud for a Resilient Security and Observability Pipeline
Read Case Study ›Experience a full version of Cribl Stream and Cribl Edge in the cloud.
Launch Now ›Transform data management with Cribl, the Data Engine for IT and Security
Learn More ›Cribl Corporate Overview
Cribl makes open observability a reality, giving you the freedom and flexibility to make choices instead of compromises.
Get the Guide ›Stay up to date on all things Cribl and observability.
Visit the Newsroom ›Cribl’s leadership team has built and launched category-defining products for some of the most innovative companies in the technology sector, and is supported by the world’s most elite investors.
Meet our Leaders ›Join the Cribl herd! The smartest, funniest, most passionate goats you’ll ever meet.
Learn More ›Whether you’re just getting started or scaling up, the Cribl for Startups program gives you the tools and resources your company needs to be successful at every stage.
Learn More ›Want to learn more about Cribl from our sales experts? Send us your contact information and we’ll be in touch.
Talk to an Expert ›Judith spearheads product marketing for Cribl Edge and our partners. With extensive exper... Read Moreience in data platforms and artificial intelligence, she is passionate about addressing the challenges of big data, utilizing Cribl products to solve the most complex issues. A proud alumna of UC Berkeley, Judith holds a degree in economics and carries the ‘Go Bears’ spirit in all her work! Read Less
In today’s environments, the number of endpoints seems to be endless. Simultaneously, with more advanced bad actors and increasingly complex systems, it is more important than ever that no endpoint goes unmonitored. However, many solutions simply can’t keep up with this growing scale of data collection at the edge.
Luckily for you, there is Cribl Edge! Cribl Edge is a highly scalable, vendor-neutral agent that allows you to collect and process IT and security data at the edge from Linux and Windows machines, applications, microservices, etc., and deliver it to your destination of choice. As a modern and intelligent agent, Cribl Edge offers a rich and interactive UI, real-time change validation, configuration version control, built-in fleet management, automatic discovery of host data, and much more!
Endless endpoints also bring unprecedented volumes of data at the edge. While plenty of this data is incredibly valuable, there are also ample amounts of data dispersed within it that do not need to be collected or analyzed. Many vendors will still charge you for bringing in this data you don’t ultimately want to keep, which may force you to make compromises on whether you should monitor certain endpoints altogether. But here at Cribl, we believe in empowering you with choice, control, and flexibility over your data, so we have introduced a new feature where data dropped in Cribl Edge does not count against the ingested volume (available in release 4.6). So let’s walk you through a few scenarios on using this new feature to make the most of your Edge ingest and get even more out of your Cribl license!
Data (events) at Edge Nodes can be dropped in Pipelines. A Pipeline is a list of functions that work on data. Edge supports 3 different Pipelines:
Pipelines can be part of a Pack too. Any original events dropped in any of the pipelines above is summed up and subtracted from the total ingest to arrive at Net Ingest for that Edge Node, but keep in mind this only does not apply to cloned events (as in when you are sending to multiple destinations) and only to the original data. Any data sent to DevNull Destination is also subtracted from total ingest. Also, as always, any data sent from Edge to Cribl Stream via Cribl HTTP or Cribl TCP Destinations is only counted once as Net Ingest from Edge so you won’t be billed for it again.
Let’s walk through a few examples.
When testing Source configurations, Pipelines, or when working in Staging environments, you don’t have to worry about ingest costs anymore. You can just route all the data to the DevNull Destination and it won’t be counted as ingest. This is the default out-of-box configuration for any fleet.
If you are ingesting 4 GB from a Source (e.g, File Monitor) and routing it all to the DevNull Destination, then you wouldn’t be charged for any ingest.
Net Ingest is 0 GB
We see many customers interested in collecting events from Windows Security Event Logs. While a lot of information from Security Event Logs is useful, there are some event codes that customers typically would like to drop before routing to a destination (e.g, Event ID 4662, which logs access to Directory Service and can result in a lot of events as read access to Directory Service is very common).
In the example below, I created a Pipeline to drop Event ID 4662 and attached it to the QuickConnect Route (as Processing Pipeline) between Windows Event Logs & Grafana Cloud. You can also attach this pipeline as a Pre-Processing Pipeline to Windows Event Logs. The result would be the same.
Net Ingest is 3.5 GB
Often, customers would like to maintain full fidelity raw logs in an archive while sending out a subset to their analytics tool or SIEM. Let’s expand on the above scenario where Windows Event Logs are sent to Grafana Cloud after dropping Event ID 4662. In addition to sending to Grafana Cloud, let’s say I want to archive all the events (including Event ID 4662) to an external storage like S3.
In this scenario, since you are cloning the data before dropping, all ingest is counted against license. However, if you drop data in a Pre-Processing Pipeline (at Source, before cloning), then, any dropped data will be deducted from ingest.
Net Ingest is 4 GB
I hope these examples help you get some ideas on how to take advantage of dropping events in Cribl Edge to get more out of your Cribl license. Maybe you can free up enough ingestion to deploy more Edge Nodes?!
Cribl, the Data Engine for IT and Security, empowers organizations to transform their data strategy. Customers use Cribl’s suite of products to collect, process, route, and analyze all IT and security data, delivering the flexibility, choice, and control required to adapt to their ever-changing needs.
We offer free training, certifications, and a free tier across our products. Our community Slack features Cribl engineers, partners, and customers who can answer your questions as you get started and continue to build and evolve. We also offer a variety of hands-on Sandboxes for those interested in how companies globally leverage our products for their data challenges.
Experience a full version of Cribl Stream and Cribl Edge in the cloud with pre-made sources and destinations.
Classic choice. Sadly, our website is designed for all modern supported browsers like Edge, Chrome, Firefox, and Safari
Got one of those handy?