Many big data projects run into the 80/20 rule. 80% of resources is spent getting data into their analytic tools and only 20% on analyzing the data. syslog-ng can deliver data from a wide variety of sources to Hadoop, Elasticsearch, MongoDB, and Kafka as well as many others.Request your free trial
Delivering data in disparate formats from systems, applications, and devices often requires multiple tools and special integration.
Big data is, well, big. Many data sources can overwhelm data collection tools.
Most big data systems capture data from complex, distributed systems, often from multiple remote sites with a variety of connectivity and latency issues.
Insights based on incomplete data are often wrong. In large environments, it’s easy to leak data during collection and ingestion.
Getting data into data stores is often the most time-consuming and costly part of big data projects.
Big data systems often serve a variety of data consumers, each having their own requirements.
syslog-ng can collect logs from legacy systems, web servers, SQL databases as well as any applications or devices generating JSON messages or text-based files.
syslog-ng natively streams data to Hadoop Distributed File System as well as the MapR distributed file system. We have partnered with Hadoop pioneers Hortonworks and MapR to ensure seamless data transfer from syslog-ng to your Hadoop cluster.
Data consumers have different needs and many organizations use a variety of data management and analysis tools, syslog-ng can flexibly route data from X sources to Y destinations.
syslog-ng streams log data directly to Elasticsearch, one of the most popular enterprise search engines. syslog-ng delivers log data to Elasticsearch in JSON format where it can be searched.
Using syslog-ng’s Pattern Database you can classify, filter, parse, re-write and enrich to transform disparate data types in real-time. Take text data and create key-value pairs for a variety data stores.
syslog-ng sends log data to MongoDB, a popular document NoSQL database. With its schema-free, document-oriented architecture, MongoDB is used as a backend to many websites and services.
Data transfer over TCP and the Reliable Log Transfer Protocol (RLTP), local disk buffering, client-side failover and other features ensure zero message loss, giving you confidence in your data.
syslog-ng directly sends data messages to Apache Kafka, a messaging system designed for streaming data use cases with large amounts of data and low latency requirements. syslog-ng publishes log messages to Kafka where subscribers can access them.
syslog-ng’s architecture enables you to deploy the same software packages on a more than 50 different server platforms.
Getting all of your data means you can rely on the insights derived from your analytic platform.
Having data delivered in real-time means you can react and get answers faster.
End to end encryption prevents unwanted 3rd party access.
Tell us a bit more about you and let us know how we can help.
Not ready to talk to an expert yet?