Logscape

Logscape is a big-data analysis tool. Using the user’s logs and other data, Logscape produces clear dashboards and provides real-time alerts. All data is indexed on your system, whether locally, or using a centralised index store. Once indexed the user can search the entire stack for a single term, or use precise functions and filters. Logscape is deployed on your infrastructure and provides a straight forward web interface, with enterprise ready access controls. Put simply, it’s an application that allows the user to run distributed searches across all the disparate log data your applications, containers, infrastructure and OS are producing. Searches are run on demand, in a matter of seconds, i.e. not off-line batch processing like Hadoop would do, and the results can be visualised in a variety of ways. Once you’ve found something interesting you can refine your search and interact with the data, zoom in or out to look at smaller or longer periods of time, or even drill right down to the matching log line highlighted in the full log file. At a basic level the user can look for occurrences of particular words, phrases or regular expressions within their log data, and then graph when, where and how often these occur. This is powerful enough in itself, but Logscape can do more! Given a log line such as: 2014:06:15 14:03:52,128 Loader INFO load complete! objectCount: 1102, took: 12. Using Logscape the user can pull out the metrics/fields out of the line, using regular expressions, custom data types, (more on those later), or even use Logscape’s in-built automatic field detection algorithms to do the hard work for you. Once the user has got access to these metrics, they really can start to explore the wealth of information that’s just been sitting in your logs for all those years.