Posts

The STALL data filter

Image
Currently, Kronometrix, is supporting two types of raw data filters: the STALL and RANGE filters. A raw data filter is a mechanism to ensure that incoming raw data follows certain rules or conditions before the numerical processing and data visualization, within Kronometrix. For example the STALL filter will ensure raw data is properly arriving to our appliance and there are no delays. The RANGE filter, will ensure incoming raw data is sane and valid, and stays within certain range of values. For example the air temperature is valid as long as it is between -50C to 50C or the CPU Utilization of a Windows server is between 0 and 100%. The STALL Filter Defined under messages.json and part of the Library of Monitoring Objects , the STALL filter is part of the data message definition. For example this is the way to define the STALL for a data message, called sysrec, which belongs to a data source type: Linux (a computer system running Linux CentOS operating system).  stall...

Windows, Linux, FreeBSD all welcome

Image
By default for IT business, we support in Kronometrix, monitoring objects from Linux and FreeBSD data sources. Recently we been porting our data recorders to Windows operating system and start to offer ready made objects for this. Example, latest Kronometrix 1.2 we plan to support Linux, FreeBSD and Windows 2008, 2012 Server editions 64 bit. Below several data sources within Kronometrix: and then we can drill down per OS, example clicking centos : Thats all. This is part of executive dashboard view.

Programming Republic of Perl, the Windows story

Image
Task: port Kronometrix from Linux, FreeBSD to Windows platform, including all data recorders and the transporter. Preferable use a programming language, like Perl to easy the porting process and re-utilize whatever we have already in Kronometrix. Timeline:  ASAP Open Source: Yes Goals Some top rules for developing the new recorders: all recorders, must be coded in a scripting language preferable, all recorders must work as CLI and Windows services all raw data, should be easy to access, via C:\Kronometrix\log\ , no more mysteries about AppData directory transporter should be done similar way, coded using a scripting language memory footprint 64MB RAM Perl5 We been experimenting previously with C/C++ for Kronometrix on Windows. Nothing wrong with C/C++ except, that for every small change we had to do a lot of work & testing. We looked to PowerShell and other langauges but nothing came closer and felt like home, than Perl. All our data recorders...

Asus Zenbook UX32VD and FreeBSD 11, part two

Image
This is a short description how I got running FreeBSD 11-current on my Asus Zenbook UX32VD laptop. Im very happy with the current setup but of course it is room for improvements in many areas. Having DTrace, ZFS and the other goodies makes FreeBSD a real good candidate for a mobile environment. This is a short update, regarding a regression for Xorg and drm2 module which breaks down Xorg. Last Updated: 18 July 2015 Zenbook UX32VD Configuration CPU: Intel(R) Core(TM) i7-3517U CPU @ 1.90GHz Memory: 6 GB RAM Storage:  SanDisk SSD i100 24GB, Samsung SSD 840 PRO 500GB Video:  Intel HD Graphics 4000, Nvidia GT620M Display: 13" IPS Full HD anti-glare Wifi: Intel Centrino Advanced-N 6235 3 x USB 3.0 port(s)  1 x HDMI  1 x Mini VGA Port  1 x SD card reader Note: The laptop's internal hard drive, has been replaced by a Samsung SSD.

The Night Shift

Image
The TV Series ... Night Shift ? Nope, this is Kronometrix appliance for night workers, operators, sleepless system administrators and for the rest of us, working late. An appliance ? What do you mean ? To be serious about monitoring you better have an application running on a cloud platform, right ? Public or private, whatever that is, Google, Amazon, Azure or on a internal network powered by OpenStack, VMware ...  preferable deployed over a large number of nodes, using large memory configurations and offering advanced dashboards to keep track of hundreds of metrics collected from machines, storage, network devices, applications all available and ready to be ... read and digested by anyone. The duty admin is confused, what dashboards will be needed for basic performance monitoring and SLA and what metrics these dashboards should include ? We took a simpler approach with Kronometrix, which can be deployed on a cloud computing platform if really needed, which was designed ...

One Tool to rule them all ...

Image
Data Recording Module -  Five default, main, data recorders, written in Perl 5, responsible to collect and report: overall system utilization and queuing , per-CPU statistics , per disk IO throughput and errors , per NIC IO throughput and the computer system inventory data: sysrec, cpurec, diskrec, nicrec and hdwrec. But why not having a single process, simple to start and stop, and operate ? Does it matter, anyway ? One tool cannot perform all jobs. We believe that. We have assigned different tasks to different recorders, making easy and simple to update a data recorder without breaking the others. As well, we wanted to separate functionality based on the main 4 system's resources: CPU, Memory, Disk and Network. Additional we think it is very important to have a description of the hardware and software running on that computer system, sort of the inventory, that everybody understands easily what are we looking at. Saying these, we ended up using the fol...

Who are you ? The story about DBus and cloning virtual machines

Image
Kronometrix Data Recording Module , ships with a transport utility called sender , which ensures all raw data is shipped to one or many data analytic appliances over HTTP or HTTPS protocols.  sender,  a Perl5 citizen, checks all raw data updates and relies on a host uuid identifier from the operating system to deliver that raw data. If such host uuid is found will use that for the entire duration of its execution. If no such host uuid is found it will generate a new one and store that on its configuration file, kronometrix.json. The analytics appliance, relies that each data source is unique and valid, properly checked or generated by the transport utility, sender.  But what's happening if this really does not work ? Data Source Id Kronometrix uses the data source id concept, ( DSID ), to identify a data source point, from where one or many data messages are received. For example for IT, Computer Performance data, a DSID identifies to a computer system ho...