Showing posts with label Cumulus. Show all posts
Showing posts with label Cumulus. Show all posts

Friday, 28 November 2014

Weather Report

My weather station has been running virtually without a hitch for several months. The few problems I had encountered with the weewx software running on the Raspberry Pi had been ironed out (due to my errors, not the software's - see posts passim). The Pi has occasionally frozen and needed a reboot, but for a £30 device running 24/7 for months on end that's remarkable. It would be stupid to mess with it; best leave well alone now it's stable.


A Silver Lining in Every Cloud

No, of course I couldn't leave it alone. About two years ago I had a Maplin weather station feeding data to Sandaysoft's Cumulus software that was running on a Windows PC (see Where's the Time Gone). Whilst I liked Cumulus I wasn't prepared to leave the PC running in order for it to upload regular updates to the website, due to the noise it generated and the power it consumed, which is why I moved to the Pi. I always wanted to use Cumulus again and had considered building a mini PC using a low-power CPU and mini-ITX board. However, although mini-ITX motherboards are relatively cheap, by the time a hard drive, memory, a case and Windows, annoyingly the most costly component of all, had been added, the total cost had become eye-watering.

That would have remained the status quo were it not for my daughter complaining that her laptop had starting misbehaving: a blue screen of death that ultimately required a restore from a backup. Then the 'e' key stopped working; which causd hr quit a problm as it's th most common lttr in th languag. My suggestion of only using words without an 'e' didn't go down well and she resorted to using an on-screen keyboard until her new laptop arrived.

There are no problems, only opportunities, as some management wnkers (sorry, the 'a' key's playing up now) are wont to say. I realised I could use her old laptop as a way to run Cumulus; it would be quiet and fairly frugal with power too. Better still it had a large hard drive so it could also be utilised as a media server.

Cloud processing - Laptop running Cumulus software

Speculate to a Cumulus

After I had rebuilt the laptop from the factory image (then removed the cruft and bloatware that was included - I'm talking about you, Dell) I downloaded the latest version of Cumulus, 1.9.4 build 1085, from the Sandaysoft website. Cumulus is donationware: free to download and use, but you're encouraged to give the author some money to at least keep him in tea and biscuits. Considering the polished nature of the software, its features and the level of support that Steve, the author, provides it would be churlish not to donate something (I have). Although judging from a couple of justifiably testy comments Steve has made in the forum, many people are too cheap to do so (but probably still expect him to sort out their problems).

Like any weather software worth its salt, Cumulus doesn't just provide a regularly updated display of information from the weather station, it also includes FTP to allow the data to be uploaded to a website. A set of quite attractive web pages are provided (although the graphs are rather ugly) and the tags (used by Cumulus to embed the weather data into the web pages) are documented so you use the ones you want and design your own web pages. Simply put, to create the web pages the program uses template pages that it processes by embedding the tag data and then FTPing the resulting page. So, for example, the tag #temp is replaced by the temperature reading from the weather station. The Webtags page in the Wiki explains this in some detail.

There isn't a manual for Cumulus but there are a fairly comprehensive set of instructions on the Cumulus Wiki, plus there's a forum that's well frequented by knowledgeable weather enthusiasts and Cumulus users.

Once again I used the web server on my trusty old QNAP NAS to make the information available to the whole wide world. And if that wasn't enough, regular updates are being sent to Weather Underground, whose pages are rather attractive and have some cool graphs too.


My Cam and Yawcam Too

Something else I had wanted to do for a while was reinstate a webcam feed. For some time my Raspberry Pi had happily processed images from a Logitech C270 webcam as well as running Weewx. Unexpectedly I started seeing problems with both Weewx not running and the webcam images not being uploaded; I have no evidence for this, but I suspect this corresponded to changes in Raspbian to accommodate the Raspberry Pi camera. My Pi is an early (not the earliest) Model B, only has 256Mb of memory and possibly struggled with the demands expected of it.

A Windows OS meant I was able to use Yawcam again. This is a neat, unassuming and free program that will take a feed from a webcam and send images, either still or streaming. I use it to grab an image every 10 minutes and squirt it to my web server where it forms part of the weather webpages on my site and Weather Underground.

Wednesday, 20 November 2013

Weather Station on a Stick

Shortly after I wrote the last post the Davis Weather Vue weather station I had ordered was delivered. Inside the box was the console (a small unit with an LCD display and some buttons) and what Davis calls the Integrated Sensor Suite, or ISS (a single white and black plastic unit housing rain gauge, anemometer, wind vane and thermometer). There was also a plastic bag that contained a mounting kit, battery and a teeny tiny Allen wrench so small I thought it was something you could use to poke into the Reset holes present on some consumer electronic equipment.

Along with the Weather Vue I had ordered a USB Data Logger, which was supplied with Davis' WeatherLink software. This is an extra - the Weather Vue will function happily without it - but I wanted to export the data to my Raspberry Pi and a Data Logger was required to do this. Prodata had thoughtfully attached detailed instructions regarding installation and preparation of the software. Presumably they had had plenty of questions from users about it in the past. Depressing, though, that the software and Data Logger hardware hadn't had the difficulties designed out.

Assembling the ISS was trivial. The instruction booklet was well presented and clearly explained how to insert the rain tipping spoon (their word), attach the wind cups and wind vane. The ISS has to be mounted on a pole, so I bought an aerial mast which, at 3cms was about the recommended diameter. Prior to mounting it I tested that it was communicating with the console and then attached it to the mast and the whole lot to the bracket that had formerly held the WH-1080. A nice touch was the spirit level built into the top of the ISS to help ensure it is level.

Ugly, though, isn't it?

Consolation Surprise

The hard part done I turned to the console. To my chagrin I realised that although it had been supplied with a mains adapter it also required three 'C' size batteries. These weren't available in either of the shops in the village and so I had to trek into the nearby town. Once procured and inserted I switched on the console which was meant to run through a self test and beep four times. I lost count after about the twelfth beep and was becoming somewhat concerned at the random messages on the screen and constant reboots.

Eventually the console settled down and I was able to start the setup process which, apart from finding elevation, latitude and longitude (Google Earth is your friend here), was pretty much a case of accepting the defaults. Once complete the latest data from the ISS is displayed together with astronomical events - I was pretty impressed to see it show that the Taurid meteor shower was due.

All this, and more
By pressing one of the buttons on the console it's possible to obtain more information about, say, the wind as well as displaying the data in the graph in the bottom left of the display. At present I've only scratched the surface of the information it is possible to display.


Web Weaver

The next stage was to link the Vantage Vue to my Raspberry Pi and upload the data to a web site. Firstly I installed the WeatherLink software that had been supplied with the data logger onto my PC which enabled me to test that I was able to download data from the console. This worked without a problem so I installed the latest version of the excellent Cumulus software, again I was able to receive data with no errors.

Being unfamiliar with weewx (and somewhat shaky with Linux) knowing that the hardware worked meant one fewer place to look if it didn't work. The beauty of weewx is that it's pretty easy to set up, offering two ways to install itself (via a package or from a downloaded tar file); both methods are explained in the docs section of the weewx website. I opted for the tar file method as it installs all the files in /home/weewx and it seemed easier to have all the gubbins in the same place.

After weewx was installed I had to edit the weewx.conf file to set the altitude, location and weather station type. This step is well documented in the docs and I used Leafpad on the Pi via an Xming session to make the changes. Yes, yes, real men use the command line, but I don't care. An extract from the weewx.conf file is shown below.
Easy peasy configuration file editing
The part that had me scratching my head was the FTP sections - crucial to get right if I wanted to see the data on the web. For the server name I first used the local URL of my web server (actually a Qnap NAS) and this failed. Eventually I had success by using the IP address of the NAS.

After I had finished fiddling about I started weewx and watched the log with crossed digits. Everything looked good, especially the FTP upload, so I opened up the webpage and was rewarded by data from the weather station and a selection of graphs. As my confidence editing weewx's index.html.tmpl file grew I added a feed from the webcam and satellite information from Meteox. This is the final result or you can peruse the half-hourly feed to Weather Underground and The Met Office Weather Observation Website (WOW).

So everything's sweetness and light. Well, not quite. I have an issue with the daily graphs in that they plot points and not lines; oddly the graphs for monthly data correctly show lines, dunno why the daily graphs don't. Before I ask on the weewx forum I want to eliminate the obvious.

Tuesday, 5 November 2013

Beeching Axe

I had been finding it increasingly difficult to make compromises with what I wanted to do with the railway layout and the space available. Ideally I wanted to be able to set up a train consist (as our North American friends call it), set it going around the layout and then I could do some interesting shunting stuff in the station yard. This concept had worked on a layout I had built some years ago, but then I'd had much more room.

Raised track at the rear of the layout (see posts passim) was created to provide some scenic interest; the idea was to create an illusion of mainline running tracks separated from the station area by the difference in height. However the inclines were starting to cause difficulties with train running and it was clear that it would cause difficulties scenically too. Ironically it was lack of space that was the reason for the failure of this idea.

Unsatisfactory. That was my view as I tried to fit the quart of ambition into the pint glass of baseboard. In the end I decided to dismantle the whole lot, baseboards included, and have a fundamental rethink. Whatever I decide to do, it will have to be built in the attic as there's no room in the house for what I want to do. Before that happens some kind of flooring and insulation will need to be installed to prevent my frostbitten (or, depending on the season, roasting) foot coming through the ceiling.


Weather Report

Nearly a year ago I wrote about using a Raspberry Pi to upload weather data from a Fine Offset WH-1080 weather station to a website. For the most part the WH-1080 has worked well and has been a worthwhile introduction to weather data collection. At the time of writing the WH-1080 is being sold in the UK by Maplin for a whisker under £60 (product code N96GY).

There have been some hiccups with interruptions in data transmission from the outside unit. Prompted by an outage lasting over a day I bought a replacement transmitter, only for the original unit to start working again. It's still prone to occasional dropouts, seemingly without any correlation to weather conditions or invertebrate infestation. The latter stopped the anemometer until I was able to clear the spider webs.

Weather Station and Spider Habitat


Presently, however, the unit isn't recording wind speed or direction data. The receiver unit shows changing wind direction but not the wind speed, and neither are being uploaded to the website. This isn't just an issue with pywws, the Cumulus weather software isn't receiving the data either. Dismantling the anemometer showed nothing apparently wrong with it; not surprisingly as all that's inside is a reed switch and a tiny magnet. As repair wasn't possible I ordered a new unit from Maplin. And I'm still waiting for it. The buggers have taken my money (£5 with postage!) and it's still 'on order'.

Finally I decided to order a Davis Vantage Vue weather station and data logger from Prodata, who are selling them together at a 'special offer' price. The Vantage Vue consists of a combined sensor unit containing rain bucket, anemometer, wind direction, temperature and humidity sensors. Like the WH-1080 the sensor data is transmitted wirelessly to an internal console with an LCD display. An optional USB data logger is required to store data and send it to a PC. My plan is to use weewx, a linux-based weather software application, installed on the trusty Raspberry Pi in place of pywws (this program won't work with the Davis unit).

Presently I'm waiting for the thing to be delivered (every noise outside sends me to the window to see if the courier has arrived) and when it is, I'll document how I set up both it and weewx more carefully than I did for pywws and the WH-1080. I'll spare you the unboxing, though.

Tuesday, 11 December 2012

Where's the Time Gone?

Crikey, time flies. Over two months since my last post and I have little to show for it. Since deciding what to base my model railway on I have made no more progress, save making some preparations to move where I work when I'm working from home to free up some room for the railway.

Looking at the only possible space to site a layout I can only think there's not enough room. This was ever the lament of the railway modeller. Even if I had a large shed at my disposal like my friend Trebian (who's sadly wasting it on wargaming) I'm sure I'd find it limiting. So, I shall press on with what I've got: maybe I should try Z gauge?

Recently much of my time has been spent getting to grips with a Raspberry Pi, with a view to configuring it to run my weather station. Linux is a whole new world to me and, whilst I've dabbled with it in the past, I'm having to get really stuck in, up to my armpits. Generally it's frustrating, obtuse, mendacious but, when something works the sun bursts forth to the sound of angels playing trumpets.

I aim to have it working for the new year so I can switch my cheapo Maplin weather station across from the current arrangement. This is connected to the excellent Cumulus software that runs on my PC and updates my website every 15 minutes. It only does this whilst my PC is running and I want it to be available all the time. Hence the move to the Raspi which draws much less power and is silent.

Assuming I make the bloody thing do my bidding I'll post the steps up here. A regular update on what I've done so far and why it didn't work would be too depressing to read (and write). With time off at and after Christmas I hope to make progress with both the Raspi and the railway.