Archive for November, 2008
OpenSQL Camp 2008 has come and gone, and hooray again for Baron who came up with the idea and made most of it happen (but let’s not forget Sheeri!) Events such as these are always educational, but the most interesting stuff happens outside of the organised sessions (and this being an un-conf, they weren’t that strictly planned anyway 😉
For me (Arjen) a major chunk of the exercise was acquiring jetlag there and back with no days to spare either side, but I feel it was well worth it. I spent most of the time listening and talking with people rather than coding. It was a great opportunity to catch up with Monty, the Percona crew (Baron, Peter, Vadim, Tom, and more – there’s so many of them now!), Brian, Stewart, Jay, Pat, Eric and other Drizzlers, Sheeri, active OurDelta people like Nick and Rob, ex-Brisbanite Ronald, and of course Jim who thought he might learn something in the MVCC session (no I’m not going to explain that joke!)
The Percona patches have moved to Launchpad, so from now on they’re being developed in plain sight, available earlier for peer review, and more easily integrated into OurDelta builds. Thanks Vadim for making that happen! An excellent example of the Open Source development model – the resulting quality will be even higher! The Percona crew is also working on their end of the 5.1 porting of the patches, with priority given to the performance-related ones. OurDelta contains additional patches and features, so we have extra work anyway – all help is great and much appreciated!
OurDelta is, as stated previously, committed to doing 5.1 builds also, but we’re going to continue doing 5.0 builds for the foreseeable future as well. Most deployments are currently on 5.0, and the various enhancements in OurDelta builds provide breathing space (in terms of performance, and monitoring/tuning instrumentation) while people check out 5.1 and plan for a possible upgrade. And we’ll make sure that anything we put in 5.0 will also be available in 5.1, so that you don’t lose anything when you do upgrade. That’s our promise.
We’re currently looking at a few more platforms to build for, such as Solaris and Windows. The latter is mainly aimed at developers, who will certainly appreciate the extra info they can get out of an OurDelta build and thus make better performing applications!
Next to performance-related patches, instrumentation is and will remain a key focus for OurDelta. We want to get even more information from the server (without increasing disk I/O, contention or CPU load and yes that is possible), as it offers more breadth and depth than any external solution. And we reckon -and that’s us who deal directly with real-world deployments on a daily basis- that is well worth the extra effort!
If you start with the d6 build, you probably have ourdelta.org in your repo files rather than mirror.ourdelta.org. Since we moved to using download mirrors, you need to update your repo config files. There are redirects in place for download users, but yum/apt-get generally don’t like redirects. For details on what your config should now look like, just take a peek at the information for each distro we currently support:
This week saw the release of OurDelta patchset d7 build of MySQL 5.0.67, basically a cleaned-up update of the earlier (and first) OurDelta d6 build. The number of downloads/fetches within the first few hours surpassed the total number from the previous weeks.
Downloads and yum/apt-get repository fetches now always go via one of our mirrors, as obviously the main server can’t possibly handle all that attention! By default you just get sent to “somewhere on the planet”, although you can tweak your repo setup to only use specific mirrors. If you want to become a mirror for OurDelta, drop us a line and we’ll be happy to add you in; the more the merrier!
Ubuntu 8.10 Intrepid is now also supported. We welcome input on which additional platforms are desirable.
There was a podcast, where interviewer James Purser came up with an good description of what OurDelta is: “a new distro for MySQL”.
OurDelta development in the coming weeks will focus on 5.1. If you would like to get involved with this particular effort, join the ourdelta-developers group on Launchpad, and check out the recent mailing list archive. There’s more to it than just code; but getting started there is not as hard as it seems, and there’s plenty of helpful hands about!
Alrighty, my mistake. In the setup of the mirror infrastructure, I stuffed up the server alias logic so that some yum and apt-get requests will be failing at the moment (specifically on the us mirrors). The uk mirror should be ok. Either temporarily override your config for the uk mirror, or wait a few hours as things gets sorted on those systems. Sorry!
Update: all fixed now – and it seems the mirror people are smarter than I anyway 😉
We’ll get some testing and monitoring in place for this kind of thing, it’s obviously very tricky to spot such problems otherwise.
OurDelta build for MySQL 5.0.67 with patchset d7 is now available, in source (new!) and packaged binaries for RHEL/CentOS 4 and 5, Debian 4.0 Etch, Ubuntu 8.04 LTS (Hardy) and (new!) Ubuntu 8.10 (Intrepid).
If you already installed the OurDelta repository information, yum update or apt-get upgrade will install the updated packages for you. Please do review the special notes on backward compatibility below.
Fixes & Additions:
- Fixed up all backward compatibility and reserved keyword issues. You can now drop in an OurDelta build to replace a stock version. Generally this merely involved some minor changes to various patches; however Arjen worked on the MicroSlow patch so that it now accepts and returns fractional seconds. This makes it backward compatible with the stock MySQL. Percona has indicated it will also move to this new version of the patch.
- Note: if you are upgrading from the OurDelta 5.0.67.d6 build, or any of the earlier Percona builds, you will need to adjust your long_query_time from microseconds to fractional seconds. (This should be the only time we needed to do this, e.g. break something to unbreak things 😉
- Added Mirrored Binlog and Fast Master Promotion patches (by Google, extracted by Percona).
- Added KILL IF IDLE and InnoDB Freeze patches (by Google, extracted by David Stainton, Spinn3r), now in a public build for the very first time!
- Added updated “innodb_rw_locks” patch (by Yasufumi Kinoshita); only in -Sail binary.
- Added new “adaptive flush of InnoDB buffer pool” patch (by Percona); only in -Sail binary.
- Bugfix “variables out-of-bounds on 32-bit” aka BIG_TABLES (launchpad#284123, mysqlbug#35346) by Antony Curtis.
- Bugfix “mysqld_safe open_files_limit” (launchpad#290190, mysqlbug#40368) by Erik Ljungstrom.
- Improved build process: creating patched source tarballs once, then feeding these into the various build machines. This means we now have those same source tarballs also available for you to download, just in case you wish to build them for another platform! Lots of script magic and time by Peter Lieverdink.
- All distro packages now also have the appropriate source packages available.
- Ubuntu 8.10 (Intrepid) builds added.
- RHEL/CentOS release RPM: further simplifies setup for YUM, with automatic mirrors and GPG key. Thanks Steve Walsh for that contribution!
- More documentation for each feature so that you know exactly which new configuration options and SQL commands you get, and how they work.
- All pages on the website now accept comments, so it’s even easier to provide corrections and other feedback on specific content pages and posts. Not intended for reporting bugs.