|
Planet MySQL
|
Planet MySQL - http://www.planetmysql.org/
|
-
Submit your presentations for Collaborate 2011!
There are approximately 3 weeks left to submit your MySQL DBA-related presentations to Collaborate 2011, held in Orlando, FL April 10-14. Experience has shown that the best presentations are submitted well in advance of the deadline, so now is a great time to submit while you have plenty of time to create a good abstract.
Information and the link to submit abstracts are at http://collaborate11.ioug.org/. I posted a cheat sheet on how to fill out the Call for Presentations for MySQLers a while ago, and as always feel free to ask me any questions.
read more
-
Digg’s main competitor (Reddit) runs Cassandra but their VP of Engineering was fired for the decision to switch.
Apparently, Digg performed a big migration from MySQL to Cassandra and a big migration to their new Digg v4 architecture and now their VP of Engineering has been shown the door:
Ever since Digg launched its new site design, it’s been plagued with all kinds of trouble, not least of which is that it keeps going down. The problems with the new architecture are so bad that VP of Engineering John Quinn is now gone, we’ve confirmed with sources close to Digg.
In a Diggnation video today, CEO Kevin Rose explained some of the technical issues the site is dealing with and why it can’t simply roll back to the previous architecture. The new version of Digg, v4, is based on a distributed database called Cassandra, which replaced the MySQL database the site ran on before. Cassandra is very advanced—it is supposed to be faster and scale better—but perhaps it is still too experimental. Or maybe it’s just the way Digg implemented it (Twitter uses Cassandra, although not for its main data store, as does Facebook in places, but it obviously is not as battle-tested as it needs to be). Every engineer at Digg is currently just trying to keep the site up and running.
Some of this is political. Perhaps Mr. Quinn was excused for other reasons above and beyond this switch.
Perhaps he should have had buy in from other members of the team. Had Rose personally signed off on this migration it would have been tough to fire their VP of Engineering.
The technical aspects on this type of migration are VERY difficult. Not just because you’re moving from one DB to another but a lot of the polish, fit, and finish of your existing system tend to be taken for granted over time.
Newer databases don’t have this type of polish and you end up having to duplicate a lot of infrastructure that’s already present on the previous generation.
MySQL is definitely no panacea. You’re going to have pain either way. At least with some of the modern DBs you’re partially headed in the right direction.
One trend I’ve seen is for people to use the LAMP stack to serve websites but then to use Hadoop + Hive as part of their ETL setup so they can run reports and transform production data.
There is no solid bigtable implementation just yet. I wish there was but it doesn’t seem like we have one just yet.
Cassandra isn’t that bad of course. Reddit, Digg’s main competitor – is running Cassandra.
Seems like a strange thing to fire someone over. If you’re main competitor is running the same database the decision to switch certainly couldn’t have been too bad.
-
Zmanda @ Oracle OpenWorld 2010
If you are coming to this year’s Oracle OpenWorld 2010, please do visit us at Booth #3824.
We will have our backup solution experts at the show to discuss any of your database or infrastructure backup needs.
When it comes to backing up various products offered by Oracle, we have several solutions:
Amanda Enterprise: Backup solution for Oracle Enterprise Linux and Solaris based systems.
Zmanda Oracle Agent: Backs up live Oracle databases to Amanda backup server - which can store backup archives on disks, tapes, or storage clouds.
Zmanda Cloud Backup: Backs up live Oracle databases running on a Windows server directly to Amazon S3.
Zmanda Recovery Manager for MySQL: Backup solution for large scale MySQL environments.
We hope to see you at the show!
-
Flexviews 1.6.0-RC1 is released
Whats new in Flexviews 1.6.0RC1This is the first release candidate before the final release. If no major bugs are uncovered, then the next release will be the first GA release. Flexviews now has a test suite for all major features. The creation of these tests uncovered a number of issues which have been resolved in this release. All MySQL aggregate functions except GROUP_CONCAT are now supported. A special aggregate function called PERCENTILE is now also supported. The calculation uses a modified version of the GROUP_CONCAT based solution suggested by Roland Bouman for percentiles. This function should be considered experimental. Please report bugs if you find any.You can add indexes to enabled materialized views using SQL_API/add_exprAdding PRIMARY KEY indexes is no longer supported. All views get an auto_incrementing primary key. You can add additional UNIQUE indexes instead.There is an upgrade process from 1.5.3b (see UPGRADE and upgrade.sql)Significant bug fixesViews with aggregate functions but no GROUP BY columns now work properly for all supported aggregate function typesNULL values in GROUP BY columns are now properly supportedNULL values now work properly with distributive aggregate functionsThere is a wrapper script around run_consumer.php which can restart the consumer if it stops runningAs always, get it at:http://sourceforge.net/projects/Flexviews
-
Getting temporal configuration values into date-range value equivalents
I collect a lot of configuration values from my database servers and most of these values are stored by date.
So often I end up with values such as:
config_date config_value
2010-09-01 value_1
2010-09-02 value_1
2010-09-03 value_2
2010-09-04 value_3
2010-09-05 value_3
2010-09-06 value_3
2010-09-07 value_3
2010-09-08 value_4
2010-09-09 value_4
2010-09-10 value_1
2010-09-11 value_5
2010-09-12 value_5
2010-09-13 value_5
I´ve been unsuccessfully been trying to figure out how to convert this in SQL into something like the following:
config_from config_to config_value
2010-09-01 2010-09-02 value_1
2010-09-03 2010-09-03 value_2
2010-09-04 2010-09-07 value_3
2010-09-08 2010-09-09 value_4
2010-09-10 2010-09-10 value_1
2010-09-11 2010-09-13 value_5
The second format is often much shorter if configuration changes are not that frequent. While this is straight forward to do in a programming language in a single pass once you have the config_date ordered data, I can’t figure out how to do this with SQL and no programming. Celko´s books haven’t enlightened me either.
So do you know how to do this?
|
