MusicBrainz Blog

We’ve been seeing a number of issues with the upgrade scripts for this release reported here on the blog, in IRC, as well as the ticket tracker. We’ve got a couple bits of news for those upgrading from codebases older than mid-August and those using versions of PostgreSQL older than 9.0:

1. MBS-5473: This is the ERROR: function controlled_for_whitespace(character varying) does not exist migration problem. Slaves with imports done before mid-August are missing a few stored procedures that are necessary for the upgrade. This has been fixed in the master branch as of commit 082e608c074641e2e8df2c0809d35421b02c7899 — to run the upgrade, run git fetch origin, then git checkout 082e608c074641e2e8df2c0809d35421b02c7899, then continue with step #6 of the original instructions. If you already started the upgrade but failed on the ‘merge-duplicate-credits’ script (as is likely, with this bug), don’t worry: at that point in the upgrade, restarting is not an issue.
2. MBS-5475: This is the ERROR: syntax error at or near “ORDER” migration problem. Unfortunately, this one’s more serious: on PostgreSQL 8.4, our upgrade scripts don’t work, as one uses a feature introduced in 9.0 (as previously mentioned) After some hours of investigation, it appears that this issue can’t be resolved reasonably; therefore, for 8.4 users the upgrade path is a data re-import using a recent (post-schema-change) codebase and a data dump from October 17th or later. We’d also recommend updating to PostgreSQL 9.x at the same time if that is possible.

Sorry again for the inconvenience.

If you have a replicated instance of MusicBrainz, please follow these instructions to get your server running on the new schema:

1. Take down the web server running MusicBrainz, if you’re running a web server.
2. Turn off cron jobs if you are automatically updating the database via cron jobs.
3. Make sure your REPLICATION_TYPE setting is RT_SLAVE
4. Switch to the new code with git fetch origin followed by git checkout v-2012-10-15-schema-change
5. Run carton install --deployment to install any new perl modules.
6. Run carton exec -- ./upgrade.sh from the top of the source directory.
7. Set DB_SCHEMA_SEQUENCE to 16 in lib/DBDefs.pm
8. Turn cron jobs back on, if needed.
9. Restart the MusicBrainz web server, if needed.

This upgrade requires quite a bit of disk-space to execute; your slave may run into trouble if there is less than 10Gb of disk space free. If you’re on a disk space constrained machine, you may want to consider re-importing the data rather than upgrading in place. The next data dump should be available in about 14-16 hours from now.

On Monday 15 October 2012 at 18:00 UTC MusicBrainz will be unavailable for about 30-45 minutes while we release the latest and greatest schema on our main servers.

Sorry for inconvenience that this may cause you.

As we mentioned yesterday, the wiki was read-only for a period today as we performed some much-needed upgrades. The new wiki is now live on http://wiki.musicbrainz.org and testing is encouraged to make sure we didn’t miss anything! It isn’t available as of this writing because a DNS change is required, but the old wiki will remain available at http://oldwiki.musicbrainz.org for some period of time, in a read-only state.

The new wiki has a few changes:

1. You’ll see that the style has changed; instead of maintaining our own complete MediaWiki skin, we’re now just doing some modifications on top of the provided monobook skin.
2. Login is now required to edit pages, partly as a spam-mitigation measure and partly because people were often editing without logging in, which made it hard to track down who exactly changed a page.
3. The MediaWiki API should now be accessible, from http://wiki.musicbrainz.org/api.php.
4. Finally, A few extensions have shuffled around and been updated as well; the full details are available on http://wiki.musicbrainz.org/Special:Version.

If you find mistakes in our setup, please contact me: ‘ianmcorvidae’ on the MusicBrainz site and on IRC, and @musicbrainz.org via email; or, file a ticket on http://tickets.musicbrainz.org (under MusicBrainz Hosting, assign to “Ian McEwen”).

Our wiki’s been needing an upgrade for some time, and we’re ready to make the switchover. However, as you may imagine, upgrading from MediaWiki 1.11.2 to 1.19.2 isn’t a trifling matter (though kudos to the MediaWiki team for it even being possible in one step!), so we’ll need a few hours to run upgrade scripts and migrate servers (though we’ve worked to make it as quick as possible). The wiki will be available during this time, but will be read-only until the switchover is complete.

The read-only window for the upgrade will start at 15:30 PDT/MST, or 22:30 UTC. The wiki will be back, shiny and new, sometime 1.5-3 hours later, presuming everything goes according to plan.

Thanks for your understanding, and hopefully you’ll agree the new wiki is much improved!

ocharles has just finished work on MBS-2547 which will result in empty labels and empty release groups also being deleted as part of our daily clean up jobs, just like empty artists are currently deleted. As we’ve never cleaned up empty labels or release groups in the past, there is quite a bit of data that will be deleted in the first run. Before we run this, we would like to share it with the community in case any of this data is important.

The cleanup algorithm is mostly the same as it is for artists. Labels and release groups will only be deleted if:

• They have existed for more than 24 hours
• They have no open edits, or open edits that show up in their edit history
• They have no relationships
• They have no releases

Here are the lists of labels and release groups that would be removed, if we were to run the script right now:

• Labels for deletion
• Release groups for deletion

If you do not want a label or release group to be deleted, please add relationships, as you would with artists or works.

We’ve just finished pushing an update to our web servers. This is our first release since the schema change, and we’ve tried to address the problem of artist landing pages. As a temporary solution, we’ve split the page up by type a bit more now, which we hope is a step in the right direction. We’re currently discussing this at User:Reosarevok/Overview Options on the wiki, and your feedback is important. If you feel strongly about this, please have a read at the ideas on that page and feel free to comment/add your own.

This release features work from Ian McEwen, nikki, Joachim LeBlanc, Nicolás Tamargo and the rest of the MusicBrainz team. Thanks everyone for your hard work!

Bug

• [MBS-1121] – Disabled submit buttons have no distinctive style
• [MBS-3861] – IMDb links not fully normalized
• [MBS-4278] – Copy changes to recordings edits the wrong recordings if recording associations were changed
• [MBS-4336] – Release editor > removing a track resets manually changed track positions
• [MBS-4520] – Deleting tracks does not update track numbers
• [MBS-4569] – Full page titles aren’t shown in /doc
• [MBS-4621] – Don’t use empty <img> tags on pages with no images
• [MBS-4649] – YouTube channel autoselect is broken
• [MBS-4656] – “Video” option for “can be streamed for free at” relationship is listed under the “License” subheading.
• [MBS-4662] – ISE: Can’t edit a relationship attribute
• [MBS-4664] – Use of uninitialized value in sprintf at lib/DBDefs.pm line 314.
• [MBS-4681] – Edit maked as Applied, but it isn’t
• [MBS-4687] – Link to create new relationship types doesn’t work
• [MBS-4697] – Approve votes missing from edit search
• [MBS-4720] – Audiobook is a primary release-group type
• [MBS-4733] – Merging release groups fails if release groups have secondary types
• [MBS-4752] – Musicbrainz webservice <iswc-list> changes break compatibility with existing applications.
• [MBS-4757] – Edit artist alias (sort name) is auto-edit
• [MBS-4760] – Release groups with secondary types cannot be deleted
• [MBS-4765] – DB_SCHEMA_SEQUENCE hasn’t been updated to 15 in DBDefs.pm.default
• [MBS-4767] – Cannot accept edit release group edits that change the primary type to a type that no longer exists
• [MBS-4769] – Bad description row in statistic_event
• [MBS-4770] – ISE: Error when requesting non-existent relationship types on /relationships
• [MBS-4772] – ModBot cannot apply old edit work edits that add ISWCs

Improvement

• [MBS-684] – TOC lookup displays too little release info
• [MBS-1874] – Search for the documentation
• [MBS-3748] – Adding new instruments is a pain
• [MBS-4298] – Confusing text when merging releases+recordings
• [MBS-4561] – Make disambiguation on tracklist credits smaller
• [MBS-4568] – Add <bdi> tags to help with rendering of RTL text
• [MBS-4657] – Add cover art to timeline
• [MBS-4700] – Fix inline buttons
• [MBS-4742] – Add a mention to the “Split Into Separate Artists” page that aliases prevent a split (or automatic removal)
• [MBS-4762] – Cover art statistics should be displayed on the tabular pages.

Task

• [MBS-4686] – Add wikisource.org to the lyrics whitelist

In other news, Oliver will be on holiday for one week (yipee!), and will be back in a week. Reachable via email if need be.

The commit sha for this release is 8fbbc36, a Git tag will follow when Rob is back tomorrow. and the git tag is v-2012-05-28

Sorry for being a week behind on this release, but we’ve just finished pushing out another set of changes. Many thanks to Lukáš Lalinský, Paul Taylor and the rest of the MusicBrainz team for making this release happen! Here’s what we’ve just released:

Bug

• [MBS-3619] – Statistics page doesn’t validate
• [MBS-3794] – A "no votes" edits got wrong status "failed vote"
• [MBS-3834] – Hovering over artist names in "edit medium" tracklist changes does not show the artist sort name
• [MBS-4082] – Titles including quote marks are truncated when adding from a CD Stub
• [MBS-4131] – Edits show credited-as name when it’s the same as the artist name
• [MBS-4183] – Release editor: enters new artist if no radio button selected on ‘add missing entities’ tab
• [MBS-4314] – Add interface elements to reorder tracks on a tracklist without having to edit the tracknumbers.
• [MBS-4367] – Current search URLs are broken on the test server
• [MBS-4418] – beta.mb is unresponsive
• [MBS-4467] – ws/2/label doesn’t include label comment
• [MBS-4484] – Limited user can vote on edits
• [MBS-4500] – ISE: ‘Can’t call method "is_auto_editor"’ when attaching a TOC
• [MBS-4504] – Set default unknown value for medium.format_name

Improvement

• [MBS-684] – TOC lookup displays too little release info
• [MBS-834] – Weird behaviour of the search checkboxes
• [MBS-1728] – Make ModBot’s edit notes grey again
• [MBS-1764] – Inconsistent display for merge edits
• [MBS-2242] – Disable editing of Medium title when there’s only one medium
• [MBS-2412] – User tags should be sorted
• [MBS-2867] – RE: "Add n track(s)" should reset to 1
• [MBS-3171] – Overview and Recording pages need to be able to exclude featured guest spots from display
• [MBS-3208] – Trim leading/trailing whitespace in release editor prior to Add Missing Entities check
• [MBS-3398] – Detect "M" in front of track numbers
• [MBS-3482] – "YouTube Relatiionship Type" needs autofix and doc
• [MBS-3628] – Prevent people from adding broken Facebook URLs
• [MBS-4234] – Move Basic search logic from mbserver to searchserver
• [MBS-4390] – Display disambiguation comments better in tooltips
• [MBS-4490] – "CD N" in Add disc from existing tracklist is confusing
• [MBS-4523] – Statistics: Use commas and right-align numbers
• [MBS-4535] – Make visited links more prominent

New Feature

• [MBS-3160] – Add view to artist pages that shows release groups/recordings/etc credited to that artist only (solo releases only – exclude collaborations, feat., etc)
• [MBS-3266] – Allow filtering by artist credit

The Git tag for this release is v-2012-04-10-ngs-bug-fixes.