Monthly Archives: June 2010

Yet again: NGS replication restarted

Sadly, the last round of NGS testing caused some problems. I’ve fixed those problems and restarted the replication feed again. Follow these instructions to get your replication started again:

  • Download and install the mb_server source code from git. Follow these instructions. (Make sure you update this code from the code you may have pulled yesterday)
  • Set your server type in DBDefs.pm to RT_SLAVE
  • Download and import this dataset. This is the same dataset has in the last NGS test!
  • Insert this required row into the database, using our psql program:
    cd <mb_server_src>/admin
    ./psql READWRITE
    insert into replication_control values (1, 12, 100, now());
    
  • Now run admin/replication/LoadReplicationChanges a few minutes after the hour to keep up to date with the data on the test server. Please note that this system may not be stable yet and that we will occasionally load new data on our test server, which will require you to reload the data on your server.

Good luck!

Once more: Testing the NGS live data feed

Now that we’re (hopefully) done making schema changes to NGS, its time to give the replication testing another try. If you’re interested in testing replication for NGS, follow these instructions:

  • Download and install the mb_server source code from git. Follow these instructions.
  • Set your server type in DBDefs.pm to RT_SLAVE
  • Download and import this dataset.
  • Insert this required row into the database, using our psql program:
    cd <mb_server_src>/admin
    ./psql READWRITE
    insert into replication_control values (1, 12, 0, '2010-06-15 17:00:02.795317-07');
    
  • Now run admin/replication/LoadReplicationChanges a few minutes after the hour to keep up to date with the data on the test server. Please note that this system may not be stable yet and that we will occaisionally load new data on our test server, which will require you to reload the data on your server.

Good luck!

Announcing NGS Beta 2!

I’m pleased to announce that we’ve finished hacking on NGS Beta 2! The test server is updated with the beta 2 source code and a fresh data dump (20100616 complete with 119,000 old edits migrated).

To play with NGS Beta 2, head over to the test server and log in with your normal MusicBrainz username/password. If you find any probems, please enter a bug report in our bug tracker. To see the complete list of issues that have been resolved for Beta 2, see this rather long list.

Oliver says:

Here’s a brief summary of my changes:

  • Edit migration – old historic edits are now migrated, along with votes. Edit notes are not yet migrated, though work has begun in this area
  • Many bug fixes from beta 1, including improved error handling
  • A few more possible edits, including removing PUIDs and adding/deleting ISRCs from recordings
  • Case change edits are now auto-edits
  • Aliases now have a ‘locale’ field
  • Annotations can be previewed before submit

It’s hard to summarize the apparent 160 issues in JIRA though, but these stand out at least.

Warp says:

  • Completely new release editor, not quite finished but it should give you a good feel of how the final version will work.
  • Some big changes to /ws/2, see the new specification.
  • Non-latin names are now properly sorted.
  • Green tagger icons
  • Ratings can be cleared.
  • Lots of data display fixes and tweaks.
  • Both Oliver and Warp have been working hard to meet this deadline, and I’m pleased that they’ve completed this important milestone! Many thanks to Oliver, Warp, Nikki, Navap, Ijabz, Murdos and anyone else who had a hand in working on beta 2. I would also like to thank Alisa Lemberg specifically for her efforts in helping Warp, Navap and myself redesign the release editor. Alisa’s UX experience helped us focus our efforts and finally deliver a solid release editor. Without her we’d still be guessing the right approach to take for creating a usable release editor.

    Happy Testing!

    Oliver Charles joins MusicBrainz full time

    I’m pleased to announce that Oliver Charles (acid2) has agreed to hack on MusicBrainz full time. Aside from some vacation time in July, Oliver will be working full time starting now.

    Along with the grant engineer from the Queen Mary Linked Data grant we will have four full time people working on MusicBrainz. We’ve never had this many people dedicated to moving along the server development. I’m hoping the times of extreme resource shortages will be over, allowing us to hopefully target a much faster release cycle for the server once we releases NGS.

    Welcome on board Oliver!

    Queen Mary University receives grant to implement new RDF web service for MusicBrainz

    The School of Electronic Engineering and Computer Science at Queen Mary University in London just received a grant to implement a new RDF based web service and a SPARQL endpoint for this web service.

    The grant will be administered by Queen Mary University and will mean that one developer will be paid for one year to work on this project. This developer will be part of the MusicBrainz development team and will take part in our usual activities, meetings and code review process.

    While we have an RDF based web service already, its worth noting that this has been stale for many years and has not been developed in favor of our XML web service. The XML web service has seen an amazing adoption and it would seem that having another web service would be superfluous. They key here is that the Linked Data world (formerly the semantic web) predominantly uses RDF as its preferred means of linking data. In order for MusicBrainz to continue to be well linked to the Linked Data world, it is important for us to continue to support an RDF web service. This grant very cleanly supports this goal and it also shows that the academic world thinks that MusicBrainz is of value and that it should be supported.

    Congratulations to the Queen Mary University team that worked on this application! For nearly all of the gory details (the detailed budget figures have been stripped from the application for privacy sake) please see the PDF grant application.

    I will be working with the hired developer to write up a detailed wiki page that will explain this project in much more detail. In the meantime if you have any questions, please read the grant application.

    Congratulations to the whole team at Queen Mary University London!

    More network maintenance over the weekend

    Our hosting provider says:

    Date: Saturday, 6/05/2010, 11:59 PM Pacific Time to Sunday, 6/06/2010, 01:30 AM Pacific Time

    Digital West will be performing necessary maintenance to our switch farm. This may result in brief losses (10 seconds to 4 minutes) of Internet connectivity between the times listed above, depending on the nature of the service you subscribe to at Digital West. If you are multi-homed, the disruption will be minimal. If you are single-homed, you may notice longer delays.