Launchpad News for 2006-08-01

Christian Robottom Reis kiko at async.com.br
Thu Aug 3 01:07:40 BST 2006


Here's a report of changes for July. These changes were rolled out
yesterday, August 1st, at revision level 3843. And read on for the real
news!

----------------------------------------------------------------------

Highlights
==========
This month's highlights include Malone's new tagging feature. This
feature allows you to group bugs arbitrarily by using strings of your
choice. It's initially being used to demonstrate Python.org's bug
import -- see it live on https://demo.launchpad.net/products/python or
on production Launchpad itself. Tags are listed in the main bug listing
for a product or distribution, and we'll be enhancing the way they can
be used over the next weeks. Stay tuned!

The bug page also sports a cool new attach-while-commenting feature,
which you can use to include a patch and describe what your fix does in
the same step -- less page loads make everybody happier, and Launchpad,
a more productive environment.

The process for filing security bugs in Malone was slightly modified,
following many reports of people misusing the privacy flag and ending up
with orphaned bugs! The new bug filing form offers only offer one
checkbox, which is used to identify security-related bugs. The security
team gets subscribed to all such bugs, and they (or the bug reporter)
can later go in and decide whether the bug in question merits being kept
private. Private bugs are now marked with a special icon in bug
listings, by the way -- yes, that's what those little padlocks mean.

Malone also includes a neat new feature in the advanced search form: you
can now choose to identify bugs which have been reported in more than
one package or product at once. This can be particularly helpful for
detecting which Ubuntu bugs have been reported upstream, and which ones
still need that step done. And keep in mind we have more improvements
for upstream bug communication coming along..

Wow, that was a lot of Malone news! In other areas: Blueprint, the
specification tracker, now offers a clickable display of dependencies
between specifications. Rosetta had a number of small but important
workflow fixes, and now sports the capability of offering translations
for packages in the Ubuntu "universe" component as soon as we flick the
switch in production. Soyuz, the archive management system is now in its
sixth month of production use, with a number of fixes for corner-cases
being regularly produced and deployed. We are gearing up for more
serious architectural work there to support the new features that we
have in the pipeline. Read onto the detailed summaries to see the
optimizations and bugfixes that landed for the individual components,
which were many!

I should mention that Launchpad can now tell how much Karma you
accumulated while working on specific distributions and upstream
products. This will allow us to produce rankings of participants in
these places, better tracking who is an important contributor in
specific areas -- not just overall. The user-visible changes that use
this machinery should be going live very soon, so expect more on them in
a future update.

Last but not least, a significant highlight for July is the preparation
for deployment of a bzr-native import system. Launchpad initially aimed
at supporting GNU Arch as a version control system; our focus has since
shifted to supporting Bazaar-NG (bzr) instead. The import system is one
of the oldest components of Launchpad, and required pervasive changes to
undergo this transition: for several months, vcs-imports in bzr format
were produced by using the extant system to produce Arch imports, and
then converting them to bzr. The deployment of "bzr-native importd" will
remove that intermediate step: vcs-imports produced directly in bzr
format. That removes the last functional dependency on GNU Arch from the
Launchpad production systems.

If you have any question related to the new features, or have
suggestions on how we can be a better platform for you, don't hesitate
to reply to this email, or pop onto the #launchpad channel on
irc.freenode.net. I'll expect you there.

Enjoy the new Launchpad!

------------------
Detailed Changelog
------------------

Note: In the listings below, Important user-visible features or fixes
are marked with exclamation points; other highlights marked with a star.

Malone (Bugs)
=============
! Malone was pitched as a candidate for the official Python.org bug
  tracker; work was done to import the existing Python bugs, and to
  accommodate for peculiarities in its data. (jamesh, bradb)
! Bugs now have the ability to be associated with tags, which can then
  be used to group and query for them. (spec SimpleBugKeywords, BjornT,
  r=jamesh)
! It is now possible to attach a file while commenting on the bug.
  Additionally, attachment comments are now optional. (bradb, r=jamesh)
* The handling of security and privacy was simplified, clarifying its
  utility and ensuring that bugs are never orphaned. (bug 1294, bradb,
  r=kiko)
* It is now possible to filter bug searches based on whether the bug is
  also reported on other contexts. (bug 37942, BjornT, r=spiv)
* An XMLRPC interface for filings bugs was deployed for testing. (bradb,
  r=jamesh)
* A major optimization was done for bug comments, inverting the way they
  are constructed from the database. (kiko, r=bradb, jamesh)
* Private bugs are now marked with a special icon. (kiko, rs=bradb)
- The bug filing page failed to send mail in certain situations; this is
  now fixed and tested. (bradb, r=kiko)
- The internal APIs for creating bugs now use a parameter object.
  (bradb, r=jamesh)
- Bug references that include line breaks now work correctly. (bug 53977,
  jamesh)
- It is now possible to change a bugtracker's type. (bug 4779,
  matsubara, r=kiko)
- Bug listings now use the correct CSS classes for status and
  importance. (bug 52009, kiko, BjornT)
- Queries for bugs were optimized, simplifying the SQL being used, and
  reducing the number of standard sorting clauses. (kiko, r=stub, bradb)
- CVE reports were optimized by factoring code into a central location.
  (kiko)
- An poor and unspecific error message on the bug page was corrected.
  (bug 41399, bradb, r=jamesh)
- The correct radio button is now selected when the bug filing page
  reloads indicating an invalid package selection. (bradb, r=kiko)
- Wording in the sort options was fixed. (mpt, rs=bradb)
- The form for editing bug statuses no longer duplicates the duplicate
  note at the top of the page. (bug 37331, mpt)
- A broken link to +addattachment was fixed. (bradb)
- Special support was added for bugs on the Landscape product. (bradb,
  r=kiko)
- A crash that occurred when changing a bug on a distribution release
  was fixed. (bug 53476, bradb)
- Minor cleanups were made to Malone's home and about page. (mpt,
  r=spiv)
- The product and distribution details portlets no longer link to the
  page for changing bug contacts when the user cannot actually change
  it. (bug 53979, mpt)
- The CVE updater was fixed to cope with the new URLs published by
  Mitre. (bug 53793, kiko, r=jamesh)

Rosetta (Translations)
======================
! Rosetta now allows translations to be imported from packages in
  universe, opening up the tool to a much wider range of software and
  end-users. (carlos)
* Uploads of translations to a product are now restricted to product
  owners, Launchpad administrators and Rosetta Experts. (carlos,
  r=BjornT)
* Products which change owners no longer are blocked in the translation
  import queue. (bug 28813, matsubara, r=kiko)
* Duplicate POSubmission entries are no longer possible, and the
  existing duplicates in the database were cleaned up. (stub, carlos)
- The distribution release languages page is now batched. (bug 6459,
  carlos, r=jamesh)
- The main translations page for a product now includes adequate
  instructions depending on the role of the user visiting the page. (bug
  37879, mpt, r=BjornT)
- Rosetta correctly handles the Save & Continue button for a translation
  which is 100% complete. (carlos, r=SteveA, spiv)
- A number of fixes were done to POSubmissions. (carlos)

Soyuz (Distribution management)
===============================
* The publisher only performs domination and apt-ftparchive index
  generation for pockets that are actually changed, which is an
  important optimization. (malcc, BjornT)
- Binaries in the NEW state are now displayed in the queue tool's info
  report. (cprov, r=jamesh)
- The archive cruft checker had a number of errors fixed. (cprov,
  r=jamesh)
- It is now possible to query through all the build records. (bug 52704,
  cprov, r=salgado)
- Build listings now properly handle builds that have not yet been
  initialized. (cprov, r=kiko)
- The build listings were modified to use 2-column layout. (bug 49862,
  cprov, r=salgado)
- buildd lockfile conflicts are now kept quiet. (cprov, r=jamesh)
- The script which copies new packages into the archive now uses rsync.
  (malcc, r=BjornT)
- Capitalization was fixed in upload confirmation message. (bug 39335,
  mpt)
- The queue pages permissions were simplified now that the content class
  has proper security verification code. (bug 51885, cprov, r=kiko)
- Two crashes due to invalid arguments in the build and queue listings
  were fixed (bugs 41104, 51959, cprov, r=salgado).
- Additional table constraints were added. (stub)
- The process-upload script no longer ignores the -J option. In some
  situations this caused builds to be identified incorrectly during
  upload. (malcc)
- Queue rejection messages now always go out with a valid To: header,
  even when no valid recipients are found in the upload. (cprov,
  r=BjornT)
- The queue tool's handling of custom uploads was broken and is now
  fixed. (bug 52595, cprov, r=BjornT)
- The manage-chroots tool was improved. (bug 52863, cprov, r=BjornT)
- Binaries related to source packages in distribution releases are now
  correctly restricted to the source package's distribution release.
  (bug 52938, cprov, r=jamesh)
- The tool that changes archive overrides now provides a proper error
  message when an unpublished package is specified. Cleanups in the
  backend code to support this were also implemented. (cprov, r=kiko)
- The publishing code that "carefully" verifies the entire archive was
  fixed to cope with the per-pocket publishing optimization. (bug 54032,
  malcc, r=SteveA)
- Mirror listings had their layout improved. (salgado, r=spiv)
- The mirror prober now handles HTTP redirects correctly. (salgado,
  r=spiv)
- The germinate cron script was improved. (Kamion)
- A broken traversal in the builder page was fixed. (matsubara)

The Bazaar (Code)
=================
! Important progress was made towards converting cscvs to output native
  bzr branches; this will improve performance and reliability of the
  synchronization service, and allows us to use the imports more
  extensively inside Launchpad. (ddaa, r=BjornT, jamesh)
* bzr clients pushing to the Bazaar sftp server now receive more
  descriptive error messages. (bug 33223, spiv, r=jamesh)
- The text on the Bazaar front page was improved. (spiv, mpool,
  rs=lifeless)
- Dyson is now able to connect through HTTP proxies. (jamesh, r=spiv)
- People in the vcs-imports group can now once more modify source code
  parameters for imports. (ddaa, r=BjornT)
- cscvs's Subversion module is now able to import Subversion symbolic
  links. (bug 44410, jamesh, r=salgado, lifeless)
- bzrsync code was moved to the proper location for scripts, and no
  longer includes database imports. (jamesh, r=SteveA)
- The branch scanner now ignores branches that have never been
  successfully mirrored. (jamesh)

Blueprint (Specifications)
==========================
* A number of improvements were made to the specification pages.
  (sabdfl)
* Specification dependencies are now presented graphically. (sabdfl,
  SteveA, r=jamesh)
- A crash that ocurred when a sprint's finish date came before
  its start date was fixed. (bug 45788, matsubara, r=jamesh, stub)
- Renaming specifications no longer crashes. (bug 51826, matsubara)
- The dependency tree of specifications now indicates if a certain
  specification is already implemented. (bug 51115, sabdfl)
- Indicating that a specification is not superseded has a less clunky UI
  now. (bug 4116, stub)
- Traversing to sprints was sanitized. (bug 51960, matsubara)
- A script that imports Zope specification metadata was included.
  (jamesh)

ShipIt
======
* Shipit now consolidates the various columns that tracked the shipment
  into a single status field. (salgado, r=kiko)
- Various tweaks were done to the text to ensure end-users are aware of
  their options while requesting CDs. (salgado, r=kiko)
- DVD offerings had their display improved and updated. (salgado)
- The flavours present in previous requests is now listed when
  displaying a person's requests. (salgado)
- A bug related to counting shipments was fixed in the country-based
  report. (salgado)
- Reports now prepend values with equal signs to ensure correct
  interpretation, and normalize whitespace. (bug 53435, salgado, stub)
- The virtual hosting setup for ShipIt was corrected. (bug 51840, stub)
- The page for setting up standard options was fixed to cope with
  virtualhosting. (salgado)
- The user request constraint and database fields related to it were
  slightly refactored. (bug 5812, stub, r=salgado)

Launchpad
=========
! Karma is now tracked by product and distribution: this allows
  capturing which people are most active in which parts of Launchpad.
  (spec KarmaContext, salgado, r=spiv)
* A regression in the display of Ubuntero status was fixed. (bug 48995,
  matsubara, r=kiko)
* The URL-recognition code was extended to support most of the
  valid characters in the specification. (bug 41410, kiko)
* Product owners are now able to transfer ownership of products to
  others. (bug 41639, matsubara, r=kiko)
- Links to the bounty feature were hidden until it is completely
  implemented. (sabdfl)
- Polls with finish dates before their start dates no longer crash. (bug
  2732, matsubara, r=BjornT)
- Poll names are now properly checked for uniqueness. (bug 2908,
  matsubara, r=BjornT)
- The user's preferred charsets are now always encoded in UTF-8, fixing
  rare crashes that occurred when they weren't. (bug 40494, BjornT,
  r=lifeless)
- A bug related to the handling of time in adding and editing calendar
  events were fixed. (matsubara, r=kiko)
- A number of XHTML validity fixes were implemented. (mpt, rs=spiv)
- Launchpad no longer categorically recommends generating a new GPG key
  to end-users. (bug 30277, mpt)
- The HTML for person icons is now valid. (bug 37453, mpt)
- References to wiki.launchpad.canonical.com were removed from the
  codebase; they were replaced to links to the new wikis. (bug 50693,
  mpt, r=kiko)
- A rare display bug that affected portlets being rendered in Internet
  Explorer was fixed. (bug 49471, mpt)
- Instructions for registering a product were included in the home page.
  (bug 42624, mpt)

Infrastructure
==============
! The Launchpad code repositories were moved to a new server
  which is dedicated to the team. (stub, spiv, lifeless, SteveA)
- The session code now uses stored procedures, which should improve its
  performance under concurrency, and avoiding spurious error messages in
  the database log. (bug 46149, stub)
- More bugs in the full-text query builder were fixed. (bug 52564, stub)
- A new Makefile target was added that avoids running some of the
  sourcecode tests when checking in Launchpad-specific code. (spec
  StopSpuriousTestFailures, kiko, r=stub)
- SQLObject's SelectResults has a corrected __contains__ hook. (spiv,
  r=lifeless)
- The batching code copes with multiple size and batch arguments
  supplied in the URL. (kiko)
- Production servers now handle requests without a Host: header
  correctly. (bug 51801, stub)
- A new database baseline was generated. (stub)
- Faults now work properly over XMLRPC. (bug 52033, SteveA, r=BjornT)
- Some additional statistics related to bug, translation and product
  counts were captured for graphing. (stub)
- Database documentation and diagrams were regenerated. (stub)
- InitZopeless' isolation parameter now works once more. (bug 32073,
  stub)
- Dilys, the IRC bot, is no longer hardcoded. (matsubara)
- The dbschema.txt doctest was renamed to be more appropriate. (bug
  1188, mpt)

Upcoming Changes
================
- Deployment of native bzr imports
- Distribution release bug management
- Form layout improvements
- Searching through the answer (formerly support) tracker
- Soyuz upload processing simplifications
- Incremental archive publishing
- Soyuz archive schema refactoring
- Product and distribution-specific karma listings
- Edgy translations

----------------------------------------------------------------------

Thanks,
-- 
Christian Robottom Reis | http://async.com.br/~kiko/ | [+55 16] 3376 0125



More information about the launchpad-users mailing list