/[collab-qa]/udd/udd
ViewVC logotype

Log of /udd/udd

View Directory Listing Directory Listing


Sticky Revision:
(Current path doesn't exist after revision 2466)

Revision 1901 - Directory Listing
Modified Wed Jan 26 19:30:58 2011 UTC (2 years, 3 months ago) by lucas
use launchpad.net, not edge.launchpad.net

Revision 1900 - Directory Listing
Modified Wed Jan 26 19:30:14 2011 UTC (2 years, 3 months ago) by lucas
also ignore Modaliases: in packages files

Revision 1896 - Directory Listing
Modified Sat Jan 22 23:34:47 2011 UTC (2 years, 4 months ago) by tille
Try harder to parse a reasonable e-mail address which works also for names with comma (',') inside as well as if the e-mail addres is included in '()' instead of '<>'

Revision 1850 - Directory Listing
Modified Mon Dec 6 23:45:30 2010 UTC (2 years, 5 months ago) by lucas
deferred_gatherer: not all entries have a Closes field

Revision 1836 - Directory Listing
Modified Mon Nov 1 10:21:22 2010 UTC (2 years, 6 months ago) by lucas
s/bug/id/ in deferred_closes

Revision 1834 - Directory Listing
Modified Mon Nov 1 10:02:47 2010 UTC (2 years, 6 months ago) by lucas
deferred gatherer

Revision 1829 - Directory Listing
Modified Sat Oct 30 09:43:39 2010 UTC (2 years, 6 months ago) by lucas
import archives without sources or without binaries

Revision 1828 - Directory Listing
Modified Sat Oct 30 09:42:14 2010 UTC (2 years, 6 months ago) by lucas
ignore Python3-Version

Revision 1825 - Directory Listing
Modified Fri Oct 15 07:43:34 2010 UTC (2 years, 7 months ago) by tille
Make sure json code will work as well if simplejson is not installed (as for instance on udd.debian.org)

Revision 1824 - Directory Listing
Modified Fri Oct 15 07:35:47 2010 UTC (2 years, 7 months ago) by tille
Handle descriptions containing i18n characters properly

Revision 1823 - Directory Listing
Modified Fri Oct 15 07:29:12 2010 UTC (2 years, 7 months ago) by tille
Make sure screenshots gatherer will also work with JSON implementations available in Squeeze

Revision 1813 - Directory Listing
Modified Sat Sep 25 14:05:29 2010 UTC (2 years, 8 months ago) by lucas
number of days for age-days

Revision 1809 - Directory Listing
Modified Sat Sep 25 10:39:27 2010 UTC (2 years, 8 months ago) by lucas
hints: do shallow copy of dict

Revision 1808 - Directory Listing
Modified Sat Sep 25 10:25:27 2010 UTC (2 years, 8 months ago) by lucas
added hints gatherer

Revision 1801 - Directory Listing
Modified Thu Sep 23 09:55:10 2010 UTC (2 years, 8 months ago) by themill-guest
* add config option to allow full history import rather than just last 2 months

Revision 1798 - Directory Listing
Modified Fri Sep 17 20:15:45 2010 UTC (2 years, 8 months ago) by lucas
handle wrong input safely

Revision 1797 - Directory Listing
Modified Fri Sep 17 20:14:41 2010 UTC (2 years, 8 months ago) by lucas
ignore python3-version

Revision 1783 - Directory Listing
Modified Mon Sep 13 09:14:01 2010 UTC (2 years, 8 months ago) by lucas
upload history fixes

Revision 1781 - Directory Listing
Modified Mon Sep 13 07:18:00 2010 UTC (2 years, 8 months ago) by tille
catch error in formating (Description-da: : Islamic hijri date and prayer time utilities) contains two ':' which confuses deb822 parsing routine.

Revision 1779 - Directory Listing
Modified Thu Aug 26 08:58:08 2010 UTC (2 years, 8 months ago) by tille
Less debug lines to enable better reading of debug output, handle problem if description is missing

Revision 1778 - Directory Listing
Modified Wed Aug 18 14:19:54 2010 UTC (2 years, 9 months ago) by plessy
Corrected the unicode handling.

Revision 1777 - Directory Listing
Modified Tue Aug 17 23:52:49 2010 UTC (2 years, 9 months ago) by plessy
Syntactic corrections to the bibref gatherer, and SQL table creation script.

Revision 1776 - Directory Listing
Modified Mon Aug 16 20:26:53 2010 UTC (2 years, 9 months ago) by tille
Try to reduce warning noise in case there is more than one description found

Revision 1774 - Directory Listing
Modified Tue Aug 10 13:13:07 2010 UTC (2 years, 9 months ago) by tille
Try to avoid reading logger configuration file

Revision 1770 - Directory Listing
Modified Thu Aug 5 15:50:35 2010 UTC (2 years, 9 months ago) by lucas
upload-history partial rewrite

Revision 1765 - Directory Listing
Modified Mon Aug 2 18:38:12 2010 UTC (2 years, 9 months ago) by lucas
understand DMs in carnivore (thanks raphael)

Revision 1764 - Directory Listing
Modified Mon Aug 2 18:15:59 2010 UTC (2 years, 9 months ago) by lucas
various udd changes

Revision 1756 - Directory Listing
Modified Thu Jul 8 08:38:52 2010 UTC (2 years, 10 months ago) by tille
Make sure a fallback for less information will not be broken ba hyving no information at all, some encoding issues which only seem to occure on my laptop, not at the server

Revision 1755 - Directory Listing
Modified Thu Jul 1 07:38:50 2010 UTC (2 years, 10 months ago) by tille
Fix encoding problem when printing warning messages

Revision 1754 - Directory Listing
Modified Tue Jun 29 14:02:41 2010 UTC (2 years, 10 months ago) by tille
Logging for ddtp gatherer, make sure utf-8 is used also in case unicode was provided in aux.py, clean rollback in case ddtp gatherer runs into a problematic insert; Many thanks to Jan Dittberner for tha patch

Revision 1752 - Directory Listing
Modified Thu Jun 24 06:49:34 2010 UTC (2 years, 11 months ago) by tille
Work around a problem in some languages and make sure at least those languages were imported, where the problem does not exist.

Revision 1733 - Directory Listing
Modified Sat Apr 10 01:38:35 2010 UTC (3 years, 1 month ago) by plessy
Bibliographic reference gatherer, untested and still in development.

Somewhat discussed in the following thread and others:
http://lists.debian.org/msgid-search/20100206130204.GA27756@kunpuu.plessy.org

Revision 1723 - Directory Listing
Modified Sun Mar 14 19:46:59 2010 UTC (3 years, 2 months ago) by tille
Fix parsing problem in ftpnew, make i18n-apps usable

Revision 1715 - Directory Listing
Modified Wed Mar 10 07:28:17 2010 UTC (3 years, 2 months ago) by tille
Better text for warnings about not ITPed bugs

Revision 1712 - Directory Listing
Modified Sat Mar 6 21:01:44 2010 UTC (3 years, 2 months ago) by tille
Typo

Revision 1710 - Directory Listing
Modified Wed Mar 3 16:15:56 2010 UTC (3 years, 2 months ago) by lucas
also remove ANALYZE for pts_public

Revision 1709 - Directory Listing
Modified Wed Mar 3 08:49:22 2010 UTC (3 years, 2 months ago) by lucas
Attempt to solve the privacy problems with PTS subscribers data

- drop the pts_public table completely. PTS subscribers data isn't available
  from non-DDs anymore. Using the guestdd account is required to access it.
- change the CGI to use the guestdd account. The rest of the functionality of
  the CGI isn't changed.

Consequences:
The pts_public table (which contained the (package, md5(email)) list) doesn't
exist anymore. Only the pts table (which contains the non-hashed version
remains, but this table is only accessible using the guestdd account, whose
password is only available to DDs.
The CGI still exists, and still provide the same information. I still believe
that the information it provides is reasonable (see
http://lists.debian.org/debian-project/2010/03/msg00011.html).
It is harder to use that data from !samosa.debian.org, but we can probably
live with it.

Revision 1706 - Directory Listing
Modified Mon Mar 1 12:07:16 2010 UTC (3 years, 2 months ago) by lucas
the w-b DB now stores dates as dates

Revision 1704 - Directory Listing
Modified Sun Feb 28 16:46:25 2010 UTC (3 years, 2 months ago) by lucas
PTS subscribers gatherer

Revision 1703 - Directory Listing
Modified Sun Feb 28 16:45:36 2010 UTC (3 years, 2 months ago) by lucas
optimize the sources and packages gatherer

Revision 1701 - Directory Listing
Modified Thu Feb 25 20:23:41 2010 UTC (3 years, 2 months ago) by tille
Try to work without unneeded warnings to get rid of daily mails

Revision 1698 - Directory Listing
Modified Thu Feb 25 08:56:08 2010 UTC (3 years, 2 months ago) by tille
Injecting information about translated applications in Debian created by the I18N team into UDD.  Please do not use this code for the moment.  While it does some useful stuff it needs further discussion with I18N people.

Revision 1697 - Directory Listing
Modified Wed Feb 24 22:18:15 2010 UTC (3 years, 2 months ago) by tille
Better handling of double entries

Revision 1696 - Directory Listing
Modified Wed Feb 24 09:01:23 2010 UTC (3 years, 3 months ago) by lucas
fix parsing of long lines. patch from Stuart Prescott

Revision 1694 - Directory Listing
Modified Sun Feb 21 11:09:22 2010 UTC (3 years, 3 months ago) by lucas
import bugs_blocks/blockedby info

Revision 1691 - Directory Listing
Modified Sun Feb 21 10:22:16 2010 UTC (3 years, 3 months ago) by lucas
import debian-installer

Revision 1673 - Directory Listing
Modified Sat Jan 23 08:41:41 2010 UTC (3 years, 4 months ago) by tille
At least this does not fail to import data, further checks needed to inspect the warnings about missing data

Revision 1672 - Directory Listing
Modified Thu Jan 21 02:47:36 2010 UTC (3 years, 4 months ago) by lucas
add derivatives table, import sidux

Revision 1661 - Directory Listing
Modified Thu Jan 7 16:23:18 2010 UTC (3 years, 4 months ago) by lucas
release is gone, really

Revision 1644 - Directory Listing
Modified Mon Dec 21 17:59:40 2009 UTC (3 years, 5 months ago) by lucas
increase number of threads when fetching LP bugs

Revision 1642 - Directory Listing
Modified Wed Dec 16 20:21:58 2009 UTC (3 years, 5 months ago) by tille
Update ddtp data only in case of changes in the language translations.  This saves a lot of time for the importer

Revision 1637 - Directory Listing
Modified Wed Dec 9 20:26:14 2009 UTC (3 years, 5 months ago) by lucas
store historical data about sources into history.sources_count

Revision 1628 - Directory Listing
Modified Sat Nov 14 08:18:33 2009 UTC (3 years, 6 months ago) by lucas
add removals gatherer

Revision 1626 - Directory Listing
Modified Sat Nov 14 07:53:31 2009 UTC (3 years, 6 months ago) by lucas
use edge.lp.net to try to avoid slowness problem in launchpad

Revision 1623 - Directory Listing
Modified Sat Nov 14 07:50:45 2009 UTC (3 years, 6 months ago) by lucas
release is now text

Revision 1615 - Directory Listing
Modified Tue Nov 3 06:18:26 2009 UTC (3 years, 6 months ago) by lucas
fix problem when importing several packages sources in the same run, and packages have the same name+version in different sources

Revision 1604 - Directory Listing
Modified Mon Oct 19 20:34:05 2009 UTC (3 years, 7 months ago) by lucas
[w-b] when parsing dates in english fails, try german, french and finnish.

Revision 1603 - Directory Listing
Modified Mon Oct 19 20:03:16 2009 UTC (3 years, 7 months ago) by lucas
add an importer for wanna-build data

Revision 1599 - Directory Listing
Modified Wed Oct 7 20:47:31 2009 UTC (3 years, 7 months ago) by lucas
turn DM-upload-allowed into boolean

Revision 1596 - Directory Listing
Modified Wed Oct 7 19:41:33 2009 UTC (3 years, 7 months ago) by lucas
tons of minor UDD stuff

Revision 1588 - Directory Listing
Modified Thu Sep 24 08:52:59 2009 UTC (3 years, 8 months ago) by lucas
also deal with src:foo in bugs_packages table

Revision 1587 - Directory Listing
Modified Thu Sep 24 06:17:47 2009 UTC (3 years, 8 months ago) by tille
Make sure wnpp_title becomes any value

Revision 1570 - Directory Listing
Modified Sat Sep 5 12:53:33 2009 UTC (3 years, 8 months ago) by lucas
ignore some packages from upload-history

Revision 1569 - Directory Listing
Modified Sat Sep 5 12:51:26 2009 UTC (3 years, 8 months ago) by lucas
small fix to output of popcon

Revision 1568 - Directory Listing
Modified Sat Sep 5 12:50:09 2009 UTC (3 years, 8 months ago) by lucas
ignore Maintainer-Homepage and Tads{2,3}-Version

Revision 1562 - Directory Listing
Modified Fri Aug 21 06:27:47 2009 UTC (3 years, 9 months ago) by tille
Better error message

Revision 1561 - Directory Listing
Modified Fri Aug 21 06:22:23 2009 UTC (3 years, 9 months ago) by tille
Do not crash if deb822 stumbles upon unknown keys

Revision 1560 - Directory Listing
Modified Sun Aug 16 12:46:51 2009 UTC (3 years, 9 months ago) by tille
More robust in case of missing information in new queue

Revision 1559 - Directory Listing
Modified Fri Aug 14 13:26:41 2009 UTC (3 years, 9 months ago) by tille
Do not report false positives of not ITPed packages

Revision 1558 - Directory Listing
Modified Fri Aug 14 13:15:37 2009 UTC (3 years, 9 months ago) by tille
Do not issue warnings we can not do much about

Revision 1557 - Directory Listing
Modified Fri Aug 14 12:59:36 2009 UTC (3 years, 9 months ago) by tille
Make ftpnew gatherer even less verbose

Revision 1556 - Directory Listing
Modified Fri Aug 14 12:31:28 2009 UTC (3 years, 9 months ago) by tille
Make ftp_new less verbose

Revision 1555 - Directory Listing
Modified Mon Aug 10 12:17:52 2009 UTC (3 years, 9 months ago) by tille
Work around a problem when new queue is lacking information about binary packages and only changes file exists as it is currently the case with makefs.

Revision 1548 - Directory Listing
Modified Thu Jul 30 00:16:18 2009 UTC (3 years, 9 months ago) by lucas
minor fixes to gatherers

Revision 1547 - Directory Listing
Modified Thu Jul 30 00:15:28 2009 UTC (3 years, 9 months ago) by lucas
minor fixes to ldap and dehs gatherer

Revision 1541 - Directory Listing
Modified Fri Jul 24 17:51:07 2009 UTC (3 years, 10 months ago) by lucas
LDAP importer. allows to get activity-from and activity-gpg, amongst others

Revision 1540 - Directory Listing
Modified Fri Jul 24 17:49:32 2009 UTC (3 years, 10 months ago) by lucas
handle bugs without submitter

Revision 1539 - Directory Listing
Modified Fri Jul 24 14:40:23 2009 UTC (3 years, 10 months ago) by lucas
split emails in the bugs and archived_bugs table. based on a patch by Olivier Berger.

Revision 1538 - Directory Listing
Modified Fri Jul 24 12:05:21 2009 UTC (3 years, 10 months ago) by lucas
DEHS gatherer

Revision 1537 - Directory Listing
Modified Fri Jul 24 12:04:21 2009 UTC (3 years, 10 months ago) by lucas
use several executemany()

Revision 1536 - Directory Listing
Modified Fri Jul 24 11:00:34 2009 UTC (3 years, 10 months ago) by lucas
use lists instead of tuples (thanks zack)

Revision 1535 - Directory Listing
Modified Fri Jul 24 10:59:45 2009 UTC (3 years, 10 months ago) by lucas
use executemany()

Revision 1534 - Directory Listing
Modified Fri Jul 24 10:33:27 2009 UTC (3 years, 10 months ago) by lucas
add information column in lintian table

Revision 1532 - Directory Listing
Modified Fri Jul 24 10:30:54 2009 UTC (3 years, 10 months ago) by lucas
analyze before commit in bugs

Revision 1531 - Directory Listing
Modified Thu Jul 23 14:05:39 2009 UTC (3 years, 10 months ago) by lucas
add ANALYZE at the end of all importers to teach pgsql some stats about the data we just imported

Revision 1529 - Directory Listing
Modified Thu Jul 23 00:28:12 2009 UTC (3 years, 10 months ago) by lucas
add _email and _name columns in sources, packages and upload_history. use executemany() in upload-history.

Revision 1525 - Directory Listing
Modified Fri Jul 17 02:59:27 2009 UTC (3 years, 10 months ago) by lucas
optimize import using executemany()

Revision 1524 - Directory Listing
Modified Fri Jul 17 02:58:42 2009 UTC (3 years, 10 months ago) by lucas
cast release properly

Revision 1514 - Directory Listing
Modified Mon Jul 13 21:28:53 2009 UTC (3 years, 10 months ago) by lucas
better error handling

Revision 1513 - Directory Listing
Modified Mon Jul 13 21:28:03 2009 UTC (3 years, 10 months ago) by lucas
use DELETE FROM instead of TRUNCATE. doesnt require locking the table.

Revision 1493 - Directory Listing
Modified Fri Jun 19 11:25:20 2009 UTC (3 years, 11 months ago) by lucas
switch to using the production launchpad

Revision 1492 - Directory Listing
Modified Fri Jun 19 11:24:48 2009 UTC (3 years, 11 months ago) by lucas
improve RE to deal correctly with orphanage bugs without description

Revision 1491 - Directory Listing
Modified Fri Jun 19 11:24:13 2009 UTC (3 years, 11 months ago) by lucas
add pedantic severity to lintian (2)

Revision 1489 - Directory Listing
Modified Tue Jun 16 18:38:35 2009 UTC (3 years, 11 months ago) by tille
Add gatherer for screenshots.debian.net

Revision 1487 - Directory Listing
Modified Sun Jun 14 07:18:44 2009 UTC (3 years, 11 months ago) by tille
Handle missing information fields

Revision 1486 - Directory Listing
Modified Sun Jun 14 06:24:12 2009 UTC (3 years, 11 months ago) by tille
Make sure all binaries will be injected

Revision 1474 - Directory Listing
Modified Wed Jun 10 11:29:30 2009 UTC (3 years, 11 months ago) by tille
To comply with table sources/packages the tables new_sources/new_packages should also feature section and component columns.  Unfortunately this information is missing in the 822 formatted export of NEW queue but I just reported this problem. A warning message is issued as long as this is not fixed by ftpmaster.

Revision 1473 - Directory Listing
Modified Tue Jun 9 21:50:03 2009 UTC (3 years, 11 months ago) by tille
Distribution field is in packages table so also feature it in new_packages

Revision 1467 - Directory Listing
Modified Sat Jun 6 21:23:42 2009 UTC (3 years, 11 months ago) by lucas
use truncate table instead of delete

Revision 1466 - Directory Listing
Modified Sat Jun 6 21:23:12 2009 UTC (3 years, 11 months ago) by lucas
fix paths

Revision 1465 - Directory Listing
Modified Sat Jun 6 21:21:44 2009 UTC (3 years, 11 months ago) by lucas
ignore more fields ; fix bug with vcs-browser

Revision 1460 - Directory Listing
Modified Sat May 16 15:11:12 2009 UTC (4 years ago) by tille
Prevent gatherer from trying to insert duplicated keys which should not exist in theory but in practice they do.  Will track down the reasons soon.

Revision 1420 - Directory Listing
Modified Tue Mar 24 02:10:08 2009 UTC (4 years, 2 months ago) by lucas
ubuntu-bugs importer: ignore bug #310331, which is corrupted in launchpad (dupetask)

Revision 1419 - Directory Listing
Modified Tue Mar 24 02:09:03 2009 UTC (4 years, 2 months ago) by lucas
improve check for lockfile: exit immediately instead of blocking

Revision 1408 - Directory Listing
Modified Mon Mar 16 10:21:12 2009 UTC (4 years, 2 months ago) by tille
Forgot to add ddtp_gatherer in latest commit; fixed somme issues in description parsing for ftpnew

Revision 1406 - Directory Listing
Modified Mon Mar 16 06:35:13 2009 UTC (4 years, 2 months ago) by tille
First shot for a ftpnew gatherer

Revision 1389 - Directory Listing
Modified Sun Feb 15 21:46:25 2009 UTC (4 years, 3 months ago) by lucas
added forwarded and done to bugs table

Revision 1382 - Directory Listing
Modified Sun Jan 25 14:15:17 2009 UTC (4 years, 3 months ago) by lucas
convert to pyyaml, add some ignores, fix import of long descriptions

Revision 1375 - Directory Listing
Modified Wed Jan 7 22:38:45 2009 UTC (4 years, 4 months ago) by lucas
added all_packages_distrelcomparch summary table and fill it

Revision 1373 - Directory Listing
Modified Wed Jan 7 20:55:35 2009 UTC (4 years, 4 months ago) by lucas
added long_description column to packages table

Revision 1368 - Directory Listing
Modified Thu Dec 25 08:19:52 2008 UTC (4 years, 5 months ago) by lucas
ignore special Packages/Sources fields in Ubuntu

Revision 1367 - Directory Listing
Modified Thu Dec 25 08:19:24 2008 UTC (4 years, 5 months ago) by lucas
ignore error lines from lintian.log

Revision 1357 - Directory Listing
Modified Sun Dec 21 22:31:55 2008 UTC (4 years, 5 months ago) by lucas
add date-left-closed to ubuntu_bugs_gatherer

Revision 1356 - Directory Listing
Modified Sun Dec 21 22:31:40 2008 UTC (4 years, 5 months ago) by lucas
complete the addition of Breaks

Revision 1355 - Directory Listing
Modified Sun Dec 21 22:08:34 2008 UTC (4 years, 5 months ago) by lucas
fix optional dbport parameter

Revision 1353 - Directory Listing
Modified Fri Dec 19 13:30:53 2008 UTC (4 years, 5 months ago) by lucas
add support for breaks, ignore some non-relevant fields

Revision 1351 - Directory Listing
Modified Fri Dec 19 13:30:01 2008 UTC (4 years, 5 months ago) by lucas
pass the db port when connecting.

Revision 1336 - Directory Listing
Modified Thu Oct 23 16:23:32 2008 UTC (4 years, 7 months ago) by lucas
fix bug with quoting of source package name when the source version differs from the binary version

Revision 1335 - Directory Listing
Modified Wed Oct 22 19:44:01 2008 UTC (4 years, 7 months ago) by lucas
bug_presence: use reference to @arch array

Revision 1332 - Directory Listing
Modified Wed Oct 22 18:11:08 2008 UTC (4 years, 7 months ago) by lucas
reduce the number of concurrent fetchers to accomodate for this sloooow launchpad ;)

Revision 1331 - Directory Listing
Modified Wed Oct 22 18:10:13 2008 UTC (4 years, 7 months ago) by lucas
added list of arches to bug_presence. doesn't work, but I'll fix it

Revision 1305 - Directory Listing
Modified Sat Sep 27 16:48:31 2008 UTC (4 years, 7 months ago) by lucas
also delete old bugs

Revision 1304 - Directory Listing
Modified Sat Sep 27 16:38:23 2008 UTC (4 years, 7 months ago) by lucas
added bugs_packages table

Revision 1302 - Directory Listing
Modified Sat Sep 27 08:53:28 2008 UTC (4 years, 7 months ago) by lucas
python sUcks

Revision 1300 - Directory Listing
Modified Sat Sep 27 08:35:35 2008 UTC (4 years, 7 months ago) by lucas
copy the mechanism in pkgreport.cgi to the the bin->src mapping

Revision 1299 - Directory Listing
Modified Fri Sep 26 22:00:46 2008 UTC (4 years, 7 months ago) by lucas
add some debugging output to compare the result of binarytosource and getpkgsrc

Revision 1298 - Directory Listing
Modified Fri Sep 26 21:38:25 2008 UTC (4 years, 7 months ago) by lucas
split Uploaders: into a seperate table. also split Maintainer into maintainer_name and maintainer_email in sources.

Revision 1294 - Directory Listing
Modified Fri Sep 26 15:57:41 2008 UTC (4 years, 7 months ago) by zack
add missing DEALLOCATE for the (prepared) lintian insert query

Revision 1293 - Directory Listing
Modified Fri Sep 26 15:55:17 2008 UTC (4 years, 7 months ago) by zack
add gatherer to inject debtags data into UDD

Revision 1287 - Directory Listing
Modified Mon Sep 22 17:08:03 2008 UTC (4 years, 8 months ago) by kroeckx
Fill in the affects_experimental field in the bugs tables.

Revision 1272 - Directory Listing
Modified Mon Sep 15 11:56:59 2008 UTC (4 years, 8 months ago) by lucas
remove calls to task_done() to be compatible with python2.4

Revision 1271 - Directory Listing
Modified Mon Sep 15 11:39:40 2008 UTC (4 years, 8 months ago) by lucas
add importer for ubuntu bugs

Revision 1265 - Directory Listing
Modified Thu Sep 11 16:23:25 2008 UTC (4 years, 8 months ago) by kroeckx
Use fields from proper table.

Revision 1264 - Directory Listing
Modified Wed Sep 10 22:18:10 2008 UTC (4 years, 8 months ago) by kroeckx
Make all inserts reference the fields they want to insert into.

Revision 1251 - Directory Listing
Modified Mon Sep 8 19:41:51 2008 UTC (4 years, 8 months ago) by lucas
don't display so many useless warnings

Revision 1249 - Directory Listing
Modified Mon Sep 8 18:58:06 2008 UTC (4 years, 8 months ago) by lucas
bugs import cleanup

Revision 1243 - Directory Listing
Modified Mon Sep 8 09:18:54 2008 UTC (4 years, 8 months ago) by lucas
added foreign keys, adapted import scripts to allow to use them. DB udd on udd.debian.net was updated manually.

Revision 1238 - Directory Listing
Modified Mon Sep 8 07:07:04 2008 UTC (4 years, 8 months ago) by lucas
dont display anything if no error

Revision 1220 - Directory Listing
Modified Sun Sep 7 18:59:22 2008 UTC (4 years, 8 months ago) by lucas
drop schemas, code for drop/setup/schema

Revision 1217 - Directory Listing
Modified Sun Sep 7 17:28:09 2008 UTC (4 years, 8 months ago) by lucas
Copied from: udd/src/udd revision 1216
move udd/* up one dir. makes more sense.

Revision 1216 - Directory Listing
Modified Sun Sep 7 17:22:24 2008 UTC (4 years, 8 months ago) by lucas
Original Path: udd/src/udd
added svn:ignore property on udd/src/udd

Revision 1118 - Directory Listing
Modified Mon Aug 18 14:29:39 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
We don't need no timing - so we switch it off

Revision 1111 - Directory Listing
Modified Sun Aug 17 13:04:15 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
use of my_config for popcon_src

Revision 1107 - Directory Listing
Modified Sun Aug 17 12:43:03 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
TRUNCATE is a bad idea (locks tables)

Revision 1106 - Directory Listing
Modified Sun Aug 17 12:24:24 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Added command 'tables' which returns the tables used by the given source

Revision 1105 - Directory Listing
Modified Sun Aug 17 11:31:33 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Remove superfluous commit
Fill summary table only once

Revision 1095 - Directory Listing
Modified Thu Aug 14 12:11:41 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
fixed foreign keys

Revision 1087 - Directory Listing
Modified Tue Aug 12 16:38:58 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Locking is implemented
upload_histories has now an extra cloeses table

Revision 1086 - Directory Listing
Modified Tue Aug 12 15:13:01 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
web/*: Fixed web scripts
TODO: rt_affects_* tristate: won't do
      PREPARE/EXECUTE for bugs: done
      access information on wiki: done
      two new TODOs
orpahend_packages: fixed typo
upload_history: added two new fields


Revision 1081 - Directory Listing
Modified Mon Aug 11 23:17:33 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
missing closing bracket

Revision 1080 - Directory Listing
Modified Mon Aug 11 23:15:37 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
bug_merged_with was a constant

Revision 1078 - Directory Listing
Modified Mon Aug 11 18:14:00 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
some curlies were missing :)

Revision 1077 - Directory Listing
Modified Mon Aug 11 18:08:36 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Removed double quouting

Revision 1075 - Directory Listing
Modified Mon Aug 11 17:10:30 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Added summary table to packages schema
modified bugs schema to use summary table from packages
use db api qupting for upload history, too

Revision 1071 - Directory Listing
Modified Mon Aug 11 13:53:37 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
s/my/our/ for specific lines

Revision 1070 - Directory Listing
Modified Mon Aug 11 13:51:32 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Added global variable to main()

Revision 1068 - Directory Listing
Modified Mon Aug 11 13:33:24 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Decentralized setup and drop scheme
bugs_gatherer.pl now has prepared SQL statements
for archived bugs, affects_* is now false

Revision 1064 - Directory Listing
Modified Mon Aug 11 03:07:53 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
optimize popcon gatherer a bit

Revision 1063 - Directory Listing
Modified Mon Aug 11 03:07:11 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
fill the summary tables

Revision 1059 - Directory Listing
Modified Sun Aug 10 15:02:05 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
use dbh-do instead of dbh->prepare->execute ; added option to only import some bugs (easier to test)

Revision 1058 - Directory Listing
Modified Sun Aug 10 13:47:13 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
bugs_unarchived -> bugs rename

Revision 1055 - Directory Listing
Modified Sun Aug 10 13:44:59 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
bugs_gatherer: improved DELETEs, added timing

Revision 1053 - Directory Listing
Modified Sun Aug 10 10:28:43 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
read_usertags was deprecated, using Debbugs::User->new now (which is pretty well hidden)

Revision 1047 - Directory Listing
Modified Sat Aug 9 21:29:02 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
really finished renamings

Revision 1044 - Directory Listing
Modified Sat Aug 9 20:34:32 2008 UTC (4 years, 9 months ago) by he
Original Path: udd/src/udd
Use sets in the carnivore gatherer to get rid of dupes in the data before
pushing them to the DB

Revision 1040 - Directory Listing
Modified Sat Aug 9 18:02:05 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
rename bugs_unarchived to bugs, bugs to bugs_both

Revision 1038 - Directory Listing
Modified Sat Aug 9 17:52:27 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Fixed bugs regarding configuration checking and db api 2 quoting

Revision 1037 - Directory Listing
Modified Sat Aug 9 16:32:42 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Configuration checking is a little less ugly now

Revision 1036 - Directory Listing
Modified Sat Aug 9 16:23:35 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Use tierators to read lines from files instead of reading the whole file at once

Revision 1033 - Directory Listing
Modified Sat Aug 9 15:18:39 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
added gatherer for orphaned packages. please check my python

Revision 1032 - Directory Listing
Modified Sat Aug 9 14:01:47 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Switched quoting to the db-api for packages and sources gatherers
fixed quoting function in aux.py (which hopefully won't be used any longer)

Revision 1029 - Directory Listing
Modified Sat Aug 9 01:49:53 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
don't insert bugs with source=null. copy the package value.

Revision 1028 - Directory Listing
Modified Sat Aug 9 01:49:48 2008 UTC (4 years, 9 months ago) by he
Original Path: udd/src/udd
Make the lintian importer actual do work

Revision 1026 - Directory Listing
Modified Sat Aug 9 01:31:01 2008 UTC (4 years, 9 months ago) by he
Original Path: udd/src/udd
First draft for a lintian.log UDD import

Revision 1024 - Directory Listing
Modified Sat Aug 9 00:26:03 2008 UTC (4 years, 9 months ago) by he
Original Path: udd/src/udd
Actually tested and working carnivore importer.

Revision 1023 - Directory Listing
Modified Fri Aug 8 23:58:51 2008 UTC (4 years, 9 months ago) by he
Original Path: udd/src/udd
First try at a carnivore data importer. God, I do hate python.
THIS SOFTWARE IS PROVIDED ``AS IS'' AND ANY EXPRESS OR IMPLIED
WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF
MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED.

Revision 1019 - Directory Listing
Modified Fri Aug 8 20:30:55 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
renamed popcon_src_max to popcon_src, realy

Revision 1013 - Directory Listing
Modified Fri Aug 8 19:26:25 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
add more columns to the packages table

Revision 1011 - Directory Listing
Modified Fri Aug 8 18:53:45 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
added missing fields from Sources

Revision 1008 - Directory Listing
Modified Fri Aug 8 18:25:07 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
typo

Revision 1007 - Directory Listing
Modified Fri Aug 8 18:24:07 2008 UTC (4 years, 9 months ago) by lucas
Original Path: udd/src/udd
import Vcs data as a (type, url, browser) triplet

Revision 999 - Directory Listing
Modified Fri Aug 8 13:53:23 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Removed surviving 'next' statement

Revision 998 - Directory Listing
Modified Fri Aug 8 13:51:14 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
debian und ubuntu each get a table of its own for packages, sources and popcon
made table names configurable for the above tables

Revision 983 - Directory Listing
Modified Sun Aug 3 16:51:14 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Split bugs table into bugs_archived and bugs_unarchived
Created bugs VIEW as union of bugs_archived and bugs_unarchived

Revision 982 - Directory Listing
Modified Sun Aug 3 13:10:16 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Fixed bug regarding bugs.source

Revision 973 - Directory Listing
Modified Thu Jul 31 15:50:45 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Removed scanning for mtimes: We need to find a way to check for updated packages first, so that we can recalculate the affects_ columns

Revision 972 - Directory Listing
Modified Thu Jul 31 15:38:29 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
delete existing entries

Revision 971 - Directory Listing
Modified Tue Jul 29 14:01:16 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Now all bugs which are going to be inserted, are deleted prior to that,
	not only bugs which are archived/unarchived

Revision 968 - Directory Listing
Modified Tue Jul 29 13:06:30 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Added code to import bugs.d.o usertags
Renamed bug_user_tags.bug_user to email

Revision 965 - Directory Listing
Modified Mon Jul 28 16:32:56 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Renamed popcon.name to popcon.package
Renamed testing_migrations.package to testing_migrations.source

Revision 958 - Directory Listing
Modified Mon Jul 28 14:56:37 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Forgot to remove print statement in popcon_gatherer
Added insts to popcon_src_* views

Revision 957 - Directory Listing
Modified Mon Jul 28 14:50:28 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Added insts column to popcon table

Revision 951 - Directory Listing
Modified Mon Jul 28 13:23:55 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Add check for illegal characters and skip them

Revision 946 - Directory Listing
Modified Sun Jul 27 13:26:34 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Added NOTES files, which should contain various notes for UDD
Modified DELETE statments for bugs_gatherer, so that only the correct entries are delted, and not everything

Revision 945 - Directory Listing
Modified Sun Jul 27 12:53:57 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Added possibility to import archived bugs
renamed bugs.affects_testings to bugs.affects_testing

Revision 943 - Directory Listing
Modified Sun Jul 27 11:57:57 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Script doesn't exit now, but returns to dispatcher

Revision 942 - Directory Listing
Modified Sun Jul 27 11:38:35 2008 UTC (4 years, 9 months ago) by neronus-guest
Original Path: udd/src/udd
Added bugs to dispatcher (bugs.debian.org that is)
Moved epoch to timestamp conversion from perl to postgresql

Revision 939 - Directory Listing
Modified Sat Jul 26 19:21:15 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
Added code to import upload history
Removed print from bugs gatherer

Revision 936 - Directory Listing
Modified Sat Jul 26 13:06:58 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
* Removed bugs gatherer optimization
* Code cleanups
* comments

Revision 931 - Directory Listing
Modified Thu Jul 24 20:23:06 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
Deleted some now redundant functions/methods

Revision 930 - Directory Listing
Modified Thu Jul 24 19:52:26 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
* Only updated bugs are updated in the DB

Revision 929 - Directory Listing
Modified Thu Jul 24 16:34:20 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
trivial change in popcon_gatherer.py
added source column to bugs table

Revision 925 - Directory Listing
Modified Thu Jul 24 12:28:46 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
* added module init file
* moved statement deallocation in sources_gatherer.py
* the pending status of bugs is read now, too

Revision 922 - Directory Listing
Modified Wed Jul 23 14:32:10 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
Added affects_* to bugs table

Revision 921 - Directory Listing
Modified Wed Jul 23 12:09:04 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
Added found_in and fixed_in and merged_with

Revision 920 - Directory Listing
Modified Wed Jul 23 10:33:26 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
Added fixed_in and found_in versions

Revision 919 - Directory Listing
Modified Tue Jul 22 19:03:59 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
Added tables for bugs.debian.org
Write script to import data from bugs.debian.org. Still incomplete

Revision 916 - Directory Listing
Modified Sat Jul 12 17:32:38 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
Added table and script for testing migrations

Revision 908 - Directory Listing
Modified Wed Jul 2 10:52:16 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
Rewrote the sources and packages gatherer
Fixed a little bug concerning the output of unknown keys

Revision 904 - Directory Listing
Modified Sun Jun 29 11:46:33 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
Now existing entries are deleted from the tables

Revision 903 - Directory Listing
Modified Sun Jun 29 11:24:35 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
Added possibility to update sources via configuration entry 'update-command', which
then is read from udd-update

Added ubuntu popcon data

modified popcon table to include distribtution

Revision 902 - Directory Listing
Modified Sun Jun 29 10:56:23 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
* It is possible to use python modules now instead of executable files
* Modified our three existing gatherers to do so

Revision 901 - Directory Listing
Added Sat Jun 28 15:50:00 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd
* Startet redesigning packages_gatherer

  ViewVC Help
Powered by ViewVC 1.1.5