/[collab-qa]/udd/udd/sources_gatherer.py
ViewVC logotype

Log of /udd/udd/sources_gatherer.py

Parent Directory Parent Directory | Revision Log Revision Log


Sticky Revision:
(Current path doesn't exist after revision 2466)

Revision 1828 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sat Oct 30 09:42:14 2010 UTC (2 years, 7 months ago) by lucas
File length: 8676 byte(s)
Diff to previous 1703
ignore Python3-Version

Revision 1703 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sun Feb 28 16:45:36 2010 UTC (3 years, 3 months ago) by lucas
File length: 8654 byte(s)
Diff to previous 1691
optimize the sources and packages gatherer

Revision 1691 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sun Feb 21 10:22:16 2010 UTC (3 years, 3 months ago) by lucas
File length: 8658 byte(s)
Diff to previous 1672
import debian-installer

Revision 1672 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Thu Jan 21 02:47:36 2010 UTC (3 years, 4 months ago) by lucas
File length: 8517 byte(s)
Diff to previous 1615
add derivatives table, import sidux

Revision 1615 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Tue Nov 3 06:18:26 2009 UTC (3 years, 7 months ago) by lucas
File length: 8518 byte(s)
Diff to previous 1599
fix problem when importing several packages sources in the same run, and packages have the same name+version in different sources

Revision 1599 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Wed Oct 7 20:47:31 2009 UTC (3 years, 8 months ago) by lucas
File length: 8552 byte(s)
Diff to previous 1568
turn DM-upload-allowed into boolean

Revision 1568 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sat Sep 5 12:50:09 2009 UTC (3 years, 9 months ago) by lucas
File length: 8431 byte(s)
Diff to previous 1536
ignore Maintainer-Homepage and Tads{2,3}-Version

Revision 1536 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Fri Jul 24 11:00:34 2009 UTC (3 years, 10 months ago) by lucas
File length: 8405 byte(s)
Diff to previous 1531
use lists instead of tuples (thanks zack)

Revision 1531 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Thu Jul 23 14:05:39 2009 UTC (3 years, 10 months ago) by lucas
File length: 8401 byte(s)
Diff to previous 1529
add ANALYZE at the end of all importers to teach pgsql some stats about the data we just imported

Revision 1529 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Thu Jul 23 00:28:12 2009 UTC (3 years, 10 months ago) by lucas
File length: 8022 byte(s)
Diff to previous 1525
add _email and _name columns in sources, packages and upload_history. use executemany() in upload-history.

Revision 1525 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Fri Jul 17 02:59:27 2009 UTC (3 years, 11 months ago) by lucas
File length: 7916 byte(s)
Diff to previous 1465
optimize import using executemany()

Revision 1465 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sat Jun 6 21:21:44 2009 UTC (4 years ago) by lucas
File length: 7790 byte(s)
Diff to previous 1382
ignore more fields ; fix bug with vcs-browser

Revision 1382 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sun Jan 25 14:15:17 2009 UTC (4 years, 4 months ago) by lucas
File length: 7782 byte(s)
Diff to previous 1368
convert to pyyaml, add some ignores, fix import of long descriptions

Revision 1368 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Thu Dec 25 08:19:52 2008 UTC (4 years, 5 months ago) by lucas
File length: 7727 byte(s)
Diff to previous 1353
ignore special Packages/Sources fields in Ubuntu

Revision 1353 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Fri Dec 19 13:30:53 2008 UTC (4 years, 6 months ago) by lucas
File length: 7464 byte(s)
Diff to previous 1302
add support for breaks, ignore some non-relevant fields

Revision 1302 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sat Sep 27 08:53:28 2008 UTC (4 years, 8 months ago) by lucas
File length: 7140 byte(s)
Diff to previous 1298
python sUcks

Revision 1298 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Fri Sep 26 21:38:25 2008 UTC (4 years, 8 months ago) by lucas
File length: 7140 byte(s)
Diff to previous 1251
split Uploaders: into a seperate table. also split Maintainer into maintainer_name and maintainer_email in sources.

Revision 1251 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Mon Sep 8 19:41:51 2008 UTC (4 years, 9 months ago) by lucas
File length: 6058 byte(s)
Diff to previous 1217
don't display so many useless warnings

Revision 1217 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sun Sep 7 17:28:09 2008 UTC (4 years, 9 months ago) by lucas
File length: 6056 byte(s)
Diff to previous 1106
move udd/* up one dir. makes more sense.

Revision 1106 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sun Aug 17 12:24:24 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 6056 byte(s)
Diff to previous 1068
Added command 'tables' which returns the tables used by the given source

Revision 1068 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Mon Aug 11 13:33:24 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 6084 byte(s)
Diff to previous 1047
Decentralized setup and drop scheme
bugs_gatherer.pl now has prepared SQL statements
for archived bugs, affects_* is now false

Revision 1047 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sat Aug 9 21:29:02 2008 UTC (4 years, 10 months ago) by lucas
Original Path: udd/src/udd/sources_gatherer.py
File length: 5717 byte(s)
Diff to previous 1038
really finished renamings

Revision 1038 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sat Aug 9 17:52:27 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 5718 byte(s)
Diff to previous 1037
Fixed bugs regarding configuration checking and db api 2 quoting

Revision 1037 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sat Aug 9 16:32:42 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 5701 byte(s)
Diff to previous 1032
Configuration checking is a little less ugly now

Revision 1032 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sat Aug 9 14:01:47 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 6157 byte(s)
Diff to previous 1011
Switched quoting to the db-api for packages and sources gatherers
fixed quoting function in aux.py (which hopefully won't be used any longer)

Revision 1011 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Fri Aug 8 18:53:45 2008 UTC (4 years, 10 months ago) by lucas
Original Path: udd/src/udd/sources_gatherer.py
File length: 6232 byte(s)
Diff to previous 1008
added missing fields from Sources

Revision 1008 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Fri Aug 8 18:25:07 2008 UTC (4 years, 10 months ago) by lucas
Original Path: udd/src/udd/sources_gatherer.py
File length: 5860 byte(s)
Diff to previous 1007
typo

Revision 1007 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Fri Aug 8 18:24:07 2008 UTC (4 years, 10 months ago) by lucas
Original Path: udd/src/udd/sources_gatherer.py
File length: 5861 byte(s)
Diff to previous 998
import Vcs data as a (type, url, browser) triplet

Revision 998 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Fri Aug 8 13:51:14 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 5463 byte(s)
Diff to previous 936
debian und ubuntu each get a table of its own for packages, sources and popcon
made table names configurable for the above tables

Revision 936 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sat Jul 26 13:06:58 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 5287 byte(s)
Diff to previous 925
* Removed bugs gatherer optimization
* Code cleanups
* comments

Revision 925 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Thu Jul 24 12:28:46 2008 UTC (4 years, 10 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 5153 byte(s)
Diff to previous 908
* added module init file
* moved statement deallocation in sources_gatherer.py
* the pending status of bugs is read now, too

Revision 908 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Wed Jul 2 10:52:16 2008 UTC (4 years, 11 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 5148 byte(s)
Diff to previous 904
Rewrote the sources and packages gatherer
Fixed a little bug concerning the output of unknown keys

Revision 904 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sun Jun 29 11:46:33 2008 UTC (4 years, 11 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 5087 byte(s)
Diff to previous 902
Now existing entries are deleted from the tables

Revision 902 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sun Jun 29 10:56:23 2008 UTC (4 years, 11 months ago) by neronus-guest
Original Path: udd/src/udd/sources_gatherer.py
File length: 4922 byte(s)
Copied from: udd/src/sources_gatherer.py revision 898
Diff to previous 898
* It is possible to use python modules now instead of executable files
* Modified our three existing gatherers to do so

Revision 898 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Thu Jun 26 12:38:35 2008 UTC (4 years, 11 months ago) by neronus-guest
Original Path: udd/src/sources_gatherer.py
File length: 5086 byte(s)
Diff to previous 895
Added popcon_average and popcon_sum views
fixed bug in sources_gatherer

Revision 895 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sun Jun 22 21:03:38 2008 UTC (4 years, 11 months ago) by neronus-guest
Original Path: udd/src/sources_gatherer.py
File length: 5086 byte(s)
Diff to previous 891
Added Code to gather Popcon sources

Revision 891 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Tue Jun 17 10:36:13 2008 UTC (5 years ago) by neronus-guest
Original Path: udd/src/sources_gatherer.py
File length: 4893 byte(s)
Diff to previous 887
Everything vrom *Sources is imported now
DB changed to hold all this information
Implemented a more flexible system to add/remove fields from Packages and Sources
Removed Serials - using multi value keys, instead

Revision 887 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Fri Jun 6 13:52:26 2008 UTC (5 years ago) by neronus-guest
Original Path: udd/src/sources_gatherer.py
File length: 4198 byte(s)
Diff to previous 885
* Added unique constraints
* Added etch to test.yaml
* Moved source finding from sources_Gatherer to packages_gatherer

Revision 885 - (view) (download) (as text) (annotate) - [select for diffs]
Added Fri Jun 6 10:42:31 2008 UTC (5 years ago) by neronus-guest
Original Path: udd/src/sources_gatherer.py
File length: 4557 byte(s)
* Added build_archs table
* Added code to suck in Sources
* Added indice for DB
* src_id is now set for packages

This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, enter a numeric revision.

  Diffs between and
  Type of Diff should be a

  ViewVC Help
Powered by ViewVC 1.1.5