setuptools sandbox isn't tight enough to hold Twisted's sand in so that it doesn't get in Nevow's eyes #455

New issue

Closed

opened 2008-06-09 23:00:07 +00:00 by zooko · 11 comments

zooko commented

2008-06-09 23:00:07 +00:00

(http://bugs.python.org/setuptools/issue20) # package required at build time seems to be not fully present at install time?

This makes it impossible to install both Twisted and Nevow in one invocation of a setuptools process. However, if you do two successive invocations of a setuptools process then the second one works. Brian is committing a patch to our Makefile so that make build does ./setup.py develop ; setup.py develop instead of just setup.py develop, which will make the etch builder start working again. This ticket is to remind me how I don't like that kludge and to be sure and take it out as soon as we have a setuptools that can install Twisted and Nevow in one pass.

(http://bugs.python.org/setuptools/issue20) # package required at build time seems to be not fully present at install time? This makes it impossible to install both Twisted and Nevow in one invocation of a setuptools process. However, if you do two successive invocations of a setuptools process then the second one works. Brian is committing a patch to our Makefile so that `make build` does `./setup.py develop ; setup.py develop` instead of just `setup.py develop`, which will make the etch builder start working again. This ticket is to remind me how I don't like that kludge and to be sure and take it out as soon as we have a setuptools that can install Twisted and Nevow in one pass.

zooko added the

labels 2008-06-09 23:00:07 +00:00

zooko self-assigned this 2008-06-09 23:00:07 +00:00

cgalvan commented

2008-08-26 04:41:13 +00:00

Owner

As noted on the setuptools tracker, this issue has been fixed in the setuptools trunk as of r65949 :)

tahoe-lafs added the

r/fixed

label 2008-08-26 04:41:13 +00:00

cgalvan closed this issue

2008-08-26 04:41:13 +00:00

cgalvan commented

2008-08-26 05:27:33 +00:00

Owner

It turns out that the current fix in the trunk only half-fixes this issue :/ But, since PJE has been very responsive lately, hopefully he will have it fully fixed soon :)

tahoe-lafs removed the

r/fixed

label 2008-08-26 05:27:33 +00:00

cgalvan reopened this issue

2008-08-26 05:27:33 +00:00

warner commented

2008-09-17 05:33:36 +00:00

After that change, it requires three invocations of 'setup.py develop' to make the errors go away. I'm updating the Makefile to do this (```make build-once | make build-once |

This problem just got worse with the changes to #249 that removed the pyutil tarball from misc/dependencies/ . It looks like one of the dependent libraries (probably zfec or pycryptopp, something that depends upon and contains a copy of pyutil internally) is causing an old version of pyutil to be imported, which then breaks the subsequent requirement on a newer version. After that change, it requires *three* invocations of 'setup.py develop' to make the errors go away. I'm updating the Makefile to do this (```make build-once | make build-once |

zooko commented

2008-09-17 17:13:44 +00:00

Author

Hm... Is the problem that when a too-old version of pyutil is installed, then the requirement that we need a newer version cannot be satisfied? If so, then this is not part of this ticket, but is instead part of a new ticket that we should probably create to investigate how to use setuptools's "multi-version" feature, so that both older and newer versions of a library can be installed and the packages that require that library will use the version that they require:

http://peak.telecommunity.com/DevCenter/setuptools#develop-deploy-the-project-source-in-development-mode

zooko commented

2008-09-17 17:14:12 +00:00

Author

adding Cc: Chris Galvan in the hopes that he can explain the multi-version feature to us...

warner commented

2008-09-17 17:33:16 +00:00

It might also suffice to not ship a copy of pyutil inside zfec/pycryptopp, perhaps by using the same approach as we're doing with tahoe (ship both sumo and normal tarballs, provide a -deps.tar.gz package, etc)

it might be, I remember seeing unusual versions of pyutil in the logs. I'll investigate more closely. For reference, it was the dapper and edgy buildslave that had the problem, and they should still be having it, so just check their logs. It might also suffice to not ship a copy of pyutil inside zfec/pycryptopp, perhaps by using the same approach as we're doing with tahoe (ship both sumo and normal tarballs, provide a -deps.tar.gz package, etc)

zooko commented

2008-09-17 18:15:06 +00:00

Author

Yes, that sounds like a good change to make to zfec (pycryptopp does not require pyutil). http://allmydata.org/trac/zfec/ticket/2 (offer unbundled "slim" version of zfec without pyutil)

Yes, that sounds like a good change to make to zfec (pycryptopp does not require pyutil). <http://allmydata.org/trac/zfec/ticket/2> (offer unbundled "slim" version of zfec without pyutil)

zooko commented

2008-10-22 02:27:35 +00:00

Author

Okay, the original problem was fixed in http://bugs.python.org/setuptools/issue20 , which is in setuptools-0.6c9, which is bundled with Tahoe as of changeset:0bc116b3a2580d89, changeset:3cfc00f5cff1452d, changeset:2e35648901ede7bd. I confirmed that this fixed the original problem when installing Tahoe on Windows.

The next problem is that zfec came with a version of pyutil bundled -- that has been fixed (http://allmydata.org/trac/zfec/ticket/2 (offer unbundled "slim" version of zfec without pyutil) has been closed).

But there is another problem that is deserving of a new ticket -- #530 (use setuptools's --multi-version mode).

Okay, the original problem was fixed in <http://bugs.python.org/setuptools/issue20> , which is in setuptools-0.6c9, which is bundled with Tahoe as of changeset:0bc116b3a2580d89, changeset:3cfc00f5cff1452d, changeset:2e35648901ede7bd. I confirmed that this fixed the original problem when installing Tahoe on Windows. The next problem is that zfec came with a version of pyutil bundled -- that has been fixed (<http://allmydata.org/trac/zfec/ticket/2> (offer unbundled "slim" version of zfec without pyutil) has been closed). But there is another problem that is deserving of a new ticket -- #530 (use setuptools's --multi-version mode).

Rows
Columns