incompatibility between zope.interface 3.6.3/3.6.4 and Nevow 0.10 #1435

New issue

Closed

opened 2011-07-18 19:28:13 +00:00 by daira · 33 comments

daira commented

2011-07-18 19:28:13 +00:00

The following error happens on python setup.py build when using Nevow 0.10 and zope.interface 3.6.4 (it appears to be the new version of zope.interface that introduces the problem, since we normally work fine with Nevow 0.10):

> python setup.py build
running darcsver
setup.py darcsver: using extant version file ['src/allmydata/_version.py']
running develop
Not found: tahoe-deps
Not found: ../tahoe-deps
running egg_info
writing requirements to src/allmydata_tahoe.egg-info/requires.txt
writing src/allmydata_tahoe.egg-info/PKG-INFO
writing top-level names to src/allmydata_tahoe.egg-info/top_level.txt
writing dependency_links to src/allmydata_tahoe.egg-info/dependency_links.txt
writing entry points to src/allmydata_tahoe.egg-info/entry_points.txt
writing requirements to src/allmydata_tahoe.egg-info/requires.txt
writing src/allmydata_tahoe.egg-info/PKG-INFO
writing top-level names to src/allmydata_tahoe.egg-info/top_level.txt
writing dependency_links to src/allmydata_tahoe.egg-info/dependency_links.txt
writing entry points to src/allmydata_tahoe.egg-info/entry_points.txt
reading manifest file 'src/allmydata_tahoe.egg-info/SOURCES.txt'
writing manifest file 'src/allmydata_tahoe.egg-info/SOURCES.txt'
running build_ext
Processing setuptools_darcs-1.2.12.egg
removing '/home/tux/allmydata-tahoe-1.8.2/support/lib/python2.6/site-packages/setuptools_darcs-1.2.12.egg' (and everything under it)
Copying setuptools_darcs-1.2.12.egg to /home/tux/allmydata-tahoe-1.8.2/support/lib/python2.6/site-packages
setuptools-darcs 1.2.12 is already the active version in easy-install.pth

Installed /home/tux/allmydata-tahoe-1.8.2/support/lib/python2.6/site-packages/setuptools_darcs-1.2.12.egg
Creating /home/tux/allmydata-tahoe-1.8.2/support/lib/python2.6/site-packages/allmydata-tahoe.egg-link (link to src)
allmydata-tahoe 1.8.2 is already the active version in easy-install.pth
Installing tahoe script to support/bin

Installed /home/tux/allmydata-tahoe-1.8.2/src
Processing dependencies for allmydata-tahoe==1.8.2
Searching for Nevow>=0.6.0
Reading http://tahoe-lafs.org/source/tahoe-lafs/deps/tahoe-dep-sdists/
Reading http://tahoe-lafs.org/source/tahoe-lafs/deps/tahoe-lafs-dep-eggs/
Best match: Nevow 0.10.0
Downloading http://tahoe-lafs.org/source/tahoe-lafs/deps/tahoe-dep-sdists/Nevow-0.10.0.tar.bz2
Processing Nevow-0.10.0.tar.bz2
Running Nevow-0.10.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-moUdxw/Nevow-0.10.0/egg-dist-tmp-dXJymM
/tmp/easy_install-moUdxw/Nevow-0.10.0/formless/annotate.py:730: DeprecationWarning: object.__new__() takes no parameters
  rv = cls = InterfaceClass.__new__(cls, name, bases, dct)
Traceback (most recent call last):
  File "setup.py", line 417, in <module>
    **setup_args
  File "/usr/lib/python2.6/distutils/core.py", line 152, in setup
    dist.run_commands()
  File "/usr/lib/python2.6/distutils/dist.py", line 975, in run_commands
    self.run_command(cmd)
  File "/usr/lib/python2.6/distutils/dist.py", line 995, in run_command
    cmd_obj.run()
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/develop.py", line 23, in run
    self.old_run()
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/develop.py", line 33, in old_run
    self.install_for_development()
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/develop.py", line 103, in install_for_development
    self.process_distribution(None, self.dist, not self.no_deps)
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 526, in process_distribution
    [requirement], self.local_index, self.easy_install
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/pkg_resources.py", line 573, in resolve
    dist = best[req.key] = env.best_match(req, self, installer)
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/pkg_resources.py", line 823, in best_match
    return self.obtain(req, installer) # try and download/install
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/pkg_resources.py", line 835, in obtain
    return installer(requirement)
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 453, in easy_install
    return self.install_item(spec, dist.location, tmpdir, deps)
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 483, in install_item
    dists = self.install_eggs(spec, download, tmpdir)
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 663, in install_eggs
    return self.build_and_install(setup_script, setup_base)
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 938, in build_and_install
    self.run_setup(setup_script, setup_base, args)
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 927, in run_setup
    run_setup(setup_script, args)
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/sandbox.py", line 62, in run_setup
    lambda: execfile(
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/sandbox.py", line 105, in run
    return func()
  File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/sandbox.py", line 64, in <lambda>
    {'__file__':setup_script, '__name__':'__main__'}
  File "setup.py", line 3, in <module>
    
  File "/tmp/easy_install-moUdxw/Nevow-0.10.0/nevow/__init__.py", line 143, in <module>
    
  File "/tmp/easy_install-moUdxw/Nevow-0.10.0/nevow/__init__.py", line 29, in load
    
  File "/tmp/easy_install-moUdxw/Nevow-0.10.0/nevow/util.py", line 183, in _namedAnyWithBuiltinTranslation
  File "/home/tux/allmydata-tahoe-1.8.2/Twisted-10.2.0-py2.6-linux-i686.egg/twisted/python/reflect.py", line 464, in namedAny
    topLevelPackage = _importAndCheckStack(trialname)
  File "/home/tux/allmydata-tahoe-1.8.2/Twisted-10.2.0-py2.6-linux-i686.egg/twisted/python/reflect.py", line 400, in _importAndCheckStack
    return __import__(importName)
  File "/tmp/easy_install-moUdxw/Nevow-0.10.0/formless/__init__.py", line 9, in <module>
    # See the README file for information on usage and redistribution.
  File "/tmp/easy_install-moUdxw/Nevow-0.10.0/formless/annotate.py", line 851, in <module>
  File "/tmp/easy_install-moUdxw/Nevow-0.10.0/formless/annotate.py", line 731, in __new__
  File "/home/tux/allmydata-tahoe-1.8.2/zope.interface-3.6.4-py2.6-linux-i686.egg/zope/interface/interface.py", line 685, in __hash__
    return hash((self.__name__, self.__module__))
AttributeError: 'MetaTypedInterface' object has no attribute '__name__'

Drew Perttula posted a workaround to monkey-patch zope.interface, but it is difficult for Tahoe to apply this workaround because the failure happens in setup.py build, before any run-time Tahoe code has executed.

The following error happens on `python setup.py build` when using Nevow 0.10 and zope.interface 3.6.4 (it appears to be the new version of zope.interface that introduces the problem, since we normally work fine with Nevow 0.10): ``` > python setup.py build running darcsver setup.py darcsver: using extant version file ['src/allmydata/_version.py'] running develop Not found: tahoe-deps Not found: ../tahoe-deps running egg_info writing requirements to src/allmydata_tahoe.egg-info/requires.txt writing src/allmydata_tahoe.egg-info/PKG-INFO writing top-level names to src/allmydata_tahoe.egg-info/top_level.txt writing dependency_links to src/allmydata_tahoe.egg-info/dependency_links.txt writing entry points to src/allmydata_tahoe.egg-info/entry_points.txt writing requirements to src/allmydata_tahoe.egg-info/requires.txt writing src/allmydata_tahoe.egg-info/PKG-INFO writing top-level names to src/allmydata_tahoe.egg-info/top_level.txt writing dependency_links to src/allmydata_tahoe.egg-info/dependency_links.txt writing entry points to src/allmydata_tahoe.egg-info/entry_points.txt reading manifest file 'src/allmydata_tahoe.egg-info/SOURCES.txt' writing manifest file 'src/allmydata_tahoe.egg-info/SOURCES.txt' running build_ext Processing setuptools_darcs-1.2.12.egg removing '/home/tux/allmydata-tahoe-1.8.2/support/lib/python2.6/site-packages/setuptools_darcs-1.2.12.egg' (and everything under it) Copying setuptools_darcs-1.2.12.egg to /home/tux/allmydata-tahoe-1.8.2/support/lib/python2.6/site-packages setuptools-darcs 1.2.12 is already the active version in easy-install.pth Installed /home/tux/allmydata-tahoe-1.8.2/support/lib/python2.6/site-packages/setuptools_darcs-1.2.12.egg Creating /home/tux/allmydata-tahoe-1.8.2/support/lib/python2.6/site-packages/allmydata-tahoe.egg-link (link to src) allmydata-tahoe 1.8.2 is already the active version in easy-install.pth Installing tahoe script to support/bin Installed /home/tux/allmydata-tahoe-1.8.2/src Processing dependencies for allmydata-tahoe==1.8.2 Searching for Nevow>=0.6.0 Reading http://tahoe-lafs.org/source/tahoe-lafs/deps/tahoe-dep-sdists/ Reading http://tahoe-lafs.org/source/tahoe-lafs/deps/tahoe-lafs-dep-eggs/ Best match: Nevow 0.10.0 Downloading http://tahoe-lafs.org/source/tahoe-lafs/deps/tahoe-dep-sdists/Nevow-0.10.0.tar.bz2 Processing Nevow-0.10.0.tar.bz2 Running Nevow-0.10.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-moUdxw/Nevow-0.10.0/egg-dist-tmp-dXJymM /tmp/easy_install-moUdxw/Nevow-0.10.0/formless/annotate.py:730: DeprecationWarning: object.__new__() takes no parameters rv = cls = InterfaceClass.__new__(cls, name, bases, dct) Traceback (most recent call last): File "setup.py", line 417, in <module> **setup_args File "/usr/lib/python2.6/distutils/core.py", line 152, in setup dist.run_commands() File "/usr/lib/python2.6/distutils/dist.py", line 975, in run_commands self.run_command(cmd) File "/usr/lib/python2.6/distutils/dist.py", line 995, in run_command cmd_obj.run() File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/develop.py", line 23, in run self.old_run() File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/develop.py", line 33, in old_run self.install_for_development() File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/develop.py", line 103, in install_for_development self.process_distribution(None, self.dist, not self.no_deps) File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 526, in process_distribution [requirement], self.local_index, self.easy_install File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/pkg_resources.py", line 573, in resolve dist = best[req.key] = env.best_match(req, self, installer) File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/pkg_resources.py", line 823, in best_match return self.obtain(req, installer) # try and download/install File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/pkg_resources.py", line 835, in obtain return installer(requirement) File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 453, in easy_install return self.install_item(spec, dist.location, tmpdir, deps) File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 483, in install_item dists = self.install_eggs(spec, download, tmpdir) File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 663, in install_eggs return self.build_and_install(setup_script, setup_base) File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 938, in build_and_install self.run_setup(setup_script, setup_base, args) File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/command/easy_install.py", line 927, in run_setup run_setup(setup_script, args) File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/sandbox.py", line 62, in run_setup lambda: execfile( File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/sandbox.py", line 105, in run return func() File "/home/tux/allmydata-tahoe-1.8.2/setuptools-0.6c16dev3.egg/setuptools/sandbox.py", line 64, in <lambda> {'__file__':setup_script, '__name__':'__main__'} File "setup.py", line 3, in <module> File "/tmp/easy_install-moUdxw/Nevow-0.10.0/nevow/__init__.py", line 143, in <module> File "/tmp/easy_install-moUdxw/Nevow-0.10.0/nevow/__init__.py", line 29, in load File "/tmp/easy_install-moUdxw/Nevow-0.10.0/nevow/util.py", line 183, in _namedAnyWithBuiltinTranslation File "/home/tux/allmydata-tahoe-1.8.2/Twisted-10.2.0-py2.6-linux-i686.egg/twisted/python/reflect.py", line 464, in namedAny topLevelPackage = _importAndCheckStack(trialname) File "/home/tux/allmydata-tahoe-1.8.2/Twisted-10.2.0-py2.6-linux-i686.egg/twisted/python/reflect.py", line 400, in _importAndCheckStack return __import__(importName) File "/tmp/easy_install-moUdxw/Nevow-0.10.0/formless/__init__.py", line 9, in <module> # See the README file for information on usage and redistribution. File "/tmp/easy_install-moUdxw/Nevow-0.10.0/formless/annotate.py", line 851, in <module> File "/tmp/easy_install-moUdxw/Nevow-0.10.0/formless/annotate.py", line 731, in __new__ File "/home/tux/allmydata-tahoe-1.8.2/zope.interface-3.6.4-py2.6-linux-i686.egg/zope/interface/interface.py", line 685, in __hash__ return hash((self.__name__, self.__module__)) AttributeError: 'MetaTypedInterface' object has no attribute '__name__' ``` Drew Perttula posted a workaround to [monkey-patch zope.interface](http://drewp.quickwitretort.com/2011/07/08/0), but it is difficult for Tahoe to apply this workaround because the failure happens in `setup.py build`, before any run-time Tahoe code has executed.

daira added the

labels 2011-07-18 19:28:13 +00:00

daira added this to the 1.9.0 milestone 2011-07-18 19:28:13 +00:00

daira commented

2011-07-19 00:50:58 +00:00

Author

attachment:dependency-updates.darcs.patch works by requiring one of the exact versions 3.3.1, 3.5.3 or 3.6.1 of zope.interface (both at build and run-time). These are the versions packaged in Debian, Ubuntu and pkgsrc. It also updates the dependency for Twisted as required by #1274 and #1429.

[attachment:dependency-updates.darcs.patch](/tahoe-lafs/trac/attachments/000078ac-5a21-19b6-e178-36264f742c49) works by requiring one of the exact versions 3.3.1, 3.5.3 or 3.6.1 of zope.interface (both at build and run-time). These are the versions packaged in Debian, Ubuntu and pkgsrc. It also updates the dependency for Twisted as required by #1274 and #1429.

daira commented

2011-07-19 02:55:43 +00:00

Author

Attachment dependency-updates.darcs.patch (19705 bytes) added

setup.py, _auto_deps.py, NEWS: dependency updates for Twisted and zope.interface. This version also removes the instruction to install pywin32 on Windows, which is no longer needed. fixes #1274, #1435. refs #1429

**Attachment** dependency-updates.darcs.patch (19705 bytes) added setup.py, _auto_deps.py, NEWS: dependency updates for Twisted and zope.interface. This version also removes the instruction to install pywin32 on Windows, which is no longer needed. fixes #1274, #1435. refs #1429

dependency-updates.darcs.patch

19 KiB

daira commented

2011-07-19 15:47:52 +00:00

Author

We still need upstream zope.interface to be fixed fairly soon, because:

we want to be able to allow future versions;
if an OS distribution packages the current version and a user has that package installed (i.e. as a single-version-externally-managed Python dist), setuptools will report a version conflict when building Tahoe-LAFS.

The sooner upstream is fixed, the less likely it is that a broken version will be packaged.

We still need upstream zope.interface to be fixed fairly soon, because: * we want to be able to allow future versions; * if an OS distribution packages the current version and a user has that package installed (i.e. as a single-version-externally-managed Python dist), setuptools will report a version conflict when building Tahoe-LAFS. The sooner upstream is fixed, the less likely it is that a broken version will be packaged.

daira commented

2011-07-22 00:50:17 +00:00

Author

Attachment fix-1435.darcs.patch (22171 bytes) added

Update the dependency on zope.interface to fix an incompatiblity between Nevow and zope.interface 3.6.4. fixes #1435 (Patch bundle also contains the patch for #1438.)

**Attachment** fix-1435.darcs.patch (22171 bytes) added Update the dependency on zope.interface to fix an incompatiblity between Nevow and zope.interface 3.6.4. fixes #1435 (Patch bundle also contains the patch for #1438.)

fix-1435.darcs.patch

22 KiB

daira commented

2011-07-22 00:53:50 +00:00

Author

Please review attachment:fix-1435.darcs.patch instead of attachment:dependency-updates.darcs.patch. They do the same thing, but fix-1435.darcs.patch has the zope.interface and Twisted updates in separate darcs patches.

Please review [attachment:fix-1435.darcs.patch](/tahoe-lafs/trac/attachments/000078ac-5a21-19b6-e178-ba90ca4e95f2) instead of [attachment:dependency-updates.darcs.patch](/tahoe-lafs/trac/attachments/000078ac-5a21-19b6-e178-36264f742c49). They do the same thing, but `fix-1435.darcs.patch` has the zope.interface and Twisted updates in separate darcs patches.

zooko commented

2011-07-22 05:43:38 +00:00

I reviewed attachment:fix-1435.darcs.patch and it looks good to me.

I reviewed [attachment:fix-1435.darcs.patch](/tahoe-lafs/trac/attachments/000078ac-5a21-19b6-e178-ba90ca4e95f2) and it looks good to me.

daira commented

2011-07-22 05:50:07 +00:00

Author

In changeset:2ebaa916df66fd3f:

Update the dependency on zope.interface to fix an incompatiblity between Nevow and zope.interface 3.6.4. fixes #1435

In changeset:2ebaa916df66fd3f: ``` Update the dependency on zope.interface to fix an incompatiblity between Nevow and zope.interface 3.6.4. fixes #1435 ```

daira added the

r/fixed

label 2011-07-22 05:50:07 +00:00

daira closed this issue

2011-07-22 05:50:07 +00:00

zooko commented

2011-08-02 17:08:58 +00:00

If we ship Tahoe-LAFS v1.9 with the current constraint -- "zope.interface == 3.3.1, == 3.5.3, == 3.6.1", then once a new Nevow comes out user will be required to use an older zope.interface for no good reason when they could instead use a newer zope.interface and an newer Nevow.

The current fix is quite unsatisfying because the bug is really in Nevow, not in zope.interface, and the Nevow maintainers are working on a new release of Nevow that will fix it, but the zope.interface maintainers are not currently planning to release a new version of zope.interface that changes this. If we ship Tahoe-LAFS v1.9 with the current constraint -- `"zope.interface == 3.3.1, == 3.5.3, == 3.6.1",` then once a new Nevow comes out user will be required to use an older zope.interface for no good reason when they could instead use a newer zope.interface and an newer Nevow.

zooko removed the

r/fixed

label 2011-08-02 17:08:58 +00:00

zooko reopened this issue

2011-08-02 17:08:58 +00:00

daira commented

2011-08-13 23:20:33 +00:00

Author

This is no longer critical; a better specification of the dependency can (and must, I think) wait until the new version of Nevow has been released.

daira added

p/major

and removed

p/critical

labels 2011-08-13 23:20:33 +00:00

zooko commented

2011-08-14 01:42:32 +00:00

Per the launchpad ticket, Tres Seaver has gone ahead and released a new version of zope.interface, v3.6.5, which works-around this problem. So we could change the dependency to something like zope.interface < 3.6.4, > 3.6.4.

Per [the launchpad ticket](https://bugs.launchpad.net/zope.interface/+bug/811792), Tres Seaver has gone ahead and released a new version of `zope.interface`, v3.6.5, which works-around this problem. So we could change the dependency to something like `zope.interface < 3.6.4, > 3.6.4`.

daira commented

2011-08-14 02:26:13 +00:00

Author

Attachment relax-zope-interface-requirement.darcs.patch (35901 bytes) added

_auto_deps.py: relax the requirement for zope.interface. fixes #1435

**Attachment** relax-zope-interface-requirement.darcs.patch (35901 bytes) added _auto_deps.py: relax the requirement for zope.interface. fixes #1435

relax-zope-interface-requirement.darcs.patch

35 KiB

daira commented

2011-08-14 02:32:11 +00:00

Author

Lenny has zope.interface 3.3.1: http://packages.debian.org/search?keywords=python-zopeinterface

attachment:relax-zope-interface-requirement.darcs.patch allows every release version of zope.interface since then according to http://pypi.python.org/pypi/zope.interface, except for 3.6.3 and 3.6.4 which result in the breakage with Nevow, and 3.6.5 which had an earlier version of the fix/workaround.

Lenny has zope.interface 3.3.1: <http://packages.debian.org/search?keywords=python-zopeinterface> [attachment:relax-zope-interface-requirement.darcs.patch](/tahoe-lafs/trac/attachments/000078ac-5a21-19b6-e178-41819a63c56c) allows every release version of zope.interface since then according to <http://pypi.python.org/pypi/zope.interface>, except for 3.6.3 and 3.6.4 which result in the breakage with Nevow, and 3.6.5 which had an earlier version of the fix/workaround.

daira changed title from ~~incompatibility between zope.interface 3.6.4 and Nevow 0.10~~ to incompatibility between zope.interface 3.6.3/3.6.4 and Nevow 0.10

2011-08-14 02:40:31 +00:00

zooko commented

2011-08-14 03:06:47 +00:00

Why not zope.interface < 3.6.4, > 3.6.4? I just tried it in a little test project, the complete contents of which are this setup.py file:

from setuptools import setup

setup(name="testeee", install_requires=["zope.interface < 3.6.4, > 3.6.4"])

It worked as expected, whether zope.interface 3.6.1 was installed, zope.interface 3.6.4 was installed, or no zope.interface at all was installed. This was using distribute v0.6.15 (Ubuntu 11.04 Natty).

There are trade-offs between more missed alarms (in the extreme, allowing all versions except ones that we know don't work) and more false alarms (in the extreme, forbidding all versions except ones that we know work). Our current practice is to err much more toward the former extreme -- we don't like to exclude versions of dependencies unless we have good reason to think that they won't work. Documenting this and deciding whether to change it, is the topic of #1452. (gdt had some good suggestions on that ticket.)

So as far as I understand, to change our requirement on zope.interface in keeping with our current practice would be to set it to zope.interface < 3.6.4, > 3.6.4. The previous release had no constraint at all on which version of zope.interface: [_auto_deps.py rev 5069 line 17]source:trunk/src/allmydata/_auto_deps.py?annotate=blame&rev=5069#L17

Why not `zope.interface < 3.6.4, > 3.6.4`? I just tried it in a little test project, the complete contents of which are this `setup.py` file: ``` from setuptools import setup setup(name="testeee", install_requires=["zope.interface < 3.6.4, > 3.6.4"]) ``` It worked as expected, whether `zope.interface` 3.6.1 was installed, `zope.interface` 3.6.4 was installed, or no `zope.interface` at all was installed. This was using `distribute v0.6.15` (Ubuntu 11.04 Natty). There are trade-offs between more missed alarms (in the extreme, allowing all versions except ones that we know don't work) and more false alarms (in the extreme, forbidding all versions except ones that we know work). Our current practice is to err much more toward the former extreme -- we don't like to exclude versions of dependencies unless we have good reason to think that they won't work. Documenting this and deciding whether to change it, is the topic of #1452. (gdt had some good suggestions on that ticket.) So as far as I understand, to change our requirement on `zope.interface` in keeping with our current practice would be to set it to `zope.interface < 3.6.4, > 3.6.4`. The previous release had no constraint at all on which version of `zope.interface`: [_auto_deps.py rev 5069 line 17]source:trunk/src/allmydata/_auto_deps.py?annotate=blame&rev=5069#L17

zooko commented

2011-08-14 03:11:57 +00:00

Oh, I overlooked that 3.6.3 is also incompatible, so I propose zope.interface < 3.6.3, > 3.6.4.

Oh, I overlooked that `3.6.3` is also incompatible, so I propose `zope.interface < 3.6.3, > 3.6.4`.

daira commented

2011-08-14 03:37:56 +00:00

Author

Replying to zooko:

So as far as I understand, to change our requirement on zope.interface in keeping with our current practice would be to set it to zope.interface < 3.6.4, > 3.6.4. The previous release had no constraint at all on which version of zope.interface: [_auto_deps.py rev 5069 line 17]source:trunk/src/allmydata/_auto_deps.py?annotate=blame&rev=5069#L17

Well, that was almost certainly wrong. There must be some minimum version of zope.interface that we rely on; it's just that we don't know what it is.

I don't think we should have any requirements where the version is unconstrained. The lack of constraint on the versions of pyOpenSSL and mock is also almost certainly wrong.

Replying to [zooko](/tahoe-lafs/trac/issues/1435#issuecomment-385409): > So as far as I understand, to change our requirement on `zope.interface` in keeping with our current practice would be to set it to `zope.interface < 3.6.4, > 3.6.4`. The previous release had no constraint at all on which version of `zope.interface`: [_auto_deps.py rev 5069 line 17]source:trunk/src/allmydata/_auto_deps.py?annotate=blame&rev=5069#L17 Well, that was almost certainly wrong. There must be *some* minimum version of zope.interface that we rely on; it's just that we don't know what it is. I don't think we should have any requirements where the version is unconstrained. The lack of constraint on the versions of pyOpenSSL and mock is also almost certainly wrong.

zooko commented

2011-08-14 04:46:05 +00:00

Replying to [davidsarah]comment:15:

Well, that was almost certainly wrong. There must be some minimum version of zope.interface that we rely on; it's just that we don't know what it is.

Maybe so, but changing that is the subject of #1452. This ticket is about avoiding the incompatibility between zope.interface and Nevow.

Replying to [davidsarah]comment:15: > > Well, that was almost certainly wrong. There must be *some* minimum version of zope.interface that we rely on; it's just that we don't know what it is. Maybe so, but changing that is the subject of #1452. This ticket is about avoiding the incompatibility between `zope.interface` and `Nevow`.

daira commented

2011-08-14 15:05:23 +00:00

Author

Replying to [zooko]comment:16:

Replying to [davidsarah]comment:15:

Well, that was almost certainly wrong. There must be some minimum version of zope.interface that we rely on; it's just that we don't know what it is.

Maybe so, but changing that is the subject of #1452. This ticket is about avoiding the incompatibility between zope.interface and Nevow.

True, but there's little point in changing the requirement to < 3.6.3, > 3.6.4, and then changing it back to essentially what is in attachment:relax-zope-interface-requirement.darcs.patch. If we're going to do the latter then we might as well do it now.

Note that there is no way to express a constraint "(version >= x and version < y) or version >= z" directly, other than by listing the versions from x to y.

Replying to [zooko]comment:16: > Replying to [davidsarah]comment:15: > > > > Well, that was almost certainly wrong. There must be *some* minimum version of zope.interface that we rely on; it's just that we don't know what it is. > > Maybe so, but changing that is the subject of #1452. This ticket is about avoiding the incompatibility between `zope.interface` and `Nevow`. True, but there's little point in changing the requirement to `< 3.6.3, > 3.6.4`, and then changing it back to essentially what is in [attachment:relax-zope-interface-requirement.darcs.patch](/tahoe-lafs/trac/attachments/000078ac-5a21-19b6-e178-41819a63c56c). If we're going to do the latter then we might as well do it now. Note that there is no way to express a constraint "`(version >= x and version < y) or version >= z`" directly, other than by listing the versions from x to y.

zooko commented

2011-08-14 15:49:33 +00:00

Replying to [davidsarah]comment:17:

True, but there's little point in changing the requirement to < 3.6.3, > 3.6.4, and then changing it back to essentially what is in attachment:relax-zope-interface-requirement.darcs.patch. If we're going to do the latter then we might as well do it now.

In my opinion we should not try to address #1452 for Tahoe-LAFS v1.9. I think we should commit a patch that fixes this ticket (working-around the incompatibility between zope.interface and Nevow), but which does not change our current policy of loose version requirements, and save that latter discussion for after v1.9.

Note that this is has immediate practical consequences--Brian was annoyed and delayed recently when working on the train because an earlier patch on this ticket had tightened the requirements of zope.interface beyond what it needed to. (Brian had an older, but perfectly functional, version of zope.interface installed.)

Replying to [davidsarah]comment:17: > > True, but there's little point in changing the requirement to `< 3.6.3, > 3.6.4`, and then changing it back to essentially what is in [attachment:relax-zope-interface-requirement.darcs.patch](/tahoe-lafs/trac/attachments/000078ac-5a21-19b6-e178-41819a63c56c). If we're going to do the latter then we might as well do it now. In my opinion we should not try to address #1452 for Tahoe-LAFS v1.9. I think we should commit a patch that fixes this ticket (working-around the incompatibility between `zope.interface` and `Nevow`), but which does *not* change our current policy of loose version requirements, and save that latter discussion for after v1.9. Note that this is has immediate practical consequences--Brian was annoyed and delayed recently when working on the train because an earlier patch on this ticket had tightened the requirements of `zope.interface` beyond what it needed to. (Brian had an older, but perfectly functional, version of `zope.interface` installed.)

daira commented

2011-08-15 03:31:37 +00:00

Author

Running the test suite with zope.interface 3.6.5 results in these failures, due to a warning that needs to be suppressed:

[FAIL]: allmydata.test.test_runner.BinTahoe.test_version_no_noise

Traceback (most recent call last):
  File "/home/davidsarah/tahoe/snotty/src/allmydata/test/test_runner.py", line 207, in _cb
    and "from pkg_resources import load_entry_point" not in line)], str(res))
twisted.trial.unittest.FailTest: ('allmydata-tahoe: 1.8.2-r5156,\nfoolscap: 0.6.1,\npycryptopp: 0.5.25,\nzfec: 1.4.5,\nTwisted: 10.1.0,\nNevow: 0.10.0,\nzope.interface: unknown,\npython: 2.6.6,\nplatform: Linux-Ubuntu_10.10-x86_64-64bit_ELF,\npyOpenSSL: 0.10,\nsimplejson: 2.1.1,\npycrypto: 2.0.1,\npyasn1: unknown,\nmock: 0.8.0beta3,\nsqlite3: 2.4.1 [sqlite 3.7.2],\nsetuptools: 0.6c16dev3\n\n', "/home/davidsarah/tahoe/snotty/support/lib/python2.6/site-packages/zope.interface-3.6.5-py2.6-linux-x86_64.egg/zope/interface/interface.py:688: UserWarning: Hashing uninitialized InterfaceClass instance\n  warnings.warn('Hashing uninitialized InterfaceClass instance')\n", 0)
===============================================================================
[FAIL]: allmydata.test.test_runner.RunNode.test_client_no_noise

Traceback (most recent call last):
  File "/home/davidsarah/tahoe/snotty/src/allmydata/test/test_runner.py", line 511, in _cb2
    and "from pkg_resources import load_entry_point" not in line)], errstr)
twisted.trial.unittest.FailTest: cc=0, OUT: '', ERR: '/home/davidsarah/tahoe/snotty/support/lib/python2.6/site-packages/zope.interface-3.6.5-py2.6-linux-x86_64.egg/zope/interface/interface.py:688: UserWarning: Hashing uninitialized InterfaceClass instance
  warnings.warn('Hashing uninitialized InterfaceClass instance')
'
===============================================================================
[FAIL]: allmydata.test.test_system.SystemTest.test_filesystem_with_cli_in_subprocess

Traceback (most recent call last):
  File "/home/davidsarah/tahoe/snotty/src/allmydata/test/test_system.py", line 1761, in _check_succeeded
    self.failUnlessEqual(err, "")
twisted.trial.unittest.FailTest: not equal:
a = "/home/davidsarah/tahoe/snotty/support/lib/python2.6/site-packages/zope.interface-3.6.5-py2.6-linux-x86_64.egg/zope/interface/interface.py:688: UserWarning: Hashing uninitialized InterfaceClass instance\n  warnings.warn('Hashing uninitialized InterfaceClass instance')\n"
b = ''

Running the test suite with zope.interface 3.6.5 results in these failures, due to a warning that needs to be suppressed: ``` [FAIL]: allmydata.test.test_runner.BinTahoe.test_version_no_noise Traceback (most recent call last): File "/home/davidsarah/tahoe/snotty/src/allmydata/test/test_runner.py", line 207, in _cb and "from pkg_resources import load_entry_point" not in line)], str(res)) twisted.trial.unittest.FailTest: ('allmydata-tahoe: 1.8.2-r5156,\nfoolscap: 0.6.1,\npycryptopp: 0.5.25,\nzfec: 1.4.5,\nTwisted: 10.1.0,\nNevow: 0.10.0,\nzope.interface: unknown,\npython: 2.6.6,\nplatform: Linux-Ubuntu_10.10-x86_64-64bit_ELF,\npyOpenSSL: 0.10,\nsimplejson: 2.1.1,\npycrypto: 2.0.1,\npyasn1: unknown,\nmock: 0.8.0beta3,\nsqlite3: 2.4.1 [sqlite 3.7.2],\nsetuptools: 0.6c16dev3\n\n', "/home/davidsarah/tahoe/snotty/support/lib/python2.6/site-packages/zope.interface-3.6.5-py2.6-linux-x86_64.egg/zope/interface/interface.py:688: UserWarning: Hashing uninitialized InterfaceClass instance\n warnings.warn('Hashing uninitialized InterfaceClass instance')\n", 0) =============================================================================== [FAIL]: allmydata.test.test_runner.RunNode.test_client_no_noise Traceback (most recent call last): File "/home/davidsarah/tahoe/snotty/src/allmydata/test/test_runner.py", line 511, in _cb2 and "from pkg_resources import load_entry_point" not in line)], errstr) twisted.trial.unittest.FailTest: cc=0, OUT: '', ERR: '/home/davidsarah/tahoe/snotty/support/lib/python2.6/site-packages/zope.interface-3.6.5-py2.6-linux-x86_64.egg/zope/interface/interface.py:688: UserWarning: Hashing uninitialized InterfaceClass instance warnings.warn('Hashing uninitialized InterfaceClass instance') ' =============================================================================== [FAIL]: allmydata.test.test_system.SystemTest.test_filesystem_with_cli_in_subprocess Traceback (most recent call last): File "/home/davidsarah/tahoe/snotty/src/allmydata/test/test_system.py", line 1761, in _check_succeeded self.failUnlessEqual(err, "") twisted.trial.unittest.FailTest: not equal: a = "/home/davidsarah/tahoe/snotty/support/lib/python2.6/site-packages/zope.interface-3.6.5-py2.6-linux-x86_64.egg/zope/interface/interface.py:688: UserWarning: Hashing uninitialized InterfaceClass instance\n warnings.warn('Hashing uninitialized InterfaceClass instance')\n" b = '' ```

zooko was unassigned by daira

2011-08-15 03:31:37 +00:00

daira self-assigned this 2011-08-15 03:31:37 +00:00

daira commented

2011-08-15 04:02:54 +00:00

Author

Attachment relax-zope-interface-requirement-2.darcs.patch (35697 bytes) added

_auto_deps.py: change the requirement for zope.interface to <= 3.6.2, >= 3.6.6. fixes #1435

**Attachment** relax-zope-interface-requirement-2.darcs.patch (35697 bytes) added _auto_deps.py: change the requirement for zope.interface to <= 3.6.2, >= 3.6.6. fixes #1435

relax-zope-interface-requirement-2.darcs.patch

35 KiB

daira commented

2011-08-15 04:09:56 +00:00

Author

zope.interface 3.6.6 doesn't fail due to the warning (I confirmed by grepping its source that 3.6.6 doesn't raise any warnings at all).

I'm fine with "<= 3.6.2, >= 3.6.6" for the Tahoe v1.9 release, although I still think we will end up changing the minimum zope.interface version to 3.3.1 (there was a bug that affects Python 2.5 support immediately before that, according to the changelog).

Note that the <= and >= constraints are correct because we don't know which post-3.6.2 version introduced the incompatibility, or which pre-3.6.6 version removed the UserWarning.

zope.interface 3.6.6 doesn't fail due to the warning (I confirmed by grepping its source that 3.6.6 doesn't raise any warnings at all). I'm fine with "`<= 3.6.2, >= 3.6.6`" for the Tahoe v1.9 release, although I still think we will end up changing the minimum zope.interface version to 3.3.1 (there was a bug that affects Python 2.5 support immediately before that, according to the changelog). Note that the `<=` and `>=` constraints are correct because we don't know which post-3.6.2 version introduced the incompatibility, or which pre-3.6.6 version removed the `UserWarning`.

daira removed their assignment 2011-08-15 04:09:56 +00:00

zooko was assigned by daira

2011-08-15 04:09:56 +00:00

daira commented

2011-08-15 05:00:18 +00:00

Author

Attachment make-version-parsing-understand-le.darcs.patch (38944 bytes) added

allmydata/init.py, test_version.py: make version parsing understand '<=', with test. refs #1435

**Attachment** make-version-parsing-understand-le.darcs.patch (38944 bytes) added allmydata/*init*.py, test_version.py: make version parsing understand '<=', with test. refs #1435

make-version-parsing-understand-le.darcs.patch

38 KiB

daira commented

2011-08-15 05:04:20 +00:00

Author

attachment:relax-zope-interface-requirement-2.darcs.patch causes a spurious failure unless attachment:make-version-parsing-understand-le.darcs.patch is applied as well. (Actually, since zope.interface doesn't declare its version, we are unable to check it, but we need to be able to parse '<=' in a requirement in order to get to the point where we know that.)

[attachment:relax-zope-interface-requirement-2.darcs.patch](/tahoe-lafs/trac/attachments/000078ac-5a21-19b6-e178-ba0131cb415e) causes a spurious failure unless [attachment:make-version-parsing-understand-le.darcs.patch](/tahoe-lafs/trac/attachments/000078ac-5a21-19b6-e178-58cc8c032581) is applied as well. (Actually, since zope.interface doesn't declare its version, we are unable to check it, but we need to be able to parse '<=' in a requirement in order to get to the point where we know that.)

zooko commented

2011-08-15 22:12:58 +00:00

+1 on attachment:make-version-parsing-understand-le.darcs.patch and attachment:relax-zope-interface-requirement-2.darcs.patch.

+1 on [attachment:make-version-parsing-understand-le.darcs.patch](/tahoe-lafs/trac/attachments/000078ac-5a21-19b6-e178-58cc8c032581) and attachment:relax-zope-interface-requirement-2.darcs.patch.

daira commented

2011-08-15 22:44:52 +00:00

Author

In changeset:a48aee11b3ba7636:

allmydata/__init__.py, test_version.py: make version parsing understand '<=', with test. refs #1435

In changeset:a48aee11b3ba7636: ``` allmydata/__init__.py, test_version.py: make version parsing understand '<=', with test. refs #1435 ```

daira commented

2011-08-15 22:44:53 +00:00

Author

In changeset:a98a4ec13f3353aa:

_auto_deps.py: change the requirement for zope.interface to <= 3.6.2, >= 3.6.6. fixes #1435

In changeset:a98a4ec13f3353aa: ``` _auto_deps.py: change the requirement for zope.interface to <= 3.6.2, >= 3.6.6. fixes #1435 ```

daira added the

r/fixed

label 2011-08-15 22:44:53 +00:00

daira closed this issue

2011-08-15 22:44:53 +00:00

daira commented

2011-08-16 22:55:02 +00:00

Author

In [5189/ticket393-MDMF-2]:

allmydata/__init__.py, test_version.py: make version parsing understand '<=', with test. refs #1435

In [5189/ticket393-MDMF-2]: ``` allmydata/__init__.py, test_version.py: make version parsing understand '<=', with test. refs #1435 ```

daira commented

2011-08-16 22:55:02 +00:00

Author

In [5190/ticket393-MDMF-2]:

_auto_deps.py: change the requirement for zope.interface to <= 3.6.2, >= 3.6.6. fixes #1435

In [5190/ticket393-MDMF-2]: ``` _auto_deps.py: change the requirement for zope.interface to <= 3.6.2, >= 3.6.6. fixes #1435 ```

zooko commented

2011-08-17 18:29:09 +00:00

That UserWarning is zope.interface warning about the poor behavior that Nevow does which caused this bug in the first place and that zope.interface currently works around. So I would expect that UserWarning to be present in newer version of zope.interface when used with Nevow 0.10.0.

Indeed, it fails with zope.interface 3.7.0:

allmydata.test.test_runner.RunNode.test_client_no_noise
===============================================================================
[FAIL]
Traceback (most recent call last):
  File "/home/zooko/playground/tahoe-lafs/393-2/src/allmydata/test/test_system.py", line 1766, in _check_succeeded
    self.failUnlessEqual(err, "")
twisted.trial.unittest.FailTest: not equal:
a = "/usr/local/lib/python2.7/dist-packages/zope.interface-3.7.0-py2.7-linux-x86_64.egg/zope/interface/interface.py:688: UserWarning: Hashing uninitialized InterfaceClass instance\n  warnings.warn('Hashing uninitialized InterfaceClass instance')\n"
b = ''

So, we should probably suppress that UserWarning and relax the requirement on zope.interface to <= 3.6.2, >= 3.6.5.

That `UserWarning` is `zope.interface` warning about the poor behavior that `Nevow` does which caused this bug in the first place and that `zope.interface` currently works around. So I would expect that `UserWarning` to be present in newer version of `zope.interface` when used with `Nevow` 0.10.0. Indeed, it fails with `zope.interface` 3.7.0: ``` allmydata.test.test_runner.RunNode.test_client_no_noise =============================================================================== [FAIL] Traceback (most recent call last): File "/home/zooko/playground/tahoe-lafs/393-2/src/allmydata/test/test_system.py", line 1766, in _check_succeeded self.failUnlessEqual(err, "") twisted.trial.unittest.FailTest: not equal: a = "/usr/local/lib/python2.7/dist-packages/zope.interface-3.7.0-py2.7-linux-x86_64.egg/zope/interface/interface.py:688: UserWarning: Hashing uninitialized InterfaceClass instance\n warnings.warn('Hashing uninitialized InterfaceClass instance')\n" b = '' ``` So, we should probably suppress that `UserWarning` and relax the requirement on `zope.interface` to `<= 3.6.2, >= 3.6.5`.

zooko removed the

r/fixed

label 2011-08-17 18:29:09 +00:00

zooko reopened this issue

2011-08-17 18:29:09 +00:00

zooko commented

2011-08-17 20:50:20 +00:00

In changeset:f627af3b9fbe2975:

suppress warning emitted by newer zope.interface with Nevow 0.10
refs #1435

In changeset:f627af3b9fbe2975: ``` suppress warning emitted by newer zope.interface with Nevow 0.10 refs #1435 ```

zooko added the

r/fixed

label 2011-08-17 20:52:51 +00:00

zooko closed this issue

2011-08-17 20:52:51 +00:00

daira commented

2011-08-18 05:15:57 +00:00

Author

Attachment cleanup-userwarnings.darcs.patch (37249 bytes) added

Cleanups for suppression of UserWarnings. refs #1435

**Attachment** cleanup-userwarnings.darcs.patch (37249 bytes) added Cleanups for suppression of [UserWarnings](wiki/UserWarnings). refs #1435

cleanup-userwarnings.darcs.patch

36 KiB

daira removed the

r/fixed

label 2011-08-18 05:16:53 +00:00

daira reopened this issue

2011-08-18 05:16:53 +00:00

zooko commented

2011-08-18 05:26:44 +00:00

+1 on attachment:cleanup-userwarnings.darcs.patch. I wonder why you didn't use darcs replace deprecation_imports warning_imports src/allmydata/*init*.py.

+1 on attachment:cleanup-userwarnings.darcs.patch. I wonder why you didn't use `darcs replace deprecation_imports warning_imports src/allmydata/*init*.py`.

daira commented

2011-08-18 05:27:20 +00:00

Author

In changeset:c41bf1402944057b:

Cleanups for suppression of UserWarnings. refs #1435

In changeset:c41bf1402944057b: ``` Cleanups for suppression of UserWarnings. refs #1435 ```

zooko added the

r/fixed

label 2011-08-18 05:32:14 +00:00

zooko closed this issue

2011-08-18 05:32:14 +00:00

No labels

c/code-frontend-ftp-sftp

c/code-frontend-magic-folder

kw:DeadReferenceError

kw:DoS

kw:FileZilla

kw:GetLastError

kw:IFinishableConsumer

kw:UncoordinatedWriteError

kw:accounting-crawler

kw:backward-compatibility

kw:blocks-cloud-deployment

kw:blocks-cloud-merge

kw:blocks-magic-folder-merge

kw:brians-opinion-needed

kw:desert-island-build

kw:design

kw:design-review-needed

kw:detection

kw:dev-infrastructure

kw:forward-compatibility

kw:garbage-collection

kw:google-cloud-storage

kw:google-drive-backend

kw:interstellar-exploration

kw:manual-test-needed

kw:notifyOnDisconnect

kw:otf-magic-folder-objective1

kw:otf-magic-folder-objective2

kw:otf-magic-folder-objective3

kw:otf-magic-folder-objective4

kw:otf-magic-folder-objective5

kw:otf-magic-folder-objective6

kw:servers-of-happiness

kw:tahoe-create-alias

kw:tahoe-create-introducer

kw:tahoe-debug

kw:tahoe-deep-check

kw:tahoe-deepcheck

kw:tahoe-lafs-trac-stream

kw:tahoe-list-aliases

kw:tahoe-ls

kw:tahoe-magic-folder

kw:ticket999-s3-backend

kw:to-be-closed-on-2011-08-01

kw:uncoordinated-writes

kw:undeletable

kw:unfinished-business

kw:warners-opinion-needed

kw:zookos-opinion-needed

r/somebody else's problem

No milestone

No project

No assignees

2 participants

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: tahoe-lafs/trac#1435

No description provided.