[mayavi] can not build mayavi (#25959) anymore...

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

[mayavi] can not build mayavi (#25959) anymore...

fred-2
Hi all,

I can not build anymore Mayavi (#25959) on debian squeeze box.

Here's the traceback:

.../...
installing package data to build/bdist.linux-i686/egg
running install_data
Traceback (most recent call last):
   File "setup.py", line 302, in <module>
     **config
   File "/usr/lib/pymodules/python2.6/numpy/distutils/core.py", line
186, in setup
     return old_setup(**new_attr)
   File "/usr/lib/python2.6/distutils/core.py", line 152, in setup
     dist.run_commands()
   File "/usr/lib/python2.6/distutils/dist.py", line 975, in run_commands
     self.run_command(cmd)
   File "/usr/lib/python2.6/distutils/dist.py", line 995, in run_command
     cmd_obj.run()
   File
"/usr/lib/pymodules/python2.6/numpy/distutils/command/install.py", line
57, in run
     r = self.setuptools_run()
   File
"/usr/lib/pymodules/python2.6/numpy/distutils/command/install.py", line
51, in setuptools_run
     self.do_egg_install()
   File
"/usr/lib/python2.6/dist-packages/setuptools/command/install.py", line
93, in do_egg_install
     self.run_command('bdist_egg')
   File "/usr/lib/python2.6/distutils/cmd.py", line 333, in run_command
     self.distribution.run_command(command)
   File "/usr/lib/python2.6/distutils/dist.py", line 995, in run_command
     cmd_obj.run()
   File
"/usr/lib/python2.6/dist-packages/setuptools/command/bdist_egg.py", line
200, in run
     self.do_install_data()
   File
"/usr/lib/python2.6/dist-packages/setuptools/command/bdist_egg.py", line
150, in do_install_data
     self.call_command('install_data', force=0, root=None)
   File
"/usr/lib/python2.6/dist-packages/setuptools/command/bdist_egg.py", line
166, in call_command
     self.run_command(cmdname)
   File "/usr/lib/python2.6/distutils/cmd.py", line 333, in run_command
     self.distribution.run_command(command)
   File "/usr/lib/python2.6/distutils/dist.py", line 995, in run_command
     cmd_obj.run()
   File "setup.py", line 141, in run
     for project in list_doc_projects():
NameError: global name 'list_doc_projects' is not defined



Cheers,

--
Fred
_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev
Reply | Threaded
Open this post in threaded view
|

Re: [mayavi] can not build mayavi (#25959) anymore...

Anthony Scopatz
Hi Fred, 

You are getting this error because I removed that function yesterday in an effort to separate the building of docs from source building.

However, Mayavi builds fine on my system with 'python setup.py build'.  What command did you run?  How are you trying to build it?

Be Well
Anthony


On Tue, Nov 2, 2010 at 10:46 AM, Fred <[hidden email]> wrote:
Hi all,

I can not build anymore Mayavi (#25959) on debian squeeze box.

Here's the traceback:

.../...
installing package data to build/bdist.linux-i686/egg
running install_data
Traceback (most recent call last):
  File "setup.py", line 302, in <module>
    **config
  File "/usr/lib/pymodules/python2.6/numpy/distutils/core.py", line
186, in setup
    return old_setup(**new_attr)
  File "/usr/lib/python2.6/distutils/core.py", line 152, in setup
    dist.run_commands()
  File "/usr/lib/python2.6/distutils/dist.py", line 975, in run_commands
    self.run_command(cmd)
  File "/usr/lib/python2.6/distutils/dist.py", line 995, in run_command
    cmd_obj.run()
  File
"/usr/lib/pymodules/python2.6/numpy/distutils/command/install.py", line
57, in run
    r = self.setuptools_run()
  File
"/usr/lib/pymodules/python2.6/numpy/distutils/command/install.py", line
51, in setuptools_run
    self.do_egg_install()
  File
"/usr/lib/python2.6/dist-packages/setuptools/command/install.py", line
93, in do_egg_install
    self.run_command('bdist_egg')
  File "/usr/lib/python2.6/distutils/cmd.py", line 333, in run_command
    self.distribution.run_command(command)
  File "/usr/lib/python2.6/distutils/dist.py", line 995, in run_command
    cmd_obj.run()
  File
"/usr/lib/python2.6/dist-packages/setuptools/command/bdist_egg.py", line
200, in run
    self.do_install_data()
  File
"/usr/lib/python2.6/dist-packages/setuptools/command/bdist_egg.py", line
150, in do_install_data
    self.call_command('install_data', force=0, root=None)
  File
"/usr/lib/python2.6/dist-packages/setuptools/command/bdist_egg.py", line
166, in call_command
    self.run_command(cmdname)
  File "/usr/lib/python2.6/distutils/cmd.py", line 333, in run_command
    self.distribution.run_command(command)
  File "/usr/lib/python2.6/distutils/dist.py", line 995, in run_command
    cmd_obj.run()
  File "setup.py", line 141, in run
    for project in list_doc_projects():
NameError: global name 'list_doc_projects' is not defined



Cheers,

--
Fred
_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev


_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev
Reply | Threaded
Open this post in threaded view
|

Re: [mayavi] can not build mayavi (#25959) anymore...

Robert Kern
On Tue, Nov 2, 2010 at 10:56 AM, Anthony Scopatz <[hidden email]> wrote:
> Hi Fred,
> You are getting this error because I removed that function yesterday in an
> effort to separate the building of docs from source building.
> However, Mayavi builds fine on my system with 'python setup.py build'.  What
> command did you run?  How are you trying to build it?

bdist_egg, which runs install_data. That's why you do not see it if
you just run "python setup.py build".

Please note that Mayavi includes the documentation as package data.
That was the main reason setupdocs was included in the build process
to begin with. I think you need to revert your changes until we can
figure out a way that satisfies the various requirements.

--
Robert Kern

"I have come to believe that the whole world is an enigma, a harmless
enigma that is made terrible by our own mad attempt to interpret it as
though it had an underlying truth."
  -- Umberto Eco
_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev
Reply | Threaded
Open this post in threaded view
|

Re: [mayavi] can not build mayavi (#25959) anymore...

Anthony Scopatz
On Tue, Nov 2, 2010 at 12:19 PM, Robert Kern <[hidden email]> wrote:
On Tue, Nov 2, 2010 at 10:56 AM, Anthony Scopatz <[hidden email]> wrote:
> Hi Fred,
> You are getting this error because I removed that function yesterday in an
> effort to separate the building of docs from source building.
> However, Mayavi builds fine on my system with 'python setup.py build'.  What
> command did you run?  How are you trying to build it?

bdist_egg, which runs install_data. That's why you do not see it if
you just run "python setup.py build".

I see.  The problem was that there was a few errant lines that I forgot to take out that only ran under install_data.  I have updated the setup.py and the install should work now.

Be Well
Anthony
 
Please note that Mayavi includes the documentation as package data.
That was the main reason setupdocs was included in the build process
to begin with. I think you need to revert your changes until we can
figure out a way that satisfies the various requirements.

--
Robert Kern

"I have come to believe that the whole world is an enigma, a harmless
enigma that is made terrible by our own mad attempt to interpret it as
though it had an underlying truth."
  -- Umberto Eco
_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev


_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev
Reply | Threaded
Open this post in threaded view
|

Re: [mayavi] can not build mayavi (#25959) anymore...

Gael Varoquaux
On Tue, Nov 02, 2010 at 01:17:37PM -0500, Anthony Scopatz wrote:
>      bdist_egg, which runs install_data. That's why you do not see it if
>      you just run "python setup.py build".

>    I see. �The problem was that there was a few errant lines that I forgot to
>    take out that only ran under install_data. �I have updated the setup.py
>    and the install should work now.

But, as Robert pointed out, the docs will no longer be installed as
package_data, which means that we have lost functionnality by removing
setupdocs: it seems to me that the docs no longer get installed, and the
interactive help in the Mayavi application will no longer work.

Beside, I see that you have removed html.zip from Mayavi. This means that
the users will need to build the docs when installing Mayavi. It is
actually a task that can easily go wrong (we generate the part of the
documentation from the examples). We had spent a fair amount of time
making sure that setupdocs and the Mayavi setup.py could generate the
docs and save them in the zip file. This is why we were happy to ship the
html.zip as a fail-safe solution.

I welcome your changes, as I too felt that setupdocs was a bit heavy.
However, the reason it was heavy was that it answered to a set of
requirements that we do use in the codebase. It stayed, even though we
weren't fully happy with it, because we couldn't find time to engineer
another solution fulfilling these requirements. I am very happy to see
that you are taking time to replace it, but I must admit I don't
currently have time to work with you to build our requirements in your
solution, and I won't have any time before mid-January.

I should note that I coded a lighter-weight solution for adding the
html.zip in joblib, that can be found in
http://github.com/joblib/joblib/blob/master/setupegg.py
and
http://github.com/joblib/joblib/blob/master/setup.cfg
If it can be of any inspiration.

Ga�l

_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev
Reply | Threaded
Open this post in threaded view
|

Re: [mayavi] can not build mayavi (#25959) anymore...

Anthony Scopatz

On Tue, Nov 2, 2010 at 1:37 PM, Gael Varoquaux <[hidden email]> wrote:
On Tue, Nov 02, 2010 at 01:17:37PM -0500, Anthony Scopatz wrote:
>      bdist_egg, which runs install_data. That's why you do not see it if
>      you just run "python setup.py build".

>    I see.  The problem was that there was a few errant lines that I forgot to
>    take out that only ran under install_data.  I have updated the setup.py
>    and the install should work now.

But, as Robert pointed out, the docs will no longer be installed as
package_data, which means that we have lost functionnality by removing
setupdocs: it seems to me that the docs no longer get installed, and the
interactive help in the Mayavi application will no longer work.

Oh, ok.  I did not realize that there was an interactive help for Mayavi that depended on this and the html.zip.  To the best of my knowledge, Mayavi is the only package in ETS that has this dependency.  

For the moment, I will go ahead and revert these changes for just Mayavi.  The build-deploy ets_docs.py tool is still forthcoming and would not solve the above problem.  

I am very happy to see that you are taking time to replace it, but I must admit I don't currently have time to work with you to build our requirements in your solution, and I won't have any time before mid-January.

I think that we are trying to do two different, but related things.  I would like to see the documentation generation decoupled from the code building so that you don't have to rebuild both to get either.  You want the docs there at runtime, though I am a bit confused as to why Mayavi doesn't use docstrings for this.  In any event, I think we should revisit it in the future because we should try to remove SetupDocs from ETS if at all possible.
 
I should note that I coded a lighter-weight solution for adding the
html.zip in joblib, that can be found in
http://github.com/joblib/joblib/blob/master/setupegg.py
and
http://github.com/joblib/joblib/blob/master/setup.cfg
If it can be of any inspiration.

Thanks for the links!
Be Well
Anthony
 
Gaël

_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev



_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev
Reply | Threaded
Open this post in threaded view
|

Re: [mayavi] can not build mayavi (#25959) anymore...

Gael Varoquaux
Hey Anthony

On Tue, Nov 02, 2010 at 02:06:20PM -0500, Anthony Scopatz wrote:
>    I did not realize that there was an interactive help for Mayavi that
>    depended on this and the html.zip. �To the best of my knowledge,
>    Mayavi is the only package in ETS that has this dependency. � For
>    the moment, I will go ahead and revert these changes for just
>    Mayavi. �The build-deploy ets_docs.py tool is still forthcoming and
>    would not solve the above problem. �

I was that you have implemented a cleaner solution that, AFAICT, retains
all the functionality required for building the Mayavi docs.

That's really cool. Thanks a lot. I am very happy to get rid of the
dependency on SetupDocs. On top of that, I really appreciate the fact
while I am terribly busy elsewhere, you guys take care of Mayavi. Thanks
heaps!

By the way, what is the recommended way of uploading documentation
nowadays? I used to do this with the magic switches of SetupDocs.

Cheers,

Ga�l

_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev
Reply | Threaded
Open this post in threaded view
|

Re: [mayavi] can not build mayavi (#25959) anymore...

Anthony Scopatz
Hey Gaël!

I was that you have implemented a cleaner solution that, AFAICT, retains
all the functionality required for building the Mayavi docs.

Awesome! Great to hear.
 
That's really cool. Thanks a lot. I am very happy to get rid of the
dependency on SetupDocs. On top of that, I really appreciate the fact
while I am terribly busy elsewhere, you guys take care of Mayavi. Thanks
heaps!

No problem.  AFAICT Mayavi is very much a part of ETS and thus under our stewardship.  (Also, Ilan was basically begging for me to find a way to get rid of setupdocs ^_^  Even though it took me a couple of weeks of off and on work, I think we can consider the problem solved!)
 
By the way, what is the recommended way of uploading documentation
nowadays? I used to do this with the magic switches of SetupDocs.

Nowadays, the ets_doc.py file is finished and is the recommended way.  If you check out 'ETS' there is an ets_docs.py file which lives next to the script it is based on, ets.py.  Basically, what this does is checkout a current version of the website, rebuilds the documentation for all of the projects that have docs, copies these back into the website repository, commits the changes to the website repository, and finally logs into the website and does an update there remotely.  How to do this is explained in the help of ets_docs.py.  If you run into problems, let me know!

Be Well
Anthony
 
Cheers,

Gaël

_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev



_______________________________________________
Enthought-Dev mailing list
[hidden email]
https://mail.enthought.com/mailman/listinfo/enthought-dev