Difference between pages "KVM" and "Zope HOWTO"

From Funtoo
(Difference between pages)
Jump to navigation Jump to search
m (tt 2 code, /etc/kvm to /dev/kvm, add gpasswd, fancy to not so much, a bunch of nit picking)
 
m (Updated some of the syntax on the page.)
 
Line 1: Line 1:
This page documents how to use Zope with Funtoo Experimental, which currently has good Zope support thanks to [[Progress Overlay Python]] integration.


== Introduction ==
== About Zope ==


KVM is a hardware-accelerated full-machine hypervisor and virtualization solution included as part of kernel 2.6.20 and later. It allows you to create and start hardware-accelerated virtual machines under Linux using the QEMU tools.
Zope is an Open Source application server framework written in Python. It has an interesting history which you should familiarize yourself with before starting Zope development, as it contains several interesting twists and turns.


== Kernel Setup ==
=== Zope History ===


To enable KVM, the following kernel config parameters should be enabled (this is based on a 3.x kernel):
{{Note|This HOWTO targets Zope 2.13, which includes Five. It is typically the version you should be using for new Zope projects.}}


Under <code>Processor type and features</code>, enable <code>Linux guest support</code>, and enable the following options:
* There are two versions of Zope: Zope 2 and Zope 3. One might assume that Zope 3 is the version that people should use for new software development projects by default, but this is not the case. Most Zope-based projects continue to use Zope 2. Zope 3 was an attempt to redesign Zope 2 from scratch, and is completely different from Zope 2, but it was not adopted by the community.


{{kernelop|title=Processor type and features,Linux guest support|desc=
* There is also something called [http://codespeak.net/z3/five/ Five] (named because it is "2 + 3") that backports many of the new features of Zope 3 into the Zope 2 framework. Several projects will use Zope 2 plus Five in order to use some of the newer features in Zope. Five was merged into mainline Zope 2 in early 2010, and first appeared in Zope 2.8.
--- Linux guest support
 
[*]   Enable paravirtualization code
* You can learn more about the history of Zope 2, 3 and Five in the [http://svn.zope.org/Zope/trunk/src/Products/Five/README.txt?view=markup Five README].
[ ]     paravirt-ops debugging (NEW)
 
[*]     Paravirtualization layer for spinlocks
* To make things even more interesting, work on [http://docs.zope.org/zope2/releases/4.0/ Zope 4] is underway, and it will be based on 2.13 rather than 3.x. It includes a number of [http://docs.zope.org/zope2/releases/4.0/CHANGES.html#restructuring incompatible changes] with prior versions.
[ ]     Xen guest support (NEW)
=== Zope Resources ===
[*]   KVM Guest support (including kvmclock) (NEW)
 
[ ]     Enable debug information for KVM Guests in debugfs (NEW)
Now that you understand what version of Zope you should be targeting (2.13), we can point you towards the correct documentation :)
[ ]   Paravirtual steal time accounting (NEW)
 
; '''[http://docs.zope.org/zope2/zope2book/ The Zope 2 Book]'''
: This book provides a general introduction to Zope concepts and ZMI. It is a good place to start, but doesn't provide a direct introduction to Zope development. It's recommended that you skim through this book to familiarize yourself with Zope. It generally does not assume much prior knowledge about Web development or Python.
; '''[http://docs.zope.org/zope2/zdgbook/ Zope Developer's Guide]'''
: This guide will give you a better introduction to Zope development. It assumes you already know Python. Skip chapters 1 and 2 and start in [http://docs.zope.org/zope2/zdgbook/ComponentsAndInterfaces.html chapter 3], which covers components and interfaces. [http://docs.zope.org/zope2/zdgbook/Products.html Chapter 5] covers the creation of your first product.
; '''[http://codespeak.net/z3/five/manual.html The Five Manual]'''
: We're not done yet. There is a bunch of stuff in Zope 2.13 that is not in the official documentation. Namely, the stuff in Five.
; '''[http://docs.zope.org/ztkpackages.html ZTK Documentation]'''
: ZTK 
; '''ZCA'''
: [http://www.muthukadan.net/docs/zca.html A Comprehensive Guide to Zope Component Architecture] offers a good introduction to the programming concepts of ZCA. We also have a new page on [[Zope Component Architecture]] which will help you to understand the big picture of ZCA and why it is useful. ZCML ("Z-camel") is a part of ZCA and  was introduced in Zope 3, so typically you will find ZCML documented within Zope 3 documentation and book.
; '''Content Components'''
: Views and Viewlets: [http://docs.zope.org/zope.viewlet/index.html This tutorial on viewlets] also contains some viewlet-related ZCML examples near the end. The "Content Component way" of developing in Zope seems to be a Zope 3 thing and tied to ZCML. Chapter 13+ of Stephan Richter's ''Zope 3 Developer's Handbook'' (book) seems to cover this quite well. You will probably also want to check out Philipp Weitershausen's ''Web Component Development with Zope 3'' (book).
; '''[http://wiki.zope.org/zope2/Zope2Wiki Zope 2 Wiki]'''
: Main wiki page for all things related to Zope 2.
; '''[http://docs.zope.org docs.zope.org]'''
: This is the main site for Zope documentation.
 
== First Steps ==
 
First, you will need to emerge {{Package|net-zope/zope}}:
{{console|body=
###i## emerge zope
}}
}}
Zope is now installed.


== Project Skeleton ==


Under the <code>Virtualization</code> category from the main kernel config menu, enable <code>Kernel-based Virtual Machine (KVM) support</code>, and enable at least one type of KVM, either for Intel or AMD processors. It is also recommended to enable <code>Host kernel acceleration for virtio net</code>.
{{Note|Zope should be run by a regular user account, not as the root user.}}
 
The first step in using Zope is to ensure that you are using a regular user account. As a regular user, create a new directory called {{c|zope_test}}:
{{console|body=
$##bl## cd
$##bl## mkdir zope_test
}}
Now, enter the directory, and create an "instance", which is a set of files and directories that are used to contain a Zope project:
{{console|body=
$##bl## cd zope_test
$##bl## /usr/lib/zope-2.13/bin/mkzopeinstance
}}
You will see the following output and will be prompted to answer a few questions:
{{console|body=
Please choose a directory in which you'd like to install
Zope "instance home" files such as database files, configuration
files, etc.
 
Directory: instance
Please choose a username and password for the initial user.
These will be the credentials you use to initially manage
your new Zope instance.
 
Username: admin
Password: ****
Verify password: ****
}}
Now, we will start our Zope instance:
{{console|body=
$##bl## cd instance
$##bl## bin/runzope
}}
Now that Zope is functional, you can go to the {{c|localhost:8080/manage}} URL in your web browser: you will be prompted to log in. Enter the username and password you specified. You are now logged in to the ZMI (Zope Management Interface.)


{{kernelop|title=Virtualization|desc=
You can stop your application by pressing Control-C. In the future, you can start and stop your Zope instance using the following commands:
--- Virtualization
{{console|body=
<M>  Kernel-based Virtual Machine (KVM) support
$##bl## zopectl start
<M>    KVM for Intel processors support
$##bl## zopectl stop
<M>    KVM for AMD processors support
[*]    KVM legacy PCI device assignment support
<M>  Host kernel accelerator for virtio net
}}
}}
{{Note|{{c|zopectl start}} will cause your instance to run in the background rather than consuming a shell console.}}
== First Project ==
We will create a single, very primitive Zope package, consisting of an Interface for a TODO class, and a TODO class.
Create the following files and directories relative to your project root:


* Create the directory {{c|lib/python/example}}.
* Create the file {{c|lib/python/example/__init__.py}} by typing {{c|touch lib/python/example/__init__.py}}.
* Create these files:


You can use modules or build these parts directly into the kernel. Build your new kernel and modules, and reboot.
=== {{c|example-configure.zcml}} ===


== User-space tools ==
This file registers the {{c|example}} directory you created in {{c|lib/python}} as a ''package'', so that it is seen by Zope. Edit {{c|/etc/package-includes/example-configure.zcml}}:
{{file|name=/etc/package-includes/example-configure.zcml|body=
<include package="example" />
}}


If you are using QEMU on your desktop, add the following USE flag to <code>/etc/portage/make.conf</code>:
=== {{c|interfaces.py}} ===


<pre>
The following file defines the <tt>ITODO</tt> interface, and also uses some Zope Schema functions to define what kind of data we expect to store in objects that implement <tt>ITODO</tt>. Edit <code>/lib/python/example/interfaces.py</code> with your favorite text editor:
USE="$USE usbredir"
</pre>
This will enable good mouse support for QEMU on your desktop.


Now, emerge qemu:
<syntaxhighlight lang="python">
from zope.interface import Interface
from zope.schema import List, Text, TextLine, Int


<console>
class ITODO(Interface):
# ##i## emerge qemu
    name = TextLine(title=u'Name', required=True)
</console>
    todo = List(title=u"TODO Items", required=True, value_type=TextLine(title=u'TODO'))
    daysleft = Int(title=u'Days left to complete', required=True)
    description = Text(title=u'Description', required=True)
</syntaxhighlight>


==Initial Setup==
=== {{c|TODO.py}} ===


Prior to using KVM, modprobe the appropriate accelerated driver for Intel or AMD:
Now, we define {{c|TODO}} to be a ''persistent'' object, meaning it can be stored in the ZODB. We specify that it implements our previously-defined {{c|ITODO}} interface, and provide reasonable defaults for all values when we create a new TODO object. Edit {{c|/lib/python/example/TODO.py}} using your favorite text editor:
{{file|name=/lib/python/example/TODO.py|lang=python|body=
from persistent import Persistent
from zope.interface import implements
from example.interfaces import ITODO


<console>
class TODO(Persistent):
# ##i##modprobe kvm_intel
    implements(ITODO)
</console>
    name = u''
    todo = []
    daysleft = 0
    description = u''
}}


== Next Steps ==
=== {{c|configure.zcml}} ===


{{important|Before using KVM, be sure that your user account is in the <code>kvm</code> group. You will need to use a command such as <code>vigr</code> or <code>gpasswd -a $USER kvm</code> as root to do this, and then log out and log back in for this to take effect.}}
Create the <tt>/lib/python/example/configure.zcml</tt> configuration file:
<syntaxhighlight lang="xml">
<configure xmlns="http://namespaces.zope.org/zope"
    xmlns:five="http://namespaces.zope.org/five"
    xmlns:browser="http://namespaces.zope.org/browser">
</configure>
</syntaxhighlight>


{{important|Atm the group <code>kvm</code> has no access to /dev/kvm. Change this with
== Debug Mode ==
chown root:kvm /dev/kvm
chmod g+rw /dev/kvm
and kvm will start like expected [https://bugs.funtoo.org/browse/FL-1626 (see bug FL-1626)] }}


For information on how to use KVM with various operating systems, see:
We can test our first project by entering debug mode:
<console>
$##i## bin/zopectl debug
Starting debugger (the name "app" is bound to the top-level Zope object)
</console>


* [[Windows 7 Virtualization with KVM]]
Now, let's try creating a new TODO object and writing it out to a ZODB database:
* [[Linux on KVM]]
<console>
>>> from ZODB import FileStorage, DB
>>> storage = FileStorage.FileStorage('mydatabase.fs')
>>> db = DB(storage)
>>> connection = db.open()
>>> import transaction
>>> root = connection.root()
>>> from example.TODO import TODO
>>> a = TODO
>>> a.name = u'My TODOs'
>>> a.TODOS = [ u'Do Laundry', u'Wash Dishes' ]
>>> a.daysleft = 1
>>> a.description = u'Things I need to do today.'
>>> root[u'today'] = a
>>> transaction.commit()
</console>


[[Category:Virtualization]]
[[Category:HOWTO]]
[[Category:KVM]]

Latest revision as of 17:32, June 25, 2015

This page documents how to use Zope with Funtoo Experimental, which currently has good Zope support thanks to Progress Overlay Python integration.

About Zope

Zope is an Open Source application server framework written in Python. It has an interesting history which you should familiarize yourself with before starting Zope development, as it contains several interesting twists and turns.

Zope History

   Note

This HOWTO targets Zope 2.13, which includes Five. It is typically the version you should be using for new Zope projects.

  • There are two versions of Zope: Zope 2 and Zope 3. One might assume that Zope 3 is the version that people should use for new software development projects by default, but this is not the case. Most Zope-based projects continue to use Zope 2. Zope 3 was an attempt to redesign Zope 2 from scratch, and is completely different from Zope 2, but it was not adopted by the community.
  • There is also something called Five (named because it is "2 + 3") that backports many of the new features of Zope 3 into the Zope 2 framework. Several projects will use Zope 2 plus Five in order to use some of the newer features in Zope. Five was merged into mainline Zope 2 in early 2010, and first appeared in Zope 2.8.
  • You can learn more about the history of Zope 2, 3 and Five in the Five README.
  • To make things even more interesting, work on Zope 4 is underway, and it will be based on 2.13 rather than 3.x. It includes a number of incompatible changes with prior versions.

Zope Resources

Now that you understand what version of Zope you should be targeting (2.13), we can point you towards the correct documentation :)

The Zope 2 Book
This book provides a general introduction to Zope concepts and ZMI. It is a good place to start, but doesn't provide a direct introduction to Zope development. It's recommended that you skim through this book to familiarize yourself with Zope. It generally does not assume much prior knowledge about Web development or Python.
Zope Developer's Guide
This guide will give you a better introduction to Zope development. It assumes you already know Python. Skip chapters 1 and 2 and start in chapter 3, which covers components and interfaces. Chapter 5 covers the creation of your first product.
The Five Manual
We're not done yet. There is a bunch of stuff in Zope 2.13 that is not in the official documentation. Namely, the stuff in Five.
ZTK Documentation
ZTK
ZCA
A Comprehensive Guide to Zope Component Architecture offers a good introduction to the programming concepts of ZCA. We also have a new page on Zope Component Architecture which will help you to understand the big picture of ZCA and why it is useful. ZCML ("Z-camel") is a part of ZCA and was introduced in Zope 3, so typically you will find ZCML documented within Zope 3 documentation and book.
Content Components
Views and Viewlets: This tutorial on viewlets also contains some viewlet-related ZCML examples near the end. The "Content Component way" of developing in Zope seems to be a Zope 3 thing and tied to ZCML. Chapter 13+ of Stephan Richter's Zope 3 Developer's Handbook (book) seems to cover this quite well. You will probably also want to check out Philipp Weitershausen's Web Component Development with Zope 3 (book).
Zope 2 Wiki
Main wiki page for all things related to Zope 2.
docs.zope.org
This is the main site for Zope documentation.

First Steps

First, you will need to emerge No results:

root # emerge zope

Zope is now installed.

Project Skeleton

   Note

Zope should be run by a regular user account, not as the root user.

The first step in using Zope is to ensure that you are using a regular user account. As a regular user, create a new directory called zope_test:

user $ cd
user $ mkdir zope_test

Now, enter the directory, and create an "instance", which is a set of files and directories that are used to contain a Zope project:

user $ cd zope_test
user $ /usr/lib/zope-2.13/bin/mkzopeinstance

You will see the following output and will be prompted to answer a few questions:

Please choose a directory in which you'd like to install
Zope "instance home" files such as database files, configuration
files, etc.

Directory: instance
Please choose a username and password for the initial user.
These will be the credentials you use to initially manage
your new Zope instance.

Username: admin
Password: ****
Verify password: ****

Now, we will start our Zope instance:

user $ cd instance
user $ bin/runzope

Now that Zope is functional, you can go to the localhost:8080/manage URL in your web browser: you will be prompted to log in. Enter the username and password you specified. You are now logged in to the ZMI (Zope Management Interface.)

You can stop your application by pressing Control-C. In the future, you can start and stop your Zope instance using the following commands:

user $ zopectl start
user $ zopectl stop
   Note

zopectl start will cause your instance to run in the background rather than consuming a shell console.

First Project

We will create a single, very primitive Zope package, consisting of an Interface for a TODO class, and a TODO class.

Create the following files and directories relative to your project root:

  • Create the directory lib/python/example.
  • Create the file lib/python/example/__init__.py by typing touch lib/python/example/__init__.py.
  • Create these files:

example-configure.zcml

This file registers the example directory you created in lib/python as a package, so that it is seen by Zope. Edit /etc/package-includes/example-configure.zcml:

   /etc/package-includes/example-configure.zcml
<include package="example" />

interfaces.py

The following file defines the ITODO interface, and also uses some Zope Schema functions to define what kind of data we expect to store in objects that implement ITODO. Edit /lib/python/example/interfaces.py with your favorite text editor:

from zope.interface import Interface
from zope.schema import List, Text, TextLine, Int

class ITODO(Interface):
    name = TextLine(title=u'Name', required=True)
    todo = List(title=u"TODO Items", required=True, value_type=TextLine(title=u'TODO'))
    daysleft = Int(title=u'Days left to complete', required=True)
    description = Text(title=u'Description', required=True)

TODO.py

Now, we define TODO to be a persistent object, meaning it can be stored in the ZODB. We specify that it implements our previously-defined ITODO interface, and provide reasonable defaults for all values when we create a new TODO object. Edit /lib/python/example/TODO.py using your favorite text editor:

   /lib/python/example/TODO.py (python source code)
from persistent import Persistent
from zope.interface import implements
from example.interfaces import ITODO

class TODO(Persistent):
    implements(ITODO)
    name = u''
    todo = []
    daysleft = 0
    description = u''

configure.zcml

Create the /lib/python/example/configure.zcml configuration file:

<configure xmlns="http://namespaces.zope.org/zope"
     xmlns:five="http://namespaces.zope.org/five"
     xmlns:browser="http://namespaces.zope.org/browser">
</configure>

Debug Mode

We can test our first project by entering debug mode:

user $ bin/zopectl debug
Starting debugger (the name "app" is bound to the top-level Zope object)

Now, let's try creating a new TODO object and writing it out to a ZODB database:

>>> from ZODB import FileStorage, DB
>>> storage = FileStorage.FileStorage('mydatabase.fs')
>>> db = DB(storage)
>>> connection = db.open()
>>> import transaction
>>> root = connection.root()
>>> from example.TODO import TODO
>>> a = TODO
>>> a.name = u'My TODOs'
>>> a.TODOS = [ u'Do Laundry', u'Wash Dishes' ]
>>> a.daysleft = 1
>>> a.description = u'Things I need to do today.'
>>> root[u'today'] = a
>>> transaction.commit()